00:00:00.001 Started by upstream project "autotest-spdk-v24.01-LTS-vs-dpdk-v22.11" build number 1002 00:00:00.001 originally caused by: 00:00:00.001 Started by upstream project "nightly-trigger" build number 3669 00:00:00.001 originally caused by: 00:00:00.001 Started by timer 00:00:00.001 Started by timer 00:00:00.088 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-downstream/autotest-phy.groovy 00:00:00.089 The recommended git tool is: git 00:00:00.089 using credential 00000000-0000-0000-0000-000000000002 00:00:00.091 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:00.135 Fetching changes from the remote Git repository 00:00:00.140 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:00.184 Using shallow fetch with depth 1 00:00:00.184 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:00.185 > git --version # timeout=10 00:00:00.219 > git --version # 'git version 2.39.2' 00:00:00.219 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:00.244 Setting http proxy: proxy-dmz.intel.com:911 00:00:00.244 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:05.753 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:05.766 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:05.781 Checking out Revision db4637e8b949f278f369ec13f70585206ccd9507 (FETCH_HEAD) 00:00:05.781 > git config core.sparsecheckout # timeout=10 00:00:05.793 > git read-tree -mu HEAD # timeout=10 00:00:05.809 > git checkout -f db4637e8b949f278f369ec13f70585206ccd9507 # timeout=5 00:00:05.835 Commit message: "jenkins/jjb-config: Add missing SPDK_TEST_NVME_INTERRUPT flag" 00:00:05.835 > git rev-list --no-walk db4637e8b949f278f369ec13f70585206ccd9507 # timeout=10 00:00:05.935 [Pipeline] Start of Pipeline 00:00:05.952 [Pipeline] library 00:00:05.954 Loading library shm_lib@master 00:00:05.954 Library shm_lib@master is cached. Copying from home. 00:00:05.975 [Pipeline] node 00:00:05.987 Running on WFP8 in /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:05.988 [Pipeline] { 00:00:05.999 [Pipeline] catchError 00:00:06.001 [Pipeline] { 00:00:06.017 [Pipeline] wrap 00:00:06.028 [Pipeline] { 00:00:06.033 [Pipeline] stage 00:00:06.035 [Pipeline] { (Prologue) 00:00:06.224 [Pipeline] sh 00:00:06.506 + logger -p user.info -t JENKINS-CI 00:00:06.523 [Pipeline] echo 00:00:06.524 Node: WFP8 00:00:06.532 [Pipeline] sh 00:00:06.827 [Pipeline] setCustomBuildProperty 00:00:06.841 [Pipeline] echo 00:00:06.843 Cleanup processes 00:00:06.848 [Pipeline] sh 00:00:07.132 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:07.132 2817911 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:07.145 [Pipeline] sh 00:00:07.429 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:07.429 ++ grep -v 'sudo pgrep' 00:00:07.429 ++ awk '{print $1}' 00:00:07.429 + sudo kill -9 00:00:07.429 + true 00:00:07.444 [Pipeline] cleanWs 00:00:07.454 [WS-CLEANUP] Deleting project workspace... 00:00:07.454 [WS-CLEANUP] Deferred wipeout is used... 00:00:07.460 [WS-CLEANUP] done 00:00:07.465 [Pipeline] setCustomBuildProperty 00:00:07.481 [Pipeline] sh 00:00:07.762 + sudo git config --global --replace-all safe.directory '*' 00:00:07.866 [Pipeline] httpRequest 00:00:08.250 [Pipeline] echo 00:00:08.252 Sorcerer 10.211.164.101 is alive 00:00:08.263 [Pipeline] retry 00:00:08.265 [Pipeline] { 00:00:08.280 [Pipeline] httpRequest 00:00:08.284 HttpMethod: GET 00:00:08.285 URL: http://10.211.164.101/packages/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:08.285 Sending request to url: http://10.211.164.101/packages/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:08.298 Response Code: HTTP/1.1 200 OK 00:00:08.298 Success: Status code 200 is in the accepted range: 200,404 00:00:08.299 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:16.036 [Pipeline] } 00:00:16.058 [Pipeline] // retry 00:00:16.067 [Pipeline] sh 00:00:16.354 + tar --no-same-owner -xf jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:16.373 [Pipeline] httpRequest 00:00:16.768 [Pipeline] echo 00:00:16.770 Sorcerer 10.211.164.101 is alive 00:00:16.782 [Pipeline] retry 00:00:16.784 [Pipeline] { 00:00:16.802 [Pipeline] httpRequest 00:00:16.806 HttpMethod: GET 00:00:16.807 URL: http://10.211.164.101/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:16.807 Sending request to url: http://10.211.164.101/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:16.814 Response Code: HTTP/1.1 200 OK 00:00:16.814 Success: Status code 200 is in the accepted range: 200,404 00:00:16.814 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:01:31.864 [Pipeline] } 00:01:31.881 [Pipeline] // retry 00:01:31.889 [Pipeline] sh 00:01:32.171 + tar --no-same-owner -xf spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:01:34.714 [Pipeline] sh 00:01:34.995 + git -C spdk log --oneline -n5 00:01:34.995 c13c99a5e test: Various fixes for Fedora40 00:01:34.995 726a04d70 test/nvmf: adjust timeout for bigger nvmes 00:01:34.995 61c96acfb dpdk: Point dpdk submodule at a latest fix from spdk-23.11 00:01:34.995 7db6dcdb8 nvme/fio_plugin: update the way ruhs descriptors are fetched 00:01:34.995 ff6f5c41e nvme/fio_plugin: trim add support for multiple ranges 00:01:35.013 [Pipeline] withCredentials 00:01:35.023 > git --version # timeout=10 00:01:35.038 > git --version # 'git version 2.39.2' 00:01:35.053 Masking supported pattern matches of $GIT_PASSWORD or $GIT_ASKPASS 00:01:35.056 [Pipeline] { 00:01:35.065 [Pipeline] retry 00:01:35.067 [Pipeline] { 00:01:35.082 [Pipeline] sh 00:01:35.366 + git ls-remote http://dpdk.org/git/dpdk-stable v22.11.4 00:01:35.377 [Pipeline] } 00:01:35.395 [Pipeline] // retry 00:01:35.400 [Pipeline] } 00:01:35.416 [Pipeline] // withCredentials 00:01:35.426 [Pipeline] httpRequest 00:01:35.819 [Pipeline] echo 00:01:35.821 Sorcerer 10.211.164.101 is alive 00:01:35.830 [Pipeline] retry 00:01:35.832 [Pipeline] { 00:01:35.847 [Pipeline] httpRequest 00:01:35.851 HttpMethod: GET 00:01:35.852 URL: http://10.211.164.101/packages/dpdk_fee0f13c213d0584f0c42a51d0e0625d99a0b2f1.tar.gz 00:01:35.852 Sending request to url: http://10.211.164.101/packages/dpdk_fee0f13c213d0584f0c42a51d0e0625d99a0b2f1.tar.gz 00:01:35.857 Response Code: HTTP/1.1 200 OK 00:01:35.857 Success: Status code 200 is in the accepted range: 200,404 00:01:35.858 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk_fee0f13c213d0584f0c42a51d0e0625d99a0b2f1.tar.gz 00:01:42.990 [Pipeline] } 00:01:43.012 [Pipeline] // retry 00:01:43.021 [Pipeline] sh 00:01:43.304 + tar --no-same-owner -xf dpdk_fee0f13c213d0584f0c42a51d0e0625d99a0b2f1.tar.gz 00:01:44.692 [Pipeline] sh 00:01:44.977 + git -C dpdk log --oneline -n5 00:01:44.977 caf0f5d395 version: 22.11.4 00:01:44.977 7d6f1cc05f Revert "net/iavf: fix abnormal disable HW interrupt" 00:01:44.977 dc9c799c7d vhost: fix missing spinlock unlock 00:01:44.977 4307659a90 net/mlx5: fix LACP redirection in Rx domain 00:01:44.977 6ef77f2a5e net/gve: fix RX buffer size alignment 00:01:44.986 [Pipeline] } 00:01:45.003 [Pipeline] // stage 00:01:45.012 [Pipeline] stage 00:01:45.015 [Pipeline] { (Prepare) 00:01:45.041 [Pipeline] writeFile 00:01:45.058 [Pipeline] sh 00:01:45.341 + logger -p user.info -t JENKINS-CI 00:01:45.353 [Pipeline] sh 00:01:45.636 + logger -p user.info -t JENKINS-CI 00:01:45.650 [Pipeline] sh 00:01:45.934 + cat autorun-spdk.conf 00:01:45.934 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:45.934 SPDK_TEST_NVMF=1 00:01:45.934 SPDK_TEST_NVME_CLI=1 00:01:45.934 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:45.934 SPDK_TEST_NVMF_NICS=e810 00:01:45.934 SPDK_TEST_VFIOUSER=1 00:01:45.934 SPDK_RUN_UBSAN=1 00:01:45.934 NET_TYPE=phy 00:01:45.934 SPDK_TEST_NATIVE_DPDK=v22.11.4 00:01:45.934 SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:45.941 RUN_NIGHTLY=1 00:01:45.946 [Pipeline] readFile 00:01:45.971 [Pipeline] withEnv 00:01:45.974 [Pipeline] { 00:01:45.986 [Pipeline] sh 00:01:46.288 + set -ex 00:01:46.288 + [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf ]] 00:01:46.288 + source /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:46.288 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:46.288 ++ SPDK_TEST_NVMF=1 00:01:46.288 ++ SPDK_TEST_NVME_CLI=1 00:01:46.288 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:46.288 ++ SPDK_TEST_NVMF_NICS=e810 00:01:46.288 ++ SPDK_TEST_VFIOUSER=1 00:01:46.288 ++ SPDK_RUN_UBSAN=1 00:01:46.288 ++ NET_TYPE=phy 00:01:46.288 ++ SPDK_TEST_NATIVE_DPDK=v22.11.4 00:01:46.288 ++ SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:46.288 ++ RUN_NIGHTLY=1 00:01:46.288 + case $SPDK_TEST_NVMF_NICS in 00:01:46.288 + DRIVERS=ice 00:01:46.288 + [[ tcp == \r\d\m\a ]] 00:01:46.288 + [[ -n ice ]] 00:01:46.288 + sudo rmmod mlx4_ib mlx5_ib irdma i40iw iw_cxgb4 00:01:46.288 rmmod: ERROR: Module mlx4_ib is not currently loaded 00:01:46.288 rmmod: ERROR: Module mlx5_ib is not currently loaded 00:01:46.288 rmmod: ERROR: Module irdma is not currently loaded 00:01:46.288 rmmod: ERROR: Module i40iw is not currently loaded 00:01:46.288 rmmod: ERROR: Module iw_cxgb4 is not currently loaded 00:01:46.288 + true 00:01:46.288 + for D in $DRIVERS 00:01:46.288 + sudo modprobe ice 00:01:46.288 + exit 0 00:01:46.297 [Pipeline] } 00:01:46.312 [Pipeline] // withEnv 00:01:46.318 [Pipeline] } 00:01:46.332 [Pipeline] // stage 00:01:46.343 [Pipeline] catchError 00:01:46.345 [Pipeline] { 00:01:46.359 [Pipeline] timeout 00:01:46.359 Timeout set to expire in 1 hr 0 min 00:01:46.362 [Pipeline] { 00:01:46.377 [Pipeline] stage 00:01:46.379 [Pipeline] { (Tests) 00:01:46.395 [Pipeline] sh 00:01:46.679 + jbp/jenkins/jjb-config/jobs/scripts/autoruner.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:46.679 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:46.679 + DIR_ROOT=/var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:46.679 + [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest ]] 00:01:46.679 + DIR_SPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:46.679 + DIR_OUTPUT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:46.679 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk ]] 00:01:46.679 + [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:46.679 + mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:46.679 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:46.679 + [[ nvmf-tcp-phy-autotest == pkgdep-* ]] 00:01:46.679 + cd /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:46.679 + source /etc/os-release 00:01:46.679 ++ NAME='Fedora Linux' 00:01:46.679 ++ VERSION='39 (Cloud Edition)' 00:01:46.679 ++ ID=fedora 00:01:46.679 ++ VERSION_ID=39 00:01:46.679 ++ VERSION_CODENAME= 00:01:46.679 ++ PLATFORM_ID=platform:f39 00:01:46.679 ++ PRETTY_NAME='Fedora Linux 39 (Cloud Edition)' 00:01:46.679 ++ ANSI_COLOR='0;38;2;60;110;180' 00:01:46.679 ++ LOGO=fedora-logo-icon 00:01:46.679 ++ CPE_NAME=cpe:/o:fedoraproject:fedora:39 00:01:46.679 ++ HOME_URL=https://fedoraproject.org/ 00:01:46.679 ++ DOCUMENTATION_URL=https://docs.fedoraproject.org/en-US/fedora/f39/system-administrators-guide/ 00:01:46.679 ++ SUPPORT_URL=https://ask.fedoraproject.org/ 00:01:46.679 ++ BUG_REPORT_URL=https://bugzilla.redhat.com/ 00:01:46.679 ++ REDHAT_BUGZILLA_PRODUCT=Fedora 00:01:46.679 ++ REDHAT_BUGZILLA_PRODUCT_VERSION=39 00:01:46.679 ++ REDHAT_SUPPORT_PRODUCT=Fedora 00:01:46.679 ++ REDHAT_SUPPORT_PRODUCT_VERSION=39 00:01:46.679 ++ SUPPORT_END=2024-11-12 00:01:46.679 ++ VARIANT='Cloud Edition' 00:01:46.679 ++ VARIANT_ID=cloud 00:01:46.679 + uname -a 00:01:46.679 Linux spdk-wfp-08 6.8.9-200.fc39.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Jul 24 03:04:40 UTC 2024 x86_64 GNU/Linux 00:01:46.679 + sudo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:01:49.216 Hugepages 00:01:49.216 node hugesize free / total 00:01:49.216 node0 1048576kB 0 / 0 00:01:49.216 node0 2048kB 0 / 0 00:01:49.216 node1 1048576kB 0 / 0 00:01:49.216 node1 2048kB 0 / 0 00:01:49.216 00:01:49.216 Type BDF Vendor Device NUMA Driver Device Block devices 00:01:49.216 I/OAT 0000:00:04.0 8086 2021 0 ioatdma - - 00:01:49.216 I/OAT 0000:00:04.1 8086 2021 0 ioatdma - - 00:01:49.216 I/OAT 0000:00:04.2 8086 2021 0 ioatdma - - 00:01:49.216 I/OAT 0000:00:04.3 8086 2021 0 ioatdma - - 00:01:49.216 I/OAT 0000:00:04.4 8086 2021 0 ioatdma - - 00:01:49.216 I/OAT 0000:00:04.5 8086 2021 0 ioatdma - - 00:01:49.216 I/OAT 0000:00:04.6 8086 2021 0 ioatdma - - 00:01:49.216 I/OAT 0000:00:04.7 8086 2021 0 ioatdma - - 00:01:49.216 NVMe 0000:5e:00.0 8086 0a54 0 nvme nvme0 nvme0n1 00:01:49.216 I/OAT 0000:80:04.0 8086 2021 1 ioatdma - - 00:01:49.216 I/OAT 0000:80:04.1 8086 2021 1 ioatdma - - 00:01:49.216 I/OAT 0000:80:04.2 8086 2021 1 ioatdma - - 00:01:49.216 I/OAT 0000:80:04.3 8086 2021 1 ioatdma - - 00:01:49.216 I/OAT 0000:80:04.4 8086 2021 1 ioatdma - - 00:01:49.216 I/OAT 0000:80:04.5 8086 2021 1 ioatdma - - 00:01:49.216 I/OAT 0000:80:04.6 8086 2021 1 ioatdma - - 00:01:49.216 I/OAT 0000:80:04.7 8086 2021 1 ioatdma - - 00:01:49.216 + rm -f /tmp/spdk-ld-path 00:01:49.216 + source autorun-spdk.conf 00:01:49.216 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:49.216 ++ SPDK_TEST_NVMF=1 00:01:49.216 ++ SPDK_TEST_NVME_CLI=1 00:01:49.216 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:49.216 ++ SPDK_TEST_NVMF_NICS=e810 00:01:49.216 ++ SPDK_TEST_VFIOUSER=1 00:01:49.216 ++ SPDK_RUN_UBSAN=1 00:01:49.216 ++ NET_TYPE=phy 00:01:49.216 ++ SPDK_TEST_NATIVE_DPDK=v22.11.4 00:01:49.216 ++ SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:49.216 ++ RUN_NIGHTLY=1 00:01:49.216 + (( SPDK_TEST_NVME_CMB == 1 || SPDK_TEST_NVME_PMR == 1 )) 00:01:49.216 + [[ -n '' ]] 00:01:49.216 + sudo git config --global --add safe.directory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:49.216 + for M in /var/spdk/build-*-manifest.txt 00:01:49.216 + [[ -f /var/spdk/build-kernel-manifest.txt ]] 00:01:49.216 + cp /var/spdk/build-kernel-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:49.216 + for M in /var/spdk/build-*-manifest.txt 00:01:49.216 + [[ -f /var/spdk/build-pkg-manifest.txt ]] 00:01:49.216 + cp /var/spdk/build-pkg-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:49.216 + for M in /var/spdk/build-*-manifest.txt 00:01:49.216 + [[ -f /var/spdk/build-repo-manifest.txt ]] 00:01:49.216 + cp /var/spdk/build-repo-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:49.216 ++ uname 00:01:49.216 + [[ Linux == \L\i\n\u\x ]] 00:01:49.216 + sudo dmesg -T 00:01:49.216 + sudo dmesg --clear 00:01:49.216 + dmesg_pid=2818983 00:01:49.216 + [[ Fedora Linux == FreeBSD ]] 00:01:49.216 + export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:49.216 + UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:49.216 + [[ -e /var/spdk/dependencies/vhost/spdk_test_image.qcow2 ]] 00:01:49.216 + [[ -x /usr/src/fio-static/fio ]] 00:01:49.216 + sudo dmesg -Tw 00:01:49.216 + export FIO_BIN=/usr/src/fio-static/fio 00:01:49.216 + FIO_BIN=/usr/src/fio-static/fio 00:01:49.216 + [[ '' == \/\v\a\r\/\j\e\n\k\i\n\s\/\w\o\r\k\s\p\a\c\e\/\n\v\m\f\-\t\c\p\-\p\h\y\-\a\u\t\o\t\e\s\t\/\q\e\m\u\_\v\f\i\o\/* ]] 00:01:49.216 + [[ ! -v VFIO_QEMU_BIN ]] 00:01:49.216 + [[ -e /usr/local/qemu/vfio-user-latest ]] 00:01:49.216 + export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:49.216 + VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:49.216 + [[ -e /usr/local/qemu/vanilla-latest ]] 00:01:49.216 + export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:49.216 + QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:49.216 + spdk/autorun.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:49.216 Test configuration: 00:01:49.216 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:49.216 SPDK_TEST_NVMF=1 00:01:49.216 SPDK_TEST_NVME_CLI=1 00:01:49.216 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:49.216 SPDK_TEST_NVMF_NICS=e810 00:01:49.216 SPDK_TEST_VFIOUSER=1 00:01:49.216 SPDK_RUN_UBSAN=1 00:01:49.216 NET_TYPE=phy 00:01:49.216 SPDK_TEST_NATIVE_DPDK=v22.11.4 00:01:49.216 SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:49.476 RUN_NIGHTLY=1 18:48:06 -- common/autotest_common.sh@1689 -- $ [[ n == y ]] 00:01:49.476 18:48:06 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:01:49.476 18:48:06 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:01:49.476 18:48:06 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:01:49.476 18:48:06 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:01:49.476 18:48:06 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:49.476 18:48:06 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:49.476 18:48:06 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:49.476 18:48:06 -- paths/export.sh@5 -- $ export PATH 00:01:49.476 18:48:06 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:49.476 18:48:06 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:01:49.476 18:48:06 -- common/autobuild_common.sh@440 -- $ date +%s 00:01:49.477 18:48:06 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1732643286.XXXXXX 00:01:49.477 18:48:06 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1732643286.4RhxPY 00:01:49.477 18:48:06 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:01:49.477 18:48:06 -- common/autobuild_common.sh@446 -- $ '[' -n v22.11.4 ']' 00:01:49.477 18:48:06 -- common/autobuild_common.sh@447 -- $ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:49.477 18:48:06 -- common/autobuild_common.sh@447 -- $ scanbuild_exclude=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk' 00:01:49.477 18:48:06 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:01:49.477 18:48:06 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:01:49.477 18:48:06 -- common/autobuild_common.sh@456 -- $ get_config_params 00:01:49.477 18:48:06 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:01:49.477 18:48:06 -- common/autotest_common.sh@10 -- $ set +x 00:01:49.477 18:48:06 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-vfio-user --with-dpdk=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build' 00:01:49.477 18:48:06 -- spdk/autobuild.sh@11 -- $ SPDK_TEST_AUTOBUILD= 00:01:49.477 18:48:06 -- spdk/autobuild.sh@12 -- $ umask 022 00:01:49.477 18:48:06 -- spdk/autobuild.sh@13 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:49.477 18:48:06 -- spdk/autobuild.sh@16 -- $ date -u 00:01:49.477 Tue Nov 26 05:48:06 PM UTC 2024 00:01:49.477 18:48:06 -- spdk/autobuild.sh@17 -- $ git describe --tags 00:01:49.477 LTS-67-gc13c99a5e 00:01:49.477 18:48:06 -- spdk/autobuild.sh@19 -- $ '[' 0 -eq 1 ']' 00:01:49.477 18:48:06 -- spdk/autobuild.sh@23 -- $ '[' 1 -eq 1 ']' 00:01:49.477 18:48:06 -- spdk/autobuild.sh@24 -- $ run_test ubsan echo 'using ubsan' 00:01:49.477 18:48:06 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:01:49.477 18:48:06 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:49.477 18:48:06 -- common/autotest_common.sh@10 -- $ set +x 00:01:49.477 ************************************ 00:01:49.477 START TEST ubsan 00:01:49.477 ************************************ 00:01:49.477 18:48:06 -- common/autotest_common.sh@1114 -- $ echo 'using ubsan' 00:01:49.477 using ubsan 00:01:49.477 00:01:49.477 real 0m0.000s 00:01:49.477 user 0m0.000s 00:01:49.477 sys 0m0.000s 00:01:49.477 18:48:06 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:01:49.477 18:48:06 -- common/autotest_common.sh@10 -- $ set +x 00:01:49.477 ************************************ 00:01:49.477 END TEST ubsan 00:01:49.477 ************************************ 00:01:49.477 18:48:06 -- spdk/autobuild.sh@27 -- $ '[' -n v22.11.4 ']' 00:01:49.477 18:48:06 -- spdk/autobuild.sh@28 -- $ build_native_dpdk 00:01:49.477 18:48:06 -- common/autobuild_common.sh@432 -- $ run_test build_native_dpdk _build_native_dpdk 00:01:49.477 18:48:06 -- common/autotest_common.sh@1087 -- $ '[' 2 -le 1 ']' 00:01:49.477 18:48:06 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:49.477 18:48:06 -- common/autotest_common.sh@10 -- $ set +x 00:01:49.477 ************************************ 00:01:49.477 START TEST build_native_dpdk 00:01:49.477 ************************************ 00:01:49.477 18:48:06 -- common/autotest_common.sh@1114 -- $ _build_native_dpdk 00:01:49.477 18:48:06 -- common/autobuild_common.sh@48 -- $ local external_dpdk_dir 00:01:49.477 18:48:06 -- common/autobuild_common.sh@49 -- $ local external_dpdk_base_dir 00:01:49.477 18:48:06 -- common/autobuild_common.sh@50 -- $ local compiler_version 00:01:49.477 18:48:06 -- common/autobuild_common.sh@51 -- $ local compiler 00:01:49.477 18:48:06 -- common/autobuild_common.sh@52 -- $ local dpdk_kmods 00:01:49.477 18:48:06 -- common/autobuild_common.sh@53 -- $ local repo=dpdk 00:01:49.477 18:48:06 -- common/autobuild_common.sh@55 -- $ compiler=gcc 00:01:49.477 18:48:06 -- common/autobuild_common.sh@61 -- $ export CC=gcc 00:01:49.477 18:48:06 -- common/autobuild_common.sh@61 -- $ CC=gcc 00:01:49.477 18:48:06 -- common/autobuild_common.sh@63 -- $ [[ gcc != *clang* ]] 00:01:49.477 18:48:06 -- common/autobuild_common.sh@63 -- $ [[ gcc != *gcc* ]] 00:01:49.477 18:48:06 -- common/autobuild_common.sh@68 -- $ gcc -dumpversion 00:01:49.477 18:48:06 -- common/autobuild_common.sh@68 -- $ compiler_version=13 00:01:49.477 18:48:06 -- common/autobuild_common.sh@69 -- $ compiler_version=13 00:01:49.477 18:48:06 -- common/autobuild_common.sh@70 -- $ external_dpdk_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:49.477 18:48:06 -- common/autobuild_common.sh@71 -- $ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:49.477 18:48:06 -- common/autobuild_common.sh@71 -- $ external_dpdk_base_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk 00:01:49.477 18:48:06 -- common/autobuild_common.sh@73 -- $ [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk ]] 00:01:49.477 18:48:06 -- common/autobuild_common.sh@82 -- $ orgdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:49.477 18:48:06 -- common/autobuild_common.sh@83 -- $ git -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk log --oneline -n 5 00:01:49.477 caf0f5d395 version: 22.11.4 00:01:49.477 7d6f1cc05f Revert "net/iavf: fix abnormal disable HW interrupt" 00:01:49.477 dc9c799c7d vhost: fix missing spinlock unlock 00:01:49.477 4307659a90 net/mlx5: fix LACP redirection in Rx domain 00:01:49.477 6ef77f2a5e net/gve: fix RX buffer size alignment 00:01:49.477 18:48:06 -- common/autobuild_common.sh@85 -- $ dpdk_cflags='-fPIC -g -fcommon' 00:01:49.477 18:48:06 -- common/autobuild_common.sh@86 -- $ dpdk_ldflags= 00:01:49.477 18:48:06 -- common/autobuild_common.sh@87 -- $ dpdk_ver=22.11.4 00:01:49.477 18:48:06 -- common/autobuild_common.sh@89 -- $ [[ gcc == *gcc* ]] 00:01:49.477 18:48:06 -- common/autobuild_common.sh@89 -- $ [[ 13 -ge 5 ]] 00:01:49.477 18:48:06 -- common/autobuild_common.sh@90 -- $ dpdk_cflags+=' -Werror' 00:01:49.477 18:48:06 -- common/autobuild_common.sh@93 -- $ [[ gcc == *gcc* ]] 00:01:49.477 18:48:06 -- common/autobuild_common.sh@93 -- $ [[ 13 -ge 10 ]] 00:01:49.477 18:48:06 -- common/autobuild_common.sh@94 -- $ dpdk_cflags+=' -Wno-stringop-overflow' 00:01:49.477 18:48:06 -- common/autobuild_common.sh@100 -- $ DPDK_DRIVERS=("bus" "bus/pci" "bus/vdev" "mempool/ring" "net/i40e" "net/i40e/base") 00:01:49.477 18:48:06 -- common/autobuild_common.sh@102 -- $ local mlx5_libs_added=n 00:01:49.477 18:48:06 -- common/autobuild_common.sh@103 -- $ [[ 0 -eq 1 ]] 00:01:49.477 18:48:06 -- common/autobuild_common.sh@103 -- $ [[ 0 -eq 1 ]] 00:01:49.477 18:48:06 -- common/autobuild_common.sh@139 -- $ [[ 0 -eq 1 ]] 00:01:49.477 18:48:06 -- common/autobuild_common.sh@167 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk 00:01:49.477 18:48:06 -- common/autobuild_common.sh@168 -- $ uname -s 00:01:49.477 18:48:06 -- common/autobuild_common.sh@168 -- $ '[' Linux = Linux ']' 00:01:49.477 18:48:06 -- common/autobuild_common.sh@169 -- $ lt 22.11.4 21.11.0 00:01:49.477 18:48:06 -- scripts/common.sh@372 -- $ cmp_versions 22.11.4 '<' 21.11.0 00:01:49.477 18:48:06 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:01:49.477 18:48:06 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:01:49.477 18:48:06 -- scripts/common.sh@335 -- $ IFS=.-: 00:01:49.477 18:48:06 -- scripts/common.sh@335 -- $ read -ra ver1 00:01:49.477 18:48:06 -- scripts/common.sh@336 -- $ IFS=.-: 00:01:49.477 18:48:06 -- scripts/common.sh@336 -- $ read -ra ver2 00:01:49.477 18:48:06 -- scripts/common.sh@337 -- $ local 'op=<' 00:01:49.477 18:48:06 -- scripts/common.sh@339 -- $ ver1_l=3 00:01:49.477 18:48:06 -- scripts/common.sh@340 -- $ ver2_l=3 00:01:49.477 18:48:06 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:01:49.477 18:48:06 -- scripts/common.sh@343 -- $ case "$op" in 00:01:49.477 18:48:06 -- scripts/common.sh@344 -- $ : 1 00:01:49.477 18:48:06 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:01:49.477 18:48:06 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:01:49.477 18:48:06 -- scripts/common.sh@364 -- $ decimal 22 00:01:49.477 18:48:06 -- scripts/common.sh@352 -- $ local d=22 00:01:49.477 18:48:06 -- scripts/common.sh@353 -- $ [[ 22 =~ ^[0-9]+$ ]] 00:01:49.477 18:48:06 -- scripts/common.sh@354 -- $ echo 22 00:01:49.477 18:48:06 -- scripts/common.sh@364 -- $ ver1[v]=22 00:01:49.477 18:48:06 -- scripts/common.sh@365 -- $ decimal 21 00:01:49.477 18:48:06 -- scripts/common.sh@352 -- $ local d=21 00:01:49.477 18:48:06 -- scripts/common.sh@353 -- $ [[ 21 =~ ^[0-9]+$ ]] 00:01:49.477 18:48:06 -- scripts/common.sh@354 -- $ echo 21 00:01:49.478 18:48:06 -- scripts/common.sh@365 -- $ ver2[v]=21 00:01:49.478 18:48:06 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:01:49.478 18:48:06 -- scripts/common.sh@366 -- $ return 1 00:01:49.478 18:48:06 -- common/autobuild_common.sh@173 -- $ patch -p1 00:01:49.478 patching file config/rte_config.h 00:01:49.478 Hunk #1 succeeded at 60 (offset 1 line). 00:01:49.478 18:48:06 -- common/autobuild_common.sh@176 -- $ lt 22.11.4 24.07.0 00:01:49.478 18:48:06 -- scripts/common.sh@372 -- $ cmp_versions 22.11.4 '<' 24.07.0 00:01:49.478 18:48:06 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:01:49.478 18:48:06 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:01:49.478 18:48:06 -- scripts/common.sh@335 -- $ IFS=.-: 00:01:49.478 18:48:06 -- scripts/common.sh@335 -- $ read -ra ver1 00:01:49.478 18:48:06 -- scripts/common.sh@336 -- $ IFS=.-: 00:01:49.478 18:48:06 -- scripts/common.sh@336 -- $ read -ra ver2 00:01:49.478 18:48:06 -- scripts/common.sh@337 -- $ local 'op=<' 00:01:49.478 18:48:06 -- scripts/common.sh@339 -- $ ver1_l=3 00:01:49.478 18:48:06 -- scripts/common.sh@340 -- $ ver2_l=3 00:01:49.478 18:48:06 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:01:49.478 18:48:06 -- scripts/common.sh@343 -- $ case "$op" in 00:01:49.478 18:48:06 -- scripts/common.sh@344 -- $ : 1 00:01:49.478 18:48:06 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:01:49.478 18:48:06 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:01:49.478 18:48:06 -- scripts/common.sh@364 -- $ decimal 22 00:01:49.478 18:48:06 -- scripts/common.sh@352 -- $ local d=22 00:01:49.478 18:48:06 -- scripts/common.sh@353 -- $ [[ 22 =~ ^[0-9]+$ ]] 00:01:49.478 18:48:06 -- scripts/common.sh@354 -- $ echo 22 00:01:49.478 18:48:06 -- scripts/common.sh@364 -- $ ver1[v]=22 00:01:49.478 18:48:06 -- scripts/common.sh@365 -- $ decimal 24 00:01:49.478 18:48:06 -- scripts/common.sh@352 -- $ local d=24 00:01:49.478 18:48:06 -- scripts/common.sh@353 -- $ [[ 24 =~ ^[0-9]+$ ]] 00:01:49.478 18:48:06 -- scripts/common.sh@354 -- $ echo 24 00:01:49.478 18:48:06 -- scripts/common.sh@365 -- $ ver2[v]=24 00:01:49.478 18:48:06 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:01:49.478 18:48:06 -- scripts/common.sh@367 -- $ (( ver1[v] < ver2[v] )) 00:01:49.478 18:48:06 -- scripts/common.sh@367 -- $ return 0 00:01:49.478 18:48:06 -- common/autobuild_common.sh@177 -- $ patch -p1 00:01:49.478 patching file lib/pcapng/rte_pcapng.c 00:01:49.478 Hunk #1 succeeded at 110 (offset -18 lines). 00:01:49.478 18:48:06 -- common/autobuild_common.sh@180 -- $ dpdk_kmods=false 00:01:49.478 18:48:06 -- common/autobuild_common.sh@181 -- $ uname -s 00:01:49.478 18:48:06 -- common/autobuild_common.sh@181 -- $ '[' Linux = FreeBSD ']' 00:01:49.478 18:48:06 -- common/autobuild_common.sh@185 -- $ printf %s, bus bus/pci bus/vdev mempool/ring net/i40e net/i40e/base 00:01:49.478 18:48:06 -- common/autobuild_common.sh@185 -- $ meson build-tmp --prefix=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build --libdir lib -Denable_docs=false -Denable_kmods=false -Dtests=false -Dc_link_args= '-Dc_args=-fPIC -g -fcommon -Werror -Wno-stringop-overflow' -Dmachine=native -Denable_drivers=bus,bus/pci,bus/vdev,mempool/ring,net/i40e,net/i40e/base, 00:01:54.753 The Meson build system 00:01:54.753 Version: 1.5.0 00:01:54.753 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk 00:01:54.753 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp 00:01:54.753 Build type: native build 00:01:54.753 Program cat found: YES (/usr/bin/cat) 00:01:54.753 Project name: DPDK 00:01:54.753 Project version: 22.11.4 00:01:54.753 C compiler for the host machine: gcc (gcc 13.3.1 "gcc (GCC) 13.3.1 20240522 (Red Hat 13.3.1-1)") 00:01:54.753 C linker for the host machine: gcc ld.bfd 2.40-14 00:01:54.753 Host machine cpu family: x86_64 00:01:54.753 Host machine cpu: x86_64 00:01:54.753 Message: ## Building in Developer Mode ## 00:01:54.753 Program pkg-config found: YES (/usr/bin/pkg-config) 00:01:54.753 Program check-symbols.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/buildtools/check-symbols.sh) 00:01:54.753 Program options-ibverbs-static.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/buildtools/options-ibverbs-static.sh) 00:01:54.753 Program objdump found: YES (/usr/bin/objdump) 00:01:54.753 Program python3 found: YES (/usr/bin/python3) 00:01:54.753 Program cat found: YES (/usr/bin/cat) 00:01:54.753 config/meson.build:83: WARNING: The "machine" option is deprecated. Please use "cpu_instruction_set" instead. 00:01:54.753 Checking for size of "void *" : 8 00:01:54.753 Checking for size of "void *" : 8 (cached) 00:01:54.753 Library m found: YES 00:01:54.753 Library numa found: YES 00:01:54.753 Has header "numaif.h" : YES 00:01:54.753 Library fdt found: NO 00:01:54.753 Library execinfo found: NO 00:01:54.753 Has header "execinfo.h" : YES 00:01:54.753 Found pkg-config: YES (/usr/bin/pkg-config) 1.9.5 00:01:54.753 Run-time dependency libarchive found: NO (tried pkgconfig) 00:01:54.753 Run-time dependency libbsd found: NO (tried pkgconfig) 00:01:54.753 Run-time dependency jansson found: NO (tried pkgconfig) 00:01:54.753 Run-time dependency openssl found: YES 3.1.1 00:01:54.753 Run-time dependency libpcap found: YES 1.10.4 00:01:54.753 Has header "pcap.h" with dependency libpcap: YES 00:01:54.753 Compiler for C supports arguments -Wcast-qual: YES 00:01:54.753 Compiler for C supports arguments -Wdeprecated: YES 00:01:54.753 Compiler for C supports arguments -Wformat: YES 00:01:54.753 Compiler for C supports arguments -Wformat-nonliteral: NO 00:01:54.753 Compiler for C supports arguments -Wformat-security: NO 00:01:54.753 Compiler for C supports arguments -Wmissing-declarations: YES 00:01:54.753 Compiler for C supports arguments -Wmissing-prototypes: YES 00:01:54.753 Compiler for C supports arguments -Wnested-externs: YES 00:01:54.753 Compiler for C supports arguments -Wold-style-definition: YES 00:01:54.753 Compiler for C supports arguments -Wpointer-arith: YES 00:01:54.753 Compiler for C supports arguments -Wsign-compare: YES 00:01:54.753 Compiler for C supports arguments -Wstrict-prototypes: YES 00:01:54.753 Compiler for C supports arguments -Wundef: YES 00:01:54.753 Compiler for C supports arguments -Wwrite-strings: YES 00:01:54.753 Compiler for C supports arguments -Wno-address-of-packed-member: YES 00:01:54.753 Compiler for C supports arguments -Wno-packed-not-aligned: YES 00:01:54.753 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:01:54.753 Compiler for C supports arguments -Wno-zero-length-bounds: YES 00:01:54.753 Compiler for C supports arguments -mavx512f: YES 00:01:54.753 Checking if "AVX512 checking" compiles: YES 00:01:54.753 Fetching value of define "__SSE4_2__" : 1 00:01:54.753 Fetching value of define "__AES__" : 1 00:01:54.753 Fetching value of define "__AVX__" : 1 00:01:54.753 Fetching value of define "__AVX2__" : 1 00:01:54.753 Fetching value of define "__AVX512BW__" : 1 00:01:54.753 Fetching value of define "__AVX512CD__" : 1 00:01:54.753 Fetching value of define "__AVX512DQ__" : 1 00:01:54.753 Fetching value of define "__AVX512F__" : 1 00:01:54.753 Fetching value of define "__AVX512VL__" : 1 00:01:54.753 Fetching value of define "__PCLMUL__" : 1 00:01:54.753 Fetching value of define "__RDRND__" : 1 00:01:54.753 Fetching value of define "__RDSEED__" : 1 00:01:54.753 Fetching value of define "__VPCLMULQDQ__" : (undefined) 00:01:54.753 Compiler for C supports arguments -Wno-format-truncation: YES 00:01:54.753 Message: lib/kvargs: Defining dependency "kvargs" 00:01:54.753 Message: lib/telemetry: Defining dependency "telemetry" 00:01:54.753 Checking for function "getentropy" : YES 00:01:54.753 Message: lib/eal: Defining dependency "eal" 00:01:54.753 Message: lib/ring: Defining dependency "ring" 00:01:54.753 Message: lib/rcu: Defining dependency "rcu" 00:01:54.753 Message: lib/mempool: Defining dependency "mempool" 00:01:54.753 Message: lib/mbuf: Defining dependency "mbuf" 00:01:54.753 Fetching value of define "__PCLMUL__" : 1 (cached) 00:01:54.753 Fetching value of define "__AVX512F__" : 1 (cached) 00:01:54.753 Fetching value of define "__AVX512BW__" : 1 (cached) 00:01:54.753 Fetching value of define "__AVX512DQ__" : 1 (cached) 00:01:54.753 Fetching value of define "__AVX512VL__" : 1 (cached) 00:01:54.753 Fetching value of define "__VPCLMULQDQ__" : (undefined) (cached) 00:01:54.753 Compiler for C supports arguments -mpclmul: YES 00:01:54.753 Compiler for C supports arguments -maes: YES 00:01:54.754 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:54.754 Compiler for C supports arguments -mavx512bw: YES 00:01:54.754 Compiler for C supports arguments -mavx512dq: YES 00:01:54.754 Compiler for C supports arguments -mavx512vl: YES 00:01:54.754 Compiler for C supports arguments -mvpclmulqdq: YES 00:01:54.754 Compiler for C supports arguments -mavx2: YES 00:01:54.754 Compiler for C supports arguments -mavx: YES 00:01:54.754 Message: lib/net: Defining dependency "net" 00:01:54.754 Message: lib/meter: Defining dependency "meter" 00:01:54.754 Message: lib/ethdev: Defining dependency "ethdev" 00:01:54.754 Message: lib/pci: Defining dependency "pci" 00:01:54.754 Message: lib/cmdline: Defining dependency "cmdline" 00:01:54.754 Message: lib/metrics: Defining dependency "metrics" 00:01:54.754 Message: lib/hash: Defining dependency "hash" 00:01:54.754 Message: lib/timer: Defining dependency "timer" 00:01:54.754 Fetching value of define "__AVX2__" : 1 (cached) 00:01:54.754 Fetching value of define "__AVX512F__" : 1 (cached) 00:01:54.754 Fetching value of define "__AVX512VL__" : 1 (cached) 00:01:54.754 Fetching value of define "__AVX512CD__" : 1 (cached) 00:01:54.754 Fetching value of define "__AVX512BW__" : 1 (cached) 00:01:54.754 Message: lib/acl: Defining dependency "acl" 00:01:54.754 Message: lib/bbdev: Defining dependency "bbdev" 00:01:54.754 Message: lib/bitratestats: Defining dependency "bitratestats" 00:01:54.754 Run-time dependency libelf found: YES 0.191 00:01:54.754 Message: lib/bpf: Defining dependency "bpf" 00:01:54.754 Message: lib/cfgfile: Defining dependency "cfgfile" 00:01:54.754 Message: lib/compressdev: Defining dependency "compressdev" 00:01:54.754 Message: lib/cryptodev: Defining dependency "cryptodev" 00:01:54.754 Message: lib/distributor: Defining dependency "distributor" 00:01:54.754 Message: lib/efd: Defining dependency "efd" 00:01:54.754 Message: lib/eventdev: Defining dependency "eventdev" 00:01:54.754 Message: lib/gpudev: Defining dependency "gpudev" 00:01:54.754 Message: lib/gro: Defining dependency "gro" 00:01:54.754 Message: lib/gso: Defining dependency "gso" 00:01:54.754 Message: lib/ip_frag: Defining dependency "ip_frag" 00:01:54.754 Message: lib/jobstats: Defining dependency "jobstats" 00:01:54.754 Message: lib/latencystats: Defining dependency "latencystats" 00:01:54.754 Message: lib/lpm: Defining dependency "lpm" 00:01:54.754 Fetching value of define "__AVX512F__" : 1 (cached) 00:01:54.754 Fetching value of define "__AVX512DQ__" : 1 (cached) 00:01:54.754 Fetching value of define "__AVX512IFMA__" : (undefined) 00:01:54.754 Compiler for C supports arguments -mavx512f -mavx512dq -mavx512ifma: YES 00:01:54.754 Message: lib/member: Defining dependency "member" 00:01:54.754 Message: lib/pcapng: Defining dependency "pcapng" 00:01:54.754 Compiler for C supports arguments -Wno-cast-qual: YES 00:01:54.754 Message: lib/power: Defining dependency "power" 00:01:54.754 Message: lib/rawdev: Defining dependency "rawdev" 00:01:54.754 Message: lib/regexdev: Defining dependency "regexdev" 00:01:54.754 Message: lib/dmadev: Defining dependency "dmadev" 00:01:54.754 Message: lib/rib: Defining dependency "rib" 00:01:54.754 Message: lib/reorder: Defining dependency "reorder" 00:01:54.754 Message: lib/sched: Defining dependency "sched" 00:01:54.754 Message: lib/security: Defining dependency "security" 00:01:54.754 Message: lib/stack: Defining dependency "stack" 00:01:54.754 Has header "linux/userfaultfd.h" : YES 00:01:54.754 Message: lib/vhost: Defining dependency "vhost" 00:01:54.754 Message: lib/ipsec: Defining dependency "ipsec" 00:01:54.754 Fetching value of define "__AVX512F__" : 1 (cached) 00:01:54.754 Fetching value of define "__AVX512DQ__" : 1 (cached) 00:01:54.754 Fetching value of define "__AVX512BW__" : 1 (cached) 00:01:54.754 Message: lib/fib: Defining dependency "fib" 00:01:54.754 Message: lib/port: Defining dependency "port" 00:01:54.754 Message: lib/pdump: Defining dependency "pdump" 00:01:54.754 Message: lib/table: Defining dependency "table" 00:01:54.754 Message: lib/pipeline: Defining dependency "pipeline" 00:01:54.754 Message: lib/graph: Defining dependency "graph" 00:01:54.754 Message: lib/node: Defining dependency "node" 00:01:54.754 Compiler for C supports arguments -Wno-format-truncation: YES (cached) 00:01:54.754 Message: drivers/bus/pci: Defining dependency "bus_pci" 00:01:54.754 Message: drivers/bus/vdev: Defining dependency "bus_vdev" 00:01:54.754 Message: drivers/mempool/ring: Defining dependency "mempool_ring" 00:01:54.754 Compiler for C supports arguments -Wno-sign-compare: YES 00:01:54.754 Compiler for C supports arguments -Wno-unused-value: YES 00:01:54.754 Compiler for C supports arguments -Wno-format: YES 00:01:54.754 Compiler for C supports arguments -Wno-format-security: YES 00:01:54.754 Compiler for C supports arguments -Wno-format-nonliteral: YES 00:01:55.014 Compiler for C supports arguments -Wno-strict-aliasing: YES 00:01:55.014 Compiler for C supports arguments -Wno-unused-but-set-variable: YES 00:01:55.014 Compiler for C supports arguments -Wno-unused-parameter: YES 00:01:55.014 Fetching value of define "__AVX2__" : 1 (cached) 00:01:55.014 Fetching value of define "__AVX512F__" : 1 (cached) 00:01:55.014 Fetching value of define "__AVX512BW__" : 1 (cached) 00:01:55.014 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:55.014 Compiler for C supports arguments -mavx512bw: YES (cached) 00:01:55.014 Compiler for C supports arguments -march=skylake-avx512: YES 00:01:55.014 Message: drivers/net/i40e: Defining dependency "net_i40e" 00:01:55.014 Program doxygen found: YES (/usr/local/bin/doxygen) 00:01:55.014 Configuring doxy-api.conf using configuration 00:01:55.014 Program sphinx-build found: NO 00:01:55.014 Configuring rte_build_config.h using configuration 00:01:55.014 Message: 00:01:55.014 ================= 00:01:55.014 Applications Enabled 00:01:55.014 ================= 00:01:55.014 00:01:55.014 apps: 00:01:55.014 dumpcap, pdump, proc-info, test-acl, test-bbdev, test-cmdline, test-compress-perf, test-crypto-perf, 00:01:55.014 test-eventdev, test-fib, test-flow-perf, test-gpudev, test-pipeline, test-pmd, test-regex, test-sad, 00:01:55.014 test-security-perf, 00:01:55.014 00:01:55.014 Message: 00:01:55.014 ================= 00:01:55.014 Libraries Enabled 00:01:55.014 ================= 00:01:55.014 00:01:55.014 libs: 00:01:55.014 kvargs, telemetry, eal, ring, rcu, mempool, mbuf, net, 00:01:55.014 meter, ethdev, pci, cmdline, metrics, hash, timer, acl, 00:01:55.014 bbdev, bitratestats, bpf, cfgfile, compressdev, cryptodev, distributor, efd, 00:01:55.014 eventdev, gpudev, gro, gso, ip_frag, jobstats, latencystats, lpm, 00:01:55.014 member, pcapng, power, rawdev, regexdev, dmadev, rib, reorder, 00:01:55.014 sched, security, stack, vhost, ipsec, fib, port, pdump, 00:01:55.014 table, pipeline, graph, node, 00:01:55.014 00:01:55.014 Message: 00:01:55.014 =============== 00:01:55.014 Drivers Enabled 00:01:55.014 =============== 00:01:55.014 00:01:55.014 common: 00:01:55.014 00:01:55.014 bus: 00:01:55.014 pci, vdev, 00:01:55.014 mempool: 00:01:55.014 ring, 00:01:55.014 dma: 00:01:55.014 00:01:55.014 net: 00:01:55.014 i40e, 00:01:55.014 raw: 00:01:55.014 00:01:55.014 crypto: 00:01:55.014 00:01:55.014 compress: 00:01:55.014 00:01:55.014 regex: 00:01:55.014 00:01:55.014 vdpa: 00:01:55.014 00:01:55.014 event: 00:01:55.014 00:01:55.014 baseband: 00:01:55.014 00:01:55.014 gpu: 00:01:55.014 00:01:55.014 00:01:55.014 Message: 00:01:55.014 ================= 00:01:55.014 Content Skipped 00:01:55.014 ================= 00:01:55.014 00:01:55.014 apps: 00:01:55.014 00:01:55.014 libs: 00:01:55.014 kni: explicitly disabled via build config (deprecated lib) 00:01:55.014 flow_classify: explicitly disabled via build config (deprecated lib) 00:01:55.014 00:01:55.014 drivers: 00:01:55.014 common/cpt: not in enabled drivers build config 00:01:55.014 common/dpaax: not in enabled drivers build config 00:01:55.014 common/iavf: not in enabled drivers build config 00:01:55.014 common/idpf: not in enabled drivers build config 00:01:55.014 common/mvep: not in enabled drivers build config 00:01:55.014 common/octeontx: not in enabled drivers build config 00:01:55.014 bus/auxiliary: not in enabled drivers build config 00:01:55.014 bus/dpaa: not in enabled drivers build config 00:01:55.014 bus/fslmc: not in enabled drivers build config 00:01:55.014 bus/ifpga: not in enabled drivers build config 00:01:55.014 bus/vmbus: not in enabled drivers build config 00:01:55.014 common/cnxk: not in enabled drivers build config 00:01:55.014 common/mlx5: not in enabled drivers build config 00:01:55.014 common/qat: not in enabled drivers build config 00:01:55.014 common/sfc_efx: not in enabled drivers build config 00:01:55.014 mempool/bucket: not in enabled drivers build config 00:01:55.014 mempool/cnxk: not in enabled drivers build config 00:01:55.014 mempool/dpaa: not in enabled drivers build config 00:01:55.014 mempool/dpaa2: not in enabled drivers build config 00:01:55.014 mempool/octeontx: not in enabled drivers build config 00:01:55.014 mempool/stack: not in enabled drivers build config 00:01:55.014 dma/cnxk: not in enabled drivers build config 00:01:55.014 dma/dpaa: not in enabled drivers build config 00:01:55.014 dma/dpaa2: not in enabled drivers build config 00:01:55.014 dma/hisilicon: not in enabled drivers build config 00:01:55.014 dma/idxd: not in enabled drivers build config 00:01:55.014 dma/ioat: not in enabled drivers build config 00:01:55.014 dma/skeleton: not in enabled drivers build config 00:01:55.014 net/af_packet: not in enabled drivers build config 00:01:55.014 net/af_xdp: not in enabled drivers build config 00:01:55.014 net/ark: not in enabled drivers build config 00:01:55.014 net/atlantic: not in enabled drivers build config 00:01:55.014 net/avp: not in enabled drivers build config 00:01:55.014 net/axgbe: not in enabled drivers build config 00:01:55.014 net/bnx2x: not in enabled drivers build config 00:01:55.014 net/bnxt: not in enabled drivers build config 00:01:55.014 net/bonding: not in enabled drivers build config 00:01:55.014 net/cnxk: not in enabled drivers build config 00:01:55.014 net/cxgbe: not in enabled drivers build config 00:01:55.014 net/dpaa: not in enabled drivers build config 00:01:55.014 net/dpaa2: not in enabled drivers build config 00:01:55.014 net/e1000: not in enabled drivers build config 00:01:55.014 net/ena: not in enabled drivers build config 00:01:55.014 net/enetc: not in enabled drivers build config 00:01:55.014 net/enetfec: not in enabled drivers build config 00:01:55.014 net/enic: not in enabled drivers build config 00:01:55.014 net/failsafe: not in enabled drivers build config 00:01:55.014 net/fm10k: not in enabled drivers build config 00:01:55.014 net/gve: not in enabled drivers build config 00:01:55.014 net/hinic: not in enabled drivers build config 00:01:55.014 net/hns3: not in enabled drivers build config 00:01:55.014 net/iavf: not in enabled drivers build config 00:01:55.014 net/ice: not in enabled drivers build config 00:01:55.014 net/idpf: not in enabled drivers build config 00:01:55.014 net/igc: not in enabled drivers build config 00:01:55.014 net/ionic: not in enabled drivers build config 00:01:55.014 net/ipn3ke: not in enabled drivers build config 00:01:55.014 net/ixgbe: not in enabled drivers build config 00:01:55.014 net/kni: not in enabled drivers build config 00:01:55.014 net/liquidio: not in enabled drivers build config 00:01:55.014 net/mana: not in enabled drivers build config 00:01:55.014 net/memif: not in enabled drivers build config 00:01:55.014 net/mlx4: not in enabled drivers build config 00:01:55.014 net/mlx5: not in enabled drivers build config 00:01:55.014 net/mvneta: not in enabled drivers build config 00:01:55.014 net/mvpp2: not in enabled drivers build config 00:01:55.014 net/netvsc: not in enabled drivers build config 00:01:55.014 net/nfb: not in enabled drivers build config 00:01:55.014 net/nfp: not in enabled drivers build config 00:01:55.014 net/ngbe: not in enabled drivers build config 00:01:55.014 net/null: not in enabled drivers build config 00:01:55.014 net/octeontx: not in enabled drivers build config 00:01:55.014 net/octeon_ep: not in enabled drivers build config 00:01:55.014 net/pcap: not in enabled drivers build config 00:01:55.014 net/pfe: not in enabled drivers build config 00:01:55.014 net/qede: not in enabled drivers build config 00:01:55.014 net/ring: not in enabled drivers build config 00:01:55.014 net/sfc: not in enabled drivers build config 00:01:55.014 net/softnic: not in enabled drivers build config 00:01:55.014 net/tap: not in enabled drivers build config 00:01:55.014 net/thunderx: not in enabled drivers build config 00:01:55.014 net/txgbe: not in enabled drivers build config 00:01:55.014 net/vdev_netvsc: not in enabled drivers build config 00:01:55.014 net/vhost: not in enabled drivers build config 00:01:55.014 net/virtio: not in enabled drivers build config 00:01:55.014 net/vmxnet3: not in enabled drivers build config 00:01:55.014 raw/cnxk_bphy: not in enabled drivers build config 00:01:55.014 raw/cnxk_gpio: not in enabled drivers build config 00:01:55.014 raw/dpaa2_cmdif: not in enabled drivers build config 00:01:55.015 raw/ifpga: not in enabled drivers build config 00:01:55.015 raw/ntb: not in enabled drivers build config 00:01:55.015 raw/skeleton: not in enabled drivers build config 00:01:55.015 crypto/armv8: not in enabled drivers build config 00:01:55.015 crypto/bcmfs: not in enabled drivers build config 00:01:55.015 crypto/caam_jr: not in enabled drivers build config 00:01:55.015 crypto/ccp: not in enabled drivers build config 00:01:55.015 crypto/cnxk: not in enabled drivers build config 00:01:55.015 crypto/dpaa_sec: not in enabled drivers build config 00:01:55.015 crypto/dpaa2_sec: not in enabled drivers build config 00:01:55.015 crypto/ipsec_mb: not in enabled drivers build config 00:01:55.015 crypto/mlx5: not in enabled drivers build config 00:01:55.015 crypto/mvsam: not in enabled drivers build config 00:01:55.015 crypto/nitrox: not in enabled drivers build config 00:01:55.015 crypto/null: not in enabled drivers build config 00:01:55.015 crypto/octeontx: not in enabled drivers build config 00:01:55.015 crypto/openssl: not in enabled drivers build config 00:01:55.015 crypto/scheduler: not in enabled drivers build config 00:01:55.015 crypto/uadk: not in enabled drivers build config 00:01:55.015 crypto/virtio: not in enabled drivers build config 00:01:55.015 compress/isal: not in enabled drivers build config 00:01:55.015 compress/mlx5: not in enabled drivers build config 00:01:55.015 compress/octeontx: not in enabled drivers build config 00:01:55.015 compress/zlib: not in enabled drivers build config 00:01:55.015 regex/mlx5: not in enabled drivers build config 00:01:55.015 regex/cn9k: not in enabled drivers build config 00:01:55.015 vdpa/ifc: not in enabled drivers build config 00:01:55.015 vdpa/mlx5: not in enabled drivers build config 00:01:55.015 vdpa/sfc: not in enabled drivers build config 00:01:55.015 event/cnxk: not in enabled drivers build config 00:01:55.015 event/dlb2: not in enabled drivers build config 00:01:55.015 event/dpaa: not in enabled drivers build config 00:01:55.015 event/dpaa2: not in enabled drivers build config 00:01:55.015 event/dsw: not in enabled drivers build config 00:01:55.015 event/opdl: not in enabled drivers build config 00:01:55.015 event/skeleton: not in enabled drivers build config 00:01:55.015 event/sw: not in enabled drivers build config 00:01:55.015 event/octeontx: not in enabled drivers build config 00:01:55.015 baseband/acc: not in enabled drivers build config 00:01:55.015 baseband/fpga_5gnr_fec: not in enabled drivers build config 00:01:55.015 baseband/fpga_lte_fec: not in enabled drivers build config 00:01:55.015 baseband/la12xx: not in enabled drivers build config 00:01:55.015 baseband/null: not in enabled drivers build config 00:01:55.015 baseband/turbo_sw: not in enabled drivers build config 00:01:55.015 gpu/cuda: not in enabled drivers build config 00:01:55.015 00:01:55.015 00:01:55.015 Build targets in project: 311 00:01:55.015 00:01:55.015 DPDK 22.11.4 00:01:55.015 00:01:55.015 User defined options 00:01:55.015 libdir : lib 00:01:55.015 prefix : /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:55.015 c_args : -fPIC -g -fcommon -Werror -Wno-stringop-overflow 00:01:55.015 c_link_args : 00:01:55.015 enable_docs : false 00:01:55.015 enable_drivers: bus,bus/pci,bus/vdev,mempool/ring,net/i40e,net/i40e/base, 00:01:55.015 enable_kmods : false 00:01:55.015 machine : native 00:01:55.015 tests : false 00:01:55.015 00:01:55.015 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:01:55.015 WARNING: Running the setup command as `meson [options]` instead of `meson setup [options]` is ambiguous and deprecated. 00:01:55.278 18:48:12 -- common/autobuild_common.sh@189 -- $ ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp -j96 00:01:55.278 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp' 00:01:55.278 [1/740] Generating lib/rte_telemetry_def with a custom command 00:01:55.278 [2/740] Generating lib/rte_kvargs_def with a custom command 00:01:55.278 [3/740] Generating lib/rte_kvargs_mingw with a custom command 00:01:55.278 [4/740] Generating lib/rte_telemetry_mingw with a custom command 00:01:55.278 [5/740] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hypervisor.c.o 00:01:55.278 [6/740] Generating lib/rte_mempool_def with a custom command 00:01:55.278 [7/740] Generating lib/rte_eal_def with a custom command 00:01:55.278 [8/740] Generating lib/rte_rcu_def with a custom command 00:01:55.278 [9/740] Generating lib/rte_eal_mingw with a custom command 00:01:55.278 [10/740] Compiling C object lib/librte_eal.a.p/eal_common_rte_version.c.o 00:01:55.278 [11/740] Generating lib/rte_ring_def with a custom command 00:01:55.278 [12/740] Generating lib/rte_rcu_mingw with a custom command 00:01:55.542 [13/740] Generating lib/rte_ring_mingw with a custom command 00:01:55.542 [14/740] Generating lib/rte_mempool_mingw with a custom command 00:01:55.542 [15/740] Generating lib/rte_mbuf_def with a custom command 00:01:55.542 [16/740] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_errno.c.o 00:01:55.542 [17/740] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_class.c.o 00:01:55.542 [18/740] Generating lib/rte_mbuf_mingw with a custom command 00:01:55.542 [19/740] Compiling C object lib/librte_eal.a.p/eal_x86_rte_spinlock.c.o 00:01:55.542 [20/740] Generating lib/rte_net_def with a custom command 00:01:55.542 [21/740] Generating lib/rte_net_mingw with a custom command 00:01:55.542 [22/740] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hexdump.c.o 00:01:55.542 [23/740] Generating lib/rte_meter_mingw with a custom command 00:01:55.542 [24/740] Compiling C object lib/librte_eal.a.p/eal_common_rte_reciprocal.c.o 00:01:55.542 [25/740] Generating lib/rte_meter_def with a custom command 00:01:55.542 [26/740] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_cpuflags.c.o 00:01:55.542 [27/740] Compiling C object lib/librte_eal.a.p/eal_x86_rte_hypervisor.c.o 00:01:55.542 [28/740] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_timer.c.o 00:01:55.542 [29/740] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_string_fns.c.o 00:01:55.542 [30/740] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio_mp_sync.c.o 00:01:55.542 [31/740] Compiling C object lib/librte_eal.a.p/eal_linux_eal_log.c.o 00:01:55.542 [32/740] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_config.c.o 00:01:55.542 [33/740] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cpuflags.c.o 00:01:55.542 [34/740] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_debug.c.o 00:01:55.542 [35/740] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_data.c.o 00:01:55.543 [36/740] Compiling C object lib/librte_eal.a.p/eal_linux_eal_cpuflags.c.o 00:01:55.543 [37/740] Compiling C object lib/librte_eal.a.p/eal_linux_eal_timer.c.o 00:01:55.543 [38/740] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_timer.c.o 00:01:55.543 [39/740] Generating lib/rte_ethdev_mingw with a custom command 00:01:55.543 [40/740] Compiling C object lib/librte_eal.a.p/eal_unix_eal_firmware.c.o 00:01:55.543 [41/740] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_thread.c.o 00:01:55.543 [42/740] Compiling C object lib/librte_eal.a.p/eal_common_rte_keepalive.c.o 00:01:55.543 [43/740] Generating lib/rte_ethdev_def with a custom command 00:01:55.543 [44/740] Compiling C object lib/librte_eal.a.p/eal_unix_eal_filesystem.c.o 00:01:55.543 [45/740] Compiling C object lib/librte_eal.a.p/eal_linux_eal_thread.c.o 00:01:55.543 [46/740] Compiling C object lib/librte_kvargs.a.p/kvargs_rte_kvargs.c.o 00:01:55.543 [47/740] Generating lib/rte_pci_mingw with a custom command 00:01:55.543 [48/740] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_uuid.c.o 00:01:55.543 [49/740] Generating lib/rte_pci_def with a custom command 00:01:55.543 [50/740] Linking static target lib/librte_kvargs.a 00:01:55.543 [51/740] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_mcfg.c.o 00:01:55.543 [52/740] Compiling C object lib/librte_eal.a.p/eal_unix_eal_debug.c.o 00:01:55.543 [53/740] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_bus.c.o 00:01:55.543 [54/740] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_legacy.c.o 00:01:55.543 [55/740] Generating lib/rte_cmdline_def with a custom command 00:01:55.543 [56/740] Generating lib/rte_cmdline_mingw with a custom command 00:01:55.543 [57/740] Compiling C object lib/librte_eal.a.p/eal_unix_eal_file.c.o 00:01:55.543 [58/740] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cycles.c.o 00:01:55.543 [59/740] Compiling C object lib/librte_eal.a.p/eal_linux_eal_lcore.c.o 00:01:55.543 [60/740] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_launch.c.o 00:01:55.543 [61/740] Generating lib/rte_metrics_def with a custom command 00:01:55.543 [62/740] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_tailqs.c.o 00:01:55.543 [63/740] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_points.c.o 00:01:55.543 [64/740] Compiling C object lib/librte_eal.a.p/eal_unix_rte_thread.c.o 00:01:55.543 [65/740] Generating lib/rte_metrics_mingw with a custom command 00:01:55.543 [66/740] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memalloc.c.o 00:01:55.543 [67/740] Compiling C object lib/librte_eal.a.p/eal_x86_rte_power_intrinsics.c.o 00:01:55.543 [68/740] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_vt100.c.o 00:01:55.543 [69/740] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_socket.c.o 00:01:55.543 [70/740] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_memory.c.o 00:01:55.543 [71/740] Compiling C object lib/librte_ring.a.p/ring_rte_ring.c.o 00:01:55.543 [72/740] Generating lib/rte_hash_mingw with a custom command 00:01:55.543 [73/740] Generating lib/rte_hash_def with a custom command 00:01:55.543 [74/740] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_os_unix.c.o 00:01:55.543 [75/740] Compiling C object lib/librte_pci.a.p/pci_rte_pci.c.o 00:01:55.543 [76/740] Compiling C object lib/librte_meter.a.p/meter_rte_meter.c.o 00:01:55.543 [77/740] Linking static target lib/librte_ring.a 00:01:55.543 [78/740] Compiling C object lib/librte_eal.a.p/eal_linux_eal_alarm.c.o 00:01:55.543 [79/740] Linking static target lib/librte_pci.a 00:01:55.543 [80/740] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_log.c.o 00:01:55.543 [81/740] Generating lib/rte_timer_mingw with a custom command 00:01:55.543 [82/740] Linking static target lib/librte_meter.a 00:01:55.543 [83/740] Generating lib/rte_timer_def with a custom command 00:01:55.543 [84/740] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_devargs.c.o 00:01:55.802 [85/740] Generating lib/rte_acl_def with a custom command 00:01:55.802 [86/740] Generating lib/rte_acl_mingw with a custom command 00:01:55.802 [87/740] Compiling C object lib/librte_eal.a.p/eal_linux_eal_dev.c.o 00:01:55.802 [88/740] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_portlist.c.o 00:01:55.802 [89/740] Generating lib/rte_bbdev_def with a custom command 00:01:55.802 [90/740] Generating lib/rte_bbdev_mingw with a custom command 00:01:55.803 [91/740] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline.c.o 00:01:55.803 [92/740] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_lcore.c.o 00:01:55.803 [93/740] Generating lib/rte_bitratestats_def with a custom command 00:01:55.803 [94/740] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_ctf.c.o 00:01:55.803 [95/740] Generating lib/rte_bitratestats_mingw with a custom command 00:01:55.803 [96/740] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_num.c.o 00:01:55.803 [97/740] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_string.c.o 00:01:55.803 [98/740] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_thread.c.o 00:01:55.803 [99/740] Compiling C object lib/librte_eal.a.p/eal_common_malloc_mp.c.o 00:01:55.803 [100/740] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_interrupts.c.o 00:01:55.803 [101/740] Compiling C object lib/librte_eal.a.p/eal_common_hotplug_mp.c.o 00:01:55.803 [102/740] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dev.c.o 00:01:55.803 [103/740] Generating lib/rte_cfgfile_mingw with a custom command 00:01:55.803 [104/740] Generating lib/rte_bpf_def with a custom command 00:01:55.803 [105/740] Generating lib/rte_cfgfile_def with a custom command 00:01:55.803 [106/740] Generating lib/rte_bpf_mingw with a custom command 00:01:55.803 [107/740] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace.c.o 00:01:55.803 [108/740] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_utils.c.o 00:01:55.803 [109/740] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_cirbuf.c.o 00:01:55.803 [110/740] Compiling C object lib/librte_eal.a.p/eal_linux_eal_hugepage_info.c.o 00:01:55.803 [111/740] Generating lib/rte_compressdev_def with a custom command 00:01:55.803 [112/740] Generating lib/rte_compressdev_mingw with a custom command 00:01:55.803 [113/740] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memzone.c.o 00:01:55.803 [114/740] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dynmem.c.o 00:01:55.803 [115/740] Compiling C object lib/librte_hash.a.p/hash_rte_fbk_hash.c.o 00:01:55.803 [116/740] Generating lib/rte_cryptodev_def with a custom command 00:01:55.803 [117/740] Generating lib/rte_cryptodev_mingw with a custom command 00:01:55.803 [118/740] Compiling C object lib/librte_metrics.a.p/metrics_rte_metrics.c.o 00:01:55.803 [119/740] Compiling C object lib/librte_eal.a.p/eal_common_malloc_elem.c.o 00:01:55.803 [120/740] Generating lib/rte_efd_def with a custom command 00:01:55.803 [121/740] Generating lib/rte_distributor_def with a custom command 00:01:55.803 [122/740] Generating lib/rte_distributor_mingw with a custom command 00:01:55.803 [123/740] Generating lib/rte_efd_mingw with a custom command 00:01:55.803 [124/740] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse.c.o 00:01:55.803 [125/740] Generating lib/rte_eventdev_def with a custom command 00:01:55.803 [126/740] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memory.c.o 00:01:55.803 [127/740] Generating lib/rte_eventdev_mingw with a custom command 00:01:55.803 [128/740] Generating lib/kvargs.sym_chk with a custom command (wrapped by meson to capture output) 00:01:56.061 [129/740] Generating lib/pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:56.061 [130/740] Generating lib/rte_gpudev_mingw with a custom command 00:01:56.061 [131/740] Generating lib/rte_gpudev_def with a custom command 00:01:56.061 [132/740] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_rdline.c.o 00:01:56.061 [133/740] Linking target lib/librte_kvargs.so.23.0 00:01:56.061 [134/740] Generating lib/meter.sym_chk with a custom command (wrapped by meson to capture output) 00:01:56.061 [135/740] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_pool_ops.c.o 00:01:56.061 [136/740] Generating lib/ring.sym_chk with a custom command (wrapped by meson to capture output) 00:01:56.061 [137/740] Compiling C object lib/librte_net.a.p/net_net_crc_sse.c.o 00:01:56.061 [138/740] Compiling C object lib/librte_eal.a.p/eal_common_rte_service.c.o 00:01:56.061 [139/740] Compiling C object lib/librte_eal.a.p/eal_common_malloc_heap.c.o 00:01:56.061 [140/740] Generating lib/rte_gro_mingw with a custom command 00:01:56.061 [141/740] Compiling C object lib/librte_net.a.p/net_rte_net_crc.c.o 00:01:56.061 [142/740] Generating lib/rte_gro_def with a custom command 00:01:56.061 [143/740] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops_default.c.o 00:01:56.061 [144/740] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_proc.c.o 00:01:56.061 [145/740] Compiling C object lib/librte_eal.a.p/eal_linux_eal.c.o 00:01:56.061 [146/740] Compiling C object lib/librte_eal.a.p/eal_common_rte_random.c.o 00:01:56.061 [147/740] Compiling C object lib/librte_net.a.p/net_rte_ether.c.o 00:01:56.061 [148/740] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_profile.c.o 00:01:56.061 [149/740] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_fbarray.c.o 00:01:56.061 [150/740] Compiling C object lib/librte_cfgfile.a.p/cfgfile_rte_cfgfile.c.o 00:01:56.061 [151/740] Generating lib/rte_gso_def with a custom command 00:01:56.061 [152/740] Generating lib/rte_gso_mingw with a custom command 00:01:56.062 [153/740] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_ptype.c.o 00:01:56.062 [154/740] Linking static target lib/librte_cfgfile.a 00:01:56.062 [155/740] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops.c.o 00:01:56.062 [156/740] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_cman.c.o 00:01:56.062 [157/740] Compiling C object lib/librte_eal.a.p/eal_linux_eal_interrupts.c.o 00:01:56.062 [158/740] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_etheraddr.c.o 00:01:56.062 [159/740] Generating symbol file lib/librte_kvargs.so.23.0.p/librte_kvargs.so.23.0.symbols 00:01:56.062 [160/740] Generating lib/rte_ip_frag_def with a custom command 00:01:56.062 [161/740] Generating lib/rte_ip_frag_mingw with a custom command 00:01:56.062 [162/740] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_ipaddr.c.o 00:01:56.062 [163/740] Compiling C object lib/net/libnet_crc_avx512_lib.a.p/net_crc_avx512.c.o 00:01:56.062 [164/740] Compiling C object lib/librte_mempool.a.p/mempool_mempool_trace_points.c.o 00:01:56.062 [165/740] Linking static target lib/librte_cmdline.a 00:01:56.325 [166/740] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_class_eth.c.o 00:01:56.325 [167/740] Linking static target lib/net/libnet_crc_avx512_lib.a 00:01:56.325 [168/740] Compiling C object lib/librte_metrics.a.p/metrics_rte_metrics_telemetry.c.o 00:01:56.325 [169/740] Compiling C object lib/librte_acl.a.p/acl_tb_mem.c.o 00:01:56.325 [170/740] Generating lib/rte_latencystats_mingw with a custom command 00:01:56.325 [171/740] Generating lib/rte_jobstats_def with a custom command 00:01:56.325 [172/740] Generating lib/rte_jobstats_mingw with a custom command 00:01:56.325 [173/740] Generating lib/rte_latencystats_def with a custom command 00:01:56.325 [174/740] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8472.c.o 00:01:56.325 [175/740] Linking static target lib/librte_metrics.a 00:01:56.325 [176/740] Generating lib/rte_lpm_def with a custom command 00:01:56.325 [177/740] Generating lib/rte_lpm_mingw with a custom command 00:01:56.325 [178/740] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memalloc.c.o 00:01:56.325 [179/740] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_trace_points.c.o 00:01:56.325 [180/740] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_telemetry.c.o 00:01:56.325 [181/740] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_dyn.c.o 00:01:56.325 [182/740] Compiling C object lib/librte_net.a.p/net_rte_arp.c.o 00:01:56.325 [183/740] Compiling C object lib/librte_timer.a.p/timer_rte_timer.c.o 00:01:56.325 [184/740] Linking static target lib/librte_timer.a 00:01:56.325 [185/740] Compiling C object lib/librte_bpf.a.p/bpf_bpf.c.o 00:01:56.325 [186/740] Generating lib/rte_member_def with a custom command 00:01:56.325 [187/740] Generating lib/rte_member_mingw with a custom command 00:01:56.325 [188/740] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_private.c.o 00:01:56.325 [189/740] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry.c.o 00:01:56.325 [190/740] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memory.c.o 00:01:56.325 [191/740] Generating lib/rte_pcapng_def with a custom command 00:01:56.325 [192/740] Linking static target lib/librte_telemetry.a 00:01:56.325 [193/740] Generating lib/rte_pcapng_mingw with a custom command 00:01:56.325 [194/740] Compiling C object lib/librte_bpf.a.p/bpf_bpf_stub.c.o 00:01:56.325 [195/740] Compiling C object lib/librte_acl.a.p/acl_rte_acl.c.o 00:01:56.325 [196/740] Compiling C object lib/librte_net.a.p/net_rte_net.c.o 00:01:56.325 [197/740] Compiling C object lib/librte_bpf.a.p/bpf_bpf_dump.c.o 00:01:56.325 [198/740] Linking static target lib/librte_net.a 00:01:56.325 [199/740] Compiling C object lib/librte_jobstats.a.p/jobstats_rte_jobstats.c.o 00:01:56.325 [200/740] Compiling C object lib/librte_bpf.a.p/bpf_bpf_load.c.o 00:01:56.325 [201/740] Generating lib/rte_power_def with a custom command 00:01:56.325 [202/740] Linking static target lib/librte_jobstats.a 00:01:56.325 [203/740] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_mtr.c.o 00:01:56.325 [204/740] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8079.c.o 00:01:56.325 [205/740] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio.c.o 00:01:56.325 [206/740] Compiling C object lib/librte_bitratestats.a.p/bitratestats_rte_bitrate.c.o 00:01:56.325 [207/740] Generating lib/rte_power_mingw with a custom command 00:01:56.325 [208/740] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev_pmd.c.o 00:01:56.325 [209/740] Linking static target lib/librte_bitratestats.a 00:01:56.325 [210/740] Compiling C object lib/librte_distributor.a.p/distributor_rte_distributor_match_sse.c.o 00:01:56.325 [211/740] Compiling C object lib/librte_eal.a.p/eal_common_rte_malloc.c.o 00:01:56.325 [212/740] Compiling C object lib/librte_power.a.p/power_power_common.c.o 00:01:56.325 [213/740] Compiling C object lib/librte_power.a.p/power_guest_channel.c.o 00:01:56.326 [214/740] Generating lib/rte_rawdev_def with a custom command 00:01:56.326 [215/740] Generating lib/rte_rawdev_mingw with a custom command 00:01:56.326 [216/740] Generating lib/rte_regexdev_mingw with a custom command 00:01:56.326 [217/740] Generating lib/rte_regexdev_def with a custom command 00:01:56.326 [218/740] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_pmd.c.o 00:01:56.326 [219/740] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_common.c.o 00:01:56.326 [220/740] Compiling C object lib/librte_power.a.p/power_power_kvm_vm.c.o 00:01:56.326 [221/740] Generating lib/rte_dmadev_def with a custom command 00:01:56.326 [222/740] Generating lib/rte_dmadev_mingw with a custom command 00:01:56.326 [223/740] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_ring.c.o 00:01:56.326 [224/740] Compiling C object lib/librte_bpf.a.p/bpf_bpf_load_elf.c.o 00:01:56.326 [225/740] Generating lib/rte_rib_def with a custom command 00:01:56.326 [226/740] Generating lib/rte_rib_mingw with a custom command 00:01:56.584 [227/740] Generating lib/rte_reorder_def with a custom command 00:01:56.584 [228/740] Generating lib/rte_reorder_mingw with a custom command 00:01:56.584 [229/740] Compiling C object lib/librte_power.a.p/power_rte_power.c.o 00:01:56.584 [230/740] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_driver.c.o 00:01:56.584 [231/740] Compiling C object lib/librte_eventdev.a.p/eventdev_eventdev_private.c.o 00:01:56.584 [232/740] Generating lib/rte_sched_mingw with a custom command 00:01:56.584 [233/740] Generating lib/rte_sched_def with a custom command 00:01:56.584 [234/740] Generating lib/rte_security_mingw with a custom command 00:01:56.584 [235/740] Generating lib/rte_security_def with a custom command 00:01:56.584 [236/740] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_tm.c.o 00:01:56.584 [237/740] Generating lib/rte_stack_mingw with a custom command 00:01:56.584 [238/740] Generating lib/rte_stack_def with a custom command 00:01:56.584 [239/740] Compiling C object lib/librte_sched.a.p/sched_rte_pie.c.o 00:01:56.584 [240/740] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8636.c.o 00:01:56.584 [241/740] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_comp.c.o 00:01:56.584 [242/740] Compiling C object lib/librte_distributor.a.p/distributor_rte_distributor_single.c.o 00:01:56.584 [243/740] Compiling C object lib/librte_stack.a.p/stack_rte_stack_std.c.o 00:01:56.584 [244/740] Generating lib/cfgfile.sym_chk with a custom command (wrapped by meson to capture output) 00:01:56.584 [245/740] Compiling C object lib/librte_stack.a.p/stack_rte_stack_lf.c.o 00:01:56.584 [246/740] Compiling C object lib/librte_sched.a.p/sched_rte_red.c.o 00:01:56.584 [247/740] Compiling C object lib/librte_bpf.a.p/bpf_bpf_convert.c.o 00:01:56.584 [248/740] Compiling C object lib/librte_acl.a.p/acl_acl_gen.c.o 00:01:56.584 [249/740] Generating lib/rte_vhost_def with a custom command 00:01:56.584 [250/740] Compiling C object lib/librte_power.a.p/power_rte_power_empty_poll.c.o 00:01:56.584 [251/740] Compiling C object lib/librte_sched.a.p/sched_rte_approx.c.o 00:01:56.584 [252/740] Generating lib/rte_vhost_mingw with a custom command 00:01:56.584 [253/740] Compiling C object lib/librte_eventdev.a.p/eventdev_eventdev_trace_points.c.o 00:01:56.584 [254/740] Compiling C object lib/librte_stack.a.p/stack_rte_stack.c.o 00:01:56.584 [255/740] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev.c.o 00:01:56.584 [256/740] Linking static target lib/librte_stack.a 00:01:56.584 [257/740] Linking static target lib/librte_compressdev.a 00:01:56.584 [258/740] Generating lib/rte_ipsec_def with a custom command 00:01:56.584 [259/740] Generating lib/rte_ipsec_mingw with a custom command 00:01:56.584 [260/740] Compiling C object lib/librte_bpf.a.p/bpf_bpf_exec.c.o 00:01:56.584 [261/740] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_trace_points.c.o 00:01:56.584 [262/740] Compiling C object lib/librte_acl.a.p/acl_acl_run_scalar.c.o 00:01:56.584 [263/740] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool.c.o 00:01:56.584 [264/740] Generating lib/net.sym_chk with a custom command (wrapped by meson to capture output) 00:01:56.584 [265/740] Linking static target lib/librte_mempool.a 00:01:56.584 [266/740] Generating lib/bitratestats.sym_chk with a custom command (wrapped by meson to capture output) 00:01:56.584 [267/740] Compiling C object lib/librte_vhost.a.p/vhost_fd_man.c.o 00:01:56.584 [268/740] Compiling C object lib/librte_gso.a.p/gso_gso_tcp4.c.o 00:01:56.584 [269/740] Compiling C object lib/librte_gso.a.p/gso_gso_udp4.c.o 00:01:56.844 [270/740] Compiling C object lib/librte_gso.a.p/gso_gso_tunnel_udp4.c.o 00:01:56.844 [271/740] Generating lib/rte_fib_def with a custom command 00:01:56.844 [272/740] Generating lib/rte_fib_mingw with a custom command 00:01:56.844 [273/740] Compiling C object lib/librte_rcu.a.p/rcu_rte_rcu_qsbr.c.o 00:01:56.844 [274/740] Linking static target lib/librte_rcu.a 00:01:56.844 [275/740] Compiling C object lib/librte_gso.a.p/gso_rte_gso.c.o 00:01:56.844 [276/740] Generating lib/jobstats.sym_chk with a custom command (wrapped by meson to capture output) 00:01:56.844 [277/740] Generating lib/metrics.sym_chk with a custom command (wrapped by meson to capture output) 00:01:56.844 [278/740] Generating lib/timer.sym_chk with a custom command (wrapped by meson to capture output) 00:01:56.844 [279/740] Compiling C object lib/librte_gso.a.p/gso_gso_tunnel_tcp4.c.o 00:01:56.844 [280/740] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv4_reassembly.c.o 00:01:56.844 [281/740] Compiling C object lib/librte_bbdev.a.p/bbdev_rte_bbdev.c.o 00:01:56.844 [282/740] Generating lib/telemetry.sym_chk with a custom command (wrapped by meson to capture output) 00:01:56.844 [283/740] Linking static target lib/librte_bbdev.a 00:01:56.844 [284/740] Generating lib/rte_port_def with a custom command 00:01:56.844 [285/740] Compiling C object lib/librte_fib.a.p/fib_rte_fib.c.o 00:01:56.844 [286/740] Generating lib/rte_port_mingw with a custom command 00:01:56.844 [287/740] Compiling C object lib/librte_gro.a.p/gro_gro_tcp4.c.o 00:01:56.844 [288/740] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv6_reassembly.c.o 00:01:56.844 [289/740] Linking target lib/librte_telemetry.so.23.0 00:01:56.844 [290/740] Compiling C object lib/librte_rawdev.a.p/rawdev_rte_rawdev.c.o 00:01:56.844 [291/740] Linking static target lib/librte_rawdev.a 00:01:56.844 [292/740] Compiling C object lib/librte_gro.a.p/gro_gro_udp4.c.o 00:01:56.844 [293/740] Compiling C object lib/librte_hash.a.p/hash_rte_thash.c.o 00:01:56.844 [294/740] Generating lib/rte_pdump_mingw with a custom command 00:01:56.844 [295/740] Generating lib/rte_pdump_def with a custom command 00:01:56.844 [296/740] Compiling C object lib/librte_gro.a.p/gro_rte_gro.c.o 00:01:56.844 [297/740] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev.c.o 00:01:56.845 [298/740] Compiling C object lib/librte_member.a.p/member_rte_member.c.o 00:01:56.845 [299/740] Linking static target lib/librte_dmadev.a 00:01:56.845 [300/740] Generating lib/stack.sym_chk with a custom command (wrapped by meson to capture output) 00:01:56.845 [301/740] Compiling C object lib/librte_gro.a.p/gro_gro_vxlan_tcp4.c.o 00:01:56.845 [302/740] Compiling C object lib/librte_bpf.a.p/bpf_bpf_pkt.c.o 00:01:57.104 [303/740] Compiling C object lib/librte_gro.a.p/gro_gro_vxlan_udp4.c.o 00:01:57.104 [304/740] Compiling C object lib/librte_distributor.a.p/distributor_rte_distributor.c.o 00:01:57.104 [305/740] Linking static target lib/librte_gro.a 00:01:57.104 [306/740] Linking static target lib/librte_distributor.a 00:01:57.104 [307/740] Compiling C object lib/librte_gpudev.a.p/gpudev_gpudev.c.o 00:01:57.104 [308/740] Linking static target lib/librte_gpudev.a 00:01:57.104 [309/740] Compiling C object lib/librte_power.a.p/power_rte_power_intel_uncore.c.o 00:01:57.104 [310/740] Compiling C object lib/member/libsketch_avx512_tmp.a.p/rte_member_sketch_avx512.c.o 00:01:57.104 [311/740] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ip_frag_common.c.o 00:01:57.104 [312/740] Compiling C object lib/librte_latencystats.a.p/latencystats_rte_latencystats.c.o 00:01:57.104 [313/740] Linking static target lib/member/libsketch_avx512_tmp.a 00:01:57.104 [314/740] Linking static target lib/librte_latencystats.a 00:01:57.104 [315/740] Compiling C object lib/librte_power.a.p/power_power_acpi_cpufreq.c.o 00:01:57.104 [316/740] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv6_fragmentation.c.o 00:01:57.104 [317/740] Generating symbol file lib/librte_telemetry.so.23.0.p/librte_telemetry.so.23.0.symbols 00:01:57.104 [318/740] Compiling C object lib/librte_ip_frag.a.p/ip_frag_ip_frag_internal.c.o 00:01:57.104 [319/740] Compiling C object lib/librte_gso.a.p/gso_gso_common.c.o 00:01:57.104 [320/740] Linking static target lib/librte_gso.a 00:01:57.104 [321/740] Compiling C object lib/librte_table.a.p/table_rte_swx_keycmp.c.o 00:01:57.104 [322/740] Generating lib/rte_table_def with a custom command 00:01:57.104 [323/740] Generating lib/rte_table_mingw with a custom command 00:01:57.104 [324/740] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_options.c.o 00:01:57.104 [325/740] Compiling C object lib/librte_bpf.a.p/bpf_bpf_validate.c.o 00:01:57.104 [326/740] Compiling C object lib/librte_lpm.a.p/lpm_rte_lpm.c.o 00:01:57.104 [327/740] Compiling C object lib/librte_power.a.p/power_power_cppc_cpufreq.c.o 00:01:57.104 [328/740] Linking static target lib/librte_eal.a 00:01:57.104 [329/740] Generating lib/rcu.sym_chk with a custom command (wrapped by meson to capture output) 00:01:57.104 [330/740] Compiling C object lib/librte_power.a.p/power_rte_power_pmd_mgmt.c.o 00:01:57.104 [331/740] Compiling C object lib/librte_regexdev.a.p/regexdev_rte_regexdev.c.o 00:01:57.104 [332/740] Linking static target lib/librte_regexdev.a 00:01:57.402 [333/740] Compiling C object lib/librte_ipsec.a.p/ipsec_ses.c.o 00:01:57.402 [334/740] Generating lib/rte_pipeline_def with a custom command 00:01:57.402 [335/740] Compiling C object lib/librte_member.a.p/member_rte_member_vbf.c.o 00:01:57.402 [336/740] Generating lib/rte_pipeline_mingw with a custom command 00:01:57.402 [337/740] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv4_fragmentation.c.o 00:01:57.402 [338/740] Compiling C object lib/librte_table.a.p/table_rte_swx_table_learner.c.o 00:01:57.402 [339/740] Linking static target lib/librte_ip_frag.a 00:01:57.402 [340/740] Compiling C object lib/librte_fib.a.p/fib_rte_fib6.c.o 00:01:57.402 [341/740] Compiling C object lib/librte_reorder.a.p/reorder_rte_reorder.c.o 00:01:57.402 [342/740] Generating lib/gro.sym_chk with a custom command (wrapped by meson to capture output) 00:01:57.402 [343/740] Linking static target lib/librte_reorder.a 00:01:57.402 [344/740] Compiling C object lib/librte_vhost.a.p/vhost_vdpa.c.o 00:01:57.402 [345/740] Compiling C object lib/librte_rib.a.p/rib_rte_rib.c.o 00:01:57.402 [346/740] Compiling C object lib/librte_ipsec.a.p/ipsec_ipsec_telemetry.c.o 00:01:57.402 [347/740] Compiling C object lib/librte_vhost.a.p/vhost_iotlb.c.o 00:01:57.402 [348/740] Compiling C object lib/librte_power.a.p/power_power_pstate_cpufreq.c.o 00:01:57.402 [349/740] Linking static target lib/librte_power.a 00:01:57.402 [350/740] Generating lib/distributor.sym_chk with a custom command (wrapped by meson to capture output) 00:01:57.402 [351/740] Compiling C object lib/librte_table.a.p/table_rte_swx_table_em.c.o 00:01:57.402 [352/740] Generating lib/rte_graph_mingw with a custom command 00:01:57.402 [353/740] Generating lib/rte_graph_def with a custom command 00:01:57.402 [354/740] Compiling C object lib/librte_port.a.p/port_rte_port_sched.c.o 00:01:57.402 [355/740] Generating lib/gso.sym_chk with a custom command (wrapped by meson to capture output) 00:01:57.402 [356/740] Generating lib/latencystats.sym_chk with a custom command (wrapped by meson to capture output) 00:01:57.402 [357/740] Compiling C object lib/librte_pcapng.a.p/pcapng_rte_pcapng.c.o 00:01:57.402 [358/740] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf.c.o 00:01:57.402 [359/740] Linking static target lib/librte_pcapng.a 00:01:57.402 [360/740] Linking static target lib/librte_mbuf.a 00:01:57.402 [361/740] Compiling C object lib/librte_security.a.p/security_rte_security.c.o 00:01:57.402 [362/740] Linking static target lib/librte_security.a 00:01:57.402 [363/740] Compiling C object lib/librte_bpf.a.p/bpf_bpf_jit_x86.c.o 00:01:57.402 [364/740] Generating lib/rte_node_def with a custom command 00:01:57.402 [365/740] Linking static target lib/librte_bpf.a 00:01:57.402 [366/740] Compiling C object lib/librte_node.a.p/node_null.c.o 00:01:57.402 [367/740] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_timer_adapter.c.o 00:01:57.402 [368/740] Generating lib/cmdline.sym_chk with a custom command (wrapped by meson to capture output) 00:01:57.402 [369/740] Compiling C object lib/librte_fib.a.p/fib_trie_avx512.c.o 00:01:57.402 [370/740] Compiling C object lib/librte_fib.a.p/fib_dir24_8_avx512.c.o 00:01:57.402 [371/740] Generating lib/rte_node_mingw with a custom command 00:01:57.402 [372/740] Generating lib/rawdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:57.686 [373/740] Generating drivers/rte_bus_pci_def with a custom command 00:01:57.686 [374/740] Compiling C object lib/librte_ipsec.a.p/ipsec_sa.c.o 00:01:57.686 [375/740] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_params.c.o 00:01:57.686 [376/740] Generating drivers/rte_bus_pci_mingw with a custom command 00:01:57.687 [377/740] Compiling C object lib/librte_table.a.p/table_rte_table_array.c.o 00:01:57.687 [378/740] Generating lib/bbdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:57.687 [379/740] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_eth_tx_adapter.c.o 00:01:57.687 [380/740] Generating drivers/rte_bus_vdev_def with a custom command 00:01:57.687 [381/740] Compiling C object lib/librte_vhost.a.p/vhost_socket.c.o 00:01:57.687 [382/740] Compiling C object lib/librte_table.a.p/table_rte_swx_table_wm.c.o 00:01:57.687 [383/740] Compiling C object lib/librte_table.a.p/table_rte_swx_table_selector.c.o 00:01:57.687 [384/740] Compiling C object lib/librte_table.a.p/table_rte_table_hash_cuckoo.c.o 00:01:57.687 [385/740] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_crypto_adapter.c.o 00:01:57.687 [386/740] Generating lib/reorder.sym_chk with a custom command (wrapped by meson to capture output) 00:01:57.687 [387/740] Generating drivers/rte_bus_vdev_mingw with a custom command 00:01:57.687 [388/740] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev_params.c.o 00:01:57.687 [389/740] Compiling C object lib/librte_table.a.p/table_rte_table_stub.c.o 00:01:57.687 [390/740] Generating drivers/rte_mempool_ring_def with a custom command 00:01:57.687 [391/740] Generating drivers/rte_mempool_ring_mingw with a custom command 00:01:57.687 [392/740] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common_uio.c.o 00:01:57.687 [393/740] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_eventdev.c.o 00:01:57.687 [394/740] Generating lib/dmadev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:57.687 [395/740] Generating lib/ip_frag.sym_chk with a custom command (wrapped by meson to capture output) 00:01:57.687 [396/740] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_flow.c.o 00:01:57.687 [397/740] Generating lib/mempool.sym_chk with a custom command (wrapped by meson to capture output) 00:01:57.687 [398/740] Compiling C object lib/librte_rib.a.p/rib_rte_rib6.c.o 00:01:57.953 [399/740] Linking static target lib/librte_rib.a 00:01:57.953 [400/740] Compiling C object lib/librte_port.a.p/port_rte_port_frag.c.o 00:01:57.953 [401/740] Compiling C object lib/librte_port.a.p/port_rte_port_ras.c.o 00:01:57.953 [402/740] Compiling C object lib/librte_lpm.a.p/lpm_rte_lpm6.c.o 00:01:57.953 [403/740] Compiling C object lib/librte_table.a.p/table_rte_table_lpm_ipv6.c.o 00:01:57.953 [404/740] Linking static target lib/librte_lpm.a 00:01:57.953 [405/740] Compiling C object lib/librte_table.a.p/table_rte_table_lpm.c.o 00:01:57.953 [406/740] Compiling C object lib/librte_port.a.p/port_rte_swx_port_ethdev.c.o 00:01:57.953 [407/740] Generating lib/pcapng.sym_chk with a custom command (wrapped by meson to capture output) 00:01:57.953 [408/740] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_uio.c.o 00:01:57.953 [409/740] Generating drivers/rte_net_i40e_def with a custom command 00:01:57.953 [410/740] Compiling C object lib/librte_port.a.p/port_rte_swx_port_fd.c.o 00:01:57.953 [411/740] Generating drivers/rte_net_i40e_mingw with a custom command 00:01:57.953 [412/740] Compiling C object lib/librte_efd.a.p/efd_rte_efd.c.o 00:01:57.954 [413/740] Compiling C object lib/librte_port.a.p/port_rte_port_fd.c.o 00:01:57.954 [414/740] Compiling C object lib/librte_member.a.p/member_rte_member_ht.c.o 00:01:57.954 [415/740] Compiling C object lib/librte_table.a.p/table_rte_table_acl.c.o 00:01:57.954 [416/740] Compiling C object lib/librte_ipsec.a.p/ipsec_ipsec_sad.c.o 00:01:57.954 [417/740] Compiling C object lib/librte_graph.a.p/graph_graph_debug.c.o 00:01:57.954 [418/740] Linking static target lib/librte_efd.a 00:01:57.954 [419/740] Compiling C object lib/librte_graph.a.p/graph_graph_ops.c.o 00:01:57.954 [420/740] Generating lib/bpf.sym_chk with a custom command (wrapped by meson to capture output) 00:01:57.954 [421/740] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_port_in_action.c.o 00:01:57.954 [422/740] Compiling C object lib/librte_port.a.p/port_rte_port_ethdev.c.o 00:01:57.954 [423/740] Generating lib/compressdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:57.954 [424/740] Compiling C object lib/librte_port.a.p/port_rte_swx_port_source_sink.c.o 00:01:57.954 [425/740] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common.c.o 00:01:57.954 [426/740] Compiling C object lib/librte_port.a.p/port_rte_port_sym_crypto.c.o 00:01:57.954 [427/740] Compiling C object app/dpdk-test-cmdline.p/test-cmdline_cmdline_test.c.o 00:01:57.954 [428/740] Compiling C object lib/librte_graph.a.p/graph_graph_populate.c.o 00:01:57.954 [429/740] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev.c.o 00:01:57.954 [430/740] Linking static target drivers/libtmp_rte_bus_vdev.a 00:01:57.954 [431/740] Compiling C object app/dpdk-test-cmdline.p/test-cmdline_commands.c.o 00:01:57.954 [432/740] Compiling C object lib/librte_node.a.p/node_log.c.o 00:01:57.954 [433/740] Compiling C object lib/librte_node.a.p/node_pkt_drop.c.o 00:01:57.954 [434/740] Compiling C object lib/librte_fib.a.p/fib_trie.c.o 00:01:57.954 [435/740] Compiling C object lib/librte_graph.a.p/graph_node.c.o 00:01:57.954 [436/740] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_vfio.c.o 00:01:58.218 [437/740] Compiling C object lib/librte_port.a.p/port_rte_port_eventdev.c.o 00:01:58.218 [438/740] Compiling C object lib/librte_node.a.p/node_ethdev_ctrl.c.o 00:01:58.218 [439/740] Compiling C object lib/librte_port.a.p/port_rte_port_source_sink.c.o 00:01:58.218 [440/740] Compiling C object lib/librte_graph.a.p/graph_graph.c.o 00:01:58.218 [441/740] Compiling C object lib/librte_graph.a.p/graph_graph_stats.c.o 00:01:58.218 [442/740] Generating lib/security.sym_chk with a custom command (wrapped by meson to capture output) 00:01:58.218 [443/740] Linking static target lib/librte_graph.a 00:01:58.218 [444/740] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_main.c.o 00:01:58.218 [445/740] Compiling C object lib/librte_node.a.p/node_ethdev_tx.c.o 00:01:58.218 [446/740] Compiling C object lib/librte_acl.a.p/acl_acl_bld.c.o 00:01:58.218 [447/740] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_evt_test.c.o 00:01:58.218 [448/740] Generating lib/efd.sym_chk with a custom command (wrapped by meson to capture output) 00:01:58.218 [449/740] Generating lib/mbuf.sym_chk with a custom command (wrapped by meson to capture output) 00:01:58.218 [450/740] Generating lib/gpudev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:58.218 [451/740] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci.c.o 00:01:58.218 [452/740] Compiling C object lib/librte_fib.a.p/fib_dir24_8.c.o 00:01:58.218 [453/740] Linking static target drivers/libtmp_rte_bus_pci.a 00:01:58.218 [454/740] Linking static target lib/librte_fib.a 00:01:58.218 [455/740] Compiling C object lib/librte_table.a.p/table_rte_table_hash_key8.c.o 00:01:58.218 [456/740] Generating lib/regexdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:58.218 [457/740] Compiling C object lib/librte_port.a.p/port_rte_swx_port_ring.c.o 00:01:58.218 [458/740] Compiling C object lib/librte_node.a.p/node_ethdev_rx.c.o 00:01:58.481 [459/740] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_diag.c.o 00:01:58.481 [460/740] Generating drivers/rte_bus_vdev.pmd.c with a custom command 00:01:58.481 [461/740] Generating lib/lpm.sym_chk with a custom command (wrapped by meson to capture output) 00:01:58.481 [462/740] Compiling C object drivers/librte_bus_vdev.a.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:58.481 [463/740] Compiling C object drivers/librte_bus_vdev.so.23.0.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:58.481 [464/740] Linking static target drivers/librte_bus_vdev.a 00:01:58.481 [465/740] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_parser.c.o 00:01:58.481 [466/740] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_hmc.c.o 00:01:58.481 [467/740] Generating lib/rib.sym_chk with a custom command (wrapped by meson to capture output) 00:01:58.481 [468/740] Compiling C object lib/librte_vhost.a.p/vhost_vhost.c.o 00:01:58.481 [469/740] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_pipeline.c.o 00:01:58.481 [470/740] Compiling C object lib/librte_pdump.a.p/pdump_rte_pdump.c.o 00:01:58.481 [471/740] Linking static target lib/librte_pdump.a 00:01:58.481 [472/740] Compiling C object lib/librte_vhost.a.p/vhost_vhost_user.c.o 00:01:58.741 [473/740] Compiling C object lib/librte_table.a.p/table_rte_table_hash_ext.c.o 00:01:58.741 [474/740] Compiling C object lib/librte_table.a.p/table_rte_table_hash_key16.c.o 00:01:58.741 [475/740] Compiling C object lib/librte_node.a.p/node_pkt_cls.c.o 00:01:58.741 [476/740] Generating drivers/rte_bus_pci.pmd.c with a custom command 00:01:58.741 [477/740] Compiling C object drivers/librte_bus_pci.a.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:58.741 [478/740] Linking static target drivers/librte_bus_pci.a 00:01:58.741 [479/740] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_vf_representor.c.o 00:01:58.741 [480/740] Compiling C object lib/librte_acl.a.p/acl_acl_run_sse.c.o 00:01:58.741 [481/740] Generating lib/power.sym_chk with a custom command (wrapped by meson to capture output) 00:01:58.741 [482/740] Generating drivers/rte_bus_vdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:58.741 [483/740] Compiling C object drivers/librte_bus_pci.so.23.0.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:58.741 [484/740] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_dcb.c.o 00:01:58.741 [485/740] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_common.c.o 00:01:58.741 [486/740] Compiling C object lib/librte_table.a.p/table_rte_table_hash_lru.c.o 00:01:58.741 [487/740] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_options_parse.c.o 00:01:58.741 [488/740] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_main.c.o 00:01:58.741 [489/740] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_vectors.c.o 00:01:58.741 [490/740] Generating lib/fib.sym_chk with a custom command (wrapped by meson to capture output) 00:01:59.001 [491/740] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_lan_hmc.c.o 00:01:59.001 [492/740] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_evt_main.c.o 00:01:59.001 [493/740] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_tm.c.o 00:01:59.001 [494/740] Compiling C object lib/librte_table.a.p/table_rte_table_hash_key32.c.o 00:01:59.001 [495/740] Linking static target lib/librte_table.a 00:01:59.001 [496/740] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_evt_options.c.o 00:01:59.001 [497/740] Generating lib/pdump.sym_chk with a custom command (wrapped by meson to capture output) 00:01:59.001 [498/740] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_vector_parsing.c.o 00:01:59.001 [499/740] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_hash.c.o 00:01:59.001 [500/740] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_adminq.c.o 00:01:59.001 [501/740] Compiling C object app/dpdk-test-acl.p/test-acl_main.c.o 00:01:59.001 [502/740] Compiling C object lib/librte_cryptodev.a.p/cryptodev_rte_cryptodev.c.o 00:01:59.001 [503/740] Linking static target lib/librte_cryptodev.a 00:01:59.001 [504/740] Compiling C object lib/librte_node.a.p/node_ip4_lookup.c.o 00:01:59.001 [505/740] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_flow_gen.c.o 00:01:59.001 [506/740] Compiling C object lib/librte_sched.a.p/sched_rte_sched.c.o 00:01:59.001 [507/740] Compiling C object app/dpdk-dumpcap.p/dumpcap_main.c.o 00:01:59.260 [508/740] Linking static target lib/librte_sched.a 00:01:59.260 [509/740] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_items_gen.c.o 00:01:59.260 [510/740] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_order_common.c.o 00:01:59.260 [511/740] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_throughput.c.o 00:01:59.260 [512/740] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_main.c.o 00:01:59.260 [513/740] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_config.c.o 00:01:59.260 [514/740] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_init.c.o 00:01:59.260 [515/740] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_ops.c.o 00:01:59.260 [516/740] Compiling C object lib/librte_ipsec.a.p/ipsec_esp_outb.c.o 00:01:59.260 [517/740] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_options_parsing.c.o 00:01:59.260 [518/740] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_ctl.c.o 00:01:59.260 [519/740] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_main.c.o 00:01:59.260 [520/740] Compiling C object app/dpdk-test-gpudev.p/test-gpudev_main.c.o 00:01:59.260 [521/740] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_acl.c.o 00:01:59.260 [522/740] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_lpm.c.o 00:01:59.260 [523/740] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_order_atq.c.o 00:01:59.260 [524/740] Generating drivers/rte_bus_pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:59.260 [525/740] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_nvm.c.o 00:01:59.260 [526/740] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_throughput.c.o 00:01:59.260 [527/740] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_order_queue.c.o 00:01:59.260 [528/740] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_stub.c.o 00:01:59.260 [529/740] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_verify.c.o 00:01:59.260 [530/740] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_lpm_ipv6.c.o 00:01:59.260 [531/740] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev.c.o 00:01:59.519 [532/740] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_pmd_cyclecount.c.o 00:01:59.519 [533/740] Compiling C object lib/librte_node.a.p/node_ip4_rewrite.c.o 00:01:59.519 [534/740] Linking static target lib/librte_node.a 00:01:59.519 [535/740] Linking static target lib/librte_ethdev.a 00:01:59.519 [536/740] Generating lib/graph.sym_chk with a custom command (wrapped by meson to capture output) 00:01:59.519 [537/740] Compiling C object lib/librte_ipsec.a.p/ipsec_esp_inb.c.o 00:01:59.519 [538/740] Compiling C object drivers/libtmp_rte_mempool_ring.a.p/mempool_ring_rte_mempool_ring.c.o 00:01:59.519 [539/740] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_pf.c.o 00:01:59.519 [540/740] Linking static target drivers/libtmp_rte_mempool_ring.a 00:01:59.519 [541/740] Linking static target lib/librte_ipsec.a 00:01:59.519 [542/740] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_latency.c.o 00:01:59.519 [543/740] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_verify.c.o 00:01:59.519 [544/740] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_hash.c.o 00:01:59.519 [545/740] Compiling C object app/dpdk-proc-info.p/proc-info_main.c.o 00:01:59.519 [546/740] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_actions_gen.c.o 00:01:59.519 [547/740] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_test_bbdev.c.o 00:01:59.519 [548/740] Compiling C object lib/librte_member.a.p/member_rte_member_sketch.c.o 00:01:59.519 [549/740] Compiling C object app/dpdk-testpmd.p/test-pmd_cmd_flex_item.c.o 00:01:59.519 [550/740] Linking static target lib/librte_member.a 00:01:59.519 [551/740] Compiling C object app/dpdk-pdump.p/pdump_main.c.o 00:01:59.519 [552/740] Generating drivers/rte_mempool_ring.pmd.c with a custom command 00:01:59.519 [553/740] Compiling C object drivers/librte_mempool_ring.a.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:59.519 [554/740] Compiling C object drivers/librte_mempool_ring.so.23.0.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:59.519 [555/740] Generating lib/sched.sym_chk with a custom command (wrapped by meson to capture output) 00:01:59.519 [556/740] Linking static target drivers/librte_mempool_ring.a 00:01:59.777 [557/740] Generating lib/node.sym_chk with a custom command (wrapped by meson to capture output) 00:01:59.777 [558/740] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_test_bbdev_vector.c.o 00:01:59.777 [559/740] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_common.c.o 00:01:59.777 [560/740] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_cyclecount.c.o 00:01:59.777 [561/740] Compiling C object app/dpdk-testpmd.p/test-pmd_bpf_cmd.c.o 00:01:59.777 [562/740] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_eth_rx_adapter.c.o 00:01:59.777 [563/740] Compiling C object app/dpdk-testpmd.p/test-pmd_macfwd.c.o 00:01:59.777 [564/740] Linking static target lib/librte_eventdev.a 00:01:59.777 [565/740] Generating lib/table.sym_chk with a custom command (wrapped by meson to capture output) 00:01:59.777 [566/740] Compiling C object lib/librte_acl.a.p/acl_acl_run_avx2.c.o 00:01:59.777 [567/740] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_perf_atq.c.o 00:01:59.777 [568/740] Compiling C object app/dpdk-test-fib.p/test-fib_main.c.o 00:01:59.777 [569/740] Compiling C object app/dpdk-testpmd.p/test-pmd_ieee1588fwd.c.o 00:01:59.777 [570/740] Generating lib/ipsec.sym_chk with a custom command (wrapped by meson to capture output) 00:01:59.777 [571/740] Compiling C object app/dpdk-test-security-perf.p/test-security-perf_test_security_perf.c.o 00:01:59.777 [572/740] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_pipeline_common.c.o 00:01:59.777 [573/740] Compiling C object app/dpdk-testpmd.p/test-pmd_5tswap.c.o 00:01:59.777 [574/740] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_mtr.c.o 00:01:59.777 [575/740] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_tm.c.o 00:01:59.777 [576/740] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_flow.c.o 00:01:59.777 [577/740] Compiling C object lib/librte_hash.a.p/hash_rte_cuckoo_hash.c.o 00:01:59.777 [578/740] Linking static target lib/librte_hash.a 00:01:59.777 [579/740] Compiling C object lib/librte_port.a.p/port_rte_port_ring.c.o 00:01:59.777 [580/740] Compiling C object app/dpdk-test-sad.p/test-sad_main.c.o 00:01:59.777 [581/740] Linking static target lib/librte_port.a 00:01:59.777 [582/740] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_pipeline_atq.c.o 00:01:59.777 [583/740] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_perf_queue.c.o 00:02:00.036 [584/740] Compiling C object app/dpdk-testpmd.p/test-pmd_flowgen.c.o 00:02:00.036 [585/740] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_pipeline_queue.c.o 00:02:00.036 [586/740] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_fdir.c.o 00:02:00.036 [587/740] Compiling C object app/dpdk-testpmd.p/test-pmd_icmpecho.c.o 00:02:00.036 [588/740] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_runtime.c.o 00:02:00.036 [589/740] Compiling C object app/dpdk-testpmd.p/test-pmd_iofwd.c.o 00:02:00.036 [590/740] Generating lib/member.sym_chk with a custom command (wrapped by meson to capture output) 00:02:00.036 [591/740] Compiling C object app/dpdk-testpmd.p/test-pmd_rxonly.c.o 00:02:00.036 [592/740] Compiling C object app/dpdk-testpmd.p/test-pmd_shared_rxq_fwd.c.o 00:02:00.036 [593/740] Compiling C object app/dpdk-testpmd.p/test-pmd_macswap.c.o 00:02:00.036 [594/740] Compiling C object app/dpdk-testpmd.p/.._drivers_net_i40e_i40e_testpmd.c.o 00:02:00.036 [595/740] Compiling C object app/dpdk-test-regex.p/test-regex_main.c.o 00:02:00.036 [596/740] Compiling C object app/dpdk-testpmd.p/test-pmd_util.c.o 00:02:00.036 [597/740] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_main.c.o 00:02:00.294 [598/740] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_rte_pmd_i40e.c.o 00:02:00.295 [599/740] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_rxtx_vec_sse.c.o 00:02:00.295 [600/740] Compiling C object app/dpdk-testpmd.p/test-pmd_parameters.c.o 00:02:00.295 [601/740] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_pipeline_spec.c.o 00:02:00.295 [602/740] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_rxtx_vec_avx2.c.o 00:02:00.295 [603/740] Compiling C object app/dpdk-test-security-perf.p/test_test_cryptodev_security_ipsec.c.o 00:02:00.295 [604/740] Compiling C object lib/librte_acl.a.p/acl_acl_run_avx512.c.o 00:02:00.295 [605/740] Linking static target lib/librte_acl.a 00:02:00.295 [606/740] Compiling C object drivers/net/i40e/libi40e_avx512_lib.a.p/i40e_rxtx_vec_avx512.c.o 00:02:00.295 [607/740] Linking static target drivers/net/i40e/libi40e_avx512_lib.a 00:02:00.553 [608/740] Compiling C object app/dpdk-testpmd.p/test-pmd_txonly.c.o 00:02:00.553 [609/740] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_common.c.o 00:02:00.553 [610/740] Linking static target drivers/net/i40e/base/libi40e_base.a 00:02:00.553 [611/740] Generating lib/port.sym_chk with a custom command (wrapped by meson to capture output) 00:02:00.812 [612/740] Compiling C object app/dpdk-testpmd.p/test-pmd_csumonly.c.o 00:02:00.812 [613/740] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_perf_common.c.o 00:02:00.812 [614/740] Generating lib/acl.sym_chk with a custom command (wrapped by meson to capture output) 00:02:00.812 [615/740] Generating lib/hash.sym_chk with a custom command (wrapped by meson to capture output) 00:02:00.812 [616/740] Compiling C object app/dpdk-testpmd.p/test-pmd_testpmd.c.o 00:02:01.071 [617/740] Compiling C object app/dpdk-testpmd.p/test-pmd_noisy_vnf.c.o 00:02:01.071 [618/740] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline.c.o 00:02:01.638 [619/740] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_rxtx.c.o 00:02:01.897 [620/740] Compiling C object app/dpdk-testpmd.p/test-pmd_config.c.o 00:02:01.897 [621/740] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_flow.c.o 00:02:01.897 [622/740] Generating lib/cryptodev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:02.469 [623/740] Generating lib/eventdev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:02.469 [624/740] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_ethdev.c.o 00:02:02.469 [625/740] Linking static target drivers/libtmp_rte_net_i40e.a 00:02:02.729 [626/740] Generating drivers/rte_net_i40e.pmd.c with a custom command 00:02:02.729 [627/740] Compiling C object drivers/librte_net_i40e.so.23.0.p/meson-generated_.._rte_net_i40e.pmd.c.o 00:02:02.729 [628/740] Compiling C object drivers/librte_net_i40e.a.p/meson-generated_.._rte_net_i40e.pmd.c.o 00:02:02.729 [629/740] Linking static target drivers/librte_net_i40e.a 00:02:03.296 [630/740] Compiling C object lib/librte_vhost.a.p/vhost_vhost_crypto.c.o 00:02:03.554 [631/740] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_test_bbdev_perf.c.o 00:02:03.554 [632/740] Generating drivers/rte_net_i40e.sym_chk with a custom command (wrapped by meson to capture output) 00:02:03.813 [633/740] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_pipeline.c.o 00:02:06.350 [634/740] Generating lib/ethdev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:08.255 [635/740] Generating lib/eal.sym_chk with a custom command (wrapped by meson to capture output) 00:02:08.255 [636/740] Linking target lib/librte_eal.so.23.0 00:02:08.514 [637/740] Generating symbol file lib/librte_eal.so.23.0.p/librte_eal.so.23.0.symbols 00:02:08.514 [638/740] Linking target lib/librte_pci.so.23.0 00:02:08.514 [639/740] Linking target lib/librte_jobstats.so.23.0 00:02:08.514 [640/740] Linking target lib/librte_meter.so.23.0 00:02:08.514 [641/740] Linking target lib/librte_ring.so.23.0 00:02:08.514 [642/740] Linking target lib/librte_timer.so.23.0 00:02:08.514 [643/740] Linking target lib/librte_cfgfile.so.23.0 00:02:08.514 [644/740] Linking target lib/librte_rawdev.so.23.0 00:02:08.514 [645/740] Linking target lib/librte_stack.so.23.0 00:02:08.514 [646/740] Linking target lib/librte_dmadev.so.23.0 00:02:08.514 [647/740] Linking target drivers/librte_bus_vdev.so.23.0 00:02:08.515 [648/740] Linking target lib/librte_graph.so.23.0 00:02:08.515 [649/740] Linking target lib/librte_acl.so.23.0 00:02:08.515 [650/740] Generating symbol file lib/librte_pci.so.23.0.p/librte_pci.so.23.0.symbols 00:02:08.515 [651/740] Generating symbol file lib/librte_acl.so.23.0.p/librte_acl.so.23.0.symbols 00:02:08.515 [652/740] Generating symbol file lib/librte_dmadev.so.23.0.p/librte_dmadev.so.23.0.symbols 00:02:08.515 [653/740] Generating symbol file lib/librte_timer.so.23.0.p/librte_timer.so.23.0.symbols 00:02:08.515 [654/740] Generating symbol file lib/librte_meter.so.23.0.p/librte_meter.so.23.0.symbols 00:02:08.515 [655/740] Generating symbol file drivers/librte_bus_vdev.so.23.0.p/librte_bus_vdev.so.23.0.symbols 00:02:08.515 [656/740] Generating symbol file lib/librte_ring.so.23.0.p/librte_ring.so.23.0.symbols 00:02:08.515 [657/740] Generating symbol file lib/librte_graph.so.23.0.p/librte_graph.so.23.0.symbols 00:02:08.515 [658/740] Linking target drivers/librte_bus_pci.so.23.0 00:02:08.773 [659/740] Linking target lib/librte_mempool.so.23.0 00:02:08.773 [660/740] Linking target lib/librte_rcu.so.23.0 00:02:08.773 [661/740] Generating symbol file drivers/librte_bus_pci.so.23.0.p/librte_bus_pci.so.23.0.symbols 00:02:08.773 [662/740] Generating symbol file lib/librte_mempool.so.23.0.p/librte_mempool.so.23.0.symbols 00:02:08.773 [663/740] Generating symbol file lib/librte_rcu.so.23.0.p/librte_rcu.so.23.0.symbols 00:02:08.773 [664/740] Linking target lib/librte_rib.so.23.0 00:02:08.773 [665/740] Linking target drivers/librte_mempool_ring.so.23.0 00:02:08.773 [666/740] Linking target lib/librte_mbuf.so.23.0 00:02:09.031 [667/740] Generating symbol file lib/librte_rib.so.23.0.p/librte_rib.so.23.0.symbols 00:02:09.031 [668/740] Generating symbol file lib/librte_mbuf.so.23.0.p/librte_mbuf.so.23.0.symbols 00:02:09.031 [669/740] Linking target lib/librte_fib.so.23.0 00:02:09.031 [670/740] Linking target lib/librte_compressdev.so.23.0 00:02:09.031 [671/740] Linking target lib/librte_sched.so.23.0 00:02:09.031 [672/740] Linking target lib/librte_bbdev.so.23.0 00:02:09.031 [673/740] Linking target lib/librte_distributor.so.23.0 00:02:09.031 [674/740] Linking target lib/librte_net.so.23.0 00:02:09.031 [675/740] Linking target lib/librte_reorder.so.23.0 00:02:09.031 [676/740] Linking target lib/librte_cryptodev.so.23.0 00:02:09.031 [677/740] Linking target lib/librte_gpudev.so.23.0 00:02:09.031 [678/740] Linking target lib/librte_regexdev.so.23.0 00:02:09.031 [679/740] Generating symbol file lib/librte_sched.so.23.0.p/librte_sched.so.23.0.symbols 00:02:09.031 [680/740] Generating symbol file lib/librte_cryptodev.so.23.0.p/librte_cryptodev.so.23.0.symbols 00:02:09.031 [681/740] Generating symbol file lib/librte_net.so.23.0.p/librte_net.so.23.0.symbols 00:02:09.289 [682/740] Linking target lib/librte_security.so.23.0 00:02:09.289 [683/740] Linking target lib/librte_cmdline.so.23.0 00:02:09.289 [684/740] Linking target lib/librte_hash.so.23.0 00:02:09.289 [685/740] Linking target lib/librte_ethdev.so.23.0 00:02:09.289 [686/740] Generating symbol file lib/librte_hash.so.23.0.p/librte_hash.so.23.0.symbols 00:02:09.289 [687/740] Generating symbol file lib/librte_security.so.23.0.p/librte_security.so.23.0.symbols 00:02:09.289 [688/740] Generating symbol file lib/librte_ethdev.so.23.0.p/librte_ethdev.so.23.0.symbols 00:02:09.289 [689/740] Linking target lib/librte_lpm.so.23.0 00:02:09.289 [690/740] Linking target lib/librte_efd.so.23.0 00:02:09.289 [691/740] Linking target lib/librte_member.so.23.0 00:02:09.289 [692/740] Linking target lib/librte_ipsec.so.23.0 00:02:09.289 [693/740] Linking target lib/librte_gro.so.23.0 00:02:09.289 [694/740] Linking target lib/librte_power.so.23.0 00:02:09.289 [695/740] Linking target lib/librte_metrics.so.23.0 00:02:09.289 [696/740] Linking target lib/librte_pcapng.so.23.0 00:02:09.289 [697/740] Linking target lib/librte_gso.so.23.0 00:02:09.289 [698/740] Linking target lib/librte_eventdev.so.23.0 00:02:09.289 [699/740] Linking target lib/librte_ip_frag.so.23.0 00:02:09.289 [700/740] Linking target lib/librte_bpf.so.23.0 00:02:09.547 [701/740] Linking target drivers/librte_net_i40e.so.23.0 00:02:09.547 [702/740] Generating symbol file lib/librte_lpm.so.23.0.p/librte_lpm.so.23.0.symbols 00:02:09.547 [703/740] Generating symbol file lib/librte_bpf.so.23.0.p/librte_bpf.so.23.0.symbols 00:02:09.547 [704/740] Generating symbol file lib/librte_eventdev.so.23.0.p/librte_eventdev.so.23.0.symbols 00:02:09.547 [705/740] Generating symbol file lib/librte_metrics.so.23.0.p/librte_metrics.so.23.0.symbols 00:02:09.547 [706/740] Generating symbol file lib/librte_pcapng.so.23.0.p/librte_pcapng.so.23.0.symbols 00:02:09.547 [707/740] Generating symbol file lib/librte_ip_frag.so.23.0.p/librte_ip_frag.so.23.0.symbols 00:02:09.547 [708/740] Linking target lib/librte_node.so.23.0 00:02:09.547 [709/740] Linking target lib/librte_bitratestats.so.23.0 00:02:09.547 [710/740] Linking target lib/librte_latencystats.so.23.0 00:02:09.547 [711/740] Linking target lib/librte_pdump.so.23.0 00:02:09.547 [712/740] Linking target lib/librte_port.so.23.0 00:02:09.805 [713/740] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net.c.o 00:02:09.805 [714/740] Generating symbol file lib/librte_port.so.23.0.p/librte_port.so.23.0.symbols 00:02:09.805 [715/740] Linking static target lib/librte_vhost.a 00:02:09.805 [716/740] Linking target lib/librte_table.so.23.0 00:02:09.805 [717/740] Generating symbol file lib/librte_table.so.23.0.p/librte_table.so.23.0.symbols 00:02:10.735 [718/740] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_table_action.c.o 00:02:10.735 [719/740] Linking static target lib/librte_pipeline.a 00:02:10.994 [720/740] Linking target app/dpdk-test-fib 00:02:10.994 [721/740] Linking target app/dpdk-pdump 00:02:10.994 [722/740] Linking target app/dpdk-dumpcap 00:02:10.994 [723/740] Linking target app/dpdk-test-cmdline 00:02:10.994 [724/740] Linking target app/dpdk-test-acl 00:02:10.994 [725/740] Linking target app/dpdk-test-crypto-perf 00:02:10.994 [726/740] Linking target app/dpdk-proc-info 00:02:10.994 [727/740] Linking target app/dpdk-test-eventdev 00:02:10.994 [728/740] Linking target app/dpdk-test-pipeline 00:02:10.994 [729/740] Linking target app/dpdk-test-bbdev 00:02:10.994 [730/740] Linking target app/dpdk-test-regex 00:02:10.994 [731/740] Linking target app/dpdk-test-sad 00:02:10.994 [732/740] Linking target app/dpdk-test-gpudev 00:02:10.994 [733/740] Linking target app/dpdk-test-compress-perf 00:02:10.994 [734/740] Linking target app/dpdk-test-flow-perf 00:02:10.994 [735/740] Linking target app/dpdk-test-security-perf 00:02:10.994 [736/740] Linking target app/dpdk-testpmd 00:02:11.253 [737/740] Generating lib/vhost.sym_chk with a custom command (wrapped by meson to capture output) 00:02:11.513 [738/740] Linking target lib/librte_vhost.so.23.0 00:02:14.800 [739/740] Generating lib/pipeline.sym_chk with a custom command (wrapped by meson to capture output) 00:02:14.800 [740/740] Linking target lib/librte_pipeline.so.23.0 00:02:15.059 18:48:31 -- common/autobuild_common.sh@190 -- $ ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp -j96 install 00:02:15.059 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp' 00:02:15.059 [0/1] Installing files. 00:02:15.324 Installing subdir /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples 00:02:15.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:15.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:15.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/em_default_v4.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:15.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:15.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_hlm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:15.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_route.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:15.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:15.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_acl.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:15.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:15.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:15.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_acl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:15.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:15.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_hlm_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:15.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/lpm_route_parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:15.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_altivec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:15.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:15.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm_altivec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:15.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_fib.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:15.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event_generic.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:15.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/lpm_default_v6.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:15.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event_internal_port.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:15.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_sequential.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:15.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:15.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_hlm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:15.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:15.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:15.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/em_route_parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:15.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/lpm_default_v4.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:15.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:15.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:15.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/em_default_v6.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:15.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_acl_scalar.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:15.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:15.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq_dcb/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq_dcb 00:02:15.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq_dcb/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq_dcb 00:02:15.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_filtering/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_filtering 00:02:15.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_filtering/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_filtering 00:02:15.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_filtering/flow_blocks.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_filtering 00:02:15.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_classify/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_classify 00:02:15.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_classify/flow_classify.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_classify 00:02:15.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_classify/ipv4_rules_file.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_classify 00:02:15.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event_internal_port.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:15.324 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event_generic.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_poll.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_common.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_poll.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/commands.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/parse_obj_list.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/commands.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/parse_obj_list.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/pkt_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/neon/port_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common/neon 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/altivec/port_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common/altivec 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/sse/port_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common/sse 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ptpclient/ptpclient.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ptpclient 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ptpclient/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ptpclient 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/helloworld/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/helloworld 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/helloworld/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/helloworld 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/rxtx_callbacks/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/rxtx_callbacks 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/rxtx_callbacks/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/rxtx_callbacks 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/oob_monitor_x86.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/vm_power_cli.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_manager.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_monitor.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_monitor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/oob_monitor_nop.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/parse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_manager.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/vm_power_cli.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/power_manager.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/oob_monitor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/power_manager.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/parse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/vm_power_cli_guest.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/vm_power_cli_guest.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/app_thread.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile_ov.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/args.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/cfg_file.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/init.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/cmdline.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/cfg_file.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/stats.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile_red.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile_pie.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/l2fwd-cat.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/cat.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/cat.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/perf_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/perf_core.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:15.325 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:02:15.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:02:15.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/vdpa_blk_compact.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:02:15.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/virtio_net.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:02:15.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:02:15.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:02:15.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:02:15.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/blk_spec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:15.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/vhost_blk.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:15.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/vhost_blk_compat.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:15.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/vhost_blk.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:15.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:15.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/blk.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:15.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_ecdsa.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:15.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_aes.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:15.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_sha.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:15.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_tdes.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:15.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:15.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:15.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_dev_self_test.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:15.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_rsa.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:15.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:15.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_dev_self_test.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:15.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_gcm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:15.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_cmac.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:15.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_xts.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:15.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_hmac.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:15.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_ccm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:15.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:15.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bond/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bond 00:02:15.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bond/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bond 00:02:15.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bond/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bond 00:02:15.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/dma/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/dma 00:02:15.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/dma/dmafwd.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/dma 00:02:15.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process 00:02:15.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/commands.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:02:15.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/commands.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:02:15.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:02:15.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:02:15.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/mp_commands.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:02:15.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:02:15.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:02:15.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/mp_commands.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:02:15.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/symmetric_mp/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/symmetric_mp 00:02:15.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/symmetric_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/symmetric_mp 00:02:15.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp 00:02:15.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/args.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:15.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/args.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:15.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/init.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:15.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:15.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:15.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/init.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:15.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_client/client.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_client 00:02:15.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_client/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_client 00:02:15.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/shared/common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/shared 00:02:15.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-graph/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-graph 00:02:15.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-graph/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-graph 00:02:15.326 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-jobstats/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-jobstats 00:02:15.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-jobstats/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-jobstats 00:02:15.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_fragmentation/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_fragmentation 00:02:15.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_fragmentation/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_fragmentation 00:02:15.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/packet_ordering/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/packet_ordering 00:02:15.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/packet_ordering/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/packet_ordering 00:02:15.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-crypto/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-crypto 00:02:15.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-crypto/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-crypto 00:02:15.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/shm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:02:15.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:02:15.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:02:15.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/shm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:02:15.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/ka-agent/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive/ka-agent 00:02:15.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/ka-agent/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive/ka-agent 00:02:15.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/skeleton/basicfwd.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/skeleton 00:02:15.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/skeleton/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/skeleton 00:02:15.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/service_cores/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/service_cores 00:02:15.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/service_cores/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/service_cores 00:02:15.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/distributor/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/distributor 00:02:15.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/distributor/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/distributor 00:02:15.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/pipeline_worker_tx.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:15.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/pipeline_worker_generic.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:15.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:15.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:15.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/pipeline_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:15.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/esp.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:15.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/event_helper.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:15.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_worker.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:15.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:15.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipip.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:15.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ep1.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:15.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sp4.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:15.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:15.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/flow.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:15.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_process.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:15.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/flow.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:15.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:15.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/rt.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:15.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_worker.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:15.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_lpm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:15.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sa.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:15.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/event_helper.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:15.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sad.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:15.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:15.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sad.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:15.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/esp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:15.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec-secgw.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:15.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sp6.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:15.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/parser.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:15.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ep0.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:15.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/parser.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:15.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec-secgw.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:15.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:15.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_3descbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:15.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_3descbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:15.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aescbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:15.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/load_env.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:15.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesctr_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:15.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_null_header_reconstruct.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:15.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/run_test.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:15.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesgcm_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:15.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/common_defs_secgw.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:15.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_3descbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:15.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesctr_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:15.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesctr_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:15.327 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/data_rxtx.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:15.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/bypass_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:15.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_ipv6opts.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:15.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesgcm_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:15.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesgcm_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:15.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesctr_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:15.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/pkttest.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:15.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesgcm_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:15.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aescbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:15.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/pkttest.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:15.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_3descbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:15.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/linux_test.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:15.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aescbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:15.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aescbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:15.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipv4_multicast/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipv4_multicast 00:02:15.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipv4_multicast/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipv4_multicast 00:02:15.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd 00:02:15.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/server/args.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/server 00:02:15.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/server/args.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/server 00:02:15.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/server/init.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/server 00:02:15.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/server/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/server 00:02:15.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/server/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/server 00:02:15.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/server/init.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/server 00:02:15.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/node/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/node 00:02:15.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/node/node.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/node 00:02:15.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/shared/common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/shared 00:02:15.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/thread.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:15.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cli.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:15.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/action.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:15.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tap.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:15.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tmgr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:15.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/swq.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:15.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/thread.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:15.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/pipeline.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:15.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/kni.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:15.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/swq.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:15.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/action.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:15.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/conn.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:15.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tap.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:15.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/link.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:15.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:15.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cryptodev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:15.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/mempool.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:15.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:15.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/conn.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:15.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/parser.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:15.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/link.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:15.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cryptodev.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:15.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:15.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/parser.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:15.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cli.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:15.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/pipeline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:15.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/mempool.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:15.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tmgr.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:15.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/kni.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:15.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/route_ecmp.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:15.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/rss.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:15.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/flow.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:15.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/kni.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:15.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/firewall.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:15.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/tap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:15.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/l2fwd.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:15.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/route.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:15.328 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/flow_crypto.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:15.329 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/t1.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:15.329 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/t3.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:15.329 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/README to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:15.329 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/dummy.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:15.329 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/t2.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:15.329 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq 00:02:15.329 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq 00:02:15.329 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/link_status_interrupt/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/link_status_interrupt 00:02:15.329 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/link_status_interrupt/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/link_status_interrupt 00:02:15.329 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_reassembly/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_reassembly 00:02:15.329 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_reassembly/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_reassembly 00:02:15.329 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bbdev_app/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bbdev_app 00:02:15.329 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bbdev_app/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bbdev_app 00:02:15.329 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/thread.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:15.329 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/cli.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:15.329 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/thread.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:15.329 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/conn.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:15.329 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:15.329 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/obj.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:15.329 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:15.329 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/conn.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:15.329 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/cli.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:15.329 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/obj.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:15.329 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/hash_func.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:15.329 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_macswp.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:15.329 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/mirroring.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:15.329 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/selector.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:15.329 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/ethdev.io to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:15.329 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/mirroring.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:15.329 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/varbit.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:15.329 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:15.329 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:15.329 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/recirculation.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:15.329 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/recirculation.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:15.329 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/varbit.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:15.329 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:15.329 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib_routing_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:15.329 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:15.329 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:15.329 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib_nexthop_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:15.329 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/learner.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:15.329 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_macswp.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:15.329 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/registers.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:15.329 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_pcap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:15.329 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib_nexthop_group_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:15.329 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:15.329 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/registers.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:15.329 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan_pcap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:15.329 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/packet.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:15.329 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/selector.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:15.329 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/meter.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:15.330 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/hash_func.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:15.330 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/pcap.io to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:15.330 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan_table.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:15.330 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/learner.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:15.330 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:15.330 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/selector.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:15.330 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/meter.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:15.330 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_macswp_pcap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:15.330 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:15.330 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/rte_policer.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:15.330 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:15.330 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:15.330 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/rte_policer.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:15.330 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool 00:02:15.330 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/ethapp.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:02:15.330 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/ethapp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:02:15.330 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:02:15.330 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:02:15.330 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/lib/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/lib 00:02:15.330 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/lib/rte_ethtool.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/lib 00:02:15.330 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/lib/rte_ethtool.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/lib 00:02:15.330 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ntb/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ntb 00:02:15.330 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ntb/ntb_fwd.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ntb 00:02:15.330 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_crypto/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_crypto 00:02:15.330 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_crypto/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_crypto 00:02:15.330 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/timer/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/timer 00:02:15.330 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/timer/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/timer 00:02:15.330 Installing lib/librte_kvargs.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_kvargs.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_telemetry.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_telemetry.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_eal.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_eal.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_ring.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_ring.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_rcu.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_rcu.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_mempool.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_mempool.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_mbuf.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_mbuf.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_net.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_net.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_meter.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_meter.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_ethdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_ethdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_pci.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_pci.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_cmdline.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_cmdline.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_metrics.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_metrics.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_hash.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_hash.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_timer.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_timer.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_acl.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_acl.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_bbdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_bbdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_bitratestats.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_bitratestats.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_bpf.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_bpf.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_cfgfile.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_cfgfile.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_compressdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_compressdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_cryptodev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_cryptodev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_distributor.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_distributor.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_efd.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_efd.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_eventdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_eventdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_gpudev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_gpudev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_gro.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_gro.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_gso.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_gso.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_ip_frag.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_ip_frag.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_jobstats.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_jobstats.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_latencystats.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_latencystats.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_lpm.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_lpm.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_member.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_member.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_pcapng.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_pcapng.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_power.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.330 Installing lib/librte_power.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.331 Installing lib/librte_rawdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.331 Installing lib/librte_rawdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.331 Installing lib/librte_regexdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.331 Installing lib/librte_regexdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.331 Installing lib/librte_dmadev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.331 Installing lib/librte_dmadev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.331 Installing lib/librte_rib.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.331 Installing lib/librte_rib.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.331 Installing lib/librte_reorder.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.331 Installing lib/librte_reorder.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.331 Installing lib/librte_sched.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.331 Installing lib/librte_sched.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.331 Installing lib/librte_security.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.331 Installing lib/librte_security.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.331 Installing lib/librte_stack.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.331 Installing lib/librte_stack.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.331 Installing lib/librte_vhost.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.331 Installing lib/librte_vhost.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.331 Installing lib/librte_ipsec.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.331 Installing lib/librte_ipsec.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.331 Installing lib/librte_fib.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.331 Installing lib/librte_fib.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.331 Installing lib/librte_port.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.331 Installing lib/librte_port.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.331 Installing lib/librte_pdump.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.331 Installing lib/librte_pdump.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.594 Installing lib/librte_table.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.594 Installing lib/librte_table.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.594 Installing lib/librte_pipeline.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.594 Installing lib/librte_pipeline.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.594 Installing lib/librte_graph.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.594 Installing lib/librte_graph.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.594 Installing lib/librte_node.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.594 Installing lib/librte_node.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.594 Installing drivers/librte_bus_pci.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.594 Installing drivers/librte_bus_pci.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0 00:02:15.594 Installing drivers/librte_bus_vdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.594 Installing drivers/librte_bus_vdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0 00:02:15.594 Installing drivers/librte_mempool_ring.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.594 Installing drivers/librte_mempool_ring.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0 00:02:15.594 Installing drivers/librte_net_i40e.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.594 Installing drivers/librte_net_i40e.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0 00:02:15.594 Installing app/dpdk-dumpcap to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:15.594 Installing app/dpdk-pdump to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:15.594 Installing app/dpdk-proc-info to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:15.594 Installing app/dpdk-test-acl to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:15.594 Installing app/dpdk-test-bbdev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:15.594 Installing app/dpdk-test-cmdline to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:15.594 Installing app/dpdk-test-compress-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:15.594 Installing app/dpdk-test-crypto-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:15.594 Installing app/dpdk-test-eventdev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:15.594 Installing app/dpdk-test-fib to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:15.594 Installing app/dpdk-test-flow-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:15.594 Installing app/dpdk-test-gpudev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:15.594 Installing app/dpdk-test-pipeline to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:15.594 Installing app/dpdk-testpmd to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:15.594 Installing app/dpdk-test-regex to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:15.594 Installing app/dpdk-test-sad to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:15.594 Installing app/dpdk-test-security-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:15.594 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/config/rte_config.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.594 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/kvargs/rte_kvargs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.594 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/telemetry/rte_telemetry.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.594 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_atomic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:15.594 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_byteorder.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:15.594 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_cpuflags.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:15.594 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_cycles.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:15.594 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_io.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:15.594 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_memcpy.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:15.594 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_pause.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:15.594 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_power_intrinsics.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:15.594 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_prefetch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:15.594 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_rwlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:15.594 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_spinlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:15.594 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_vect.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:15.594 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_atomic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.594 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_byteorder.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.594 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_cpuflags.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.594 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_cycles.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.594 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_io.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.594 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_memcpy.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.594 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_pause.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.594 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_power_intrinsics.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.594 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_prefetch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.594 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_rtm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.594 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_rwlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.594 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_spinlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.594 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_vect.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.594 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_atomic_32.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.594 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_atomic_64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.594 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_byteorder_32.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.594 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_byteorder_64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.594 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_alarm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.594 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_bitmap.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.594 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_bitops.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.594 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_branch_prediction.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.594 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_bus.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.594 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_class.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.594 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.594 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_compat.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.594 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_debug.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.594 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_dev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.594 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_devargs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.594 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_eal.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.594 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_eal_memconfig.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.594 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_eal_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.594 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_errno.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.594 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_epoll.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.594 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_fbarray.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.594 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_hexdump.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.594 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_hypervisor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.594 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_interrupts.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_keepalive.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_launch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_lcore.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_log.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_malloc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_mcslock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_memory.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_memzone.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_pci_dev_feature_defs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_pci_dev_features.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_per_lcore.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_pflock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_random.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_reciprocal.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_seqcount.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_seqlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_service.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_service_component.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_string_fns.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_tailq.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_thread.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_ticketlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_time.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_trace_point.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_trace_point_register.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_uuid.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_version.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_vfio.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/linux/include/rte_os.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_elem.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_c11_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_generic_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_hts.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_hts_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_peek.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_peek_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_peek_zc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_rts.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_rts_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rcu/rte_rcu_qsbr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mempool/rte_mempool.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mempool/rte_mempool_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mempool/rte_mempool_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_ptype.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_pool_ops.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_dyn.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ip.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_tcp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_udp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_esp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_sctp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_icmp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_arp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ether.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_macsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_vxlan.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_gre.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_gtp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_net.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_net_crc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_mpls.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_higig.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ecpri.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_geneve.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_l2tpv2.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ppp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/meter/rte_meter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_cman.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_dev_info.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_flow.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_flow_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_mtr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_mtr_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.595 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_tm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_tm_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_eth_ctrl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pci/rte_pci.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_num.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_ipaddr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_etheraddr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_string.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_rdline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_vt100.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_socket.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_cirbuf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_portlist.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/metrics/rte_metrics.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/metrics/rte_metrics_telemetry.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_fbk_hash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_hash_crc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_hash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_jhash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_thash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_thash_gfni.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_arm64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_generic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_sw.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_x86.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_thash_x86_gfni.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/timer/rte_timer.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/acl/rte_acl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/acl/rte_acl_osdep.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bbdev/rte_bbdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bbdev/rte_bbdev_pmd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bbdev/rte_bbdev_op.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bitratestats/rte_bitrate.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bpf/bpf_def.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bpf/rte_bpf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bpf/rte_bpf_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cfgfile/rte_cfgfile.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/compressdev/rte_compressdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/compressdev/rte_comp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_crypto.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_crypto_sym.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_crypto_asym.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/distributor/rte_distributor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/efd/rte_efd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_crypto_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_eth_rx_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_eth_tx_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_timer_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_eventdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_eventdev_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_eventdev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/gpudev/rte_gpudev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/gro/rte_gro.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/gso/rte_gso.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ip_frag/rte_ip_frag.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/jobstats/rte_jobstats.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/latencystats/rte_latencystats.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_altivec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_scalar.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_sve.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/member/rte_member.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pcapng/rte_pcapng.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_empty_poll.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_intel_uncore.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_pmd_mgmt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_guest_channel.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rawdev/rte_rawdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rawdev/rte_rawdev_pmd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/regexdev/rte_regexdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/regexdev/rte_regexdev_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.596 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/regexdev/rte_regexdev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/dmadev/rte_dmadev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/dmadev/rte_dmadev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rib/rte_rib.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rib/rte_rib6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/reorder/rte_reorder.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_approx.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_red.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_sched.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_sched_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_pie.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/security/rte_security.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/security/rte_security_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_std.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf_generic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf_c11.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf_stubs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vdpa.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vhost.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vhost_async.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vhost_crypto.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec_sa.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec_sad.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/fib/rte_fib.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/fib/rte_fib6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_fd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_frag.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_ras.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_sched.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_source_sink.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_sym_crypto.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_eventdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_fd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_source_sink.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pdump/rte_pdump.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_lru.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_hash_func.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_em.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_learner.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_selector.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_wm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_acl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_array.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash_cuckoo.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash_func.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_lpm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_lpm_ipv6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_stub.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_lru_arm64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_lru_x86.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash_func_arm64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_pipeline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_port_in_action.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_table_action.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_pipeline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_extern.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_ctl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph_worker.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/node/rte_node_ip4_api.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/node/rte_node_eth_api.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/drivers/bus/pci/rte_bus_pci.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/drivers/bus/vdev/rte_bus_vdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/drivers/net/i40e/rte_pmd_i40e.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-devbind.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-pmdinfo.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-telemetry.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-hugepages.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp/rte_build_config.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:15.597 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp/meson-private/libdpdk-libs.pc to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/pkgconfig 00:02:15.598 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp/meson-private/libdpdk.pc to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/pkgconfig 00:02:15.598 Installing symlink pointing to librte_kvargs.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_kvargs.so.23 00:02:15.598 Installing symlink pointing to librte_kvargs.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_kvargs.so 00:02:15.598 Installing symlink pointing to librte_telemetry.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_telemetry.so.23 00:02:15.598 Installing symlink pointing to librte_telemetry.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_telemetry.so 00:02:15.598 Installing symlink pointing to librte_eal.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eal.so.23 00:02:15.598 Installing symlink pointing to librte_eal.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eal.so 00:02:15.598 Installing symlink pointing to librte_ring.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ring.so.23 00:02:15.598 Installing symlink pointing to librte_ring.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ring.so 00:02:15.598 Installing symlink pointing to librte_rcu.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rcu.so.23 00:02:15.598 Installing symlink pointing to librte_rcu.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rcu.so 00:02:15.598 Installing symlink pointing to librte_mempool.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mempool.so.23 00:02:15.598 Installing symlink pointing to librte_mempool.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mempool.so 00:02:15.598 Installing symlink pointing to librte_mbuf.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mbuf.so.23 00:02:15.598 Installing symlink pointing to librte_mbuf.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mbuf.so 00:02:15.598 Installing symlink pointing to librte_net.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_net.so.23 00:02:15.598 Installing symlink pointing to librte_net.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_net.so 00:02:15.598 Installing symlink pointing to librte_meter.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_meter.so.23 00:02:15.598 Installing symlink pointing to librte_meter.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_meter.so 00:02:15.598 Installing symlink pointing to librte_ethdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ethdev.so.23 00:02:15.598 Installing symlink pointing to librte_ethdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ethdev.so 00:02:15.598 Installing symlink pointing to librte_pci.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pci.so.23 00:02:15.598 Installing symlink pointing to librte_pci.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pci.so 00:02:15.598 Installing symlink pointing to librte_cmdline.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cmdline.so.23 00:02:15.598 Installing symlink pointing to librte_cmdline.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cmdline.so 00:02:15.598 Installing symlink pointing to librte_metrics.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_metrics.so.23 00:02:15.598 Installing symlink pointing to librte_metrics.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_metrics.so 00:02:15.598 Installing symlink pointing to librte_hash.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_hash.so.23 00:02:15.598 Installing symlink pointing to librte_hash.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_hash.so 00:02:15.598 Installing symlink pointing to librte_timer.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_timer.so.23 00:02:15.598 Installing symlink pointing to librte_timer.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_timer.so 00:02:15.598 Installing symlink pointing to librte_acl.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_acl.so.23 00:02:15.598 Installing symlink pointing to librte_acl.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_acl.so 00:02:15.598 Installing symlink pointing to librte_bbdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bbdev.so.23 00:02:15.598 Installing symlink pointing to librte_bbdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bbdev.so 00:02:15.598 Installing symlink pointing to librte_bitratestats.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bitratestats.so.23 00:02:15.598 Installing symlink pointing to librte_bitratestats.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bitratestats.so 00:02:15.598 Installing symlink pointing to librte_bpf.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bpf.so.23 00:02:15.598 Installing symlink pointing to librte_bpf.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bpf.so 00:02:15.598 Installing symlink pointing to librte_cfgfile.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cfgfile.so.23 00:02:15.598 Installing symlink pointing to librte_cfgfile.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cfgfile.so 00:02:15.598 Installing symlink pointing to librte_compressdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_compressdev.so.23 00:02:15.598 Installing symlink pointing to librte_compressdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_compressdev.so 00:02:15.598 Installing symlink pointing to librte_cryptodev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cryptodev.so.23 00:02:15.598 Installing symlink pointing to librte_cryptodev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cryptodev.so 00:02:15.598 Installing symlink pointing to librte_distributor.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_distributor.so.23 00:02:15.598 Installing symlink pointing to librte_distributor.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_distributor.so 00:02:15.598 Installing symlink pointing to librte_efd.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_efd.so.23 00:02:15.598 Installing symlink pointing to librte_efd.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_efd.so 00:02:15.598 Installing symlink pointing to librte_eventdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eventdev.so.23 00:02:15.598 Installing symlink pointing to librte_eventdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eventdev.so 00:02:15.598 Installing symlink pointing to librte_gpudev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gpudev.so.23 00:02:15.598 Installing symlink pointing to librte_gpudev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gpudev.so 00:02:15.598 Installing symlink pointing to librte_gro.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gro.so.23 00:02:15.598 Installing symlink pointing to librte_gro.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gro.so 00:02:15.598 Installing symlink pointing to librte_gso.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gso.so.23 00:02:15.598 Installing symlink pointing to librte_gso.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gso.so 00:02:15.598 Installing symlink pointing to librte_ip_frag.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ip_frag.so.23 00:02:15.598 Installing symlink pointing to librte_ip_frag.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ip_frag.so 00:02:15.598 Installing symlink pointing to librte_jobstats.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_jobstats.so.23 00:02:15.598 Installing symlink pointing to librte_jobstats.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_jobstats.so 00:02:15.598 Installing symlink pointing to librte_latencystats.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_latencystats.so.23 00:02:15.598 Installing symlink pointing to librte_latencystats.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_latencystats.so 00:02:15.598 Installing symlink pointing to librte_lpm.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_lpm.so.23 00:02:15.598 Installing symlink pointing to librte_lpm.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_lpm.so 00:02:15.598 Installing symlink pointing to librte_member.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_member.so.23 00:02:15.598 Installing symlink pointing to librte_member.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_member.so 00:02:15.598 Installing symlink pointing to librte_pcapng.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pcapng.so.23 00:02:15.598 Installing symlink pointing to librte_pcapng.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pcapng.so 00:02:15.598 Installing symlink pointing to librte_power.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_power.so.23 00:02:15.598 Installing symlink pointing to librte_power.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_power.so 00:02:15.598 Installing symlink pointing to librte_rawdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rawdev.so.23 00:02:15.598 Installing symlink pointing to librte_rawdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rawdev.so 00:02:15.598 Installing symlink pointing to librte_regexdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_regexdev.so.23 00:02:15.598 Installing symlink pointing to librte_regexdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_regexdev.so 00:02:15.598 Installing symlink pointing to librte_dmadev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_dmadev.so.23 00:02:15.598 Installing symlink pointing to librte_dmadev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_dmadev.so 00:02:15.598 Installing symlink pointing to librte_rib.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rib.so.23 00:02:15.598 Installing symlink pointing to librte_rib.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rib.so 00:02:15.599 Installing symlink pointing to librte_reorder.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_reorder.so.23 00:02:15.599 Installing symlink pointing to librte_reorder.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_reorder.so 00:02:15.599 Installing symlink pointing to librte_sched.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_sched.so.23 00:02:15.599 Installing symlink pointing to librte_sched.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_sched.so 00:02:15.599 Installing symlink pointing to librte_security.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_security.so.23 00:02:15.599 Installing symlink pointing to librte_security.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_security.so 00:02:15.599 Installing symlink pointing to librte_stack.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_stack.so.23 00:02:15.599 Installing symlink pointing to librte_stack.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_stack.so 00:02:15.599 Installing symlink pointing to librte_vhost.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_vhost.so.23 00:02:15.599 Installing symlink pointing to librte_vhost.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_vhost.so 00:02:15.599 Installing symlink pointing to librte_ipsec.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ipsec.so.23 00:02:15.599 Installing symlink pointing to librte_ipsec.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ipsec.so 00:02:15.599 Installing symlink pointing to librte_fib.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_fib.so.23 00:02:15.599 Installing symlink pointing to librte_fib.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_fib.so 00:02:15.599 Installing symlink pointing to librte_port.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_port.so.23 00:02:15.599 Installing symlink pointing to librte_port.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_port.so 00:02:15.599 Installing symlink pointing to librte_pdump.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pdump.so.23 00:02:15.599 Installing symlink pointing to librte_pdump.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pdump.so 00:02:15.599 Installing symlink pointing to librte_table.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_table.so.23 00:02:15.599 Installing symlink pointing to librte_table.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_table.so 00:02:15.599 Installing symlink pointing to librte_pipeline.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pipeline.so.23 00:02:15.599 Installing symlink pointing to librte_pipeline.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pipeline.so 00:02:15.599 Installing symlink pointing to librte_graph.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_graph.so.23 00:02:15.599 Installing symlink pointing to librte_graph.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_graph.so 00:02:15.599 Installing symlink pointing to librte_node.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_node.so.23 00:02:15.599 Installing symlink pointing to librte_node.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_node.so 00:02:15.599 Installing symlink pointing to librte_bus_pci.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_pci.so.23 00:02:15.599 Installing symlink pointing to librte_bus_pci.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_pci.so 00:02:15.599 Installing symlink pointing to librte_bus_vdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_vdev.so.23 00:02:15.599 Installing symlink pointing to librte_bus_vdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_vdev.so 00:02:15.599 './librte_bus_pci.so' -> 'dpdk/pmds-23.0/librte_bus_pci.so' 00:02:15.599 './librte_bus_pci.so.23' -> 'dpdk/pmds-23.0/librte_bus_pci.so.23' 00:02:15.599 './librte_bus_pci.so.23.0' -> 'dpdk/pmds-23.0/librte_bus_pci.so.23.0' 00:02:15.599 './librte_bus_vdev.so' -> 'dpdk/pmds-23.0/librte_bus_vdev.so' 00:02:15.599 './librte_bus_vdev.so.23' -> 'dpdk/pmds-23.0/librte_bus_vdev.so.23' 00:02:15.599 './librte_bus_vdev.so.23.0' -> 'dpdk/pmds-23.0/librte_bus_vdev.so.23.0' 00:02:15.599 './librte_mempool_ring.so' -> 'dpdk/pmds-23.0/librte_mempool_ring.so' 00:02:15.599 './librte_mempool_ring.so.23' -> 'dpdk/pmds-23.0/librte_mempool_ring.so.23' 00:02:15.599 './librte_mempool_ring.so.23.0' -> 'dpdk/pmds-23.0/librte_mempool_ring.so.23.0' 00:02:15.599 './librte_net_i40e.so' -> 'dpdk/pmds-23.0/librte_net_i40e.so' 00:02:15.599 './librte_net_i40e.so.23' -> 'dpdk/pmds-23.0/librte_net_i40e.so.23' 00:02:15.599 './librte_net_i40e.so.23.0' -> 'dpdk/pmds-23.0/librte_net_i40e.so.23.0' 00:02:15.599 Installing symlink pointing to librte_mempool_ring.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_mempool_ring.so.23 00:02:15.599 Installing symlink pointing to librte_mempool_ring.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_mempool_ring.so 00:02:15.599 Installing symlink pointing to librte_net_i40e.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_net_i40e.so.23 00:02:15.599 Installing symlink pointing to librte_net_i40e.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_net_i40e.so 00:02:15.599 Running custom install script '/bin/sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/config/../buildtools/symlink-drivers-solibs.sh lib dpdk/pmds-23.0' 00:02:15.599 18:48:32 -- common/autobuild_common.sh@192 -- $ uname -s 00:02:15.599 18:48:32 -- common/autobuild_common.sh@192 -- $ [[ Linux == \F\r\e\e\B\S\D ]] 00:02:15.599 18:48:32 -- common/autobuild_common.sh@203 -- $ cat 00:02:15.599 18:48:32 -- common/autobuild_common.sh@208 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:15.599 00:02:15.599 real 0m26.157s 00:02:15.599 user 6m55.200s 00:02:15.599 sys 1m45.221s 00:02:15.599 18:48:32 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:02:15.599 18:48:32 -- common/autotest_common.sh@10 -- $ set +x 00:02:15.599 ************************************ 00:02:15.599 END TEST build_native_dpdk 00:02:15.599 ************************************ 00:02:15.599 18:48:32 -- spdk/autobuild.sh@31 -- $ case "$SPDK_TEST_AUTOBUILD" in 00:02:15.599 18:48:32 -- spdk/autobuild.sh@47 -- $ [[ 0 -eq 1 ]] 00:02:15.599 18:48:32 -- spdk/autobuild.sh@51 -- $ [[ 0 -eq 1 ]] 00:02:15.599 18:48:32 -- spdk/autobuild.sh@55 -- $ [[ -n '' ]] 00:02:15.599 18:48:32 -- spdk/autobuild.sh@57 -- $ [[ 0 -eq 1 ]] 00:02:15.599 18:48:32 -- spdk/autobuild.sh@59 -- $ [[ 0 -eq 1 ]] 00:02:15.599 18:48:32 -- spdk/autobuild.sh@62 -- $ [[ 0 -eq 1 ]] 00:02:15.599 18:48:32 -- spdk/autobuild.sh@67 -- $ /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/configure --enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-vfio-user --with-dpdk=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build --with-shared 00:02:15.859 Using /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/pkgconfig for additional libs... 00:02:15.859 DPDK libraries: /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:15.859 DPDK includes: //var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:16.119 Using default SPDK env in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:02:16.378 Using 'verbs' RDMA provider 00:02:29.154 Configuring ISA-L (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l/spdk-isal.log)...done. 00:02:39.135 Configuring ISA-L-crypto (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l-crypto/spdk-isal-crypto.log)...done. 00:02:39.393 Creating mk/config.mk...done. 00:02:39.393 Creating mk/cc.flags.mk...done. 00:02:39.393 Type 'make' to build. 00:02:39.393 18:48:56 -- spdk/autobuild.sh@69 -- $ run_test make make -j96 00:02:39.393 18:48:56 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:02:39.393 18:48:56 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:02:39.393 18:48:56 -- common/autotest_common.sh@10 -- $ set +x 00:02:39.393 ************************************ 00:02:39.393 START TEST make 00:02:39.393 ************************************ 00:02:39.393 18:48:56 -- common/autotest_common.sh@1114 -- $ make -j96 00:02:39.651 make[1]: Nothing to be done for 'all'. 00:02:41.038 The Meson build system 00:02:41.038 Version: 1.5.0 00:02:41.038 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/libvfio-user 00:02:41.038 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug 00:02:41.038 Build type: native build 00:02:41.038 Project name: libvfio-user 00:02:41.038 Project version: 0.0.1 00:02:41.038 C compiler for the host machine: gcc (gcc 13.3.1 "gcc (GCC) 13.3.1 20240522 (Red Hat 13.3.1-1)") 00:02:41.038 C linker for the host machine: gcc ld.bfd 2.40-14 00:02:41.038 Host machine cpu family: x86_64 00:02:41.038 Host machine cpu: x86_64 00:02:41.038 Run-time dependency threads found: YES 00:02:41.038 Library dl found: YES 00:02:41.038 Found pkg-config: YES (/usr/bin/pkg-config) 1.9.5 00:02:41.038 Run-time dependency json-c found: YES 0.17 00:02:41.038 Run-time dependency cmocka found: YES 1.1.7 00:02:41.038 Program pytest-3 found: NO 00:02:41.038 Program flake8 found: NO 00:02:41.038 Program misspell-fixer found: NO 00:02:41.038 Program restructuredtext-lint found: NO 00:02:41.038 Program valgrind found: YES (/usr/bin/valgrind) 00:02:41.038 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:02:41.038 Compiler for C supports arguments -Wmissing-declarations: YES 00:02:41.038 Compiler for C supports arguments -Wwrite-strings: YES 00:02:41.038 ../libvfio-user/test/meson.build:20: WARNING: Project targets '>= 0.53.0' but uses feature introduced in '0.57.0': exclude_suites arg in add_test_setup. 00:02:41.038 Program test-lspci.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/libvfio-user/test/test-lspci.sh) 00:02:41.038 Program test-linkage.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/libvfio-user/test/test-linkage.sh) 00:02:41.038 ../libvfio-user/test/py/meson.build:16: WARNING: Project targets '>= 0.53.0' but uses feature introduced in '0.57.0': exclude_suites arg in add_test_setup. 00:02:41.038 Build targets in project: 8 00:02:41.038 WARNING: Project specifies a minimum meson_version '>= 0.53.0' but uses features which were added in newer versions: 00:02:41.038 * 0.57.0: {'exclude_suites arg in add_test_setup'} 00:02:41.038 00:02:41.038 libvfio-user 0.0.1 00:02:41.038 00:02:41.038 User defined options 00:02:41.038 buildtype : debug 00:02:41.038 default_library: shared 00:02:41.038 libdir : /usr/local/lib 00:02:41.038 00:02:41.038 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:02:41.605 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug' 00:02:41.605 [1/37] Compiling C object samples/shadow_ioeventfd_server.p/shadow_ioeventfd_server.c.o 00:02:41.605 [2/37] Compiling C object samples/null.p/null.c.o 00:02:41.605 [3/37] Compiling C object samples/lspci.p/lspci.c.o 00:02:41.605 [4/37] Compiling C object samples/client.p/.._lib_migration.c.o 00:02:41.605 [5/37] Compiling C object lib/libvfio-user.so.0.0.1.p/dma.c.o 00:02:41.605 [6/37] Compiling C object lib/libvfio-user.so.0.0.1.p/irq.c.o 00:02:41.605 [7/37] Compiling C object lib/libvfio-user.so.0.0.1.p/tran.c.o 00:02:41.605 [8/37] Compiling C object samples/gpio-pci-idio-16.p/gpio-pci-idio-16.c.o 00:02:41.605 [9/37] Compiling C object test/unit_tests.p/.._lib_tran.c.o 00:02:41.605 [10/37] Compiling C object samples/client.p/.._lib_tran.c.o 00:02:41.605 [11/37] Compiling C object lib/libvfio-user.so.0.0.1.p/migration.c.o 00:02:41.605 [12/37] Compiling C object test/unit_tests.p/.._lib_irq.c.o 00:02:41.605 [13/37] Compiling C object test/unit_tests.p/.._lib_tran_pipe.c.o 00:02:41.605 [14/37] Compiling C object test/unit_tests.p/mocks.c.o 00:02:41.605 [15/37] Compiling C object lib/libvfio-user.so.0.0.1.p/pci.c.o 00:02:41.605 [16/37] Compiling C object test/unit_tests.p/.._lib_pci.c.o 00:02:41.605 [17/37] Compiling C object test/unit_tests.p/.._lib_migration.c.o 00:02:41.605 [18/37] Compiling C object test/unit_tests.p/.._lib_tran_sock.c.o 00:02:41.605 [19/37] Compiling C object lib/libvfio-user.so.0.0.1.p/pci_caps.c.o 00:02:41.605 [20/37] Compiling C object lib/libvfio-user.so.0.0.1.p/tran_sock.c.o 00:02:41.605 [21/37] Compiling C object samples/client.p/.._lib_tran_sock.c.o 00:02:41.605 [22/37] Compiling C object samples/client.p/client.c.o 00:02:41.605 [23/37] Compiling C object samples/server.p/server.c.o 00:02:41.605 [24/37] Compiling C object test/unit_tests.p/.._lib_pci_caps.c.o 00:02:41.605 [25/37] Compiling C object test/unit_tests.p/.._lib_dma.c.o 00:02:41.605 [26/37] Compiling C object test/unit_tests.p/unit-tests.c.o 00:02:41.605 [27/37] Linking target samples/client 00:02:41.863 [28/37] Compiling C object lib/libvfio-user.so.0.0.1.p/libvfio-user.c.o 00:02:41.863 [29/37] Linking target lib/libvfio-user.so.0.0.1 00:02:41.863 [30/37] Compiling C object test/unit_tests.p/.._lib_libvfio-user.c.o 00:02:41.863 [31/37] Linking target test/unit_tests 00:02:41.863 [32/37] Generating symbol file lib/libvfio-user.so.0.0.1.p/libvfio-user.so.0.0.1.symbols 00:02:41.863 [33/37] Linking target samples/server 00:02:41.863 [34/37] Linking target samples/shadow_ioeventfd_server 00:02:41.863 [35/37] Linking target samples/gpio-pci-idio-16 00:02:41.863 [36/37] Linking target samples/lspci 00:02:41.863 [37/37] Linking target samples/null 00:02:41.863 INFO: autodetecting backend as ninja 00:02:41.863 INFO: calculating backend command to run: /usr/local/bin/ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug 00:02:42.122 DESTDIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user meson install --quiet -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug 00:02:42.381 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug' 00:02:42.381 ninja: no work to do. 00:02:50.505 CC lib/ut/ut.o 00:02:50.505 CC lib/ut_mock/mock.o 00:02:50.505 CC lib/log/log.o 00:02:50.505 CC lib/log/log_flags.o 00:02:50.505 CC lib/log/log_deprecated.o 00:02:50.505 LIB libspdk_ut_mock.a 00:02:50.505 LIB libspdk_ut.a 00:02:50.505 SO libspdk_ut_mock.so.5.0 00:02:50.505 LIB libspdk_log.a 00:02:50.505 SO libspdk_ut.so.1.0 00:02:50.505 SO libspdk_log.so.6.1 00:02:50.505 SYMLINK libspdk_ut_mock.so 00:02:50.505 SYMLINK libspdk_ut.so 00:02:50.505 SYMLINK libspdk_log.so 00:02:50.505 CXX lib/trace_parser/trace.o 00:02:50.505 CC lib/ioat/ioat.o 00:02:50.505 CC lib/util/base64.o 00:02:50.505 CC lib/dma/dma.o 00:02:50.505 CC lib/util/bit_array.o 00:02:50.505 CC lib/util/crc32.o 00:02:50.505 CC lib/util/cpuset.o 00:02:50.505 CC lib/util/crc32c.o 00:02:50.505 CC lib/util/crc16.o 00:02:50.505 CC lib/util/crc32_ieee.o 00:02:50.505 CC lib/util/crc64.o 00:02:50.505 CC lib/util/dif.o 00:02:50.505 CC lib/util/fd.o 00:02:50.505 CC lib/util/file.o 00:02:50.505 CC lib/util/hexlify.o 00:02:50.505 CC lib/util/iov.o 00:02:50.505 CC lib/util/math.o 00:02:50.505 CC lib/util/pipe.o 00:02:50.505 CC lib/util/strerror_tls.o 00:02:50.505 CC lib/util/string.o 00:02:50.505 CC lib/util/uuid.o 00:02:50.505 CC lib/util/fd_group.o 00:02:50.505 CC lib/util/xor.o 00:02:50.505 CC lib/util/zipf.o 00:02:50.505 CC lib/vfio_user/host/vfio_user_pci.o 00:02:50.505 CC lib/vfio_user/host/vfio_user.o 00:02:50.505 LIB libspdk_dma.a 00:02:50.505 SO libspdk_dma.so.3.0 00:02:50.505 LIB libspdk_ioat.a 00:02:50.505 SYMLINK libspdk_dma.so 00:02:50.505 SO libspdk_ioat.so.6.0 00:02:50.505 LIB libspdk_vfio_user.a 00:02:50.505 SYMLINK libspdk_ioat.so 00:02:50.505 SO libspdk_vfio_user.so.4.0 00:02:50.505 SYMLINK libspdk_vfio_user.so 00:02:50.505 LIB libspdk_util.a 00:02:50.765 SO libspdk_util.so.8.0 00:02:50.765 SYMLINK libspdk_util.so 00:02:50.765 LIB libspdk_trace_parser.a 00:02:50.765 SO libspdk_trace_parser.so.4.0 00:02:51.024 SYMLINK libspdk_trace_parser.so 00:02:51.024 CC lib/env_dpdk/env.o 00:02:51.024 CC lib/env_dpdk/memory.o 00:02:51.024 CC lib/env_dpdk/pci.o 00:02:51.024 CC lib/env_dpdk/init.o 00:02:51.024 CC lib/env_dpdk/threads.o 00:02:51.024 CC lib/env_dpdk/pci_ioat.o 00:02:51.024 CC lib/env_dpdk/pci_virtio.o 00:02:51.025 CC lib/env_dpdk/pci_vmd.o 00:02:51.025 CC lib/env_dpdk/pci_idxd.o 00:02:51.025 CC lib/env_dpdk/pci_event.o 00:02:51.025 CC lib/env_dpdk/sigbus_handler.o 00:02:51.025 CC lib/env_dpdk/pci_dpdk.o 00:02:51.025 CC lib/env_dpdk/pci_dpdk_2207.o 00:02:51.025 CC lib/env_dpdk/pci_dpdk_2211.o 00:02:51.025 CC lib/json/json_parse.o 00:02:51.025 CC lib/vmd/vmd.o 00:02:51.025 CC lib/json/json_util.o 00:02:51.025 CC lib/json/json_write.o 00:02:51.025 CC lib/vmd/led.o 00:02:51.025 CC lib/conf/conf.o 00:02:51.025 CC lib/idxd/idxd.o 00:02:51.025 CC lib/rdma/common.o 00:02:51.025 CC lib/idxd/idxd_user.o 00:02:51.025 CC lib/rdma/rdma_verbs.o 00:02:51.025 CC lib/idxd/idxd_kernel.o 00:02:51.284 LIB libspdk_conf.a 00:02:51.284 SO libspdk_conf.so.5.0 00:02:51.284 LIB libspdk_json.a 00:02:51.284 LIB libspdk_rdma.a 00:02:51.284 SO libspdk_json.so.5.1 00:02:51.284 SYMLINK libspdk_conf.so 00:02:51.284 SO libspdk_rdma.so.5.0 00:02:51.284 SYMLINK libspdk_json.so 00:02:51.284 SYMLINK libspdk_rdma.so 00:02:51.284 LIB libspdk_idxd.a 00:02:51.543 SO libspdk_idxd.so.11.0 00:02:51.543 LIB libspdk_vmd.a 00:02:51.543 CC lib/jsonrpc/jsonrpc_client.o 00:02:51.543 CC lib/jsonrpc/jsonrpc_server.o 00:02:51.543 CC lib/jsonrpc/jsonrpc_server_tcp.o 00:02:51.543 CC lib/jsonrpc/jsonrpc_client_tcp.o 00:02:51.543 SO libspdk_vmd.so.5.0 00:02:51.543 SYMLINK libspdk_idxd.so 00:02:51.543 SYMLINK libspdk_vmd.so 00:02:51.803 LIB libspdk_jsonrpc.a 00:02:51.803 SO libspdk_jsonrpc.so.5.1 00:02:51.803 SYMLINK libspdk_jsonrpc.so 00:02:52.063 LIB libspdk_env_dpdk.a 00:02:52.063 CC lib/rpc/rpc.o 00:02:52.063 SO libspdk_env_dpdk.so.13.0 00:02:52.063 LIB libspdk_rpc.a 00:02:52.063 SYMLINK libspdk_env_dpdk.so 00:02:52.063 SO libspdk_rpc.so.5.0 00:02:52.323 SYMLINK libspdk_rpc.so 00:02:52.323 CC lib/sock/sock.o 00:02:52.323 CC lib/sock/sock_rpc.o 00:02:52.323 CC lib/trace/trace.o 00:02:52.323 CC lib/trace/trace_flags.o 00:02:52.323 CC lib/trace/trace_rpc.o 00:02:52.323 CC lib/notify/notify.o 00:02:52.323 CC lib/notify/notify_rpc.o 00:02:52.581 LIB libspdk_notify.a 00:02:52.581 SO libspdk_notify.so.5.0 00:02:52.581 LIB libspdk_trace.a 00:02:52.581 SYMLINK libspdk_notify.so 00:02:52.581 SO libspdk_trace.so.9.0 00:02:52.581 LIB libspdk_sock.a 00:02:52.581 SYMLINK libspdk_trace.so 00:02:52.841 SO libspdk_sock.so.8.0 00:02:52.841 SYMLINK libspdk_sock.so 00:02:52.841 CC lib/thread/thread.o 00:02:52.841 CC lib/thread/iobuf.o 00:02:53.100 CC lib/nvme/nvme_ctrlr_cmd.o 00:02:53.100 CC lib/nvme/nvme_ctrlr.o 00:02:53.100 CC lib/nvme/nvme_fabric.o 00:02:53.100 CC lib/nvme/nvme_ns_cmd.o 00:02:53.100 CC lib/nvme/nvme_ns.o 00:02:53.100 CC lib/nvme/nvme_pcie_common.o 00:02:53.100 CC lib/nvme/nvme_pcie.o 00:02:53.100 CC lib/nvme/nvme_qpair.o 00:02:53.100 CC lib/nvme/nvme_discovery.o 00:02:53.100 CC lib/nvme/nvme.o 00:02:53.100 CC lib/nvme/nvme_quirks.o 00:02:53.100 CC lib/nvme/nvme_transport.o 00:02:53.100 CC lib/nvme/nvme_ctrlr_ocssd_cmd.o 00:02:53.100 CC lib/nvme/nvme_ns_ocssd_cmd.o 00:02:53.100 CC lib/nvme/nvme_tcp.o 00:02:53.100 CC lib/nvme/nvme_opal.o 00:02:53.100 CC lib/nvme/nvme_cuse.o 00:02:53.100 CC lib/nvme/nvme_io_msg.o 00:02:53.100 CC lib/nvme/nvme_poll_group.o 00:02:53.100 CC lib/nvme/nvme_zns.o 00:02:53.100 CC lib/nvme/nvme_vfio_user.o 00:02:53.100 CC lib/nvme/nvme_rdma.o 00:02:54.035 LIB libspdk_thread.a 00:02:54.035 SO libspdk_thread.so.9.0 00:02:54.035 SYMLINK libspdk_thread.so 00:02:54.294 CC lib/init/subsystem.o 00:02:54.294 CC lib/init/subsystem_rpc.o 00:02:54.294 CC lib/init/json_config.o 00:02:54.294 CC lib/init/rpc.o 00:02:54.294 CC lib/vfu_tgt/tgt_endpoint.o 00:02:54.294 CC lib/vfu_tgt/tgt_rpc.o 00:02:54.294 CC lib/virtio/virtio.o 00:02:54.294 CC lib/virtio/virtio_vfio_user.o 00:02:54.294 CC lib/virtio/virtio_vhost_user.o 00:02:54.294 CC lib/accel/accel.o 00:02:54.294 CC lib/virtio/virtio_pci.o 00:02:54.294 CC lib/accel/accel_rpc.o 00:02:54.294 CC lib/accel/accel_sw.o 00:02:54.294 CC lib/blob/blobstore.o 00:02:54.294 CC lib/blob/request.o 00:02:54.294 CC lib/blob/zeroes.o 00:02:54.294 CC lib/blob/blob_bs_dev.o 00:02:54.554 LIB libspdk_init.a 00:02:54.554 SO libspdk_init.so.4.0 00:02:54.554 LIB libspdk_vfu_tgt.a 00:02:54.554 LIB libspdk_nvme.a 00:02:54.554 SYMLINK libspdk_init.so 00:02:54.554 LIB libspdk_virtio.a 00:02:54.554 SO libspdk_vfu_tgt.so.2.0 00:02:54.554 SO libspdk_virtio.so.6.0 00:02:54.554 SYMLINK libspdk_vfu_tgt.so 00:02:54.554 SO libspdk_nvme.so.12.0 00:02:54.554 SYMLINK libspdk_virtio.so 00:02:54.814 CC lib/event/app.o 00:02:54.814 CC lib/event/log_rpc.o 00:02:54.814 CC lib/event/reactor.o 00:02:54.814 CC lib/event/scheduler_static.o 00:02:54.814 CC lib/event/app_rpc.o 00:02:54.814 SYMLINK libspdk_nvme.so 00:02:55.072 LIB libspdk_accel.a 00:02:55.072 LIB libspdk_event.a 00:02:55.072 SO libspdk_accel.so.14.0 00:02:55.072 SO libspdk_event.so.12.0 00:02:55.072 SYMLINK libspdk_accel.so 00:02:55.072 SYMLINK libspdk_event.so 00:02:55.331 CC lib/bdev/bdev_rpc.o 00:02:55.331 CC lib/bdev/bdev.o 00:02:55.331 CC lib/bdev/part.o 00:02:55.331 CC lib/bdev/bdev_zone.o 00:02:55.331 CC lib/bdev/scsi_nvme.o 00:02:56.267 LIB libspdk_blob.a 00:02:56.267 SO libspdk_blob.so.10.1 00:02:56.267 SYMLINK libspdk_blob.so 00:02:56.526 CC lib/lvol/lvol.o 00:02:56.526 CC lib/blobfs/blobfs.o 00:02:56.526 CC lib/blobfs/tree.o 00:02:57.094 LIB libspdk_bdev.a 00:02:57.094 LIB libspdk_blobfs.a 00:02:57.094 SO libspdk_bdev.so.14.0 00:02:57.094 LIB libspdk_lvol.a 00:02:57.094 SO libspdk_lvol.so.9.1 00:02:57.094 SO libspdk_blobfs.so.9.0 00:02:57.353 SYMLINK libspdk_bdev.so 00:02:57.353 SYMLINK libspdk_lvol.so 00:02:57.353 SYMLINK libspdk_blobfs.so 00:02:57.353 CC lib/ftl/ftl_core.o 00:02:57.353 CC lib/ftl/ftl_init.o 00:02:57.353 CC lib/ftl/ftl_layout.o 00:02:57.353 CC lib/ftl/ftl_debug.o 00:02:57.353 CC lib/ftl/ftl_io.o 00:02:57.353 CC lib/ftl/ftl_sb.o 00:02:57.353 CC lib/ftl/ftl_l2p.o 00:02:57.353 CC lib/ftl/ftl_band.o 00:02:57.353 CC lib/ftl/ftl_l2p_flat.o 00:02:57.353 CC lib/ftl/ftl_nv_cache.o 00:02:57.353 CC lib/ftl/ftl_band_ops.o 00:02:57.353 CC lib/ftl/ftl_writer.o 00:02:57.353 CC lib/ftl/ftl_rq.o 00:02:57.353 CC lib/ftl/ftl_reloc.o 00:02:57.353 CC lib/ftl/mngt/ftl_mngt.o 00:02:57.353 CC lib/ftl/mngt/ftl_mngt_bdev.o 00:02:57.353 CC lib/ftl/ftl_l2p_cache.o 00:02:57.353 CC lib/ftl/ftl_p2l.o 00:02:57.353 CC lib/ftl/mngt/ftl_mngt_startup.o 00:02:57.353 CC lib/ftl/mngt/ftl_mngt_shutdown.o 00:02:57.353 CC lib/ftl/mngt/ftl_mngt_md.o 00:02:57.353 CC lib/ftl/mngt/ftl_mngt_l2p.o 00:02:57.353 CC lib/ftl/mngt/ftl_mngt_misc.o 00:02:57.353 CC lib/ftl/mngt/ftl_mngt_ioch.o 00:02:57.353 CC lib/nvmf/ctrlr.o 00:02:57.353 CC lib/nvmf/ctrlr_bdev.o 00:02:57.353 CC lib/nvmf/ctrlr_discovery.o 00:02:57.353 CC lib/ftl/mngt/ftl_mngt_p2l.o 00:02:57.353 CC lib/ftl/mngt/ftl_mngt_band.o 00:02:57.353 CC lib/ftl/mngt/ftl_mngt_self_test.o 00:02:57.353 CC lib/nvmf/subsystem.o 00:02:57.353 CC lib/ftl/utils/ftl_conf.o 00:02:57.353 CC lib/ftl/mngt/ftl_mngt_recovery.o 00:02:57.353 CC lib/nvmf/nvmf.o 00:02:57.353 CC lib/ftl/mngt/ftl_mngt_upgrade.o 00:02:57.353 CC lib/nvmf/nvmf_rpc.o 00:02:57.353 CC lib/nvmf/transport.o 00:02:57.353 CC lib/ftl/utils/ftl_md.o 00:02:57.353 CC lib/nvmf/vfio_user.o 00:02:57.353 CC lib/ftl/utils/ftl_bitmap.o 00:02:57.353 CC lib/nvmf/tcp.o 00:02:57.353 CC lib/nvmf/rdma.o 00:02:57.353 CC lib/ftl/utils/ftl_mempool.o 00:02:57.353 CC lib/ftl/utils/ftl_property.o 00:02:57.353 CC lib/ftl/upgrade/ftl_layout_upgrade.o 00:02:57.353 CC lib/ftl/utils/ftl_layout_tracker_bdev.o 00:02:57.353 CC lib/ftl/upgrade/ftl_p2l_upgrade.o 00:02:57.353 CC lib/ftl/upgrade/ftl_band_upgrade.o 00:02:57.353 CC lib/ftl/upgrade/ftl_sb_upgrade.o 00:02:57.353 CC lib/ftl/upgrade/ftl_sb_v5.o 00:02:57.354 CC lib/ftl/upgrade/ftl_chunk_upgrade.o 00:02:57.354 CC lib/nbd/nbd.o 00:02:57.354 CC lib/ftl/upgrade/ftl_sb_v3.o 00:02:57.354 CC lib/nbd/nbd_rpc.o 00:02:57.354 CC lib/ftl/nvc/ftl_nvc_dev.o 00:02:57.354 CC lib/ftl/nvc/ftl_nvc_bdev_vss.o 00:02:57.354 CC lib/ftl/base/ftl_base_dev.o 00:02:57.354 CC lib/ublk/ublk.o 00:02:57.354 CC lib/ftl/base/ftl_base_bdev.o 00:02:57.354 CC lib/ftl/ftl_trace.o 00:02:57.354 CC lib/scsi/lun.o 00:02:57.354 CC lib/scsi/dev.o 00:02:57.354 CC lib/ublk/ublk_rpc.o 00:02:57.354 CC lib/scsi/port.o 00:02:57.354 CC lib/scsi/scsi.o 00:02:57.354 CC lib/scsi/scsi_pr.o 00:02:57.354 CC lib/scsi/scsi_bdev.o 00:02:57.354 CC lib/scsi/task.o 00:02:57.354 CC lib/scsi/scsi_rpc.o 00:02:57.920 LIB libspdk_nbd.a 00:02:57.920 LIB libspdk_scsi.a 00:02:58.177 SO libspdk_nbd.so.6.0 00:02:58.177 SO libspdk_scsi.so.8.0 00:02:58.177 SYMLINK libspdk_nbd.so 00:02:58.177 SYMLINK libspdk_scsi.so 00:02:58.177 LIB libspdk_ublk.a 00:02:58.177 SO libspdk_ublk.so.2.0 00:02:58.177 SYMLINK libspdk_ublk.so 00:02:58.435 CC lib/vhost/vhost_rpc.o 00:02:58.435 CC lib/iscsi/conn.o 00:02:58.435 CC lib/vhost/vhost.o 00:02:58.435 CC lib/iscsi/init_grp.o 00:02:58.435 CC lib/iscsi/iscsi.o 00:02:58.435 CC lib/iscsi/md5.o 00:02:58.435 CC lib/vhost/vhost_scsi.o 00:02:58.435 CC lib/vhost/rte_vhost_user.o 00:02:58.435 CC lib/vhost/vhost_blk.o 00:02:58.435 CC lib/iscsi/portal_grp.o 00:02:58.435 CC lib/iscsi/param.o 00:02:58.435 CC lib/iscsi/tgt_node.o 00:02:58.435 CC lib/iscsi/iscsi_rpc.o 00:02:58.435 CC lib/iscsi/iscsi_subsystem.o 00:02:58.435 CC lib/iscsi/task.o 00:02:58.435 LIB libspdk_ftl.a 00:02:58.435 SO libspdk_ftl.so.8.0 00:02:58.694 SYMLINK libspdk_ftl.so 00:02:58.953 LIB libspdk_nvmf.a 00:02:59.212 SO libspdk_nvmf.so.17.0 00:02:59.212 LIB libspdk_vhost.a 00:02:59.212 SO libspdk_vhost.so.7.1 00:02:59.212 SYMLINK libspdk_nvmf.so 00:02:59.212 SYMLINK libspdk_vhost.so 00:02:59.212 LIB libspdk_iscsi.a 00:02:59.471 SO libspdk_iscsi.so.7.0 00:02:59.471 SYMLINK libspdk_iscsi.so 00:02:59.730 CC module/env_dpdk/env_dpdk_rpc.o 00:02:59.730 CC module/vfu_device/vfu_virtio.o 00:02:59.730 CC module/vfu_device/vfu_virtio_blk.o 00:02:59.730 CC module/vfu_device/vfu_virtio_scsi.o 00:02:59.730 CC module/vfu_device/vfu_virtio_rpc.o 00:02:59.989 CC module/accel/iaa/accel_iaa.o 00:02:59.989 CC module/accel/iaa/accel_iaa_rpc.o 00:02:59.989 CC module/sock/posix/posix.o 00:02:59.989 CC module/scheduler/gscheduler/gscheduler.o 00:02:59.989 CC module/accel/ioat/accel_ioat.o 00:02:59.989 CC module/accel/ioat/accel_ioat_rpc.o 00:02:59.989 CC module/accel/error/accel_error.o 00:02:59.989 CC module/accel/error/accel_error_rpc.o 00:02:59.989 CC module/scheduler/dpdk_governor/dpdk_governor.o 00:02:59.989 CC module/accel/dsa/accel_dsa.o 00:02:59.989 CC module/accel/dsa/accel_dsa_rpc.o 00:02:59.989 CC module/blob/bdev/blob_bdev.o 00:02:59.989 CC module/scheduler/dynamic/scheduler_dynamic.o 00:02:59.989 LIB libspdk_env_dpdk_rpc.a 00:02:59.989 SO libspdk_env_dpdk_rpc.so.5.0 00:02:59.989 SYMLINK libspdk_env_dpdk_rpc.so 00:02:59.989 LIB libspdk_scheduler_gscheduler.a 00:02:59.989 SO libspdk_scheduler_gscheduler.so.3.0 00:02:59.989 LIB libspdk_accel_ioat.a 00:02:59.989 LIB libspdk_scheduler_dpdk_governor.a 00:02:59.989 LIB libspdk_accel_iaa.a 00:02:59.989 SO libspdk_scheduler_dpdk_governor.so.3.0 00:02:59.989 LIB libspdk_accel_error.a 00:03:00.248 SO libspdk_accel_ioat.so.5.0 00:03:00.248 LIB libspdk_scheduler_dynamic.a 00:03:00.248 SYMLINK libspdk_scheduler_gscheduler.so 00:03:00.248 SO libspdk_accel_iaa.so.2.0 00:03:00.248 LIB libspdk_accel_dsa.a 00:03:00.248 SO libspdk_accel_error.so.1.0 00:03:00.248 SO libspdk_scheduler_dynamic.so.3.0 00:03:00.248 SYMLINK libspdk_accel_ioat.so 00:03:00.248 SYMLINK libspdk_scheduler_dpdk_governor.so 00:03:00.248 LIB libspdk_blob_bdev.a 00:03:00.248 SYMLINK libspdk_accel_iaa.so 00:03:00.248 SO libspdk_accel_dsa.so.4.0 00:03:00.248 SYMLINK libspdk_scheduler_dynamic.so 00:03:00.248 SYMLINK libspdk_accel_error.so 00:03:00.248 SO libspdk_blob_bdev.so.10.1 00:03:00.248 SYMLINK libspdk_accel_dsa.so 00:03:00.248 SYMLINK libspdk_blob_bdev.so 00:03:00.248 LIB libspdk_vfu_device.a 00:03:00.507 SO libspdk_vfu_device.so.2.0 00:03:00.507 LIB libspdk_sock_posix.a 00:03:00.507 SYMLINK libspdk_vfu_device.so 00:03:00.507 SO libspdk_sock_posix.so.5.0 00:03:00.507 CC module/bdev/malloc/bdev_malloc.o 00:03:00.507 CC module/bdev/malloc/bdev_malloc_rpc.o 00:03:00.507 CC module/bdev/error/vbdev_error_rpc.o 00:03:00.507 CC module/bdev/error/vbdev_error.o 00:03:00.507 CC module/bdev/nvme/bdev_nvme_rpc.o 00:03:00.507 CC module/bdev/nvme/bdev_nvme.o 00:03:00.507 CC module/bdev/zone_block/vbdev_zone_block_rpc.o 00:03:00.507 CC module/bdev/zone_block/vbdev_zone_block.o 00:03:00.507 CC module/bdev/nvme/bdev_mdns_client.o 00:03:00.507 CC module/bdev/split/vbdev_split.o 00:03:00.507 CC module/bdev/nvme/nvme_rpc.o 00:03:00.507 CC module/bdev/split/vbdev_split_rpc.o 00:03:00.507 CC module/bdev/virtio/bdev_virtio_scsi.o 00:03:00.507 CC module/bdev/nvme/vbdev_opal.o 00:03:00.507 CC module/bdev/nvme/vbdev_opal_rpc.o 00:03:00.507 CC module/bdev/virtio/bdev_virtio_blk.o 00:03:00.507 CC module/bdev/nvme/bdev_nvme_cuse_rpc.o 00:03:00.507 CC module/bdev/virtio/bdev_virtio_rpc.o 00:03:00.507 CC module/bdev/passthru/vbdev_passthru.o 00:03:00.507 CC module/bdev/gpt/vbdev_gpt.o 00:03:00.507 CC module/bdev/gpt/gpt.o 00:03:00.507 CC module/bdev/passthru/vbdev_passthru_rpc.o 00:03:00.507 CC module/bdev/null/bdev_null.o 00:03:00.507 CC module/blobfs/bdev/blobfs_bdev.o 00:03:00.507 CC module/blobfs/bdev/blobfs_bdev_rpc.o 00:03:00.507 CC module/bdev/null/bdev_null_rpc.o 00:03:00.507 CC module/bdev/delay/vbdev_delay.o 00:03:00.507 CC module/bdev/delay/vbdev_delay_rpc.o 00:03:00.507 CC module/bdev/raid/bdev_raid.o 00:03:00.507 CC module/bdev/raid/bdev_raid_rpc.o 00:03:00.507 CC module/bdev/raid/bdev_raid_sb.o 00:03:00.507 CC module/bdev/raid/raid0.o 00:03:00.507 CC module/bdev/raid/raid1.o 00:03:00.507 CC module/bdev/raid/concat.o 00:03:00.507 CC module/bdev/ftl/bdev_ftl.o 00:03:00.507 CC module/bdev/aio/bdev_aio.o 00:03:00.507 CC module/bdev/aio/bdev_aio_rpc.o 00:03:00.507 CC module/bdev/ftl/bdev_ftl_rpc.o 00:03:00.507 CC module/bdev/lvol/vbdev_lvol.o 00:03:00.507 SYMLINK libspdk_sock_posix.so 00:03:00.507 CC module/bdev/lvol/vbdev_lvol_rpc.o 00:03:00.507 CC module/bdev/iscsi/bdev_iscsi.o 00:03:00.507 CC module/bdev/iscsi/bdev_iscsi_rpc.o 00:03:00.765 LIB libspdk_bdev_split.a 00:03:00.765 LIB libspdk_blobfs_bdev.a 00:03:00.765 SO libspdk_bdev_split.so.5.0 00:03:00.765 LIB libspdk_bdev_error.a 00:03:00.765 LIB libspdk_bdev_gpt.a 00:03:00.765 LIB libspdk_bdev_null.a 00:03:00.765 SO libspdk_blobfs_bdev.so.5.0 00:03:00.765 SO libspdk_bdev_error.so.5.0 00:03:00.765 SO libspdk_bdev_null.so.5.0 00:03:00.765 LIB libspdk_bdev_ftl.a 00:03:00.765 SO libspdk_bdev_gpt.so.5.0 00:03:00.765 LIB libspdk_bdev_passthru.a 00:03:00.765 LIB libspdk_bdev_malloc.a 00:03:00.765 SYMLINK libspdk_bdev_split.so 00:03:00.765 LIB libspdk_bdev_aio.a 00:03:00.765 SO libspdk_bdev_passthru.so.5.0 00:03:01.024 SYMLINK libspdk_blobfs_bdev.so 00:03:01.024 SO libspdk_bdev_ftl.so.5.0 00:03:01.024 SO libspdk_bdev_malloc.so.5.0 00:03:01.024 LIB libspdk_bdev_zone_block.a 00:03:01.024 SYMLINK libspdk_bdev_null.so 00:03:01.024 SYMLINK libspdk_bdev_error.so 00:03:01.024 SYMLINK libspdk_bdev_gpt.so 00:03:01.024 SO libspdk_bdev_aio.so.5.0 00:03:01.024 LIB libspdk_bdev_iscsi.a 00:03:01.024 LIB libspdk_bdev_delay.a 00:03:01.024 SO libspdk_bdev_zone_block.so.5.0 00:03:01.024 SYMLINK libspdk_bdev_passthru.so 00:03:01.024 SO libspdk_bdev_delay.so.5.0 00:03:01.024 SO libspdk_bdev_iscsi.so.5.0 00:03:01.024 SYMLINK libspdk_bdev_ftl.so 00:03:01.024 SYMLINK libspdk_bdev_malloc.so 00:03:01.024 SYMLINK libspdk_bdev_aio.so 00:03:01.024 SYMLINK libspdk_bdev_zone_block.so 00:03:01.024 SYMLINK libspdk_bdev_delay.so 00:03:01.024 LIB libspdk_bdev_virtio.a 00:03:01.024 SYMLINK libspdk_bdev_iscsi.so 00:03:01.024 LIB libspdk_bdev_lvol.a 00:03:01.024 SO libspdk_bdev_virtio.so.5.0 00:03:01.024 SO libspdk_bdev_lvol.so.5.0 00:03:01.024 SYMLINK libspdk_bdev_virtio.so 00:03:01.024 SYMLINK libspdk_bdev_lvol.so 00:03:01.283 LIB libspdk_bdev_raid.a 00:03:01.283 SO libspdk_bdev_raid.so.5.0 00:03:01.543 SYMLINK libspdk_bdev_raid.so 00:03:02.111 LIB libspdk_bdev_nvme.a 00:03:02.111 SO libspdk_bdev_nvme.so.6.0 00:03:02.371 SYMLINK libspdk_bdev_nvme.so 00:03:02.630 CC module/event/subsystems/scheduler/scheduler.o 00:03:02.630 CC module/event/subsystems/iobuf/iobuf.o 00:03:02.630 CC module/event/subsystems/iobuf/iobuf_rpc.o 00:03:02.630 CC module/event/subsystems/vfu_tgt/vfu_tgt.o 00:03:02.630 CC module/event/subsystems/vmd/vmd.o 00:03:02.630 CC module/event/subsystems/vmd/vmd_rpc.o 00:03:02.630 CC module/event/subsystems/vhost_blk/vhost_blk.o 00:03:02.630 CC module/event/subsystems/sock/sock.o 00:03:02.889 LIB libspdk_event_scheduler.a 00:03:02.889 LIB libspdk_event_vfu_tgt.a 00:03:02.889 LIB libspdk_event_iobuf.a 00:03:02.889 SO libspdk_event_scheduler.so.3.0 00:03:02.889 LIB libspdk_event_vmd.a 00:03:02.889 LIB libspdk_event_sock.a 00:03:02.889 LIB libspdk_event_vhost_blk.a 00:03:02.889 SO libspdk_event_vfu_tgt.so.2.0 00:03:02.889 SO libspdk_event_iobuf.so.2.0 00:03:02.889 SO libspdk_event_sock.so.4.0 00:03:02.889 SO libspdk_event_vmd.so.5.0 00:03:02.889 SO libspdk_event_vhost_blk.so.2.0 00:03:02.889 SYMLINK libspdk_event_scheduler.so 00:03:02.889 SYMLINK libspdk_event_vfu_tgt.so 00:03:02.889 SYMLINK libspdk_event_sock.so 00:03:02.889 SYMLINK libspdk_event_iobuf.so 00:03:02.889 SYMLINK libspdk_event_vmd.so 00:03:02.889 SYMLINK libspdk_event_vhost_blk.so 00:03:03.148 CC module/event/subsystems/accel/accel.o 00:03:03.148 LIB libspdk_event_accel.a 00:03:03.148 SO libspdk_event_accel.so.5.0 00:03:03.148 SYMLINK libspdk_event_accel.so 00:03:03.410 CC module/event/subsystems/bdev/bdev.o 00:03:03.784 LIB libspdk_event_bdev.a 00:03:03.784 SO libspdk_event_bdev.so.5.0 00:03:03.784 SYMLINK libspdk_event_bdev.so 00:03:03.784 CC module/event/subsystems/nvmf/nvmf_rpc.o 00:03:03.784 CC module/event/subsystems/nvmf/nvmf_tgt.o 00:03:03.784 CC module/event/subsystems/scsi/scsi.o 00:03:03.784 CC module/event/subsystems/ublk/ublk.o 00:03:03.784 CC module/event/subsystems/nbd/nbd.o 00:03:04.085 LIB libspdk_event_ublk.a 00:03:04.085 LIB libspdk_event_scsi.a 00:03:04.085 SO libspdk_event_ublk.so.2.0 00:03:04.085 LIB libspdk_event_nbd.a 00:03:04.085 SO libspdk_event_scsi.so.5.0 00:03:04.085 LIB libspdk_event_nvmf.a 00:03:04.085 SO libspdk_event_nbd.so.5.0 00:03:04.085 SO libspdk_event_nvmf.so.5.0 00:03:04.085 SYMLINK libspdk_event_ublk.so 00:03:04.085 SYMLINK libspdk_event_scsi.so 00:03:04.085 SYMLINK libspdk_event_nbd.so 00:03:04.085 SYMLINK libspdk_event_nvmf.so 00:03:04.424 CC module/event/subsystems/vhost_scsi/vhost_scsi.o 00:03:04.424 CC module/event/subsystems/iscsi/iscsi.o 00:03:04.424 LIB libspdk_event_vhost_scsi.a 00:03:04.424 SO libspdk_event_vhost_scsi.so.2.0 00:03:04.424 LIB libspdk_event_iscsi.a 00:03:04.424 SO libspdk_event_iscsi.so.5.0 00:03:04.424 SYMLINK libspdk_event_vhost_scsi.so 00:03:04.424 SYMLINK libspdk_event_iscsi.so 00:03:04.683 SO libspdk.so.5.0 00:03:04.683 SYMLINK libspdk.so 00:03:04.948 TEST_HEADER include/spdk/accel.h 00:03:04.948 TEST_HEADER include/spdk/assert.h 00:03:04.948 TEST_HEADER include/spdk/accel_module.h 00:03:04.948 TEST_HEADER include/spdk/barrier.h 00:03:04.948 TEST_HEADER include/spdk/base64.h 00:03:04.948 TEST_HEADER include/spdk/bdev.h 00:03:04.948 TEST_HEADER include/spdk/bdev_module.h 00:03:04.948 TEST_HEADER include/spdk/bit_array.h 00:03:04.948 TEST_HEADER include/spdk/bdev_zone.h 00:03:04.948 TEST_HEADER include/spdk/bit_pool.h 00:03:04.948 CC app/trace_record/trace_record.o 00:03:04.948 TEST_HEADER include/spdk/blobfs_bdev.h 00:03:04.948 TEST_HEADER include/spdk/blobfs.h 00:03:04.948 TEST_HEADER include/spdk/blob.h 00:03:04.948 CC app/spdk_nvme_identify/identify.o 00:03:04.948 TEST_HEADER include/spdk/config.h 00:03:04.948 TEST_HEADER include/spdk/cpuset.h 00:03:04.948 CC app/spdk_lspci/spdk_lspci.o 00:03:04.948 TEST_HEADER include/spdk/conf.h 00:03:04.948 TEST_HEADER include/spdk/blob_bdev.h 00:03:04.948 TEST_HEADER include/spdk/crc32.h 00:03:04.948 TEST_HEADER include/spdk/crc16.h 00:03:04.948 TEST_HEADER include/spdk/crc64.h 00:03:04.948 TEST_HEADER include/spdk/dif.h 00:03:04.948 TEST_HEADER include/spdk/dma.h 00:03:04.948 CXX app/trace/trace.o 00:03:04.948 TEST_HEADER include/spdk/env_dpdk.h 00:03:04.948 CC app/spdk_nvme_perf/perf.o 00:03:04.948 TEST_HEADER include/spdk/endian.h 00:03:04.948 TEST_HEADER include/spdk/event.h 00:03:04.948 TEST_HEADER include/spdk/env.h 00:03:04.948 TEST_HEADER include/spdk/fd.h 00:03:04.948 TEST_HEADER include/spdk/fd_group.h 00:03:04.948 TEST_HEADER include/spdk/file.h 00:03:04.948 CC app/spdk_top/spdk_top.o 00:03:04.948 TEST_HEADER include/spdk/gpt_spec.h 00:03:04.948 TEST_HEADER include/spdk/hexlify.h 00:03:04.948 TEST_HEADER include/spdk/ftl.h 00:03:04.948 CC test/rpc_client/rpc_client_test.o 00:03:04.948 TEST_HEADER include/spdk/histogram_data.h 00:03:04.948 TEST_HEADER include/spdk/idxd.h 00:03:04.948 TEST_HEADER include/spdk/init.h 00:03:04.948 TEST_HEADER include/spdk/idxd_spec.h 00:03:04.948 TEST_HEADER include/spdk/ioat.h 00:03:04.949 CC app/spdk_nvme_discover/discovery_aer.o 00:03:04.949 TEST_HEADER include/spdk/ioat_spec.h 00:03:04.949 TEST_HEADER include/spdk/iscsi_spec.h 00:03:04.949 TEST_HEADER include/spdk/jsonrpc.h 00:03:04.949 TEST_HEADER include/spdk/json.h 00:03:04.949 TEST_HEADER include/spdk/likely.h 00:03:04.949 TEST_HEADER include/spdk/log.h 00:03:04.949 TEST_HEADER include/spdk/lvol.h 00:03:04.949 TEST_HEADER include/spdk/memory.h 00:03:04.949 TEST_HEADER include/spdk/nbd.h 00:03:04.949 TEST_HEADER include/spdk/mmio.h 00:03:04.949 TEST_HEADER include/spdk/nvme.h 00:03:04.949 TEST_HEADER include/spdk/notify.h 00:03:04.949 TEST_HEADER include/spdk/nvme_ocssd.h 00:03:04.949 TEST_HEADER include/spdk/nvme_intel.h 00:03:04.949 TEST_HEADER include/spdk/nvme_ocssd_spec.h 00:03:04.949 TEST_HEADER include/spdk/nvme_spec.h 00:03:04.949 CC app/iscsi_tgt/iscsi_tgt.o 00:03:04.949 CC app/spdk_dd/spdk_dd.o 00:03:04.949 TEST_HEADER include/spdk/nvme_zns.h 00:03:04.949 CC app/nvmf_tgt/nvmf_main.o 00:03:04.949 TEST_HEADER include/spdk/nvmf_cmd.h 00:03:04.949 CC examples/interrupt_tgt/interrupt_tgt.o 00:03:04.949 TEST_HEADER include/spdk/nvmf_fc_spec.h 00:03:04.949 TEST_HEADER include/spdk/nvmf.h 00:03:04.949 TEST_HEADER include/spdk/nvmf_spec.h 00:03:04.949 TEST_HEADER include/spdk/opal.h 00:03:04.949 TEST_HEADER include/spdk/opal_spec.h 00:03:04.949 TEST_HEADER include/spdk/nvmf_transport.h 00:03:04.949 TEST_HEADER include/spdk/pipe.h 00:03:04.949 TEST_HEADER include/spdk/pci_ids.h 00:03:04.949 TEST_HEADER include/spdk/reduce.h 00:03:04.949 TEST_HEADER include/spdk/queue.h 00:03:04.949 TEST_HEADER include/spdk/rpc.h 00:03:04.949 TEST_HEADER include/spdk/scsi_spec.h 00:03:04.949 TEST_HEADER include/spdk/scheduler.h 00:03:04.949 TEST_HEADER include/spdk/scsi.h 00:03:04.949 TEST_HEADER include/spdk/sock.h 00:03:04.949 TEST_HEADER include/spdk/stdinc.h 00:03:04.949 TEST_HEADER include/spdk/thread.h 00:03:04.949 TEST_HEADER include/spdk/trace_parser.h 00:03:04.949 TEST_HEADER include/spdk/string.h 00:03:04.949 TEST_HEADER include/spdk/trace.h 00:03:04.949 TEST_HEADER include/spdk/tree.h 00:03:04.949 TEST_HEADER include/spdk/ublk.h 00:03:04.949 TEST_HEADER include/spdk/util.h 00:03:04.949 TEST_HEADER include/spdk/uuid.h 00:03:04.949 TEST_HEADER include/spdk/version.h 00:03:04.949 CC app/spdk_tgt/spdk_tgt.o 00:03:04.949 TEST_HEADER include/spdk/vfio_user_pci.h 00:03:04.949 TEST_HEADER include/spdk/vhost.h 00:03:04.949 TEST_HEADER include/spdk/vmd.h 00:03:04.949 TEST_HEADER include/spdk/vfio_user_spec.h 00:03:04.949 CC app/vhost/vhost.o 00:03:04.949 TEST_HEADER include/spdk/xor.h 00:03:04.949 TEST_HEADER include/spdk/zipf.h 00:03:04.949 CXX test/cpp_headers/accel.o 00:03:04.949 CXX test/cpp_headers/accel_module.o 00:03:04.949 CXX test/cpp_headers/assert.o 00:03:04.949 CXX test/cpp_headers/base64.o 00:03:04.949 CXX test/cpp_headers/barrier.o 00:03:04.949 CXX test/cpp_headers/bdev_module.o 00:03:04.949 CXX test/cpp_headers/bdev.o 00:03:04.949 CXX test/cpp_headers/bdev_zone.o 00:03:04.949 CXX test/cpp_headers/bit_array.o 00:03:04.949 CXX test/cpp_headers/bit_pool.o 00:03:04.949 CXX test/cpp_headers/blob_bdev.o 00:03:04.949 CXX test/cpp_headers/blob.o 00:03:04.949 CXX test/cpp_headers/blobfs.o 00:03:04.949 CXX test/cpp_headers/blobfs_bdev.o 00:03:04.949 CXX test/cpp_headers/conf.o 00:03:04.949 CXX test/cpp_headers/config.o 00:03:04.949 CXX test/cpp_headers/cpuset.o 00:03:04.949 CXX test/cpp_headers/crc16.o 00:03:04.949 CXX test/cpp_headers/crc32.o 00:03:04.949 CXX test/cpp_headers/dif.o 00:03:04.949 CXX test/cpp_headers/crc64.o 00:03:04.949 CC examples/accel/perf/accel_perf.o 00:03:04.949 CC test/event/event_perf/event_perf.o 00:03:04.949 CC examples/ioat/perf/perf.o 00:03:04.949 CC examples/vmd/led/led.o 00:03:04.949 CC examples/ioat/verify/verify.o 00:03:04.949 CC test/env/vtophys/vtophys.o 00:03:04.949 CC test/env/env_dpdk_post_init/env_dpdk_post_init.o 00:03:04.949 CC test/nvme/sgl/sgl.o 00:03:04.949 CC test/nvme/overhead/overhead.o 00:03:04.949 CC examples/nvme/pmr_persistence/pmr_persistence.o 00:03:04.949 CC examples/nvme/nvme_manage/nvme_manage.o 00:03:04.949 CC examples/vmd/lsvmd/lsvmd.o 00:03:04.949 CC examples/sock/hello_world/hello_sock.o 00:03:04.949 CC test/nvme/reset/reset.o 00:03:04.949 CC test/nvme/compliance/nvme_compliance.o 00:03:04.949 CC examples/nvme/reconnect/reconnect.o 00:03:04.949 CC test/event/reactor/reactor.o 00:03:04.949 CC examples/util/zipf/zipf.o 00:03:04.949 CC test/app/jsoncat/jsoncat.o 00:03:04.949 CC test/app/histogram_perf/histogram_perf.o 00:03:04.949 CC test/env/memory/memory_ut.o 00:03:04.949 CC app/fio/nvme/fio_plugin.o 00:03:04.949 CC test/nvme/aer/aer.o 00:03:04.949 CXX test/cpp_headers/dma.o 00:03:04.949 CC examples/nvme/cmb_copy/cmb_copy.o 00:03:04.949 CC test/nvme/err_injection/err_injection.o 00:03:04.949 CC test/thread/poller_perf/poller_perf.o 00:03:04.949 CC test/app/stub/stub.o 00:03:04.949 CC examples/thread/thread/thread_ex.o 00:03:04.949 CC examples/nvme/abort/abort.o 00:03:04.949 CC test/blobfs/mkfs/mkfs.o 00:03:04.949 CC test/nvme/simple_copy/simple_copy.o 00:03:04.949 CC test/env/pci/pci_ut.o 00:03:04.949 CC test/nvme/e2edp/nvme_dp.o 00:03:04.949 CC test/nvme/connect_stress/connect_stress.o 00:03:04.949 CC test/bdev/bdevio/bdevio.o 00:03:04.949 CC examples/nvme/hotplug/hotplug.o 00:03:04.949 CC test/nvme/boot_partition/boot_partition.o 00:03:04.949 CC examples/nvmf/nvmf/nvmf.o 00:03:04.949 CC test/event/app_repeat/app_repeat.o 00:03:04.949 CC examples/nvme/arbitration/arbitration.o 00:03:04.949 CC examples/blob/cli/blobcli.o 00:03:04.949 CC test/nvme/reserve/reserve.o 00:03:04.949 CC examples/blob/hello_world/hello_blob.o 00:03:04.949 CC test/nvme/doorbell_aers/doorbell_aers.o 00:03:04.949 CC test/nvme/fdp/fdp.o 00:03:04.949 CC examples/idxd/perf/perf.o 00:03:04.949 CC test/nvme/cuse/cuse.o 00:03:04.949 CC test/accel/dif/dif.o 00:03:04.949 CC test/dma/test_dma/test_dma.o 00:03:04.949 CC test/nvme/startup/startup.o 00:03:05.212 CC test/event/scheduler/scheduler.o 00:03:05.212 CC test/event/reactor_perf/reactor_perf.o 00:03:05.212 CC test/nvme/fused_ordering/fused_ordering.o 00:03:05.212 CC examples/nvme/hello_world/hello_world.o 00:03:05.212 CC test/app/bdev_svc/bdev_svc.o 00:03:05.213 CC examples/bdev/bdevperf/bdevperf.o 00:03:05.213 CC app/fio/bdev/fio_plugin.o 00:03:05.213 CC examples/bdev/hello_world/hello_bdev.o 00:03:05.213 LINK spdk_lspci 00:03:05.213 CC test/env/mem_callbacks/mem_callbacks.o 00:03:05.213 CC test/app/fuzz/nvme_fuzz/nvme_fuzz.o 00:03:05.213 CC test/lvol/esnap/esnap.o 00:03:05.213 LINK interrupt_tgt 00:03:05.480 LINK lsvmd 00:03:05.480 LINK iscsi_tgt 00:03:05.480 LINK vtophys 00:03:05.480 LINK jsoncat 00:03:05.480 LINK spdk_trace_record 00:03:05.480 LINK histogram_perf 00:03:05.480 LINK zipf 00:03:05.480 LINK poller_perf 00:03:05.480 LINK app_repeat 00:03:05.480 LINK rpc_client_test 00:03:05.480 LINK pmr_persistence 00:03:05.480 LINK spdk_tgt 00:03:05.480 LINK nvmf_tgt 00:03:05.480 LINK stub 00:03:05.480 CXX test/cpp_headers/endian.o 00:03:05.480 CXX test/cpp_headers/env_dpdk.o 00:03:05.480 LINK boot_partition 00:03:05.480 CXX test/cpp_headers/env.o 00:03:05.480 LINK spdk_nvme_discover 00:03:05.480 LINK startup 00:03:05.480 CXX test/cpp_headers/event.o 00:03:05.480 CXX test/cpp_headers/fd_group.o 00:03:05.480 CXX test/cpp_headers/fd.o 00:03:05.480 CXX test/cpp_headers/file.o 00:03:05.480 LINK cmb_copy 00:03:05.480 LINK event_perf 00:03:05.480 LINK led 00:03:05.480 CXX test/cpp_headers/ftl.o 00:03:05.480 CXX test/cpp_headers/gpt_spec.o 00:03:05.480 LINK verify 00:03:05.480 CXX test/cpp_headers/hexlify.o 00:03:05.480 LINK vhost 00:03:05.480 LINK reactor 00:03:05.480 LINK env_dpdk_post_init 00:03:05.480 LINK hello_world 00:03:05.480 LINK reactor_perf 00:03:05.480 LINK reset 00:03:05.480 LINK sgl 00:03:05.480 LINK connect_stress 00:03:05.480 CC test/app/fuzz/iscsi_fuzz/iscsi_fuzz.o 00:03:05.480 LINK nvme_dp 00:03:05.480 LINK overhead 00:03:05.740 LINK err_injection 00:03:05.740 LINK doorbell_aers 00:03:05.740 LINK mkfs 00:03:05.740 LINK hello_bdev 00:03:05.740 LINK ioat_perf 00:03:05.740 CXX test/cpp_headers/histogram_data.o 00:03:05.740 LINK spdk_dd 00:03:05.740 LINK reserve 00:03:05.740 LINK bdev_svc 00:03:05.740 CXX test/cpp_headers/idxd.o 00:03:05.740 LINK hello_sock 00:03:05.740 CXX test/cpp_headers/idxd_spec.o 00:03:05.740 LINK fused_ordering 00:03:05.740 CXX test/cpp_headers/init.o 00:03:05.740 LINK nvme_compliance 00:03:05.740 LINK simple_copy 00:03:05.740 CXX test/cpp_headers/ioat.o 00:03:05.740 CXX test/cpp_headers/ioat_spec.o 00:03:05.740 LINK reconnect 00:03:05.740 CXX test/cpp_headers/iscsi_spec.o 00:03:05.740 LINK hotplug 00:03:05.740 LINK thread 00:03:05.740 LINK hello_blob 00:03:05.740 CXX test/cpp_headers/json.o 00:03:05.740 CXX test/cpp_headers/jsonrpc.o 00:03:05.740 CC test/app/fuzz/vhost_fuzz/vhost_fuzz_rpc.o 00:03:05.740 CXX test/cpp_headers/likely.o 00:03:05.740 LINK scheduler 00:03:05.740 CXX test/cpp_headers/log.o 00:03:05.740 LINK abort 00:03:05.740 CC test/app/fuzz/vhost_fuzz/vhost_fuzz.o 00:03:05.740 CXX test/cpp_headers/lvol.o 00:03:05.740 CXX test/cpp_headers/memory.o 00:03:05.740 LINK pci_ut 00:03:05.740 CXX test/cpp_headers/mmio.o 00:03:05.740 CXX test/cpp_headers/nbd.o 00:03:05.740 CXX test/cpp_headers/notify.o 00:03:05.741 LINK mem_callbacks 00:03:05.741 CXX test/cpp_headers/nvme.o 00:03:05.741 CXX test/cpp_headers/nvme_intel.o 00:03:05.741 LINK test_dma 00:03:05.741 CXX test/cpp_headers/nvme_ocssd.o 00:03:05.741 CXX test/cpp_headers/nvme_ocssd_spec.o 00:03:05.741 LINK dif 00:03:05.741 LINK aer 00:03:05.741 LINK bdevio 00:03:05.741 CXX test/cpp_headers/nvme_spec.o 00:03:05.741 CXX test/cpp_headers/nvme_zns.o 00:03:05.741 LINK accel_perf 00:03:05.741 CXX test/cpp_headers/nvmf_cmd.o 00:03:05.741 CXX test/cpp_headers/nvmf_fc_spec.o 00:03:05.741 CXX test/cpp_headers/nvmf.o 00:03:05.741 LINK nvmf 00:03:05.741 CXX test/cpp_headers/nvmf_spec.o 00:03:05.741 CXX test/cpp_headers/nvmf_transport.o 00:03:05.741 LINK fdp 00:03:05.741 CXX test/cpp_headers/opal.o 00:03:05.741 CXX test/cpp_headers/opal_spec.o 00:03:05.741 CXX test/cpp_headers/pci_ids.o 00:03:05.741 CXX test/cpp_headers/pipe.o 00:03:05.741 CXX test/cpp_headers/queue.o 00:03:05.741 CXX test/cpp_headers/reduce.o 00:03:05.741 CXX test/cpp_headers/rpc.o 00:03:05.741 CXX test/cpp_headers/scheduler.o 00:03:05.741 CXX test/cpp_headers/scsi.o 00:03:05.741 LINK arbitration 00:03:05.741 CXX test/cpp_headers/scsi_spec.o 00:03:05.741 CXX test/cpp_headers/sock.o 00:03:05.741 CXX test/cpp_headers/stdinc.o 00:03:05.741 CXX test/cpp_headers/string.o 00:03:05.741 CXX test/cpp_headers/thread.o 00:03:05.999 CXX test/cpp_headers/trace.o 00:03:05.999 CXX test/cpp_headers/trace_parser.o 00:03:05.999 CXX test/cpp_headers/tree.o 00:03:05.999 CXX test/cpp_headers/ublk.o 00:03:05.999 CXX test/cpp_headers/util.o 00:03:05.999 LINK idxd_perf 00:03:05.999 CXX test/cpp_headers/uuid.o 00:03:05.999 CXX test/cpp_headers/version.o 00:03:05.999 CXX test/cpp_headers/vfio_user_pci.o 00:03:05.999 CXX test/cpp_headers/vfio_user_spec.o 00:03:05.999 LINK nvme_fuzz 00:03:05.999 LINK spdk_trace 00:03:05.999 CXX test/cpp_headers/vhost.o 00:03:05.999 CXX test/cpp_headers/vmd.o 00:03:05.999 CXX test/cpp_headers/xor.o 00:03:05.999 CXX test/cpp_headers/zipf.o 00:03:05.999 LINK spdk_nvme 00:03:05.999 LINK spdk_bdev 00:03:05.999 LINK blobcli 00:03:05.999 LINK nvme_manage 00:03:06.258 LINK spdk_nvme_perf 00:03:06.258 LINK memory_ut 00:03:06.258 LINK bdevperf 00:03:06.258 LINK vhost_fuzz 00:03:06.516 LINK spdk_nvme_identify 00:03:06.516 LINK spdk_top 00:03:06.516 LINK cuse 00:03:07.084 LINK iscsi_fuzz 00:03:08.989 LINK esnap 00:03:09.249 00:03:09.249 real 0m29.699s 00:03:09.249 user 5m0.308s 00:03:09.249 sys 2m22.693s 00:03:09.249 18:49:25 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:03:09.249 18:49:25 -- common/autotest_common.sh@10 -- $ set +x 00:03:09.249 ************************************ 00:03:09.249 END TEST make 00:03:09.249 ************************************ 00:03:09.249 18:49:26 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:09.249 18:49:26 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:09.249 18:49:26 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:09.249 18:49:26 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:09.249 18:49:26 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:09.249 18:49:26 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:09.249 18:49:26 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:09.249 18:49:26 -- scripts/common.sh@335 -- # IFS=.-: 00:03:09.249 18:49:26 -- scripts/common.sh@335 -- # read -ra ver1 00:03:09.249 18:49:26 -- scripts/common.sh@336 -- # IFS=.-: 00:03:09.249 18:49:26 -- scripts/common.sh@336 -- # read -ra ver2 00:03:09.249 18:49:26 -- scripts/common.sh@337 -- # local 'op=<' 00:03:09.249 18:49:26 -- scripts/common.sh@339 -- # ver1_l=2 00:03:09.249 18:49:26 -- scripts/common.sh@340 -- # ver2_l=1 00:03:09.249 18:49:26 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:09.249 18:49:26 -- scripts/common.sh@343 -- # case "$op" in 00:03:09.249 18:49:26 -- scripts/common.sh@344 -- # : 1 00:03:09.249 18:49:26 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:09.249 18:49:26 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:09.249 18:49:26 -- scripts/common.sh@364 -- # decimal 1 00:03:09.249 18:49:26 -- scripts/common.sh@352 -- # local d=1 00:03:09.249 18:49:26 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:09.249 18:49:26 -- scripts/common.sh@354 -- # echo 1 00:03:09.249 18:49:26 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:09.249 18:49:26 -- scripts/common.sh@365 -- # decimal 2 00:03:09.249 18:49:26 -- scripts/common.sh@352 -- # local d=2 00:03:09.249 18:49:26 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:09.249 18:49:26 -- scripts/common.sh@354 -- # echo 2 00:03:09.249 18:49:26 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:09.249 18:49:26 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:09.249 18:49:26 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:09.249 18:49:26 -- scripts/common.sh@367 -- # return 0 00:03:09.249 18:49:26 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:09.249 18:49:26 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:09.249 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:09.249 --rc genhtml_branch_coverage=1 00:03:09.249 --rc genhtml_function_coverage=1 00:03:09.249 --rc genhtml_legend=1 00:03:09.249 --rc geninfo_all_blocks=1 00:03:09.249 --rc geninfo_unexecuted_blocks=1 00:03:09.249 00:03:09.249 ' 00:03:09.249 18:49:26 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:09.249 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:09.249 --rc genhtml_branch_coverage=1 00:03:09.249 --rc genhtml_function_coverage=1 00:03:09.249 --rc genhtml_legend=1 00:03:09.249 --rc geninfo_all_blocks=1 00:03:09.249 --rc geninfo_unexecuted_blocks=1 00:03:09.249 00:03:09.249 ' 00:03:09.249 18:49:26 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:09.249 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:09.249 --rc genhtml_branch_coverage=1 00:03:09.249 --rc genhtml_function_coverage=1 00:03:09.249 --rc genhtml_legend=1 00:03:09.249 --rc geninfo_all_blocks=1 00:03:09.249 --rc geninfo_unexecuted_blocks=1 00:03:09.249 00:03:09.249 ' 00:03:09.249 18:49:26 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:09.249 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:09.249 --rc genhtml_branch_coverage=1 00:03:09.249 --rc genhtml_function_coverage=1 00:03:09.249 --rc genhtml_legend=1 00:03:09.249 --rc geninfo_all_blocks=1 00:03:09.249 --rc geninfo_unexecuted_blocks=1 00:03:09.249 00:03:09.249 ' 00:03:09.249 18:49:26 -- spdk/autotest.sh@25 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:03:09.249 18:49:26 -- nvmf/common.sh@7 -- # uname -s 00:03:09.249 18:49:26 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:03:09.249 18:49:26 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:03:09.249 18:49:26 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:03:09.249 18:49:26 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:03:09.249 18:49:26 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:03:09.249 18:49:26 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:03:09.249 18:49:26 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:03:09.249 18:49:26 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:03:09.249 18:49:26 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:03:09.249 18:49:26 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:03:09.249 18:49:26 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:03:09.249 18:49:26 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:03:09.249 18:49:26 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:03:09.249 18:49:26 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:03:09.249 18:49:26 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:03:09.249 18:49:26 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:03:09.249 18:49:26 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:03:09.249 18:49:26 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:03:09.249 18:49:26 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:03:09.249 18:49:26 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:09.249 18:49:26 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:09.249 18:49:26 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:09.249 18:49:26 -- paths/export.sh@5 -- # export PATH 00:03:09.249 18:49:26 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:09.249 18:49:26 -- nvmf/common.sh@46 -- # : 0 00:03:09.249 18:49:26 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:03:09.249 18:49:26 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:03:09.249 18:49:26 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:03:09.249 18:49:26 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:03:09.249 18:49:26 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:03:09.249 18:49:26 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:03:09.249 18:49:26 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:03:09.249 18:49:26 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:03:09.249 18:49:26 -- spdk/autotest.sh@27 -- # '[' 0 -ne 0 ']' 00:03:09.249 18:49:26 -- spdk/autotest.sh@32 -- # uname -s 00:03:09.249 18:49:26 -- spdk/autotest.sh@32 -- # '[' Linux = Linux ']' 00:03:09.249 18:49:26 -- spdk/autotest.sh@33 -- # old_core_pattern='|/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h' 00:03:09.249 18:49:26 -- spdk/autotest.sh@34 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:03:09.509 18:49:26 -- spdk/autotest.sh@39 -- # echo '|/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/core-collector.sh %P %s %t' 00:03:09.509 18:49:26 -- spdk/autotest.sh@40 -- # echo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:03:09.509 18:49:26 -- spdk/autotest.sh@44 -- # modprobe nbd 00:03:09.509 18:49:26 -- spdk/autotest.sh@46 -- # type -P udevadm 00:03:09.509 18:49:26 -- spdk/autotest.sh@46 -- # udevadm=/usr/sbin/udevadm 00:03:09.509 18:49:26 -- spdk/autotest.sh@48 -- # udevadm_pid=2873499 00:03:09.509 18:49:26 -- spdk/autotest.sh@47 -- # /usr/sbin/udevadm monitor --property 00:03:09.509 18:49:26 -- spdk/autotest.sh@51 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:03:09.509 18:49:26 -- spdk/autotest.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:03:09.509 18:49:26 -- spdk/autotest.sh@54 -- # echo 2873501 00:03:09.509 18:49:26 -- spdk/autotest.sh@56 -- # echo 2873502 00:03:09.509 18:49:26 -- spdk/autotest.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:03:09.509 18:49:26 -- spdk/autotest.sh@58 -- # [[ ............................... != QEMU ]] 00:03:09.509 18:49:26 -- spdk/autotest.sh@60 -- # echo 2873503 00:03:09.509 18:49:26 -- spdk/autotest.sh@59 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:03:09.509 18:49:26 -- spdk/autotest.sh@62 -- # echo 2873504 00:03:09.509 18:49:26 -- spdk/autotest.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:03:09.509 18:49:26 -- spdk/autotest.sh@66 -- # trap 'autotest_cleanup || :; exit 1' SIGINT SIGTERM EXIT 00:03:09.509 18:49:26 -- spdk/autotest.sh@68 -- # timing_enter autotest 00:03:09.509 18:49:26 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:09.509 18:49:26 -- common/autotest_common.sh@10 -- # set +x 00:03:09.509 18:49:26 -- spdk/autotest.sh@70 -- # create_test_list 00:03:09.509 18:49:26 -- common/autotest_common.sh@746 -- # xtrace_disable 00:03:09.509 18:49:26 -- common/autotest_common.sh@10 -- # set +x 00:03:09.509 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-bmc-pm.bmc.pm.log 00:03:09.509 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-cpu-temp.pm.log 00:03:09.509 18:49:26 -- spdk/autotest.sh@72 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/autotest.sh 00:03:09.509 18:49:26 -- spdk/autotest.sh@72 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:09.509 18:49:26 -- spdk/autotest.sh@72 -- # src=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:09.509 18:49:26 -- spdk/autotest.sh@73 -- # out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:03:09.509 18:49:26 -- spdk/autotest.sh@74 -- # cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:09.509 18:49:26 -- spdk/autotest.sh@76 -- # freebsd_update_contigmem_mod 00:03:09.509 18:49:26 -- common/autotest_common.sh@1450 -- # uname 00:03:09.509 18:49:26 -- common/autotest_common.sh@1450 -- # '[' Linux = FreeBSD ']' 00:03:09.509 18:49:26 -- spdk/autotest.sh@77 -- # freebsd_set_maxsock_buf 00:03:09.509 18:49:26 -- common/autotest_common.sh@1470 -- # uname 00:03:09.509 18:49:26 -- common/autotest_common.sh@1470 -- # [[ Linux = FreeBSD ]] 00:03:09.509 18:49:26 -- spdk/autotest.sh@79 -- # [[ y == y ]] 00:03:09.509 18:49:26 -- spdk/autotest.sh@81 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 --version 00:03:09.509 lcov: LCOV version 1.15 00:03:09.509 18:49:26 -- spdk/autotest.sh@83 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -i -t Baseline -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info 00:03:21.722 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno:no functions found 00:03:21.722 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno 00:03:21.722 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno:no functions found 00:03:21.722 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno 00:03:21.722 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno:no functions found 00:03:21.722 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno 00:03:31.714 18:49:47 -- spdk/autotest.sh@87 -- # timing_enter pre_cleanup 00:03:31.714 18:49:47 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:31.714 18:49:47 -- common/autotest_common.sh@10 -- # set +x 00:03:31.714 18:49:47 -- spdk/autotest.sh@89 -- # rm -f 00:03:31.714 18:49:47 -- spdk/autotest.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:33.627 0000:5e:00.0 (8086 0a54): Already using the nvme driver 00:03:33.627 0000:00:04.7 (8086 2021): Already using the ioatdma driver 00:03:33.627 0000:00:04.6 (8086 2021): Already using the ioatdma driver 00:03:33.627 0000:00:04.5 (8086 2021): Already using the ioatdma driver 00:03:33.627 0000:00:04.4 (8086 2021): Already using the ioatdma driver 00:03:33.627 0000:00:04.3 (8086 2021): Already using the ioatdma driver 00:03:33.627 0000:00:04.2 (8086 2021): Already using the ioatdma driver 00:03:33.886 0000:00:04.1 (8086 2021): Already using the ioatdma driver 00:03:33.886 0000:00:04.0 (8086 2021): Already using the ioatdma driver 00:03:33.886 0000:80:04.7 (8086 2021): Already using the ioatdma driver 00:03:33.886 0000:80:04.6 (8086 2021): Already using the ioatdma driver 00:03:33.886 0000:80:04.5 (8086 2021): Already using the ioatdma driver 00:03:33.886 0000:80:04.4 (8086 2021): Already using the ioatdma driver 00:03:33.886 0000:80:04.3 (8086 2021): Already using the ioatdma driver 00:03:33.886 0000:80:04.2 (8086 2021): Already using the ioatdma driver 00:03:33.886 0000:80:04.1 (8086 2021): Already using the ioatdma driver 00:03:33.886 0000:80:04.0 (8086 2021): Already using the ioatdma driver 00:03:33.886 18:49:50 -- spdk/autotest.sh@94 -- # get_zoned_devs 00:03:33.886 18:49:50 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:03:33.886 18:49:50 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:03:33.886 18:49:50 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:03:33.886 18:49:50 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:03:33.886 18:49:50 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:03:33.886 18:49:50 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:03:33.886 18:49:50 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:33.886 18:49:50 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:03:33.886 18:49:50 -- spdk/autotest.sh@96 -- # (( 0 > 0 )) 00:03:33.886 18:49:50 -- spdk/autotest.sh@108 -- # ls /dev/nvme0n1 00:03:33.886 18:49:50 -- spdk/autotest.sh@108 -- # grep -v p 00:03:33.886 18:49:50 -- spdk/autotest.sh@108 -- # for dev in $(ls /dev/nvme*n* | grep -v p || true) 00:03:33.886 18:49:50 -- spdk/autotest.sh@110 -- # [[ -z '' ]] 00:03:33.886 18:49:50 -- spdk/autotest.sh@111 -- # block_in_use /dev/nvme0n1 00:03:33.886 18:49:50 -- scripts/common.sh@380 -- # local block=/dev/nvme0n1 pt 00:03:33.886 18:49:50 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py /dev/nvme0n1 00:03:34.145 No valid GPT data, bailing 00:03:34.145 18:49:50 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:03:34.145 18:49:50 -- scripts/common.sh@393 -- # pt= 00:03:34.145 18:49:50 -- scripts/common.sh@394 -- # return 1 00:03:34.145 18:49:50 -- spdk/autotest.sh@112 -- # dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=1 00:03:34.145 1+0 records in 00:03:34.145 1+0 records out 00:03:34.145 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00531716 s, 197 MB/s 00:03:34.145 18:49:50 -- spdk/autotest.sh@116 -- # sync 00:03:34.145 18:49:50 -- spdk/autotest.sh@118 -- # xtrace_disable_per_cmd reap_spdk_processes 00:03:34.145 18:49:50 -- common/autotest_common.sh@22 -- # eval 'reap_spdk_processes 12> /dev/null' 00:03:34.145 18:49:50 -- common/autotest_common.sh@22 -- # reap_spdk_processes 00:03:39.421 18:49:55 -- spdk/autotest.sh@122 -- # uname -s 00:03:39.421 18:49:55 -- spdk/autotest.sh@122 -- # '[' Linux = Linux ']' 00:03:39.421 18:49:55 -- spdk/autotest.sh@123 -- # run_test setup.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:03:39.421 18:49:55 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:39.421 18:49:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:39.421 18:49:55 -- common/autotest_common.sh@10 -- # set +x 00:03:39.421 ************************************ 00:03:39.421 START TEST setup.sh 00:03:39.421 ************************************ 00:03:39.421 18:49:55 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:03:39.421 * Looking for test storage... 00:03:39.421 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:39.421 18:49:55 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:39.421 18:49:55 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:39.421 18:49:55 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:39.421 18:49:55 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:39.421 18:49:55 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:39.421 18:49:55 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:39.421 18:49:55 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:39.421 18:49:55 -- scripts/common.sh@335 -- # IFS=.-: 00:03:39.421 18:49:55 -- scripts/common.sh@335 -- # read -ra ver1 00:03:39.421 18:49:55 -- scripts/common.sh@336 -- # IFS=.-: 00:03:39.421 18:49:55 -- scripts/common.sh@336 -- # read -ra ver2 00:03:39.421 18:49:55 -- scripts/common.sh@337 -- # local 'op=<' 00:03:39.421 18:49:55 -- scripts/common.sh@339 -- # ver1_l=2 00:03:39.421 18:49:55 -- scripts/common.sh@340 -- # ver2_l=1 00:03:39.421 18:49:55 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:39.421 18:49:55 -- scripts/common.sh@343 -- # case "$op" in 00:03:39.421 18:49:55 -- scripts/common.sh@344 -- # : 1 00:03:39.421 18:49:55 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:39.421 18:49:55 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:39.421 18:49:55 -- scripts/common.sh@364 -- # decimal 1 00:03:39.421 18:49:55 -- scripts/common.sh@352 -- # local d=1 00:03:39.421 18:49:55 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:39.421 18:49:55 -- scripts/common.sh@354 -- # echo 1 00:03:39.421 18:49:55 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:39.421 18:49:55 -- scripts/common.sh@365 -- # decimal 2 00:03:39.421 18:49:55 -- scripts/common.sh@352 -- # local d=2 00:03:39.421 18:49:55 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:39.421 18:49:55 -- scripts/common.sh@354 -- # echo 2 00:03:39.421 18:49:55 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:39.421 18:49:55 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:39.421 18:49:55 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:39.421 18:49:55 -- scripts/common.sh@367 -- # return 0 00:03:39.421 18:49:55 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:39.421 18:49:55 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:39.421 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:39.421 --rc genhtml_branch_coverage=1 00:03:39.421 --rc genhtml_function_coverage=1 00:03:39.421 --rc genhtml_legend=1 00:03:39.421 --rc geninfo_all_blocks=1 00:03:39.421 --rc geninfo_unexecuted_blocks=1 00:03:39.421 00:03:39.421 ' 00:03:39.421 18:49:55 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:39.421 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:39.421 --rc genhtml_branch_coverage=1 00:03:39.421 --rc genhtml_function_coverage=1 00:03:39.421 --rc genhtml_legend=1 00:03:39.421 --rc geninfo_all_blocks=1 00:03:39.421 --rc geninfo_unexecuted_blocks=1 00:03:39.421 00:03:39.421 ' 00:03:39.421 18:49:55 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:39.421 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:39.421 --rc genhtml_branch_coverage=1 00:03:39.421 --rc genhtml_function_coverage=1 00:03:39.421 --rc genhtml_legend=1 00:03:39.421 --rc geninfo_all_blocks=1 00:03:39.421 --rc geninfo_unexecuted_blocks=1 00:03:39.421 00:03:39.421 ' 00:03:39.421 18:49:55 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:39.421 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:39.421 --rc genhtml_branch_coverage=1 00:03:39.421 --rc genhtml_function_coverage=1 00:03:39.421 --rc genhtml_legend=1 00:03:39.421 --rc geninfo_all_blocks=1 00:03:39.421 --rc geninfo_unexecuted_blocks=1 00:03:39.421 00:03:39.421 ' 00:03:39.422 18:49:55 -- setup/test-setup.sh@10 -- # uname -s 00:03:39.422 18:49:55 -- setup/test-setup.sh@10 -- # [[ Linux == Linux ]] 00:03:39.422 18:49:55 -- setup/test-setup.sh@12 -- # run_test acl /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:03:39.422 18:49:55 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:39.422 18:49:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:39.422 18:49:55 -- common/autotest_common.sh@10 -- # set +x 00:03:39.422 ************************************ 00:03:39.422 START TEST acl 00:03:39.422 ************************************ 00:03:39.422 18:49:55 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:03:39.422 * Looking for test storage... 00:03:39.422 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:39.422 18:49:55 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:39.422 18:49:55 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:39.422 18:49:55 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:39.422 18:49:55 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:39.422 18:49:55 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:39.422 18:49:55 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:39.422 18:49:55 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:39.422 18:49:55 -- scripts/common.sh@335 -- # IFS=.-: 00:03:39.422 18:49:55 -- scripts/common.sh@335 -- # read -ra ver1 00:03:39.422 18:49:55 -- scripts/common.sh@336 -- # IFS=.-: 00:03:39.422 18:49:55 -- scripts/common.sh@336 -- # read -ra ver2 00:03:39.422 18:49:55 -- scripts/common.sh@337 -- # local 'op=<' 00:03:39.422 18:49:55 -- scripts/common.sh@339 -- # ver1_l=2 00:03:39.422 18:49:55 -- scripts/common.sh@340 -- # ver2_l=1 00:03:39.422 18:49:55 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:39.422 18:49:55 -- scripts/common.sh@343 -- # case "$op" in 00:03:39.422 18:49:55 -- scripts/common.sh@344 -- # : 1 00:03:39.422 18:49:55 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:39.422 18:49:55 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:39.422 18:49:55 -- scripts/common.sh@364 -- # decimal 1 00:03:39.422 18:49:55 -- scripts/common.sh@352 -- # local d=1 00:03:39.422 18:49:55 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:39.422 18:49:55 -- scripts/common.sh@354 -- # echo 1 00:03:39.422 18:49:55 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:39.422 18:49:55 -- scripts/common.sh@365 -- # decimal 2 00:03:39.422 18:49:55 -- scripts/common.sh@352 -- # local d=2 00:03:39.422 18:49:55 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:39.422 18:49:55 -- scripts/common.sh@354 -- # echo 2 00:03:39.422 18:49:55 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:39.422 18:49:55 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:39.422 18:49:55 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:39.422 18:49:55 -- scripts/common.sh@367 -- # return 0 00:03:39.422 18:49:55 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:39.422 18:49:55 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:39.422 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:39.422 --rc genhtml_branch_coverage=1 00:03:39.422 --rc genhtml_function_coverage=1 00:03:39.422 --rc genhtml_legend=1 00:03:39.422 --rc geninfo_all_blocks=1 00:03:39.422 --rc geninfo_unexecuted_blocks=1 00:03:39.422 00:03:39.422 ' 00:03:39.422 18:49:55 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:39.422 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:39.422 --rc genhtml_branch_coverage=1 00:03:39.422 --rc genhtml_function_coverage=1 00:03:39.422 --rc genhtml_legend=1 00:03:39.422 --rc geninfo_all_blocks=1 00:03:39.422 --rc geninfo_unexecuted_blocks=1 00:03:39.422 00:03:39.422 ' 00:03:39.422 18:49:55 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:39.422 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:39.422 --rc genhtml_branch_coverage=1 00:03:39.422 --rc genhtml_function_coverage=1 00:03:39.422 --rc genhtml_legend=1 00:03:39.422 --rc geninfo_all_blocks=1 00:03:39.422 --rc geninfo_unexecuted_blocks=1 00:03:39.422 00:03:39.422 ' 00:03:39.422 18:49:55 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:39.422 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:39.422 --rc genhtml_branch_coverage=1 00:03:39.422 --rc genhtml_function_coverage=1 00:03:39.422 --rc genhtml_legend=1 00:03:39.422 --rc geninfo_all_blocks=1 00:03:39.422 --rc geninfo_unexecuted_blocks=1 00:03:39.422 00:03:39.422 ' 00:03:39.422 18:49:55 -- setup/acl.sh@10 -- # get_zoned_devs 00:03:39.422 18:49:55 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:03:39.422 18:49:55 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:03:39.422 18:49:55 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:03:39.422 18:49:55 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:03:39.422 18:49:55 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:03:39.422 18:49:55 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:03:39.422 18:49:55 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:39.422 18:49:55 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:03:39.422 18:49:55 -- setup/acl.sh@12 -- # devs=() 00:03:39.422 18:49:55 -- setup/acl.sh@12 -- # declare -a devs 00:03:39.422 18:49:55 -- setup/acl.sh@13 -- # drivers=() 00:03:39.422 18:49:55 -- setup/acl.sh@13 -- # declare -A drivers 00:03:39.422 18:49:55 -- setup/acl.sh@51 -- # setup reset 00:03:39.422 18:49:55 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:39.422 18:49:55 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:42.711 18:49:59 -- setup/acl.sh@52 -- # collect_setup_devs 00:03:42.711 18:49:59 -- setup/acl.sh@16 -- # local dev driver 00:03:42.711 18:49:59 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:42.711 18:49:59 -- setup/acl.sh@15 -- # setup output status 00:03:42.711 18:49:59 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:42.711 18:49:59 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:03:45.245 Hugepages 00:03:45.245 node hugesize free / total 00:03:45.245 18:50:01 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:03:45.245 18:50:01 -- setup/acl.sh@19 -- # continue 00:03:45.245 18:50:01 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:45.245 18:50:01 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:03:45.245 18:50:01 -- setup/acl.sh@19 -- # continue 00:03:45.245 18:50:01 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:45.245 18:50:01 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:03:45.245 18:50:01 -- setup/acl.sh@19 -- # continue 00:03:45.245 18:50:01 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:45.245 00:03:45.245 Type BDF Vendor Device NUMA Driver Device Block devices 00:03:45.245 18:50:01 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:03:45.245 18:50:01 -- setup/acl.sh@19 -- # continue 00:03:45.245 18:50:01 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:45.245 18:50:01 -- setup/acl.sh@19 -- # [[ 0000:00:04.0 == *:*:*.* ]] 00:03:45.245 18:50:01 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:45.245 18:50:01 -- setup/acl.sh@20 -- # continue 00:03:45.245 18:50:01 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:45.245 18:50:01 -- setup/acl.sh@19 -- # [[ 0000:00:04.1 == *:*:*.* ]] 00:03:45.245 18:50:01 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:45.245 18:50:01 -- setup/acl.sh@20 -- # continue 00:03:45.245 18:50:01 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:45.245 18:50:01 -- setup/acl.sh@19 -- # [[ 0000:00:04.2 == *:*:*.* ]] 00:03:45.245 18:50:01 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:45.245 18:50:01 -- setup/acl.sh@20 -- # continue 00:03:45.245 18:50:01 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:45.245 18:50:01 -- setup/acl.sh@19 -- # [[ 0000:00:04.3 == *:*:*.* ]] 00:03:45.245 18:50:01 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:45.245 18:50:01 -- setup/acl.sh@20 -- # continue 00:03:45.245 18:50:01 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:45.245 18:50:01 -- setup/acl.sh@19 -- # [[ 0000:00:04.4 == *:*:*.* ]] 00:03:45.245 18:50:01 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:45.245 18:50:01 -- setup/acl.sh@20 -- # continue 00:03:45.245 18:50:01 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:45.245 18:50:01 -- setup/acl.sh@19 -- # [[ 0000:00:04.5 == *:*:*.* ]] 00:03:45.245 18:50:01 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:45.245 18:50:01 -- setup/acl.sh@20 -- # continue 00:03:45.245 18:50:01 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:45.245 18:50:01 -- setup/acl.sh@19 -- # [[ 0000:00:04.6 == *:*:*.* ]] 00:03:45.245 18:50:01 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:45.245 18:50:01 -- setup/acl.sh@20 -- # continue 00:03:45.245 18:50:01 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:45.245 18:50:01 -- setup/acl.sh@19 -- # [[ 0000:00:04.7 == *:*:*.* ]] 00:03:45.245 18:50:01 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:45.245 18:50:01 -- setup/acl.sh@20 -- # continue 00:03:45.245 18:50:01 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:45.245 18:50:01 -- setup/acl.sh@19 -- # [[ 0000:5e:00.0 == *:*:*.* ]] 00:03:45.245 18:50:01 -- setup/acl.sh@20 -- # [[ nvme == nvme ]] 00:03:45.245 18:50:01 -- setup/acl.sh@21 -- # [[ '' == *\0\0\0\0\:\5\e\:\0\0\.\0* ]] 00:03:45.245 18:50:01 -- setup/acl.sh@22 -- # devs+=("$dev") 00:03:45.245 18:50:01 -- setup/acl.sh@22 -- # drivers["$dev"]=nvme 00:03:45.245 18:50:01 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:45.245 18:50:01 -- setup/acl.sh@19 -- # [[ 0000:80:04.0 == *:*:*.* ]] 00:03:45.245 18:50:01 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:45.245 18:50:01 -- setup/acl.sh@20 -- # continue 00:03:45.245 18:50:01 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:45.245 18:50:01 -- setup/acl.sh@19 -- # [[ 0000:80:04.1 == *:*:*.* ]] 00:03:45.245 18:50:01 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:45.245 18:50:01 -- setup/acl.sh@20 -- # continue 00:03:45.245 18:50:01 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:45.245 18:50:01 -- setup/acl.sh@19 -- # [[ 0000:80:04.2 == *:*:*.* ]] 00:03:45.245 18:50:01 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:45.245 18:50:01 -- setup/acl.sh@20 -- # continue 00:03:45.245 18:50:01 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:45.245 18:50:01 -- setup/acl.sh@19 -- # [[ 0000:80:04.3 == *:*:*.* ]] 00:03:45.245 18:50:01 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:45.245 18:50:01 -- setup/acl.sh@20 -- # continue 00:03:45.245 18:50:01 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:45.245 18:50:01 -- setup/acl.sh@19 -- # [[ 0000:80:04.4 == *:*:*.* ]] 00:03:45.245 18:50:01 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:45.245 18:50:01 -- setup/acl.sh@20 -- # continue 00:03:45.245 18:50:01 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:45.245 18:50:01 -- setup/acl.sh@19 -- # [[ 0000:80:04.5 == *:*:*.* ]] 00:03:45.245 18:50:01 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:45.245 18:50:01 -- setup/acl.sh@20 -- # continue 00:03:45.245 18:50:01 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:45.245 18:50:01 -- setup/acl.sh@19 -- # [[ 0000:80:04.6 == *:*:*.* ]] 00:03:45.245 18:50:01 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:45.245 18:50:01 -- setup/acl.sh@20 -- # continue 00:03:45.245 18:50:01 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:45.245 18:50:01 -- setup/acl.sh@19 -- # [[ 0000:80:04.7 == *:*:*.* ]] 00:03:45.245 18:50:01 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:45.245 18:50:01 -- setup/acl.sh@20 -- # continue 00:03:45.245 18:50:01 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:45.245 18:50:01 -- setup/acl.sh@24 -- # (( 1 > 0 )) 00:03:45.245 18:50:01 -- setup/acl.sh@54 -- # run_test denied denied 00:03:45.245 18:50:01 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:45.245 18:50:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:45.245 18:50:01 -- common/autotest_common.sh@10 -- # set +x 00:03:45.245 ************************************ 00:03:45.245 START TEST denied 00:03:45.245 ************************************ 00:03:45.245 18:50:01 -- common/autotest_common.sh@1114 -- # denied 00:03:45.245 18:50:01 -- setup/acl.sh@38 -- # PCI_BLOCKED=' 0000:5e:00.0' 00:03:45.245 18:50:01 -- setup/acl.sh@38 -- # setup output config 00:03:45.245 18:50:01 -- setup/acl.sh@39 -- # grep 'Skipping denied controller at 0000:5e:00.0' 00:03:45.245 18:50:01 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:45.245 18:50:01 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:48.532 0000:5e:00.0 (8086 0a54): Skipping denied controller at 0000:5e:00.0 00:03:48.532 18:50:04 -- setup/acl.sh@40 -- # verify 0000:5e:00.0 00:03:48.532 18:50:04 -- setup/acl.sh@28 -- # local dev driver 00:03:48.532 18:50:04 -- setup/acl.sh@30 -- # for dev in "$@" 00:03:48.532 18:50:04 -- setup/acl.sh@31 -- # [[ -e /sys/bus/pci/devices/0000:5e:00.0 ]] 00:03:48.532 18:50:04 -- setup/acl.sh@32 -- # readlink -f /sys/bus/pci/devices/0000:5e:00.0/driver 00:03:48.532 18:50:04 -- setup/acl.sh@32 -- # driver=/sys/bus/pci/drivers/nvme 00:03:48.532 18:50:04 -- setup/acl.sh@33 -- # [[ nvme == \n\v\m\e ]] 00:03:48.532 18:50:04 -- setup/acl.sh@41 -- # setup reset 00:03:48.532 18:50:04 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:48.532 18:50:04 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:52.721 00:03:52.721 real 0m7.045s 00:03:52.721 user 0m2.288s 00:03:52.721 sys 0m4.062s 00:03:52.721 18:50:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:52.721 18:50:08 -- common/autotest_common.sh@10 -- # set +x 00:03:52.721 ************************************ 00:03:52.721 END TEST denied 00:03:52.721 ************************************ 00:03:52.721 18:50:08 -- setup/acl.sh@55 -- # run_test allowed allowed 00:03:52.721 18:50:08 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:52.721 18:50:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:52.721 18:50:08 -- common/autotest_common.sh@10 -- # set +x 00:03:52.721 ************************************ 00:03:52.721 START TEST allowed 00:03:52.721 ************************************ 00:03:52.721 18:50:08 -- common/autotest_common.sh@1114 -- # allowed 00:03:52.721 18:50:08 -- setup/acl.sh@45 -- # PCI_ALLOWED=0000:5e:00.0 00:03:52.721 18:50:08 -- setup/acl.sh@45 -- # setup output config 00:03:52.721 18:50:08 -- setup/acl.sh@46 -- # grep -E '0000:5e:00.0 .*: nvme -> .*' 00:03:52.721 18:50:08 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:52.721 18:50:08 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:56.008 0000:5e:00.0 (8086 0a54): nvme -> vfio-pci 00:03:56.008 18:50:12 -- setup/acl.sh@47 -- # verify 00:03:56.008 18:50:12 -- setup/acl.sh@28 -- # local dev driver 00:03:56.008 18:50:12 -- setup/acl.sh@48 -- # setup reset 00:03:56.008 18:50:12 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:56.008 18:50:12 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:59.291 00:03:59.291 real 0m7.131s 00:03:59.291 user 0m2.309s 00:03:59.291 sys 0m4.049s 00:03:59.291 18:50:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:59.291 18:50:16 -- common/autotest_common.sh@10 -- # set +x 00:03:59.291 ************************************ 00:03:59.291 END TEST allowed 00:03:59.291 ************************************ 00:03:59.291 00:03:59.291 real 0m20.343s 00:03:59.291 user 0m6.967s 00:03:59.291 sys 0m12.142s 00:03:59.291 18:50:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:59.291 18:50:16 -- common/autotest_common.sh@10 -- # set +x 00:03:59.291 ************************************ 00:03:59.291 END TEST acl 00:03:59.291 ************************************ 00:03:59.291 18:50:16 -- setup/test-setup.sh@13 -- # run_test hugepages /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:03:59.291 18:50:16 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:59.291 18:50:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:59.291 18:50:16 -- common/autotest_common.sh@10 -- # set +x 00:03:59.291 ************************************ 00:03:59.291 START TEST hugepages 00:03:59.291 ************************************ 00:03:59.291 18:50:16 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:03:59.291 * Looking for test storage... 00:03:59.291 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:59.291 18:50:16 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:59.291 18:50:16 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:59.291 18:50:16 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:59.550 18:50:16 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:59.550 18:50:16 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:59.550 18:50:16 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:59.550 18:50:16 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:59.550 18:50:16 -- scripts/common.sh@335 -- # IFS=.-: 00:03:59.550 18:50:16 -- scripts/common.sh@335 -- # read -ra ver1 00:03:59.550 18:50:16 -- scripts/common.sh@336 -- # IFS=.-: 00:03:59.550 18:50:16 -- scripts/common.sh@336 -- # read -ra ver2 00:03:59.550 18:50:16 -- scripts/common.sh@337 -- # local 'op=<' 00:03:59.550 18:50:16 -- scripts/common.sh@339 -- # ver1_l=2 00:03:59.550 18:50:16 -- scripts/common.sh@340 -- # ver2_l=1 00:03:59.550 18:50:16 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:59.550 18:50:16 -- scripts/common.sh@343 -- # case "$op" in 00:03:59.550 18:50:16 -- scripts/common.sh@344 -- # : 1 00:03:59.550 18:50:16 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:59.550 18:50:16 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:59.550 18:50:16 -- scripts/common.sh@364 -- # decimal 1 00:03:59.550 18:50:16 -- scripts/common.sh@352 -- # local d=1 00:03:59.550 18:50:16 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:59.550 18:50:16 -- scripts/common.sh@354 -- # echo 1 00:03:59.550 18:50:16 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:59.550 18:50:16 -- scripts/common.sh@365 -- # decimal 2 00:03:59.550 18:50:16 -- scripts/common.sh@352 -- # local d=2 00:03:59.550 18:50:16 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:59.550 18:50:16 -- scripts/common.sh@354 -- # echo 2 00:03:59.550 18:50:16 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:59.550 18:50:16 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:59.550 18:50:16 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:59.550 18:50:16 -- scripts/common.sh@367 -- # return 0 00:03:59.550 18:50:16 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:59.550 18:50:16 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:59.550 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:59.550 --rc genhtml_branch_coverage=1 00:03:59.550 --rc genhtml_function_coverage=1 00:03:59.550 --rc genhtml_legend=1 00:03:59.550 --rc geninfo_all_blocks=1 00:03:59.550 --rc geninfo_unexecuted_blocks=1 00:03:59.550 00:03:59.550 ' 00:03:59.550 18:50:16 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:59.550 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:59.550 --rc genhtml_branch_coverage=1 00:03:59.550 --rc genhtml_function_coverage=1 00:03:59.550 --rc genhtml_legend=1 00:03:59.550 --rc geninfo_all_blocks=1 00:03:59.550 --rc geninfo_unexecuted_blocks=1 00:03:59.550 00:03:59.550 ' 00:03:59.550 18:50:16 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:59.550 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:59.550 --rc genhtml_branch_coverage=1 00:03:59.550 --rc genhtml_function_coverage=1 00:03:59.550 --rc genhtml_legend=1 00:03:59.550 --rc geninfo_all_blocks=1 00:03:59.550 --rc geninfo_unexecuted_blocks=1 00:03:59.550 00:03:59.550 ' 00:03:59.550 18:50:16 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:59.550 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:59.550 --rc genhtml_branch_coverage=1 00:03:59.550 --rc genhtml_function_coverage=1 00:03:59.550 --rc genhtml_legend=1 00:03:59.550 --rc geninfo_all_blocks=1 00:03:59.550 --rc geninfo_unexecuted_blocks=1 00:03:59.550 00:03:59.550 ' 00:03:59.550 18:50:16 -- setup/hugepages.sh@10 -- # nodes_sys=() 00:03:59.550 18:50:16 -- setup/hugepages.sh@10 -- # declare -a nodes_sys 00:03:59.550 18:50:16 -- setup/hugepages.sh@12 -- # declare -i default_hugepages=0 00:03:59.550 18:50:16 -- setup/hugepages.sh@13 -- # declare -i no_nodes=0 00:03:59.550 18:50:16 -- setup/hugepages.sh@14 -- # declare -i nr_hugepages=0 00:03:59.550 18:50:16 -- setup/hugepages.sh@16 -- # get_meminfo Hugepagesize 00:03:59.550 18:50:16 -- setup/common.sh@17 -- # local get=Hugepagesize 00:03:59.550 18:50:16 -- setup/common.sh@18 -- # local node= 00:03:59.550 18:50:16 -- setup/common.sh@19 -- # local var val 00:03:59.550 18:50:16 -- setup/common.sh@20 -- # local mem_f mem 00:03:59.550 18:50:16 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:59.550 18:50:16 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:59.550 18:50:16 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:59.550 18:50:16 -- setup/common.sh@28 -- # mapfile -t mem 00:03:59.550 18:50:16 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:59.550 18:50:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.550 18:50:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.550 18:50:16 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191371056 kB' 'MemFree: 169530968 kB' 'MemAvailable: 173857172 kB' 'Buffers: 3900 kB' 'Cached: 13013792 kB' 'SwapCached: 0 kB' 'Active: 9546668 kB' 'Inactive: 4095672 kB' 'Active(anon): 8450372 kB' 'Inactive(anon): 0 kB' 'Active(file): 1096296 kB' 'Inactive(file): 4095672 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 627544 kB' 'Mapped: 233056 kB' 'Shmem: 7825724 kB' 'KReclaimable: 556792 kB' 'Slab: 1518824 kB' 'SReclaimable: 556792 kB' 'SUnreclaim: 962032 kB' 'KernelStack: 20720 kB' 'PageTables: 9592 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 101976980 kB' 'Committed_AS: 9844448 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 318388 kB' 'VmallocChunk: 0 kB' 'Percpu: 103296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 2048' 'HugePages_Free: 2048' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 4194304 kB' 'DirectMap4k: 3668948 kB' 'DirectMap2M: 40050688 kB' 'DirectMap1G: 159383552 kB' 00:03:59.550 18:50:16 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:59.550 18:50:16 -- setup/common.sh@32 -- # continue 00:03:59.550 18:50:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.550 18:50:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.550 18:50:16 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:59.550 18:50:16 -- setup/common.sh@32 -- # continue 00:03:59.550 18:50:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.550 18:50:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.550 18:50:16 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:59.550 18:50:16 -- setup/common.sh@32 -- # continue 00:03:59.550 18:50:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.550 18:50:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.550 18:50:16 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:59.550 18:50:16 -- setup/common.sh@32 -- # continue 00:03:59.550 18:50:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.550 18:50:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.550 18:50:16 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:59.550 18:50:16 -- setup/common.sh@32 -- # continue 00:03:59.550 18:50:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.550 18:50:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.550 18:50:16 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:59.550 18:50:16 -- setup/common.sh@32 -- # continue 00:03:59.550 18:50:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.550 18:50:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.550 18:50:16 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:59.550 18:50:16 -- setup/common.sh@32 -- # continue 00:03:59.550 18:50:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.550 18:50:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.550 18:50:16 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:59.550 18:50:16 -- setup/common.sh@32 -- # continue 00:03:59.550 18:50:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.550 18:50:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.550 18:50:16 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # continue 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # continue 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # continue 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # continue 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # continue 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # continue 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # continue 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # continue 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # continue 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # continue 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # continue 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # continue 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # continue 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # continue 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # continue 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # continue 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # continue 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # continue 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # continue 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # continue 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # continue 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # continue 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # continue 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # continue 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # continue 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # continue 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # continue 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # continue 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # continue 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # continue 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # continue 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # continue 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # continue 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # continue 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # continue 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # continue 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # continue 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # continue 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # continue 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # continue 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # continue 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.551 18:50:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:59.551 18:50:16 -- setup/common.sh@32 -- # continue 00:03:59.552 18:50:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.552 18:50:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.552 18:50:16 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:59.552 18:50:16 -- setup/common.sh@32 -- # continue 00:03:59.552 18:50:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.552 18:50:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.552 18:50:16 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:59.552 18:50:16 -- setup/common.sh@32 -- # continue 00:03:59.552 18:50:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.552 18:50:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.552 18:50:16 -- setup/common.sh@32 -- # [[ Hugepagesize == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:59.552 18:50:16 -- setup/common.sh@33 -- # echo 2048 00:03:59.552 18:50:16 -- setup/common.sh@33 -- # return 0 00:03:59.552 18:50:16 -- setup/hugepages.sh@16 -- # default_hugepages=2048 00:03:59.552 18:50:16 -- setup/hugepages.sh@17 -- # default_huge_nr=/sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages 00:03:59.552 18:50:16 -- setup/hugepages.sh@18 -- # global_huge_nr=/proc/sys/vm/nr_hugepages 00:03:59.552 18:50:16 -- setup/hugepages.sh@21 -- # unset -v HUGE_EVEN_ALLOC 00:03:59.552 18:50:16 -- setup/hugepages.sh@22 -- # unset -v HUGEMEM 00:03:59.552 18:50:16 -- setup/hugepages.sh@23 -- # unset -v HUGENODE 00:03:59.552 18:50:16 -- setup/hugepages.sh@24 -- # unset -v NRHUGE 00:03:59.552 18:50:16 -- setup/hugepages.sh@207 -- # get_nodes 00:03:59.552 18:50:16 -- setup/hugepages.sh@27 -- # local node 00:03:59.552 18:50:16 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:59.552 18:50:16 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=2048 00:03:59.552 18:50:16 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:59.552 18:50:16 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:59.552 18:50:16 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:59.552 18:50:16 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:59.552 18:50:16 -- setup/hugepages.sh@208 -- # clear_hp 00:03:59.552 18:50:16 -- setup/hugepages.sh@37 -- # local node hp 00:03:59.552 18:50:16 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:59.552 18:50:16 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:59.552 18:50:16 -- setup/hugepages.sh@41 -- # echo 0 00:03:59.552 18:50:16 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:59.552 18:50:16 -- setup/hugepages.sh@41 -- # echo 0 00:03:59.552 18:50:16 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:59.552 18:50:16 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:59.552 18:50:16 -- setup/hugepages.sh@41 -- # echo 0 00:03:59.552 18:50:16 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:59.552 18:50:16 -- setup/hugepages.sh@41 -- # echo 0 00:03:59.552 18:50:16 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:03:59.552 18:50:16 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:03:59.552 18:50:16 -- setup/hugepages.sh@210 -- # run_test default_setup default_setup 00:03:59.552 18:50:16 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:59.552 18:50:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:59.552 18:50:16 -- common/autotest_common.sh@10 -- # set +x 00:03:59.552 ************************************ 00:03:59.552 START TEST default_setup 00:03:59.552 ************************************ 00:03:59.552 18:50:16 -- common/autotest_common.sh@1114 -- # default_setup 00:03:59.552 18:50:16 -- setup/hugepages.sh@136 -- # get_test_nr_hugepages 2097152 0 00:03:59.552 18:50:16 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:59.552 18:50:16 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:03:59.552 18:50:16 -- setup/hugepages.sh@51 -- # shift 00:03:59.552 18:50:16 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:03:59.552 18:50:16 -- setup/hugepages.sh@52 -- # local node_ids 00:03:59.552 18:50:16 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:59.552 18:50:16 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:59.552 18:50:16 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:03:59.552 18:50:16 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:03:59.552 18:50:16 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:59.552 18:50:16 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:59.552 18:50:16 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:59.552 18:50:16 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:59.552 18:50:16 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:59.552 18:50:16 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:03:59.552 18:50:16 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:59.552 18:50:16 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:03:59.552 18:50:16 -- setup/hugepages.sh@73 -- # return 0 00:03:59.552 18:50:16 -- setup/hugepages.sh@137 -- # setup output 00:03:59.552 18:50:16 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:59.552 18:50:16 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:02.830 0000:00:04.7 (8086 2021): ioatdma -> vfio-pci 00:04:02.830 0000:00:04.6 (8086 2021): ioatdma -> vfio-pci 00:04:02.830 0000:00:04.5 (8086 2021): ioatdma -> vfio-pci 00:04:02.830 0000:00:04.4 (8086 2021): ioatdma -> vfio-pci 00:04:02.830 0000:00:04.3 (8086 2021): ioatdma -> vfio-pci 00:04:02.830 0000:00:04.2 (8086 2021): ioatdma -> vfio-pci 00:04:02.830 0000:00:04.1 (8086 2021): ioatdma -> vfio-pci 00:04:02.830 0000:00:04.0 (8086 2021): ioatdma -> vfio-pci 00:04:02.830 0000:80:04.7 (8086 2021): ioatdma -> vfio-pci 00:04:02.830 0000:80:04.6 (8086 2021): ioatdma -> vfio-pci 00:04:02.830 0000:80:04.5 (8086 2021): ioatdma -> vfio-pci 00:04:02.830 0000:80:04.4 (8086 2021): ioatdma -> vfio-pci 00:04:02.830 0000:80:04.3 (8086 2021): ioatdma -> vfio-pci 00:04:02.830 0000:80:04.2 (8086 2021): ioatdma -> vfio-pci 00:04:02.830 0000:80:04.1 (8086 2021): ioatdma -> vfio-pci 00:04:02.830 0000:80:04.0 (8086 2021): ioatdma -> vfio-pci 00:04:03.398 0000:5e:00.0 (8086 0a54): nvme -> vfio-pci 00:04:03.398 18:50:20 -- setup/hugepages.sh@138 -- # verify_nr_hugepages 00:04:03.398 18:50:20 -- setup/hugepages.sh@89 -- # local node 00:04:03.398 18:50:20 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:03.398 18:50:20 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:03.398 18:50:20 -- setup/hugepages.sh@92 -- # local surp 00:04:03.398 18:50:20 -- setup/hugepages.sh@93 -- # local resv 00:04:03.398 18:50:20 -- setup/hugepages.sh@94 -- # local anon 00:04:03.398 18:50:20 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:03.398 18:50:20 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:03.398 18:50:20 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:03.398 18:50:20 -- setup/common.sh@18 -- # local node= 00:04:03.398 18:50:20 -- setup/common.sh@19 -- # local var val 00:04:03.398 18:50:20 -- setup/common.sh@20 -- # local mem_f mem 00:04:03.398 18:50:20 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:03.398 18:50:20 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:03.398 18:50:20 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:03.398 18:50:20 -- setup/common.sh@28 -- # mapfile -t mem 00:04:03.398 18:50:20 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:03.398 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.398 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.398 18:50:20 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191371056 kB' 'MemFree: 171724596 kB' 'MemAvailable: 176050796 kB' 'Buffers: 3900 kB' 'Cached: 13013912 kB' 'SwapCached: 0 kB' 'Active: 9552244 kB' 'Inactive: 4095672 kB' 'Active(anon): 8455948 kB' 'Inactive(anon): 0 kB' 'Active(file): 1096296 kB' 'Inactive(file): 4095672 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 633900 kB' 'Mapped: 232736 kB' 'Shmem: 7825844 kB' 'KReclaimable: 556784 kB' 'Slab: 1518200 kB' 'SReclaimable: 556784 kB' 'SUnreclaim: 961416 kB' 'KernelStack: 20880 kB' 'PageTables: 10352 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103025556 kB' 'Committed_AS: 9851916 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 318420 kB' 'VmallocChunk: 0 kB' 'Percpu: 103296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 3668948 kB' 'DirectMap2M: 40050688 kB' 'DirectMap1G: 159383552 kB' 00:04:03.398 18:50:20 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.398 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.398 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.398 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.398 18:50:20 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.398 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.398 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.398 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.398 18:50:20 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.398 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.399 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.399 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.400 18:50:20 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.400 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.400 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.400 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.400 18:50:20 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.400 18:50:20 -- setup/common.sh@33 -- # echo 0 00:04:03.400 18:50:20 -- setup/common.sh@33 -- # return 0 00:04:03.400 18:50:20 -- setup/hugepages.sh@97 -- # anon=0 00:04:03.400 18:50:20 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:03.400 18:50:20 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:03.400 18:50:20 -- setup/common.sh@18 -- # local node= 00:04:03.400 18:50:20 -- setup/common.sh@19 -- # local var val 00:04:03.400 18:50:20 -- setup/common.sh@20 -- # local mem_f mem 00:04:03.400 18:50:20 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:03.400 18:50:20 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:03.400 18:50:20 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:03.400 18:50:20 -- setup/common.sh@28 -- # mapfile -t mem 00:04:03.400 18:50:20 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:03.400 18:50:20 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191371056 kB' 'MemFree: 171725256 kB' 'MemAvailable: 176051456 kB' 'Buffers: 3900 kB' 'Cached: 13013916 kB' 'SwapCached: 0 kB' 'Active: 9552016 kB' 'Inactive: 4095672 kB' 'Active(anon): 8455720 kB' 'Inactive(anon): 0 kB' 'Active(file): 1096296 kB' 'Inactive(file): 4095672 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 633576 kB' 'Mapped: 232736 kB' 'Shmem: 7825848 kB' 'KReclaimable: 556784 kB' 'Slab: 1518240 kB' 'SReclaimable: 556784 kB' 'SUnreclaim: 961456 kB' 'KernelStack: 20976 kB' 'PageTables: 10124 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103025556 kB' 'Committed_AS: 9851928 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 318500 kB' 'VmallocChunk: 0 kB' 'Percpu: 103296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 3668948 kB' 'DirectMap2M: 40050688 kB' 'DirectMap1G: 159383552 kB' 00:04:03.400 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.400 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.400 18:50:20 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.400 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.400 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.400 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.400 18:50:20 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.400 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.400 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.400 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.400 18:50:20 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.400 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.400 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.400 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.400 18:50:20 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.400 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.400 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.400 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.400 18:50:20 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.400 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.400 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.400 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.400 18:50:20 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.400 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.400 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.400 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.400 18:50:20 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.400 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.400 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.400 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.400 18:50:20 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.400 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.400 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.400 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.400 18:50:20 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.400 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.400 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.400 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.400 18:50:20 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.400 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.400 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.400 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.400 18:50:20 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.400 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.400 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.400 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.400 18:50:20 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.400 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.400 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.400 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.400 18:50:20 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.400 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.400 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.400 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.400 18:50:20 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.400 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.400 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.400 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.400 18:50:20 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.400 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.400 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.400 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.400 18:50:20 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.400 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.400 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.400 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.400 18:50:20 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.400 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.400 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.400 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.400 18:50:20 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.400 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.400 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.400 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.400 18:50:20 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.400 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.400 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.400 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.400 18:50:20 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.400 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.400 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.400 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.400 18:50:20 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.400 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.400 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.400 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.400 18:50:20 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.400 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.400 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.400 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.400 18:50:20 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.400 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.400 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.400 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.400 18:50:20 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.400 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.400 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.400 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.400 18:50:20 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.400 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.400 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.400 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.400 18:50:20 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.400 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.400 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.400 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.400 18:50:20 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.400 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.400 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.400 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.400 18:50:20 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.400 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.400 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.401 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.401 18:50:20 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.401 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.401 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.401 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.401 18:50:20 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.401 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.401 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.401 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.401 18:50:20 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.401 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.401 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.401 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.401 18:50:20 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.401 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.401 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.401 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.401 18:50:20 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.401 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.401 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.401 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.401 18:50:20 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.401 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.401 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.401 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.401 18:50:20 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.401 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.401 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.401 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.401 18:50:20 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.401 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.401 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.401 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.401 18:50:20 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.401 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.401 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.401 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.401 18:50:20 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.401 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.401 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.401 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.401 18:50:20 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.401 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.401 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.401 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.401 18:50:20 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.401 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.401 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.401 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.401 18:50:20 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.401 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.401 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.401 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.401 18:50:20 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.401 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.401 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.401 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.401 18:50:20 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.401 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.401 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.401 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.401 18:50:20 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.401 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.401 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.401 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.401 18:50:20 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.401 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.401 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.401 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.401 18:50:20 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.401 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.401 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.401 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.401 18:50:20 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.401 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.401 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.401 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.401 18:50:20 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.401 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.401 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.401 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.401 18:50:20 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.401 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.401 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.401 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.401 18:50:20 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.401 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.401 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.401 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.401 18:50:20 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.401 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.401 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.401 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.401 18:50:20 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.401 18:50:20 -- setup/common.sh@33 -- # echo 0 00:04:03.401 18:50:20 -- setup/common.sh@33 -- # return 0 00:04:03.401 18:50:20 -- setup/hugepages.sh@99 -- # surp=0 00:04:03.401 18:50:20 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:03.401 18:50:20 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:03.401 18:50:20 -- setup/common.sh@18 -- # local node= 00:04:03.401 18:50:20 -- setup/common.sh@19 -- # local var val 00:04:03.401 18:50:20 -- setup/common.sh@20 -- # local mem_f mem 00:04:03.401 18:50:20 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:03.401 18:50:20 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:03.401 18:50:20 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:03.401 18:50:20 -- setup/common.sh@28 -- # mapfile -t mem 00:04:03.401 18:50:20 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:03.401 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.401 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.401 18:50:20 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191371056 kB' 'MemFree: 171725712 kB' 'MemAvailable: 176051912 kB' 'Buffers: 3900 kB' 'Cached: 13013928 kB' 'SwapCached: 0 kB' 'Active: 9551592 kB' 'Inactive: 4095672 kB' 'Active(anon): 8455296 kB' 'Inactive(anon): 0 kB' 'Active(file): 1096296 kB' 'Inactive(file): 4095672 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 633024 kB' 'Mapped: 232736 kB' 'Shmem: 7825860 kB' 'KReclaimable: 556784 kB' 'Slab: 1518240 kB' 'SReclaimable: 556784 kB' 'SUnreclaim: 961456 kB' 'KernelStack: 21040 kB' 'PageTables: 10168 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103025556 kB' 'Committed_AS: 9851708 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 318500 kB' 'VmallocChunk: 0 kB' 'Percpu: 103296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 3668948 kB' 'DirectMap2M: 40050688 kB' 'DirectMap1G: 159383552 kB' 00:04:03.401 18:50:20 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.401 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.401 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.401 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.401 18:50:20 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.401 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.401 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.401 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.401 18:50:20 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.401 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.401 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.401 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.401 18:50:20 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.401 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.401 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.401 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.401 18:50:20 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.401 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.401 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.401 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.401 18:50:20 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.401 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.401 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.401 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.401 18:50:20 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.402 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.402 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.403 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.403 18:50:20 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.403 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.403 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.403 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.403 18:50:20 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.403 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.403 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.403 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.403 18:50:20 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.403 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.403 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.403 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.403 18:50:20 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.403 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.403 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.403 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.403 18:50:20 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.403 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.403 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.403 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.403 18:50:20 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.403 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.403 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.403 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.403 18:50:20 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.403 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.403 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.403 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.403 18:50:20 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.403 18:50:20 -- setup/common.sh@33 -- # echo 0 00:04:03.403 18:50:20 -- setup/common.sh@33 -- # return 0 00:04:03.403 18:50:20 -- setup/hugepages.sh@100 -- # resv=0 00:04:03.403 18:50:20 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:03.403 nr_hugepages=1024 00:04:03.403 18:50:20 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:03.403 resv_hugepages=0 00:04:03.403 18:50:20 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:03.403 surplus_hugepages=0 00:04:03.403 18:50:20 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:03.403 anon_hugepages=0 00:04:03.403 18:50:20 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:03.403 18:50:20 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:03.403 18:50:20 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:03.403 18:50:20 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:03.403 18:50:20 -- setup/common.sh@18 -- # local node= 00:04:03.403 18:50:20 -- setup/common.sh@19 -- # local var val 00:04:03.403 18:50:20 -- setup/common.sh@20 -- # local mem_f mem 00:04:03.403 18:50:20 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:03.403 18:50:20 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:03.403 18:50:20 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:03.403 18:50:20 -- setup/common.sh@28 -- # mapfile -t mem 00:04:03.403 18:50:20 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:03.403 18:50:20 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191371056 kB' 'MemFree: 171724892 kB' 'MemAvailable: 176051092 kB' 'Buffers: 3900 kB' 'Cached: 13013928 kB' 'SwapCached: 0 kB' 'Active: 9552068 kB' 'Inactive: 4095672 kB' 'Active(anon): 8455772 kB' 'Inactive(anon): 0 kB' 'Active(file): 1096296 kB' 'Inactive(file): 4095672 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 633500 kB' 'Mapped: 232736 kB' 'Shmem: 7825860 kB' 'KReclaimable: 556784 kB' 'Slab: 1518240 kB' 'SReclaimable: 556784 kB' 'SUnreclaim: 961456 kB' 'KernelStack: 20992 kB' 'PageTables: 10144 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103025556 kB' 'Committed_AS: 9850836 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 318484 kB' 'VmallocChunk: 0 kB' 'Percpu: 103296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 3668948 kB' 'DirectMap2M: 40050688 kB' 'DirectMap1G: 159383552 kB' 00:04:03.403 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.403 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.403 18:50:20 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.403 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.403 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.403 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.403 18:50:20 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.403 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.403 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.403 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.403 18:50:20 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.403 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.403 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.403 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.403 18:50:20 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.403 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.403 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.403 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.403 18:50:20 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.403 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.403 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.403 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.403 18:50:20 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.403 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.403 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.403 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.403 18:50:20 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.403 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.403 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.403 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.403 18:50:20 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.403 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.403 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.403 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.403 18:50:20 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.403 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.403 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.403 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.403 18:50:20 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.403 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.403 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.403 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.403 18:50:20 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.403 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.403 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.403 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.404 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.404 18:50:20 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.404 18:50:20 -- setup/common.sh@33 -- # echo 1024 00:04:03.405 18:50:20 -- setup/common.sh@33 -- # return 0 00:04:03.405 18:50:20 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:03.405 18:50:20 -- setup/hugepages.sh@112 -- # get_nodes 00:04:03.405 18:50:20 -- setup/hugepages.sh@27 -- # local node 00:04:03.405 18:50:20 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:03.405 18:50:20 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:03.405 18:50:20 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:03.405 18:50:20 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:03.405 18:50:20 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:03.405 18:50:20 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:03.405 18:50:20 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:03.405 18:50:20 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:03.405 18:50:20 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:03.405 18:50:20 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:03.405 18:50:20 -- setup/common.sh@18 -- # local node=0 00:04:03.405 18:50:20 -- setup/common.sh@19 -- # local var val 00:04:03.405 18:50:20 -- setup/common.sh@20 -- # local mem_f mem 00:04:03.405 18:50:20 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:03.405 18:50:20 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:03.405 18:50:20 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:03.405 18:50:20 -- setup/common.sh@28 -- # mapfile -t mem 00:04:03.405 18:50:20 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:03.405 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.405 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.405 18:50:20 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 97609576 kB' 'MemFree: 89437108 kB' 'MemUsed: 8172468 kB' 'SwapCached: 0 kB' 'Active: 3696388 kB' 'Inactive: 281892 kB' 'Active(anon): 2815712 kB' 'Inactive(anon): 0 kB' 'Active(file): 880676 kB' 'Inactive(file): 281892 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3548044 kB' 'Mapped: 133700 kB' 'AnonPages: 433600 kB' 'Shmem: 2385476 kB' 'KernelStack: 13224 kB' 'PageTables: 6396 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 361692 kB' 'Slab: 893540 kB' 'SReclaimable: 361692 kB' 'SUnreclaim: 531848 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:03.405 18:50:20 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.405 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.405 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.405 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.405 18:50:20 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.405 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.405 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.405 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.405 18:50:20 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.405 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.405 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.405 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.405 18:50:20 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.405 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.405 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.405 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.405 18:50:20 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.405 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.405 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.405 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.405 18:50:20 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.405 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.405 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.405 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.405 18:50:20 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.405 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.405 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.405 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.405 18:50:20 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.405 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.405 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.405 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.405 18:50:20 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.405 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.405 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.405 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.405 18:50:20 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.405 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.405 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.405 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.405 18:50:20 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.405 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.405 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.405 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.405 18:50:20 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.405 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.405 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.405 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.405 18:50:20 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.405 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.405 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.405 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.405 18:50:20 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.405 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.405 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.405 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.405 18:50:20 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.405 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.405 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.405 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.405 18:50:20 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.405 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.405 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.405 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.405 18:50:20 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.405 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.405 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.405 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.405 18:50:20 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.405 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.405 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.405 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.405 18:50:20 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.405 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.405 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.405 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.405 18:50:20 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.405 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.405 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.405 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.405 18:50:20 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.405 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.405 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.405 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.405 18:50:20 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.405 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.405 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.405 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.405 18:50:20 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.405 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.405 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.405 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.405 18:50:20 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.405 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.405 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.405 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.405 18:50:20 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.405 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.405 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.405 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.405 18:50:20 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.405 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.405 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.405 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.405 18:50:20 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.405 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.405 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.405 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.405 18:50:20 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.405 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.405 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.405 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.405 18:50:20 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.405 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.406 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.406 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.406 18:50:20 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.406 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.406 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.406 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.406 18:50:20 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.406 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.406 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.406 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.406 18:50:20 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.406 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.406 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.406 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.406 18:50:20 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.406 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.406 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.406 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.406 18:50:20 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.406 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.406 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.406 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.406 18:50:20 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.406 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.406 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.406 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.406 18:50:20 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.406 18:50:20 -- setup/common.sh@32 -- # continue 00:04:03.406 18:50:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.406 18:50:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.406 18:50:20 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.406 18:50:20 -- setup/common.sh@33 -- # echo 0 00:04:03.406 18:50:20 -- setup/common.sh@33 -- # return 0 00:04:03.406 18:50:20 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:03.406 18:50:20 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:03.406 18:50:20 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:03.406 18:50:20 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:03.406 18:50:20 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:04:03.406 node0=1024 expecting 1024 00:04:03.406 18:50:20 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:04:03.406 00:04:03.406 real 0m3.978s 00:04:03.406 user 0m1.282s 00:04:03.406 sys 0m1.967s 00:04:03.406 18:50:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:03.406 18:50:20 -- common/autotest_common.sh@10 -- # set +x 00:04:03.406 ************************************ 00:04:03.406 END TEST default_setup 00:04:03.406 ************************************ 00:04:03.664 18:50:20 -- setup/hugepages.sh@211 -- # run_test per_node_1G_alloc per_node_1G_alloc 00:04:03.664 18:50:20 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:03.664 18:50:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:03.664 18:50:20 -- common/autotest_common.sh@10 -- # set +x 00:04:03.664 ************************************ 00:04:03.664 START TEST per_node_1G_alloc 00:04:03.664 ************************************ 00:04:03.664 18:50:20 -- common/autotest_common.sh@1114 -- # per_node_1G_alloc 00:04:03.664 18:50:20 -- setup/hugepages.sh@143 -- # local IFS=, 00:04:03.664 18:50:20 -- setup/hugepages.sh@145 -- # get_test_nr_hugepages 1048576 0 1 00:04:03.664 18:50:20 -- setup/hugepages.sh@49 -- # local size=1048576 00:04:03.664 18:50:20 -- setup/hugepages.sh@50 -- # (( 3 > 1 )) 00:04:03.664 18:50:20 -- setup/hugepages.sh@51 -- # shift 00:04:03.664 18:50:20 -- setup/hugepages.sh@52 -- # node_ids=('0' '1') 00:04:03.664 18:50:20 -- setup/hugepages.sh@52 -- # local node_ids 00:04:03.664 18:50:20 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:03.664 18:50:20 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:04:03.664 18:50:20 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 1 00:04:03.664 18:50:20 -- setup/hugepages.sh@62 -- # user_nodes=('0' '1') 00:04:03.664 18:50:20 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:03.664 18:50:20 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:04:03.664 18:50:20 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:03.664 18:50:20 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:03.664 18:50:20 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:03.664 18:50:20 -- setup/hugepages.sh@69 -- # (( 2 > 0 )) 00:04:03.664 18:50:20 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:03.664 18:50:20 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:04:03.664 18:50:20 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:03.664 18:50:20 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:04:03.664 18:50:20 -- setup/hugepages.sh@73 -- # return 0 00:04:03.664 18:50:20 -- setup/hugepages.sh@146 -- # NRHUGE=512 00:04:03.664 18:50:20 -- setup/hugepages.sh@146 -- # HUGENODE=0,1 00:04:03.664 18:50:20 -- setup/hugepages.sh@146 -- # setup output 00:04:03.664 18:50:20 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:03.664 18:50:20 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:06.189 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:04:06.189 0000:5e:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:06.189 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:04:06.189 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:04:06.189 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:04:06.189 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:04:06.189 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:04:06.189 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:04:06.189 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:04:06.189 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:04:06.189 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:04:06.189 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:04:06.189 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:04:06.189 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:04:06.189 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:04:06.189 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:04:06.189 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:04:06.189 18:50:23 -- setup/hugepages.sh@147 -- # nr_hugepages=1024 00:04:06.190 18:50:23 -- setup/hugepages.sh@147 -- # verify_nr_hugepages 00:04:06.190 18:50:23 -- setup/hugepages.sh@89 -- # local node 00:04:06.190 18:50:23 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:06.190 18:50:23 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:06.190 18:50:23 -- setup/hugepages.sh@92 -- # local surp 00:04:06.190 18:50:23 -- setup/hugepages.sh@93 -- # local resv 00:04:06.190 18:50:23 -- setup/hugepages.sh@94 -- # local anon 00:04:06.190 18:50:23 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:06.190 18:50:23 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:06.190 18:50:23 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:06.190 18:50:23 -- setup/common.sh@18 -- # local node= 00:04:06.190 18:50:23 -- setup/common.sh@19 -- # local var val 00:04:06.190 18:50:23 -- setup/common.sh@20 -- # local mem_f mem 00:04:06.190 18:50:23 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:06.190 18:50:23 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:06.190 18:50:23 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:06.190 18:50:23 -- setup/common.sh@28 -- # mapfile -t mem 00:04:06.190 18:50:23 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:06.190 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.190 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.190 18:50:23 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191371056 kB' 'MemFree: 171759872 kB' 'MemAvailable: 176086060 kB' 'Buffers: 3900 kB' 'Cached: 13014012 kB' 'SwapCached: 0 kB' 'Active: 9552120 kB' 'Inactive: 4095672 kB' 'Active(anon): 8455824 kB' 'Inactive(anon): 0 kB' 'Active(file): 1096296 kB' 'Inactive(file): 4095672 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 633044 kB' 'Mapped: 232672 kB' 'Shmem: 7825944 kB' 'KReclaimable: 556760 kB' 'Slab: 1518452 kB' 'SReclaimable: 556760 kB' 'SUnreclaim: 961692 kB' 'KernelStack: 21200 kB' 'PageTables: 10600 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103025556 kB' 'Committed_AS: 9852292 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 318612 kB' 'VmallocChunk: 0 kB' 'Percpu: 103296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 3668948 kB' 'DirectMap2M: 40050688 kB' 'DirectMap1G: 159383552 kB' 00:04:06.190 18:50:23 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.190 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.190 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.190 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.190 18:50:23 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.190 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.190 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.190 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.190 18:50:23 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.190 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.190 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.190 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.190 18:50:23 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.190 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.190 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.190 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.190 18:50:23 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.190 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.190 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.190 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.190 18:50:23 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.190 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.190 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.190 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.190 18:50:23 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.190 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.190 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.190 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.190 18:50:23 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.190 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.190 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.190 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.190 18:50:23 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.190 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.190 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.190 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.190 18:50:23 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.190 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.190 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.190 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.190 18:50:23 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.190 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.190 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.190 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.190 18:50:23 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.190 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.190 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.190 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.190 18:50:23 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.190 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.190 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.190 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.190 18:50:23 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.190 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.190 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.190 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.190 18:50:23 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.190 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.190 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.190 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.190 18:50:23 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.190 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.190 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.190 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.190 18:50:23 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.190 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.190 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.190 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.190 18:50:23 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.190 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.190 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.190 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.190 18:50:23 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.190 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.190 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.190 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.190 18:50:23 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.190 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.190 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.190 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.190 18:50:23 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.190 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.190 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.190 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.190 18:50:23 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.190 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.190 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.190 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.190 18:50:23 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.190 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.190 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.190 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.190 18:50:23 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.190 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.190 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.190 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.190 18:50:23 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.190 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.190 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.190 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.190 18:50:23 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.190 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.190 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.190 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.190 18:50:23 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.190 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.190 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.191 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.191 18:50:23 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.191 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.191 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.191 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.191 18:50:23 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.191 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.191 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.191 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.191 18:50:23 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.191 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.191 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.191 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.191 18:50:23 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.191 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.191 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.191 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.191 18:50:23 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.191 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.191 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.191 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.191 18:50:23 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.191 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.191 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.191 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.449 18:50:23 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.449 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.449 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.449 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.449 18:50:23 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.449 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.449 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.449 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.449 18:50:23 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.449 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.449 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.449 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.449 18:50:23 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.449 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.449 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.449 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.449 18:50:23 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.449 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.449 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.449 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.449 18:50:23 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.449 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.449 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.449 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.449 18:50:23 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.449 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.449 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.449 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.449 18:50:23 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.449 18:50:23 -- setup/common.sh@33 -- # echo 0 00:04:06.449 18:50:23 -- setup/common.sh@33 -- # return 0 00:04:06.449 18:50:23 -- setup/hugepages.sh@97 -- # anon=0 00:04:06.449 18:50:23 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:06.449 18:50:23 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:06.449 18:50:23 -- setup/common.sh@18 -- # local node= 00:04:06.449 18:50:23 -- setup/common.sh@19 -- # local var val 00:04:06.449 18:50:23 -- setup/common.sh@20 -- # local mem_f mem 00:04:06.449 18:50:23 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:06.449 18:50:23 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:06.449 18:50:23 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:06.449 18:50:23 -- setup/common.sh@28 -- # mapfile -t mem 00:04:06.449 18:50:23 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:06.449 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.449 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.450 18:50:23 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191371056 kB' 'MemFree: 171760500 kB' 'MemAvailable: 176086688 kB' 'Buffers: 3900 kB' 'Cached: 13014012 kB' 'SwapCached: 0 kB' 'Active: 9550696 kB' 'Inactive: 4095672 kB' 'Active(anon): 8454400 kB' 'Inactive(anon): 0 kB' 'Active(file): 1096296 kB' 'Inactive(file): 4095672 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 631704 kB' 'Mapped: 232664 kB' 'Shmem: 7825944 kB' 'KReclaimable: 556760 kB' 'Slab: 1518244 kB' 'SReclaimable: 556760 kB' 'SUnreclaim: 961484 kB' 'KernelStack: 20880 kB' 'PageTables: 9724 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103025556 kB' 'Committed_AS: 9850800 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 318612 kB' 'VmallocChunk: 0 kB' 'Percpu: 103296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 3668948 kB' 'DirectMap2M: 40050688 kB' 'DirectMap1G: 159383552 kB' 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.450 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.450 18:50:23 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.450 18:50:23 -- setup/common.sh@33 -- # echo 0 00:04:06.450 18:50:23 -- setup/common.sh@33 -- # return 0 00:04:06.450 18:50:23 -- setup/hugepages.sh@99 -- # surp=0 00:04:06.450 18:50:23 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:06.451 18:50:23 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:06.451 18:50:23 -- setup/common.sh@18 -- # local node= 00:04:06.451 18:50:23 -- setup/common.sh@19 -- # local var val 00:04:06.451 18:50:23 -- setup/common.sh@20 -- # local mem_f mem 00:04:06.451 18:50:23 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:06.451 18:50:23 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:06.451 18:50:23 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:06.451 18:50:23 -- setup/common.sh@28 -- # mapfile -t mem 00:04:06.451 18:50:23 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:06.451 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.451 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.451 18:50:23 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191371056 kB' 'MemFree: 171758756 kB' 'MemAvailable: 176084944 kB' 'Buffers: 3900 kB' 'Cached: 13014024 kB' 'SwapCached: 0 kB' 'Active: 9550664 kB' 'Inactive: 4095672 kB' 'Active(anon): 8454368 kB' 'Inactive(anon): 0 kB' 'Active(file): 1096296 kB' 'Inactive(file): 4095672 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 631600 kB' 'Mapped: 232664 kB' 'Shmem: 7825956 kB' 'KReclaimable: 556760 kB' 'Slab: 1518388 kB' 'SReclaimable: 556760 kB' 'SUnreclaim: 961628 kB' 'KernelStack: 20832 kB' 'PageTables: 9828 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103025556 kB' 'Committed_AS: 9852320 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 318580 kB' 'VmallocChunk: 0 kB' 'Percpu: 103296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 3668948 kB' 'DirectMap2M: 40050688 kB' 'DirectMap1G: 159383552 kB' 00:04:06.451 18:50:23 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.451 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.451 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.451 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.451 18:50:23 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.451 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.451 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.451 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.451 18:50:23 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.451 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.451 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.451 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.451 18:50:23 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.451 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.451 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.451 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.451 18:50:23 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.451 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.451 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.451 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.451 18:50:23 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.451 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.451 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.451 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.451 18:50:23 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.451 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.451 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.451 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.451 18:50:23 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.451 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.451 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.451 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.451 18:50:23 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.451 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.451 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.451 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.451 18:50:23 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.451 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.451 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.451 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.451 18:50:23 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.451 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.451 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.451 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.451 18:50:23 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.451 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.451 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.451 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.451 18:50:23 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.451 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.451 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.451 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.451 18:50:23 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.451 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.451 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.451 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.451 18:50:23 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.451 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.451 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.451 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.451 18:50:23 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.451 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.451 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.451 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.451 18:50:23 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.451 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.451 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.451 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.451 18:50:23 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.451 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.451 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.451 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.451 18:50:23 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.451 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.451 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.451 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.451 18:50:23 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.451 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.451 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.451 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.451 18:50:23 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.451 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.451 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.451 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.451 18:50:23 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.451 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.451 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.451 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.451 18:50:23 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.451 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.451 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.451 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.451 18:50:23 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.451 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.451 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.451 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.451 18:50:23 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.451 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.451 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.451 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.451 18:50:23 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.451 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.451 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.451 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.451 18:50:23 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.451 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.451 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.451 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.451 18:50:23 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.451 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.451 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.451 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.451 18:50:23 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.451 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.451 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.451 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.451 18:50:23 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.451 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.451 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.451 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.451 18:50:23 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.451 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.451 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.451 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.451 18:50:23 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.451 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.451 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.451 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.451 18:50:23 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.452 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.452 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.452 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.452 18:50:23 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.452 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.452 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.452 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.452 18:50:23 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.452 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.452 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.452 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.452 18:50:23 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.452 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.452 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.452 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.452 18:50:23 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.452 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.452 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.452 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.452 18:50:23 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.452 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.452 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.452 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.452 18:50:23 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.452 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.452 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.452 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.452 18:50:23 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.452 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.452 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.452 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.452 18:50:23 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.452 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.452 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.452 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.452 18:50:23 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.452 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.452 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.452 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.452 18:50:23 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.452 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.452 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.452 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.452 18:50:23 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.452 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.452 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.452 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.452 18:50:23 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.452 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.452 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.452 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.452 18:50:23 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.452 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.452 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.452 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.452 18:50:23 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.452 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.452 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.452 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.452 18:50:23 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.452 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.452 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.452 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.452 18:50:23 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.452 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.452 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.452 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.452 18:50:23 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.452 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.452 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.452 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.452 18:50:23 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.452 18:50:23 -- setup/common.sh@33 -- # echo 0 00:04:06.452 18:50:23 -- setup/common.sh@33 -- # return 0 00:04:06.452 18:50:23 -- setup/hugepages.sh@100 -- # resv=0 00:04:06.452 18:50:23 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:06.452 nr_hugepages=1024 00:04:06.452 18:50:23 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:06.452 resv_hugepages=0 00:04:06.452 18:50:23 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:06.452 surplus_hugepages=0 00:04:06.452 18:50:23 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:06.452 anon_hugepages=0 00:04:06.452 18:50:23 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:06.452 18:50:23 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:06.452 18:50:23 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:06.452 18:50:23 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:06.452 18:50:23 -- setup/common.sh@18 -- # local node= 00:04:06.452 18:50:23 -- setup/common.sh@19 -- # local var val 00:04:06.452 18:50:23 -- setup/common.sh@20 -- # local mem_f mem 00:04:06.452 18:50:23 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:06.452 18:50:23 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:06.452 18:50:23 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:06.452 18:50:23 -- setup/common.sh@28 -- # mapfile -t mem 00:04:06.452 18:50:23 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:06.452 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.452 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.452 18:50:23 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191371056 kB' 'MemFree: 171752508 kB' 'MemAvailable: 176078696 kB' 'Buffers: 3900 kB' 'Cached: 13014040 kB' 'SwapCached: 0 kB' 'Active: 9554564 kB' 'Inactive: 4095672 kB' 'Active(anon): 8458268 kB' 'Inactive(anon): 0 kB' 'Active(file): 1096296 kB' 'Inactive(file): 4095672 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 636048 kB' 'Mapped: 233168 kB' 'Shmem: 7825972 kB' 'KReclaimable: 556760 kB' 'Slab: 1518356 kB' 'SReclaimable: 556760 kB' 'SUnreclaim: 961596 kB' 'KernelStack: 20752 kB' 'PageTables: 9356 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103025556 kB' 'Committed_AS: 9852984 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 318452 kB' 'VmallocChunk: 0 kB' 'Percpu: 103296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 3668948 kB' 'DirectMap2M: 40050688 kB' 'DirectMap1G: 159383552 kB' 00:04:06.452 18:50:23 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.452 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.452 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.452 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.452 18:50:23 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.452 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.452 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.452 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.452 18:50:23 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.452 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.452 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.452 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.452 18:50:23 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.452 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.452 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.452 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.452 18:50:23 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.452 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.452 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.452 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.452 18:50:23 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.452 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.452 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.452 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.452 18:50:23 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.452 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.452 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.452 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.452 18:50:23 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.452 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.452 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.452 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.452 18:50:23 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.452 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.452 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.452 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.452 18:50:23 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.452 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.452 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.452 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.452 18:50:23 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.452 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.452 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.452 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.452 18:50:23 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.452 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.452 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.452 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.452 18:50:23 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.452 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.452 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.452 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.452 18:50:23 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.452 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.452 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.452 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.452 18:50:23 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.452 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.453 18:50:23 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.453 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.453 18:50:23 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.453 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.453 18:50:23 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.453 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.453 18:50:23 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.453 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.453 18:50:23 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.453 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.453 18:50:23 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.453 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.453 18:50:23 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.453 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.453 18:50:23 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.453 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.453 18:50:23 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.453 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.453 18:50:23 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.453 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.453 18:50:23 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.453 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.453 18:50:23 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.453 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.453 18:50:23 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.453 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.453 18:50:23 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.453 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.453 18:50:23 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.453 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.453 18:50:23 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.453 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.453 18:50:23 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.453 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.453 18:50:23 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.453 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.453 18:50:23 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.453 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.453 18:50:23 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.453 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.453 18:50:23 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.453 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.453 18:50:23 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.453 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.453 18:50:23 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.453 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.453 18:50:23 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.453 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.453 18:50:23 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.453 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.453 18:50:23 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.453 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.453 18:50:23 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.453 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.453 18:50:23 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.453 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.453 18:50:23 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.453 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.453 18:50:23 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.453 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.453 18:50:23 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.453 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.453 18:50:23 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.453 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.453 18:50:23 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.453 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.453 18:50:23 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.453 18:50:23 -- setup/common.sh@33 -- # echo 1024 00:04:06.453 18:50:23 -- setup/common.sh@33 -- # return 0 00:04:06.453 18:50:23 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:06.453 18:50:23 -- setup/hugepages.sh@112 -- # get_nodes 00:04:06.453 18:50:23 -- setup/hugepages.sh@27 -- # local node 00:04:06.453 18:50:23 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:06.453 18:50:23 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:06.453 18:50:23 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:06.453 18:50:23 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:06.453 18:50:23 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:06.453 18:50:23 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:06.453 18:50:23 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:06.453 18:50:23 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:06.453 18:50:23 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:06.453 18:50:23 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:06.453 18:50:23 -- setup/common.sh@18 -- # local node=0 00:04:06.453 18:50:23 -- setup/common.sh@19 -- # local var val 00:04:06.453 18:50:23 -- setup/common.sh@20 -- # local mem_f mem 00:04:06.453 18:50:23 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:06.453 18:50:23 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:06.453 18:50:23 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:06.453 18:50:23 -- setup/common.sh@28 -- # mapfile -t mem 00:04:06.453 18:50:23 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.453 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.454 18:50:23 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 97609576 kB' 'MemFree: 90505896 kB' 'MemUsed: 7103680 kB' 'SwapCached: 0 kB' 'Active: 3696416 kB' 'Inactive: 281892 kB' 'Active(anon): 2815740 kB' 'Inactive(anon): 0 kB' 'Active(file): 880676 kB' 'Inactive(file): 281892 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3548140 kB' 'Mapped: 133704 kB' 'AnonPages: 433304 kB' 'Shmem: 2385572 kB' 'KernelStack: 13208 kB' 'PageTables: 6280 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 361668 kB' 'Slab: 893552 kB' 'SReclaimable: 361668 kB' 'SUnreclaim: 531884 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.454 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.454 18:50:23 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.454 18:50:23 -- setup/common.sh@33 -- # echo 0 00:04:06.454 18:50:23 -- setup/common.sh@33 -- # return 0 00:04:06.454 18:50:23 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:06.454 18:50:23 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:06.454 18:50:23 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:06.454 18:50:23 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:06.454 18:50:23 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:06.454 18:50:23 -- setup/common.sh@18 -- # local node=1 00:04:06.454 18:50:23 -- setup/common.sh@19 -- # local var val 00:04:06.454 18:50:23 -- setup/common.sh@20 -- # local mem_f mem 00:04:06.454 18:50:23 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:06.454 18:50:23 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:06.454 18:50:23 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:06.454 18:50:23 -- setup/common.sh@28 -- # mapfile -t mem 00:04:06.454 18:50:23 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:06.454 18:50:23 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93761480 kB' 'MemFree: 81255888 kB' 'MemUsed: 12505592 kB' 'SwapCached: 0 kB' 'Active: 5853772 kB' 'Inactive: 3813780 kB' 'Active(anon): 5638152 kB' 'Inactive(anon): 0 kB' 'Active(file): 215620 kB' 'Inactive(file): 3813780 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9469816 kB' 'Mapped: 98960 kB' 'AnonPages: 197788 kB' 'Shmem: 5440416 kB' 'KernelStack: 7544 kB' 'PageTables: 3360 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 195092 kB' 'Slab: 624780 kB' 'SReclaimable: 195092 kB' 'SUnreclaim: 429688 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # continue 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.455 18:50:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.455 18:50:23 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.455 18:50:23 -- setup/common.sh@33 -- # echo 0 00:04:06.455 18:50:23 -- setup/common.sh@33 -- # return 0 00:04:06.455 18:50:23 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:06.455 18:50:23 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:06.455 18:50:23 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:06.455 18:50:23 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:06.455 18:50:23 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:04:06.455 node0=512 expecting 512 00:04:06.455 18:50:23 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:06.455 18:50:23 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:06.455 18:50:23 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:06.455 18:50:23 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:04:06.455 node1=512 expecting 512 00:04:06.455 18:50:23 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:04:06.455 00:04:06.455 real 0m2.951s 00:04:06.455 user 0m1.184s 00:04:06.455 sys 0m1.820s 00:04:06.455 18:50:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:06.455 18:50:23 -- common/autotest_common.sh@10 -- # set +x 00:04:06.455 ************************************ 00:04:06.455 END TEST per_node_1G_alloc 00:04:06.455 ************************************ 00:04:06.455 18:50:23 -- setup/hugepages.sh@212 -- # run_test even_2G_alloc even_2G_alloc 00:04:06.455 18:50:23 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:06.455 18:50:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:06.455 18:50:23 -- common/autotest_common.sh@10 -- # set +x 00:04:06.455 ************************************ 00:04:06.455 START TEST even_2G_alloc 00:04:06.455 ************************************ 00:04:06.455 18:50:23 -- common/autotest_common.sh@1114 -- # even_2G_alloc 00:04:06.455 18:50:23 -- setup/hugepages.sh@152 -- # get_test_nr_hugepages 2097152 00:04:06.455 18:50:23 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:06.455 18:50:23 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:06.455 18:50:23 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:06.455 18:50:23 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:06.455 18:50:23 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:06.455 18:50:23 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:06.455 18:50:23 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:06.455 18:50:23 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:06.455 18:50:23 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:06.455 18:50:23 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:06.455 18:50:23 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:06.455 18:50:23 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:06.455 18:50:23 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:04:06.455 18:50:23 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:06.455 18:50:23 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:04:06.455 18:50:23 -- setup/hugepages.sh@83 -- # : 512 00:04:06.455 18:50:23 -- setup/hugepages.sh@84 -- # : 1 00:04:06.455 18:50:23 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:06.455 18:50:23 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:04:06.455 18:50:23 -- setup/hugepages.sh@83 -- # : 0 00:04:06.455 18:50:23 -- setup/hugepages.sh@84 -- # : 0 00:04:06.455 18:50:23 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:06.455 18:50:23 -- setup/hugepages.sh@153 -- # NRHUGE=1024 00:04:06.455 18:50:23 -- setup/hugepages.sh@153 -- # HUGE_EVEN_ALLOC=yes 00:04:06.455 18:50:23 -- setup/hugepages.sh@153 -- # setup output 00:04:06.455 18:50:23 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:06.455 18:50:23 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:08.975 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:04:08.975 0000:5e:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:08.975 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:04:08.975 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:04:08.975 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:04:08.975 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:04:08.975 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:04:08.975 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:04:08.975 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:04:08.975 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:04:08.975 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:04:08.975 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:04:08.975 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:04:08.975 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:04:08.975 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:04:08.975 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:04:08.975 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:04:09.238 18:50:25 -- setup/hugepages.sh@154 -- # verify_nr_hugepages 00:04:09.238 18:50:25 -- setup/hugepages.sh@89 -- # local node 00:04:09.238 18:50:25 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:09.238 18:50:25 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:09.238 18:50:25 -- setup/hugepages.sh@92 -- # local surp 00:04:09.238 18:50:25 -- setup/hugepages.sh@93 -- # local resv 00:04:09.238 18:50:25 -- setup/hugepages.sh@94 -- # local anon 00:04:09.238 18:50:25 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:09.238 18:50:25 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:09.238 18:50:25 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:09.238 18:50:25 -- setup/common.sh@18 -- # local node= 00:04:09.238 18:50:25 -- setup/common.sh@19 -- # local var val 00:04:09.238 18:50:25 -- setup/common.sh@20 -- # local mem_f mem 00:04:09.238 18:50:25 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:09.238 18:50:25 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:09.238 18:50:25 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:09.238 18:50:25 -- setup/common.sh@28 -- # mapfile -t mem 00:04:09.238 18:50:25 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:09.238 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.238 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.238 18:50:25 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191371056 kB' 'MemFree: 171764252 kB' 'MemAvailable: 176090440 kB' 'Buffers: 3900 kB' 'Cached: 13014136 kB' 'SwapCached: 0 kB' 'Active: 9550500 kB' 'Inactive: 4095672 kB' 'Active(anon): 8454204 kB' 'Inactive(anon): 0 kB' 'Active(file): 1096296 kB' 'Inactive(file): 4095672 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 630804 kB' 'Mapped: 231640 kB' 'Shmem: 7826068 kB' 'KReclaimable: 556760 kB' 'Slab: 1517932 kB' 'SReclaimable: 556760 kB' 'SUnreclaim: 961172 kB' 'KernelStack: 20832 kB' 'PageTables: 9360 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103025556 kB' 'Committed_AS: 9841048 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 318644 kB' 'VmallocChunk: 0 kB' 'Percpu: 103296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 3668948 kB' 'DirectMap2M: 40050688 kB' 'DirectMap1G: 159383552 kB' 00:04:09.238 18:50:25 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:09.238 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.238 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.238 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.238 18:50:25 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:09.238 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.238 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.238 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.238 18:50:25 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:09.238 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.238 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.238 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.238 18:50:25 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:09.238 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.238 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.238 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.238 18:50:25 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:09.238 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.238 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.238 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.238 18:50:25 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:09.238 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.238 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.238 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.238 18:50:25 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:09.238 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.238 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.238 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.239 18:50:25 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:09.239 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.239 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.239 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.239 18:50:25 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:09.239 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.239 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.239 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.239 18:50:25 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:09.239 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.239 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.239 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.239 18:50:25 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:09.239 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.239 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.239 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.239 18:50:25 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:09.239 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.239 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.239 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.239 18:50:25 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:09.239 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.239 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.239 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.239 18:50:25 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:09.239 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.239 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.239 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.239 18:50:25 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:09.239 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.239 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.239 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.239 18:50:25 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:09.239 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.239 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.239 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.239 18:50:25 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:09.239 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.239 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.239 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.239 18:50:25 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:09.239 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.239 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.239 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.239 18:50:25 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:09.239 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.239 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.239 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.239 18:50:25 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:09.239 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.239 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.239 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.239 18:50:25 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:09.239 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.239 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.239 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.239 18:50:25 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:09.239 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.239 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.239 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.239 18:50:25 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:09.239 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.239 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.239 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.239 18:50:25 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:09.239 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.239 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.239 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.239 18:50:25 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:09.239 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.239 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.239 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.239 18:50:25 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:09.239 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.239 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.239 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.239 18:50:25 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:09.239 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.239 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.239 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.239 18:50:25 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:09.239 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.239 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.239 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.239 18:50:25 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:09.239 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.239 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.239 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.239 18:50:25 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:09.239 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.239 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.239 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.239 18:50:25 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:09.239 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.239 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.239 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.239 18:50:25 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:09.239 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.239 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.239 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.239 18:50:25 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:09.239 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.239 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.239 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.239 18:50:25 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:09.239 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.239 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.239 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.239 18:50:25 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:09.239 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.239 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.239 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.239 18:50:25 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:09.239 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.239 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.239 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.239 18:50:25 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:09.239 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.239 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.239 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.239 18:50:25 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:09.239 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.239 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.239 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.239 18:50:25 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:09.239 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.239 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.239 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.239 18:50:25 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:09.239 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.239 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.239 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.239 18:50:25 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:09.239 18:50:25 -- setup/common.sh@33 -- # echo 0 00:04:09.239 18:50:25 -- setup/common.sh@33 -- # return 0 00:04:09.239 18:50:25 -- setup/hugepages.sh@97 -- # anon=0 00:04:09.239 18:50:25 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:09.239 18:50:25 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:09.239 18:50:25 -- setup/common.sh@18 -- # local node= 00:04:09.239 18:50:25 -- setup/common.sh@19 -- # local var val 00:04:09.239 18:50:25 -- setup/common.sh@20 -- # local mem_f mem 00:04:09.239 18:50:25 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:09.239 18:50:25 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:09.239 18:50:25 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:09.239 18:50:25 -- setup/common.sh@28 -- # mapfile -t mem 00:04:09.239 18:50:25 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:09.239 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.239 18:50:25 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191371056 kB' 'MemFree: 171767552 kB' 'MemAvailable: 176093740 kB' 'Buffers: 3900 kB' 'Cached: 13014140 kB' 'SwapCached: 0 kB' 'Active: 9550840 kB' 'Inactive: 4095672 kB' 'Active(anon): 8454544 kB' 'Inactive(anon): 0 kB' 'Active(file): 1096296 kB' 'Inactive(file): 4095672 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 631696 kB' 'Mapped: 231624 kB' 'Shmem: 7826072 kB' 'KReclaimable: 556760 kB' 'Slab: 1517964 kB' 'SReclaimable: 556760 kB' 'SUnreclaim: 961204 kB' 'KernelStack: 21216 kB' 'PageTables: 11000 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103025556 kB' 'Committed_AS: 9841060 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 318692 kB' 'VmallocChunk: 0 kB' 'Percpu: 103296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 3668948 kB' 'DirectMap2M: 40050688 kB' 'DirectMap1G: 159383552 kB' 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.240 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.240 18:50:25 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.241 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.241 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.241 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.241 18:50:25 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.241 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.241 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.241 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.241 18:50:25 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.241 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.241 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.241 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.241 18:50:25 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.241 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.241 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.241 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.241 18:50:25 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.241 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.241 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.241 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.241 18:50:25 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.241 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.241 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.241 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.241 18:50:25 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.241 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.241 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.241 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.241 18:50:25 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.241 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.241 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.241 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.241 18:50:25 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.241 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.241 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.241 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.241 18:50:25 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.241 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.241 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.241 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.241 18:50:25 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.241 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.241 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.241 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.241 18:50:25 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.241 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.241 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.241 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.241 18:50:25 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.241 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.241 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.241 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.241 18:50:25 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.241 18:50:25 -- setup/common.sh@33 -- # echo 0 00:04:09.241 18:50:25 -- setup/common.sh@33 -- # return 0 00:04:09.241 18:50:25 -- setup/hugepages.sh@99 -- # surp=0 00:04:09.241 18:50:25 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:09.241 18:50:25 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:09.241 18:50:25 -- setup/common.sh@18 -- # local node= 00:04:09.241 18:50:25 -- setup/common.sh@19 -- # local var val 00:04:09.241 18:50:25 -- setup/common.sh@20 -- # local mem_f mem 00:04:09.241 18:50:25 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:09.241 18:50:25 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:09.241 18:50:25 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:09.241 18:50:25 -- setup/common.sh@28 -- # mapfile -t mem 00:04:09.241 18:50:25 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:09.241 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.241 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.241 18:50:25 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191371056 kB' 'MemFree: 171773752 kB' 'MemAvailable: 176099940 kB' 'Buffers: 3900 kB' 'Cached: 13014148 kB' 'SwapCached: 0 kB' 'Active: 9549752 kB' 'Inactive: 4095672 kB' 'Active(anon): 8453456 kB' 'Inactive(anon): 0 kB' 'Active(file): 1096296 kB' 'Inactive(file): 4095672 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 630528 kB' 'Mapped: 231624 kB' 'Shmem: 7826080 kB' 'KReclaimable: 556760 kB' 'Slab: 1517884 kB' 'SReclaimable: 556760 kB' 'SUnreclaim: 961124 kB' 'KernelStack: 20960 kB' 'PageTables: 9864 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103025556 kB' 'Committed_AS: 9836660 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 318532 kB' 'VmallocChunk: 0 kB' 'Percpu: 103296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 3668948 kB' 'DirectMap2M: 40050688 kB' 'DirectMap1G: 159383552 kB' 00:04:09.241 18:50:25 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:09.241 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.241 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.241 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.241 18:50:25 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:09.241 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.241 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.241 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.241 18:50:25 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:09.241 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.241 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.241 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.241 18:50:25 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:09.241 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.241 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.241 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.241 18:50:25 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:09.241 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.241 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.241 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.241 18:50:25 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:09.241 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.241 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.241 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.241 18:50:25 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:09.241 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.241 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.241 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.241 18:50:25 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:09.241 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.241 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.241 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.241 18:50:25 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:09.241 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.241 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.241 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.241 18:50:25 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:09.241 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.241 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.241 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.241 18:50:25 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:09.241 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.241 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.241 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.241 18:50:25 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:09.241 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.241 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.241 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.241 18:50:25 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:09.241 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.241 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.241 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.241 18:50:25 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:09.241 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.241 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.241 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.241 18:50:25 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:09.241 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.241 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.241 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.241 18:50:25 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:09.241 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.241 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.241 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.241 18:50:25 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:09.241 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.241 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.241 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.241 18:50:25 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:09.241 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.241 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.241 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.241 18:50:25 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:09.241 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.241 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.241 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.241 18:50:25 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:09.242 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.242 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.242 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.242 18:50:25 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:09.242 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.242 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.242 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.242 18:50:25 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:09.242 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.242 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.242 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.242 18:50:25 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:09.242 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.242 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.242 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.242 18:50:25 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:09.242 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.242 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.242 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.242 18:50:25 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:09.242 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.242 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.242 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.242 18:50:25 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:09.242 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.242 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.242 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.242 18:50:25 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:09.242 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.242 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.242 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.242 18:50:25 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:09.242 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.242 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.242 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.242 18:50:25 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:09.242 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.242 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.242 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.242 18:50:25 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:09.242 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.242 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.242 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.242 18:50:25 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:09.242 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.242 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.242 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.242 18:50:25 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:09.242 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.242 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.242 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.242 18:50:25 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:09.242 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.242 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.242 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.242 18:50:25 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:09.242 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.242 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.242 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.242 18:50:25 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:09.242 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.242 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.242 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.242 18:50:25 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:09.242 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.242 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.242 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.242 18:50:25 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:09.242 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.242 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.242 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.242 18:50:25 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:09.242 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.242 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.242 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.242 18:50:25 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:09.242 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.242 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.242 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.242 18:50:25 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:09.242 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.242 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.242 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.242 18:50:25 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:09.242 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.242 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.242 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.242 18:50:25 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:09.242 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.242 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.242 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.242 18:50:25 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:09.242 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.242 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.242 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.242 18:50:25 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:09.242 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.242 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.242 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.242 18:50:25 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:09.242 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.242 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.242 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.242 18:50:25 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:09.242 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.242 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.242 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.242 18:50:25 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:09.242 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.242 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.242 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.242 18:50:25 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:09.242 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.242 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.242 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.242 18:50:25 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:09.242 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.242 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.242 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.242 18:50:25 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:09.242 18:50:25 -- setup/common.sh@32 -- # continue 00:04:09.242 18:50:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.242 18:50:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.242 18:50:25 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:09.242 18:50:25 -- setup/common.sh@33 -- # echo 0 00:04:09.242 18:50:25 -- setup/common.sh@33 -- # return 0 00:04:09.242 18:50:25 -- setup/hugepages.sh@100 -- # resv=0 00:04:09.242 18:50:25 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:09.242 nr_hugepages=1024 00:04:09.242 18:50:25 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:09.242 resv_hugepages=0 00:04:09.242 18:50:25 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:09.242 surplus_hugepages=0 00:04:09.242 18:50:25 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:09.242 anon_hugepages=0 00:04:09.242 18:50:25 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:09.242 18:50:25 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:09.242 18:50:25 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:09.242 18:50:25 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:09.242 18:50:26 -- setup/common.sh@18 -- # local node= 00:04:09.242 18:50:26 -- setup/common.sh@19 -- # local var val 00:04:09.242 18:50:26 -- setup/common.sh@20 -- # local mem_f mem 00:04:09.242 18:50:26 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:09.242 18:50:26 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:09.242 18:50:26 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:09.242 18:50:26 -- setup/common.sh@28 -- # mapfile -t mem 00:04:09.242 18:50:26 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:09.242 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.242 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.243 18:50:26 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191371056 kB' 'MemFree: 171775356 kB' 'MemAvailable: 176101544 kB' 'Buffers: 3900 kB' 'Cached: 13014148 kB' 'SwapCached: 0 kB' 'Active: 9549180 kB' 'Inactive: 4095672 kB' 'Active(anon): 8452884 kB' 'Inactive(anon): 0 kB' 'Active(file): 1096296 kB' 'Inactive(file): 4095672 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 629988 kB' 'Mapped: 231624 kB' 'Shmem: 7826080 kB' 'KReclaimable: 556760 kB' 'Slab: 1517980 kB' 'SReclaimable: 556760 kB' 'SUnreclaim: 961220 kB' 'KernelStack: 20640 kB' 'PageTables: 9180 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103025556 kB' 'Committed_AS: 9836672 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 318532 kB' 'VmallocChunk: 0 kB' 'Percpu: 103296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 3668948 kB' 'DirectMap2M: 40050688 kB' 'DirectMap1G: 159383552 kB' 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:09.243 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.243 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.244 18:50:26 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:09.244 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.244 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.244 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.244 18:50:26 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:09.244 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.244 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.244 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.244 18:50:26 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:09.244 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.244 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.244 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.244 18:50:26 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:09.244 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.244 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.244 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.244 18:50:26 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:09.244 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.244 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.244 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.244 18:50:26 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:09.244 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.244 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.244 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.244 18:50:26 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:09.244 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.244 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.244 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.244 18:50:26 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:09.244 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.244 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.244 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.244 18:50:26 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:09.244 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.244 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.244 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.244 18:50:26 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:09.244 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.244 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.244 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.244 18:50:26 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:09.244 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.244 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.244 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.244 18:50:26 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:09.244 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.244 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.244 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.244 18:50:26 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:09.244 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.244 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.244 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.244 18:50:26 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:09.244 18:50:26 -- setup/common.sh@33 -- # echo 1024 00:04:09.244 18:50:26 -- setup/common.sh@33 -- # return 0 00:04:09.244 18:50:26 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:09.244 18:50:26 -- setup/hugepages.sh@112 -- # get_nodes 00:04:09.244 18:50:26 -- setup/hugepages.sh@27 -- # local node 00:04:09.244 18:50:26 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:09.244 18:50:26 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:09.244 18:50:26 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:09.244 18:50:26 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:09.244 18:50:26 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:09.244 18:50:26 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:09.244 18:50:26 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:09.244 18:50:26 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:09.244 18:50:26 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:09.244 18:50:26 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:09.244 18:50:26 -- setup/common.sh@18 -- # local node=0 00:04:09.244 18:50:26 -- setup/common.sh@19 -- # local var val 00:04:09.244 18:50:26 -- setup/common.sh@20 -- # local mem_f mem 00:04:09.244 18:50:26 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:09.244 18:50:26 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:09.244 18:50:26 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:09.244 18:50:26 -- setup/common.sh@28 -- # mapfile -t mem 00:04:09.244 18:50:26 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:09.244 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.244 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.244 18:50:26 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 97609576 kB' 'MemFree: 90511480 kB' 'MemUsed: 7098096 kB' 'SwapCached: 0 kB' 'Active: 3696208 kB' 'Inactive: 281892 kB' 'Active(anon): 2815532 kB' 'Inactive(anon): 0 kB' 'Active(file): 880676 kB' 'Inactive(file): 281892 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3548204 kB' 'Mapped: 132768 kB' 'AnonPages: 433032 kB' 'Shmem: 2385636 kB' 'KernelStack: 13176 kB' 'PageTables: 6148 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 361668 kB' 'Slab: 893572 kB' 'SReclaimable: 361668 kB' 'SUnreclaim: 531904 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:09.244 18:50:26 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.244 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.244 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.244 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.244 18:50:26 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.244 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.244 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.244 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.244 18:50:26 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.244 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.244 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.244 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.244 18:50:26 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.244 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.244 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.244 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.244 18:50:26 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.244 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.244 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.244 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.244 18:50:26 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.244 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.244 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.244 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.244 18:50:26 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.244 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.244 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.244 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.244 18:50:26 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.244 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.244 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.244 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.244 18:50:26 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.244 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.244 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.244 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.244 18:50:26 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.244 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.244 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.244 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.244 18:50:26 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.244 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.244 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.244 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.244 18:50:26 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.244 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.244 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.244 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.244 18:50:26 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.244 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.244 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.244 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.244 18:50:26 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.244 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.244 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.244 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.244 18:50:26 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.244 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.244 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.244 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.244 18:50:26 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.244 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.244 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.244 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.244 18:50:26 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.244 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.244 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.244 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.244 18:50:26 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.244 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.244 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.244 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.245 18:50:26 -- setup/common.sh@33 -- # echo 0 00:04:09.245 18:50:26 -- setup/common.sh@33 -- # return 0 00:04:09.245 18:50:26 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:09.245 18:50:26 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:09.245 18:50:26 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:09.245 18:50:26 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:09.245 18:50:26 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:09.245 18:50:26 -- setup/common.sh@18 -- # local node=1 00:04:09.245 18:50:26 -- setup/common.sh@19 -- # local var val 00:04:09.245 18:50:26 -- setup/common.sh@20 -- # local mem_f mem 00:04:09.245 18:50:26 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:09.245 18:50:26 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:09.245 18:50:26 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:09.245 18:50:26 -- setup/common.sh@28 -- # mapfile -t mem 00:04:09.245 18:50:26 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:09.245 18:50:26 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93761480 kB' 'MemFree: 81263896 kB' 'MemUsed: 12497584 kB' 'SwapCached: 0 kB' 'Active: 5852700 kB' 'Inactive: 3813780 kB' 'Active(anon): 5637080 kB' 'Inactive(anon): 0 kB' 'Active(file): 215620 kB' 'Inactive(file): 3813780 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9469888 kB' 'Mapped: 98856 kB' 'AnonPages: 196664 kB' 'Shmem: 5440488 kB' 'KernelStack: 7480 kB' 'PageTables: 3084 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 195092 kB' 'Slab: 624408 kB' 'SReclaimable: 195092 kB' 'SUnreclaim: 429316 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.245 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.245 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.246 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.246 18:50:26 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.246 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.246 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.246 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.246 18:50:26 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.246 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.246 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.246 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.246 18:50:26 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.246 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.246 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.246 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.246 18:50:26 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.246 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.246 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.246 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.246 18:50:26 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.246 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.246 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.246 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.246 18:50:26 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.246 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.246 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.246 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.246 18:50:26 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.246 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.246 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.246 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.246 18:50:26 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.246 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.246 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.246 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.246 18:50:26 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.246 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.246 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.246 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.246 18:50:26 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.246 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.246 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.246 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.246 18:50:26 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.246 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.246 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.246 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.246 18:50:26 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.246 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.246 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.246 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.246 18:50:26 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.246 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.246 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.246 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.246 18:50:26 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.246 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.246 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.246 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.246 18:50:26 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.246 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.246 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.246 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.246 18:50:26 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.246 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.246 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.246 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.246 18:50:26 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.246 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.246 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.246 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.246 18:50:26 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.246 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.246 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.246 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.246 18:50:26 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.246 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.246 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.246 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.246 18:50:26 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.246 18:50:26 -- setup/common.sh@32 -- # continue 00:04:09.246 18:50:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:09.246 18:50:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:09.246 18:50:26 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:09.246 18:50:26 -- setup/common.sh@33 -- # echo 0 00:04:09.246 18:50:26 -- setup/common.sh@33 -- # return 0 00:04:09.246 18:50:26 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:09.246 18:50:26 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:09.246 18:50:26 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:09.246 18:50:26 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:09.246 18:50:26 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:04:09.246 node0=512 expecting 512 00:04:09.246 18:50:26 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:09.246 18:50:26 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:09.246 18:50:26 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:09.246 18:50:26 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:04:09.246 node1=512 expecting 512 00:04:09.246 18:50:26 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:04:09.246 00:04:09.246 real 0m2.781s 00:04:09.246 user 0m1.108s 00:04:09.246 sys 0m1.694s 00:04:09.246 18:50:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:09.246 18:50:26 -- common/autotest_common.sh@10 -- # set +x 00:04:09.246 ************************************ 00:04:09.246 END TEST even_2G_alloc 00:04:09.246 ************************************ 00:04:09.246 18:50:26 -- setup/hugepages.sh@213 -- # run_test odd_alloc odd_alloc 00:04:09.246 18:50:26 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:09.246 18:50:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:09.246 18:50:26 -- common/autotest_common.sh@10 -- # set +x 00:04:09.246 ************************************ 00:04:09.246 START TEST odd_alloc 00:04:09.246 ************************************ 00:04:09.246 18:50:26 -- common/autotest_common.sh@1114 -- # odd_alloc 00:04:09.246 18:50:26 -- setup/hugepages.sh@159 -- # get_test_nr_hugepages 2098176 00:04:09.246 18:50:26 -- setup/hugepages.sh@49 -- # local size=2098176 00:04:09.246 18:50:26 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:09.246 18:50:26 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:09.246 18:50:26 -- setup/hugepages.sh@57 -- # nr_hugepages=1025 00:04:09.246 18:50:26 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:09.246 18:50:26 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:09.246 18:50:26 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:09.246 18:50:26 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1025 00:04:09.246 18:50:26 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:09.246 18:50:26 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:09.246 18:50:26 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:09.246 18:50:26 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:09.246 18:50:26 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:04:09.246 18:50:26 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:09.246 18:50:26 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:04:09.246 18:50:26 -- setup/hugepages.sh@83 -- # : 513 00:04:09.246 18:50:26 -- setup/hugepages.sh@84 -- # : 1 00:04:09.246 18:50:26 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:09.246 18:50:26 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=513 00:04:09.246 18:50:26 -- setup/hugepages.sh@83 -- # : 0 00:04:09.246 18:50:26 -- setup/hugepages.sh@84 -- # : 0 00:04:09.246 18:50:26 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:09.246 18:50:26 -- setup/hugepages.sh@160 -- # HUGEMEM=2049 00:04:09.246 18:50:26 -- setup/hugepages.sh@160 -- # HUGE_EVEN_ALLOC=yes 00:04:09.246 18:50:26 -- setup/hugepages.sh@160 -- # setup output 00:04:09.246 18:50:26 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:09.246 18:50:26 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:12.679 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:04:12.679 0000:5e:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:12.679 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:04:12.679 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:04:12.679 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:04:12.679 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:04:12.679 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:04:12.679 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:04:12.679 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:04:12.679 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:04:12.679 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:04:12.679 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:04:12.679 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:04:12.679 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:04:12.679 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:04:12.679 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:04:12.679 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:04:12.679 18:50:29 -- setup/hugepages.sh@161 -- # verify_nr_hugepages 00:04:12.679 18:50:29 -- setup/hugepages.sh@89 -- # local node 00:04:12.679 18:50:29 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:12.679 18:50:29 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:12.679 18:50:29 -- setup/hugepages.sh@92 -- # local surp 00:04:12.679 18:50:29 -- setup/hugepages.sh@93 -- # local resv 00:04:12.679 18:50:29 -- setup/hugepages.sh@94 -- # local anon 00:04:12.679 18:50:29 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:12.679 18:50:29 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:12.679 18:50:29 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:12.679 18:50:29 -- setup/common.sh@18 -- # local node= 00:04:12.679 18:50:29 -- setup/common.sh@19 -- # local var val 00:04:12.679 18:50:29 -- setup/common.sh@20 -- # local mem_f mem 00:04:12.679 18:50:29 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:12.679 18:50:29 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:12.679 18:50:29 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:12.679 18:50:29 -- setup/common.sh@28 -- # mapfile -t mem 00:04:12.679 18:50:29 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:12.679 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.679 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.679 18:50:29 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191371056 kB' 'MemFree: 171804372 kB' 'MemAvailable: 176130560 kB' 'Buffers: 3900 kB' 'Cached: 13014256 kB' 'SwapCached: 0 kB' 'Active: 9549444 kB' 'Inactive: 4095672 kB' 'Active(anon): 8453148 kB' 'Inactive(anon): 0 kB' 'Active(file): 1096296 kB' 'Inactive(file): 4095672 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 630144 kB' 'Mapped: 231644 kB' 'Shmem: 7826188 kB' 'KReclaimable: 556760 kB' 'Slab: 1518140 kB' 'SReclaimable: 556760 kB' 'SUnreclaim: 961380 kB' 'KernelStack: 20592 kB' 'PageTables: 9048 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103024532 kB' 'Committed_AS: 9837144 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 318468 kB' 'VmallocChunk: 0 kB' 'Percpu: 103296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 3668948 kB' 'DirectMap2M: 40050688 kB' 'DirectMap1G: 159383552 kB' 00:04:12.679 18:50:29 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.679 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.679 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.679 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.679 18:50:29 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.679 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.679 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.679 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.679 18:50:29 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.679 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.679 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.679 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.679 18:50:29 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.679 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.679 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.679 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.679 18:50:29 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.679 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.679 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.679 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.679 18:50:29 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.679 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.679 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.679 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.679 18:50:29 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.679 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.679 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.679 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.679 18:50:29 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.679 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.679 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.679 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.679 18:50:29 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.679 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.679 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.679 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.679 18:50:29 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.679 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.679 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.680 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.680 18:50:29 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.680 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.680 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.680 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.680 18:50:29 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.680 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.680 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.680 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.680 18:50:29 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.680 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.680 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.680 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.680 18:50:29 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.680 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.680 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.680 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.680 18:50:29 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.680 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.680 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.680 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.680 18:50:29 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.680 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.680 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.680 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.680 18:50:29 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.680 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.680 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.680 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.680 18:50:29 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.680 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.680 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.680 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.680 18:50:29 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.680 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.680 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.680 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.680 18:50:29 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.680 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.680 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.680 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.680 18:50:29 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.680 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.680 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.680 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.680 18:50:29 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.680 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.680 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.680 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.680 18:50:29 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.680 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.680 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.680 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.680 18:50:29 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.680 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.680 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.680 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.680 18:50:29 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.680 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.680 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.680 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.680 18:50:29 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.680 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.680 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.680 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.680 18:50:29 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.680 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.680 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.680 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.680 18:50:29 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.680 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.680 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.680 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.680 18:50:29 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.680 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.680 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.680 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.680 18:50:29 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.680 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.680 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.680 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.680 18:50:29 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.680 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.680 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.680 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.680 18:50:29 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.680 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.680 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.680 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.680 18:50:29 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.680 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.680 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.680 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.680 18:50:29 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.680 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.680 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.680 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.680 18:50:29 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.680 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.680 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.680 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.680 18:50:29 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.680 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.680 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.680 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.680 18:50:29 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.680 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.680 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.680 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.680 18:50:29 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.680 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.680 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.680 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.680 18:50:29 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.680 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.680 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.680 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.680 18:50:29 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.680 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.680 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.680 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.680 18:50:29 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.680 18:50:29 -- setup/common.sh@33 -- # echo 0 00:04:12.680 18:50:29 -- setup/common.sh@33 -- # return 0 00:04:12.680 18:50:29 -- setup/hugepages.sh@97 -- # anon=0 00:04:12.680 18:50:29 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:12.680 18:50:29 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:12.680 18:50:29 -- setup/common.sh@18 -- # local node= 00:04:12.680 18:50:29 -- setup/common.sh@19 -- # local var val 00:04:12.680 18:50:29 -- setup/common.sh@20 -- # local mem_f mem 00:04:12.681 18:50:29 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:12.681 18:50:29 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:12.681 18:50:29 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:12.681 18:50:29 -- setup/common.sh@28 -- # mapfile -t mem 00:04:12.681 18:50:29 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.681 18:50:29 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191371056 kB' 'MemFree: 171805004 kB' 'MemAvailable: 176131192 kB' 'Buffers: 3900 kB' 'Cached: 13014260 kB' 'SwapCached: 0 kB' 'Active: 9549728 kB' 'Inactive: 4095672 kB' 'Active(anon): 8453432 kB' 'Inactive(anon): 0 kB' 'Active(file): 1096296 kB' 'Inactive(file): 4095672 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 630500 kB' 'Mapped: 231644 kB' 'Shmem: 7826192 kB' 'KReclaimable: 556760 kB' 'Slab: 1518200 kB' 'SReclaimable: 556760 kB' 'SUnreclaim: 961440 kB' 'KernelStack: 20592 kB' 'PageTables: 9056 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103024532 kB' 'Committed_AS: 9837156 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 318452 kB' 'VmallocChunk: 0 kB' 'Percpu: 103296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 3668948 kB' 'DirectMap2M: 40050688 kB' 'DirectMap1G: 159383552 kB' 00:04:12.681 18:50:29 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.681 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.681 18:50:29 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.681 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.681 18:50:29 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.681 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.681 18:50:29 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.681 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.681 18:50:29 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.681 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.681 18:50:29 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.681 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.681 18:50:29 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.681 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.681 18:50:29 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.681 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.681 18:50:29 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.681 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.681 18:50:29 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.681 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.681 18:50:29 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.681 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.681 18:50:29 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.681 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.681 18:50:29 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.681 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.681 18:50:29 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.681 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.681 18:50:29 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.681 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.681 18:50:29 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.681 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.681 18:50:29 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.681 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.681 18:50:29 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.681 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.681 18:50:29 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.681 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.681 18:50:29 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.681 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.681 18:50:29 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.681 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.681 18:50:29 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.681 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.681 18:50:29 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.681 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.681 18:50:29 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.681 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.681 18:50:29 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.681 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.681 18:50:29 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.681 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.681 18:50:29 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.681 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.681 18:50:29 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.681 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.681 18:50:29 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.681 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.681 18:50:29 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.681 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.681 18:50:29 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.681 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.681 18:50:29 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.681 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.681 18:50:29 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.681 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.681 18:50:29 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.681 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.681 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.682 18:50:29 -- setup/common.sh@33 -- # echo 0 00:04:12.682 18:50:29 -- setup/common.sh@33 -- # return 0 00:04:12.682 18:50:29 -- setup/hugepages.sh@99 -- # surp=0 00:04:12.682 18:50:29 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:12.682 18:50:29 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:12.682 18:50:29 -- setup/common.sh@18 -- # local node= 00:04:12.682 18:50:29 -- setup/common.sh@19 -- # local var val 00:04:12.682 18:50:29 -- setup/common.sh@20 -- # local mem_f mem 00:04:12.682 18:50:29 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:12.682 18:50:29 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:12.682 18:50:29 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:12.682 18:50:29 -- setup/common.sh@28 -- # mapfile -t mem 00:04:12.682 18:50:29 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.682 18:50:29 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191371056 kB' 'MemFree: 171804500 kB' 'MemAvailable: 176130688 kB' 'Buffers: 3900 kB' 'Cached: 13014260 kB' 'SwapCached: 0 kB' 'Active: 9549728 kB' 'Inactive: 4095672 kB' 'Active(anon): 8453432 kB' 'Inactive(anon): 0 kB' 'Active(file): 1096296 kB' 'Inactive(file): 4095672 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 630500 kB' 'Mapped: 231644 kB' 'Shmem: 7826192 kB' 'KReclaimable: 556760 kB' 'Slab: 1518200 kB' 'SReclaimable: 556760 kB' 'SUnreclaim: 961440 kB' 'KernelStack: 20592 kB' 'PageTables: 9056 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103024532 kB' 'Committed_AS: 9837172 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 318452 kB' 'VmallocChunk: 0 kB' 'Percpu: 103296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 3668948 kB' 'DirectMap2M: 40050688 kB' 'DirectMap1G: 159383552 kB' 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.682 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.682 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.683 18:50:29 -- setup/common.sh@33 -- # echo 0 00:04:12.683 18:50:29 -- setup/common.sh@33 -- # return 0 00:04:12.683 18:50:29 -- setup/hugepages.sh@100 -- # resv=0 00:04:12.683 18:50:29 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1025 00:04:12.683 nr_hugepages=1025 00:04:12.683 18:50:29 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:12.683 resv_hugepages=0 00:04:12.683 18:50:29 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:12.683 surplus_hugepages=0 00:04:12.683 18:50:29 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:12.683 anon_hugepages=0 00:04:12.683 18:50:29 -- setup/hugepages.sh@107 -- # (( 1025 == nr_hugepages + surp + resv )) 00:04:12.683 18:50:29 -- setup/hugepages.sh@109 -- # (( 1025 == nr_hugepages )) 00:04:12.683 18:50:29 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:12.683 18:50:29 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:12.683 18:50:29 -- setup/common.sh@18 -- # local node= 00:04:12.683 18:50:29 -- setup/common.sh@19 -- # local var val 00:04:12.683 18:50:29 -- setup/common.sh@20 -- # local mem_f mem 00:04:12.683 18:50:29 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:12.683 18:50:29 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:12.683 18:50:29 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:12.683 18:50:29 -- setup/common.sh@28 -- # mapfile -t mem 00:04:12.683 18:50:29 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.683 18:50:29 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191371056 kB' 'MemFree: 171804932 kB' 'MemAvailable: 176131120 kB' 'Buffers: 3900 kB' 'Cached: 13014284 kB' 'SwapCached: 0 kB' 'Active: 9549772 kB' 'Inactive: 4095672 kB' 'Active(anon): 8453476 kB' 'Inactive(anon): 0 kB' 'Active(file): 1096296 kB' 'Inactive(file): 4095672 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 630500 kB' 'Mapped: 231644 kB' 'Shmem: 7826216 kB' 'KReclaimable: 556760 kB' 'Slab: 1518200 kB' 'SReclaimable: 556760 kB' 'SUnreclaim: 961440 kB' 'KernelStack: 20592 kB' 'PageTables: 9056 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103024532 kB' 'Committed_AS: 9837188 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 318452 kB' 'VmallocChunk: 0 kB' 'Percpu: 103296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 3668948 kB' 'DirectMap2M: 40050688 kB' 'DirectMap1G: 159383552 kB' 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.683 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.683 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.684 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.684 18:50:29 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.685 18:50:29 -- setup/common.sh@33 -- # echo 1025 00:04:12.685 18:50:29 -- setup/common.sh@33 -- # return 0 00:04:12.685 18:50:29 -- setup/hugepages.sh@110 -- # (( 1025 == nr_hugepages + surp + resv )) 00:04:12.685 18:50:29 -- setup/hugepages.sh@112 -- # get_nodes 00:04:12.685 18:50:29 -- setup/hugepages.sh@27 -- # local node 00:04:12.685 18:50:29 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:12.685 18:50:29 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:12.685 18:50:29 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:12.685 18:50:29 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=513 00:04:12.685 18:50:29 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:12.685 18:50:29 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:12.685 18:50:29 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:12.685 18:50:29 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:12.685 18:50:29 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:12.685 18:50:29 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:12.685 18:50:29 -- setup/common.sh@18 -- # local node=0 00:04:12.685 18:50:29 -- setup/common.sh@19 -- # local var val 00:04:12.685 18:50:29 -- setup/common.sh@20 -- # local mem_f mem 00:04:12.685 18:50:29 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:12.685 18:50:29 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:12.685 18:50:29 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:12.685 18:50:29 -- setup/common.sh@28 -- # mapfile -t mem 00:04:12.685 18:50:29 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.685 18:50:29 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 97609576 kB' 'MemFree: 90539692 kB' 'MemUsed: 7069884 kB' 'SwapCached: 0 kB' 'Active: 3696628 kB' 'Inactive: 281892 kB' 'Active(anon): 2815952 kB' 'Inactive(anon): 0 kB' 'Active(file): 880676 kB' 'Inactive(file): 281892 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3548240 kB' 'Mapped: 132788 kB' 'AnonPages: 433412 kB' 'Shmem: 2385672 kB' 'KernelStack: 13128 kB' 'PageTables: 6112 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 361668 kB' 'Slab: 893684 kB' 'SReclaimable: 361668 kB' 'SUnreclaim: 532016 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.685 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.685 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.686 18:50:29 -- setup/common.sh@33 -- # echo 0 00:04:12.686 18:50:29 -- setup/common.sh@33 -- # return 0 00:04:12.686 18:50:29 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:12.686 18:50:29 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:12.686 18:50:29 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:12.686 18:50:29 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:12.686 18:50:29 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:12.686 18:50:29 -- setup/common.sh@18 -- # local node=1 00:04:12.686 18:50:29 -- setup/common.sh@19 -- # local var val 00:04:12.686 18:50:29 -- setup/common.sh@20 -- # local mem_f mem 00:04:12.686 18:50:29 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:12.686 18:50:29 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:12.686 18:50:29 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:12.686 18:50:29 -- setup/common.sh@28 -- # mapfile -t mem 00:04:12.686 18:50:29 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.686 18:50:29 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93761480 kB' 'MemFree: 81265336 kB' 'MemUsed: 12496144 kB' 'SwapCached: 0 kB' 'Active: 5853016 kB' 'Inactive: 3813780 kB' 'Active(anon): 5637396 kB' 'Inactive(anon): 0 kB' 'Active(file): 215620 kB' 'Inactive(file): 3813780 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9469972 kB' 'Mapped: 98856 kB' 'AnonPages: 196888 kB' 'Shmem: 5440572 kB' 'KernelStack: 7448 kB' 'PageTables: 2892 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 195092 kB' 'Slab: 624516 kB' 'SReclaimable: 195092 kB' 'SUnreclaim: 429424 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 513' 'HugePages_Free: 513' 'HugePages_Surp: 0' 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.686 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.686 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.687 18:50:29 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.687 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.687 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.687 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.687 18:50:29 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.687 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.687 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.687 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.687 18:50:29 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.687 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.687 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.687 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.687 18:50:29 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.687 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.687 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.687 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.687 18:50:29 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.687 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.687 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.687 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.687 18:50:29 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.687 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.687 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.687 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.687 18:50:29 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.687 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.687 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.687 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.687 18:50:29 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.687 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.687 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.687 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.687 18:50:29 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.687 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.687 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.687 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.687 18:50:29 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.687 18:50:29 -- setup/common.sh@32 -- # continue 00:04:12.687 18:50:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.687 18:50:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.687 18:50:29 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.687 18:50:29 -- setup/common.sh@33 -- # echo 0 00:04:12.687 18:50:29 -- setup/common.sh@33 -- # return 0 00:04:12.687 18:50:29 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:12.687 18:50:29 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:12.687 18:50:29 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:12.687 18:50:29 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:12.687 18:50:29 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 513' 00:04:12.687 node0=512 expecting 513 00:04:12.687 18:50:29 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:12.687 18:50:29 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:12.687 18:50:29 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:12.687 18:50:29 -- setup/hugepages.sh@128 -- # echo 'node1=513 expecting 512' 00:04:12.687 node1=513 expecting 512 00:04:12.687 18:50:29 -- setup/hugepages.sh@130 -- # [[ 512 513 == \5\1\2\ \5\1\3 ]] 00:04:12.687 00:04:12.687 real 0m3.039s 00:04:12.687 user 0m1.250s 00:04:12.687 sys 0m1.847s 00:04:12.687 18:50:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:12.687 18:50:29 -- common/autotest_common.sh@10 -- # set +x 00:04:12.687 ************************************ 00:04:12.687 END TEST odd_alloc 00:04:12.687 ************************************ 00:04:12.687 18:50:29 -- setup/hugepages.sh@214 -- # run_test custom_alloc custom_alloc 00:04:12.687 18:50:29 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:12.687 18:50:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:12.687 18:50:29 -- common/autotest_common.sh@10 -- # set +x 00:04:12.687 ************************************ 00:04:12.687 START TEST custom_alloc 00:04:12.687 ************************************ 00:04:12.687 18:50:29 -- common/autotest_common.sh@1114 -- # custom_alloc 00:04:12.687 18:50:29 -- setup/hugepages.sh@167 -- # local IFS=, 00:04:12.687 18:50:29 -- setup/hugepages.sh@169 -- # local node 00:04:12.687 18:50:29 -- setup/hugepages.sh@170 -- # nodes_hp=() 00:04:12.687 18:50:29 -- setup/hugepages.sh@170 -- # local nodes_hp 00:04:12.687 18:50:29 -- setup/hugepages.sh@172 -- # local nr_hugepages=0 _nr_hugepages=0 00:04:12.687 18:50:29 -- setup/hugepages.sh@174 -- # get_test_nr_hugepages 1048576 00:04:12.687 18:50:29 -- setup/hugepages.sh@49 -- # local size=1048576 00:04:12.687 18:50:29 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:12.687 18:50:29 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:12.687 18:50:29 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:04:12.687 18:50:29 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:12.687 18:50:29 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:12.687 18:50:29 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:12.687 18:50:29 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:04:12.687 18:50:29 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:12.687 18:50:29 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:12.687 18:50:29 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:12.687 18:50:29 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:12.687 18:50:29 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:04:12.687 18:50:29 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:12.687 18:50:29 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:04:12.687 18:50:29 -- setup/hugepages.sh@83 -- # : 256 00:04:12.687 18:50:29 -- setup/hugepages.sh@84 -- # : 1 00:04:12.687 18:50:29 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:12.687 18:50:29 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:04:12.687 18:50:29 -- setup/hugepages.sh@83 -- # : 0 00:04:12.687 18:50:29 -- setup/hugepages.sh@84 -- # : 0 00:04:12.687 18:50:29 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:12.687 18:50:29 -- setup/hugepages.sh@175 -- # nodes_hp[0]=512 00:04:12.687 18:50:29 -- setup/hugepages.sh@176 -- # (( 2 > 1 )) 00:04:12.687 18:50:29 -- setup/hugepages.sh@177 -- # get_test_nr_hugepages 2097152 00:04:12.687 18:50:29 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:12.687 18:50:29 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:12.687 18:50:29 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:12.687 18:50:29 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:12.687 18:50:29 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:12.687 18:50:29 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:12.687 18:50:29 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:12.687 18:50:29 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:12.687 18:50:29 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:12.687 18:50:29 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:12.687 18:50:29 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:12.687 18:50:29 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:12.687 18:50:29 -- setup/hugepages.sh@74 -- # (( 1 > 0 )) 00:04:12.687 18:50:29 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:04:12.687 18:50:29 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:04:12.687 18:50:29 -- setup/hugepages.sh@78 -- # return 0 00:04:12.687 18:50:29 -- setup/hugepages.sh@178 -- # nodes_hp[1]=1024 00:04:12.687 18:50:29 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:04:12.687 18:50:29 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:04:12.687 18:50:29 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:04:12.687 18:50:29 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:04:12.687 18:50:29 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:04:12.687 18:50:29 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:04:12.687 18:50:29 -- setup/hugepages.sh@186 -- # get_test_nr_hugepages_per_node 00:04:12.687 18:50:29 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:12.687 18:50:29 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:12.687 18:50:29 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:12.687 18:50:29 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:12.687 18:50:29 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:12.687 18:50:29 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:12.687 18:50:29 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:12.687 18:50:29 -- setup/hugepages.sh@74 -- # (( 2 > 0 )) 00:04:12.687 18:50:29 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:04:12.687 18:50:29 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:04:12.687 18:50:29 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:04:12.687 18:50:29 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=1024 00:04:12.687 18:50:29 -- setup/hugepages.sh@78 -- # return 0 00:04:12.687 18:50:29 -- setup/hugepages.sh@187 -- # HUGENODE='nodes_hp[0]=512,nodes_hp[1]=1024' 00:04:12.687 18:50:29 -- setup/hugepages.sh@187 -- # setup output 00:04:12.687 18:50:29 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:12.687 18:50:29 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:15.217 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:04:15.217 0000:5e:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:15.217 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:04:15.217 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:04:15.217 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:04:15.217 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:04:15.217 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:04:15.217 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:04:15.217 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:04:15.217 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:04:15.217 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:04:15.217 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:04:15.217 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:04:15.217 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:04:15.217 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:04:15.217 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:04:15.217 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:04:15.217 18:50:32 -- setup/hugepages.sh@188 -- # nr_hugepages=1536 00:04:15.217 18:50:32 -- setup/hugepages.sh@188 -- # verify_nr_hugepages 00:04:15.217 18:50:32 -- setup/hugepages.sh@89 -- # local node 00:04:15.217 18:50:32 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:15.217 18:50:32 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:15.217 18:50:32 -- setup/hugepages.sh@92 -- # local surp 00:04:15.217 18:50:32 -- setup/hugepages.sh@93 -- # local resv 00:04:15.217 18:50:32 -- setup/hugepages.sh@94 -- # local anon 00:04:15.217 18:50:32 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:15.217 18:50:32 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:15.217 18:50:32 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:15.217 18:50:32 -- setup/common.sh@18 -- # local node= 00:04:15.217 18:50:32 -- setup/common.sh@19 -- # local var val 00:04:15.217 18:50:32 -- setup/common.sh@20 -- # local mem_f mem 00:04:15.217 18:50:32 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:15.217 18:50:32 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:15.217 18:50:32 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:15.217 18:50:32 -- setup/common.sh@28 -- # mapfile -t mem 00:04:15.217 18:50:32 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:15.217 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.217 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.218 18:50:32 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191371056 kB' 'MemFree: 170755412 kB' 'MemAvailable: 175081600 kB' 'Buffers: 3900 kB' 'Cached: 13014372 kB' 'SwapCached: 0 kB' 'Active: 9548576 kB' 'Inactive: 4095672 kB' 'Active(anon): 8452280 kB' 'Inactive(anon): 0 kB' 'Active(file): 1096296 kB' 'Inactive(file): 4095672 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 629288 kB' 'Mapped: 231748 kB' 'Shmem: 7826304 kB' 'KReclaimable: 556760 kB' 'Slab: 1517928 kB' 'SReclaimable: 556760 kB' 'SUnreclaim: 961168 kB' 'KernelStack: 20704 kB' 'PageTables: 9292 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 102501268 kB' 'Committed_AS: 9837644 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 318436 kB' 'VmallocChunk: 0 kB' 'Percpu: 103296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 3668948 kB' 'DirectMap2M: 40050688 kB' 'DirectMap1G: 159383552 kB' 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.218 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:15.218 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.219 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.219 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.219 18:50:32 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:15.219 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.219 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.219 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.219 18:50:32 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:15.219 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.219 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.219 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.219 18:50:32 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:15.219 18:50:32 -- setup/common.sh@33 -- # echo 0 00:04:15.219 18:50:32 -- setup/common.sh@33 -- # return 0 00:04:15.219 18:50:32 -- setup/hugepages.sh@97 -- # anon=0 00:04:15.219 18:50:32 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:15.219 18:50:32 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:15.219 18:50:32 -- setup/common.sh@18 -- # local node= 00:04:15.219 18:50:32 -- setup/common.sh@19 -- # local var val 00:04:15.219 18:50:32 -- setup/common.sh@20 -- # local mem_f mem 00:04:15.219 18:50:32 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:15.219 18:50:32 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:15.219 18:50:32 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:15.219 18:50:32 -- setup/common.sh@28 -- # mapfile -t mem 00:04:15.219 18:50:32 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:15.219 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.219 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.219 18:50:32 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191371056 kB' 'MemFree: 170756128 kB' 'MemAvailable: 175082316 kB' 'Buffers: 3900 kB' 'Cached: 13014376 kB' 'SwapCached: 0 kB' 'Active: 9548580 kB' 'Inactive: 4095672 kB' 'Active(anon): 8452284 kB' 'Inactive(anon): 0 kB' 'Active(file): 1096296 kB' 'Inactive(file): 4095672 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 629300 kB' 'Mapped: 231636 kB' 'Shmem: 7826308 kB' 'KReclaimable: 556760 kB' 'Slab: 1517900 kB' 'SReclaimable: 556760 kB' 'SUnreclaim: 961140 kB' 'KernelStack: 20688 kB' 'PageTables: 9248 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 102501268 kB' 'Committed_AS: 9837656 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 318420 kB' 'VmallocChunk: 0 kB' 'Percpu: 103296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 3668948 kB' 'DirectMap2M: 40050688 kB' 'DirectMap1G: 159383552 kB' 00:04:15.219 18:50:32 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.219 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.219 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.481 18:50:32 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.481 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.481 18:50:32 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.481 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.481 18:50:32 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.481 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.481 18:50:32 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.481 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.481 18:50:32 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.481 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.481 18:50:32 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.481 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.481 18:50:32 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.481 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.481 18:50:32 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.481 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.481 18:50:32 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.481 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.481 18:50:32 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.481 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.481 18:50:32 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.481 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.481 18:50:32 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.481 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.481 18:50:32 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.481 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.481 18:50:32 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.481 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.481 18:50:32 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.481 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.481 18:50:32 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.481 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.481 18:50:32 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.481 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.481 18:50:32 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.481 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.481 18:50:32 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.481 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.481 18:50:32 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.481 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.481 18:50:32 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.481 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.481 18:50:32 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.481 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.481 18:50:32 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.481 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.481 18:50:32 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.481 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.481 18:50:32 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.481 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.481 18:50:32 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.481 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.481 18:50:32 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.481 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.481 18:50:32 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.481 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.481 18:50:32 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.481 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.481 18:50:32 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.481 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.481 18:50:32 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.481 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.481 18:50:32 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.481 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.481 18:50:32 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.481 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.481 18:50:32 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.481 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.481 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.482 18:50:32 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.482 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.482 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.482 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.482 18:50:32 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.482 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.482 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.482 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.482 18:50:32 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.482 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.482 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.482 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.482 18:50:32 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.482 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.482 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.482 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.482 18:50:32 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.482 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.482 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.482 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.482 18:50:32 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.482 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.482 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.482 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.482 18:50:32 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.482 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.482 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.482 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.482 18:50:32 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.482 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.482 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.482 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.482 18:50:32 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.482 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.482 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.482 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.482 18:50:32 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.482 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.482 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.482 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.482 18:50:32 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.482 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.482 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.482 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.482 18:50:32 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.482 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.482 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.482 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.482 18:50:32 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.482 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.482 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.482 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.482 18:50:32 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.482 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.482 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.482 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.482 18:50:32 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.482 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.482 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.482 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.482 18:50:32 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.482 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.482 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.482 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.482 18:50:32 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.482 18:50:32 -- setup/common.sh@33 -- # echo 0 00:04:15.482 18:50:32 -- setup/common.sh@33 -- # return 0 00:04:15.482 18:50:32 -- setup/hugepages.sh@99 -- # surp=0 00:04:15.482 18:50:32 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:15.482 18:50:32 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:15.482 18:50:32 -- setup/common.sh@18 -- # local node= 00:04:15.482 18:50:32 -- setup/common.sh@19 -- # local var val 00:04:15.482 18:50:32 -- setup/common.sh@20 -- # local mem_f mem 00:04:15.482 18:50:32 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:15.482 18:50:32 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:15.482 18:50:32 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:15.482 18:50:32 -- setup/common.sh@28 -- # mapfile -t mem 00:04:15.482 18:50:32 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:15.482 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.482 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.482 18:50:32 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191371056 kB' 'MemFree: 170756296 kB' 'MemAvailable: 175082484 kB' 'Buffers: 3900 kB' 'Cached: 13014388 kB' 'SwapCached: 0 kB' 'Active: 9548296 kB' 'Inactive: 4095672 kB' 'Active(anon): 8452000 kB' 'Inactive(anon): 0 kB' 'Active(file): 1096296 kB' 'Inactive(file): 4095672 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 628964 kB' 'Mapped: 231636 kB' 'Shmem: 7826320 kB' 'KReclaimable: 556760 kB' 'Slab: 1517900 kB' 'SReclaimable: 556760 kB' 'SUnreclaim: 961140 kB' 'KernelStack: 20688 kB' 'PageTables: 9244 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 102501268 kB' 'Committed_AS: 9837672 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 318420 kB' 'VmallocChunk: 0 kB' 'Percpu: 103296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 3668948 kB' 'DirectMap2M: 40050688 kB' 'DirectMap1G: 159383552 kB' 00:04:15.482 18:50:32 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:15.482 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.482 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.482 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.482 18:50:32 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:15.482 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.482 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.482 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.482 18:50:32 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:15.482 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.482 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.482 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.482 18:50:32 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:15.482 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.482 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.482 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.482 18:50:32 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:15.482 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.482 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.482 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.482 18:50:32 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:15.482 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.482 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.482 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.482 18:50:32 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:15.482 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.482 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.482 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.482 18:50:32 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:15.482 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.482 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.482 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.482 18:50:32 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:15.482 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.482 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.482 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.482 18:50:32 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:15.482 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.482 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.482 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.482 18:50:32 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:15.482 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.482 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.482 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.482 18:50:32 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:15.482 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.482 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.482 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.482 18:50:32 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:15.482 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.482 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.482 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.482 18:50:32 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:15.482 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.482 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.482 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.482 18:50:32 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:15.482 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.482 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.482 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.482 18:50:32 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:15.482 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.482 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.482 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.482 18:50:32 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:15.483 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.483 18:50:32 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:15.483 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.483 18:50:32 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:15.483 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.483 18:50:32 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:15.483 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.483 18:50:32 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:15.483 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.483 18:50:32 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:15.483 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.483 18:50:32 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:15.483 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.483 18:50:32 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:15.483 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.483 18:50:32 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:15.483 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.483 18:50:32 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:15.483 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.483 18:50:32 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:15.483 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.483 18:50:32 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:15.483 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.483 18:50:32 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:15.483 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.483 18:50:32 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:15.483 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.483 18:50:32 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:15.483 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.483 18:50:32 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:15.483 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.483 18:50:32 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:15.483 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.483 18:50:32 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:15.483 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.483 18:50:32 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:15.483 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.483 18:50:32 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:15.483 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.483 18:50:32 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:15.483 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.483 18:50:32 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:15.483 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.483 18:50:32 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:15.483 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.483 18:50:32 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:15.483 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.483 18:50:32 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:15.483 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.483 18:50:32 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:15.483 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.483 18:50:32 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:15.483 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.483 18:50:32 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:15.483 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.483 18:50:32 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:15.483 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.483 18:50:32 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:15.483 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.483 18:50:32 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:15.483 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.483 18:50:32 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:15.483 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.483 18:50:32 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:15.483 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.483 18:50:32 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:15.483 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.483 18:50:32 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:15.483 18:50:32 -- setup/common.sh@33 -- # echo 0 00:04:15.483 18:50:32 -- setup/common.sh@33 -- # return 0 00:04:15.483 18:50:32 -- setup/hugepages.sh@100 -- # resv=0 00:04:15.483 18:50:32 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1536 00:04:15.483 nr_hugepages=1536 00:04:15.483 18:50:32 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:15.483 resv_hugepages=0 00:04:15.483 18:50:32 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:15.483 surplus_hugepages=0 00:04:15.483 18:50:32 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:15.483 anon_hugepages=0 00:04:15.483 18:50:32 -- setup/hugepages.sh@107 -- # (( 1536 == nr_hugepages + surp + resv )) 00:04:15.483 18:50:32 -- setup/hugepages.sh@109 -- # (( 1536 == nr_hugepages )) 00:04:15.483 18:50:32 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:15.483 18:50:32 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:15.483 18:50:32 -- setup/common.sh@18 -- # local node= 00:04:15.483 18:50:32 -- setup/common.sh@19 -- # local var val 00:04:15.483 18:50:32 -- setup/common.sh@20 -- # local mem_f mem 00:04:15.483 18:50:32 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:15.483 18:50:32 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:15.483 18:50:32 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:15.483 18:50:32 -- setup/common.sh@28 -- # mapfile -t mem 00:04:15.483 18:50:32 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.483 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.484 18:50:32 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191371056 kB' 'MemFree: 170764340 kB' 'MemAvailable: 175090528 kB' 'Buffers: 3900 kB' 'Cached: 13014400 kB' 'SwapCached: 0 kB' 'Active: 9548220 kB' 'Inactive: 4095672 kB' 'Active(anon): 8451924 kB' 'Inactive(anon): 0 kB' 'Active(file): 1096296 kB' 'Inactive(file): 4095672 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 628852 kB' 'Mapped: 231636 kB' 'Shmem: 7826332 kB' 'KReclaimable: 556760 kB' 'Slab: 1517876 kB' 'SReclaimable: 556760 kB' 'SUnreclaim: 961116 kB' 'KernelStack: 20672 kB' 'PageTables: 9196 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 102501268 kB' 'Committed_AS: 9849508 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 318452 kB' 'VmallocChunk: 0 kB' 'Percpu: 103296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 3668948 kB' 'DirectMap2M: 40050688 kB' 'DirectMap1G: 159383552 kB' 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.484 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.484 18:50:32 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:15.485 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.485 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.485 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.485 18:50:32 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:15.485 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.485 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.485 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.485 18:50:32 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:15.485 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.485 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.485 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.485 18:50:32 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:15.485 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.485 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.485 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.485 18:50:32 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:15.485 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.485 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.485 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.485 18:50:32 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:15.485 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.485 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.485 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.485 18:50:32 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:15.485 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.485 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.485 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.485 18:50:32 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:15.485 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.485 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.485 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.485 18:50:32 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:15.485 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.485 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.485 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.485 18:50:32 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:15.485 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.485 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.485 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.485 18:50:32 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:15.485 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.485 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.485 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.485 18:50:32 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:15.485 18:50:32 -- setup/common.sh@33 -- # echo 1536 00:04:15.485 18:50:32 -- setup/common.sh@33 -- # return 0 00:04:15.485 18:50:32 -- setup/hugepages.sh@110 -- # (( 1536 == nr_hugepages + surp + resv )) 00:04:15.485 18:50:32 -- setup/hugepages.sh@112 -- # get_nodes 00:04:15.485 18:50:32 -- setup/hugepages.sh@27 -- # local node 00:04:15.485 18:50:32 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:15.485 18:50:32 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:15.485 18:50:32 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:15.485 18:50:32 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:15.485 18:50:32 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:15.485 18:50:32 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:15.485 18:50:32 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:15.485 18:50:32 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:15.485 18:50:32 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:15.485 18:50:32 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:15.485 18:50:32 -- setup/common.sh@18 -- # local node=0 00:04:15.485 18:50:32 -- setup/common.sh@19 -- # local var val 00:04:15.485 18:50:32 -- setup/common.sh@20 -- # local mem_f mem 00:04:15.485 18:50:32 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:15.485 18:50:32 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:15.485 18:50:32 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:15.485 18:50:32 -- setup/common.sh@28 -- # mapfile -t mem 00:04:15.485 18:50:32 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:15.485 18:50:32 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 97609576 kB' 'MemFree: 90545292 kB' 'MemUsed: 7064284 kB' 'SwapCached: 0 kB' 'Active: 3696652 kB' 'Inactive: 281892 kB' 'Active(anon): 2815976 kB' 'Inactive(anon): 0 kB' 'Active(file): 880676 kB' 'Inactive(file): 281892 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3548272 kB' 'Mapped: 132780 kB' 'AnonPages: 433372 kB' 'Shmem: 2385704 kB' 'KernelStack: 13128 kB' 'PageTables: 5976 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 361668 kB' 'Slab: 893460 kB' 'SReclaimable: 361668 kB' 'SUnreclaim: 531792 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:15.485 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.485 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.485 18:50:32 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.485 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.485 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.485 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.485 18:50:32 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.485 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.485 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.485 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.485 18:50:32 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.485 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.485 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.485 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.485 18:50:32 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.485 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.485 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.485 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.485 18:50:32 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.485 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.485 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.485 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.485 18:50:32 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.485 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.485 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.485 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.485 18:50:32 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.485 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.485 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.485 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.485 18:50:32 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.485 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.485 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.485 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.485 18:50:32 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.485 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.485 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.485 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.485 18:50:32 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.485 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.485 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.485 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.485 18:50:32 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.485 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.485 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.485 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.485 18:50:32 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.485 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.485 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.485 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.485 18:50:32 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.485 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.485 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.485 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.485 18:50:32 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.486 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.486 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.486 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.486 18:50:32 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.486 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.486 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.486 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.486 18:50:32 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.486 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.486 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.486 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.486 18:50:32 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.486 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.486 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.486 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.486 18:50:32 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.486 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.486 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.486 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.486 18:50:32 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.486 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.486 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.486 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.486 18:50:32 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.486 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.486 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.486 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.486 18:50:32 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.486 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.486 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.486 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.486 18:50:32 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.486 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.486 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.486 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.486 18:50:32 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.486 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.486 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.486 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.486 18:50:32 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.486 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.486 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.486 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.486 18:50:32 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.486 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.486 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.486 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.486 18:50:32 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.486 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.486 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.486 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.486 18:50:32 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.486 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.486 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.486 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.486 18:50:32 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.486 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.486 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.486 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.486 18:50:32 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.486 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.486 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.486 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.486 18:50:32 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.486 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.486 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.486 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.486 18:50:32 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.486 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.486 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.486 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.486 18:50:32 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.486 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.486 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.486 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.486 18:50:32 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.486 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.486 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.486 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.486 18:50:32 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.486 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.486 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.486 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.486 18:50:32 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.486 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.486 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.486 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.486 18:50:32 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.486 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.486 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.486 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.486 18:50:32 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.486 18:50:32 -- setup/common.sh@33 -- # echo 0 00:04:15.486 18:50:32 -- setup/common.sh@33 -- # return 0 00:04:15.486 18:50:32 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:15.486 18:50:32 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:15.486 18:50:32 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:15.486 18:50:32 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:15.486 18:50:32 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:15.486 18:50:32 -- setup/common.sh@18 -- # local node=1 00:04:15.486 18:50:32 -- setup/common.sh@19 -- # local var val 00:04:15.486 18:50:32 -- setup/common.sh@20 -- # local mem_f mem 00:04:15.486 18:50:32 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:15.486 18:50:32 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:15.486 18:50:32 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:15.486 18:50:32 -- setup/common.sh@28 -- # mapfile -t mem 00:04:15.486 18:50:32 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:15.486 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.486 18:50:32 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93761480 kB' 'MemFree: 80219016 kB' 'MemUsed: 13542464 kB' 'SwapCached: 0 kB' 'Active: 5851432 kB' 'Inactive: 3813780 kB' 'Active(anon): 5635812 kB' 'Inactive(anon): 0 kB' 'Active(file): 215620 kB' 'Inactive(file): 3813780 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9470060 kB' 'Mapped: 98856 kB' 'AnonPages: 195252 kB' 'Shmem: 5440660 kB' 'KernelStack: 7496 kB' 'PageTables: 3032 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 195092 kB' 'Slab: 624416 kB' 'SReclaimable: 195092 kB' 'SUnreclaim: 429324 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:15.486 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.486 18:50:32 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.486 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.486 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.486 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.486 18:50:32 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.486 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.486 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.486 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.486 18:50:32 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.486 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.486 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.486 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.486 18:50:32 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.486 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.486 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.486 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.486 18:50:32 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.486 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.486 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.486 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.486 18:50:32 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.486 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.486 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.486 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.486 18:50:32 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.486 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.486 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.486 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.486 18:50:32 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.486 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.486 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.486 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.486 18:50:32 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.486 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.486 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.486 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.486 18:50:32 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.486 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.486 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.486 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.486 18:50:32 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.486 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.487 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.487 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.487 18:50:32 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.487 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.487 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.487 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.487 18:50:32 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.487 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.487 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.487 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.487 18:50:32 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.487 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.487 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.487 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.487 18:50:32 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.487 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.487 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.487 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.487 18:50:32 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.487 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.487 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.487 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.487 18:50:32 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.487 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.487 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.487 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.487 18:50:32 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.487 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.487 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.487 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.487 18:50:32 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.487 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.487 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.487 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.487 18:50:32 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.487 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.487 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.487 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.487 18:50:32 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.487 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.487 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.487 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.487 18:50:32 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.487 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.487 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.487 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.487 18:50:32 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.487 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.487 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.487 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.487 18:50:32 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.487 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.487 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.487 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.487 18:50:32 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.487 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.487 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.487 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.487 18:50:32 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.487 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.487 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.487 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.487 18:50:32 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.487 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.487 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.487 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.487 18:50:32 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.487 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.487 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.487 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.487 18:50:32 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.487 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.487 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.487 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.487 18:50:32 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.487 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.487 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.487 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.487 18:50:32 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.487 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.487 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.487 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.487 18:50:32 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.487 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.487 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.487 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.487 18:50:32 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.487 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.487 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.487 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.487 18:50:32 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.487 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.487 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.487 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.487 18:50:32 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.487 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.487 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.487 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.487 18:50:32 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.487 18:50:32 -- setup/common.sh@32 -- # continue 00:04:15.487 18:50:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:15.487 18:50:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:15.487 18:50:32 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:15.487 18:50:32 -- setup/common.sh@33 -- # echo 0 00:04:15.487 18:50:32 -- setup/common.sh@33 -- # return 0 00:04:15.487 18:50:32 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:15.487 18:50:32 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:15.487 18:50:32 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:15.487 18:50:32 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:15.487 18:50:32 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:04:15.487 node0=512 expecting 512 00:04:15.487 18:50:32 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:15.487 18:50:32 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:15.487 18:50:32 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:15.487 18:50:32 -- setup/hugepages.sh@128 -- # echo 'node1=1024 expecting 1024' 00:04:15.487 node1=1024 expecting 1024 00:04:15.487 18:50:32 -- setup/hugepages.sh@130 -- # [[ 512,1024 == \5\1\2\,\1\0\2\4 ]] 00:04:15.487 00:04:15.487 real 0m3.073s 00:04:15.487 user 0m1.222s 00:04:15.487 sys 0m1.907s 00:04:15.487 18:50:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:15.487 18:50:32 -- common/autotest_common.sh@10 -- # set +x 00:04:15.487 ************************************ 00:04:15.487 END TEST custom_alloc 00:04:15.487 ************************************ 00:04:15.487 18:50:32 -- setup/hugepages.sh@215 -- # run_test no_shrink_alloc no_shrink_alloc 00:04:15.487 18:50:32 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:15.487 18:50:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:15.487 18:50:32 -- common/autotest_common.sh@10 -- # set +x 00:04:15.487 ************************************ 00:04:15.487 START TEST no_shrink_alloc 00:04:15.487 ************************************ 00:04:15.487 18:50:32 -- common/autotest_common.sh@1114 -- # no_shrink_alloc 00:04:15.487 18:50:32 -- setup/hugepages.sh@195 -- # get_test_nr_hugepages 2097152 0 00:04:15.487 18:50:32 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:15.487 18:50:32 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:04:15.487 18:50:32 -- setup/hugepages.sh@51 -- # shift 00:04:15.487 18:50:32 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:04:15.487 18:50:32 -- setup/hugepages.sh@52 -- # local node_ids 00:04:15.487 18:50:32 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:15.487 18:50:32 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:15.487 18:50:32 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:04:15.487 18:50:32 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:04:15.487 18:50:32 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:15.487 18:50:32 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:15.487 18:50:32 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:15.487 18:50:32 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:15.487 18:50:32 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:15.487 18:50:32 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:04:15.487 18:50:32 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:15.487 18:50:32 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:04:15.487 18:50:32 -- setup/hugepages.sh@73 -- # return 0 00:04:15.487 18:50:32 -- setup/hugepages.sh@198 -- # setup output 00:04:15.487 18:50:32 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:15.487 18:50:32 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:18.771 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:04:18.771 0000:5e:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:18.771 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:04:18.771 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:04:18.771 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:04:18.771 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:04:18.771 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:04:18.771 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:04:18.771 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:04:18.771 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:04:18.772 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:04:18.772 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:04:18.772 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:04:18.772 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:04:18.772 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:04:18.772 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:04:18.772 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:04:18.772 18:50:35 -- setup/hugepages.sh@199 -- # verify_nr_hugepages 00:04:18.772 18:50:35 -- setup/hugepages.sh@89 -- # local node 00:04:18.772 18:50:35 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:18.772 18:50:35 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:18.772 18:50:35 -- setup/hugepages.sh@92 -- # local surp 00:04:18.772 18:50:35 -- setup/hugepages.sh@93 -- # local resv 00:04:18.772 18:50:35 -- setup/hugepages.sh@94 -- # local anon 00:04:18.772 18:50:35 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:18.772 18:50:35 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:18.772 18:50:35 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:18.772 18:50:35 -- setup/common.sh@18 -- # local node= 00:04:18.772 18:50:35 -- setup/common.sh@19 -- # local var val 00:04:18.772 18:50:35 -- setup/common.sh@20 -- # local mem_f mem 00:04:18.772 18:50:35 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:18.772 18:50:35 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:18.772 18:50:35 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:18.772 18:50:35 -- setup/common.sh@28 -- # mapfile -t mem 00:04:18.772 18:50:35 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:18.772 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.772 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.772 18:50:35 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191371056 kB' 'MemFree: 171784416 kB' 'MemAvailable: 176110604 kB' 'Buffers: 3900 kB' 'Cached: 13014492 kB' 'SwapCached: 0 kB' 'Active: 9550552 kB' 'Inactive: 4095672 kB' 'Active(anon): 8454256 kB' 'Inactive(anon): 0 kB' 'Active(file): 1096296 kB' 'Inactive(file): 4095672 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 630688 kB' 'Mapped: 231724 kB' 'Shmem: 7826424 kB' 'KReclaimable: 556760 kB' 'Slab: 1517844 kB' 'SReclaimable: 556760 kB' 'SUnreclaim: 961084 kB' 'KernelStack: 20736 kB' 'PageTables: 9408 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103025556 kB' 'Committed_AS: 9842468 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 318484 kB' 'VmallocChunk: 0 kB' 'Percpu: 103296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 3668948 kB' 'DirectMap2M: 40050688 kB' 'DirectMap1G: 159383552 kB' 00:04:18.772 18:50:35 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.772 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.772 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.772 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.772 18:50:35 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.772 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.772 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.772 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.772 18:50:35 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.772 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.772 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.772 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.772 18:50:35 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.772 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.772 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.772 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.772 18:50:35 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.772 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.772 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.772 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.772 18:50:35 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.772 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.772 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.772 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.772 18:50:35 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.772 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.772 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.772 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.772 18:50:35 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.772 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.772 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.772 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.772 18:50:35 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.772 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.772 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.772 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.772 18:50:35 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.772 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.772 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.772 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.772 18:50:35 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.772 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.772 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.772 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.772 18:50:35 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.772 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.772 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.772 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.772 18:50:35 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.772 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.772 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.772 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.772 18:50:35 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.772 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.772 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.772 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.772 18:50:35 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.772 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.772 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.772 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.772 18:50:35 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.772 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.772 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.772 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.772 18:50:35 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.772 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.772 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.772 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.772 18:50:35 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.772 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.772 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.772 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.772 18:50:35 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.772 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.772 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.772 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.772 18:50:35 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.772 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.772 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.772 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.772 18:50:35 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.772 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.772 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.772 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.772 18:50:35 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.772 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.772 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.772 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.772 18:50:35 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.772 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.772 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.772 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.772 18:50:35 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.772 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.772 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.772 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.772 18:50:35 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.772 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.772 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.772 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.772 18:50:35 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.772 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.772 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.772 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.772 18:50:35 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.772 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.772 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.772 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.772 18:50:35 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.772 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.772 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.772 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.772 18:50:35 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.772 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.772 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.772 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.773 18:50:35 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.773 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.773 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.773 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.773 18:50:35 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.773 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.773 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.773 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.773 18:50:35 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.773 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.773 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.773 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.773 18:50:35 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.773 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.773 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.773 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.773 18:50:35 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.773 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.773 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.773 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.773 18:50:35 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.773 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.773 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.773 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.773 18:50:35 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.773 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.773 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.773 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.773 18:50:35 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.773 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.773 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.773 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.773 18:50:35 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.773 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.773 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.773 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.773 18:50:35 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.773 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.773 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.773 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.773 18:50:35 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.773 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.773 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.773 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.773 18:50:35 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.773 18:50:35 -- setup/common.sh@33 -- # echo 0 00:04:18.773 18:50:35 -- setup/common.sh@33 -- # return 0 00:04:18.773 18:50:35 -- setup/hugepages.sh@97 -- # anon=0 00:04:18.773 18:50:35 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:18.773 18:50:35 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:18.773 18:50:35 -- setup/common.sh@18 -- # local node= 00:04:18.773 18:50:35 -- setup/common.sh@19 -- # local var val 00:04:18.773 18:50:35 -- setup/common.sh@20 -- # local mem_f mem 00:04:18.773 18:50:35 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:18.773 18:50:35 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:18.773 18:50:35 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:18.773 18:50:35 -- setup/common.sh@28 -- # mapfile -t mem 00:04:18.773 18:50:35 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:18.773 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.773 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.773 18:50:35 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191371056 kB' 'MemFree: 171786876 kB' 'MemAvailable: 176113064 kB' 'Buffers: 3900 kB' 'Cached: 13014496 kB' 'SwapCached: 0 kB' 'Active: 9550004 kB' 'Inactive: 4095672 kB' 'Active(anon): 8453708 kB' 'Inactive(anon): 0 kB' 'Active(file): 1096296 kB' 'Inactive(file): 4095672 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 630284 kB' 'Mapped: 231720 kB' 'Shmem: 7826428 kB' 'KReclaimable: 556760 kB' 'Slab: 1517828 kB' 'SReclaimable: 556760 kB' 'SUnreclaim: 961068 kB' 'KernelStack: 20784 kB' 'PageTables: 9192 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103025556 kB' 'Committed_AS: 9841332 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 318436 kB' 'VmallocChunk: 0 kB' 'Percpu: 103296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 3668948 kB' 'DirectMap2M: 40050688 kB' 'DirectMap1G: 159383552 kB' 00:04:18.773 18:50:35 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.773 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.773 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.773 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.773 18:50:35 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.773 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.773 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.773 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.773 18:50:35 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.773 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.773 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.773 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.773 18:50:35 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.773 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.773 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.773 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.773 18:50:35 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.773 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.773 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.773 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.773 18:50:35 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.773 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.773 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.773 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.773 18:50:35 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.773 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.773 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.773 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.773 18:50:35 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.773 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.773 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.773 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.773 18:50:35 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.773 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.773 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.773 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.773 18:50:35 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.773 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.773 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.773 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.773 18:50:35 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.773 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.773 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.773 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.773 18:50:35 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.773 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.773 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.773 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.773 18:50:35 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.773 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.773 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.773 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.773 18:50:35 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.773 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.773 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.773 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.773 18:50:35 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.773 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.773 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.773 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.773 18:50:35 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.773 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.773 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.773 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.773 18:50:35 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.773 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.773 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.773 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.773 18:50:35 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.773 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.773 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.773 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.773 18:50:35 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.773 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.773 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.773 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.773 18:50:35 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.773 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.773 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.773 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.773 18:50:35 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.773 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.773 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.773 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.773 18:50:35 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.773 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.774 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.774 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.774 18:50:35 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.774 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.774 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.774 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.774 18:50:35 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.774 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.774 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.774 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.774 18:50:35 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.774 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.774 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.774 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.774 18:50:35 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.774 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.774 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.774 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.774 18:50:35 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.774 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.774 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.774 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.774 18:50:35 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.774 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.774 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.774 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.774 18:50:35 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.774 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.774 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.774 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.774 18:50:35 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.774 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.774 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.774 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.774 18:50:35 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.774 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.774 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.774 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.774 18:50:35 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.774 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.774 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.774 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.774 18:50:35 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.774 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.774 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.774 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.774 18:50:35 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.774 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.774 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.774 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.774 18:50:35 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.774 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.774 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.774 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.774 18:50:35 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.774 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.774 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.774 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.774 18:50:35 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.774 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.774 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.774 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.774 18:50:35 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.774 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.774 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.774 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.774 18:50:35 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.774 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.774 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.774 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.774 18:50:35 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.774 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.774 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.774 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.774 18:50:35 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.774 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.774 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.774 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.774 18:50:35 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.774 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.774 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.774 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.774 18:50:35 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.774 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.774 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.774 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.774 18:50:35 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.774 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.774 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.774 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.774 18:50:35 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.774 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.774 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.774 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.774 18:50:35 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.774 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.774 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.774 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.774 18:50:35 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.774 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.774 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.774 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.774 18:50:35 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.774 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.774 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.774 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.774 18:50:35 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.774 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.774 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.774 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.774 18:50:35 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.774 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.774 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.774 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.774 18:50:35 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.774 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.774 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.774 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.774 18:50:35 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.774 18:50:35 -- setup/common.sh@33 -- # echo 0 00:04:18.774 18:50:35 -- setup/common.sh@33 -- # return 0 00:04:18.774 18:50:35 -- setup/hugepages.sh@99 -- # surp=0 00:04:18.774 18:50:35 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:18.774 18:50:35 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:18.774 18:50:35 -- setup/common.sh@18 -- # local node= 00:04:18.774 18:50:35 -- setup/common.sh@19 -- # local var val 00:04:18.774 18:50:35 -- setup/common.sh@20 -- # local mem_f mem 00:04:18.774 18:50:35 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:18.774 18:50:35 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:18.774 18:50:35 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:18.774 18:50:35 -- setup/common.sh@28 -- # mapfile -t mem 00:04:18.774 18:50:35 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:18.774 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.774 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.774 18:50:35 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191371056 kB' 'MemFree: 171786472 kB' 'MemAvailable: 176112660 kB' 'Buffers: 3900 kB' 'Cached: 13014508 kB' 'SwapCached: 0 kB' 'Active: 9549588 kB' 'Inactive: 4095672 kB' 'Active(anon): 8453292 kB' 'Inactive(anon): 0 kB' 'Active(file): 1096296 kB' 'Inactive(file): 4095672 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 630180 kB' 'Mapped: 231644 kB' 'Shmem: 7826440 kB' 'KReclaimable: 556760 kB' 'Slab: 1517828 kB' 'SReclaimable: 556760 kB' 'SUnreclaim: 961068 kB' 'KernelStack: 20896 kB' 'PageTables: 9864 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103025556 kB' 'Committed_AS: 9841348 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 318612 kB' 'VmallocChunk: 0 kB' 'Percpu: 103296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 3668948 kB' 'DirectMap2M: 40050688 kB' 'DirectMap1G: 159383552 kB' 00:04:18.774 18:50:35 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.774 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.774 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.774 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.774 18:50:35 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.774 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.774 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.774 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.774 18:50:35 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.774 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.775 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.775 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.776 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.776 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.776 18:50:35 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.776 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.776 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.776 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.776 18:50:35 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.776 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.776 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.776 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.776 18:50:35 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.776 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.776 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.776 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.776 18:50:35 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.776 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.776 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.776 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.776 18:50:35 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.776 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.776 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.776 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.776 18:50:35 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.776 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.776 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.776 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.776 18:50:35 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.776 18:50:35 -- setup/common.sh@33 -- # echo 0 00:04:18.776 18:50:35 -- setup/common.sh@33 -- # return 0 00:04:18.776 18:50:35 -- setup/hugepages.sh@100 -- # resv=0 00:04:18.776 18:50:35 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:18.776 nr_hugepages=1024 00:04:18.776 18:50:35 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:18.776 resv_hugepages=0 00:04:18.776 18:50:35 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:18.776 surplus_hugepages=0 00:04:18.776 18:50:35 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:18.776 anon_hugepages=0 00:04:18.776 18:50:35 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:18.776 18:50:35 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:18.776 18:50:35 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:18.776 18:50:35 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:18.776 18:50:35 -- setup/common.sh@18 -- # local node= 00:04:18.776 18:50:35 -- setup/common.sh@19 -- # local var val 00:04:18.776 18:50:35 -- setup/common.sh@20 -- # local mem_f mem 00:04:18.776 18:50:35 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:18.776 18:50:35 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:18.776 18:50:35 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:18.776 18:50:35 -- setup/common.sh@28 -- # mapfile -t mem 00:04:18.776 18:50:35 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:18.776 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.776 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.776 18:50:35 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191371056 kB' 'MemFree: 171787348 kB' 'MemAvailable: 176113536 kB' 'Buffers: 3900 kB' 'Cached: 13014520 kB' 'SwapCached: 0 kB' 'Active: 9549876 kB' 'Inactive: 4095672 kB' 'Active(anon): 8453580 kB' 'Inactive(anon): 0 kB' 'Active(file): 1096296 kB' 'Inactive(file): 4095672 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 630388 kB' 'Mapped: 231644 kB' 'Shmem: 7826452 kB' 'KReclaimable: 556760 kB' 'Slab: 1517828 kB' 'SReclaimable: 556760 kB' 'SUnreclaim: 961068 kB' 'KernelStack: 20832 kB' 'PageTables: 9912 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103025556 kB' 'Committed_AS: 9841364 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 318628 kB' 'VmallocChunk: 0 kB' 'Percpu: 103296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 3668948 kB' 'DirectMap2M: 40050688 kB' 'DirectMap1G: 159383552 kB' 00:04:18.776 18:50:35 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.776 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.776 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.776 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.776 18:50:35 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.776 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.776 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.776 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.776 18:50:35 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.776 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.776 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.776 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.776 18:50:35 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.776 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.776 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.776 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.776 18:50:35 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.776 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.776 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.776 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.776 18:50:35 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.776 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.776 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.776 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.776 18:50:35 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.776 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.776 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.776 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.776 18:50:35 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.776 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.776 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.776 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.776 18:50:35 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.776 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.776 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.776 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.776 18:50:35 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.776 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.776 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.776 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.776 18:50:35 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.776 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.776 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.776 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.776 18:50:35 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.776 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.776 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.776 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.776 18:50:35 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.776 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.776 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.776 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.776 18:50:35 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.776 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.776 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.776 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.776 18:50:35 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.776 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.776 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.776 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.776 18:50:35 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.776 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.776 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.776 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.776 18:50:35 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.776 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.776 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.776 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.776 18:50:35 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.777 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.777 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.777 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.777 18:50:35 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.777 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.777 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.777 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.777 18:50:35 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.777 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.777 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.777 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.777 18:50:35 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.777 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.777 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.777 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.777 18:50:35 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.777 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.777 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.777 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.777 18:50:35 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.777 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.777 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.777 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.777 18:50:35 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.777 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.777 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.777 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.777 18:50:35 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.777 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.777 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.777 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.777 18:50:35 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.777 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.777 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.777 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.777 18:50:35 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.777 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.777 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.777 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.777 18:50:35 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.777 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.777 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.777 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.777 18:50:35 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.777 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.777 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.777 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.777 18:50:35 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.777 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.777 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.777 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.777 18:50:35 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.777 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.777 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.777 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.777 18:50:35 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.777 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.777 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.777 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.777 18:50:35 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.777 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.777 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.777 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.777 18:50:35 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.777 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.777 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.777 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.777 18:50:35 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.777 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.777 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.777 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.777 18:50:35 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.777 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.777 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.777 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.777 18:50:35 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.777 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.777 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.777 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.777 18:50:35 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.777 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.777 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.777 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.777 18:50:35 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.777 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.777 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.777 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.777 18:50:35 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.777 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.777 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.777 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.777 18:50:35 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.777 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.777 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.777 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.777 18:50:35 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.777 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.777 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.777 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.777 18:50:35 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.777 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.777 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.777 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.777 18:50:35 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.777 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.777 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.777 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.777 18:50:35 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.777 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.777 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.777 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.777 18:50:35 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.777 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.777 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.777 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.777 18:50:35 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.777 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.777 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.777 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.777 18:50:35 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.777 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.777 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.777 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.777 18:50:35 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.777 18:50:35 -- setup/common.sh@33 -- # echo 1024 00:04:18.777 18:50:35 -- setup/common.sh@33 -- # return 0 00:04:18.777 18:50:35 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:18.777 18:50:35 -- setup/hugepages.sh@112 -- # get_nodes 00:04:18.777 18:50:35 -- setup/hugepages.sh@27 -- # local node 00:04:18.777 18:50:35 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:18.777 18:50:35 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:18.777 18:50:35 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:18.777 18:50:35 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:18.777 18:50:35 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:18.777 18:50:35 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:18.777 18:50:35 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:18.777 18:50:35 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:18.777 18:50:35 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:18.777 18:50:35 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:18.777 18:50:35 -- setup/common.sh@18 -- # local node=0 00:04:18.777 18:50:35 -- setup/common.sh@19 -- # local var val 00:04:18.777 18:50:35 -- setup/common.sh@20 -- # local mem_f mem 00:04:18.777 18:50:35 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:18.777 18:50:35 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:18.777 18:50:35 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:18.777 18:50:35 -- setup/common.sh@28 -- # mapfile -t mem 00:04:18.777 18:50:35 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:18.777 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.777 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.777 18:50:35 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 97609576 kB' 'MemFree: 89487780 kB' 'MemUsed: 8121796 kB' 'SwapCached: 0 kB' 'Active: 3698820 kB' 'Inactive: 281892 kB' 'Active(anon): 2818144 kB' 'Inactive(anon): 0 kB' 'Active(file): 880676 kB' 'Inactive(file): 281892 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3548308 kB' 'Mapped: 132788 kB' 'AnonPages: 435592 kB' 'Shmem: 2385740 kB' 'KernelStack: 13432 kB' 'PageTables: 6900 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 361668 kB' 'Slab: 893528 kB' 'SReclaimable: 361668 kB' 'SUnreclaim: 531860 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # continue 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.778 18:50:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.778 18:50:35 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.778 18:50:35 -- setup/common.sh@33 -- # echo 0 00:04:18.778 18:50:35 -- setup/common.sh@33 -- # return 0 00:04:18.778 18:50:35 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:18.778 18:50:35 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:18.778 18:50:35 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:18.778 18:50:35 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:18.778 18:50:35 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:04:18.778 node0=1024 expecting 1024 00:04:18.778 18:50:35 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:04:18.778 18:50:35 -- setup/hugepages.sh@202 -- # CLEAR_HUGE=no 00:04:18.778 18:50:35 -- setup/hugepages.sh@202 -- # NRHUGE=512 00:04:18.778 18:50:35 -- setup/hugepages.sh@202 -- # setup output 00:04:18.778 18:50:35 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:18.778 18:50:35 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:21.309 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:04:21.309 0000:5e:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:21.309 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:04:21.309 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:04:21.309 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:04:21.309 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:04:21.309 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:04:21.309 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:04:21.309 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:04:21.309 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:04:21.309 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:04:21.309 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:04:21.309 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:04:21.309 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:04:21.309 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:04:21.309 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:04:21.309 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:04:21.571 INFO: Requested 512 hugepages but 1024 already allocated on node0 00:04:21.571 18:50:38 -- setup/hugepages.sh@204 -- # verify_nr_hugepages 00:04:21.571 18:50:38 -- setup/hugepages.sh@89 -- # local node 00:04:21.571 18:50:38 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:21.571 18:50:38 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:21.571 18:50:38 -- setup/hugepages.sh@92 -- # local surp 00:04:21.571 18:50:38 -- setup/hugepages.sh@93 -- # local resv 00:04:21.571 18:50:38 -- setup/hugepages.sh@94 -- # local anon 00:04:21.571 18:50:38 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:21.571 18:50:38 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:21.571 18:50:38 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:21.571 18:50:38 -- setup/common.sh@18 -- # local node= 00:04:21.571 18:50:38 -- setup/common.sh@19 -- # local var val 00:04:21.571 18:50:38 -- setup/common.sh@20 -- # local mem_f mem 00:04:21.571 18:50:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:21.571 18:50:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:21.571 18:50:38 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:21.571 18:50:38 -- setup/common.sh@28 -- # mapfile -t mem 00:04:21.571 18:50:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:21.571 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.571 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.571 18:50:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191371056 kB' 'MemFree: 171770396 kB' 'MemAvailable: 176096584 kB' 'Buffers: 3900 kB' 'Cached: 13014608 kB' 'SwapCached: 0 kB' 'Active: 9550648 kB' 'Inactive: 4095672 kB' 'Active(anon): 8454352 kB' 'Inactive(anon): 0 kB' 'Active(file): 1096296 kB' 'Inactive(file): 4095672 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 631024 kB' 'Mapped: 231732 kB' 'Shmem: 7826540 kB' 'KReclaimable: 556760 kB' 'Slab: 1517852 kB' 'SReclaimable: 556760 kB' 'SUnreclaim: 961092 kB' 'KernelStack: 20976 kB' 'PageTables: 9868 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103025556 kB' 'Committed_AS: 9843340 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 318724 kB' 'VmallocChunk: 0 kB' 'Percpu: 103296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 3668948 kB' 'DirectMap2M: 40050688 kB' 'DirectMap1G: 159383552 kB' 00:04:21.571 18:50:38 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.571 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.571 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.571 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.571 18:50:38 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.571 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.571 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.571 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.571 18:50:38 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.571 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.571 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.571 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.571 18:50:38 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.571 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.571 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.571 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.571 18:50:38 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.571 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.571 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.571 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.571 18:50:38 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.571 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.571 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.571 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.571 18:50:38 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.571 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.571 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.571 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.571 18:50:38 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.571 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.571 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.571 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.571 18:50:38 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.571 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.571 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.571 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.571 18:50:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.571 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.571 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.571 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.571 18:50:38 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.571 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.571 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.571 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.571 18:50:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.571 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.571 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.571 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.571 18:50:38 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.571 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.571 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.571 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.571 18:50:38 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.571 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.571 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.571 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.571 18:50:38 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.571 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.571 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.571 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.571 18:50:38 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.571 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.571 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.571 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.571 18:50:38 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.571 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.571 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.571 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.571 18:50:38 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.571 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.571 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.571 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.571 18:50:38 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.571 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.571 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.571 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.571 18:50:38 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.571 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.571 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.571 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.571 18:50:38 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.571 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.571 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.571 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.571 18:50:38 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.571 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.571 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.572 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.572 18:50:38 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.572 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.572 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.572 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.572 18:50:38 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.572 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.572 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.572 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.572 18:50:38 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.572 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.572 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.572 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.572 18:50:38 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.572 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.572 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.572 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.572 18:50:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.572 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.572 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.572 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.572 18:50:38 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.572 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.572 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.572 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.572 18:50:38 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.572 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.572 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.572 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.572 18:50:38 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.572 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.572 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.572 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.572 18:50:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.572 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.572 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.572 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.572 18:50:38 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.572 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.572 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.572 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.572 18:50:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.572 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.572 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.572 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.572 18:50:38 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.572 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.572 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.572 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.572 18:50:38 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.572 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.572 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.572 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.572 18:50:38 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.572 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.572 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.572 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.572 18:50:38 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.572 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.572 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.572 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.572 18:50:38 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.572 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.572 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.572 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.572 18:50:38 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.572 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.572 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.572 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.572 18:50:38 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.572 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.572 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.572 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.572 18:50:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.572 18:50:38 -- setup/common.sh@33 -- # echo 0 00:04:21.572 18:50:38 -- setup/common.sh@33 -- # return 0 00:04:21.572 18:50:38 -- setup/hugepages.sh@97 -- # anon=0 00:04:21.572 18:50:38 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:21.572 18:50:38 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:21.572 18:50:38 -- setup/common.sh@18 -- # local node= 00:04:21.572 18:50:38 -- setup/common.sh@19 -- # local var val 00:04:21.572 18:50:38 -- setup/common.sh@20 -- # local mem_f mem 00:04:21.572 18:50:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:21.572 18:50:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:21.572 18:50:38 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:21.572 18:50:38 -- setup/common.sh@28 -- # mapfile -t mem 00:04:21.572 18:50:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:21.572 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.572 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.572 18:50:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191371056 kB' 'MemFree: 171773560 kB' 'MemAvailable: 176099748 kB' 'Buffers: 3900 kB' 'Cached: 13014612 kB' 'SwapCached: 0 kB' 'Active: 9552080 kB' 'Inactive: 4095672 kB' 'Active(anon): 8455784 kB' 'Inactive(anon): 0 kB' 'Active(file): 1096296 kB' 'Inactive(file): 4095672 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 632496 kB' 'Mapped: 232232 kB' 'Shmem: 7826544 kB' 'KReclaimable: 556760 kB' 'Slab: 1517980 kB' 'SReclaimable: 556760 kB' 'SUnreclaim: 961220 kB' 'KernelStack: 21104 kB' 'PageTables: 10556 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103025556 kB' 'Committed_AS: 9845368 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 318660 kB' 'VmallocChunk: 0 kB' 'Percpu: 103296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 3668948 kB' 'DirectMap2M: 40050688 kB' 'DirectMap1G: 159383552 kB' 00:04:21.572 18:50:38 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.572 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.572 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.572 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.572 18:50:38 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.572 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.572 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.572 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.572 18:50:38 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.572 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.572 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.572 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.572 18:50:38 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.572 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.572 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.572 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.572 18:50:38 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.572 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.572 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.573 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.573 18:50:38 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.573 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.573 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.573 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.573 18:50:38 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.573 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.573 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.573 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.573 18:50:38 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.573 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.573 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.573 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.573 18:50:38 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.573 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.573 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.573 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.573 18:50:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.573 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.573 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.573 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.573 18:50:38 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.573 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.573 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.573 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.573 18:50:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.573 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.573 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.573 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.573 18:50:38 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.573 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.573 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.573 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.573 18:50:38 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.573 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.573 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.573 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.573 18:50:38 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.573 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.573 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.573 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.573 18:50:38 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.573 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.573 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.573 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.573 18:50:38 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.573 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.573 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.573 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.573 18:50:38 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.573 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.573 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.573 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.573 18:50:38 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.573 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.573 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.573 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.573 18:50:38 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.573 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.573 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.573 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.573 18:50:38 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.573 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.573 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.573 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.573 18:50:38 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.573 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.573 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.573 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.573 18:50:38 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.573 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.573 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.573 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.573 18:50:38 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.573 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.573 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.573 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.573 18:50:38 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.573 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.573 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.573 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.573 18:50:38 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.573 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.573 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.573 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.573 18:50:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.573 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.573 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.573 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.573 18:50:38 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.573 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.573 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.573 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.573 18:50:38 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.573 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.573 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.573 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.573 18:50:38 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.573 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.573 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.573 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.573 18:50:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.573 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.573 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.573 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.573 18:50:38 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.573 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.573 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.573 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.573 18:50:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.573 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.573 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.573 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.573 18:50:38 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.573 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.573 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.573 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.573 18:50:38 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.573 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.573 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.573 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.573 18:50:38 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.574 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.574 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.574 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.574 18:50:38 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.574 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.574 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.574 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.574 18:50:38 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.574 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.574 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.574 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.574 18:50:38 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.574 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.574 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.574 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.574 18:50:38 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.574 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.574 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.574 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.574 18:50:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.574 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.574 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.574 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.574 18:50:38 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.574 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.574 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.574 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.574 18:50:38 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.574 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.574 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.574 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.574 18:50:38 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.574 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.574 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.574 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.574 18:50:38 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.574 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.574 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.574 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.574 18:50:38 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.574 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.574 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.574 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.574 18:50:38 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.574 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.574 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.574 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.574 18:50:38 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.574 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.574 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.574 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.574 18:50:38 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.574 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.574 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.574 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.574 18:50:38 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.574 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.574 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.574 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.574 18:50:38 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.574 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.574 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.574 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.574 18:50:38 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.574 18:50:38 -- setup/common.sh@33 -- # echo 0 00:04:21.574 18:50:38 -- setup/common.sh@33 -- # return 0 00:04:21.574 18:50:38 -- setup/hugepages.sh@99 -- # surp=0 00:04:21.574 18:50:38 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:21.574 18:50:38 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:21.574 18:50:38 -- setup/common.sh@18 -- # local node= 00:04:21.574 18:50:38 -- setup/common.sh@19 -- # local var val 00:04:21.574 18:50:38 -- setup/common.sh@20 -- # local mem_f mem 00:04:21.574 18:50:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:21.574 18:50:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:21.574 18:50:38 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:21.574 18:50:38 -- setup/common.sh@28 -- # mapfile -t mem 00:04:21.574 18:50:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:21.574 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.574 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.574 18:50:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191371056 kB' 'MemFree: 171769760 kB' 'MemAvailable: 176095948 kB' 'Buffers: 3900 kB' 'Cached: 13014624 kB' 'SwapCached: 0 kB' 'Active: 9557016 kB' 'Inactive: 4095672 kB' 'Active(anon): 8460720 kB' 'Inactive(anon): 0 kB' 'Active(file): 1096296 kB' 'Inactive(file): 4095672 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 637456 kB' 'Mapped: 232172 kB' 'Shmem: 7826556 kB' 'KReclaimable: 556760 kB' 'Slab: 1518044 kB' 'SReclaimable: 556760 kB' 'SUnreclaim: 961284 kB' 'KernelStack: 21600 kB' 'PageTables: 12152 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103025556 kB' 'Committed_AS: 9849324 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 318808 kB' 'VmallocChunk: 0 kB' 'Percpu: 103296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 3668948 kB' 'DirectMap2M: 40050688 kB' 'DirectMap1G: 159383552 kB' 00:04:21.574 18:50:38 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.574 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.574 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.574 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.574 18:50:38 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.574 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.574 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.574 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.574 18:50:38 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.574 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.574 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.574 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.574 18:50:38 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.574 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.574 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.574 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.574 18:50:38 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.574 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.574 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.574 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.574 18:50:38 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.574 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.574 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.574 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.574 18:50:38 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.575 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.575 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.575 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.575 18:50:38 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.575 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.575 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.575 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.575 18:50:38 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.575 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.575 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.575 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.575 18:50:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.575 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.575 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.575 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.575 18:50:38 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.575 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.575 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.575 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.575 18:50:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.575 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.575 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.575 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.575 18:50:38 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.575 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.575 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.575 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.575 18:50:38 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.575 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.575 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.575 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.575 18:50:38 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.575 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.575 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.575 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.575 18:50:38 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.575 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.575 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.575 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.575 18:50:38 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.575 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.575 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.575 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.575 18:50:38 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.575 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.575 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.575 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.575 18:50:38 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.575 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.575 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.575 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.575 18:50:38 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.575 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.575 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.575 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.575 18:50:38 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.575 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.575 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.575 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.575 18:50:38 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.575 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.575 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.575 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.575 18:50:38 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.575 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.575 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.575 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.575 18:50:38 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.575 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.575 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.575 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.575 18:50:38 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.575 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.575 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.575 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.575 18:50:38 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.575 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.575 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.575 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.575 18:50:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.575 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.575 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.575 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.575 18:50:38 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.575 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.575 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.575 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.575 18:50:38 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.575 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.575 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.575 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.575 18:50:38 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.575 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.575 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.575 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.575 18:50:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.575 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.575 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.575 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.575 18:50:38 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.575 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.575 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.575 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.575 18:50:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.575 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.575 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.575 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.575 18:50:38 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.575 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.575 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.575 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.575 18:50:38 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.575 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.575 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.575 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.575 18:50:38 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.575 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.575 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.575 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.575 18:50:38 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.575 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.575 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.576 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.576 18:50:38 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.576 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.576 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.576 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.576 18:50:38 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.576 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.576 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.576 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.576 18:50:38 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.576 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.576 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.576 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.576 18:50:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.576 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.576 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.576 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.576 18:50:38 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.576 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.576 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.576 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.576 18:50:38 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.576 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.576 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.576 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.576 18:50:38 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.576 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.576 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.576 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.576 18:50:38 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.576 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.576 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.576 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.576 18:50:38 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.576 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.576 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.576 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.576 18:50:38 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.576 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.576 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.576 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.576 18:50:38 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.576 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.576 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.576 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.576 18:50:38 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.576 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.576 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.576 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.576 18:50:38 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.576 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.576 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.576 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.576 18:50:38 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.576 18:50:38 -- setup/common.sh@33 -- # echo 0 00:04:21.576 18:50:38 -- setup/common.sh@33 -- # return 0 00:04:21.576 18:50:38 -- setup/hugepages.sh@100 -- # resv=0 00:04:21.576 18:50:38 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:21.576 nr_hugepages=1024 00:04:21.576 18:50:38 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:21.576 resv_hugepages=0 00:04:21.576 18:50:38 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:21.576 surplus_hugepages=0 00:04:21.576 18:50:38 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:21.576 anon_hugepages=0 00:04:21.576 18:50:38 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:21.576 18:50:38 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:21.576 18:50:38 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:21.576 18:50:38 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:21.576 18:50:38 -- setup/common.sh@18 -- # local node= 00:04:21.576 18:50:38 -- setup/common.sh@19 -- # local var val 00:04:21.576 18:50:38 -- setup/common.sh@20 -- # local mem_f mem 00:04:21.576 18:50:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:21.576 18:50:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:21.576 18:50:38 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:21.576 18:50:38 -- setup/common.sh@28 -- # mapfile -t mem 00:04:21.576 18:50:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:21.576 18:50:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191371056 kB' 'MemFree: 171771108 kB' 'MemAvailable: 176097296 kB' 'Buffers: 3900 kB' 'Cached: 13014636 kB' 'SwapCached: 0 kB' 'Active: 9551112 kB' 'Inactive: 4095672 kB' 'Active(anon): 8454816 kB' 'Inactive(anon): 0 kB' 'Active(file): 1096296 kB' 'Inactive(file): 4095672 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 631508 kB' 'Mapped: 231652 kB' 'Shmem: 7826568 kB' 'KReclaimable: 556760 kB' 'Slab: 1517980 kB' 'SReclaimable: 556760 kB' 'SUnreclaim: 961220 kB' 'KernelStack: 20960 kB' 'PageTables: 10236 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103025556 kB' 'Committed_AS: 9838836 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 318484 kB' 'VmallocChunk: 0 kB' 'Percpu: 103296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 3668948 kB' 'DirectMap2M: 40050688 kB' 'DirectMap1G: 159383552 kB' 00:04:21.576 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.576 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.576 18:50:38 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.576 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.576 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.576 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.576 18:50:38 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.576 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.576 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.576 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.576 18:50:38 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.576 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.576 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.576 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.576 18:50:38 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.576 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.576 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.576 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.576 18:50:38 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.576 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.576 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.576 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.576 18:50:38 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.577 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.577 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.577 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.577 18:50:38 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.577 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.577 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.577 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.577 18:50:38 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.577 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.577 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.577 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.577 18:50:38 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.577 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.577 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.577 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.577 18:50:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.577 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.577 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.577 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.577 18:50:38 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.577 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.577 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.577 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.577 18:50:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.577 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.577 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.577 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.577 18:50:38 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.577 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.577 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.577 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.577 18:50:38 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.577 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.577 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.577 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.577 18:50:38 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.577 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.577 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.577 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.577 18:50:38 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.577 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.577 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.577 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.577 18:50:38 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.577 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.577 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.577 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.577 18:50:38 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.577 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.577 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.577 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.577 18:50:38 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.577 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.577 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.577 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.577 18:50:38 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.577 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.577 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.577 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.577 18:50:38 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.577 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.577 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.577 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.577 18:50:38 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.577 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.577 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.577 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.577 18:50:38 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.577 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.577 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.577 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.577 18:50:38 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.577 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.577 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.577 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.577 18:50:38 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.577 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.577 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.577 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.577 18:50:38 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.577 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.577 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.577 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.577 18:50:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.577 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.577 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.577 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.577 18:50:38 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.577 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.577 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.577 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.577 18:50:38 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.577 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.577 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.577 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.577 18:50:38 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.578 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.578 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.578 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.578 18:50:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.578 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.578 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.578 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.578 18:50:38 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.578 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.578 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.578 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.578 18:50:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.578 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.578 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.578 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.578 18:50:38 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.578 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.578 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.578 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.578 18:50:38 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.578 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.578 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.578 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.578 18:50:38 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.578 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.578 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.578 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.578 18:50:38 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.578 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.578 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.578 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.578 18:50:38 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.578 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.578 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.578 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.578 18:50:38 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.578 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.578 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.578 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.578 18:50:38 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.578 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.578 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.578 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.578 18:50:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.578 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.578 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.578 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.578 18:50:38 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.578 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.578 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.578 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.578 18:50:38 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.578 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.578 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.578 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.578 18:50:38 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.578 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.578 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.578 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.578 18:50:38 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.578 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.578 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.578 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.578 18:50:38 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.578 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.578 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.578 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.578 18:50:38 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.578 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.578 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.578 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.578 18:50:38 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.578 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.578 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.578 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.578 18:50:38 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.578 18:50:38 -- setup/common.sh@33 -- # echo 1024 00:04:21.578 18:50:38 -- setup/common.sh@33 -- # return 0 00:04:21.578 18:50:38 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:21.578 18:50:38 -- setup/hugepages.sh@112 -- # get_nodes 00:04:21.578 18:50:38 -- setup/hugepages.sh@27 -- # local node 00:04:21.578 18:50:38 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:21.578 18:50:38 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:21.578 18:50:38 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:21.578 18:50:38 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:21.578 18:50:38 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:21.578 18:50:38 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:21.578 18:50:38 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:21.578 18:50:38 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:21.578 18:50:38 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:21.578 18:50:38 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:21.578 18:50:38 -- setup/common.sh@18 -- # local node=0 00:04:21.578 18:50:38 -- setup/common.sh@19 -- # local var val 00:04:21.578 18:50:38 -- setup/common.sh@20 -- # local mem_f mem 00:04:21.578 18:50:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:21.578 18:50:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:21.578 18:50:38 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:21.578 18:50:38 -- setup/common.sh@28 -- # mapfile -t mem 00:04:21.578 18:50:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:21.578 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.578 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.578 18:50:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 97609576 kB' 'MemFree: 89482320 kB' 'MemUsed: 8127256 kB' 'SwapCached: 0 kB' 'Active: 3698352 kB' 'Inactive: 281892 kB' 'Active(anon): 2817676 kB' 'Inactive(anon): 0 kB' 'Active(file): 880676 kB' 'Inactive(file): 281892 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3548344 kB' 'Mapped: 132796 kB' 'AnonPages: 435108 kB' 'Shmem: 2385776 kB' 'KernelStack: 13320 kB' 'PageTables: 6588 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 361668 kB' 'Slab: 893516 kB' 'SReclaimable: 361668 kB' 'SUnreclaim: 531848 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:21.578 18:50:38 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.578 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.578 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.578 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.578 18:50:38 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.578 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.578 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.578 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.578 18:50:38 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.578 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.579 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.579 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.579 18:50:38 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.579 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.579 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.579 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.579 18:50:38 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.579 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.579 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.579 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.579 18:50:38 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.579 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.579 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.579 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.579 18:50:38 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.579 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.579 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.579 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.579 18:50:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.579 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.579 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.579 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.579 18:50:38 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.579 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.579 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.579 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.579 18:50:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.579 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.579 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.579 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.579 18:50:38 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.579 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.579 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.579 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.579 18:50:38 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.579 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.579 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.579 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.579 18:50:38 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.579 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.579 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.579 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.579 18:50:38 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.579 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.579 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.579 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.579 18:50:38 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.579 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.579 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.579 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.579 18:50:38 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.579 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.579 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.579 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.579 18:50:38 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.579 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.579 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.579 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.579 18:50:38 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.579 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.579 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.579 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.579 18:50:38 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.579 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.579 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.579 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.579 18:50:38 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.579 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.579 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.579 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.579 18:50:38 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.579 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.579 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.579 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.579 18:50:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.579 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.579 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.579 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.579 18:50:38 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.579 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.579 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.579 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.579 18:50:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.579 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.579 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.579 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.579 18:50:38 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.579 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.579 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.838 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.838 18:50:38 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.838 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.838 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.838 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.838 18:50:38 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.838 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.838 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.838 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.838 18:50:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.838 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.838 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.838 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.838 18:50:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.838 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.838 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.838 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.838 18:50:38 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.838 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.838 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.838 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.838 18:50:38 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.838 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.838 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.838 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.838 18:50:38 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.838 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.838 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.838 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.838 18:50:38 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.838 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.838 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.838 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.838 18:50:38 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.838 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.838 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.838 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.838 18:50:38 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.838 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.838 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.838 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.838 18:50:38 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.838 18:50:38 -- setup/common.sh@32 -- # continue 00:04:21.838 18:50:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.838 18:50:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.838 18:50:38 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.838 18:50:38 -- setup/common.sh@33 -- # echo 0 00:04:21.838 18:50:38 -- setup/common.sh@33 -- # return 0 00:04:21.838 18:50:38 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:21.839 18:50:38 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:21.839 18:50:38 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:21.839 18:50:38 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:21.839 18:50:38 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:04:21.839 node0=1024 expecting 1024 00:04:21.839 18:50:38 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:04:21.839 00:04:21.839 real 0m6.160s 00:04:21.839 user 0m2.466s 00:04:21.839 sys 0m3.833s 00:04:21.839 18:50:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:21.839 18:50:38 -- common/autotest_common.sh@10 -- # set +x 00:04:21.839 ************************************ 00:04:21.839 END TEST no_shrink_alloc 00:04:21.839 ************************************ 00:04:21.839 18:50:38 -- setup/hugepages.sh@217 -- # clear_hp 00:04:21.839 18:50:38 -- setup/hugepages.sh@37 -- # local node hp 00:04:21.839 18:50:38 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:21.839 18:50:38 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:21.839 18:50:38 -- setup/hugepages.sh@41 -- # echo 0 00:04:21.839 18:50:38 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:21.839 18:50:38 -- setup/hugepages.sh@41 -- # echo 0 00:04:21.839 18:50:38 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:21.839 18:50:38 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:21.839 18:50:38 -- setup/hugepages.sh@41 -- # echo 0 00:04:21.839 18:50:38 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:21.839 18:50:38 -- setup/hugepages.sh@41 -- # echo 0 00:04:21.839 18:50:38 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:04:21.839 18:50:38 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:04:21.839 00:04:21.839 real 0m22.421s 00:04:21.839 user 0m8.721s 00:04:21.839 sys 0m13.348s 00:04:21.839 18:50:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:21.839 18:50:38 -- common/autotest_common.sh@10 -- # set +x 00:04:21.839 ************************************ 00:04:21.839 END TEST hugepages 00:04:21.839 ************************************ 00:04:21.839 18:50:38 -- setup/test-setup.sh@14 -- # run_test driver /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:04:21.839 18:50:38 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:21.839 18:50:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:21.839 18:50:38 -- common/autotest_common.sh@10 -- # set +x 00:04:21.839 ************************************ 00:04:21.839 START TEST driver 00:04:21.839 ************************************ 00:04:21.839 18:50:38 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:04:21.839 * Looking for test storage... 00:04:21.839 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:21.839 18:50:38 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:21.839 18:50:38 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:21.839 18:50:38 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:21.839 18:50:38 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:21.839 18:50:38 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:21.839 18:50:38 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:21.839 18:50:38 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:21.839 18:50:38 -- scripts/common.sh@335 -- # IFS=.-: 00:04:21.839 18:50:38 -- scripts/common.sh@335 -- # read -ra ver1 00:04:21.839 18:50:38 -- scripts/common.sh@336 -- # IFS=.-: 00:04:21.839 18:50:38 -- scripts/common.sh@336 -- # read -ra ver2 00:04:21.839 18:50:38 -- scripts/common.sh@337 -- # local 'op=<' 00:04:21.839 18:50:38 -- scripts/common.sh@339 -- # ver1_l=2 00:04:21.839 18:50:38 -- scripts/common.sh@340 -- # ver2_l=1 00:04:21.839 18:50:38 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:21.839 18:50:38 -- scripts/common.sh@343 -- # case "$op" in 00:04:21.839 18:50:38 -- scripts/common.sh@344 -- # : 1 00:04:21.839 18:50:38 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:21.839 18:50:38 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:21.839 18:50:38 -- scripts/common.sh@364 -- # decimal 1 00:04:21.839 18:50:38 -- scripts/common.sh@352 -- # local d=1 00:04:21.839 18:50:38 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:21.839 18:50:38 -- scripts/common.sh@354 -- # echo 1 00:04:21.839 18:50:38 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:21.839 18:50:38 -- scripts/common.sh@365 -- # decimal 2 00:04:21.839 18:50:38 -- scripts/common.sh@352 -- # local d=2 00:04:21.839 18:50:38 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:21.839 18:50:38 -- scripts/common.sh@354 -- # echo 2 00:04:21.839 18:50:38 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:21.839 18:50:38 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:21.839 18:50:38 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:21.839 18:50:38 -- scripts/common.sh@367 -- # return 0 00:04:21.839 18:50:38 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:21.839 18:50:38 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:21.839 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:21.839 --rc genhtml_branch_coverage=1 00:04:21.839 --rc genhtml_function_coverage=1 00:04:21.839 --rc genhtml_legend=1 00:04:21.839 --rc geninfo_all_blocks=1 00:04:21.839 --rc geninfo_unexecuted_blocks=1 00:04:21.839 00:04:21.839 ' 00:04:21.839 18:50:38 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:21.839 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:21.839 --rc genhtml_branch_coverage=1 00:04:21.839 --rc genhtml_function_coverage=1 00:04:21.839 --rc genhtml_legend=1 00:04:21.839 --rc geninfo_all_blocks=1 00:04:21.839 --rc geninfo_unexecuted_blocks=1 00:04:21.839 00:04:21.839 ' 00:04:21.839 18:50:38 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:21.839 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:21.839 --rc genhtml_branch_coverage=1 00:04:21.839 --rc genhtml_function_coverage=1 00:04:21.839 --rc genhtml_legend=1 00:04:21.839 --rc geninfo_all_blocks=1 00:04:21.839 --rc geninfo_unexecuted_blocks=1 00:04:21.839 00:04:21.839 ' 00:04:21.839 18:50:38 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:21.839 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:21.839 --rc genhtml_branch_coverage=1 00:04:21.839 --rc genhtml_function_coverage=1 00:04:21.839 --rc genhtml_legend=1 00:04:21.839 --rc geninfo_all_blocks=1 00:04:21.839 --rc geninfo_unexecuted_blocks=1 00:04:21.839 00:04:21.839 ' 00:04:21.839 18:50:38 -- setup/driver.sh@68 -- # setup reset 00:04:21.839 18:50:38 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:21.839 18:50:38 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:26.027 18:50:42 -- setup/driver.sh@69 -- # run_test guess_driver guess_driver 00:04:26.027 18:50:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:26.027 18:50:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:26.027 18:50:42 -- common/autotest_common.sh@10 -- # set +x 00:04:26.027 ************************************ 00:04:26.027 START TEST guess_driver 00:04:26.027 ************************************ 00:04:26.027 18:50:42 -- common/autotest_common.sh@1114 -- # guess_driver 00:04:26.027 18:50:42 -- setup/driver.sh@46 -- # local driver setup_driver marker 00:04:26.027 18:50:42 -- setup/driver.sh@47 -- # local fail=0 00:04:26.027 18:50:42 -- setup/driver.sh@49 -- # pick_driver 00:04:26.027 18:50:42 -- setup/driver.sh@36 -- # vfio 00:04:26.027 18:50:42 -- setup/driver.sh@21 -- # local iommu_grups 00:04:26.027 18:50:42 -- setup/driver.sh@22 -- # local unsafe_vfio 00:04:26.027 18:50:42 -- setup/driver.sh@24 -- # [[ -e /sys/module/vfio/parameters/enable_unsafe_noiommu_mode ]] 00:04:26.027 18:50:42 -- setup/driver.sh@25 -- # unsafe_vfio=N 00:04:26.027 18:50:42 -- setup/driver.sh@27 -- # iommu_groups=(/sys/kernel/iommu_groups/*) 00:04:26.027 18:50:42 -- setup/driver.sh@29 -- # (( 174 > 0 )) 00:04:26.027 18:50:42 -- setup/driver.sh@30 -- # is_driver vfio_pci 00:04:26.027 18:50:42 -- setup/driver.sh@14 -- # mod vfio_pci 00:04:26.027 18:50:42 -- setup/driver.sh@12 -- # dep vfio_pci 00:04:26.027 18:50:42 -- setup/driver.sh@11 -- # modprobe --show-depends vfio_pci 00:04:26.027 18:50:42 -- setup/driver.sh@12 -- # [[ insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/virt/lib/irqbypass.ko.xz 00:04:26.027 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:04:26.027 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:04:26.027 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:04:26.027 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:04:26.027 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio_iommu_type1.ko.xz 00:04:26.027 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci-core.ko.xz 00:04:26.027 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci.ko.xz == *\.\k\o* ]] 00:04:26.027 18:50:42 -- setup/driver.sh@30 -- # return 0 00:04:26.027 18:50:42 -- setup/driver.sh@37 -- # echo vfio-pci 00:04:26.027 18:50:42 -- setup/driver.sh@49 -- # driver=vfio-pci 00:04:26.027 18:50:42 -- setup/driver.sh@51 -- # [[ vfio-pci == \N\o\ \v\a\l\i\d\ \d\r\i\v\e\r\ \f\o\u\n\d ]] 00:04:26.027 18:50:42 -- setup/driver.sh@56 -- # echo 'Looking for driver=vfio-pci' 00:04:26.027 Looking for driver=vfio-pci 00:04:26.027 18:50:42 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:26.027 18:50:42 -- setup/driver.sh@45 -- # setup output config 00:04:26.027 18:50:42 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:26.027 18:50:42 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:29.309 18:50:45 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:29.309 18:50:45 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:29.309 18:50:45 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:29.309 18:50:45 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:29.309 18:50:45 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:29.309 18:50:45 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:29.309 18:50:45 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:29.309 18:50:45 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:29.309 18:50:45 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:29.309 18:50:45 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:29.309 18:50:45 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:29.309 18:50:45 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:29.309 18:50:45 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:29.309 18:50:45 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:29.309 18:50:45 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:29.309 18:50:45 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:29.309 18:50:45 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:29.309 18:50:45 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:29.309 18:50:45 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:29.309 18:50:45 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:29.309 18:50:45 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:29.309 18:50:45 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:29.309 18:50:45 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:29.309 18:50:45 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:29.309 18:50:45 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:29.309 18:50:45 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:29.309 18:50:45 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:29.309 18:50:45 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:29.309 18:50:45 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:29.309 18:50:45 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:29.309 18:50:45 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:29.309 18:50:45 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:29.309 18:50:45 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:29.309 18:50:45 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:29.309 18:50:45 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:29.309 18:50:45 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:29.309 18:50:45 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:29.309 18:50:45 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:29.309 18:50:45 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:29.309 18:50:45 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:29.309 18:50:45 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:29.309 18:50:45 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:29.309 18:50:45 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:29.309 18:50:45 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:29.309 18:50:45 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:29.309 18:50:45 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:29.309 18:50:45 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:29.310 18:50:45 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:29.877 18:50:46 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:29.877 18:50:46 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:29.877 18:50:46 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:30.135 18:50:46 -- setup/driver.sh@64 -- # (( fail == 0 )) 00:04:30.135 18:50:46 -- setup/driver.sh@65 -- # setup reset 00:04:30.135 18:50:46 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:30.135 18:50:46 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:34.319 00:04:34.319 real 0m7.983s 00:04:34.319 user 0m2.319s 00:04:34.319 sys 0m4.176s 00:04:34.319 18:50:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:34.319 18:50:50 -- common/autotest_common.sh@10 -- # set +x 00:04:34.319 ************************************ 00:04:34.319 END TEST guess_driver 00:04:34.319 ************************************ 00:04:34.319 00:04:34.319 real 0m12.281s 00:04:34.319 user 0m3.615s 00:04:34.319 sys 0m6.479s 00:04:34.319 18:50:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:34.319 18:50:50 -- common/autotest_common.sh@10 -- # set +x 00:04:34.319 ************************************ 00:04:34.319 END TEST driver 00:04:34.319 ************************************ 00:04:34.319 18:50:50 -- setup/test-setup.sh@15 -- # run_test devices /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:04:34.319 18:50:50 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:34.319 18:50:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:34.319 18:50:50 -- common/autotest_common.sh@10 -- # set +x 00:04:34.319 ************************************ 00:04:34.319 START TEST devices 00:04:34.319 ************************************ 00:04:34.319 18:50:50 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:04:34.319 * Looking for test storage... 00:04:34.319 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:34.319 18:50:50 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:34.319 18:50:50 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:34.319 18:50:50 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:34.319 18:50:51 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:34.320 18:50:51 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:34.320 18:50:51 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:34.320 18:50:51 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:34.320 18:50:51 -- scripts/common.sh@335 -- # IFS=.-: 00:04:34.320 18:50:51 -- scripts/common.sh@335 -- # read -ra ver1 00:04:34.320 18:50:51 -- scripts/common.sh@336 -- # IFS=.-: 00:04:34.320 18:50:51 -- scripts/common.sh@336 -- # read -ra ver2 00:04:34.320 18:50:51 -- scripts/common.sh@337 -- # local 'op=<' 00:04:34.320 18:50:51 -- scripts/common.sh@339 -- # ver1_l=2 00:04:34.320 18:50:51 -- scripts/common.sh@340 -- # ver2_l=1 00:04:34.320 18:50:51 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:34.320 18:50:51 -- scripts/common.sh@343 -- # case "$op" in 00:04:34.320 18:50:51 -- scripts/common.sh@344 -- # : 1 00:04:34.320 18:50:51 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:34.320 18:50:51 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:34.320 18:50:51 -- scripts/common.sh@364 -- # decimal 1 00:04:34.320 18:50:51 -- scripts/common.sh@352 -- # local d=1 00:04:34.320 18:50:51 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:34.320 18:50:51 -- scripts/common.sh@354 -- # echo 1 00:04:34.320 18:50:51 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:34.320 18:50:51 -- scripts/common.sh@365 -- # decimal 2 00:04:34.320 18:50:51 -- scripts/common.sh@352 -- # local d=2 00:04:34.320 18:50:51 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:34.320 18:50:51 -- scripts/common.sh@354 -- # echo 2 00:04:34.320 18:50:51 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:34.320 18:50:51 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:34.320 18:50:51 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:34.320 18:50:51 -- scripts/common.sh@367 -- # return 0 00:04:34.320 18:50:51 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:34.320 18:50:51 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:34.320 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:34.320 --rc genhtml_branch_coverage=1 00:04:34.320 --rc genhtml_function_coverage=1 00:04:34.320 --rc genhtml_legend=1 00:04:34.320 --rc geninfo_all_blocks=1 00:04:34.320 --rc geninfo_unexecuted_blocks=1 00:04:34.320 00:04:34.320 ' 00:04:34.320 18:50:51 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:34.320 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:34.320 --rc genhtml_branch_coverage=1 00:04:34.320 --rc genhtml_function_coverage=1 00:04:34.320 --rc genhtml_legend=1 00:04:34.320 --rc geninfo_all_blocks=1 00:04:34.320 --rc geninfo_unexecuted_blocks=1 00:04:34.320 00:04:34.320 ' 00:04:34.320 18:50:51 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:34.320 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:34.320 --rc genhtml_branch_coverage=1 00:04:34.320 --rc genhtml_function_coverage=1 00:04:34.320 --rc genhtml_legend=1 00:04:34.320 --rc geninfo_all_blocks=1 00:04:34.320 --rc geninfo_unexecuted_blocks=1 00:04:34.320 00:04:34.320 ' 00:04:34.320 18:50:51 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:34.320 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:34.320 --rc genhtml_branch_coverage=1 00:04:34.320 --rc genhtml_function_coverage=1 00:04:34.320 --rc genhtml_legend=1 00:04:34.320 --rc geninfo_all_blocks=1 00:04:34.320 --rc geninfo_unexecuted_blocks=1 00:04:34.320 00:04:34.320 ' 00:04:34.320 18:50:51 -- setup/devices.sh@190 -- # trap cleanup EXIT 00:04:34.320 18:50:51 -- setup/devices.sh@192 -- # setup reset 00:04:34.320 18:50:51 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:34.320 18:50:51 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:37.601 18:50:54 -- setup/devices.sh@194 -- # get_zoned_devs 00:04:37.601 18:50:54 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:04:37.601 18:50:54 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:04:37.601 18:50:54 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:04:37.601 18:50:54 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:04:37.601 18:50:54 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:04:37.601 18:50:54 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:04:37.601 18:50:54 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:04:37.601 18:50:54 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:04:37.601 18:50:54 -- setup/devices.sh@196 -- # blocks=() 00:04:37.601 18:50:54 -- setup/devices.sh@196 -- # declare -a blocks 00:04:37.601 18:50:54 -- setup/devices.sh@197 -- # blocks_to_pci=() 00:04:37.601 18:50:54 -- setup/devices.sh@197 -- # declare -A blocks_to_pci 00:04:37.601 18:50:54 -- setup/devices.sh@198 -- # min_disk_size=3221225472 00:04:37.601 18:50:54 -- setup/devices.sh@200 -- # for block in "/sys/block/nvme"!(*c*) 00:04:37.601 18:50:54 -- setup/devices.sh@201 -- # ctrl=nvme0n1 00:04:37.601 18:50:54 -- setup/devices.sh@201 -- # ctrl=nvme0 00:04:37.601 18:50:54 -- setup/devices.sh@202 -- # pci=0000:5e:00.0 00:04:37.601 18:50:54 -- setup/devices.sh@203 -- # [[ '' == *\0\0\0\0\:\5\e\:\0\0\.\0* ]] 00:04:37.601 18:50:54 -- setup/devices.sh@204 -- # block_in_use nvme0n1 00:04:37.601 18:50:54 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:04:37.601 18:50:54 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:04:37.601 No valid GPT data, bailing 00:04:37.601 18:50:54 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:04:37.601 18:50:54 -- scripts/common.sh@393 -- # pt= 00:04:37.601 18:50:54 -- scripts/common.sh@394 -- # return 1 00:04:37.601 18:50:54 -- setup/devices.sh@204 -- # sec_size_to_bytes nvme0n1 00:04:37.601 18:50:54 -- setup/common.sh@76 -- # local dev=nvme0n1 00:04:37.601 18:50:54 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:04:37.601 18:50:54 -- setup/common.sh@80 -- # echo 1000204886016 00:04:37.601 18:50:54 -- setup/devices.sh@204 -- # (( 1000204886016 >= min_disk_size )) 00:04:37.601 18:50:54 -- setup/devices.sh@205 -- # blocks+=("${block##*/}") 00:04:37.602 18:50:54 -- setup/devices.sh@206 -- # blocks_to_pci["${block##*/}"]=0000:5e:00.0 00:04:37.602 18:50:54 -- setup/devices.sh@209 -- # (( 1 > 0 )) 00:04:37.602 18:50:54 -- setup/devices.sh@211 -- # declare -r test_disk=nvme0n1 00:04:37.602 18:50:54 -- setup/devices.sh@213 -- # run_test nvme_mount nvme_mount 00:04:37.602 18:50:54 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:37.602 18:50:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:37.602 18:50:54 -- common/autotest_common.sh@10 -- # set +x 00:04:37.602 ************************************ 00:04:37.602 START TEST nvme_mount 00:04:37.602 ************************************ 00:04:37.602 18:50:54 -- common/autotest_common.sh@1114 -- # nvme_mount 00:04:37.602 18:50:54 -- setup/devices.sh@95 -- # nvme_disk=nvme0n1 00:04:37.602 18:50:54 -- setup/devices.sh@96 -- # nvme_disk_p=nvme0n1p1 00:04:37.602 18:50:54 -- setup/devices.sh@97 -- # nvme_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:37.602 18:50:54 -- setup/devices.sh@98 -- # nvme_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:37.602 18:50:54 -- setup/devices.sh@101 -- # partition_drive nvme0n1 1 00:04:37.602 18:50:54 -- setup/common.sh@39 -- # local disk=nvme0n1 00:04:37.602 18:50:54 -- setup/common.sh@40 -- # local part_no=1 00:04:37.602 18:50:54 -- setup/common.sh@41 -- # local size=1073741824 00:04:37.602 18:50:54 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:04:37.602 18:50:54 -- setup/common.sh@44 -- # parts=() 00:04:37.602 18:50:54 -- setup/common.sh@44 -- # local parts 00:04:37.602 18:50:54 -- setup/common.sh@46 -- # (( part = 1 )) 00:04:37.602 18:50:54 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:37.602 18:50:54 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:04:37.602 18:50:54 -- setup/common.sh@46 -- # (( part++ )) 00:04:37.602 18:50:54 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:37.602 18:50:54 -- setup/common.sh@51 -- # (( size /= 512 )) 00:04:37.602 18:50:54 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:04:37.602 18:50:54 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 00:04:38.535 Creating new GPT entries in memory. 00:04:38.535 GPT data structures destroyed! You may now partition the disk using fdisk or 00:04:38.535 other utilities. 00:04:38.535 18:50:55 -- setup/common.sh@57 -- # (( part = 1 )) 00:04:38.535 18:50:55 -- setup/common.sh@57 -- # (( part <= part_no )) 00:04:38.535 18:50:55 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:04:38.535 18:50:55 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:04:38.535 18:50:55 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:04:39.468 Creating new GPT entries in memory. 00:04:39.468 The operation has completed successfully. 00:04:39.468 18:50:56 -- setup/common.sh@57 -- # (( part++ )) 00:04:39.468 18:50:56 -- setup/common.sh@57 -- # (( part <= part_no )) 00:04:39.468 18:50:56 -- setup/common.sh@62 -- # wait 2905118 00:04:39.468 18:50:56 -- setup/devices.sh@102 -- # mkfs /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:39.468 18:50:56 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1p1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size= 00:04:39.468 18:50:56 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:39.468 18:50:56 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1p1 ]] 00:04:39.469 18:50:56 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1p1 00:04:39.469 18:50:56 -- setup/common.sh@72 -- # mount /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:39.726 18:50:56 -- setup/devices.sh@105 -- # verify 0000:5e:00.0 nvme0n1:nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:39.726 18:50:56 -- setup/devices.sh@48 -- # local dev=0000:5e:00.0 00:04:39.726 18:50:56 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1p1 00:04:39.726 18:50:56 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:39.726 18:50:56 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:39.726 18:50:56 -- setup/devices.sh@53 -- # local found=0 00:04:39.726 18:50:56 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:04:39.726 18:50:56 -- setup/devices.sh@56 -- # : 00:04:39.726 18:50:56 -- setup/devices.sh@59 -- # local pci status 00:04:39.726 18:50:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:39.726 18:50:56 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:5e:00.0 00:04:39.726 18:50:56 -- setup/devices.sh@47 -- # setup output config 00:04:39.726 18:50:56 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:39.726 18:50:56 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:42.254 18:50:58 -- setup/devices.sh@62 -- # [[ 0000:5e:00.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:42.254 18:50:58 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1p1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1\p\1* ]] 00:04:42.254 18:50:58 -- setup/devices.sh@63 -- # found=1 00:04:42.254 18:50:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:42.254 18:50:58 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:42.254 18:50:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:42.254 18:50:58 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:42.254 18:50:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:42.254 18:50:58 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:42.254 18:50:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:42.254 18:50:58 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:42.254 18:50:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:42.254 18:50:58 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:42.254 18:50:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:42.254 18:50:58 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:42.254 18:50:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:42.254 18:50:58 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:42.254 18:50:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:42.254 18:50:58 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:42.254 18:50:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:42.254 18:50:58 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:42.254 18:50:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:42.254 18:50:58 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:42.254 18:50:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:42.254 18:50:58 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:42.254 18:50:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:42.254 18:50:58 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:42.254 18:50:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:42.254 18:50:58 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:42.254 18:50:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:42.254 18:50:58 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:42.254 18:50:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:42.254 18:50:58 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:42.254 18:50:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:42.254 18:50:58 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:42.254 18:50:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:42.254 18:50:59 -- setup/devices.sh@66 -- # (( found == 1 )) 00:04:42.254 18:50:59 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:04:42.254 18:50:59 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:42.254 18:50:59 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:04:42.254 18:50:59 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:42.254 18:50:59 -- setup/devices.sh@110 -- # cleanup_nvme 00:04:42.254 18:50:59 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:42.254 18:50:59 -- setup/devices.sh@21 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:42.254 18:50:59 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:04:42.254 18:50:59 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:04:42.254 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:04:42.254 18:50:59 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:04:42.254 18:50:59 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:04:42.511 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:04:42.511 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:04:42.511 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:04:42.511 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:04:42.511 18:50:59 -- setup/devices.sh@113 -- # mkfs /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 1024M 00:04:42.511 18:50:59 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size=1024M 00:04:42.511 18:50:59 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:42.769 18:50:59 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1 ]] 00:04:42.769 18:50:59 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1 1024M 00:04:42.769 18:50:59 -- setup/common.sh@72 -- # mount /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:42.769 18:50:59 -- setup/devices.sh@116 -- # verify 0000:5e:00.0 nvme0n1:nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:42.769 18:50:59 -- setup/devices.sh@48 -- # local dev=0000:5e:00.0 00:04:42.769 18:50:59 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1 00:04:42.769 18:50:59 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:42.769 18:50:59 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:42.769 18:50:59 -- setup/devices.sh@53 -- # local found=0 00:04:42.769 18:50:59 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:04:42.769 18:50:59 -- setup/devices.sh@56 -- # : 00:04:42.769 18:50:59 -- setup/devices.sh@59 -- # local pci status 00:04:42.769 18:50:59 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:42.769 18:50:59 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:5e:00.0 00:04:42.769 18:50:59 -- setup/devices.sh@47 -- # setup output config 00:04:42.769 18:50:59 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:42.769 18:50:59 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:45.297 18:51:02 -- setup/devices.sh@62 -- # [[ 0000:5e:00.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:45.297 18:51:02 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1* ]] 00:04:45.297 18:51:02 -- setup/devices.sh@63 -- # found=1 00:04:45.297 18:51:02 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.297 18:51:02 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:45.297 18:51:02 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.297 18:51:02 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:45.297 18:51:02 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.297 18:51:02 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:45.297 18:51:02 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.297 18:51:02 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:45.297 18:51:02 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.297 18:51:02 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:45.297 18:51:02 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.297 18:51:02 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:45.297 18:51:02 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.297 18:51:02 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:45.297 18:51:02 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.297 18:51:02 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:45.297 18:51:02 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.297 18:51:02 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:45.297 18:51:02 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.297 18:51:02 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:45.297 18:51:02 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.297 18:51:02 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:45.297 18:51:02 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.297 18:51:02 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:45.297 18:51:02 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.297 18:51:02 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:45.297 18:51:02 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.297 18:51:02 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:45.297 18:51:02 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.297 18:51:02 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:45.297 18:51:02 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.297 18:51:02 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:45.297 18:51:02 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.555 18:51:02 -- setup/devices.sh@66 -- # (( found == 1 )) 00:04:45.555 18:51:02 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:04:45.555 18:51:02 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:45.555 18:51:02 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:04:45.555 18:51:02 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:45.555 18:51:02 -- setup/devices.sh@123 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:45.555 18:51:02 -- setup/devices.sh@125 -- # verify 0000:5e:00.0 data@nvme0n1 '' '' 00:04:45.555 18:51:02 -- setup/devices.sh@48 -- # local dev=0000:5e:00.0 00:04:45.555 18:51:02 -- setup/devices.sh@49 -- # local mounts=data@nvme0n1 00:04:45.555 18:51:02 -- setup/devices.sh@50 -- # local mount_point= 00:04:45.555 18:51:02 -- setup/devices.sh@51 -- # local test_file= 00:04:45.555 18:51:02 -- setup/devices.sh@53 -- # local found=0 00:04:45.555 18:51:02 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:04:45.555 18:51:02 -- setup/devices.sh@59 -- # local pci status 00:04:45.555 18:51:02 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.555 18:51:02 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:5e:00.0 00:04:45.555 18:51:02 -- setup/devices.sh@47 -- # setup output config 00:04:45.555 18:51:02 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:45.555 18:51:02 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:48.087 18:51:04 -- setup/devices.sh@62 -- # [[ 0000:5e:00.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:48.087 18:51:04 -- setup/devices.sh@62 -- # [[ Active devices: data@nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\d\a\t\a\@\n\v\m\e\0\n\1* ]] 00:04:48.087 18:51:04 -- setup/devices.sh@63 -- # found=1 00:04:48.087 18:51:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.087 18:51:04 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:48.087 18:51:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.087 18:51:04 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:48.087 18:51:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.087 18:51:04 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:48.087 18:51:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.087 18:51:04 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:48.087 18:51:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.087 18:51:04 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:48.087 18:51:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.087 18:51:04 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:48.087 18:51:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.087 18:51:04 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:48.087 18:51:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.087 18:51:04 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:48.087 18:51:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.087 18:51:04 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:48.087 18:51:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.087 18:51:04 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:48.087 18:51:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.087 18:51:04 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:48.087 18:51:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.087 18:51:04 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:48.087 18:51:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.087 18:51:04 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:48.087 18:51:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.087 18:51:04 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:48.087 18:51:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.087 18:51:04 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:48.087 18:51:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.087 18:51:04 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:48.087 18:51:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.346 18:51:05 -- setup/devices.sh@66 -- # (( found == 1 )) 00:04:48.346 18:51:05 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:04:48.346 18:51:05 -- setup/devices.sh@68 -- # return 0 00:04:48.346 18:51:05 -- setup/devices.sh@128 -- # cleanup_nvme 00:04:48.346 18:51:05 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:48.346 18:51:05 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:04:48.346 18:51:05 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:04:48.346 18:51:05 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:04:48.346 /dev/nvme0n1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:04:48.346 00:04:48.346 real 0m10.959s 00:04:48.346 user 0m3.278s 00:04:48.346 sys 0m5.495s 00:04:48.346 18:51:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:48.346 18:51:05 -- common/autotest_common.sh@10 -- # set +x 00:04:48.346 ************************************ 00:04:48.346 END TEST nvme_mount 00:04:48.346 ************************************ 00:04:48.346 18:51:05 -- setup/devices.sh@214 -- # run_test dm_mount dm_mount 00:04:48.346 18:51:05 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:48.346 18:51:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:48.346 18:51:05 -- common/autotest_common.sh@10 -- # set +x 00:04:48.346 ************************************ 00:04:48.346 START TEST dm_mount 00:04:48.346 ************************************ 00:04:48.346 18:51:05 -- common/autotest_common.sh@1114 -- # dm_mount 00:04:48.346 18:51:05 -- setup/devices.sh@144 -- # pv=nvme0n1 00:04:48.346 18:51:05 -- setup/devices.sh@145 -- # pv0=nvme0n1p1 00:04:48.346 18:51:05 -- setup/devices.sh@146 -- # pv1=nvme0n1p2 00:04:48.346 18:51:05 -- setup/devices.sh@148 -- # partition_drive nvme0n1 00:04:48.346 18:51:05 -- setup/common.sh@39 -- # local disk=nvme0n1 00:04:48.346 18:51:05 -- setup/common.sh@40 -- # local part_no=2 00:04:48.346 18:51:05 -- setup/common.sh@41 -- # local size=1073741824 00:04:48.346 18:51:05 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:04:48.346 18:51:05 -- setup/common.sh@44 -- # parts=() 00:04:48.346 18:51:05 -- setup/common.sh@44 -- # local parts 00:04:48.346 18:51:05 -- setup/common.sh@46 -- # (( part = 1 )) 00:04:48.346 18:51:05 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:48.346 18:51:05 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:04:48.346 18:51:05 -- setup/common.sh@46 -- # (( part++ )) 00:04:48.346 18:51:05 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:48.346 18:51:05 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:04:48.346 18:51:05 -- setup/common.sh@46 -- # (( part++ )) 00:04:48.346 18:51:05 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:48.346 18:51:05 -- setup/common.sh@51 -- # (( size /= 512 )) 00:04:48.346 18:51:05 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:04:48.346 18:51:05 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 nvme0n1p2 00:04:49.722 Creating new GPT entries in memory. 00:04:49.722 GPT data structures destroyed! You may now partition the disk using fdisk or 00:04:49.722 other utilities. 00:04:49.722 18:51:06 -- setup/common.sh@57 -- # (( part = 1 )) 00:04:49.722 18:51:06 -- setup/common.sh@57 -- # (( part <= part_no )) 00:04:49.722 18:51:06 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:04:49.722 18:51:06 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:04:49.722 18:51:06 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:04:50.657 Creating new GPT entries in memory. 00:04:50.657 The operation has completed successfully. 00:04:50.657 18:51:07 -- setup/common.sh@57 -- # (( part++ )) 00:04:50.657 18:51:07 -- setup/common.sh@57 -- # (( part <= part_no )) 00:04:50.657 18:51:07 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:04:50.657 18:51:07 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:04:50.657 18:51:07 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=2:2099200:4196351 00:04:51.591 The operation has completed successfully. 00:04:51.591 18:51:08 -- setup/common.sh@57 -- # (( part++ )) 00:04:51.591 18:51:08 -- setup/common.sh@57 -- # (( part <= part_no )) 00:04:51.591 18:51:08 -- setup/common.sh@62 -- # wait 2909514 00:04:51.591 18:51:08 -- setup/devices.sh@150 -- # dm_name=nvme_dm_test 00:04:51.591 18:51:08 -- setup/devices.sh@151 -- # dm_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:51.591 18:51:08 -- setup/devices.sh@152 -- # dm_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:04:51.591 18:51:08 -- setup/devices.sh@155 -- # dmsetup create nvme_dm_test 00:04:51.591 18:51:08 -- setup/devices.sh@160 -- # for t in {1..5} 00:04:51.591 18:51:08 -- setup/devices.sh@161 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:04:51.591 18:51:08 -- setup/devices.sh@161 -- # break 00:04:51.591 18:51:08 -- setup/devices.sh@164 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:04:51.591 18:51:08 -- setup/devices.sh@165 -- # readlink -f /dev/mapper/nvme_dm_test 00:04:51.591 18:51:08 -- setup/devices.sh@165 -- # dm=/dev/dm-2 00:04:51.591 18:51:08 -- setup/devices.sh@166 -- # dm=dm-2 00:04:51.591 18:51:08 -- setup/devices.sh@168 -- # [[ -e /sys/class/block/nvme0n1p1/holders/dm-2 ]] 00:04:51.591 18:51:08 -- setup/devices.sh@169 -- # [[ -e /sys/class/block/nvme0n1p2/holders/dm-2 ]] 00:04:51.591 18:51:08 -- setup/devices.sh@171 -- # mkfs /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:51.591 18:51:08 -- setup/common.sh@66 -- # local dev=/dev/mapper/nvme_dm_test mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount size= 00:04:51.591 18:51:08 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:51.591 18:51:08 -- setup/common.sh@70 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:04:51.591 18:51:08 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/mapper/nvme_dm_test 00:04:51.591 18:51:08 -- setup/common.sh@72 -- # mount /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:51.591 18:51:08 -- setup/devices.sh@174 -- # verify 0000:5e:00.0 nvme0n1:nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:04:51.591 18:51:08 -- setup/devices.sh@48 -- # local dev=0000:5e:00.0 00:04:51.591 18:51:08 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme_dm_test 00:04:51.591 18:51:08 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:51.591 18:51:08 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:04:51.591 18:51:08 -- setup/devices.sh@53 -- # local found=0 00:04:51.591 18:51:08 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:04:51.591 18:51:08 -- setup/devices.sh@56 -- # : 00:04:51.591 18:51:08 -- setup/devices.sh@59 -- # local pci status 00:04:51.591 18:51:08 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:51.591 18:51:08 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:5e:00.0 00:04:51.591 18:51:08 -- setup/devices.sh@47 -- # setup output config 00:04:51.591 18:51:08 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:51.591 18:51:08 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:54.113 18:51:10 -- setup/devices.sh@62 -- # [[ 0000:5e:00.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:54.113 18:51:10 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-2,holder@nvme0n1p2:dm-2,mount@nvme0n1:nvme_dm_test, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\_\d\m\_\t\e\s\t* ]] 00:04:54.113 18:51:10 -- setup/devices.sh@63 -- # found=1 00:04:54.113 18:51:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:54.113 18:51:10 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:54.113 18:51:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:54.113 18:51:10 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:54.113 18:51:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:54.113 18:51:10 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:54.113 18:51:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:54.113 18:51:10 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:54.113 18:51:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:54.113 18:51:10 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:54.113 18:51:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:54.113 18:51:10 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:54.113 18:51:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:54.113 18:51:10 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:54.113 18:51:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:54.113 18:51:10 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:54.113 18:51:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:54.114 18:51:10 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:54.114 18:51:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:54.114 18:51:10 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:54.114 18:51:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:54.114 18:51:10 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:54.114 18:51:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:54.114 18:51:10 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:54.114 18:51:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:54.114 18:51:10 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:54.114 18:51:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:54.114 18:51:10 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:54.114 18:51:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:54.114 18:51:10 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:54.114 18:51:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:54.114 18:51:10 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:54.114 18:51:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:54.114 18:51:10 -- setup/devices.sh@66 -- # (( found == 1 )) 00:04:54.114 18:51:10 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount ]] 00:04:54.114 18:51:10 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:54.114 18:51:10 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:04:54.114 18:51:10 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:04:54.114 18:51:10 -- setup/devices.sh@182 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:54.114 18:51:11 -- setup/devices.sh@184 -- # verify 0000:5e:00.0 holder@nvme0n1p1:dm-2,holder@nvme0n1p2:dm-2 '' '' 00:04:54.114 18:51:11 -- setup/devices.sh@48 -- # local dev=0000:5e:00.0 00:04:54.114 18:51:11 -- setup/devices.sh@49 -- # local mounts=holder@nvme0n1p1:dm-2,holder@nvme0n1p2:dm-2 00:04:54.114 18:51:11 -- setup/devices.sh@50 -- # local mount_point= 00:04:54.114 18:51:11 -- setup/devices.sh@51 -- # local test_file= 00:04:54.114 18:51:11 -- setup/devices.sh@53 -- # local found=0 00:04:54.114 18:51:11 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:04:54.114 18:51:11 -- setup/devices.sh@59 -- # local pci status 00:04:54.114 18:51:11 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:54.114 18:51:11 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:5e:00.0 00:04:54.114 18:51:11 -- setup/devices.sh@47 -- # setup output config 00:04:54.114 18:51:11 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:54.114 18:51:11 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:56.640 18:51:13 -- setup/devices.sh@62 -- # [[ 0000:5e:00.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:56.640 18:51:13 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-2,holder@nvme0n1p2:dm-2, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\1\:\d\m\-\2\,\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\2\:\d\m\-\2* ]] 00:04:56.640 18:51:13 -- setup/devices.sh@63 -- # found=1 00:04:56.640 18:51:13 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:56.640 18:51:13 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:56.640 18:51:13 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:56.640 18:51:13 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:56.640 18:51:13 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:56.898 18:51:13 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:56.898 18:51:13 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:56.898 18:51:13 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:56.898 18:51:13 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:56.898 18:51:13 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:56.898 18:51:13 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:56.898 18:51:13 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:56.898 18:51:13 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:56.898 18:51:13 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:56.898 18:51:13 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:56.898 18:51:13 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:56.898 18:51:13 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:56.898 18:51:13 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:56.898 18:51:13 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:56.898 18:51:13 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:56.898 18:51:13 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:56.898 18:51:13 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:56.898 18:51:13 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:56.898 18:51:13 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:56.898 18:51:13 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:56.898 18:51:13 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:56.898 18:51:13 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:56.898 18:51:13 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:56.898 18:51:13 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:56.898 18:51:13 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:56.898 18:51:13 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:56.898 18:51:13 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:56.898 18:51:13 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:56.898 18:51:13 -- setup/devices.sh@66 -- # (( found == 1 )) 00:04:56.898 18:51:13 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:04:56.898 18:51:13 -- setup/devices.sh@68 -- # return 0 00:04:56.898 18:51:13 -- setup/devices.sh@187 -- # cleanup_dm 00:04:56.898 18:51:13 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:56.898 18:51:13 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:04:56.898 18:51:13 -- setup/devices.sh@37 -- # dmsetup remove --force nvme_dm_test 00:04:57.157 18:51:13 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:04:57.157 18:51:13 -- setup/devices.sh@40 -- # wipefs --all /dev/nvme0n1p1 00:04:57.157 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:04:57.157 18:51:13 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:04:57.157 18:51:13 -- setup/devices.sh@43 -- # wipefs --all /dev/nvme0n1p2 00:04:57.157 00:04:57.157 real 0m8.631s 00:04:57.157 user 0m1.984s 00:04:57.157 sys 0m3.581s 00:04:57.157 18:51:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:57.157 18:51:13 -- common/autotest_common.sh@10 -- # set +x 00:04:57.157 ************************************ 00:04:57.157 END TEST dm_mount 00:04:57.157 ************************************ 00:04:57.157 18:51:13 -- setup/devices.sh@1 -- # cleanup 00:04:57.157 18:51:13 -- setup/devices.sh@11 -- # cleanup_nvme 00:04:57.157 18:51:13 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:57.157 18:51:13 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:04:57.157 18:51:13 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:04:57.157 18:51:13 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:04:57.157 18:51:13 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:04:57.414 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:04:57.414 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:04:57.414 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:04:57.414 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:04:57.414 18:51:14 -- setup/devices.sh@12 -- # cleanup_dm 00:04:57.415 18:51:14 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:57.415 18:51:14 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:04:57.415 18:51:14 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:04:57.415 18:51:14 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:04:57.415 18:51:14 -- setup/devices.sh@14 -- # [[ -b /dev/nvme0n1 ]] 00:04:57.415 18:51:14 -- setup/devices.sh@15 -- # wipefs --all /dev/nvme0n1 00:04:57.415 00:04:57.415 real 0m23.262s 00:04:57.415 user 0m6.571s 00:04:57.415 sys 0m11.283s 00:04:57.415 18:51:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:57.415 18:51:14 -- common/autotest_common.sh@10 -- # set +x 00:04:57.415 ************************************ 00:04:57.415 END TEST devices 00:04:57.415 ************************************ 00:04:57.415 00:04:57.415 real 1m18.646s 00:04:57.415 user 0m26.029s 00:04:57.415 sys 0m43.474s 00:04:57.415 18:51:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:57.415 18:51:14 -- common/autotest_common.sh@10 -- # set +x 00:04:57.415 ************************************ 00:04:57.415 END TEST setup.sh 00:04:57.415 ************************************ 00:04:57.415 18:51:14 -- spdk/autotest.sh@126 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:04:59.940 Hugepages 00:04:59.940 node hugesize free / total 00:04:59.940 node0 1048576kB 0 / 0 00:04:59.940 node0 2048kB 2048 / 2048 00:04:59.940 node1 1048576kB 0 / 0 00:04:59.940 node1 2048kB 0 / 0 00:04:59.940 00:04:59.940 Type BDF Vendor Device NUMA Driver Device Block devices 00:04:59.940 I/OAT 0000:00:04.0 8086 2021 0 ioatdma - - 00:04:59.940 I/OAT 0000:00:04.1 8086 2021 0 ioatdma - - 00:04:59.940 I/OAT 0000:00:04.2 8086 2021 0 ioatdma - - 00:04:59.940 I/OAT 0000:00:04.3 8086 2021 0 ioatdma - - 00:04:59.940 I/OAT 0000:00:04.4 8086 2021 0 ioatdma - - 00:04:59.940 I/OAT 0000:00:04.5 8086 2021 0 ioatdma - - 00:04:59.940 I/OAT 0000:00:04.6 8086 2021 0 ioatdma - - 00:04:59.940 I/OAT 0000:00:04.7 8086 2021 0 ioatdma - - 00:04:59.940 NVMe 0000:5e:00.0 8086 0a54 0 nvme nvme0 nvme0n1 00:04:59.940 I/OAT 0000:80:04.0 8086 2021 1 ioatdma - - 00:04:59.940 I/OAT 0000:80:04.1 8086 2021 1 ioatdma - - 00:04:59.940 I/OAT 0000:80:04.2 8086 2021 1 ioatdma - - 00:04:59.940 I/OAT 0000:80:04.3 8086 2021 1 ioatdma - - 00:04:59.940 I/OAT 0000:80:04.4 8086 2021 1 ioatdma - - 00:04:59.940 I/OAT 0000:80:04.5 8086 2021 1 ioatdma - - 00:04:59.940 I/OAT 0000:80:04.6 8086 2021 1 ioatdma - - 00:04:59.940 I/OAT 0000:80:04.7 8086 2021 1 ioatdma - - 00:04:59.940 18:51:16 -- spdk/autotest.sh@128 -- # uname -s 00:04:59.940 18:51:16 -- spdk/autotest.sh@128 -- # [[ Linux == Linux ]] 00:04:59.940 18:51:16 -- spdk/autotest.sh@130 -- # nvme_namespace_revert 00:04:59.940 18:51:16 -- common/autotest_common.sh@1526 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:05:02.468 0000:00:04.7 (8086 2021): ioatdma -> vfio-pci 00:05:02.468 0000:00:04.6 (8086 2021): ioatdma -> vfio-pci 00:05:02.468 0000:00:04.5 (8086 2021): ioatdma -> vfio-pci 00:05:02.468 0000:00:04.4 (8086 2021): ioatdma -> vfio-pci 00:05:02.468 0000:00:04.3 (8086 2021): ioatdma -> vfio-pci 00:05:02.468 0000:00:04.2 (8086 2021): ioatdma -> vfio-pci 00:05:02.468 0000:00:04.1 (8086 2021): ioatdma -> vfio-pci 00:05:02.468 0000:00:04.0 (8086 2021): ioatdma -> vfio-pci 00:05:02.468 0000:80:04.7 (8086 2021): ioatdma -> vfio-pci 00:05:02.468 0000:80:04.6 (8086 2021): ioatdma -> vfio-pci 00:05:02.468 0000:80:04.5 (8086 2021): ioatdma -> vfio-pci 00:05:02.468 0000:80:04.4 (8086 2021): ioatdma -> vfio-pci 00:05:02.468 0000:80:04.3 (8086 2021): ioatdma -> vfio-pci 00:05:02.468 0000:80:04.2 (8086 2021): ioatdma -> vfio-pci 00:05:02.468 0000:80:04.1 (8086 2021): ioatdma -> vfio-pci 00:05:02.468 0000:80:04.0 (8086 2021): ioatdma -> vfio-pci 00:05:03.401 0000:5e:00.0 (8086 0a54): nvme -> vfio-pci 00:05:03.401 18:51:20 -- common/autotest_common.sh@1527 -- # sleep 1 00:05:04.334 18:51:21 -- common/autotest_common.sh@1528 -- # bdfs=() 00:05:04.334 18:51:21 -- common/autotest_common.sh@1528 -- # local bdfs 00:05:04.334 18:51:21 -- common/autotest_common.sh@1529 -- # bdfs=($(get_nvme_bdfs)) 00:05:04.334 18:51:21 -- common/autotest_common.sh@1529 -- # get_nvme_bdfs 00:05:04.334 18:51:21 -- common/autotest_common.sh@1508 -- # bdfs=() 00:05:04.334 18:51:21 -- common/autotest_common.sh@1508 -- # local bdfs 00:05:04.334 18:51:21 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:05:04.334 18:51:21 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:05:04.593 18:51:21 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:05:04.593 18:51:21 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:05:04.593 18:51:21 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:5e:00.0 00:05:04.593 18:51:21 -- common/autotest_common.sh@1531 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:05:07.118 Waiting for block devices as requested 00:05:07.118 0000:5e:00.0 (8086 0a54): vfio-pci -> nvme 00:05:07.376 0000:00:04.7 (8086 2021): vfio-pci -> ioatdma 00:05:07.376 0000:00:04.6 (8086 2021): vfio-pci -> ioatdma 00:05:07.376 0000:00:04.5 (8086 2021): vfio-pci -> ioatdma 00:05:07.633 0000:00:04.4 (8086 2021): vfio-pci -> ioatdma 00:05:07.633 0000:00:04.3 (8086 2021): vfio-pci -> ioatdma 00:05:07.633 0000:00:04.2 (8086 2021): vfio-pci -> ioatdma 00:05:07.892 0000:00:04.1 (8086 2021): vfio-pci -> ioatdma 00:05:07.892 0000:00:04.0 (8086 2021): vfio-pci -> ioatdma 00:05:07.892 0000:80:04.7 (8086 2021): vfio-pci -> ioatdma 00:05:07.892 0000:80:04.6 (8086 2021): vfio-pci -> ioatdma 00:05:08.150 0000:80:04.5 (8086 2021): vfio-pci -> ioatdma 00:05:08.150 0000:80:04.4 (8086 2021): vfio-pci -> ioatdma 00:05:08.150 0000:80:04.3 (8086 2021): vfio-pci -> ioatdma 00:05:08.485 0000:80:04.2 (8086 2021): vfio-pci -> ioatdma 00:05:08.485 0000:80:04.1 (8086 2021): vfio-pci -> ioatdma 00:05:08.485 0000:80:04.0 (8086 2021): vfio-pci -> ioatdma 00:05:08.485 18:51:25 -- common/autotest_common.sh@1533 -- # for bdf in "${bdfs[@]}" 00:05:08.485 18:51:25 -- common/autotest_common.sh@1534 -- # get_nvme_ctrlr_from_bdf 0000:5e:00.0 00:05:08.485 18:51:25 -- common/autotest_common.sh@1497 -- # readlink -f /sys/class/nvme/nvme0 00:05:08.485 18:51:25 -- common/autotest_common.sh@1497 -- # grep 0000:5e:00.0/nvme/nvme 00:05:08.485 18:51:25 -- common/autotest_common.sh@1497 -- # bdf_sysfs_path=/sys/devices/pci0000:5d/0000:5d:02.0/0000:5e:00.0/nvme/nvme0 00:05:08.485 18:51:25 -- common/autotest_common.sh@1498 -- # [[ -z /sys/devices/pci0000:5d/0000:5d:02.0/0000:5e:00.0/nvme/nvme0 ]] 00:05:08.485 18:51:25 -- common/autotest_common.sh@1502 -- # basename /sys/devices/pci0000:5d/0000:5d:02.0/0000:5e:00.0/nvme/nvme0 00:05:08.485 18:51:25 -- common/autotest_common.sh@1502 -- # printf '%s\n' nvme0 00:05:08.485 18:51:25 -- common/autotest_common.sh@1534 -- # nvme_ctrlr=/dev/nvme0 00:05:08.485 18:51:25 -- common/autotest_common.sh@1535 -- # [[ -z /dev/nvme0 ]] 00:05:08.485 18:51:25 -- common/autotest_common.sh@1540 -- # nvme id-ctrl /dev/nvme0 00:05:08.485 18:51:25 -- common/autotest_common.sh@1540 -- # grep oacs 00:05:08.485 18:51:25 -- common/autotest_common.sh@1540 -- # cut -d: -f2 00:05:08.485 18:51:25 -- common/autotest_common.sh@1540 -- # oacs=' 0xe' 00:05:08.485 18:51:25 -- common/autotest_common.sh@1541 -- # oacs_ns_manage=8 00:05:08.485 18:51:25 -- common/autotest_common.sh@1543 -- # [[ 8 -ne 0 ]] 00:05:08.485 18:51:25 -- common/autotest_common.sh@1549 -- # grep unvmcap 00:05:08.485 18:51:25 -- common/autotest_common.sh@1549 -- # nvme id-ctrl /dev/nvme0 00:05:08.485 18:51:25 -- common/autotest_common.sh@1549 -- # cut -d: -f2 00:05:08.485 18:51:25 -- common/autotest_common.sh@1549 -- # unvmcap=' 0' 00:05:08.485 18:51:25 -- common/autotest_common.sh@1550 -- # [[ 0 -eq 0 ]] 00:05:08.485 18:51:25 -- common/autotest_common.sh@1552 -- # continue 00:05:08.485 18:51:25 -- spdk/autotest.sh@133 -- # timing_exit pre_cleanup 00:05:08.485 18:51:25 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:08.485 18:51:25 -- common/autotest_common.sh@10 -- # set +x 00:05:08.485 18:51:25 -- spdk/autotest.sh@136 -- # timing_enter afterboot 00:05:08.485 18:51:25 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:08.485 18:51:25 -- common/autotest_common.sh@10 -- # set +x 00:05:08.485 18:51:25 -- spdk/autotest.sh@137 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:05:11.800 0000:00:04.7 (8086 2021): ioatdma -> vfio-pci 00:05:11.800 0000:00:04.6 (8086 2021): ioatdma -> vfio-pci 00:05:11.800 0000:00:04.5 (8086 2021): ioatdma -> vfio-pci 00:05:11.800 0000:00:04.4 (8086 2021): ioatdma -> vfio-pci 00:05:11.800 0000:00:04.3 (8086 2021): ioatdma -> vfio-pci 00:05:11.800 0000:00:04.2 (8086 2021): ioatdma -> vfio-pci 00:05:11.800 0000:00:04.1 (8086 2021): ioatdma -> vfio-pci 00:05:11.800 0000:00:04.0 (8086 2021): ioatdma -> vfio-pci 00:05:11.800 0000:80:04.7 (8086 2021): ioatdma -> vfio-pci 00:05:11.800 0000:80:04.6 (8086 2021): ioatdma -> vfio-pci 00:05:11.800 0000:80:04.5 (8086 2021): ioatdma -> vfio-pci 00:05:11.800 0000:80:04.4 (8086 2021): ioatdma -> vfio-pci 00:05:11.800 0000:80:04.3 (8086 2021): ioatdma -> vfio-pci 00:05:11.800 0000:80:04.2 (8086 2021): ioatdma -> vfio-pci 00:05:11.800 0000:80:04.1 (8086 2021): ioatdma -> vfio-pci 00:05:11.800 0000:80:04.0 (8086 2021): ioatdma -> vfio-pci 00:05:12.366 0000:5e:00.0 (8086 0a54): nvme -> vfio-pci 00:05:12.624 18:51:29 -- spdk/autotest.sh@138 -- # timing_exit afterboot 00:05:12.624 18:51:29 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:12.624 18:51:29 -- common/autotest_common.sh@10 -- # set +x 00:05:12.624 18:51:29 -- spdk/autotest.sh@142 -- # opal_revert_cleanup 00:05:12.624 18:51:29 -- common/autotest_common.sh@1586 -- # mapfile -t bdfs 00:05:12.624 18:51:29 -- common/autotest_common.sh@1586 -- # get_nvme_bdfs_by_id 0x0a54 00:05:12.624 18:51:29 -- common/autotest_common.sh@1572 -- # bdfs=() 00:05:12.624 18:51:29 -- common/autotest_common.sh@1572 -- # local bdfs 00:05:12.624 18:51:29 -- common/autotest_common.sh@1574 -- # get_nvme_bdfs 00:05:12.624 18:51:29 -- common/autotest_common.sh@1508 -- # bdfs=() 00:05:12.624 18:51:29 -- common/autotest_common.sh@1508 -- # local bdfs 00:05:12.624 18:51:29 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:05:12.624 18:51:29 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:05:12.624 18:51:29 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:05:12.624 18:51:29 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:05:12.624 18:51:29 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:5e:00.0 00:05:12.624 18:51:29 -- common/autotest_common.sh@1574 -- # for bdf in $(get_nvme_bdfs) 00:05:12.624 18:51:29 -- common/autotest_common.sh@1575 -- # cat /sys/bus/pci/devices/0000:5e:00.0/device 00:05:12.624 18:51:29 -- common/autotest_common.sh@1575 -- # device=0x0a54 00:05:12.624 18:51:29 -- common/autotest_common.sh@1576 -- # [[ 0x0a54 == \0\x\0\a\5\4 ]] 00:05:12.624 18:51:29 -- common/autotest_common.sh@1577 -- # bdfs+=($bdf) 00:05:12.624 18:51:29 -- common/autotest_common.sh@1581 -- # printf '%s\n' 0000:5e:00.0 00:05:12.624 18:51:29 -- common/autotest_common.sh@1587 -- # [[ -z 0000:5e:00.0 ]] 00:05:12.624 18:51:29 -- common/autotest_common.sh@1592 -- # spdk_tgt_pid=2918843 00:05:12.624 18:51:29 -- common/autotest_common.sh@1593 -- # waitforlisten 2918843 00:05:12.624 18:51:29 -- common/autotest_common.sh@1591 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:05:12.624 18:51:29 -- common/autotest_common.sh@829 -- # '[' -z 2918843 ']' 00:05:12.624 18:51:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:12.624 18:51:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:12.624 18:51:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:12.624 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:12.624 18:51:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:12.624 18:51:29 -- common/autotest_common.sh@10 -- # set +x 00:05:12.624 [2024-11-26 18:51:29.469189] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:12.624 [2024-11-26 18:51:29.469233] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2918843 ] 00:05:12.624 EAL: No free 2048 kB hugepages reported on node 1 00:05:12.624 [2024-11-26 18:51:29.526128] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:12.882 [2024-11-26 18:51:29.566284] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:12.882 [2024-11-26 18:51:29.566409] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:13.447 18:51:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:13.447 18:51:30 -- common/autotest_common.sh@862 -- # return 0 00:05:13.447 18:51:30 -- common/autotest_common.sh@1595 -- # bdf_id=0 00:05:13.447 18:51:30 -- common/autotest_common.sh@1596 -- # for bdf in "${bdfs[@]}" 00:05:13.448 18:51:30 -- common/autotest_common.sh@1597 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b nvme0 -t pcie -a 0000:5e:00.0 00:05:16.733 nvme0n1 00:05:16.733 18:51:33 -- common/autotest_common.sh@1599 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_opal_revert -b nvme0 -p test 00:05:16.733 [2024-11-26 18:51:33.462568] vbdev_opal_rpc.c: 125:rpc_bdev_nvme_opal_revert: *ERROR*: nvme0 not support opal 00:05:16.733 request: 00:05:16.733 { 00:05:16.733 "nvme_ctrlr_name": "nvme0", 00:05:16.733 "password": "test", 00:05:16.733 "method": "bdev_nvme_opal_revert", 00:05:16.733 "req_id": 1 00:05:16.733 } 00:05:16.733 Got JSON-RPC error response 00:05:16.733 response: 00:05:16.733 { 00:05:16.733 "code": -32602, 00:05:16.733 "message": "Invalid parameters" 00:05:16.733 } 00:05:16.733 18:51:33 -- common/autotest_common.sh@1599 -- # true 00:05:16.733 18:51:33 -- common/autotest_common.sh@1600 -- # (( ++bdf_id )) 00:05:16.733 18:51:33 -- common/autotest_common.sh@1603 -- # killprocess 2918843 00:05:16.733 18:51:33 -- common/autotest_common.sh@936 -- # '[' -z 2918843 ']' 00:05:16.733 18:51:33 -- common/autotest_common.sh@940 -- # kill -0 2918843 00:05:16.733 18:51:33 -- common/autotest_common.sh@941 -- # uname 00:05:16.733 18:51:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:16.733 18:51:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2918843 00:05:16.733 18:51:33 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:16.733 18:51:33 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:16.733 18:51:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2918843' 00:05:16.733 killing process with pid 2918843 00:05:16.733 18:51:33 -- common/autotest_common.sh@955 -- # kill 2918843 00:05:16.733 18:51:33 -- common/autotest_common.sh@960 -- # wait 2918843 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.733 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:16.734 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:18.635 18:51:35 -- spdk/autotest.sh@148 -- # '[' 0 -eq 1 ']' 00:05:18.635 18:51:35 -- spdk/autotest.sh@152 -- # '[' 1 -eq 1 ']' 00:05:18.635 18:51:35 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:05:18.635 18:51:35 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:05:18.635 18:51:35 -- spdk/autotest.sh@160 -- # timing_enter lib 00:05:18.635 18:51:35 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:18.635 18:51:35 -- common/autotest_common.sh@10 -- # set +x 00:05:18.635 18:51:35 -- spdk/autotest.sh@162 -- # run_test env /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:05:18.635 18:51:35 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:18.635 18:51:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:18.635 18:51:35 -- common/autotest_common.sh@10 -- # set +x 00:05:18.635 ************************************ 00:05:18.635 START TEST env 00:05:18.636 ************************************ 00:05:18.636 18:51:35 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:05:18.636 * Looking for test storage... 00:05:18.636 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env 00:05:18.636 18:51:35 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:18.636 18:51:35 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:18.636 18:51:35 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:18.636 18:51:35 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:18.636 18:51:35 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:18.636 18:51:35 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:18.636 18:51:35 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:18.636 18:51:35 -- scripts/common.sh@335 -- # IFS=.-: 00:05:18.636 18:51:35 -- scripts/common.sh@335 -- # read -ra ver1 00:05:18.636 18:51:35 -- scripts/common.sh@336 -- # IFS=.-: 00:05:18.636 18:51:35 -- scripts/common.sh@336 -- # read -ra ver2 00:05:18.636 18:51:35 -- scripts/common.sh@337 -- # local 'op=<' 00:05:18.636 18:51:35 -- scripts/common.sh@339 -- # ver1_l=2 00:05:18.636 18:51:35 -- scripts/common.sh@340 -- # ver2_l=1 00:05:18.636 18:51:35 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:18.636 18:51:35 -- scripts/common.sh@343 -- # case "$op" in 00:05:18.636 18:51:35 -- scripts/common.sh@344 -- # : 1 00:05:18.636 18:51:35 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:18.636 18:51:35 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:18.636 18:51:35 -- scripts/common.sh@364 -- # decimal 1 00:05:18.636 18:51:35 -- scripts/common.sh@352 -- # local d=1 00:05:18.636 18:51:35 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:18.636 18:51:35 -- scripts/common.sh@354 -- # echo 1 00:05:18.636 18:51:35 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:18.636 18:51:35 -- scripts/common.sh@365 -- # decimal 2 00:05:18.636 18:51:35 -- scripts/common.sh@352 -- # local d=2 00:05:18.636 18:51:35 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:18.636 18:51:35 -- scripts/common.sh@354 -- # echo 2 00:05:18.636 18:51:35 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:18.636 18:51:35 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:18.636 18:51:35 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:18.636 18:51:35 -- scripts/common.sh@367 -- # return 0 00:05:18.636 18:51:35 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:18.636 18:51:35 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:18.636 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:18.636 --rc genhtml_branch_coverage=1 00:05:18.636 --rc genhtml_function_coverage=1 00:05:18.636 --rc genhtml_legend=1 00:05:18.636 --rc geninfo_all_blocks=1 00:05:18.636 --rc geninfo_unexecuted_blocks=1 00:05:18.636 00:05:18.636 ' 00:05:18.636 18:51:35 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:18.636 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:18.636 --rc genhtml_branch_coverage=1 00:05:18.636 --rc genhtml_function_coverage=1 00:05:18.636 --rc genhtml_legend=1 00:05:18.636 --rc geninfo_all_blocks=1 00:05:18.636 --rc geninfo_unexecuted_blocks=1 00:05:18.636 00:05:18.636 ' 00:05:18.636 18:51:35 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:18.636 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:18.636 --rc genhtml_branch_coverage=1 00:05:18.636 --rc genhtml_function_coverage=1 00:05:18.636 --rc genhtml_legend=1 00:05:18.636 --rc geninfo_all_blocks=1 00:05:18.636 --rc geninfo_unexecuted_blocks=1 00:05:18.636 00:05:18.636 ' 00:05:18.636 18:51:35 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:18.636 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:18.636 --rc genhtml_branch_coverage=1 00:05:18.636 --rc genhtml_function_coverage=1 00:05:18.636 --rc genhtml_legend=1 00:05:18.636 --rc geninfo_all_blocks=1 00:05:18.636 --rc geninfo_unexecuted_blocks=1 00:05:18.636 00:05:18.636 ' 00:05:18.636 18:51:35 -- env/env.sh@10 -- # run_test env_memory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:05:18.636 18:51:35 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:18.636 18:51:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:18.636 18:51:35 -- common/autotest_common.sh@10 -- # set +x 00:05:18.636 ************************************ 00:05:18.636 START TEST env_memory 00:05:18.636 ************************************ 00:05:18.636 18:51:35 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:05:18.636 00:05:18.636 00:05:18.636 CUnit - A unit testing framework for C - Version 2.1-3 00:05:18.636 http://cunit.sourceforge.net/ 00:05:18.636 00:05:18.636 00:05:18.636 Suite: memory 00:05:18.636 Test: alloc and free memory map ...[2024-11-26 18:51:35.334711] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 283:spdk_mem_map_alloc: *ERROR*: Initial mem_map notify failed 00:05:18.636 passed 00:05:18.636 Test: mem map translation ...[2024-11-26 18:51:35.354107] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=2097152 len=1234 00:05:18.636 [2024-11-26 18:51:35.354121] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=1234 len=2097152 00:05:18.636 [2024-11-26 18:51:35.354157] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 584:spdk_mem_map_set_translation: *ERROR*: invalid usermode virtual address 281474976710656 00:05:18.636 [2024-11-26 18:51:35.354163] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 600:spdk_mem_map_set_translation: *ERROR*: could not get 0xffffffe00000 map 00:05:18.636 passed 00:05:18.636 Test: mem map registration ...[2024-11-26 18:51:35.393610] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x200000 len=1234 00:05:18.636 [2024-11-26 18:51:35.393624] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x4d2 len=2097152 00:05:18.636 passed 00:05:18.636 Test: mem map adjacent registrations ...passed 00:05:18.636 00:05:18.636 Run Summary: Type Total Ran Passed Failed Inactive 00:05:18.636 suites 1 1 n/a 0 0 00:05:18.636 tests 4 4 4 0 0 00:05:18.636 asserts 152 152 152 0 n/a 00:05:18.636 00:05:18.636 Elapsed time = 0.145 seconds 00:05:18.636 00:05:18.636 real 0m0.157s 00:05:18.636 user 0m0.143s 00:05:18.636 sys 0m0.014s 00:05:18.636 18:51:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:18.636 18:51:35 -- common/autotest_common.sh@10 -- # set +x 00:05:18.636 ************************************ 00:05:18.636 END TEST env_memory 00:05:18.636 ************************************ 00:05:18.636 18:51:35 -- env/env.sh@11 -- # run_test env_vtophys /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:05:18.636 18:51:35 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:18.636 18:51:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:18.636 18:51:35 -- common/autotest_common.sh@10 -- # set +x 00:05:18.636 ************************************ 00:05:18.636 START TEST env_vtophys 00:05:18.636 ************************************ 00:05:18.636 18:51:35 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:05:18.636 EAL: lib.eal log level changed from notice to debug 00:05:18.636 EAL: Detected lcore 0 as core 0 on socket 0 00:05:18.636 EAL: Detected lcore 1 as core 1 on socket 0 00:05:18.636 EAL: Detected lcore 2 as core 2 on socket 0 00:05:18.636 EAL: Detected lcore 3 as core 3 on socket 0 00:05:18.636 EAL: Detected lcore 4 as core 4 on socket 0 00:05:18.636 EAL: Detected lcore 5 as core 5 on socket 0 00:05:18.636 EAL: Detected lcore 6 as core 6 on socket 0 00:05:18.636 EAL: Detected lcore 7 as core 8 on socket 0 00:05:18.636 EAL: Detected lcore 8 as core 9 on socket 0 00:05:18.636 EAL: Detected lcore 9 as core 10 on socket 0 00:05:18.636 EAL: Detected lcore 10 as core 11 on socket 0 00:05:18.636 EAL: Detected lcore 11 as core 12 on socket 0 00:05:18.636 EAL: Detected lcore 12 as core 13 on socket 0 00:05:18.636 EAL: Detected lcore 13 as core 16 on socket 0 00:05:18.636 EAL: Detected lcore 14 as core 17 on socket 0 00:05:18.636 EAL: Detected lcore 15 as core 18 on socket 0 00:05:18.636 EAL: Detected lcore 16 as core 19 on socket 0 00:05:18.636 EAL: Detected lcore 17 as core 20 on socket 0 00:05:18.636 EAL: Detected lcore 18 as core 21 on socket 0 00:05:18.636 EAL: Detected lcore 19 as core 25 on socket 0 00:05:18.636 EAL: Detected lcore 20 as core 26 on socket 0 00:05:18.636 EAL: Detected lcore 21 as core 27 on socket 0 00:05:18.636 EAL: Detected lcore 22 as core 28 on socket 0 00:05:18.636 EAL: Detected lcore 23 as core 29 on socket 0 00:05:18.636 EAL: Detected lcore 24 as core 0 on socket 1 00:05:18.636 EAL: Detected lcore 25 as core 1 on socket 1 00:05:18.636 EAL: Detected lcore 26 as core 2 on socket 1 00:05:18.636 EAL: Detected lcore 27 as core 3 on socket 1 00:05:18.636 EAL: Detected lcore 28 as core 4 on socket 1 00:05:18.636 EAL: Detected lcore 29 as core 5 on socket 1 00:05:18.636 EAL: Detected lcore 30 as core 6 on socket 1 00:05:18.636 EAL: Detected lcore 31 as core 9 on socket 1 00:05:18.636 EAL: Detected lcore 32 as core 10 on socket 1 00:05:18.636 EAL: Detected lcore 33 as core 11 on socket 1 00:05:18.636 EAL: Detected lcore 34 as core 12 on socket 1 00:05:18.636 EAL: Detected lcore 35 as core 13 on socket 1 00:05:18.636 EAL: Detected lcore 36 as core 16 on socket 1 00:05:18.636 EAL: Detected lcore 37 as core 17 on socket 1 00:05:18.636 EAL: Detected lcore 38 as core 18 on socket 1 00:05:18.636 EAL: Detected lcore 39 as core 19 on socket 1 00:05:18.636 EAL: Detected lcore 40 as core 20 on socket 1 00:05:18.636 EAL: Detected lcore 41 as core 21 on socket 1 00:05:18.636 EAL: Detected lcore 42 as core 24 on socket 1 00:05:18.636 EAL: Detected lcore 43 as core 25 on socket 1 00:05:18.636 EAL: Detected lcore 44 as core 26 on socket 1 00:05:18.636 EAL: Detected lcore 45 as core 27 on socket 1 00:05:18.636 EAL: Detected lcore 46 as core 28 on socket 1 00:05:18.636 EAL: Detected lcore 47 as core 29 on socket 1 00:05:18.636 EAL: Detected lcore 48 as core 0 on socket 0 00:05:18.636 EAL: Detected lcore 49 as core 1 on socket 0 00:05:18.636 EAL: Detected lcore 50 as core 2 on socket 0 00:05:18.636 EAL: Detected lcore 51 as core 3 on socket 0 00:05:18.637 EAL: Detected lcore 52 as core 4 on socket 0 00:05:18.637 EAL: Detected lcore 53 as core 5 on socket 0 00:05:18.637 EAL: Detected lcore 54 as core 6 on socket 0 00:05:18.637 EAL: Detected lcore 55 as core 8 on socket 0 00:05:18.637 EAL: Detected lcore 56 as core 9 on socket 0 00:05:18.637 EAL: Detected lcore 57 as core 10 on socket 0 00:05:18.637 EAL: Detected lcore 58 as core 11 on socket 0 00:05:18.637 EAL: Detected lcore 59 as core 12 on socket 0 00:05:18.637 EAL: Detected lcore 60 as core 13 on socket 0 00:05:18.637 EAL: Detected lcore 61 as core 16 on socket 0 00:05:18.637 EAL: Detected lcore 62 as core 17 on socket 0 00:05:18.637 EAL: Detected lcore 63 as core 18 on socket 0 00:05:18.637 EAL: Detected lcore 64 as core 19 on socket 0 00:05:18.637 EAL: Detected lcore 65 as core 20 on socket 0 00:05:18.637 EAL: Detected lcore 66 as core 21 on socket 0 00:05:18.637 EAL: Detected lcore 67 as core 25 on socket 0 00:05:18.637 EAL: Detected lcore 68 as core 26 on socket 0 00:05:18.637 EAL: Detected lcore 69 as core 27 on socket 0 00:05:18.637 EAL: Detected lcore 70 as core 28 on socket 0 00:05:18.637 EAL: Detected lcore 71 as core 29 on socket 0 00:05:18.637 EAL: Detected lcore 72 as core 0 on socket 1 00:05:18.637 EAL: Detected lcore 73 as core 1 on socket 1 00:05:18.637 EAL: Detected lcore 74 as core 2 on socket 1 00:05:18.637 EAL: Detected lcore 75 as core 3 on socket 1 00:05:18.637 EAL: Detected lcore 76 as core 4 on socket 1 00:05:18.637 EAL: Detected lcore 77 as core 5 on socket 1 00:05:18.637 EAL: Detected lcore 78 as core 6 on socket 1 00:05:18.637 EAL: Detected lcore 79 as core 9 on socket 1 00:05:18.637 EAL: Detected lcore 80 as core 10 on socket 1 00:05:18.637 EAL: Detected lcore 81 as core 11 on socket 1 00:05:18.637 EAL: Detected lcore 82 as core 12 on socket 1 00:05:18.637 EAL: Detected lcore 83 as core 13 on socket 1 00:05:18.637 EAL: Detected lcore 84 as core 16 on socket 1 00:05:18.637 EAL: Detected lcore 85 as core 17 on socket 1 00:05:18.637 EAL: Detected lcore 86 as core 18 on socket 1 00:05:18.637 EAL: Detected lcore 87 as core 19 on socket 1 00:05:18.637 EAL: Detected lcore 88 as core 20 on socket 1 00:05:18.637 EAL: Detected lcore 89 as core 21 on socket 1 00:05:18.637 EAL: Detected lcore 90 as core 24 on socket 1 00:05:18.637 EAL: Detected lcore 91 as core 25 on socket 1 00:05:18.637 EAL: Detected lcore 92 as core 26 on socket 1 00:05:18.637 EAL: Detected lcore 93 as core 27 on socket 1 00:05:18.637 EAL: Detected lcore 94 as core 28 on socket 1 00:05:18.637 EAL: Detected lcore 95 as core 29 on socket 1 00:05:18.637 EAL: Maximum logical cores by configuration: 128 00:05:18.637 EAL: Detected CPU lcores: 96 00:05:18.637 EAL: Detected NUMA nodes: 2 00:05:18.637 EAL: Checking presence of .so 'librte_eal.so.23.0' 00:05:18.637 EAL: Detected shared linkage of DPDK 00:05:18.637 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_pci.so.23.0 00:05:18.637 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_vdev.so.23.0 00:05:18.637 EAL: Registered [vdev] bus. 00:05:18.637 EAL: bus.vdev log level changed from disabled to notice 00:05:18.637 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_mempool_ring.so.23.0 00:05:18.637 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_net_i40e.so.23.0 00:05:18.637 EAL: pmd.net.i40e.init log level changed from disabled to notice 00:05:18.637 EAL: pmd.net.i40e.driver log level changed from disabled to notice 00:05:18.637 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_pci.so 00:05:18.637 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_vdev.so 00:05:18.637 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_mempool_ring.so 00:05:18.637 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_net_i40e.so 00:05:18.637 EAL: No shared files mode enabled, IPC will be disabled 00:05:18.637 EAL: No shared files mode enabled, IPC is disabled 00:05:18.637 EAL: Bus pci wants IOVA as 'DC' 00:05:18.637 EAL: Bus vdev wants IOVA as 'DC' 00:05:18.637 EAL: Buses did not request a specific IOVA mode. 00:05:18.637 EAL: IOMMU is available, selecting IOVA as VA mode. 00:05:18.637 EAL: Selected IOVA mode 'VA' 00:05:18.637 EAL: No free 2048 kB hugepages reported on node 1 00:05:18.637 EAL: Probing VFIO support... 00:05:18.637 EAL: IOMMU type 1 (Type 1) is supported 00:05:18.637 EAL: IOMMU type 7 (sPAPR) is not supported 00:05:18.637 EAL: IOMMU type 8 (No-IOMMU) is not supported 00:05:18.637 EAL: VFIO support initialized 00:05:18.637 EAL: Ask a virtual area of 0x2e000 bytes 00:05:18.637 EAL: Virtual area found at 0x200000000000 (size = 0x2e000) 00:05:18.637 EAL: Setting up physically contiguous memory... 00:05:18.637 EAL: Setting maximum number of open files to 524288 00:05:18.637 EAL: Detected memory type: socket_id:0 hugepage_sz:2097152 00:05:18.637 EAL: Detected memory type: socket_id:1 hugepage_sz:2097152 00:05:18.637 EAL: Creating 4 segment lists: n_segs:8192 socket_id:0 hugepage_sz:2097152 00:05:18.637 EAL: Ask a virtual area of 0x61000 bytes 00:05:18.637 EAL: Virtual area found at 0x20000002e000 (size = 0x61000) 00:05:18.637 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:18.637 EAL: Ask a virtual area of 0x400000000 bytes 00:05:18.637 EAL: Virtual area found at 0x200000200000 (size = 0x400000000) 00:05:18.637 EAL: VA reserved for memseg list at 0x200000200000, size 400000000 00:05:18.637 EAL: Ask a virtual area of 0x61000 bytes 00:05:18.637 EAL: Virtual area found at 0x200400200000 (size = 0x61000) 00:05:18.637 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:18.637 EAL: Ask a virtual area of 0x400000000 bytes 00:05:18.637 EAL: Virtual area found at 0x200400400000 (size = 0x400000000) 00:05:18.637 EAL: VA reserved for memseg list at 0x200400400000, size 400000000 00:05:18.637 EAL: Ask a virtual area of 0x61000 bytes 00:05:18.637 EAL: Virtual area found at 0x200800400000 (size = 0x61000) 00:05:18.637 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:18.637 EAL: Ask a virtual area of 0x400000000 bytes 00:05:18.637 EAL: Virtual area found at 0x200800600000 (size = 0x400000000) 00:05:18.637 EAL: VA reserved for memseg list at 0x200800600000, size 400000000 00:05:18.637 EAL: Ask a virtual area of 0x61000 bytes 00:05:18.637 EAL: Virtual area found at 0x200c00600000 (size = 0x61000) 00:05:18.637 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:18.637 EAL: Ask a virtual area of 0x400000000 bytes 00:05:18.637 EAL: Virtual area found at 0x200c00800000 (size = 0x400000000) 00:05:18.637 EAL: VA reserved for memseg list at 0x200c00800000, size 400000000 00:05:18.637 EAL: Creating 4 segment lists: n_segs:8192 socket_id:1 hugepage_sz:2097152 00:05:18.637 EAL: Ask a virtual area of 0x61000 bytes 00:05:18.637 EAL: Virtual area found at 0x201000800000 (size = 0x61000) 00:05:18.637 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:18.637 EAL: Ask a virtual area of 0x400000000 bytes 00:05:18.637 EAL: Virtual area found at 0x201000a00000 (size = 0x400000000) 00:05:18.637 EAL: VA reserved for memseg list at 0x201000a00000, size 400000000 00:05:18.637 EAL: Ask a virtual area of 0x61000 bytes 00:05:18.637 EAL: Virtual area found at 0x201400a00000 (size = 0x61000) 00:05:18.637 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:18.637 EAL: Ask a virtual area of 0x400000000 bytes 00:05:18.637 EAL: Virtual area found at 0x201400c00000 (size = 0x400000000) 00:05:18.637 EAL: VA reserved for memseg list at 0x201400c00000, size 400000000 00:05:18.637 EAL: Ask a virtual area of 0x61000 bytes 00:05:18.637 EAL: Virtual area found at 0x201800c00000 (size = 0x61000) 00:05:18.637 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:18.637 EAL: Ask a virtual area of 0x400000000 bytes 00:05:18.637 EAL: Virtual area found at 0x201800e00000 (size = 0x400000000) 00:05:18.637 EAL: VA reserved for memseg list at 0x201800e00000, size 400000000 00:05:18.637 EAL: Ask a virtual area of 0x61000 bytes 00:05:18.637 EAL: Virtual area found at 0x201c00e00000 (size = 0x61000) 00:05:18.637 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:18.637 EAL: Ask a virtual area of 0x400000000 bytes 00:05:18.637 EAL: Virtual area found at 0x201c01000000 (size = 0x400000000) 00:05:18.637 EAL: VA reserved for memseg list at 0x201c01000000, size 400000000 00:05:18.637 EAL: Hugepages will be freed exactly as allocated. 00:05:18.637 EAL: No shared files mode enabled, IPC is disabled 00:05:18.637 EAL: No shared files mode enabled, IPC is disabled 00:05:18.637 EAL: TSC frequency is ~2300000 KHz 00:05:18.637 EAL: Main lcore 0 is ready (tid=7ff8681dca00;cpuset=[0]) 00:05:18.637 EAL: Trying to obtain current memory policy. 00:05:18.637 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:18.637 EAL: Restoring previous memory policy: 0 00:05:18.637 EAL: request: mp_malloc_sync 00:05:18.637 EAL: No shared files mode enabled, IPC is disabled 00:05:18.637 EAL: Heap on socket 0 was expanded by 2MB 00:05:18.637 EAL: PCI device 0000:3d:00.0 on NUMA socket 0 00:05:18.637 EAL: probe driver: 8086:37d2 net_i40e 00:05:18.637 EAL: Not managed by a supported kernel driver, skipped 00:05:18.637 EAL: PCI device 0000:3d:00.1 on NUMA socket 0 00:05:18.637 EAL: probe driver: 8086:37d2 net_i40e 00:05:18.637 EAL: Not managed by a supported kernel driver, skipped 00:05:18.637 EAL: No shared files mode enabled, IPC is disabled 00:05:18.637 EAL: No shared files mode enabled, IPC is disabled 00:05:18.637 EAL: No PCI address specified using 'addr=' in: bus=pci 00:05:18.637 EAL: Mem event callback 'spdk:(nil)' registered 00:05:18.896 00:05:18.896 00:05:18.896 CUnit - A unit testing framework for C - Version 2.1-3 00:05:18.896 http://cunit.sourceforge.net/ 00:05:18.896 00:05:18.896 00:05:18.896 Suite: components_suite 00:05:18.896 Test: vtophys_malloc_test ...passed 00:05:18.896 Test: vtophys_spdk_malloc_test ...EAL: Trying to obtain current memory policy. 00:05:18.896 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:18.896 EAL: Restoring previous memory policy: 4 00:05:18.896 EAL: Calling mem event callback 'spdk:(nil)' 00:05:18.896 EAL: request: mp_malloc_sync 00:05:18.896 EAL: No shared files mode enabled, IPC is disabled 00:05:18.896 EAL: Heap on socket 0 was expanded by 4MB 00:05:18.896 EAL: Calling mem event callback 'spdk:(nil)' 00:05:18.896 EAL: request: mp_malloc_sync 00:05:18.896 EAL: No shared files mode enabled, IPC is disabled 00:05:18.896 EAL: Heap on socket 0 was shrunk by 4MB 00:05:18.896 EAL: Trying to obtain current memory policy. 00:05:18.896 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:18.896 EAL: Restoring previous memory policy: 4 00:05:18.896 EAL: Calling mem event callback 'spdk:(nil)' 00:05:18.896 EAL: request: mp_malloc_sync 00:05:18.896 EAL: No shared files mode enabled, IPC is disabled 00:05:18.896 EAL: Heap on socket 0 was expanded by 6MB 00:05:18.896 EAL: Calling mem event callback 'spdk:(nil)' 00:05:18.896 EAL: request: mp_malloc_sync 00:05:18.896 EAL: No shared files mode enabled, IPC is disabled 00:05:18.896 EAL: Heap on socket 0 was shrunk by 6MB 00:05:18.896 EAL: Trying to obtain current memory policy. 00:05:18.896 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:18.896 EAL: Restoring previous memory policy: 4 00:05:18.896 EAL: Calling mem event callback 'spdk:(nil)' 00:05:18.896 EAL: request: mp_malloc_sync 00:05:18.896 EAL: No shared files mode enabled, IPC is disabled 00:05:18.896 EAL: Heap on socket 0 was expanded by 10MB 00:05:18.896 EAL: Calling mem event callback 'spdk:(nil)' 00:05:18.896 EAL: request: mp_malloc_sync 00:05:18.896 EAL: No shared files mode enabled, IPC is disabled 00:05:18.896 EAL: Heap on socket 0 was shrunk by 10MB 00:05:18.896 EAL: Trying to obtain current memory policy. 00:05:18.896 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:18.896 EAL: Restoring previous memory policy: 4 00:05:18.896 EAL: Calling mem event callback 'spdk:(nil)' 00:05:18.896 EAL: request: mp_malloc_sync 00:05:18.896 EAL: No shared files mode enabled, IPC is disabled 00:05:18.896 EAL: Heap on socket 0 was expanded by 18MB 00:05:18.896 EAL: Calling mem event callback 'spdk:(nil)' 00:05:18.896 EAL: request: mp_malloc_sync 00:05:18.896 EAL: No shared files mode enabled, IPC is disabled 00:05:18.896 EAL: Heap on socket 0 was shrunk by 18MB 00:05:18.896 EAL: Trying to obtain current memory policy. 00:05:18.896 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:18.896 EAL: Restoring previous memory policy: 4 00:05:18.896 EAL: Calling mem event callback 'spdk:(nil)' 00:05:18.896 EAL: request: mp_malloc_sync 00:05:18.896 EAL: No shared files mode enabled, IPC is disabled 00:05:18.896 EAL: Heap on socket 0 was expanded by 34MB 00:05:18.896 EAL: Calling mem event callback 'spdk:(nil)' 00:05:18.896 EAL: request: mp_malloc_sync 00:05:18.896 EAL: No shared files mode enabled, IPC is disabled 00:05:18.896 EAL: Heap on socket 0 was shrunk by 34MB 00:05:18.896 EAL: Trying to obtain current memory policy. 00:05:18.896 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:18.896 EAL: Restoring previous memory policy: 4 00:05:18.896 EAL: Calling mem event callback 'spdk:(nil)' 00:05:18.896 EAL: request: mp_malloc_sync 00:05:18.896 EAL: No shared files mode enabled, IPC is disabled 00:05:18.896 EAL: Heap on socket 0 was expanded by 66MB 00:05:18.896 EAL: Calling mem event callback 'spdk:(nil)' 00:05:18.896 EAL: request: mp_malloc_sync 00:05:18.896 EAL: No shared files mode enabled, IPC is disabled 00:05:18.896 EAL: Heap on socket 0 was shrunk by 66MB 00:05:18.896 EAL: Trying to obtain current memory policy. 00:05:18.896 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:18.896 EAL: Restoring previous memory policy: 4 00:05:18.896 EAL: Calling mem event callback 'spdk:(nil)' 00:05:18.896 EAL: request: mp_malloc_sync 00:05:18.896 EAL: No shared files mode enabled, IPC is disabled 00:05:18.896 EAL: Heap on socket 0 was expanded by 130MB 00:05:18.896 EAL: Calling mem event callback 'spdk:(nil)' 00:05:18.896 EAL: request: mp_malloc_sync 00:05:18.896 EAL: No shared files mode enabled, IPC is disabled 00:05:18.896 EAL: Heap on socket 0 was shrunk by 130MB 00:05:18.896 EAL: Trying to obtain current memory policy. 00:05:18.896 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:18.896 EAL: Restoring previous memory policy: 4 00:05:18.896 EAL: Calling mem event callback 'spdk:(nil)' 00:05:18.896 EAL: request: mp_malloc_sync 00:05:18.896 EAL: No shared files mode enabled, IPC is disabled 00:05:18.896 EAL: Heap on socket 0 was expanded by 258MB 00:05:18.896 EAL: Calling mem event callback 'spdk:(nil)' 00:05:18.897 EAL: request: mp_malloc_sync 00:05:18.897 EAL: No shared files mode enabled, IPC is disabled 00:05:18.897 EAL: Heap on socket 0 was shrunk by 258MB 00:05:18.897 EAL: Trying to obtain current memory policy. 00:05:18.897 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:19.155 EAL: Restoring previous memory policy: 4 00:05:19.155 EAL: Calling mem event callback 'spdk:(nil)' 00:05:19.155 EAL: request: mp_malloc_sync 00:05:19.155 EAL: No shared files mode enabled, IPC is disabled 00:05:19.155 EAL: Heap on socket 0 was expanded by 514MB 00:05:19.155 EAL: Calling mem event callback 'spdk:(nil)' 00:05:19.155 EAL: request: mp_malloc_sync 00:05:19.155 EAL: No shared files mode enabled, IPC is disabled 00:05:19.155 EAL: Heap on socket 0 was shrunk by 514MB 00:05:19.155 EAL: Trying to obtain current memory policy. 00:05:19.155 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:19.414 EAL: Restoring previous memory policy: 4 00:05:19.414 EAL: Calling mem event callback 'spdk:(nil)' 00:05:19.414 EAL: request: mp_malloc_sync 00:05:19.414 EAL: No shared files mode enabled, IPC is disabled 00:05:19.414 EAL: Heap on socket 0 was expanded by 1026MB 00:05:19.672 EAL: Calling mem event callback 'spdk:(nil)' 00:05:19.672 EAL: request: mp_malloc_sync 00:05:19.672 EAL: No shared files mode enabled, IPC is disabled 00:05:19.672 EAL: Heap on socket 0 was shrunk by 1026MB 00:05:19.672 passed 00:05:19.672 00:05:19.672 Run Summary: Type Total Ran Passed Failed Inactive 00:05:19.672 suites 1 1 n/a 0 0 00:05:19.672 tests 2 2 2 0 0 00:05:19.672 asserts 497 497 497 0 n/a 00:05:19.672 00:05:19.672 Elapsed time = 0.963 seconds 00:05:19.672 EAL: Calling mem event callback 'spdk:(nil)' 00:05:19.672 EAL: request: mp_malloc_sync 00:05:19.672 EAL: No shared files mode enabled, IPC is disabled 00:05:19.672 EAL: Heap on socket 0 was shrunk by 2MB 00:05:19.672 EAL: No shared files mode enabled, IPC is disabled 00:05:19.672 EAL: No shared files mode enabled, IPC is disabled 00:05:19.672 EAL: No shared files mode enabled, IPC is disabled 00:05:19.672 00:05:19.672 real 0m1.083s 00:05:19.672 user 0m0.626s 00:05:19.672 sys 0m0.421s 00:05:19.672 18:51:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:19.672 18:51:36 -- common/autotest_common.sh@10 -- # set +x 00:05:19.672 ************************************ 00:05:19.672 END TEST env_vtophys 00:05:19.672 ************************************ 00:05:19.931 18:51:36 -- env/env.sh@12 -- # run_test env_pci /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:05:19.931 18:51:36 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:19.931 18:51:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:19.931 18:51:36 -- common/autotest_common.sh@10 -- # set +x 00:05:19.931 ************************************ 00:05:19.931 START TEST env_pci 00:05:19.931 ************************************ 00:05:19.931 18:51:36 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:05:19.931 00:05:19.931 00:05:19.931 CUnit - A unit testing framework for C - Version 2.1-3 00:05:19.931 http://cunit.sourceforge.net/ 00:05:19.931 00:05:19.931 00:05:19.931 Suite: pci 00:05:19.931 Test: pci_hook ...[2024-11-26 18:51:36.621677] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/pci.c:1040:spdk_pci_device_claim: *ERROR*: Cannot create lock on device /var/tmp/spdk_pci_lock_10000:00:01.0, probably process 2920165 has claimed it 00:05:19.931 EAL: Cannot find device (10000:00:01.0) 00:05:19.931 EAL: Failed to attach device on primary process 00:05:19.931 passed 00:05:19.931 00:05:19.931 Run Summary: Type Total Ran Passed Failed Inactive 00:05:19.931 suites 1 1 n/a 0 0 00:05:19.931 tests 1 1 1 0 0 00:05:19.931 asserts 25 25 25 0 n/a 00:05:19.931 00:05:19.931 Elapsed time = 0.029 seconds 00:05:19.931 00:05:19.931 real 0m0.047s 00:05:19.931 user 0m0.015s 00:05:19.931 sys 0m0.032s 00:05:19.931 18:51:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:19.931 18:51:36 -- common/autotest_common.sh@10 -- # set +x 00:05:19.931 ************************************ 00:05:19.931 END TEST env_pci 00:05:19.931 ************************************ 00:05:19.931 18:51:36 -- env/env.sh@14 -- # argv='-c 0x1 ' 00:05:19.931 18:51:36 -- env/env.sh@15 -- # uname 00:05:19.931 18:51:36 -- env/env.sh@15 -- # '[' Linux = Linux ']' 00:05:19.931 18:51:36 -- env/env.sh@22 -- # argv+=--base-virtaddr=0x200000000000 00:05:19.931 18:51:36 -- env/env.sh@24 -- # run_test env_dpdk_post_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:05:19.931 18:51:36 -- common/autotest_common.sh@1087 -- # '[' 5 -le 1 ']' 00:05:19.931 18:51:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:19.931 18:51:36 -- common/autotest_common.sh@10 -- # set +x 00:05:19.931 ************************************ 00:05:19.931 START TEST env_dpdk_post_init 00:05:19.931 ************************************ 00:05:19.931 18:51:36 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:05:19.931 EAL: Detected CPU lcores: 96 00:05:19.931 EAL: Detected NUMA nodes: 2 00:05:19.931 EAL: Detected shared linkage of DPDK 00:05:19.931 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:05:19.931 EAL: Selected IOVA mode 'VA' 00:05:19.931 EAL: No free 2048 kB hugepages reported on node 1 00:05:19.931 EAL: VFIO support initialized 00:05:19.931 TELEMETRY: No legacy callbacks, legacy socket not created 00:05:19.931 EAL: Using IOMMU type 1 (Type 1) 00:05:19.931 EAL: Ignore mapping IO port bar(1) 00:05:19.931 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.0 (socket 0) 00:05:19.931 EAL: Ignore mapping IO port bar(1) 00:05:19.931 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.1 (socket 0) 00:05:19.931 EAL: Ignore mapping IO port bar(1) 00:05:19.931 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.2 (socket 0) 00:05:19.931 EAL: Ignore mapping IO port bar(1) 00:05:19.931 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.3 (socket 0) 00:05:20.189 EAL: Ignore mapping IO port bar(1) 00:05:20.189 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.4 (socket 0) 00:05:20.189 EAL: Ignore mapping IO port bar(1) 00:05:20.189 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.5 (socket 0) 00:05:20.189 EAL: Ignore mapping IO port bar(1) 00:05:20.189 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.6 (socket 0) 00:05:20.189 EAL: Ignore mapping IO port bar(1) 00:05:20.190 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.7 (socket 0) 00:05:20.756 EAL: Probe PCI driver: spdk_nvme (8086:0a54) device: 0000:5e:00.0 (socket 0) 00:05:20.756 EAL: Ignore mapping IO port bar(1) 00:05:20.756 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.0 (socket 1) 00:05:20.756 EAL: Ignore mapping IO port bar(1) 00:05:20.756 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.1 (socket 1) 00:05:20.756 EAL: Ignore mapping IO port bar(1) 00:05:20.756 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.2 (socket 1) 00:05:20.756 EAL: Ignore mapping IO port bar(1) 00:05:20.756 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.3 (socket 1) 00:05:21.014 EAL: Ignore mapping IO port bar(1) 00:05:21.014 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.4 (socket 1) 00:05:21.014 EAL: Ignore mapping IO port bar(1) 00:05:21.014 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.5 (socket 1) 00:05:21.014 EAL: Ignore mapping IO port bar(1) 00:05:21.014 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.6 (socket 1) 00:05:21.014 EAL: Ignore mapping IO port bar(1) 00:05:21.014 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.7 (socket 1) 00:05:24.308 EAL: Releasing PCI mapped resource for 0000:5e:00.0 00:05:24.308 EAL: Calling pci_unmap_resource for 0000:5e:00.0 at 0x202001020000 00:05:24.308 Starting DPDK initialization... 00:05:24.308 Starting SPDK post initialization... 00:05:24.308 SPDK NVMe probe 00:05:24.308 Attaching to 0000:5e:00.0 00:05:24.308 Attached to 0000:5e:00.0 00:05:24.308 Cleaning up... 00:05:24.308 00:05:24.308 real 0m4.336s 00:05:24.308 user 0m3.246s 00:05:24.308 sys 0m0.167s 00:05:24.308 18:51:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:24.308 18:51:41 -- common/autotest_common.sh@10 -- # set +x 00:05:24.308 ************************************ 00:05:24.308 END TEST env_dpdk_post_init 00:05:24.308 ************************************ 00:05:24.308 18:51:41 -- env/env.sh@26 -- # uname 00:05:24.308 18:51:41 -- env/env.sh@26 -- # '[' Linux = Linux ']' 00:05:24.308 18:51:41 -- env/env.sh@29 -- # run_test env_mem_callbacks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:05:24.308 18:51:41 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:24.308 18:51:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:24.308 18:51:41 -- common/autotest_common.sh@10 -- # set +x 00:05:24.308 ************************************ 00:05:24.308 START TEST env_mem_callbacks 00:05:24.308 ************************************ 00:05:24.308 18:51:41 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:05:24.308 EAL: Detected CPU lcores: 96 00:05:24.308 EAL: Detected NUMA nodes: 2 00:05:24.308 EAL: Detected shared linkage of DPDK 00:05:24.308 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:05:24.308 EAL: Selected IOVA mode 'VA' 00:05:24.309 EAL: No free 2048 kB hugepages reported on node 1 00:05:24.309 EAL: VFIO support initialized 00:05:24.309 TELEMETRY: No legacy callbacks, legacy socket not created 00:05:24.309 00:05:24.309 00:05:24.309 CUnit - A unit testing framework for C - Version 2.1-3 00:05:24.309 http://cunit.sourceforge.net/ 00:05:24.309 00:05:24.309 00:05:24.309 Suite: memory 00:05:24.309 Test: test ... 00:05:24.309 register 0x200000200000 2097152 00:05:24.309 malloc 3145728 00:05:24.309 register 0x200000400000 4194304 00:05:24.309 buf 0x200000500000 len 3145728 PASSED 00:05:24.309 malloc 64 00:05:24.309 buf 0x2000004fff40 len 64 PASSED 00:05:24.309 malloc 4194304 00:05:24.309 register 0x200000800000 6291456 00:05:24.309 buf 0x200000a00000 len 4194304 PASSED 00:05:24.309 free 0x200000500000 3145728 00:05:24.309 free 0x2000004fff40 64 00:05:24.309 unregister 0x200000400000 4194304 PASSED 00:05:24.309 free 0x200000a00000 4194304 00:05:24.309 unregister 0x200000800000 6291456 PASSED 00:05:24.309 malloc 8388608 00:05:24.309 register 0x200000400000 10485760 00:05:24.309 buf 0x200000600000 len 8388608 PASSED 00:05:24.309 free 0x200000600000 8388608 00:05:24.309 unregister 0x200000400000 10485760 PASSED 00:05:24.309 passed 00:05:24.309 00:05:24.309 Run Summary: Type Total Ran Passed Failed Inactive 00:05:24.309 suites 1 1 n/a 0 0 00:05:24.309 tests 1 1 1 0 0 00:05:24.309 asserts 15 15 15 0 n/a 00:05:24.309 00:05:24.309 Elapsed time = 0.006 seconds 00:05:24.309 00:05:24.309 real 0m0.054s 00:05:24.309 user 0m0.017s 00:05:24.309 sys 0m0.037s 00:05:24.309 18:51:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:24.309 18:51:41 -- common/autotest_common.sh@10 -- # set +x 00:05:24.309 ************************************ 00:05:24.309 END TEST env_mem_callbacks 00:05:24.309 ************************************ 00:05:24.309 00:05:24.309 real 0m6.040s 00:05:24.309 user 0m4.205s 00:05:24.309 sys 0m0.912s 00:05:24.309 18:51:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:24.309 18:51:41 -- common/autotest_common.sh@10 -- # set +x 00:05:24.309 ************************************ 00:05:24.309 END TEST env 00:05:24.309 ************************************ 00:05:24.309 18:51:41 -- spdk/autotest.sh@163 -- # run_test rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:05:24.309 18:51:41 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:24.309 18:51:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:24.309 18:51:41 -- common/autotest_common.sh@10 -- # set +x 00:05:24.309 ************************************ 00:05:24.309 START TEST rpc 00:05:24.309 ************************************ 00:05:24.309 18:51:41 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:05:24.567 * Looking for test storage... 00:05:24.567 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:05:24.567 18:51:41 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:24.567 18:51:41 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:24.567 18:51:41 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:24.567 18:51:41 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:24.567 18:51:41 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:24.567 18:51:41 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:24.567 18:51:41 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:24.567 18:51:41 -- scripts/common.sh@335 -- # IFS=.-: 00:05:24.567 18:51:41 -- scripts/common.sh@335 -- # read -ra ver1 00:05:24.567 18:51:41 -- scripts/common.sh@336 -- # IFS=.-: 00:05:24.567 18:51:41 -- scripts/common.sh@336 -- # read -ra ver2 00:05:24.567 18:51:41 -- scripts/common.sh@337 -- # local 'op=<' 00:05:24.567 18:51:41 -- scripts/common.sh@339 -- # ver1_l=2 00:05:24.567 18:51:41 -- scripts/common.sh@340 -- # ver2_l=1 00:05:24.567 18:51:41 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:24.567 18:51:41 -- scripts/common.sh@343 -- # case "$op" in 00:05:24.567 18:51:41 -- scripts/common.sh@344 -- # : 1 00:05:24.567 18:51:41 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:24.567 18:51:41 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:24.567 18:51:41 -- scripts/common.sh@364 -- # decimal 1 00:05:24.567 18:51:41 -- scripts/common.sh@352 -- # local d=1 00:05:24.567 18:51:41 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:24.567 18:51:41 -- scripts/common.sh@354 -- # echo 1 00:05:24.567 18:51:41 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:24.567 18:51:41 -- scripts/common.sh@365 -- # decimal 2 00:05:24.567 18:51:41 -- scripts/common.sh@352 -- # local d=2 00:05:24.567 18:51:41 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:24.567 18:51:41 -- scripts/common.sh@354 -- # echo 2 00:05:24.567 18:51:41 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:24.567 18:51:41 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:24.567 18:51:41 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:24.567 18:51:41 -- scripts/common.sh@367 -- # return 0 00:05:24.567 18:51:41 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:24.567 18:51:41 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:24.567 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:24.567 --rc genhtml_branch_coverage=1 00:05:24.567 --rc genhtml_function_coverage=1 00:05:24.567 --rc genhtml_legend=1 00:05:24.567 --rc geninfo_all_blocks=1 00:05:24.567 --rc geninfo_unexecuted_blocks=1 00:05:24.567 00:05:24.567 ' 00:05:24.567 18:51:41 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:24.567 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:24.567 --rc genhtml_branch_coverage=1 00:05:24.567 --rc genhtml_function_coverage=1 00:05:24.567 --rc genhtml_legend=1 00:05:24.567 --rc geninfo_all_blocks=1 00:05:24.567 --rc geninfo_unexecuted_blocks=1 00:05:24.567 00:05:24.567 ' 00:05:24.567 18:51:41 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:24.567 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:24.567 --rc genhtml_branch_coverage=1 00:05:24.567 --rc genhtml_function_coverage=1 00:05:24.567 --rc genhtml_legend=1 00:05:24.567 --rc geninfo_all_blocks=1 00:05:24.567 --rc geninfo_unexecuted_blocks=1 00:05:24.567 00:05:24.567 ' 00:05:24.567 18:51:41 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:24.567 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:24.567 --rc genhtml_branch_coverage=1 00:05:24.567 --rc genhtml_function_coverage=1 00:05:24.567 --rc genhtml_legend=1 00:05:24.567 --rc geninfo_all_blocks=1 00:05:24.567 --rc geninfo_unexecuted_blocks=1 00:05:24.567 00:05:24.567 ' 00:05:24.567 18:51:41 -- rpc/rpc.sh@65 -- # spdk_pid=2920999 00:05:24.567 18:51:41 -- rpc/rpc.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -e bdev 00:05:24.567 18:51:41 -- rpc/rpc.sh@66 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:05:24.567 18:51:41 -- rpc/rpc.sh@67 -- # waitforlisten 2920999 00:05:24.567 18:51:41 -- common/autotest_common.sh@829 -- # '[' -z 2920999 ']' 00:05:24.567 18:51:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:24.567 18:51:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:24.567 18:51:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:24.567 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:24.567 18:51:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:24.567 18:51:41 -- common/autotest_common.sh@10 -- # set +x 00:05:24.567 [2024-11-26 18:51:41.423175] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:24.567 [2024-11-26 18:51:41.423224] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2920999 ] 00:05:24.567 EAL: No free 2048 kB hugepages reported on node 1 00:05:24.567 [2024-11-26 18:51:41.476617] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:24.826 [2024-11-26 18:51:41.514895] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:24.826 [2024-11-26 18:51:41.515029] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask bdev specified. 00:05:24.826 [2024-11-26 18:51:41.515040] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s spdk_tgt -p 2920999' to capture a snapshot of events at runtime. 00:05:24.826 [2024-11-26 18:51:41.515047] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/spdk_tgt_trace.pid2920999 for offline analysis/debug. 00:05:24.826 [2024-11-26 18:51:41.515066] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:25.393 18:51:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:25.393 18:51:42 -- common/autotest_common.sh@862 -- # return 0 00:05:25.393 18:51:42 -- rpc/rpc.sh@69 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:05:25.393 18:51:42 -- rpc/rpc.sh@69 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:05:25.393 18:51:42 -- rpc/rpc.sh@72 -- # rpc=rpc_cmd 00:05:25.393 18:51:42 -- rpc/rpc.sh@73 -- # run_test rpc_integrity rpc_integrity 00:05:25.393 18:51:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:25.393 18:51:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:25.393 18:51:42 -- common/autotest_common.sh@10 -- # set +x 00:05:25.393 ************************************ 00:05:25.393 START TEST rpc_integrity 00:05:25.393 ************************************ 00:05:25.393 18:51:42 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:05:25.393 18:51:42 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:05:25.393 18:51:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:25.393 18:51:42 -- common/autotest_common.sh@10 -- # set +x 00:05:25.393 18:51:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:25.393 18:51:42 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:05:25.393 18:51:42 -- rpc/rpc.sh@13 -- # jq length 00:05:25.393 18:51:42 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:05:25.393 18:51:42 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:05:25.393 18:51:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:25.393 18:51:42 -- common/autotest_common.sh@10 -- # set +x 00:05:25.393 18:51:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:25.393 18:51:42 -- rpc/rpc.sh@15 -- # malloc=Malloc0 00:05:25.393 18:51:42 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:05:25.393 18:51:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:25.393 18:51:42 -- common/autotest_common.sh@10 -- # set +x 00:05:25.652 18:51:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:25.652 18:51:42 -- rpc/rpc.sh@16 -- # bdevs='[ 00:05:25.652 { 00:05:25.652 "name": "Malloc0", 00:05:25.652 "aliases": [ 00:05:25.652 "18be4e93-1fe6-46cb-8a38-408fb93b9f8b" 00:05:25.652 ], 00:05:25.652 "product_name": "Malloc disk", 00:05:25.652 "block_size": 512, 00:05:25.652 "num_blocks": 16384, 00:05:25.652 "uuid": "18be4e93-1fe6-46cb-8a38-408fb93b9f8b", 00:05:25.652 "assigned_rate_limits": { 00:05:25.652 "rw_ios_per_sec": 0, 00:05:25.652 "rw_mbytes_per_sec": 0, 00:05:25.652 "r_mbytes_per_sec": 0, 00:05:25.652 "w_mbytes_per_sec": 0 00:05:25.652 }, 00:05:25.652 "claimed": false, 00:05:25.652 "zoned": false, 00:05:25.652 "supported_io_types": { 00:05:25.652 "read": true, 00:05:25.652 "write": true, 00:05:25.652 "unmap": true, 00:05:25.652 "write_zeroes": true, 00:05:25.652 "flush": true, 00:05:25.652 "reset": true, 00:05:25.652 "compare": false, 00:05:25.652 "compare_and_write": false, 00:05:25.652 "abort": true, 00:05:25.652 "nvme_admin": false, 00:05:25.652 "nvme_io": false 00:05:25.652 }, 00:05:25.652 "memory_domains": [ 00:05:25.652 { 00:05:25.652 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:25.652 "dma_device_type": 2 00:05:25.652 } 00:05:25.652 ], 00:05:25.652 "driver_specific": {} 00:05:25.652 } 00:05:25.652 ]' 00:05:25.652 18:51:42 -- rpc/rpc.sh@17 -- # jq length 00:05:25.652 18:51:42 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:05:25.652 18:51:42 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc0 -p Passthru0 00:05:25.652 18:51:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:25.652 18:51:42 -- common/autotest_common.sh@10 -- # set +x 00:05:25.652 [2024-11-26 18:51:42.371693] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc0 00:05:25.652 [2024-11-26 18:51:42.371725] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:05:25.652 [2024-11-26 18:51:42.371738] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x11cce70 00:05:25.652 [2024-11-26 18:51:42.371744] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:05:25.652 [2024-11-26 18:51:42.372767] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:05:25.652 [2024-11-26 18:51:42.372787] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:05:25.652 Passthru0 00:05:25.652 18:51:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:25.652 18:51:42 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:05:25.652 18:51:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:25.652 18:51:42 -- common/autotest_common.sh@10 -- # set +x 00:05:25.652 18:51:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:25.652 18:51:42 -- rpc/rpc.sh@20 -- # bdevs='[ 00:05:25.652 { 00:05:25.652 "name": "Malloc0", 00:05:25.652 "aliases": [ 00:05:25.652 "18be4e93-1fe6-46cb-8a38-408fb93b9f8b" 00:05:25.652 ], 00:05:25.652 "product_name": "Malloc disk", 00:05:25.652 "block_size": 512, 00:05:25.652 "num_blocks": 16384, 00:05:25.652 "uuid": "18be4e93-1fe6-46cb-8a38-408fb93b9f8b", 00:05:25.652 "assigned_rate_limits": { 00:05:25.652 "rw_ios_per_sec": 0, 00:05:25.652 "rw_mbytes_per_sec": 0, 00:05:25.652 "r_mbytes_per_sec": 0, 00:05:25.652 "w_mbytes_per_sec": 0 00:05:25.652 }, 00:05:25.652 "claimed": true, 00:05:25.652 "claim_type": "exclusive_write", 00:05:25.652 "zoned": false, 00:05:25.652 "supported_io_types": { 00:05:25.652 "read": true, 00:05:25.652 "write": true, 00:05:25.652 "unmap": true, 00:05:25.652 "write_zeroes": true, 00:05:25.652 "flush": true, 00:05:25.652 "reset": true, 00:05:25.652 "compare": false, 00:05:25.652 "compare_and_write": false, 00:05:25.652 "abort": true, 00:05:25.652 "nvme_admin": false, 00:05:25.652 "nvme_io": false 00:05:25.652 }, 00:05:25.652 "memory_domains": [ 00:05:25.652 { 00:05:25.652 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:25.652 "dma_device_type": 2 00:05:25.652 } 00:05:25.652 ], 00:05:25.652 "driver_specific": {} 00:05:25.652 }, 00:05:25.652 { 00:05:25.652 "name": "Passthru0", 00:05:25.652 "aliases": [ 00:05:25.652 "16975902-b18b-540c-b14c-b5fc6a3d8c70" 00:05:25.652 ], 00:05:25.652 "product_name": "passthru", 00:05:25.652 "block_size": 512, 00:05:25.652 "num_blocks": 16384, 00:05:25.652 "uuid": "16975902-b18b-540c-b14c-b5fc6a3d8c70", 00:05:25.652 "assigned_rate_limits": { 00:05:25.652 "rw_ios_per_sec": 0, 00:05:25.652 "rw_mbytes_per_sec": 0, 00:05:25.652 "r_mbytes_per_sec": 0, 00:05:25.652 "w_mbytes_per_sec": 0 00:05:25.652 }, 00:05:25.652 "claimed": false, 00:05:25.652 "zoned": false, 00:05:25.652 "supported_io_types": { 00:05:25.652 "read": true, 00:05:25.652 "write": true, 00:05:25.652 "unmap": true, 00:05:25.652 "write_zeroes": true, 00:05:25.652 "flush": true, 00:05:25.652 "reset": true, 00:05:25.652 "compare": false, 00:05:25.652 "compare_and_write": false, 00:05:25.652 "abort": true, 00:05:25.652 "nvme_admin": false, 00:05:25.652 "nvme_io": false 00:05:25.652 }, 00:05:25.652 "memory_domains": [ 00:05:25.652 { 00:05:25.652 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:25.652 "dma_device_type": 2 00:05:25.652 } 00:05:25.652 ], 00:05:25.652 "driver_specific": { 00:05:25.652 "passthru": { 00:05:25.652 "name": "Passthru0", 00:05:25.652 "base_bdev_name": "Malloc0" 00:05:25.652 } 00:05:25.652 } 00:05:25.652 } 00:05:25.652 ]' 00:05:25.652 18:51:42 -- rpc/rpc.sh@21 -- # jq length 00:05:25.652 18:51:42 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:05:25.652 18:51:42 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:05:25.652 18:51:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:25.652 18:51:42 -- common/autotest_common.sh@10 -- # set +x 00:05:25.652 18:51:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:25.652 18:51:42 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc0 00:05:25.652 18:51:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:25.652 18:51:42 -- common/autotest_common.sh@10 -- # set +x 00:05:25.652 18:51:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:25.652 18:51:42 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:05:25.652 18:51:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:25.652 18:51:42 -- common/autotest_common.sh@10 -- # set +x 00:05:25.652 18:51:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:25.652 18:51:42 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:05:25.652 18:51:42 -- rpc/rpc.sh@26 -- # jq length 00:05:25.652 18:51:42 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:05:25.652 00:05:25.652 real 0m0.259s 00:05:25.652 user 0m0.158s 00:05:25.652 sys 0m0.039s 00:05:25.652 18:51:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:25.652 18:51:42 -- common/autotest_common.sh@10 -- # set +x 00:05:25.652 ************************************ 00:05:25.652 END TEST rpc_integrity 00:05:25.652 ************************************ 00:05:25.652 18:51:42 -- rpc/rpc.sh@74 -- # run_test rpc_plugins rpc_plugins 00:05:25.652 18:51:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:25.652 18:51:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:25.652 18:51:42 -- common/autotest_common.sh@10 -- # set +x 00:05:25.652 ************************************ 00:05:25.652 START TEST rpc_plugins 00:05:25.652 ************************************ 00:05:25.652 18:51:42 -- common/autotest_common.sh@1114 -- # rpc_plugins 00:05:25.652 18:51:42 -- rpc/rpc.sh@30 -- # rpc_cmd --plugin rpc_plugin create_malloc 00:05:25.652 18:51:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:25.652 18:51:42 -- common/autotest_common.sh@10 -- # set +x 00:05:25.652 18:51:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:25.652 18:51:42 -- rpc/rpc.sh@30 -- # malloc=Malloc1 00:05:25.652 18:51:42 -- rpc/rpc.sh@31 -- # rpc_cmd bdev_get_bdevs 00:05:25.652 18:51:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:25.652 18:51:42 -- common/autotest_common.sh@10 -- # set +x 00:05:25.911 18:51:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:25.911 18:51:42 -- rpc/rpc.sh@31 -- # bdevs='[ 00:05:25.911 { 00:05:25.911 "name": "Malloc1", 00:05:25.911 "aliases": [ 00:05:25.911 "27052fb2-ffea-47b5-b714-f669b116c392" 00:05:25.911 ], 00:05:25.911 "product_name": "Malloc disk", 00:05:25.911 "block_size": 4096, 00:05:25.911 "num_blocks": 256, 00:05:25.911 "uuid": "27052fb2-ffea-47b5-b714-f669b116c392", 00:05:25.911 "assigned_rate_limits": { 00:05:25.911 "rw_ios_per_sec": 0, 00:05:25.911 "rw_mbytes_per_sec": 0, 00:05:25.911 "r_mbytes_per_sec": 0, 00:05:25.911 "w_mbytes_per_sec": 0 00:05:25.911 }, 00:05:25.911 "claimed": false, 00:05:25.911 "zoned": false, 00:05:25.911 "supported_io_types": { 00:05:25.911 "read": true, 00:05:25.911 "write": true, 00:05:25.911 "unmap": true, 00:05:25.911 "write_zeroes": true, 00:05:25.911 "flush": true, 00:05:25.911 "reset": true, 00:05:25.911 "compare": false, 00:05:25.911 "compare_and_write": false, 00:05:25.911 "abort": true, 00:05:25.911 "nvme_admin": false, 00:05:25.911 "nvme_io": false 00:05:25.911 }, 00:05:25.911 "memory_domains": [ 00:05:25.911 { 00:05:25.911 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:25.911 "dma_device_type": 2 00:05:25.911 } 00:05:25.911 ], 00:05:25.911 "driver_specific": {} 00:05:25.911 } 00:05:25.911 ]' 00:05:25.911 18:51:42 -- rpc/rpc.sh@32 -- # jq length 00:05:25.911 18:51:42 -- rpc/rpc.sh@32 -- # '[' 1 == 1 ']' 00:05:25.911 18:51:42 -- rpc/rpc.sh@34 -- # rpc_cmd --plugin rpc_plugin delete_malloc Malloc1 00:05:25.911 18:51:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:25.911 18:51:42 -- common/autotest_common.sh@10 -- # set +x 00:05:25.911 18:51:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:25.911 18:51:42 -- rpc/rpc.sh@35 -- # rpc_cmd bdev_get_bdevs 00:05:25.911 18:51:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:25.911 18:51:42 -- common/autotest_common.sh@10 -- # set +x 00:05:25.911 18:51:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:25.911 18:51:42 -- rpc/rpc.sh@35 -- # bdevs='[]' 00:05:25.911 18:51:42 -- rpc/rpc.sh@36 -- # jq length 00:05:25.911 18:51:42 -- rpc/rpc.sh@36 -- # '[' 0 == 0 ']' 00:05:25.911 00:05:25.911 real 0m0.141s 00:05:25.911 user 0m0.089s 00:05:25.911 sys 0m0.015s 00:05:25.911 18:51:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:25.911 18:51:42 -- common/autotest_common.sh@10 -- # set +x 00:05:25.911 ************************************ 00:05:25.911 END TEST rpc_plugins 00:05:25.911 ************************************ 00:05:25.911 18:51:42 -- rpc/rpc.sh@75 -- # run_test rpc_trace_cmd_test rpc_trace_cmd_test 00:05:25.911 18:51:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:25.911 18:51:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:25.911 18:51:42 -- common/autotest_common.sh@10 -- # set +x 00:05:25.911 ************************************ 00:05:25.911 START TEST rpc_trace_cmd_test 00:05:25.911 ************************************ 00:05:25.912 18:51:42 -- common/autotest_common.sh@1114 -- # rpc_trace_cmd_test 00:05:25.912 18:51:42 -- rpc/rpc.sh@40 -- # local info 00:05:25.912 18:51:42 -- rpc/rpc.sh@42 -- # rpc_cmd trace_get_info 00:05:25.912 18:51:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:25.912 18:51:42 -- common/autotest_common.sh@10 -- # set +x 00:05:25.912 18:51:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:25.912 18:51:42 -- rpc/rpc.sh@42 -- # info='{ 00:05:25.912 "tpoint_shm_path": "/dev/shm/spdk_tgt_trace.pid2920999", 00:05:25.912 "tpoint_group_mask": "0x8", 00:05:25.912 "iscsi_conn": { 00:05:25.912 "mask": "0x2", 00:05:25.912 "tpoint_mask": "0x0" 00:05:25.912 }, 00:05:25.912 "scsi": { 00:05:25.912 "mask": "0x4", 00:05:25.912 "tpoint_mask": "0x0" 00:05:25.912 }, 00:05:25.912 "bdev": { 00:05:25.912 "mask": "0x8", 00:05:25.912 "tpoint_mask": "0xffffffffffffffff" 00:05:25.912 }, 00:05:25.912 "nvmf_rdma": { 00:05:25.912 "mask": "0x10", 00:05:25.912 "tpoint_mask": "0x0" 00:05:25.912 }, 00:05:25.912 "nvmf_tcp": { 00:05:25.912 "mask": "0x20", 00:05:25.912 "tpoint_mask": "0x0" 00:05:25.912 }, 00:05:25.912 "ftl": { 00:05:25.912 "mask": "0x40", 00:05:25.912 "tpoint_mask": "0x0" 00:05:25.912 }, 00:05:25.912 "blobfs": { 00:05:25.912 "mask": "0x80", 00:05:25.912 "tpoint_mask": "0x0" 00:05:25.912 }, 00:05:25.912 "dsa": { 00:05:25.912 "mask": "0x200", 00:05:25.912 "tpoint_mask": "0x0" 00:05:25.912 }, 00:05:25.912 "thread": { 00:05:25.912 "mask": "0x400", 00:05:25.912 "tpoint_mask": "0x0" 00:05:25.912 }, 00:05:25.912 "nvme_pcie": { 00:05:25.912 "mask": "0x800", 00:05:25.912 "tpoint_mask": "0x0" 00:05:25.912 }, 00:05:25.912 "iaa": { 00:05:25.912 "mask": "0x1000", 00:05:25.912 "tpoint_mask": "0x0" 00:05:25.912 }, 00:05:25.912 "nvme_tcp": { 00:05:25.912 "mask": "0x2000", 00:05:25.912 "tpoint_mask": "0x0" 00:05:25.912 }, 00:05:25.912 "bdev_nvme": { 00:05:25.912 "mask": "0x4000", 00:05:25.912 "tpoint_mask": "0x0" 00:05:25.912 } 00:05:25.912 }' 00:05:25.912 18:51:42 -- rpc/rpc.sh@43 -- # jq length 00:05:25.912 18:51:42 -- rpc/rpc.sh@43 -- # '[' 15 -gt 2 ']' 00:05:25.912 18:51:42 -- rpc/rpc.sh@44 -- # jq 'has("tpoint_group_mask")' 00:05:25.912 18:51:42 -- rpc/rpc.sh@44 -- # '[' true = true ']' 00:05:25.912 18:51:42 -- rpc/rpc.sh@45 -- # jq 'has("tpoint_shm_path")' 00:05:26.171 18:51:42 -- rpc/rpc.sh@45 -- # '[' true = true ']' 00:05:26.171 18:51:42 -- rpc/rpc.sh@46 -- # jq 'has("bdev")' 00:05:26.171 18:51:42 -- rpc/rpc.sh@46 -- # '[' true = true ']' 00:05:26.171 18:51:42 -- rpc/rpc.sh@47 -- # jq -r .bdev.tpoint_mask 00:05:26.171 18:51:42 -- rpc/rpc.sh@47 -- # '[' 0xffffffffffffffff '!=' 0x0 ']' 00:05:26.171 00:05:26.171 real 0m0.229s 00:05:26.171 user 0m0.189s 00:05:26.171 sys 0m0.031s 00:05:26.171 18:51:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:26.171 18:51:42 -- common/autotest_common.sh@10 -- # set +x 00:05:26.171 ************************************ 00:05:26.171 END TEST rpc_trace_cmd_test 00:05:26.171 ************************************ 00:05:26.171 18:51:42 -- rpc/rpc.sh@76 -- # [[ 0 -eq 1 ]] 00:05:26.171 18:51:42 -- rpc/rpc.sh@80 -- # rpc=rpc_cmd 00:05:26.171 18:51:42 -- rpc/rpc.sh@81 -- # run_test rpc_daemon_integrity rpc_integrity 00:05:26.171 18:51:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:26.171 18:51:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:26.171 18:51:42 -- common/autotest_common.sh@10 -- # set +x 00:05:26.171 ************************************ 00:05:26.171 START TEST rpc_daemon_integrity 00:05:26.171 ************************************ 00:05:26.171 18:51:42 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:05:26.171 18:51:42 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:05:26.171 18:51:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:26.171 18:51:42 -- common/autotest_common.sh@10 -- # set +x 00:05:26.171 18:51:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:26.171 18:51:43 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:05:26.171 18:51:43 -- rpc/rpc.sh@13 -- # jq length 00:05:26.171 18:51:43 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:05:26.171 18:51:43 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:05:26.171 18:51:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:26.171 18:51:43 -- common/autotest_common.sh@10 -- # set +x 00:05:26.171 18:51:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:26.171 18:51:43 -- rpc/rpc.sh@15 -- # malloc=Malloc2 00:05:26.171 18:51:43 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:05:26.171 18:51:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:26.171 18:51:43 -- common/autotest_common.sh@10 -- # set +x 00:05:26.171 18:51:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:26.171 18:51:43 -- rpc/rpc.sh@16 -- # bdevs='[ 00:05:26.171 { 00:05:26.171 "name": "Malloc2", 00:05:26.171 "aliases": [ 00:05:26.171 "55103817-660c-4a01-8586-506948750f5e" 00:05:26.171 ], 00:05:26.171 "product_name": "Malloc disk", 00:05:26.171 "block_size": 512, 00:05:26.171 "num_blocks": 16384, 00:05:26.171 "uuid": "55103817-660c-4a01-8586-506948750f5e", 00:05:26.171 "assigned_rate_limits": { 00:05:26.171 "rw_ios_per_sec": 0, 00:05:26.171 "rw_mbytes_per_sec": 0, 00:05:26.171 "r_mbytes_per_sec": 0, 00:05:26.171 "w_mbytes_per_sec": 0 00:05:26.171 }, 00:05:26.171 "claimed": false, 00:05:26.171 "zoned": false, 00:05:26.171 "supported_io_types": { 00:05:26.171 "read": true, 00:05:26.171 "write": true, 00:05:26.171 "unmap": true, 00:05:26.171 "write_zeroes": true, 00:05:26.171 "flush": true, 00:05:26.171 "reset": true, 00:05:26.171 "compare": false, 00:05:26.171 "compare_and_write": false, 00:05:26.171 "abort": true, 00:05:26.171 "nvme_admin": false, 00:05:26.171 "nvme_io": false 00:05:26.171 }, 00:05:26.171 "memory_domains": [ 00:05:26.171 { 00:05:26.171 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:26.171 "dma_device_type": 2 00:05:26.171 } 00:05:26.171 ], 00:05:26.171 "driver_specific": {} 00:05:26.171 } 00:05:26.171 ]' 00:05:26.171 18:51:43 -- rpc/rpc.sh@17 -- # jq length 00:05:26.430 18:51:43 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:05:26.430 18:51:43 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc2 -p Passthru0 00:05:26.430 18:51:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:26.430 18:51:43 -- common/autotest_common.sh@10 -- # set +x 00:05:26.430 [2024-11-26 18:51:43.129756] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc2 00:05:26.430 [2024-11-26 18:51:43.129785] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:05:26.430 [2024-11-26 18:51:43.129801] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x11d0610 00:05:26.430 [2024-11-26 18:51:43.129807] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:05:26.430 [2024-11-26 18:51:43.130733] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:05:26.430 [2024-11-26 18:51:43.130752] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:05:26.430 Passthru0 00:05:26.430 18:51:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:26.430 18:51:43 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:05:26.430 18:51:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:26.430 18:51:43 -- common/autotest_common.sh@10 -- # set +x 00:05:26.430 18:51:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:26.430 18:51:43 -- rpc/rpc.sh@20 -- # bdevs='[ 00:05:26.430 { 00:05:26.430 "name": "Malloc2", 00:05:26.430 "aliases": [ 00:05:26.430 "55103817-660c-4a01-8586-506948750f5e" 00:05:26.430 ], 00:05:26.430 "product_name": "Malloc disk", 00:05:26.430 "block_size": 512, 00:05:26.430 "num_blocks": 16384, 00:05:26.430 "uuid": "55103817-660c-4a01-8586-506948750f5e", 00:05:26.430 "assigned_rate_limits": { 00:05:26.430 "rw_ios_per_sec": 0, 00:05:26.430 "rw_mbytes_per_sec": 0, 00:05:26.430 "r_mbytes_per_sec": 0, 00:05:26.430 "w_mbytes_per_sec": 0 00:05:26.430 }, 00:05:26.430 "claimed": true, 00:05:26.430 "claim_type": "exclusive_write", 00:05:26.430 "zoned": false, 00:05:26.430 "supported_io_types": { 00:05:26.431 "read": true, 00:05:26.431 "write": true, 00:05:26.431 "unmap": true, 00:05:26.431 "write_zeroes": true, 00:05:26.431 "flush": true, 00:05:26.431 "reset": true, 00:05:26.431 "compare": false, 00:05:26.431 "compare_and_write": false, 00:05:26.431 "abort": true, 00:05:26.431 "nvme_admin": false, 00:05:26.431 "nvme_io": false 00:05:26.431 }, 00:05:26.431 "memory_domains": [ 00:05:26.431 { 00:05:26.431 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:26.431 "dma_device_type": 2 00:05:26.431 } 00:05:26.431 ], 00:05:26.431 "driver_specific": {} 00:05:26.431 }, 00:05:26.431 { 00:05:26.431 "name": "Passthru0", 00:05:26.431 "aliases": [ 00:05:26.431 "013f8368-4750-5438-8b5c-c987673c10b9" 00:05:26.431 ], 00:05:26.431 "product_name": "passthru", 00:05:26.431 "block_size": 512, 00:05:26.431 "num_blocks": 16384, 00:05:26.431 "uuid": "013f8368-4750-5438-8b5c-c987673c10b9", 00:05:26.431 "assigned_rate_limits": { 00:05:26.431 "rw_ios_per_sec": 0, 00:05:26.431 "rw_mbytes_per_sec": 0, 00:05:26.431 "r_mbytes_per_sec": 0, 00:05:26.431 "w_mbytes_per_sec": 0 00:05:26.431 }, 00:05:26.431 "claimed": false, 00:05:26.431 "zoned": false, 00:05:26.431 "supported_io_types": { 00:05:26.431 "read": true, 00:05:26.431 "write": true, 00:05:26.431 "unmap": true, 00:05:26.431 "write_zeroes": true, 00:05:26.431 "flush": true, 00:05:26.431 "reset": true, 00:05:26.431 "compare": false, 00:05:26.431 "compare_and_write": false, 00:05:26.431 "abort": true, 00:05:26.431 "nvme_admin": false, 00:05:26.431 "nvme_io": false 00:05:26.431 }, 00:05:26.431 "memory_domains": [ 00:05:26.431 { 00:05:26.431 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:26.431 "dma_device_type": 2 00:05:26.431 } 00:05:26.431 ], 00:05:26.431 "driver_specific": { 00:05:26.431 "passthru": { 00:05:26.431 "name": "Passthru0", 00:05:26.431 "base_bdev_name": "Malloc2" 00:05:26.431 } 00:05:26.431 } 00:05:26.431 } 00:05:26.431 ]' 00:05:26.431 18:51:43 -- rpc/rpc.sh@21 -- # jq length 00:05:26.431 18:51:43 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:05:26.431 18:51:43 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:05:26.431 18:51:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:26.431 18:51:43 -- common/autotest_common.sh@10 -- # set +x 00:05:26.431 18:51:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:26.431 18:51:43 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc2 00:05:26.431 18:51:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:26.431 18:51:43 -- common/autotest_common.sh@10 -- # set +x 00:05:26.431 18:51:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:26.431 18:51:43 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:05:26.431 18:51:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:26.431 18:51:43 -- common/autotest_common.sh@10 -- # set +x 00:05:26.431 18:51:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:26.431 18:51:43 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:05:26.431 18:51:43 -- rpc/rpc.sh@26 -- # jq length 00:05:26.431 18:51:43 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:05:26.431 00:05:26.431 real 0m0.271s 00:05:26.431 user 0m0.163s 00:05:26.431 sys 0m0.044s 00:05:26.431 18:51:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:26.431 18:51:43 -- common/autotest_common.sh@10 -- # set +x 00:05:26.431 ************************************ 00:05:26.431 END TEST rpc_daemon_integrity 00:05:26.431 ************************************ 00:05:26.431 18:51:43 -- rpc/rpc.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:05:26.431 18:51:43 -- rpc/rpc.sh@84 -- # killprocess 2920999 00:05:26.431 18:51:43 -- common/autotest_common.sh@936 -- # '[' -z 2920999 ']' 00:05:26.431 18:51:43 -- common/autotest_common.sh@940 -- # kill -0 2920999 00:05:26.431 18:51:43 -- common/autotest_common.sh@941 -- # uname 00:05:26.431 18:51:43 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:26.431 18:51:43 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2920999 00:05:26.431 18:51:43 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:26.431 18:51:43 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:26.431 18:51:43 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2920999' 00:05:26.431 killing process with pid 2920999 00:05:26.431 18:51:43 -- common/autotest_common.sh@955 -- # kill 2920999 00:05:26.431 18:51:43 -- common/autotest_common.sh@960 -- # wait 2920999 00:05:27.001 00:05:27.001 real 0m2.438s 00:05:27.001 user 0m3.095s 00:05:27.001 sys 0m0.644s 00:05:27.001 18:51:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:27.001 18:51:43 -- common/autotest_common.sh@10 -- # set +x 00:05:27.001 ************************************ 00:05:27.001 END TEST rpc 00:05:27.001 ************************************ 00:05:27.001 18:51:43 -- spdk/autotest.sh@164 -- # run_test rpc_client /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:05:27.001 18:51:43 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:27.001 18:51:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:27.001 18:51:43 -- common/autotest_common.sh@10 -- # set +x 00:05:27.001 ************************************ 00:05:27.001 START TEST rpc_client 00:05:27.001 ************************************ 00:05:27.001 18:51:43 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:05:27.001 * Looking for test storage... 00:05:27.001 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client 00:05:27.001 18:51:43 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:27.001 18:51:43 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:27.001 18:51:43 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:27.001 18:51:43 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:27.001 18:51:43 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:27.001 18:51:43 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:27.001 18:51:43 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:27.001 18:51:43 -- scripts/common.sh@335 -- # IFS=.-: 00:05:27.001 18:51:43 -- scripts/common.sh@335 -- # read -ra ver1 00:05:27.001 18:51:43 -- scripts/common.sh@336 -- # IFS=.-: 00:05:27.001 18:51:43 -- scripts/common.sh@336 -- # read -ra ver2 00:05:27.001 18:51:43 -- scripts/common.sh@337 -- # local 'op=<' 00:05:27.001 18:51:43 -- scripts/common.sh@339 -- # ver1_l=2 00:05:27.001 18:51:43 -- scripts/common.sh@340 -- # ver2_l=1 00:05:27.001 18:51:43 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:27.001 18:51:43 -- scripts/common.sh@343 -- # case "$op" in 00:05:27.001 18:51:43 -- scripts/common.sh@344 -- # : 1 00:05:27.001 18:51:43 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:27.001 18:51:43 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:27.001 18:51:43 -- scripts/common.sh@364 -- # decimal 1 00:05:27.001 18:51:43 -- scripts/common.sh@352 -- # local d=1 00:05:27.001 18:51:43 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:27.001 18:51:43 -- scripts/common.sh@354 -- # echo 1 00:05:27.001 18:51:43 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:27.001 18:51:43 -- scripts/common.sh@365 -- # decimal 2 00:05:27.001 18:51:43 -- scripts/common.sh@352 -- # local d=2 00:05:27.001 18:51:43 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:27.001 18:51:43 -- scripts/common.sh@354 -- # echo 2 00:05:27.001 18:51:43 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:27.001 18:51:43 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:27.001 18:51:43 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:27.001 18:51:43 -- scripts/common.sh@367 -- # return 0 00:05:27.001 18:51:43 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:27.001 18:51:43 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:27.001 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:27.001 --rc genhtml_branch_coverage=1 00:05:27.001 --rc genhtml_function_coverage=1 00:05:27.001 --rc genhtml_legend=1 00:05:27.001 --rc geninfo_all_blocks=1 00:05:27.001 --rc geninfo_unexecuted_blocks=1 00:05:27.001 00:05:27.001 ' 00:05:27.001 18:51:43 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:27.001 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:27.001 --rc genhtml_branch_coverage=1 00:05:27.001 --rc genhtml_function_coverage=1 00:05:27.001 --rc genhtml_legend=1 00:05:27.001 --rc geninfo_all_blocks=1 00:05:27.001 --rc geninfo_unexecuted_blocks=1 00:05:27.001 00:05:27.001 ' 00:05:27.001 18:51:43 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:27.001 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:27.001 --rc genhtml_branch_coverage=1 00:05:27.001 --rc genhtml_function_coverage=1 00:05:27.001 --rc genhtml_legend=1 00:05:27.001 --rc geninfo_all_blocks=1 00:05:27.001 --rc geninfo_unexecuted_blocks=1 00:05:27.001 00:05:27.001 ' 00:05:27.001 18:51:43 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:27.001 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:27.001 --rc genhtml_branch_coverage=1 00:05:27.001 --rc genhtml_function_coverage=1 00:05:27.001 --rc genhtml_legend=1 00:05:27.001 --rc geninfo_all_blocks=1 00:05:27.001 --rc geninfo_unexecuted_blocks=1 00:05:27.001 00:05:27.001 ' 00:05:27.001 18:51:43 -- rpc_client/rpc_client.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client_test 00:05:27.001 OK 00:05:27.001 18:51:43 -- rpc_client/rpc_client.sh@12 -- # trap - SIGINT SIGTERM EXIT 00:05:27.001 00:05:27.001 real 0m0.185s 00:05:27.001 user 0m0.109s 00:05:27.001 sys 0m0.089s 00:05:27.001 18:51:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:27.001 18:51:43 -- common/autotest_common.sh@10 -- # set +x 00:05:27.001 ************************************ 00:05:27.001 END TEST rpc_client 00:05:27.001 ************************************ 00:05:27.001 18:51:43 -- spdk/autotest.sh@165 -- # run_test json_config /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:05:27.001 18:51:43 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:27.001 18:51:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:27.001 18:51:43 -- common/autotest_common.sh@10 -- # set +x 00:05:27.001 ************************************ 00:05:27.001 START TEST json_config 00:05:27.001 ************************************ 00:05:27.001 18:51:43 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:05:27.261 18:51:43 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:27.261 18:51:43 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:27.261 18:51:43 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:27.261 18:51:44 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:27.261 18:51:44 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:27.261 18:51:44 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:27.261 18:51:44 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:27.261 18:51:44 -- scripts/common.sh@335 -- # IFS=.-: 00:05:27.261 18:51:44 -- scripts/common.sh@335 -- # read -ra ver1 00:05:27.261 18:51:44 -- scripts/common.sh@336 -- # IFS=.-: 00:05:27.261 18:51:44 -- scripts/common.sh@336 -- # read -ra ver2 00:05:27.261 18:51:44 -- scripts/common.sh@337 -- # local 'op=<' 00:05:27.261 18:51:44 -- scripts/common.sh@339 -- # ver1_l=2 00:05:27.261 18:51:44 -- scripts/common.sh@340 -- # ver2_l=1 00:05:27.261 18:51:44 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:27.261 18:51:44 -- scripts/common.sh@343 -- # case "$op" in 00:05:27.261 18:51:44 -- scripts/common.sh@344 -- # : 1 00:05:27.261 18:51:44 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:27.261 18:51:44 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:27.261 18:51:44 -- scripts/common.sh@364 -- # decimal 1 00:05:27.261 18:51:44 -- scripts/common.sh@352 -- # local d=1 00:05:27.261 18:51:44 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:27.261 18:51:44 -- scripts/common.sh@354 -- # echo 1 00:05:27.261 18:51:44 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:27.261 18:51:44 -- scripts/common.sh@365 -- # decimal 2 00:05:27.261 18:51:44 -- scripts/common.sh@352 -- # local d=2 00:05:27.261 18:51:44 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:27.261 18:51:44 -- scripts/common.sh@354 -- # echo 2 00:05:27.261 18:51:44 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:27.261 18:51:44 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:27.261 18:51:44 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:27.261 18:51:44 -- scripts/common.sh@367 -- # return 0 00:05:27.261 18:51:44 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:27.261 18:51:44 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:27.261 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:27.261 --rc genhtml_branch_coverage=1 00:05:27.261 --rc genhtml_function_coverage=1 00:05:27.261 --rc genhtml_legend=1 00:05:27.261 --rc geninfo_all_blocks=1 00:05:27.261 --rc geninfo_unexecuted_blocks=1 00:05:27.261 00:05:27.261 ' 00:05:27.261 18:51:44 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:27.261 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:27.261 --rc genhtml_branch_coverage=1 00:05:27.261 --rc genhtml_function_coverage=1 00:05:27.261 --rc genhtml_legend=1 00:05:27.261 --rc geninfo_all_blocks=1 00:05:27.261 --rc geninfo_unexecuted_blocks=1 00:05:27.261 00:05:27.261 ' 00:05:27.261 18:51:44 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:27.261 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:27.261 --rc genhtml_branch_coverage=1 00:05:27.261 --rc genhtml_function_coverage=1 00:05:27.261 --rc genhtml_legend=1 00:05:27.261 --rc geninfo_all_blocks=1 00:05:27.261 --rc geninfo_unexecuted_blocks=1 00:05:27.261 00:05:27.261 ' 00:05:27.261 18:51:44 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:27.261 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:27.261 --rc genhtml_branch_coverage=1 00:05:27.261 --rc genhtml_function_coverage=1 00:05:27.261 --rc genhtml_legend=1 00:05:27.261 --rc geninfo_all_blocks=1 00:05:27.261 --rc geninfo_unexecuted_blocks=1 00:05:27.261 00:05:27.261 ' 00:05:27.261 18:51:44 -- json_config/json_config.sh@8 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:05:27.261 18:51:44 -- nvmf/common.sh@7 -- # uname -s 00:05:27.261 18:51:44 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:05:27.261 18:51:44 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:05:27.261 18:51:44 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:05:27.261 18:51:44 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:05:27.261 18:51:44 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:05:27.261 18:51:44 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:05:27.261 18:51:44 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:05:27.261 18:51:44 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:05:27.261 18:51:44 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:05:27.261 18:51:44 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:05:27.261 18:51:44 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:05:27.261 18:51:44 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:05:27.261 18:51:44 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:05:27.261 18:51:44 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:05:27.261 18:51:44 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:05:27.261 18:51:44 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:05:27.261 18:51:44 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:05:27.261 18:51:44 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:05:27.261 18:51:44 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:05:27.261 18:51:44 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:27.261 18:51:44 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:27.261 18:51:44 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:27.261 18:51:44 -- paths/export.sh@5 -- # export PATH 00:05:27.261 18:51:44 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:27.261 18:51:44 -- nvmf/common.sh@46 -- # : 0 00:05:27.261 18:51:44 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:05:27.261 18:51:44 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:05:27.261 18:51:44 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:05:27.262 18:51:44 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:05:27.262 18:51:44 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:05:27.262 18:51:44 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:05:27.262 18:51:44 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:05:27.262 18:51:44 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:05:27.262 18:51:44 -- json_config/json_config.sh@10 -- # [[ 0 -eq 1 ]] 00:05:27.262 18:51:44 -- json_config/json_config.sh@14 -- # [[ 0 -ne 1 ]] 00:05:27.262 18:51:44 -- json_config/json_config.sh@14 -- # [[ 0 -eq 1 ]] 00:05:27.262 18:51:44 -- json_config/json_config.sh@25 -- # (( SPDK_TEST_BLOCKDEV + SPDK_TEST_ISCSI + SPDK_TEST_NVMF + SPDK_TEST_VHOST + SPDK_TEST_VHOST_INIT + SPDK_TEST_RBD == 0 )) 00:05:27.262 18:51:44 -- json_config/json_config.sh@30 -- # app_pid=(['target']='' ['initiator']='') 00:05:27.262 18:51:44 -- json_config/json_config.sh@30 -- # declare -A app_pid 00:05:27.262 18:51:44 -- json_config/json_config.sh@31 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock' ['initiator']='/var/tmp/spdk_initiator.sock') 00:05:27.262 18:51:44 -- json_config/json_config.sh@31 -- # declare -A app_socket 00:05:27.262 18:51:44 -- json_config/json_config.sh@32 -- # app_params=(['target']='-m 0x1 -s 1024' ['initiator']='-m 0x2 -g -u -s 1024') 00:05:27.262 18:51:44 -- json_config/json_config.sh@32 -- # declare -A app_params 00:05:27.262 18:51:44 -- json_config/json_config.sh@33 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json' ['initiator']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json') 00:05:27.262 18:51:44 -- json_config/json_config.sh@33 -- # declare -A configs_path 00:05:27.262 18:51:44 -- json_config/json_config.sh@43 -- # last_event_id=0 00:05:27.262 18:51:44 -- json_config/json_config.sh@418 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:05:27.262 18:51:44 -- json_config/json_config.sh@419 -- # echo 'INFO: JSON configuration test init' 00:05:27.262 INFO: JSON configuration test init 00:05:27.262 18:51:44 -- json_config/json_config.sh@420 -- # json_config_test_init 00:05:27.262 18:51:44 -- json_config/json_config.sh@315 -- # timing_enter json_config_test_init 00:05:27.262 18:51:44 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:27.262 18:51:44 -- common/autotest_common.sh@10 -- # set +x 00:05:27.262 18:51:44 -- json_config/json_config.sh@316 -- # timing_enter json_config_setup_target 00:05:27.262 18:51:44 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:27.262 18:51:44 -- common/autotest_common.sh@10 -- # set +x 00:05:27.262 18:51:44 -- json_config/json_config.sh@318 -- # json_config_test_start_app target --wait-for-rpc 00:05:27.262 18:51:44 -- json_config/json_config.sh@98 -- # local app=target 00:05:27.262 18:51:44 -- json_config/json_config.sh@99 -- # shift 00:05:27.262 18:51:44 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:05:27.262 18:51:44 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:05:27.262 18:51:44 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:05:27.262 18:51:44 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:27.262 18:51:44 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:27.262 18:51:44 -- json_config/json_config.sh@111 -- # app_pid[$app]=2921685 00:05:27.262 18:51:44 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:05:27.262 Waiting for target to run... 00:05:27.262 18:51:44 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --wait-for-rpc 00:05:27.262 18:51:44 -- json_config/json_config.sh@114 -- # waitforlisten 2921685 /var/tmp/spdk_tgt.sock 00:05:27.262 18:51:44 -- common/autotest_common.sh@829 -- # '[' -z 2921685 ']' 00:05:27.262 18:51:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:05:27.262 18:51:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:27.262 18:51:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:05:27.262 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:05:27.262 18:51:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:27.262 18:51:44 -- common/autotest_common.sh@10 -- # set +x 00:05:27.262 [2024-11-26 18:51:44.141760] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:27.262 [2024-11-26 18:51:44.141809] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2921685 ] 00:05:27.262 EAL: No free 2048 kB hugepages reported on node 1 00:05:27.828 [2024-11-26 18:51:44.574600] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:27.828 [2024-11-26 18:51:44.603367] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:27.828 [2024-11-26 18:51:44.603467] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:28.086 18:51:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:28.086 18:51:44 -- common/autotest_common.sh@862 -- # return 0 00:05:28.086 18:51:44 -- json_config/json_config.sh@115 -- # echo '' 00:05:28.086 00:05:28.086 18:51:44 -- json_config/json_config.sh@322 -- # create_accel_config 00:05:28.086 18:51:44 -- json_config/json_config.sh@146 -- # timing_enter create_accel_config 00:05:28.086 18:51:44 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:28.086 18:51:44 -- common/autotest_common.sh@10 -- # set +x 00:05:28.086 18:51:44 -- json_config/json_config.sh@148 -- # [[ 0 -eq 1 ]] 00:05:28.086 18:51:44 -- json_config/json_config.sh@154 -- # timing_exit create_accel_config 00:05:28.086 18:51:44 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:28.086 18:51:44 -- common/autotest_common.sh@10 -- # set +x 00:05:28.086 18:51:44 -- json_config/json_config.sh@326 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh --json-with-subsystems 00:05:28.086 18:51:44 -- json_config/json_config.sh@327 -- # tgt_rpc load_config 00:05:28.086 18:51:44 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock load_config 00:05:31.369 18:51:48 -- json_config/json_config.sh@329 -- # tgt_check_notification_types 00:05:31.369 18:51:48 -- json_config/json_config.sh@46 -- # timing_enter tgt_check_notification_types 00:05:31.369 18:51:48 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:31.369 18:51:48 -- common/autotest_common.sh@10 -- # set +x 00:05:31.369 18:51:48 -- json_config/json_config.sh@48 -- # local ret=0 00:05:31.369 18:51:48 -- json_config/json_config.sh@49 -- # enabled_types=('bdev_register' 'bdev_unregister') 00:05:31.369 18:51:48 -- json_config/json_config.sh@49 -- # local enabled_types 00:05:31.369 18:51:48 -- json_config/json_config.sh@51 -- # tgt_rpc notify_get_types 00:05:31.369 18:51:48 -- json_config/json_config.sh@51 -- # jq -r '.[]' 00:05:31.369 18:51:48 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock notify_get_types 00:05:31.369 18:51:48 -- json_config/json_config.sh@51 -- # get_types=('bdev_register' 'bdev_unregister') 00:05:31.369 18:51:48 -- json_config/json_config.sh@51 -- # local get_types 00:05:31.369 18:51:48 -- json_config/json_config.sh@52 -- # [[ bdev_register bdev_unregister != \b\d\e\v\_\r\e\g\i\s\t\e\r\ \b\d\e\v\_\u\n\r\e\g\i\s\t\e\r ]] 00:05:31.369 18:51:48 -- json_config/json_config.sh@57 -- # timing_exit tgt_check_notification_types 00:05:31.369 18:51:48 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:31.369 18:51:48 -- common/autotest_common.sh@10 -- # set +x 00:05:31.369 18:51:48 -- json_config/json_config.sh@58 -- # return 0 00:05:31.369 18:51:48 -- json_config/json_config.sh@331 -- # [[ 0 -eq 1 ]] 00:05:31.369 18:51:48 -- json_config/json_config.sh@335 -- # [[ 0 -eq 1 ]] 00:05:31.369 18:51:48 -- json_config/json_config.sh@339 -- # [[ 0 -eq 1 ]] 00:05:31.369 18:51:48 -- json_config/json_config.sh@343 -- # [[ 1 -eq 1 ]] 00:05:31.369 18:51:48 -- json_config/json_config.sh@344 -- # create_nvmf_subsystem_config 00:05:31.369 18:51:48 -- json_config/json_config.sh@283 -- # timing_enter create_nvmf_subsystem_config 00:05:31.369 18:51:48 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:31.369 18:51:48 -- common/autotest_common.sh@10 -- # set +x 00:05:31.369 18:51:48 -- json_config/json_config.sh@285 -- # NVMF_FIRST_TARGET_IP=127.0.0.1 00:05:31.369 18:51:48 -- json_config/json_config.sh@286 -- # [[ tcp == \r\d\m\a ]] 00:05:31.369 18:51:48 -- json_config/json_config.sh@290 -- # [[ -z 127.0.0.1 ]] 00:05:31.369 18:51:48 -- json_config/json_config.sh@295 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocForNvmf0 00:05:31.369 18:51:48 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocForNvmf0 00:05:31.627 MallocForNvmf0 00:05:31.627 18:51:48 -- json_config/json_config.sh@296 -- # tgt_rpc bdev_malloc_create 4 1024 --name MallocForNvmf1 00:05:31.627 18:51:48 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 4 1024 --name MallocForNvmf1 00:05:31.885 MallocForNvmf1 00:05:31.885 18:51:48 -- json_config/json_config.sh@298 -- # tgt_rpc nvmf_create_transport -t tcp -u 8192 -c 0 00:05:31.886 18:51:48 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_transport -t tcp -u 8192 -c 0 00:05:31.886 [2024-11-26 18:51:48.783159] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:05:31.886 18:51:48 -- json_config/json_config.sh@299 -- # tgt_rpc nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:05:31.886 18:51:48 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:05:32.144 18:51:48 -- json_config/json_config.sh@300 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:05:32.144 18:51:48 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:05:32.402 18:51:49 -- json_config/json_config.sh@301 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:05:32.402 18:51:49 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:05:32.402 18:51:49 -- json_config/json_config.sh@302 -- # tgt_rpc nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:05:32.402 18:51:49 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:05:32.660 [2024-11-26 18:51:49.457348] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:05:32.660 18:51:49 -- json_config/json_config.sh@304 -- # timing_exit create_nvmf_subsystem_config 00:05:32.660 18:51:49 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:32.660 18:51:49 -- common/autotest_common.sh@10 -- # set +x 00:05:32.660 18:51:49 -- json_config/json_config.sh@346 -- # timing_exit json_config_setup_target 00:05:32.660 18:51:49 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:32.660 18:51:49 -- common/autotest_common.sh@10 -- # set +x 00:05:32.660 18:51:49 -- json_config/json_config.sh@348 -- # [[ 0 -eq 1 ]] 00:05:32.660 18:51:49 -- json_config/json_config.sh@353 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:05:32.660 18:51:49 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:05:32.918 MallocBdevForConfigChangeCheck 00:05:32.918 18:51:49 -- json_config/json_config.sh@355 -- # timing_exit json_config_test_init 00:05:32.918 18:51:49 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:32.918 18:51:49 -- common/autotest_common.sh@10 -- # set +x 00:05:32.918 18:51:49 -- json_config/json_config.sh@422 -- # tgt_rpc save_config 00:05:32.918 18:51:49 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:33.176 18:51:50 -- json_config/json_config.sh@424 -- # echo 'INFO: shutting down applications...' 00:05:33.176 INFO: shutting down applications... 00:05:33.176 18:51:50 -- json_config/json_config.sh@425 -- # [[ 0 -eq 1 ]] 00:05:33.176 18:51:50 -- json_config/json_config.sh@431 -- # json_config_clear target 00:05:33.176 18:51:50 -- json_config/json_config.sh@385 -- # [[ -n 22 ]] 00:05:33.176 18:51:50 -- json_config/json_config.sh@386 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py -s /var/tmp/spdk_tgt.sock clear_config 00:05:35.072 Calling clear_iscsi_subsystem 00:05:35.072 Calling clear_nvmf_subsystem 00:05:35.072 Calling clear_nbd_subsystem 00:05:35.072 Calling clear_ublk_subsystem 00:05:35.072 Calling clear_vhost_blk_subsystem 00:05:35.072 Calling clear_vhost_scsi_subsystem 00:05:35.072 Calling clear_scheduler_subsystem 00:05:35.072 Calling clear_bdev_subsystem 00:05:35.072 Calling clear_accel_subsystem 00:05:35.072 Calling clear_vmd_subsystem 00:05:35.072 Calling clear_sock_subsystem 00:05:35.072 Calling clear_iobuf_subsystem 00:05:35.072 18:51:51 -- json_config/json_config.sh@390 -- # local config_filter=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py 00:05:35.072 18:51:51 -- json_config/json_config.sh@396 -- # count=100 00:05:35.072 18:51:51 -- json_config/json_config.sh@397 -- # '[' 100 -gt 0 ']' 00:05:35.072 18:51:51 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:35.072 18:51:51 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method delete_global_parameters 00:05:35.072 18:51:51 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method check_empty 00:05:35.072 18:51:51 -- json_config/json_config.sh@398 -- # break 00:05:35.072 18:51:51 -- json_config/json_config.sh@403 -- # '[' 100 -eq 0 ']' 00:05:35.072 18:51:51 -- json_config/json_config.sh@432 -- # json_config_test_shutdown_app target 00:05:35.072 18:51:51 -- json_config/json_config.sh@120 -- # local app=target 00:05:35.072 18:51:51 -- json_config/json_config.sh@123 -- # [[ -n 22 ]] 00:05:35.072 18:51:51 -- json_config/json_config.sh@124 -- # [[ -n 2921685 ]] 00:05:35.072 18:51:51 -- json_config/json_config.sh@127 -- # kill -SIGINT 2921685 00:05:35.072 18:51:51 -- json_config/json_config.sh@129 -- # (( i = 0 )) 00:05:35.072 18:51:51 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:05:35.072 18:51:51 -- json_config/json_config.sh@130 -- # kill -0 2921685 00:05:35.072 18:51:51 -- json_config/json_config.sh@134 -- # sleep 0.5 00:05:35.640 18:51:52 -- json_config/json_config.sh@129 -- # (( i++ )) 00:05:35.640 18:51:52 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:05:35.640 18:51:52 -- json_config/json_config.sh@130 -- # kill -0 2921685 00:05:35.640 18:51:52 -- json_config/json_config.sh@131 -- # app_pid[$app]= 00:05:35.640 18:51:52 -- json_config/json_config.sh@132 -- # break 00:05:35.640 18:51:52 -- json_config/json_config.sh@137 -- # [[ -n '' ]] 00:05:35.640 18:51:52 -- json_config/json_config.sh@142 -- # echo 'SPDK target shutdown done' 00:05:35.640 SPDK target shutdown done 00:05:35.640 18:51:52 -- json_config/json_config.sh@434 -- # echo 'INFO: relaunching applications...' 00:05:35.640 INFO: relaunching applications... 00:05:35.640 18:51:52 -- json_config/json_config.sh@435 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:35.640 18:51:52 -- json_config/json_config.sh@98 -- # local app=target 00:05:35.640 18:51:52 -- json_config/json_config.sh@99 -- # shift 00:05:35.640 18:51:52 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:05:35.640 18:51:52 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:05:35.640 18:51:52 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:05:35.640 18:51:52 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:35.640 18:51:52 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:35.640 18:51:52 -- json_config/json_config.sh@111 -- # app_pid[$app]=2923215 00:05:35.640 18:51:52 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:05:35.640 Waiting for target to run... 00:05:35.640 18:51:52 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:35.640 18:51:52 -- json_config/json_config.sh@114 -- # waitforlisten 2923215 /var/tmp/spdk_tgt.sock 00:05:35.640 18:51:52 -- common/autotest_common.sh@829 -- # '[' -z 2923215 ']' 00:05:35.640 18:51:52 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:05:35.640 18:51:52 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:35.640 18:51:52 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:05:35.640 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:05:35.640 18:51:52 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:35.640 18:51:52 -- common/autotest_common.sh@10 -- # set +x 00:05:35.640 [2024-11-26 18:51:52.483393] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:35.640 [2024-11-26 18:51:52.483452] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2923215 ] 00:05:35.640 EAL: No free 2048 kB hugepages reported on node 1 00:05:35.898 [2024-11-26 18:51:52.781636] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:35.898 [2024-11-26 18:51:52.804134] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:35.898 [2024-11-26 18:51:52.804243] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:39.181 [2024-11-26 18:51:55.785018] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:05:39.181 [2024-11-26 18:51:55.817375] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:05:39.181 18:51:55 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:39.181 18:51:55 -- common/autotest_common.sh@862 -- # return 0 00:05:39.181 18:51:55 -- json_config/json_config.sh@115 -- # echo '' 00:05:39.181 00:05:39.181 18:51:55 -- json_config/json_config.sh@436 -- # [[ 0 -eq 1 ]] 00:05:39.181 18:51:55 -- json_config/json_config.sh@440 -- # echo 'INFO: Checking if target configuration is the same...' 00:05:39.181 INFO: Checking if target configuration is the same... 00:05:39.181 18:51:55 -- json_config/json_config.sh@441 -- # tgt_rpc save_config 00:05:39.181 18:51:55 -- json_config/json_config.sh@441 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:39.181 18:51:55 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:39.181 + '[' 2 -ne 2 ']' 00:05:39.181 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:05:39.181 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:05:39.181 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:05:39.181 +++ basename /dev/fd/62 00:05:39.181 ++ mktemp /tmp/62.XXX 00:05:39.181 + tmp_file_1=/tmp/62.7wV 00:05:39.181 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:39.181 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:05:39.181 + tmp_file_2=/tmp/spdk_tgt_config.json.lET 00:05:39.181 + ret=0 00:05:39.181 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:39.439 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:39.439 + diff -u /tmp/62.7wV /tmp/spdk_tgt_config.json.lET 00:05:39.439 + echo 'INFO: JSON config files are the same' 00:05:39.439 INFO: JSON config files are the same 00:05:39.439 + rm /tmp/62.7wV /tmp/spdk_tgt_config.json.lET 00:05:39.439 + exit 0 00:05:39.439 18:51:56 -- json_config/json_config.sh@442 -- # [[ 0 -eq 1 ]] 00:05:39.439 18:51:56 -- json_config/json_config.sh@447 -- # echo 'INFO: changing configuration and checking if this can be detected...' 00:05:39.439 INFO: changing configuration and checking if this can be detected... 00:05:39.439 18:51:56 -- json_config/json_config.sh@449 -- # tgt_rpc bdev_malloc_delete MallocBdevForConfigChangeCheck 00:05:39.439 18:51:56 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_delete MallocBdevForConfigChangeCheck 00:05:39.697 18:51:56 -- json_config/json_config.sh@450 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:39.697 18:51:56 -- json_config/json_config.sh@450 -- # tgt_rpc save_config 00:05:39.697 18:51:56 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:39.697 + '[' 2 -ne 2 ']' 00:05:39.697 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:05:39.697 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:05:39.697 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:05:39.697 +++ basename /dev/fd/62 00:05:39.697 ++ mktemp /tmp/62.XXX 00:05:39.697 + tmp_file_1=/tmp/62.jXL 00:05:39.697 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:39.697 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:05:39.697 + tmp_file_2=/tmp/spdk_tgt_config.json.1Ig 00:05:39.697 + ret=0 00:05:39.697 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:39.954 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:40.213 + diff -u /tmp/62.jXL /tmp/spdk_tgt_config.json.1Ig 00:05:40.213 + ret=1 00:05:40.213 + echo '=== Start of file: /tmp/62.jXL ===' 00:05:40.213 + cat /tmp/62.jXL 00:05:40.213 + echo '=== End of file: /tmp/62.jXL ===' 00:05:40.213 + echo '' 00:05:40.213 + echo '=== Start of file: /tmp/spdk_tgt_config.json.1Ig ===' 00:05:40.213 + cat /tmp/spdk_tgt_config.json.1Ig 00:05:40.213 + echo '=== End of file: /tmp/spdk_tgt_config.json.1Ig ===' 00:05:40.213 + echo '' 00:05:40.213 + rm /tmp/62.jXL /tmp/spdk_tgt_config.json.1Ig 00:05:40.213 + exit 1 00:05:40.213 18:51:56 -- json_config/json_config.sh@454 -- # echo 'INFO: configuration change detected.' 00:05:40.213 INFO: configuration change detected. 00:05:40.213 18:51:56 -- json_config/json_config.sh@457 -- # json_config_test_fini 00:05:40.213 18:51:56 -- json_config/json_config.sh@359 -- # timing_enter json_config_test_fini 00:05:40.213 18:51:56 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:40.213 18:51:56 -- common/autotest_common.sh@10 -- # set +x 00:05:40.213 18:51:56 -- json_config/json_config.sh@360 -- # local ret=0 00:05:40.213 18:51:56 -- json_config/json_config.sh@362 -- # [[ -n '' ]] 00:05:40.213 18:51:56 -- json_config/json_config.sh@370 -- # [[ -n 2923215 ]] 00:05:40.213 18:51:56 -- json_config/json_config.sh@373 -- # cleanup_bdev_subsystem_config 00:05:40.213 18:51:56 -- json_config/json_config.sh@237 -- # timing_enter cleanup_bdev_subsystem_config 00:05:40.213 18:51:56 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:40.213 18:51:56 -- common/autotest_common.sh@10 -- # set +x 00:05:40.213 18:51:56 -- json_config/json_config.sh@239 -- # [[ 0 -eq 1 ]] 00:05:40.213 18:51:56 -- json_config/json_config.sh@246 -- # uname -s 00:05:40.213 18:51:56 -- json_config/json_config.sh@246 -- # [[ Linux = Linux ]] 00:05:40.213 18:51:56 -- json_config/json_config.sh@247 -- # rm -f /sample_aio 00:05:40.213 18:51:56 -- json_config/json_config.sh@250 -- # [[ 0 -eq 1 ]] 00:05:40.213 18:51:56 -- json_config/json_config.sh@254 -- # timing_exit cleanup_bdev_subsystem_config 00:05:40.213 18:51:56 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:40.213 18:51:56 -- common/autotest_common.sh@10 -- # set +x 00:05:40.213 18:51:56 -- json_config/json_config.sh@376 -- # killprocess 2923215 00:05:40.213 18:51:56 -- common/autotest_common.sh@936 -- # '[' -z 2923215 ']' 00:05:40.213 18:51:56 -- common/autotest_common.sh@940 -- # kill -0 2923215 00:05:40.213 18:51:56 -- common/autotest_common.sh@941 -- # uname 00:05:40.213 18:51:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:40.213 18:51:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2923215 00:05:40.213 18:51:57 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:40.213 18:51:57 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:40.213 18:51:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2923215' 00:05:40.213 killing process with pid 2923215 00:05:40.213 18:51:57 -- common/autotest_common.sh@955 -- # kill 2923215 00:05:40.213 18:51:57 -- common/autotest_common.sh@960 -- # wait 2923215 00:05:41.586 18:51:58 -- json_config/json_config.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:41.586 18:51:58 -- json_config/json_config.sh@380 -- # timing_exit json_config_test_fini 00:05:41.586 18:51:58 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:41.586 18:51:58 -- common/autotest_common.sh@10 -- # set +x 00:05:41.845 18:51:58 -- json_config/json_config.sh@381 -- # return 0 00:05:41.845 18:51:58 -- json_config/json_config.sh@459 -- # echo 'INFO: Success' 00:05:41.845 INFO: Success 00:05:41.845 00:05:41.845 real 0m14.619s 00:05:41.845 user 0m15.813s 00:05:41.845 sys 0m1.898s 00:05:41.845 18:51:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:41.845 18:51:58 -- common/autotest_common.sh@10 -- # set +x 00:05:41.845 ************************************ 00:05:41.845 END TEST json_config 00:05:41.845 ************************************ 00:05:41.845 18:51:58 -- spdk/autotest.sh@166 -- # run_test json_config_extra_key /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:05:41.845 18:51:58 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:41.845 18:51:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:41.845 18:51:58 -- common/autotest_common.sh@10 -- # set +x 00:05:41.845 ************************************ 00:05:41.845 START TEST json_config_extra_key 00:05:41.845 ************************************ 00:05:41.845 18:51:58 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:05:41.845 18:51:58 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:41.845 18:51:58 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:41.845 18:51:58 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:41.845 18:51:58 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:41.845 18:51:58 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:41.845 18:51:58 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:41.845 18:51:58 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:41.845 18:51:58 -- scripts/common.sh@335 -- # IFS=.-: 00:05:41.845 18:51:58 -- scripts/common.sh@335 -- # read -ra ver1 00:05:41.845 18:51:58 -- scripts/common.sh@336 -- # IFS=.-: 00:05:41.845 18:51:58 -- scripts/common.sh@336 -- # read -ra ver2 00:05:41.845 18:51:58 -- scripts/common.sh@337 -- # local 'op=<' 00:05:41.845 18:51:58 -- scripts/common.sh@339 -- # ver1_l=2 00:05:41.845 18:51:58 -- scripts/common.sh@340 -- # ver2_l=1 00:05:41.845 18:51:58 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:41.845 18:51:58 -- scripts/common.sh@343 -- # case "$op" in 00:05:41.845 18:51:58 -- scripts/common.sh@344 -- # : 1 00:05:41.845 18:51:58 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:41.845 18:51:58 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:41.845 18:51:58 -- scripts/common.sh@364 -- # decimal 1 00:05:41.845 18:51:58 -- scripts/common.sh@352 -- # local d=1 00:05:41.845 18:51:58 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:41.845 18:51:58 -- scripts/common.sh@354 -- # echo 1 00:05:41.845 18:51:58 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:41.845 18:51:58 -- scripts/common.sh@365 -- # decimal 2 00:05:41.845 18:51:58 -- scripts/common.sh@352 -- # local d=2 00:05:41.845 18:51:58 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:41.845 18:51:58 -- scripts/common.sh@354 -- # echo 2 00:05:41.845 18:51:58 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:41.845 18:51:58 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:41.845 18:51:58 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:41.845 18:51:58 -- scripts/common.sh@367 -- # return 0 00:05:41.845 18:51:58 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:41.845 18:51:58 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:41.845 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:41.845 --rc genhtml_branch_coverage=1 00:05:41.845 --rc genhtml_function_coverage=1 00:05:41.845 --rc genhtml_legend=1 00:05:41.845 --rc geninfo_all_blocks=1 00:05:41.845 --rc geninfo_unexecuted_blocks=1 00:05:41.845 00:05:41.845 ' 00:05:41.845 18:51:58 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:41.845 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:41.845 --rc genhtml_branch_coverage=1 00:05:41.845 --rc genhtml_function_coverage=1 00:05:41.845 --rc genhtml_legend=1 00:05:41.845 --rc geninfo_all_blocks=1 00:05:41.845 --rc geninfo_unexecuted_blocks=1 00:05:41.845 00:05:41.845 ' 00:05:41.845 18:51:58 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:41.845 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:41.845 --rc genhtml_branch_coverage=1 00:05:41.845 --rc genhtml_function_coverage=1 00:05:41.845 --rc genhtml_legend=1 00:05:41.845 --rc geninfo_all_blocks=1 00:05:41.845 --rc geninfo_unexecuted_blocks=1 00:05:41.845 00:05:41.845 ' 00:05:41.845 18:51:58 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:41.845 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:41.845 --rc genhtml_branch_coverage=1 00:05:41.845 --rc genhtml_function_coverage=1 00:05:41.845 --rc genhtml_legend=1 00:05:41.845 --rc geninfo_all_blocks=1 00:05:41.845 --rc geninfo_unexecuted_blocks=1 00:05:41.845 00:05:41.845 ' 00:05:41.845 18:51:58 -- json_config/json_config_extra_key.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:05:41.845 18:51:58 -- nvmf/common.sh@7 -- # uname -s 00:05:41.845 18:51:58 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:05:41.845 18:51:58 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:05:41.845 18:51:58 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:05:41.846 18:51:58 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:05:41.846 18:51:58 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:05:41.846 18:51:58 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:05:41.846 18:51:58 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:05:41.846 18:51:58 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:05:41.846 18:51:58 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:05:41.846 18:51:58 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:05:41.846 18:51:58 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:05:41.846 18:51:58 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:05:41.846 18:51:58 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:05:41.846 18:51:58 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:05:41.846 18:51:58 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:05:41.846 18:51:58 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:05:41.846 18:51:58 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:05:41.846 18:51:58 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:05:41.846 18:51:58 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:05:41.846 18:51:58 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:41.846 18:51:58 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:41.846 18:51:58 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:41.846 18:51:58 -- paths/export.sh@5 -- # export PATH 00:05:41.846 18:51:58 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:41.846 18:51:58 -- nvmf/common.sh@46 -- # : 0 00:05:41.846 18:51:58 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:05:41.846 18:51:58 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:05:41.846 18:51:58 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:05:41.846 18:51:58 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:05:41.846 18:51:58 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:05:41.846 18:51:58 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:05:41.846 18:51:58 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:05:41.846 18:51:58 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:05:41.846 18:51:58 -- json_config/json_config_extra_key.sh@16 -- # app_pid=(['target']='') 00:05:41.846 18:51:58 -- json_config/json_config_extra_key.sh@16 -- # declare -A app_pid 00:05:41.846 18:51:58 -- json_config/json_config_extra_key.sh@17 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock') 00:05:41.846 18:51:58 -- json_config/json_config_extra_key.sh@17 -- # declare -A app_socket 00:05:41.846 18:51:58 -- json_config/json_config_extra_key.sh@18 -- # app_params=(['target']='-m 0x1 -s 1024') 00:05:41.846 18:51:58 -- json_config/json_config_extra_key.sh@18 -- # declare -A app_params 00:05:41.846 18:51:58 -- json_config/json_config_extra_key.sh@19 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json') 00:05:41.846 18:51:58 -- json_config/json_config_extra_key.sh@19 -- # declare -A configs_path 00:05:41.846 18:51:58 -- json_config/json_config_extra_key.sh@74 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:05:41.846 18:51:58 -- json_config/json_config_extra_key.sh@76 -- # echo 'INFO: launching applications...' 00:05:41.846 INFO: launching applications... 00:05:41.846 18:51:58 -- json_config/json_config_extra_key.sh@77 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:05:41.846 18:51:58 -- json_config/json_config_extra_key.sh@24 -- # local app=target 00:05:41.846 18:51:58 -- json_config/json_config_extra_key.sh@25 -- # shift 00:05:41.846 18:51:58 -- json_config/json_config_extra_key.sh@27 -- # [[ -n 22 ]] 00:05:41.846 18:51:58 -- json_config/json_config_extra_key.sh@28 -- # [[ -z '' ]] 00:05:41.846 18:51:58 -- json_config/json_config_extra_key.sh@31 -- # app_pid[$app]=2924502 00:05:41.846 18:51:58 -- json_config/json_config_extra_key.sh@33 -- # echo 'Waiting for target to run...' 00:05:41.846 Waiting for target to run... 00:05:41.846 18:51:58 -- json_config/json_config_extra_key.sh@34 -- # waitforlisten 2924502 /var/tmp/spdk_tgt.sock 00:05:41.846 18:51:58 -- common/autotest_common.sh@829 -- # '[' -z 2924502 ']' 00:05:41.846 18:51:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:05:41.846 18:51:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:41.846 18:51:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:05:41.846 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:05:41.846 18:51:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:41.846 18:51:58 -- common/autotest_common.sh@10 -- # set +x 00:05:41.846 18:51:58 -- json_config/json_config_extra_key.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:05:41.846 [2024-11-26 18:51:58.762308] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:41.846 [2024-11-26 18:51:58.762357] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2924502 ] 00:05:42.104 EAL: No free 2048 kB hugepages reported on node 1 00:05:42.366 [2024-11-26 18:51:59.029954] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:42.366 [2024-11-26 18:51:59.052358] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:42.366 [2024-11-26 18:51:59.052453] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:42.933 18:51:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:42.933 18:51:59 -- common/autotest_common.sh@862 -- # return 0 00:05:42.933 18:51:59 -- json_config/json_config_extra_key.sh@35 -- # echo '' 00:05:42.933 00:05:42.933 18:51:59 -- json_config/json_config_extra_key.sh@79 -- # echo 'INFO: shutting down applications...' 00:05:42.933 INFO: shutting down applications... 00:05:42.933 18:51:59 -- json_config/json_config_extra_key.sh@80 -- # json_config_test_shutdown_app target 00:05:42.933 18:51:59 -- json_config/json_config_extra_key.sh@40 -- # local app=target 00:05:42.933 18:51:59 -- json_config/json_config_extra_key.sh@43 -- # [[ -n 22 ]] 00:05:42.933 18:51:59 -- json_config/json_config_extra_key.sh@44 -- # [[ -n 2924502 ]] 00:05:42.933 18:51:59 -- json_config/json_config_extra_key.sh@47 -- # kill -SIGINT 2924502 00:05:42.933 18:51:59 -- json_config/json_config_extra_key.sh@49 -- # (( i = 0 )) 00:05:42.933 18:51:59 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:05:42.933 18:51:59 -- json_config/json_config_extra_key.sh@50 -- # kill -0 2924502 00:05:42.933 18:51:59 -- json_config/json_config_extra_key.sh@54 -- # sleep 0.5 00:05:43.191 18:52:00 -- json_config/json_config_extra_key.sh@49 -- # (( i++ )) 00:05:43.191 18:52:00 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:05:43.191 18:52:00 -- json_config/json_config_extra_key.sh@50 -- # kill -0 2924502 00:05:43.191 18:52:00 -- json_config/json_config_extra_key.sh@51 -- # app_pid[$app]= 00:05:43.191 18:52:00 -- json_config/json_config_extra_key.sh@52 -- # break 00:05:43.191 18:52:00 -- json_config/json_config_extra_key.sh@57 -- # [[ -n '' ]] 00:05:43.191 18:52:00 -- json_config/json_config_extra_key.sh@62 -- # echo 'SPDK target shutdown done' 00:05:43.191 SPDK target shutdown done 00:05:43.191 18:52:00 -- json_config/json_config_extra_key.sh@82 -- # echo Success 00:05:43.191 Success 00:05:43.191 00:05:43.191 real 0m1.509s 00:05:43.191 user 0m1.293s 00:05:43.191 sys 0m0.366s 00:05:43.191 18:52:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:43.191 18:52:00 -- common/autotest_common.sh@10 -- # set +x 00:05:43.191 ************************************ 00:05:43.191 END TEST json_config_extra_key 00:05:43.191 ************************************ 00:05:43.191 18:52:00 -- spdk/autotest.sh@167 -- # run_test alias_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:05:43.191 18:52:00 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:43.191 18:52:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:43.191 18:52:00 -- common/autotest_common.sh@10 -- # set +x 00:05:43.191 ************************************ 00:05:43.191 START TEST alias_rpc 00:05:43.191 ************************************ 00:05:43.191 18:52:00 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:05:43.451 * Looking for test storage... 00:05:43.451 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc 00:05:43.451 18:52:00 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:43.451 18:52:00 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:43.451 18:52:00 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:43.451 18:52:00 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:43.451 18:52:00 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:43.451 18:52:00 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:43.451 18:52:00 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:43.451 18:52:00 -- scripts/common.sh@335 -- # IFS=.-: 00:05:43.451 18:52:00 -- scripts/common.sh@335 -- # read -ra ver1 00:05:43.451 18:52:00 -- scripts/common.sh@336 -- # IFS=.-: 00:05:43.451 18:52:00 -- scripts/common.sh@336 -- # read -ra ver2 00:05:43.451 18:52:00 -- scripts/common.sh@337 -- # local 'op=<' 00:05:43.451 18:52:00 -- scripts/common.sh@339 -- # ver1_l=2 00:05:43.451 18:52:00 -- scripts/common.sh@340 -- # ver2_l=1 00:05:43.451 18:52:00 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:43.451 18:52:00 -- scripts/common.sh@343 -- # case "$op" in 00:05:43.451 18:52:00 -- scripts/common.sh@344 -- # : 1 00:05:43.451 18:52:00 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:43.451 18:52:00 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:43.451 18:52:00 -- scripts/common.sh@364 -- # decimal 1 00:05:43.452 18:52:00 -- scripts/common.sh@352 -- # local d=1 00:05:43.452 18:52:00 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:43.452 18:52:00 -- scripts/common.sh@354 -- # echo 1 00:05:43.452 18:52:00 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:43.452 18:52:00 -- scripts/common.sh@365 -- # decimal 2 00:05:43.452 18:52:00 -- scripts/common.sh@352 -- # local d=2 00:05:43.452 18:52:00 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:43.452 18:52:00 -- scripts/common.sh@354 -- # echo 2 00:05:43.452 18:52:00 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:43.452 18:52:00 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:43.452 18:52:00 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:43.452 18:52:00 -- scripts/common.sh@367 -- # return 0 00:05:43.452 18:52:00 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:43.452 18:52:00 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:43.452 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:43.452 --rc genhtml_branch_coverage=1 00:05:43.452 --rc genhtml_function_coverage=1 00:05:43.452 --rc genhtml_legend=1 00:05:43.452 --rc geninfo_all_blocks=1 00:05:43.452 --rc geninfo_unexecuted_blocks=1 00:05:43.452 00:05:43.452 ' 00:05:43.452 18:52:00 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:43.452 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:43.452 --rc genhtml_branch_coverage=1 00:05:43.452 --rc genhtml_function_coverage=1 00:05:43.452 --rc genhtml_legend=1 00:05:43.452 --rc geninfo_all_blocks=1 00:05:43.452 --rc geninfo_unexecuted_blocks=1 00:05:43.452 00:05:43.452 ' 00:05:43.452 18:52:00 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:43.452 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:43.452 --rc genhtml_branch_coverage=1 00:05:43.452 --rc genhtml_function_coverage=1 00:05:43.452 --rc genhtml_legend=1 00:05:43.452 --rc geninfo_all_blocks=1 00:05:43.452 --rc geninfo_unexecuted_blocks=1 00:05:43.452 00:05:43.452 ' 00:05:43.452 18:52:00 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:43.452 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:43.452 --rc genhtml_branch_coverage=1 00:05:43.452 --rc genhtml_function_coverage=1 00:05:43.452 --rc genhtml_legend=1 00:05:43.452 --rc geninfo_all_blocks=1 00:05:43.452 --rc geninfo_unexecuted_blocks=1 00:05:43.452 00:05:43.452 ' 00:05:43.452 18:52:00 -- alias_rpc/alias_rpc.sh@10 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:05:43.452 18:52:00 -- alias_rpc/alias_rpc.sh@13 -- # spdk_tgt_pid=2924798 00:05:43.452 18:52:00 -- alias_rpc/alias_rpc.sh@14 -- # waitforlisten 2924798 00:05:43.452 18:52:00 -- alias_rpc/alias_rpc.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:05:43.452 18:52:00 -- common/autotest_common.sh@829 -- # '[' -z 2924798 ']' 00:05:43.452 18:52:00 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:43.452 18:52:00 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:43.452 18:52:00 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:43.452 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:43.452 18:52:00 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:43.452 18:52:00 -- common/autotest_common.sh@10 -- # set +x 00:05:43.452 [2024-11-26 18:52:00.320749] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:43.452 [2024-11-26 18:52:00.320799] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2924798 ] 00:05:43.452 EAL: No free 2048 kB hugepages reported on node 1 00:05:43.712 [2024-11-26 18:52:00.376547] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:43.712 [2024-11-26 18:52:00.416674] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:43.712 [2024-11-26 18:52:00.416791] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:44.278 18:52:01 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:44.278 18:52:01 -- common/autotest_common.sh@862 -- # return 0 00:05:44.278 18:52:01 -- alias_rpc/alias_rpc.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_config -i 00:05:44.537 18:52:01 -- alias_rpc/alias_rpc.sh@19 -- # killprocess 2924798 00:05:44.537 18:52:01 -- common/autotest_common.sh@936 -- # '[' -z 2924798 ']' 00:05:44.537 18:52:01 -- common/autotest_common.sh@940 -- # kill -0 2924798 00:05:44.537 18:52:01 -- common/autotest_common.sh@941 -- # uname 00:05:44.537 18:52:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:44.537 18:52:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2924798 00:05:44.537 18:52:01 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:44.537 18:52:01 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:44.537 18:52:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2924798' 00:05:44.537 killing process with pid 2924798 00:05:44.537 18:52:01 -- common/autotest_common.sh@955 -- # kill 2924798 00:05:44.537 18:52:01 -- common/autotest_common.sh@960 -- # wait 2924798 00:05:44.796 00:05:44.796 real 0m1.605s 00:05:44.796 user 0m1.784s 00:05:44.796 sys 0m0.411s 00:05:44.796 18:52:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:44.796 18:52:01 -- common/autotest_common.sh@10 -- # set +x 00:05:44.796 ************************************ 00:05:44.796 END TEST alias_rpc 00:05:44.796 ************************************ 00:05:45.056 18:52:01 -- spdk/autotest.sh@169 -- # [[ 0 -eq 0 ]] 00:05:45.056 18:52:01 -- spdk/autotest.sh@170 -- # run_test spdkcli_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:05:45.056 18:52:01 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:45.056 18:52:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:45.056 18:52:01 -- common/autotest_common.sh@10 -- # set +x 00:05:45.056 ************************************ 00:05:45.056 START TEST spdkcli_tcp 00:05:45.057 ************************************ 00:05:45.057 18:52:01 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:05:45.057 * Looking for test storage... 00:05:45.057 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:05:45.057 18:52:01 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:45.057 18:52:01 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:45.057 18:52:01 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:45.057 18:52:01 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:45.057 18:52:01 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:45.057 18:52:01 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:45.057 18:52:01 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:45.057 18:52:01 -- scripts/common.sh@335 -- # IFS=.-: 00:05:45.057 18:52:01 -- scripts/common.sh@335 -- # read -ra ver1 00:05:45.057 18:52:01 -- scripts/common.sh@336 -- # IFS=.-: 00:05:45.057 18:52:01 -- scripts/common.sh@336 -- # read -ra ver2 00:05:45.057 18:52:01 -- scripts/common.sh@337 -- # local 'op=<' 00:05:45.057 18:52:01 -- scripts/common.sh@339 -- # ver1_l=2 00:05:45.057 18:52:01 -- scripts/common.sh@340 -- # ver2_l=1 00:05:45.057 18:52:01 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:45.057 18:52:01 -- scripts/common.sh@343 -- # case "$op" in 00:05:45.057 18:52:01 -- scripts/common.sh@344 -- # : 1 00:05:45.057 18:52:01 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:45.057 18:52:01 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:45.057 18:52:01 -- scripts/common.sh@364 -- # decimal 1 00:05:45.057 18:52:01 -- scripts/common.sh@352 -- # local d=1 00:05:45.057 18:52:01 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:45.057 18:52:01 -- scripts/common.sh@354 -- # echo 1 00:05:45.057 18:52:01 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:45.057 18:52:01 -- scripts/common.sh@365 -- # decimal 2 00:05:45.057 18:52:01 -- scripts/common.sh@352 -- # local d=2 00:05:45.057 18:52:01 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:45.057 18:52:01 -- scripts/common.sh@354 -- # echo 2 00:05:45.057 18:52:01 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:45.057 18:52:01 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:45.057 18:52:01 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:45.057 18:52:01 -- scripts/common.sh@367 -- # return 0 00:05:45.057 18:52:01 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:45.057 18:52:01 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:45.057 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:45.057 --rc genhtml_branch_coverage=1 00:05:45.057 --rc genhtml_function_coverage=1 00:05:45.057 --rc genhtml_legend=1 00:05:45.057 --rc geninfo_all_blocks=1 00:05:45.057 --rc geninfo_unexecuted_blocks=1 00:05:45.057 00:05:45.057 ' 00:05:45.057 18:52:01 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:45.057 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:45.057 --rc genhtml_branch_coverage=1 00:05:45.057 --rc genhtml_function_coverage=1 00:05:45.057 --rc genhtml_legend=1 00:05:45.057 --rc geninfo_all_blocks=1 00:05:45.057 --rc geninfo_unexecuted_blocks=1 00:05:45.057 00:05:45.057 ' 00:05:45.057 18:52:01 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:45.057 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:45.057 --rc genhtml_branch_coverage=1 00:05:45.057 --rc genhtml_function_coverage=1 00:05:45.057 --rc genhtml_legend=1 00:05:45.057 --rc geninfo_all_blocks=1 00:05:45.057 --rc geninfo_unexecuted_blocks=1 00:05:45.057 00:05:45.057 ' 00:05:45.057 18:52:01 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:45.057 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:45.057 --rc genhtml_branch_coverage=1 00:05:45.057 --rc genhtml_function_coverage=1 00:05:45.057 --rc genhtml_legend=1 00:05:45.057 --rc geninfo_all_blocks=1 00:05:45.057 --rc geninfo_unexecuted_blocks=1 00:05:45.057 00:05:45.057 ' 00:05:45.057 18:52:01 -- spdkcli/tcp.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:05:45.057 18:52:01 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:05:45.057 18:52:01 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:05:45.057 18:52:01 -- spdkcli/tcp.sh@18 -- # IP_ADDRESS=127.0.0.1 00:05:45.057 18:52:01 -- spdkcli/tcp.sh@19 -- # PORT=9998 00:05:45.057 18:52:01 -- spdkcli/tcp.sh@21 -- # trap 'err_cleanup; exit 1' SIGINT SIGTERM EXIT 00:05:45.057 18:52:01 -- spdkcli/tcp.sh@23 -- # timing_enter run_spdk_tgt_tcp 00:05:45.057 18:52:01 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:45.057 18:52:01 -- common/autotest_common.sh@10 -- # set +x 00:05:45.057 18:52:01 -- spdkcli/tcp.sh@25 -- # spdk_tgt_pid=2925093 00:05:45.057 18:52:01 -- spdkcli/tcp.sh@27 -- # waitforlisten 2925093 00:05:45.057 18:52:01 -- spdkcli/tcp.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x3 -p 0 00:05:45.057 18:52:01 -- common/autotest_common.sh@829 -- # '[' -z 2925093 ']' 00:05:45.057 18:52:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:45.057 18:52:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:45.057 18:52:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:45.057 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:45.057 18:52:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:45.057 18:52:01 -- common/autotest_common.sh@10 -- # set +x 00:05:45.057 [2024-11-26 18:52:01.965896] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:45.057 [2024-11-26 18:52:01.965954] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2925093 ] 00:05:45.317 EAL: No free 2048 kB hugepages reported on node 1 00:05:45.317 [2024-11-26 18:52:02.021029] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:45.317 [2024-11-26 18:52:02.058899] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:45.317 [2024-11-26 18:52:02.059152] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:45.317 [2024-11-26 18:52:02.059156] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:45.885 18:52:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:45.885 18:52:02 -- common/autotest_common.sh@862 -- # return 0 00:05:45.885 18:52:02 -- spdkcli/tcp.sh@30 -- # socat TCP-LISTEN:9998 UNIX-CONNECT:/var/tmp/spdk.sock 00:05:45.885 18:52:02 -- spdkcli/tcp.sh@31 -- # socat_pid=2925325 00:05:45.885 18:52:02 -- spdkcli/tcp.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -r 100 -t 2 -s 127.0.0.1 -p 9998 rpc_get_methods 00:05:46.144 [ 00:05:46.144 "bdev_malloc_delete", 00:05:46.144 "bdev_malloc_create", 00:05:46.144 "bdev_null_resize", 00:05:46.144 "bdev_null_delete", 00:05:46.144 "bdev_null_create", 00:05:46.144 "bdev_nvme_cuse_unregister", 00:05:46.144 "bdev_nvme_cuse_register", 00:05:46.144 "bdev_opal_new_user", 00:05:46.144 "bdev_opal_set_lock_state", 00:05:46.144 "bdev_opal_delete", 00:05:46.144 "bdev_opal_get_info", 00:05:46.144 "bdev_opal_create", 00:05:46.144 "bdev_nvme_opal_revert", 00:05:46.144 "bdev_nvme_opal_init", 00:05:46.144 "bdev_nvme_send_cmd", 00:05:46.144 "bdev_nvme_get_path_iostat", 00:05:46.144 "bdev_nvme_get_mdns_discovery_info", 00:05:46.144 "bdev_nvme_stop_mdns_discovery", 00:05:46.144 "bdev_nvme_start_mdns_discovery", 00:05:46.144 "bdev_nvme_set_multipath_policy", 00:05:46.144 "bdev_nvme_set_preferred_path", 00:05:46.144 "bdev_nvme_get_io_paths", 00:05:46.144 "bdev_nvme_remove_error_injection", 00:05:46.144 "bdev_nvme_add_error_injection", 00:05:46.144 "bdev_nvme_get_discovery_info", 00:05:46.144 "bdev_nvme_stop_discovery", 00:05:46.144 "bdev_nvme_start_discovery", 00:05:46.144 "bdev_nvme_get_controller_health_info", 00:05:46.144 "bdev_nvme_disable_controller", 00:05:46.144 "bdev_nvme_enable_controller", 00:05:46.144 "bdev_nvme_reset_controller", 00:05:46.144 "bdev_nvme_get_transport_statistics", 00:05:46.144 "bdev_nvme_apply_firmware", 00:05:46.144 "bdev_nvme_detach_controller", 00:05:46.144 "bdev_nvme_get_controllers", 00:05:46.144 "bdev_nvme_attach_controller", 00:05:46.144 "bdev_nvme_set_hotplug", 00:05:46.144 "bdev_nvme_set_options", 00:05:46.144 "bdev_passthru_delete", 00:05:46.144 "bdev_passthru_create", 00:05:46.144 "bdev_lvol_grow_lvstore", 00:05:46.144 "bdev_lvol_get_lvols", 00:05:46.144 "bdev_lvol_get_lvstores", 00:05:46.144 "bdev_lvol_delete", 00:05:46.144 "bdev_lvol_set_read_only", 00:05:46.144 "bdev_lvol_resize", 00:05:46.144 "bdev_lvol_decouple_parent", 00:05:46.144 "bdev_lvol_inflate", 00:05:46.144 "bdev_lvol_rename", 00:05:46.144 "bdev_lvol_clone_bdev", 00:05:46.144 "bdev_lvol_clone", 00:05:46.144 "bdev_lvol_snapshot", 00:05:46.144 "bdev_lvol_create", 00:05:46.144 "bdev_lvol_delete_lvstore", 00:05:46.144 "bdev_lvol_rename_lvstore", 00:05:46.144 "bdev_lvol_create_lvstore", 00:05:46.144 "bdev_raid_set_options", 00:05:46.144 "bdev_raid_remove_base_bdev", 00:05:46.144 "bdev_raid_add_base_bdev", 00:05:46.144 "bdev_raid_delete", 00:05:46.144 "bdev_raid_create", 00:05:46.144 "bdev_raid_get_bdevs", 00:05:46.144 "bdev_error_inject_error", 00:05:46.144 "bdev_error_delete", 00:05:46.144 "bdev_error_create", 00:05:46.144 "bdev_split_delete", 00:05:46.144 "bdev_split_create", 00:05:46.144 "bdev_delay_delete", 00:05:46.144 "bdev_delay_create", 00:05:46.144 "bdev_delay_update_latency", 00:05:46.144 "bdev_zone_block_delete", 00:05:46.144 "bdev_zone_block_create", 00:05:46.144 "blobfs_create", 00:05:46.144 "blobfs_detect", 00:05:46.144 "blobfs_set_cache_size", 00:05:46.144 "bdev_aio_delete", 00:05:46.144 "bdev_aio_rescan", 00:05:46.144 "bdev_aio_create", 00:05:46.144 "bdev_ftl_set_property", 00:05:46.144 "bdev_ftl_get_properties", 00:05:46.144 "bdev_ftl_get_stats", 00:05:46.144 "bdev_ftl_unmap", 00:05:46.144 "bdev_ftl_unload", 00:05:46.144 "bdev_ftl_delete", 00:05:46.144 "bdev_ftl_load", 00:05:46.144 "bdev_ftl_create", 00:05:46.144 "bdev_virtio_attach_controller", 00:05:46.144 "bdev_virtio_scsi_get_devices", 00:05:46.144 "bdev_virtio_detach_controller", 00:05:46.144 "bdev_virtio_blk_set_hotplug", 00:05:46.144 "bdev_iscsi_delete", 00:05:46.144 "bdev_iscsi_create", 00:05:46.144 "bdev_iscsi_set_options", 00:05:46.144 "accel_error_inject_error", 00:05:46.144 "ioat_scan_accel_module", 00:05:46.144 "dsa_scan_accel_module", 00:05:46.144 "iaa_scan_accel_module", 00:05:46.144 "vfu_virtio_create_scsi_endpoint", 00:05:46.144 "vfu_virtio_scsi_remove_target", 00:05:46.144 "vfu_virtio_scsi_add_target", 00:05:46.144 "vfu_virtio_create_blk_endpoint", 00:05:46.144 "vfu_virtio_delete_endpoint", 00:05:46.144 "iscsi_set_options", 00:05:46.144 "iscsi_get_auth_groups", 00:05:46.144 "iscsi_auth_group_remove_secret", 00:05:46.144 "iscsi_auth_group_add_secret", 00:05:46.144 "iscsi_delete_auth_group", 00:05:46.144 "iscsi_create_auth_group", 00:05:46.144 "iscsi_set_discovery_auth", 00:05:46.144 "iscsi_get_options", 00:05:46.144 "iscsi_target_node_request_logout", 00:05:46.144 "iscsi_target_node_set_redirect", 00:05:46.144 "iscsi_target_node_set_auth", 00:05:46.144 "iscsi_target_node_add_lun", 00:05:46.144 "iscsi_get_connections", 00:05:46.144 "iscsi_portal_group_set_auth", 00:05:46.144 "iscsi_start_portal_group", 00:05:46.144 "iscsi_delete_portal_group", 00:05:46.144 "iscsi_create_portal_group", 00:05:46.144 "iscsi_get_portal_groups", 00:05:46.144 "iscsi_delete_target_node", 00:05:46.144 "iscsi_target_node_remove_pg_ig_maps", 00:05:46.144 "iscsi_target_node_add_pg_ig_maps", 00:05:46.144 "iscsi_create_target_node", 00:05:46.144 "iscsi_get_target_nodes", 00:05:46.144 "iscsi_delete_initiator_group", 00:05:46.144 "iscsi_initiator_group_remove_initiators", 00:05:46.144 "iscsi_initiator_group_add_initiators", 00:05:46.144 "iscsi_create_initiator_group", 00:05:46.144 "iscsi_get_initiator_groups", 00:05:46.144 "nvmf_set_crdt", 00:05:46.144 "nvmf_set_config", 00:05:46.144 "nvmf_set_max_subsystems", 00:05:46.144 "nvmf_subsystem_get_listeners", 00:05:46.144 "nvmf_subsystem_get_qpairs", 00:05:46.144 "nvmf_subsystem_get_controllers", 00:05:46.144 "nvmf_get_stats", 00:05:46.144 "nvmf_get_transports", 00:05:46.144 "nvmf_create_transport", 00:05:46.144 "nvmf_get_targets", 00:05:46.144 "nvmf_delete_target", 00:05:46.144 "nvmf_create_target", 00:05:46.144 "nvmf_subsystem_allow_any_host", 00:05:46.144 "nvmf_subsystem_remove_host", 00:05:46.144 "nvmf_subsystem_add_host", 00:05:46.144 "nvmf_subsystem_remove_ns", 00:05:46.144 "nvmf_subsystem_add_ns", 00:05:46.144 "nvmf_subsystem_listener_set_ana_state", 00:05:46.144 "nvmf_discovery_get_referrals", 00:05:46.144 "nvmf_discovery_remove_referral", 00:05:46.144 "nvmf_discovery_add_referral", 00:05:46.144 "nvmf_subsystem_remove_listener", 00:05:46.144 "nvmf_subsystem_add_listener", 00:05:46.144 "nvmf_delete_subsystem", 00:05:46.144 "nvmf_create_subsystem", 00:05:46.144 "nvmf_get_subsystems", 00:05:46.144 "env_dpdk_get_mem_stats", 00:05:46.144 "nbd_get_disks", 00:05:46.144 "nbd_stop_disk", 00:05:46.144 "nbd_start_disk", 00:05:46.144 "ublk_recover_disk", 00:05:46.144 "ublk_get_disks", 00:05:46.144 "ublk_stop_disk", 00:05:46.144 "ublk_start_disk", 00:05:46.144 "ublk_destroy_target", 00:05:46.144 "ublk_create_target", 00:05:46.144 "virtio_blk_create_transport", 00:05:46.144 "virtio_blk_get_transports", 00:05:46.144 "vhost_controller_set_coalescing", 00:05:46.144 "vhost_get_controllers", 00:05:46.144 "vhost_delete_controller", 00:05:46.144 "vhost_create_blk_controller", 00:05:46.144 "vhost_scsi_controller_remove_target", 00:05:46.144 "vhost_scsi_controller_add_target", 00:05:46.144 "vhost_start_scsi_controller", 00:05:46.144 "vhost_create_scsi_controller", 00:05:46.144 "thread_set_cpumask", 00:05:46.144 "framework_get_scheduler", 00:05:46.144 "framework_set_scheduler", 00:05:46.144 "framework_get_reactors", 00:05:46.144 "thread_get_io_channels", 00:05:46.145 "thread_get_pollers", 00:05:46.145 "thread_get_stats", 00:05:46.145 "framework_monitor_context_switch", 00:05:46.145 "spdk_kill_instance", 00:05:46.145 "log_enable_timestamps", 00:05:46.145 "log_get_flags", 00:05:46.145 "log_clear_flag", 00:05:46.145 "log_set_flag", 00:05:46.145 "log_get_level", 00:05:46.145 "log_set_level", 00:05:46.145 "log_get_print_level", 00:05:46.145 "log_set_print_level", 00:05:46.145 "framework_enable_cpumask_locks", 00:05:46.145 "framework_disable_cpumask_locks", 00:05:46.145 "framework_wait_init", 00:05:46.145 "framework_start_init", 00:05:46.145 "scsi_get_devices", 00:05:46.145 "bdev_get_histogram", 00:05:46.145 "bdev_enable_histogram", 00:05:46.145 "bdev_set_qos_limit", 00:05:46.145 "bdev_set_qd_sampling_period", 00:05:46.145 "bdev_get_bdevs", 00:05:46.145 "bdev_reset_iostat", 00:05:46.145 "bdev_get_iostat", 00:05:46.145 "bdev_examine", 00:05:46.145 "bdev_wait_for_examine", 00:05:46.145 "bdev_set_options", 00:05:46.145 "notify_get_notifications", 00:05:46.145 "notify_get_types", 00:05:46.145 "accel_get_stats", 00:05:46.145 "accel_set_options", 00:05:46.145 "accel_set_driver", 00:05:46.145 "accel_crypto_key_destroy", 00:05:46.145 "accel_crypto_keys_get", 00:05:46.145 "accel_crypto_key_create", 00:05:46.145 "accel_assign_opc", 00:05:46.145 "accel_get_module_info", 00:05:46.145 "accel_get_opc_assignments", 00:05:46.145 "vmd_rescan", 00:05:46.145 "vmd_remove_device", 00:05:46.145 "vmd_enable", 00:05:46.145 "sock_set_default_impl", 00:05:46.145 "sock_impl_set_options", 00:05:46.145 "sock_impl_get_options", 00:05:46.145 "iobuf_get_stats", 00:05:46.145 "iobuf_set_options", 00:05:46.145 "framework_get_pci_devices", 00:05:46.145 "framework_get_config", 00:05:46.145 "framework_get_subsystems", 00:05:46.145 "vfu_tgt_set_base_path", 00:05:46.145 "trace_get_info", 00:05:46.145 "trace_get_tpoint_group_mask", 00:05:46.145 "trace_disable_tpoint_group", 00:05:46.145 "trace_enable_tpoint_group", 00:05:46.145 "trace_clear_tpoint_mask", 00:05:46.145 "trace_set_tpoint_mask", 00:05:46.145 "spdk_get_version", 00:05:46.145 "rpc_get_methods" 00:05:46.145 ] 00:05:46.145 18:52:02 -- spdkcli/tcp.sh@35 -- # timing_exit run_spdk_tgt_tcp 00:05:46.145 18:52:02 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:46.145 18:52:02 -- common/autotest_common.sh@10 -- # set +x 00:05:46.145 18:52:02 -- spdkcli/tcp.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:05:46.145 18:52:02 -- spdkcli/tcp.sh@38 -- # killprocess 2925093 00:05:46.145 18:52:02 -- common/autotest_common.sh@936 -- # '[' -z 2925093 ']' 00:05:46.145 18:52:02 -- common/autotest_common.sh@940 -- # kill -0 2925093 00:05:46.145 18:52:02 -- common/autotest_common.sh@941 -- # uname 00:05:46.145 18:52:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:46.145 18:52:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2925093 00:05:46.145 18:52:03 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:46.145 18:52:03 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:46.145 18:52:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2925093' 00:05:46.145 killing process with pid 2925093 00:05:46.145 18:52:03 -- common/autotest_common.sh@955 -- # kill 2925093 00:05:46.145 18:52:03 -- common/autotest_common.sh@960 -- # wait 2925093 00:05:46.711 00:05:46.711 real 0m1.579s 00:05:46.711 user 0m2.950s 00:05:46.711 sys 0m0.427s 00:05:46.711 18:52:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:46.711 18:52:03 -- common/autotest_common.sh@10 -- # set +x 00:05:46.711 ************************************ 00:05:46.711 END TEST spdkcli_tcp 00:05:46.711 ************************************ 00:05:46.711 18:52:03 -- spdk/autotest.sh@173 -- # run_test dpdk_mem_utility /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:05:46.711 18:52:03 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:46.711 18:52:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:46.711 18:52:03 -- common/autotest_common.sh@10 -- # set +x 00:05:46.711 ************************************ 00:05:46.711 START TEST dpdk_mem_utility 00:05:46.711 ************************************ 00:05:46.711 18:52:03 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:05:46.711 * Looking for test storage... 00:05:46.711 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility 00:05:46.711 18:52:03 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:46.711 18:52:03 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:46.711 18:52:03 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:46.711 18:52:03 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:46.711 18:52:03 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:46.711 18:52:03 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:46.711 18:52:03 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:46.711 18:52:03 -- scripts/common.sh@335 -- # IFS=.-: 00:05:46.711 18:52:03 -- scripts/common.sh@335 -- # read -ra ver1 00:05:46.711 18:52:03 -- scripts/common.sh@336 -- # IFS=.-: 00:05:46.711 18:52:03 -- scripts/common.sh@336 -- # read -ra ver2 00:05:46.711 18:52:03 -- scripts/common.sh@337 -- # local 'op=<' 00:05:46.711 18:52:03 -- scripts/common.sh@339 -- # ver1_l=2 00:05:46.711 18:52:03 -- scripts/common.sh@340 -- # ver2_l=1 00:05:46.711 18:52:03 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:46.711 18:52:03 -- scripts/common.sh@343 -- # case "$op" in 00:05:46.711 18:52:03 -- scripts/common.sh@344 -- # : 1 00:05:46.711 18:52:03 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:46.711 18:52:03 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:46.711 18:52:03 -- scripts/common.sh@364 -- # decimal 1 00:05:46.711 18:52:03 -- scripts/common.sh@352 -- # local d=1 00:05:46.711 18:52:03 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:46.711 18:52:03 -- scripts/common.sh@354 -- # echo 1 00:05:46.711 18:52:03 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:46.711 18:52:03 -- scripts/common.sh@365 -- # decimal 2 00:05:46.711 18:52:03 -- scripts/common.sh@352 -- # local d=2 00:05:46.711 18:52:03 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:46.711 18:52:03 -- scripts/common.sh@354 -- # echo 2 00:05:46.711 18:52:03 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:46.711 18:52:03 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:46.711 18:52:03 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:46.711 18:52:03 -- scripts/common.sh@367 -- # return 0 00:05:46.711 18:52:03 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:46.711 18:52:03 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:46.711 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:46.711 --rc genhtml_branch_coverage=1 00:05:46.711 --rc genhtml_function_coverage=1 00:05:46.711 --rc genhtml_legend=1 00:05:46.711 --rc geninfo_all_blocks=1 00:05:46.711 --rc geninfo_unexecuted_blocks=1 00:05:46.711 00:05:46.711 ' 00:05:46.711 18:52:03 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:46.711 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:46.711 --rc genhtml_branch_coverage=1 00:05:46.711 --rc genhtml_function_coverage=1 00:05:46.711 --rc genhtml_legend=1 00:05:46.711 --rc geninfo_all_blocks=1 00:05:46.711 --rc geninfo_unexecuted_blocks=1 00:05:46.711 00:05:46.711 ' 00:05:46.711 18:52:03 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:46.711 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:46.711 --rc genhtml_branch_coverage=1 00:05:46.711 --rc genhtml_function_coverage=1 00:05:46.711 --rc genhtml_legend=1 00:05:46.711 --rc geninfo_all_blocks=1 00:05:46.711 --rc geninfo_unexecuted_blocks=1 00:05:46.711 00:05:46.711 ' 00:05:46.711 18:52:03 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:46.711 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:46.711 --rc genhtml_branch_coverage=1 00:05:46.711 --rc genhtml_function_coverage=1 00:05:46.711 --rc genhtml_legend=1 00:05:46.711 --rc geninfo_all_blocks=1 00:05:46.711 --rc geninfo_unexecuted_blocks=1 00:05:46.711 00:05:46.711 ' 00:05:46.711 18:52:03 -- dpdk_memory_utility/test_dpdk_mem_info.sh@10 -- # MEM_SCRIPT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:05:46.711 18:52:03 -- dpdk_memory_utility/test_dpdk_mem_info.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:05:46.711 18:52:03 -- dpdk_memory_utility/test_dpdk_mem_info.sh@13 -- # spdkpid=2925408 00:05:46.711 18:52:03 -- dpdk_memory_utility/test_dpdk_mem_info.sh@15 -- # waitforlisten 2925408 00:05:46.711 18:52:03 -- common/autotest_common.sh@829 -- # '[' -z 2925408 ']' 00:05:46.711 18:52:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:46.711 18:52:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:46.711 18:52:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:46.711 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:46.711 18:52:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:46.711 18:52:03 -- common/autotest_common.sh@10 -- # set +x 00:05:46.711 [2024-11-26 18:52:03.567626] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:46.711 [2024-11-26 18:52:03.567678] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2925408 ] 00:05:46.711 EAL: No free 2048 kB hugepages reported on node 1 00:05:46.711 [2024-11-26 18:52:03.621248] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:46.970 [2024-11-26 18:52:03.660219] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:46.970 [2024-11-26 18:52:03.660340] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:47.535 18:52:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:47.535 18:52:04 -- common/autotest_common.sh@862 -- # return 0 00:05:47.535 18:52:04 -- dpdk_memory_utility/test_dpdk_mem_info.sh@17 -- # trap 'killprocess $spdkpid' SIGINT SIGTERM EXIT 00:05:47.535 18:52:04 -- dpdk_memory_utility/test_dpdk_mem_info.sh@19 -- # rpc_cmd env_dpdk_get_mem_stats 00:05:47.535 18:52:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:47.535 18:52:04 -- common/autotest_common.sh@10 -- # set +x 00:05:47.535 { 00:05:47.535 "filename": "/tmp/spdk_mem_dump.txt" 00:05:47.535 } 00:05:47.535 18:52:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:47.535 18:52:04 -- dpdk_memory_utility/test_dpdk_mem_info.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:05:47.535 DPDK memory size 814.000000 MiB in 1 heap(s) 00:05:47.535 1 heaps totaling size 814.000000 MiB 00:05:47.535 size: 814.000000 MiB heap id: 0 00:05:47.535 end heaps---------- 00:05:47.535 8 mempools totaling size 598.116089 MiB 00:05:47.535 size: 212.674988 MiB name: PDU_immediate_data_Pool 00:05:47.535 size: 158.602051 MiB name: PDU_data_out_Pool 00:05:47.535 size: 84.521057 MiB name: bdev_io_2925408 00:05:47.535 size: 51.011292 MiB name: evtpool_2925408 00:05:47.535 size: 50.003479 MiB name: msgpool_2925408 00:05:47.535 size: 21.763794 MiB name: PDU_Pool 00:05:47.535 size: 19.513306 MiB name: SCSI_TASK_Pool 00:05:47.535 size: 0.026123 MiB name: Session_Pool 00:05:47.535 end mempools------- 00:05:47.535 6 memzones totaling size 4.142822 MiB 00:05:47.535 size: 1.000366 MiB name: RG_ring_0_2925408 00:05:47.535 size: 1.000366 MiB name: RG_ring_1_2925408 00:05:47.535 size: 1.000366 MiB name: RG_ring_4_2925408 00:05:47.535 size: 1.000366 MiB name: RG_ring_5_2925408 00:05:47.535 size: 0.125366 MiB name: RG_ring_2_2925408 00:05:47.535 size: 0.015991 MiB name: RG_ring_3_2925408 00:05:47.535 end memzones------- 00:05:47.793 18:52:04 -- dpdk_memory_utility/test_dpdk_mem_info.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py -m 0 00:05:47.793 heap id: 0 total size: 814.000000 MiB number of busy elements: 41 number of free elements: 15 00:05:47.793 list of free elements. size: 12.519348 MiB 00:05:47.793 element at address: 0x200000400000 with size: 1.999512 MiB 00:05:47.793 element at address: 0x200018e00000 with size: 0.999878 MiB 00:05:47.793 element at address: 0x200019000000 with size: 0.999878 MiB 00:05:47.793 element at address: 0x200003e00000 with size: 0.996277 MiB 00:05:47.793 element at address: 0x200031c00000 with size: 0.994446 MiB 00:05:47.793 element at address: 0x200013800000 with size: 0.978699 MiB 00:05:47.793 element at address: 0x200007000000 with size: 0.959839 MiB 00:05:47.793 element at address: 0x200019200000 with size: 0.936584 MiB 00:05:47.793 element at address: 0x200000200000 with size: 0.841614 MiB 00:05:47.793 element at address: 0x20001aa00000 with size: 0.582886 MiB 00:05:47.793 element at address: 0x20000b200000 with size: 0.490723 MiB 00:05:47.793 element at address: 0x200000800000 with size: 0.487793 MiB 00:05:47.793 element at address: 0x200019400000 with size: 0.485657 MiB 00:05:47.793 element at address: 0x200027e00000 with size: 0.410034 MiB 00:05:47.793 element at address: 0x200003a00000 with size: 0.355530 MiB 00:05:47.793 list of standard malloc elements. size: 199.218079 MiB 00:05:47.793 element at address: 0x20000b3fff80 with size: 132.000122 MiB 00:05:47.793 element at address: 0x2000071fff80 with size: 64.000122 MiB 00:05:47.793 element at address: 0x200018efff80 with size: 1.000122 MiB 00:05:47.793 element at address: 0x2000190fff80 with size: 1.000122 MiB 00:05:47.793 element at address: 0x2000192fff80 with size: 1.000122 MiB 00:05:47.793 element at address: 0x2000003d9f00 with size: 0.140747 MiB 00:05:47.793 element at address: 0x2000192eff00 with size: 0.062622 MiB 00:05:47.793 element at address: 0x2000003fdf80 with size: 0.007935 MiB 00:05:47.793 element at address: 0x2000192efdc0 with size: 0.000305 MiB 00:05:47.793 element at address: 0x2000002d7740 with size: 0.000183 MiB 00:05:47.793 element at address: 0x2000002d7800 with size: 0.000183 MiB 00:05:47.793 element at address: 0x2000002d78c0 with size: 0.000183 MiB 00:05:47.793 element at address: 0x2000002d7ac0 with size: 0.000183 MiB 00:05:47.793 element at address: 0x2000002d7b80 with size: 0.000183 MiB 00:05:47.793 element at address: 0x2000002d7c40 with size: 0.000183 MiB 00:05:47.793 element at address: 0x2000003d9e40 with size: 0.000183 MiB 00:05:47.793 element at address: 0x20000087ce00 with size: 0.000183 MiB 00:05:47.793 element at address: 0x20000087cec0 with size: 0.000183 MiB 00:05:47.793 element at address: 0x2000008fd180 with size: 0.000183 MiB 00:05:47.793 element at address: 0x200003a5b040 with size: 0.000183 MiB 00:05:47.793 element at address: 0x200003adb300 with size: 0.000183 MiB 00:05:47.793 element at address: 0x200003adb500 with size: 0.000183 MiB 00:05:47.793 element at address: 0x200003adf7c0 with size: 0.000183 MiB 00:05:47.793 element at address: 0x200003affa80 with size: 0.000183 MiB 00:05:47.793 element at address: 0x200003affb40 with size: 0.000183 MiB 00:05:47.793 element at address: 0x200003eff0c0 with size: 0.000183 MiB 00:05:47.793 element at address: 0x2000070fdd80 with size: 0.000183 MiB 00:05:47.793 element at address: 0x20000b27da00 with size: 0.000183 MiB 00:05:47.793 element at address: 0x20000b27dac0 with size: 0.000183 MiB 00:05:47.793 element at address: 0x20000b2fdd80 with size: 0.000183 MiB 00:05:47.794 element at address: 0x2000138fa8c0 with size: 0.000183 MiB 00:05:47.794 element at address: 0x2000192efc40 with size: 0.000183 MiB 00:05:47.794 element at address: 0x2000192efd00 with size: 0.000183 MiB 00:05:47.794 element at address: 0x2000194bc740 with size: 0.000183 MiB 00:05:47.794 element at address: 0x20001aa95380 with size: 0.000183 MiB 00:05:47.794 element at address: 0x20001aa95440 with size: 0.000183 MiB 00:05:47.794 element at address: 0x200027e68f80 with size: 0.000183 MiB 00:05:47.794 element at address: 0x200027e69040 with size: 0.000183 MiB 00:05:47.794 element at address: 0x200027e6fc40 with size: 0.000183 MiB 00:05:47.794 element at address: 0x200027e6fe40 with size: 0.000183 MiB 00:05:47.794 element at address: 0x200027e6ff00 with size: 0.000183 MiB 00:05:47.794 list of memzone associated elements. size: 602.262573 MiB 00:05:47.794 element at address: 0x20001aa95500 with size: 211.416748 MiB 00:05:47.794 associated memzone info: size: 211.416626 MiB name: MP_PDU_immediate_data_Pool_0 00:05:47.794 element at address: 0x200027e6ffc0 with size: 157.562561 MiB 00:05:47.794 associated memzone info: size: 157.562439 MiB name: MP_PDU_data_out_Pool_0 00:05:47.794 element at address: 0x2000139fab80 with size: 84.020630 MiB 00:05:47.794 associated memzone info: size: 84.020508 MiB name: MP_bdev_io_2925408_0 00:05:47.794 element at address: 0x2000009ff380 with size: 48.003052 MiB 00:05:47.794 associated memzone info: size: 48.002930 MiB name: MP_evtpool_2925408_0 00:05:47.794 element at address: 0x200003fff380 with size: 48.003052 MiB 00:05:47.794 associated memzone info: size: 48.002930 MiB name: MP_msgpool_2925408_0 00:05:47.794 element at address: 0x2000195be940 with size: 20.255554 MiB 00:05:47.794 associated memzone info: size: 20.255432 MiB name: MP_PDU_Pool_0 00:05:47.794 element at address: 0x200031dfeb40 with size: 18.005066 MiB 00:05:47.794 associated memzone info: size: 18.004944 MiB name: MP_SCSI_TASK_Pool_0 00:05:47.794 element at address: 0x2000005ffe00 with size: 2.000488 MiB 00:05:47.794 associated memzone info: size: 2.000366 MiB name: RG_MP_evtpool_2925408 00:05:47.794 element at address: 0x200003bffe00 with size: 2.000488 MiB 00:05:47.794 associated memzone info: size: 2.000366 MiB name: RG_MP_msgpool_2925408 00:05:47.794 element at address: 0x2000002d7d00 with size: 1.008118 MiB 00:05:47.794 associated memzone info: size: 1.007996 MiB name: MP_evtpool_2925408 00:05:47.794 element at address: 0x20000b2fde40 with size: 1.008118 MiB 00:05:47.794 associated memzone info: size: 1.007996 MiB name: MP_PDU_Pool 00:05:47.794 element at address: 0x2000194bc800 with size: 1.008118 MiB 00:05:47.794 associated memzone info: size: 1.007996 MiB name: MP_PDU_immediate_data_Pool 00:05:47.794 element at address: 0x2000070fde40 with size: 1.008118 MiB 00:05:47.794 associated memzone info: size: 1.007996 MiB name: MP_PDU_data_out_Pool 00:05:47.794 element at address: 0x2000008fd240 with size: 1.008118 MiB 00:05:47.794 associated memzone info: size: 1.007996 MiB name: MP_SCSI_TASK_Pool 00:05:47.794 element at address: 0x200003eff180 with size: 1.000488 MiB 00:05:47.794 associated memzone info: size: 1.000366 MiB name: RG_ring_0_2925408 00:05:47.794 element at address: 0x200003affc00 with size: 1.000488 MiB 00:05:47.794 associated memzone info: size: 1.000366 MiB name: RG_ring_1_2925408 00:05:47.794 element at address: 0x2000138fa980 with size: 1.000488 MiB 00:05:47.794 associated memzone info: size: 1.000366 MiB name: RG_ring_4_2925408 00:05:47.794 element at address: 0x200031cfe940 with size: 1.000488 MiB 00:05:47.794 associated memzone info: size: 1.000366 MiB name: RG_ring_5_2925408 00:05:47.794 element at address: 0x200003a5b100 with size: 0.500488 MiB 00:05:47.794 associated memzone info: size: 0.500366 MiB name: RG_MP_bdev_io_2925408 00:05:47.794 element at address: 0x20000b27db80 with size: 0.500488 MiB 00:05:47.794 associated memzone info: size: 0.500366 MiB name: RG_MP_PDU_Pool 00:05:47.794 element at address: 0x20000087cf80 with size: 0.500488 MiB 00:05:47.794 associated memzone info: size: 0.500366 MiB name: RG_MP_SCSI_TASK_Pool 00:05:47.794 element at address: 0x20001947c540 with size: 0.250488 MiB 00:05:47.794 associated memzone info: size: 0.250366 MiB name: RG_MP_PDU_immediate_data_Pool 00:05:47.794 element at address: 0x200003adf880 with size: 0.125488 MiB 00:05:47.794 associated memzone info: size: 0.125366 MiB name: RG_ring_2_2925408 00:05:47.794 element at address: 0x2000070f5b80 with size: 0.031738 MiB 00:05:47.794 associated memzone info: size: 0.031616 MiB name: RG_MP_PDU_data_out_Pool 00:05:47.794 element at address: 0x200027e69100 with size: 0.023743 MiB 00:05:47.794 associated memzone info: size: 0.023621 MiB name: MP_Session_Pool_0 00:05:47.794 element at address: 0x200003adb5c0 with size: 0.016113 MiB 00:05:47.794 associated memzone info: size: 0.015991 MiB name: RG_ring_3_2925408 00:05:47.794 element at address: 0x200027e6f240 with size: 0.002441 MiB 00:05:47.794 associated memzone info: size: 0.002319 MiB name: RG_MP_Session_Pool 00:05:47.794 element at address: 0x2000002d7980 with size: 0.000305 MiB 00:05:47.794 associated memzone info: size: 0.000183 MiB name: MP_msgpool_2925408 00:05:47.794 element at address: 0x200003adb3c0 with size: 0.000305 MiB 00:05:47.794 associated memzone info: size: 0.000183 MiB name: MP_bdev_io_2925408 00:05:47.794 element at address: 0x200027e6fd00 with size: 0.000305 MiB 00:05:47.794 associated memzone info: size: 0.000183 MiB name: MP_Session_Pool 00:05:47.794 18:52:04 -- dpdk_memory_utility/test_dpdk_mem_info.sh@25 -- # trap - SIGINT SIGTERM EXIT 00:05:47.794 18:52:04 -- dpdk_memory_utility/test_dpdk_mem_info.sh@26 -- # killprocess 2925408 00:05:47.794 18:52:04 -- common/autotest_common.sh@936 -- # '[' -z 2925408 ']' 00:05:47.794 18:52:04 -- common/autotest_common.sh@940 -- # kill -0 2925408 00:05:47.794 18:52:04 -- common/autotest_common.sh@941 -- # uname 00:05:47.794 18:52:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:47.794 18:52:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2925408 00:05:47.794 18:52:04 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:47.794 18:52:04 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:47.794 18:52:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2925408' 00:05:47.794 killing process with pid 2925408 00:05:47.794 18:52:04 -- common/autotest_common.sh@955 -- # kill 2925408 00:05:47.794 18:52:04 -- common/autotest_common.sh@960 -- # wait 2925408 00:05:48.051 00:05:48.051 real 0m1.494s 00:05:48.051 user 0m1.588s 00:05:48.051 sys 0m0.410s 00:05:48.051 18:52:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:48.051 18:52:04 -- common/autotest_common.sh@10 -- # set +x 00:05:48.051 ************************************ 00:05:48.051 END TEST dpdk_mem_utility 00:05:48.051 ************************************ 00:05:48.051 18:52:04 -- spdk/autotest.sh@174 -- # run_test event /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:05:48.051 18:52:04 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:48.051 18:52:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:48.051 18:52:04 -- common/autotest_common.sh@10 -- # set +x 00:05:48.051 ************************************ 00:05:48.051 START TEST event 00:05:48.051 ************************************ 00:05:48.051 18:52:04 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:05:48.309 * Looking for test storage... 00:05:48.309 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:05:48.309 18:52:04 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:48.309 18:52:04 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:48.309 18:52:04 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:48.309 18:52:05 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:48.309 18:52:05 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:48.309 18:52:05 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:48.309 18:52:05 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:48.309 18:52:05 -- scripts/common.sh@335 -- # IFS=.-: 00:05:48.309 18:52:05 -- scripts/common.sh@335 -- # read -ra ver1 00:05:48.309 18:52:05 -- scripts/common.sh@336 -- # IFS=.-: 00:05:48.309 18:52:05 -- scripts/common.sh@336 -- # read -ra ver2 00:05:48.309 18:52:05 -- scripts/common.sh@337 -- # local 'op=<' 00:05:48.309 18:52:05 -- scripts/common.sh@339 -- # ver1_l=2 00:05:48.309 18:52:05 -- scripts/common.sh@340 -- # ver2_l=1 00:05:48.309 18:52:05 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:48.309 18:52:05 -- scripts/common.sh@343 -- # case "$op" in 00:05:48.309 18:52:05 -- scripts/common.sh@344 -- # : 1 00:05:48.309 18:52:05 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:48.309 18:52:05 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:48.309 18:52:05 -- scripts/common.sh@364 -- # decimal 1 00:05:48.309 18:52:05 -- scripts/common.sh@352 -- # local d=1 00:05:48.309 18:52:05 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:48.309 18:52:05 -- scripts/common.sh@354 -- # echo 1 00:05:48.309 18:52:05 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:48.309 18:52:05 -- scripts/common.sh@365 -- # decimal 2 00:05:48.309 18:52:05 -- scripts/common.sh@352 -- # local d=2 00:05:48.309 18:52:05 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:48.309 18:52:05 -- scripts/common.sh@354 -- # echo 2 00:05:48.309 18:52:05 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:48.309 18:52:05 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:48.309 18:52:05 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:48.309 18:52:05 -- scripts/common.sh@367 -- # return 0 00:05:48.309 18:52:05 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:48.309 18:52:05 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:48.309 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:48.309 --rc genhtml_branch_coverage=1 00:05:48.309 --rc genhtml_function_coverage=1 00:05:48.309 --rc genhtml_legend=1 00:05:48.309 --rc geninfo_all_blocks=1 00:05:48.309 --rc geninfo_unexecuted_blocks=1 00:05:48.309 00:05:48.309 ' 00:05:48.309 18:52:05 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:48.309 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:48.309 --rc genhtml_branch_coverage=1 00:05:48.309 --rc genhtml_function_coverage=1 00:05:48.309 --rc genhtml_legend=1 00:05:48.309 --rc geninfo_all_blocks=1 00:05:48.309 --rc geninfo_unexecuted_blocks=1 00:05:48.309 00:05:48.309 ' 00:05:48.309 18:52:05 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:48.309 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:48.309 --rc genhtml_branch_coverage=1 00:05:48.309 --rc genhtml_function_coverage=1 00:05:48.309 --rc genhtml_legend=1 00:05:48.309 --rc geninfo_all_blocks=1 00:05:48.309 --rc geninfo_unexecuted_blocks=1 00:05:48.309 00:05:48.309 ' 00:05:48.309 18:52:05 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:48.309 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:48.309 --rc genhtml_branch_coverage=1 00:05:48.309 --rc genhtml_function_coverage=1 00:05:48.309 --rc genhtml_legend=1 00:05:48.309 --rc geninfo_all_blocks=1 00:05:48.309 --rc geninfo_unexecuted_blocks=1 00:05:48.309 00:05:48.309 ' 00:05:48.309 18:52:05 -- event/event.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/nbd_common.sh 00:05:48.309 18:52:05 -- bdev/nbd_common.sh@6 -- # set -e 00:05:48.309 18:52:05 -- event/event.sh@45 -- # run_test event_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:05:48.309 18:52:05 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:05:48.309 18:52:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:48.309 18:52:05 -- common/autotest_common.sh@10 -- # set +x 00:05:48.309 ************************************ 00:05:48.309 START TEST event_perf 00:05:48.309 ************************************ 00:05:48.309 18:52:05 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:05:48.309 Running I/O for 1 seconds...[2024-11-26 18:52:05.098164] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:48.309 [2024-11-26 18:52:05.098245] [ DPDK EAL parameters: event_perf --no-shconf -c 0xF --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2925795 ] 00:05:48.309 EAL: No free 2048 kB hugepages reported on node 1 00:05:48.309 [2024-11-26 18:52:05.158345] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:05:48.309 [2024-11-26 18:52:05.199118] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:48.309 [2024-11-26 18:52:05.199218] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:48.309 [2024-11-26 18:52:05.199302] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:48.309 [2024-11-26 18:52:05.199303] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:49.682 Running I/O for 1 seconds... 00:05:49.682 lcore 0: 207508 00:05:49.682 lcore 1: 207506 00:05:49.682 lcore 2: 207506 00:05:49.682 lcore 3: 207506 00:05:49.682 done. 00:05:49.682 00:05:49.682 real 0m1.181s 00:05:49.682 user 0m4.102s 00:05:49.682 sys 0m0.077s 00:05:49.682 18:52:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:49.682 18:52:06 -- common/autotest_common.sh@10 -- # set +x 00:05:49.682 ************************************ 00:05:49.682 END TEST event_perf 00:05:49.682 ************************************ 00:05:49.682 18:52:06 -- event/event.sh@46 -- # run_test event_reactor /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:05:49.682 18:52:06 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:05:49.682 18:52:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:49.682 18:52:06 -- common/autotest_common.sh@10 -- # set +x 00:05:49.682 ************************************ 00:05:49.682 START TEST event_reactor 00:05:49.682 ************************************ 00:05:49.682 18:52:06 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:05:49.682 [2024-11-26 18:52:06.316969] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:49.682 [2024-11-26 18:52:06.317047] [ DPDK EAL parameters: reactor --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2925967 ] 00:05:49.682 EAL: No free 2048 kB hugepages reported on node 1 00:05:49.682 [2024-11-26 18:52:06.377474] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:49.682 [2024-11-26 18:52:06.414364] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:50.617 test_start 00:05:50.617 oneshot 00:05:50.617 tick 100 00:05:50.617 tick 100 00:05:50.617 tick 250 00:05:50.617 tick 100 00:05:50.617 tick 100 00:05:50.617 tick 100 00:05:50.617 tick 250 00:05:50.617 tick 500 00:05:50.617 tick 100 00:05:50.617 tick 100 00:05:50.617 tick 250 00:05:50.617 tick 100 00:05:50.617 tick 100 00:05:50.617 test_end 00:05:50.617 00:05:50.617 real 0m1.176s 00:05:50.617 user 0m1.098s 00:05:50.617 sys 0m0.073s 00:05:50.617 18:52:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:50.617 18:52:07 -- common/autotest_common.sh@10 -- # set +x 00:05:50.617 ************************************ 00:05:50.617 END TEST event_reactor 00:05:50.617 ************************************ 00:05:50.617 18:52:07 -- event/event.sh@47 -- # run_test event_reactor_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:05:50.617 18:52:07 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:05:50.617 18:52:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:50.617 18:52:07 -- common/autotest_common.sh@10 -- # set +x 00:05:50.617 ************************************ 00:05:50.617 START TEST event_reactor_perf 00:05:50.617 ************************************ 00:05:50.617 18:52:07 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:05:50.617 [2024-11-26 18:52:07.523941] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:50.617 [2024-11-26 18:52:07.524029] [ DPDK EAL parameters: reactor_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2926212 ] 00:05:50.875 EAL: No free 2048 kB hugepages reported on node 1 00:05:50.875 [2024-11-26 18:52:07.581361] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:50.875 [2024-11-26 18:52:07.618212] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:51.810 test_start 00:05:51.810 test_end 00:05:51.810 Performance: 494593 events per second 00:05:51.810 00:05:51.810 real 0m1.172s 00:05:51.810 user 0m1.097s 00:05:51.810 sys 0m0.070s 00:05:51.810 18:52:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:51.810 18:52:08 -- common/autotest_common.sh@10 -- # set +x 00:05:51.810 ************************************ 00:05:51.810 END TEST event_reactor_perf 00:05:51.810 ************************************ 00:05:51.810 18:52:08 -- event/event.sh@49 -- # uname -s 00:05:51.810 18:52:08 -- event/event.sh@49 -- # '[' Linux = Linux ']' 00:05:51.810 18:52:08 -- event/event.sh@50 -- # run_test event_scheduler /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:05:51.810 18:52:08 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:51.810 18:52:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:51.810 18:52:08 -- common/autotest_common.sh@10 -- # set +x 00:05:51.810 ************************************ 00:05:51.810 START TEST event_scheduler 00:05:51.810 ************************************ 00:05:51.810 18:52:08 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:05:52.069 * Looking for test storage... 00:05:52.070 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler 00:05:52.070 18:52:08 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:52.070 18:52:08 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:52.070 18:52:08 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:52.070 18:52:08 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:52.070 18:52:08 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:52.070 18:52:08 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:52.070 18:52:08 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:52.070 18:52:08 -- scripts/common.sh@335 -- # IFS=.-: 00:05:52.070 18:52:08 -- scripts/common.sh@335 -- # read -ra ver1 00:05:52.070 18:52:08 -- scripts/common.sh@336 -- # IFS=.-: 00:05:52.070 18:52:08 -- scripts/common.sh@336 -- # read -ra ver2 00:05:52.070 18:52:08 -- scripts/common.sh@337 -- # local 'op=<' 00:05:52.070 18:52:08 -- scripts/common.sh@339 -- # ver1_l=2 00:05:52.070 18:52:08 -- scripts/common.sh@340 -- # ver2_l=1 00:05:52.070 18:52:08 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:52.070 18:52:08 -- scripts/common.sh@343 -- # case "$op" in 00:05:52.070 18:52:08 -- scripts/common.sh@344 -- # : 1 00:05:52.070 18:52:08 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:52.070 18:52:08 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:52.070 18:52:08 -- scripts/common.sh@364 -- # decimal 1 00:05:52.070 18:52:08 -- scripts/common.sh@352 -- # local d=1 00:05:52.070 18:52:08 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:52.070 18:52:08 -- scripts/common.sh@354 -- # echo 1 00:05:52.070 18:52:08 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:52.070 18:52:08 -- scripts/common.sh@365 -- # decimal 2 00:05:52.070 18:52:08 -- scripts/common.sh@352 -- # local d=2 00:05:52.070 18:52:08 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:52.070 18:52:08 -- scripts/common.sh@354 -- # echo 2 00:05:52.070 18:52:08 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:52.070 18:52:08 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:52.070 18:52:08 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:52.070 18:52:08 -- scripts/common.sh@367 -- # return 0 00:05:52.070 18:52:08 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:52.070 18:52:08 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:52.070 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:52.070 --rc genhtml_branch_coverage=1 00:05:52.070 --rc genhtml_function_coverage=1 00:05:52.070 --rc genhtml_legend=1 00:05:52.070 --rc geninfo_all_blocks=1 00:05:52.070 --rc geninfo_unexecuted_blocks=1 00:05:52.070 00:05:52.070 ' 00:05:52.070 18:52:08 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:52.070 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:52.070 --rc genhtml_branch_coverage=1 00:05:52.070 --rc genhtml_function_coverage=1 00:05:52.070 --rc genhtml_legend=1 00:05:52.070 --rc geninfo_all_blocks=1 00:05:52.070 --rc geninfo_unexecuted_blocks=1 00:05:52.070 00:05:52.070 ' 00:05:52.070 18:52:08 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:52.070 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:52.070 --rc genhtml_branch_coverage=1 00:05:52.070 --rc genhtml_function_coverage=1 00:05:52.070 --rc genhtml_legend=1 00:05:52.070 --rc geninfo_all_blocks=1 00:05:52.070 --rc geninfo_unexecuted_blocks=1 00:05:52.070 00:05:52.070 ' 00:05:52.070 18:52:08 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:52.070 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:52.070 --rc genhtml_branch_coverage=1 00:05:52.070 --rc genhtml_function_coverage=1 00:05:52.070 --rc genhtml_legend=1 00:05:52.070 --rc geninfo_all_blocks=1 00:05:52.070 --rc geninfo_unexecuted_blocks=1 00:05:52.070 00:05:52.070 ' 00:05:52.070 18:52:08 -- scheduler/scheduler.sh@29 -- # rpc=rpc_cmd 00:05:52.070 18:52:08 -- scheduler/scheduler.sh@35 -- # scheduler_pid=2926493 00:05:52.070 18:52:08 -- scheduler/scheduler.sh@36 -- # trap 'killprocess $scheduler_pid; exit 1' SIGINT SIGTERM EXIT 00:05:52.070 18:52:08 -- scheduler/scheduler.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler -m 0xF -p 0x2 --wait-for-rpc -f 00:05:52.070 18:52:08 -- scheduler/scheduler.sh@37 -- # waitforlisten 2926493 00:05:52.070 18:52:08 -- common/autotest_common.sh@829 -- # '[' -z 2926493 ']' 00:05:52.070 18:52:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:52.070 18:52:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:52.070 18:52:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:52.070 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:52.070 18:52:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:52.070 18:52:08 -- common/autotest_common.sh@10 -- # set +x 00:05:52.070 [2024-11-26 18:52:08.913625] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:52.070 [2024-11-26 18:52:08.913674] [ DPDK EAL parameters: scheduler --no-shconf -c 0xF --main-lcore=2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2926493 ] 00:05:52.070 EAL: No free 2048 kB hugepages reported on node 1 00:05:52.070 [2024-11-26 18:52:08.964268] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:05:52.329 [2024-11-26 18:52:09.006195] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:52.329 [2024-11-26 18:52:09.006279] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:52.329 [2024-11-26 18:52:09.006378] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:52.329 [2024-11-26 18:52:09.006379] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:52.329 18:52:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:52.329 18:52:09 -- common/autotest_common.sh@862 -- # return 0 00:05:52.329 18:52:09 -- scheduler/scheduler.sh@39 -- # rpc_cmd framework_set_scheduler dynamic 00:05:52.329 18:52:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:52.329 18:52:09 -- common/autotest_common.sh@10 -- # set +x 00:05:52.329 POWER: Env isn't set yet! 00:05:52.329 POWER: Attempting to initialise ACPI cpufreq power management... 00:05:52.329 POWER: Failed to write /sys/devices/system/cpu/cpu%u/cpufreq/scaling_governor 00:05:52.329 POWER: Cannot set governor of lcore 0 to userspace 00:05:52.329 POWER: Attempting to initialise PSTAT power management... 00:05:52.329 POWER: Power management governor of lcore 0 has been set to 'performance' successfully 00:05:52.329 POWER: Initialized successfully for lcore 0 power management 00:05:52.329 POWER: Power management governor of lcore 1 has been set to 'performance' successfully 00:05:52.329 POWER: Initialized successfully for lcore 1 power management 00:05:52.329 POWER: Power management governor of lcore 2 has been set to 'performance' successfully 00:05:52.329 POWER: Initialized successfully for lcore 2 power management 00:05:52.329 POWER: Power management governor of lcore 3 has been set to 'performance' successfully 00:05:52.330 POWER: Initialized successfully for lcore 3 power management 00:05:52.330 [2024-11-26 18:52:09.101111] scheduler_dynamic.c: 387:set_opts: *NOTICE*: Setting scheduler load limit to 20 00:05:52.330 [2024-11-26 18:52:09.101125] scheduler_dynamic.c: 389:set_opts: *NOTICE*: Setting scheduler core limit to 80 00:05:52.330 [2024-11-26 18:52:09.101133] scheduler_dynamic.c: 391:set_opts: *NOTICE*: Setting scheduler core busy to 95 00:05:52.330 18:52:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:52.330 18:52:09 -- scheduler/scheduler.sh@40 -- # rpc_cmd framework_start_init 00:05:52.330 18:52:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:52.330 18:52:09 -- common/autotest_common.sh@10 -- # set +x 00:05:52.330 [2024-11-26 18:52:09.165141] scheduler.c: 382:test_start: *NOTICE*: Scheduler test application started. 00:05:52.330 18:52:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:52.330 18:52:09 -- scheduler/scheduler.sh@43 -- # run_test scheduler_create_thread scheduler_create_thread 00:05:52.330 18:52:09 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:52.330 18:52:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:52.330 18:52:09 -- common/autotest_common.sh@10 -- # set +x 00:05:52.330 ************************************ 00:05:52.330 START TEST scheduler_create_thread 00:05:52.330 ************************************ 00:05:52.330 18:52:09 -- common/autotest_common.sh@1114 -- # scheduler_create_thread 00:05:52.330 18:52:09 -- scheduler/scheduler.sh@12 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x1 -a 100 00:05:52.330 18:52:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:52.330 18:52:09 -- common/autotest_common.sh@10 -- # set +x 00:05:52.330 2 00:05:52.330 18:52:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:52.330 18:52:09 -- scheduler/scheduler.sh@13 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x2 -a 100 00:05:52.330 18:52:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:52.330 18:52:09 -- common/autotest_common.sh@10 -- # set +x 00:05:52.330 3 00:05:52.330 18:52:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:52.330 18:52:09 -- scheduler/scheduler.sh@14 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x4 -a 100 00:05:52.330 18:52:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:52.330 18:52:09 -- common/autotest_common.sh@10 -- # set +x 00:05:52.330 4 00:05:52.330 18:52:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:52.330 18:52:09 -- scheduler/scheduler.sh@15 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x8 -a 100 00:05:52.330 18:52:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:52.330 18:52:09 -- common/autotest_common.sh@10 -- # set +x 00:05:52.330 5 00:05:52.330 18:52:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:52.330 18:52:09 -- scheduler/scheduler.sh@16 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x1 -a 0 00:05:52.330 18:52:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:52.330 18:52:09 -- common/autotest_common.sh@10 -- # set +x 00:05:52.330 6 00:05:52.330 18:52:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:52.330 18:52:09 -- scheduler/scheduler.sh@17 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x2 -a 0 00:05:52.330 18:52:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:52.330 18:52:09 -- common/autotest_common.sh@10 -- # set +x 00:05:52.330 7 00:05:52.330 18:52:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:52.330 18:52:09 -- scheduler/scheduler.sh@18 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x4 -a 0 00:05:52.330 18:52:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:52.330 18:52:09 -- common/autotest_common.sh@10 -- # set +x 00:05:52.330 8 00:05:52.330 18:52:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:52.330 18:52:09 -- scheduler/scheduler.sh@19 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x8 -a 0 00:05:52.330 18:52:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:52.330 18:52:09 -- common/autotest_common.sh@10 -- # set +x 00:05:52.588 9 00:05:52.588 18:52:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:52.588 18:52:09 -- scheduler/scheduler.sh@21 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n one_third_active -a 30 00:05:52.588 18:52:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:52.588 18:52:09 -- common/autotest_common.sh@10 -- # set +x 00:05:52.588 10 00:05:52.588 18:52:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:52.588 18:52:09 -- scheduler/scheduler.sh@22 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n half_active -a 0 00:05:52.588 18:52:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:52.588 18:52:09 -- common/autotest_common.sh@10 -- # set +x 00:05:52.588 18:52:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:52.588 18:52:09 -- scheduler/scheduler.sh@22 -- # thread_id=11 00:05:52.588 18:52:09 -- scheduler/scheduler.sh@23 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_set_active 11 50 00:05:52.588 18:52:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:52.588 18:52:09 -- common/autotest_common.sh@10 -- # set +x 00:05:53.523 18:52:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:53.524 18:52:10 -- scheduler/scheduler.sh@25 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n deleted -a 100 00:05:53.524 18:52:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:53.524 18:52:10 -- common/autotest_common.sh@10 -- # set +x 00:05:55.011 18:52:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:55.011 18:52:11 -- scheduler/scheduler.sh@25 -- # thread_id=12 00:05:55.011 18:52:11 -- scheduler/scheduler.sh@26 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_delete 12 00:05:55.011 18:52:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:55.011 18:52:11 -- common/autotest_common.sh@10 -- # set +x 00:05:55.961 18:52:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:55.961 00:05:55.961 real 0m3.384s 00:05:55.961 user 0m0.025s 00:05:55.961 sys 0m0.004s 00:05:55.961 18:52:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:55.961 18:52:12 -- common/autotest_common.sh@10 -- # set +x 00:05:55.961 ************************************ 00:05:55.961 END TEST scheduler_create_thread 00:05:55.961 ************************************ 00:05:55.961 18:52:12 -- scheduler/scheduler.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:05:55.961 18:52:12 -- scheduler/scheduler.sh@46 -- # killprocess 2926493 00:05:55.961 18:52:12 -- common/autotest_common.sh@936 -- # '[' -z 2926493 ']' 00:05:55.961 18:52:12 -- common/autotest_common.sh@940 -- # kill -0 2926493 00:05:55.961 18:52:12 -- common/autotest_common.sh@941 -- # uname 00:05:55.961 18:52:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:55.961 18:52:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2926493 00:05:55.961 18:52:12 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:05:55.961 18:52:12 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:05:55.961 18:52:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2926493' 00:05:55.961 killing process with pid 2926493 00:05:55.961 18:52:12 -- common/autotest_common.sh@955 -- # kill 2926493 00:05:55.961 18:52:12 -- common/autotest_common.sh@960 -- # wait 2926493 00:05:56.220 [2024-11-26 18:52:12.937228] scheduler.c: 360:test_shutdown: *NOTICE*: Scheduler test application stopped. 00:05:56.220 POWER: Power management governor of lcore 0 has been set to 'powersave' successfully 00:05:56.220 POWER: Power management of lcore 0 has exited from 'performance' mode and been set back to the original 00:05:56.220 POWER: Power management governor of lcore 1 has been set to 'powersave' successfully 00:05:56.220 POWER: Power management of lcore 1 has exited from 'performance' mode and been set back to the original 00:05:56.220 POWER: Power management governor of lcore 2 has been set to 'powersave' successfully 00:05:56.220 POWER: Power management of lcore 2 has exited from 'performance' mode and been set back to the original 00:05:56.220 POWER: Power management governor of lcore 3 has been set to 'powersave' successfully 00:05:56.220 POWER: Power management of lcore 3 has exited from 'performance' mode and been set back to the original 00:05:56.480 00:05:56.480 real 0m4.443s 00:05:56.480 user 0m7.821s 00:05:56.480 sys 0m0.337s 00:05:56.480 18:52:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:56.480 18:52:13 -- common/autotest_common.sh@10 -- # set +x 00:05:56.480 ************************************ 00:05:56.480 END TEST event_scheduler 00:05:56.480 ************************************ 00:05:56.480 18:52:13 -- event/event.sh@51 -- # modprobe -n nbd 00:05:56.480 18:52:13 -- event/event.sh@52 -- # run_test app_repeat app_repeat_test 00:05:56.480 18:52:13 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:56.480 18:52:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:56.480 18:52:13 -- common/autotest_common.sh@10 -- # set +x 00:05:56.480 ************************************ 00:05:56.480 START TEST app_repeat 00:05:56.480 ************************************ 00:05:56.480 18:52:13 -- common/autotest_common.sh@1114 -- # app_repeat_test 00:05:56.480 18:52:13 -- event/event.sh@12 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:56.480 18:52:13 -- event/event.sh@13 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:56.480 18:52:13 -- event/event.sh@13 -- # local nbd_list 00:05:56.480 18:52:13 -- event/event.sh@14 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:56.480 18:52:13 -- event/event.sh@14 -- # local bdev_list 00:05:56.480 18:52:13 -- event/event.sh@15 -- # local repeat_times=4 00:05:56.480 18:52:13 -- event/event.sh@17 -- # modprobe nbd 00:05:56.480 18:52:13 -- event/event.sh@19 -- # repeat_pid=2927259 00:05:56.480 18:52:13 -- event/event.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/app_repeat/app_repeat -r /var/tmp/spdk-nbd.sock -m 0x3 -t 4 00:05:56.480 18:52:13 -- event/event.sh@20 -- # trap 'killprocess $repeat_pid; exit 1' SIGINT SIGTERM EXIT 00:05:56.480 18:52:13 -- event/event.sh@21 -- # echo 'Process app_repeat pid: 2927259' 00:05:56.480 Process app_repeat pid: 2927259 00:05:56.480 18:52:13 -- event/event.sh@23 -- # for i in {0..2} 00:05:56.480 18:52:13 -- event/event.sh@24 -- # echo 'spdk_app_start Round 0' 00:05:56.480 spdk_app_start Round 0 00:05:56.480 18:52:13 -- event/event.sh@25 -- # waitforlisten 2927259 /var/tmp/spdk-nbd.sock 00:05:56.480 18:52:13 -- common/autotest_common.sh@829 -- # '[' -z 2927259 ']' 00:05:56.480 18:52:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:05:56.480 18:52:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:56.480 18:52:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:05:56.480 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:05:56.480 18:52:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:56.480 18:52:13 -- common/autotest_common.sh@10 -- # set +x 00:05:56.480 [2024-11-26 18:52:13.237026] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:56.480 [2024-11-26 18:52:13.237103] [ DPDK EAL parameters: app_repeat --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2927259 ] 00:05:56.480 EAL: No free 2048 kB hugepages reported on node 1 00:05:56.480 [2024-11-26 18:52:13.296741] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:56.480 [2024-11-26 18:52:13.337036] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:56.480 [2024-11-26 18:52:13.337040] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:57.417 18:52:14 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:57.417 18:52:14 -- common/autotest_common.sh@862 -- # return 0 00:05:57.417 18:52:14 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:57.417 Malloc0 00:05:57.417 18:52:14 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:57.676 Malloc1 00:05:57.676 18:52:14 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:57.676 18:52:14 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:57.676 18:52:14 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:57.676 18:52:14 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:05:57.676 18:52:14 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:57.676 18:52:14 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:05:57.676 18:52:14 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:57.676 18:52:14 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:57.676 18:52:14 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:57.676 18:52:14 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:05:57.676 18:52:14 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:57.676 18:52:14 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:05:57.676 18:52:14 -- bdev/nbd_common.sh@12 -- # local i 00:05:57.676 18:52:14 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:05:57.676 18:52:14 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:57.676 18:52:14 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:05:57.935 /dev/nbd0 00:05:57.935 18:52:14 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:05:57.935 18:52:14 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:05:57.935 18:52:14 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:05:57.935 18:52:14 -- common/autotest_common.sh@867 -- # local i 00:05:57.935 18:52:14 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:05:57.935 18:52:14 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:05:57.935 18:52:14 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:05:57.935 18:52:14 -- common/autotest_common.sh@871 -- # break 00:05:57.935 18:52:14 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:05:57.935 18:52:14 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:05:57.935 18:52:14 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:57.935 1+0 records in 00:05:57.935 1+0 records out 00:05:57.935 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000212785 s, 19.2 MB/s 00:05:57.935 18:52:14 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:57.935 18:52:14 -- common/autotest_common.sh@884 -- # size=4096 00:05:57.935 18:52:14 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:57.935 18:52:14 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:05:57.935 18:52:14 -- common/autotest_common.sh@887 -- # return 0 00:05:57.935 18:52:14 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:57.935 18:52:14 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:57.935 18:52:14 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:05:57.935 /dev/nbd1 00:05:57.935 18:52:14 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:05:57.935 18:52:14 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:05:57.935 18:52:14 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:05:57.935 18:52:14 -- common/autotest_common.sh@867 -- # local i 00:05:57.935 18:52:14 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:05:57.935 18:52:14 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:05:57.935 18:52:14 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:05:58.194 18:52:14 -- common/autotest_common.sh@871 -- # break 00:05:58.194 18:52:14 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:05:58.194 18:52:14 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:05:58.194 18:52:14 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:58.194 1+0 records in 00:05:58.194 1+0 records out 00:05:58.194 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000197263 s, 20.8 MB/s 00:05:58.194 18:52:14 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:58.194 18:52:14 -- common/autotest_common.sh@884 -- # size=4096 00:05:58.194 18:52:14 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:58.194 18:52:14 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:05:58.194 18:52:14 -- common/autotest_common.sh@887 -- # return 0 00:05:58.194 18:52:14 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:58.194 18:52:14 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:58.194 18:52:14 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:58.194 18:52:14 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:58.194 18:52:14 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:58.194 18:52:15 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:05:58.194 { 00:05:58.194 "nbd_device": "/dev/nbd0", 00:05:58.194 "bdev_name": "Malloc0" 00:05:58.194 }, 00:05:58.194 { 00:05:58.194 "nbd_device": "/dev/nbd1", 00:05:58.194 "bdev_name": "Malloc1" 00:05:58.194 } 00:05:58.194 ]' 00:05:58.194 18:52:15 -- bdev/nbd_common.sh@64 -- # echo '[ 00:05:58.194 { 00:05:58.194 "nbd_device": "/dev/nbd0", 00:05:58.194 "bdev_name": "Malloc0" 00:05:58.194 }, 00:05:58.194 { 00:05:58.194 "nbd_device": "/dev/nbd1", 00:05:58.194 "bdev_name": "Malloc1" 00:05:58.194 } 00:05:58.194 ]' 00:05:58.194 18:52:15 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:58.194 18:52:15 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:05:58.194 /dev/nbd1' 00:05:58.194 18:52:15 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:05:58.194 /dev/nbd1' 00:05:58.194 18:52:15 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:58.194 18:52:15 -- bdev/nbd_common.sh@65 -- # count=2 00:05:58.194 18:52:15 -- bdev/nbd_common.sh@66 -- # echo 2 00:05:58.194 18:52:15 -- bdev/nbd_common.sh@95 -- # count=2 00:05:58.194 18:52:15 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:05:58.194 18:52:15 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:05:58.194 18:52:15 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:58.194 18:52:15 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:58.194 18:52:15 -- bdev/nbd_common.sh@71 -- # local operation=write 00:05:58.194 18:52:15 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:58.194 18:52:15 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:05:58.195 18:52:15 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:05:58.453 256+0 records in 00:05:58.453 256+0 records out 00:05:58.453 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106248 s, 98.7 MB/s 00:05:58.453 18:52:15 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:58.453 18:52:15 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:05:58.453 256+0 records in 00:05:58.453 256+0 records out 00:05:58.453 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143055 s, 73.3 MB/s 00:05:58.453 18:52:15 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:58.453 18:52:15 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:05:58.453 256+0 records in 00:05:58.453 256+0 records out 00:05:58.453 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01517 s, 69.1 MB/s 00:05:58.453 18:52:15 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:05:58.453 18:52:15 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:58.453 18:52:15 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:58.453 18:52:15 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:05:58.453 18:52:15 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:58.453 18:52:15 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:05:58.453 18:52:15 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:05:58.453 18:52:15 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:58.453 18:52:15 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:05:58.453 18:52:15 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:58.453 18:52:15 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:05:58.453 18:52:15 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:58.453 18:52:15 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:05:58.453 18:52:15 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:58.453 18:52:15 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:58.453 18:52:15 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:05:58.453 18:52:15 -- bdev/nbd_common.sh@51 -- # local i 00:05:58.453 18:52:15 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:58.453 18:52:15 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:05:58.453 18:52:15 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:05:58.453 18:52:15 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:05:58.453 18:52:15 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:05:58.453 18:52:15 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:58.712 18:52:15 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:58.712 18:52:15 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:05:58.712 18:52:15 -- bdev/nbd_common.sh@41 -- # break 00:05:58.712 18:52:15 -- bdev/nbd_common.sh@45 -- # return 0 00:05:58.712 18:52:15 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:58.712 18:52:15 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:05:58.712 18:52:15 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:05:58.712 18:52:15 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:05:58.712 18:52:15 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:05:58.712 18:52:15 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:58.712 18:52:15 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:58.712 18:52:15 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:05:58.712 18:52:15 -- bdev/nbd_common.sh@41 -- # break 00:05:58.712 18:52:15 -- bdev/nbd_common.sh@45 -- # return 0 00:05:58.712 18:52:15 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:58.712 18:52:15 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:58.712 18:52:15 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:58.971 18:52:15 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:05:58.971 18:52:15 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:05:58.971 18:52:15 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:58.971 18:52:15 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:05:58.971 18:52:15 -- bdev/nbd_common.sh@65 -- # echo '' 00:05:58.971 18:52:15 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:58.971 18:52:15 -- bdev/nbd_common.sh@65 -- # true 00:05:58.971 18:52:15 -- bdev/nbd_common.sh@65 -- # count=0 00:05:58.971 18:52:15 -- bdev/nbd_common.sh@66 -- # echo 0 00:05:58.971 18:52:15 -- bdev/nbd_common.sh@104 -- # count=0 00:05:58.971 18:52:15 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:05:58.971 18:52:15 -- bdev/nbd_common.sh@109 -- # return 0 00:05:58.971 18:52:15 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:05:59.230 18:52:16 -- event/event.sh@35 -- # sleep 3 00:05:59.488 [2024-11-26 18:52:16.195184] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:59.488 [2024-11-26 18:52:16.230132] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:59.488 [2024-11-26 18:52:16.230135] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:59.488 [2024-11-26 18:52:16.271741] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:05:59.488 [2024-11-26 18:52:16.271782] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:06:02.775 18:52:19 -- event/event.sh@23 -- # for i in {0..2} 00:06:02.775 18:52:19 -- event/event.sh@24 -- # echo 'spdk_app_start Round 1' 00:06:02.775 spdk_app_start Round 1 00:06:02.775 18:52:19 -- event/event.sh@25 -- # waitforlisten 2927259 /var/tmp/spdk-nbd.sock 00:06:02.775 18:52:19 -- common/autotest_common.sh@829 -- # '[' -z 2927259 ']' 00:06:02.775 18:52:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:02.775 18:52:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:02.775 18:52:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:02.775 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:02.775 18:52:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:02.775 18:52:19 -- common/autotest_common.sh@10 -- # set +x 00:06:02.775 18:52:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:02.775 18:52:19 -- common/autotest_common.sh@862 -- # return 0 00:06:02.775 18:52:19 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:02.775 Malloc0 00:06:02.775 18:52:19 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:02.775 Malloc1 00:06:02.775 18:52:19 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:02.775 18:52:19 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:02.775 18:52:19 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:02.775 18:52:19 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:06:02.775 18:52:19 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:02.775 18:52:19 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:06:02.775 18:52:19 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:02.775 18:52:19 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:02.775 18:52:19 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:02.775 18:52:19 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:06:02.775 18:52:19 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:02.775 18:52:19 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:06:02.775 18:52:19 -- bdev/nbd_common.sh@12 -- # local i 00:06:02.775 18:52:19 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:06:02.775 18:52:19 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:02.775 18:52:19 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:06:03.034 /dev/nbd0 00:06:03.035 18:52:19 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:06:03.035 18:52:19 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:06:03.035 18:52:19 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:06:03.035 18:52:19 -- common/autotest_common.sh@867 -- # local i 00:06:03.035 18:52:19 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:03.035 18:52:19 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:03.035 18:52:19 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:06:03.035 18:52:19 -- common/autotest_common.sh@871 -- # break 00:06:03.035 18:52:19 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:03.035 18:52:19 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:03.035 18:52:19 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:03.035 1+0 records in 00:06:03.035 1+0 records out 00:06:03.035 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000156614 s, 26.2 MB/s 00:06:03.035 18:52:19 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:03.035 18:52:19 -- common/autotest_common.sh@884 -- # size=4096 00:06:03.035 18:52:19 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:03.035 18:52:19 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:03.035 18:52:19 -- common/autotest_common.sh@887 -- # return 0 00:06:03.035 18:52:19 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:03.035 18:52:19 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:03.035 18:52:19 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:06:03.035 /dev/nbd1 00:06:03.293 18:52:19 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:06:03.293 18:52:19 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:06:03.293 18:52:19 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:06:03.293 18:52:19 -- common/autotest_common.sh@867 -- # local i 00:06:03.293 18:52:19 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:03.293 18:52:19 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:03.293 18:52:19 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:06:03.293 18:52:19 -- common/autotest_common.sh@871 -- # break 00:06:03.293 18:52:19 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:03.293 18:52:19 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:03.293 18:52:19 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:03.293 1+0 records in 00:06:03.293 1+0 records out 00:06:03.293 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000130099 s, 31.5 MB/s 00:06:03.293 18:52:19 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:03.293 18:52:19 -- common/autotest_common.sh@884 -- # size=4096 00:06:03.293 18:52:19 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:03.293 18:52:19 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:03.293 18:52:19 -- common/autotest_common.sh@887 -- # return 0 00:06:03.293 18:52:19 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:03.293 18:52:19 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:03.293 18:52:19 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:03.293 18:52:19 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:03.293 18:52:19 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:03.293 18:52:20 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:06:03.293 { 00:06:03.293 "nbd_device": "/dev/nbd0", 00:06:03.293 "bdev_name": "Malloc0" 00:06:03.293 }, 00:06:03.293 { 00:06:03.293 "nbd_device": "/dev/nbd1", 00:06:03.293 "bdev_name": "Malloc1" 00:06:03.293 } 00:06:03.293 ]' 00:06:03.293 18:52:20 -- bdev/nbd_common.sh@64 -- # echo '[ 00:06:03.293 { 00:06:03.293 "nbd_device": "/dev/nbd0", 00:06:03.293 "bdev_name": "Malloc0" 00:06:03.293 }, 00:06:03.293 { 00:06:03.293 "nbd_device": "/dev/nbd1", 00:06:03.293 "bdev_name": "Malloc1" 00:06:03.293 } 00:06:03.293 ]' 00:06:03.293 18:52:20 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:03.293 18:52:20 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:06:03.293 /dev/nbd1' 00:06:03.293 18:52:20 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:06:03.293 /dev/nbd1' 00:06:03.293 18:52:20 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:03.293 18:52:20 -- bdev/nbd_common.sh@65 -- # count=2 00:06:03.293 18:52:20 -- bdev/nbd_common.sh@66 -- # echo 2 00:06:03.293 18:52:20 -- bdev/nbd_common.sh@95 -- # count=2 00:06:03.293 18:52:20 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:06:03.293 18:52:20 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:06:03.293 18:52:20 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:03.293 18:52:20 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:03.293 18:52:20 -- bdev/nbd_common.sh@71 -- # local operation=write 00:06:03.294 18:52:20 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:03.294 18:52:20 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:06:03.294 18:52:20 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:06:03.553 256+0 records in 00:06:03.553 256+0 records out 00:06:03.553 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010188 s, 103 MB/s 00:06:03.553 18:52:20 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:03.553 18:52:20 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:06:03.553 256+0 records in 00:06:03.553 256+0 records out 00:06:03.553 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135314 s, 77.5 MB/s 00:06:03.553 18:52:20 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:03.553 18:52:20 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:06:03.553 256+0 records in 00:06:03.553 256+0 records out 00:06:03.553 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145989 s, 71.8 MB/s 00:06:03.553 18:52:20 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:06:03.553 18:52:20 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:03.553 18:52:20 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:03.553 18:52:20 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:06:03.553 18:52:20 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:03.553 18:52:20 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:06:03.553 18:52:20 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:06:03.553 18:52:20 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:03.553 18:52:20 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:06:03.553 18:52:20 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:03.553 18:52:20 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:06:03.553 18:52:20 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:03.553 18:52:20 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:06:03.553 18:52:20 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:03.553 18:52:20 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:03.553 18:52:20 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:06:03.553 18:52:20 -- bdev/nbd_common.sh@51 -- # local i 00:06:03.553 18:52:20 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:03.553 18:52:20 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:06:03.553 18:52:20 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:06:03.553 18:52:20 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:06:03.553 18:52:20 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:06:03.553 18:52:20 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:03.553 18:52:20 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:03.553 18:52:20 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:06:03.812 18:52:20 -- bdev/nbd_common.sh@41 -- # break 00:06:03.812 18:52:20 -- bdev/nbd_common.sh@45 -- # return 0 00:06:03.812 18:52:20 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:03.812 18:52:20 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:06:03.812 18:52:20 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:06:03.812 18:52:20 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:06:03.812 18:52:20 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:06:03.812 18:52:20 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:03.812 18:52:20 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:03.812 18:52:20 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:06:03.812 18:52:20 -- bdev/nbd_common.sh@41 -- # break 00:06:03.812 18:52:20 -- bdev/nbd_common.sh@45 -- # return 0 00:06:03.812 18:52:20 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:03.812 18:52:20 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:03.812 18:52:20 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:04.071 18:52:20 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:06:04.071 18:52:20 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:06:04.071 18:52:20 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:04.071 18:52:20 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:06:04.071 18:52:20 -- bdev/nbd_common.sh@65 -- # echo '' 00:06:04.071 18:52:20 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:04.071 18:52:20 -- bdev/nbd_common.sh@65 -- # true 00:06:04.071 18:52:20 -- bdev/nbd_common.sh@65 -- # count=0 00:06:04.071 18:52:20 -- bdev/nbd_common.sh@66 -- # echo 0 00:06:04.071 18:52:20 -- bdev/nbd_common.sh@104 -- # count=0 00:06:04.071 18:52:20 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:06:04.071 18:52:20 -- bdev/nbd_common.sh@109 -- # return 0 00:06:04.071 18:52:20 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:06:04.330 18:52:21 -- event/event.sh@35 -- # sleep 3 00:06:04.589 [2024-11-26 18:52:21.269931] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:04.589 [2024-11-26 18:52:21.304736] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:04.589 [2024-11-26 18:52:21.304738] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:04.590 [2024-11-26 18:52:21.346132] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:06:04.590 [2024-11-26 18:52:21.346175] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:06:07.878 18:52:24 -- event/event.sh@23 -- # for i in {0..2} 00:06:07.878 18:52:24 -- event/event.sh@24 -- # echo 'spdk_app_start Round 2' 00:06:07.878 spdk_app_start Round 2 00:06:07.878 18:52:24 -- event/event.sh@25 -- # waitforlisten 2927259 /var/tmp/spdk-nbd.sock 00:06:07.878 18:52:24 -- common/autotest_common.sh@829 -- # '[' -z 2927259 ']' 00:06:07.878 18:52:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:07.878 18:52:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:07.878 18:52:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:07.878 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:07.878 18:52:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:07.878 18:52:24 -- common/autotest_common.sh@10 -- # set +x 00:06:07.878 18:52:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:07.878 18:52:24 -- common/autotest_common.sh@862 -- # return 0 00:06:07.878 18:52:24 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:07.878 Malloc0 00:06:07.878 18:52:24 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:07.878 Malloc1 00:06:07.878 18:52:24 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:07.878 18:52:24 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:07.878 18:52:24 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:07.878 18:52:24 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:06:07.878 18:52:24 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:07.878 18:52:24 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:06:07.878 18:52:24 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:07.878 18:52:24 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:07.878 18:52:24 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:07.878 18:52:24 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:06:07.878 18:52:24 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:07.878 18:52:24 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:06:07.878 18:52:24 -- bdev/nbd_common.sh@12 -- # local i 00:06:07.878 18:52:24 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:06:07.878 18:52:24 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:07.878 18:52:24 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:06:08.137 /dev/nbd0 00:06:08.137 18:52:24 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:06:08.137 18:52:24 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:06:08.137 18:52:24 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:06:08.137 18:52:24 -- common/autotest_common.sh@867 -- # local i 00:06:08.137 18:52:24 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:08.137 18:52:24 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:08.137 18:52:24 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:06:08.137 18:52:24 -- common/autotest_common.sh@871 -- # break 00:06:08.137 18:52:24 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:08.137 18:52:24 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:08.137 18:52:24 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:08.137 1+0 records in 00:06:08.137 1+0 records out 00:06:08.137 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000217415 s, 18.8 MB/s 00:06:08.137 18:52:24 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:08.137 18:52:24 -- common/autotest_common.sh@884 -- # size=4096 00:06:08.137 18:52:24 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:08.137 18:52:24 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:08.137 18:52:24 -- common/autotest_common.sh@887 -- # return 0 00:06:08.137 18:52:24 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:08.137 18:52:24 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:08.137 18:52:24 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:06:08.137 /dev/nbd1 00:06:08.402 18:52:25 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:06:08.402 18:52:25 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:06:08.402 18:52:25 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:06:08.402 18:52:25 -- common/autotest_common.sh@867 -- # local i 00:06:08.402 18:52:25 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:08.402 18:52:25 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:08.402 18:52:25 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:06:08.402 18:52:25 -- common/autotest_common.sh@871 -- # break 00:06:08.402 18:52:25 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:08.402 18:52:25 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:08.402 18:52:25 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:08.402 1+0 records in 00:06:08.402 1+0 records out 00:06:08.403 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00019438 s, 21.1 MB/s 00:06:08.403 18:52:25 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:08.403 18:52:25 -- common/autotest_common.sh@884 -- # size=4096 00:06:08.403 18:52:25 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:08.403 18:52:25 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:08.403 18:52:25 -- common/autotest_common.sh@887 -- # return 0 00:06:08.403 18:52:25 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:08.403 18:52:25 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:08.403 18:52:25 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:08.403 18:52:25 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:08.403 18:52:25 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:08.403 18:52:25 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:06:08.403 { 00:06:08.403 "nbd_device": "/dev/nbd0", 00:06:08.403 "bdev_name": "Malloc0" 00:06:08.403 }, 00:06:08.403 { 00:06:08.403 "nbd_device": "/dev/nbd1", 00:06:08.403 "bdev_name": "Malloc1" 00:06:08.403 } 00:06:08.403 ]' 00:06:08.403 18:52:25 -- bdev/nbd_common.sh@64 -- # echo '[ 00:06:08.403 { 00:06:08.403 "nbd_device": "/dev/nbd0", 00:06:08.403 "bdev_name": "Malloc0" 00:06:08.403 }, 00:06:08.403 { 00:06:08.403 "nbd_device": "/dev/nbd1", 00:06:08.403 "bdev_name": "Malloc1" 00:06:08.403 } 00:06:08.403 ]' 00:06:08.403 18:52:25 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:08.403 18:52:25 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:06:08.403 /dev/nbd1' 00:06:08.403 18:52:25 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:06:08.403 /dev/nbd1' 00:06:08.403 18:52:25 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:08.403 18:52:25 -- bdev/nbd_common.sh@65 -- # count=2 00:06:08.403 18:52:25 -- bdev/nbd_common.sh@66 -- # echo 2 00:06:08.403 18:52:25 -- bdev/nbd_common.sh@95 -- # count=2 00:06:08.403 18:52:25 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:06:08.403 18:52:25 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:06:08.403 18:52:25 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:08.403 18:52:25 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:08.403 18:52:25 -- bdev/nbd_common.sh@71 -- # local operation=write 00:06:08.404 18:52:25 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:08.404 18:52:25 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:06:08.404 18:52:25 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:06:08.404 256+0 records in 00:06:08.404 256+0 records out 00:06:08.404 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106488 s, 98.5 MB/s 00:06:08.670 18:52:25 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:08.670 18:52:25 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:06:08.670 256+0 records in 00:06:08.670 256+0 records out 00:06:08.670 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141598 s, 74.1 MB/s 00:06:08.670 18:52:25 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:08.670 18:52:25 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:06:08.670 256+0 records in 00:06:08.670 256+0 records out 00:06:08.670 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147799 s, 70.9 MB/s 00:06:08.670 18:52:25 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:06:08.670 18:52:25 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:08.670 18:52:25 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:08.670 18:52:25 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:06:08.670 18:52:25 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:08.670 18:52:25 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:06:08.670 18:52:25 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:06:08.670 18:52:25 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:08.670 18:52:25 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:06:08.670 18:52:25 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:08.670 18:52:25 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:06:08.670 18:52:25 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:08.670 18:52:25 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:06:08.670 18:52:25 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:08.670 18:52:25 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:08.670 18:52:25 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:06:08.670 18:52:25 -- bdev/nbd_common.sh@51 -- # local i 00:06:08.670 18:52:25 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:08.670 18:52:25 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:06:08.670 18:52:25 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:06:08.670 18:52:25 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:06:08.670 18:52:25 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:06:08.670 18:52:25 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:08.670 18:52:25 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:08.670 18:52:25 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:06:08.670 18:52:25 -- bdev/nbd_common.sh@41 -- # break 00:06:08.670 18:52:25 -- bdev/nbd_common.sh@45 -- # return 0 00:06:08.670 18:52:25 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:08.670 18:52:25 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:06:08.929 18:52:25 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:06:08.929 18:52:25 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:06:08.929 18:52:25 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:06:08.929 18:52:25 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:08.929 18:52:25 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:08.929 18:52:25 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:06:08.929 18:52:25 -- bdev/nbd_common.sh@41 -- # break 00:06:08.929 18:52:25 -- bdev/nbd_common.sh@45 -- # return 0 00:06:08.929 18:52:25 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:08.929 18:52:25 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:08.929 18:52:25 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:09.187 18:52:25 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:06:09.188 18:52:25 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:06:09.188 18:52:25 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:09.188 18:52:26 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:06:09.188 18:52:26 -- bdev/nbd_common.sh@65 -- # echo '' 00:06:09.188 18:52:26 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:09.188 18:52:26 -- bdev/nbd_common.sh@65 -- # true 00:06:09.188 18:52:26 -- bdev/nbd_common.sh@65 -- # count=0 00:06:09.188 18:52:26 -- bdev/nbd_common.sh@66 -- # echo 0 00:06:09.188 18:52:26 -- bdev/nbd_common.sh@104 -- # count=0 00:06:09.188 18:52:26 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:06:09.188 18:52:26 -- bdev/nbd_common.sh@109 -- # return 0 00:06:09.188 18:52:26 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:06:09.447 18:52:26 -- event/event.sh@35 -- # sleep 3 00:06:09.706 [2024-11-26 18:52:26.386013] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:09.706 [2024-11-26 18:52:26.421304] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:09.706 [2024-11-26 18:52:26.421307] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:09.706 [2024-11-26 18:52:26.462660] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:06:09.706 [2024-11-26 18:52:26.462701] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:06:12.995 18:52:29 -- event/event.sh@38 -- # waitforlisten 2927259 /var/tmp/spdk-nbd.sock 00:06:12.995 18:52:29 -- common/autotest_common.sh@829 -- # '[' -z 2927259 ']' 00:06:12.995 18:52:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:12.996 18:52:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:12.996 18:52:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:12.996 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:12.996 18:52:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:12.996 18:52:29 -- common/autotest_common.sh@10 -- # set +x 00:06:12.996 18:52:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:12.996 18:52:29 -- common/autotest_common.sh@862 -- # return 0 00:06:12.996 18:52:29 -- event/event.sh@39 -- # killprocess 2927259 00:06:12.996 18:52:29 -- common/autotest_common.sh@936 -- # '[' -z 2927259 ']' 00:06:12.996 18:52:29 -- common/autotest_common.sh@940 -- # kill -0 2927259 00:06:12.996 18:52:29 -- common/autotest_common.sh@941 -- # uname 00:06:12.996 18:52:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:12.996 18:52:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2927259 00:06:12.996 18:52:29 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:12.996 18:52:29 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:12.996 18:52:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2927259' 00:06:12.996 killing process with pid 2927259 00:06:12.996 18:52:29 -- common/autotest_common.sh@955 -- # kill 2927259 00:06:12.996 18:52:29 -- common/autotest_common.sh@960 -- # wait 2927259 00:06:12.996 spdk_app_start is called in Round 0. 00:06:12.996 Shutdown signal received, stop current app iteration 00:06:12.996 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 reinitialization... 00:06:12.996 spdk_app_start is called in Round 1. 00:06:12.996 Shutdown signal received, stop current app iteration 00:06:12.996 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 reinitialization... 00:06:12.996 spdk_app_start is called in Round 2. 00:06:12.996 Shutdown signal received, stop current app iteration 00:06:12.996 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 reinitialization... 00:06:12.996 spdk_app_start is called in Round 3. 00:06:12.996 Shutdown signal received, stop current app iteration 00:06:12.996 18:52:29 -- event/event.sh@40 -- # trap - SIGINT SIGTERM EXIT 00:06:12.996 18:52:29 -- event/event.sh@42 -- # return 0 00:06:12.996 00:06:12.996 real 0m16.397s 00:06:12.996 user 0m35.742s 00:06:12.996 sys 0m2.431s 00:06:12.996 18:52:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:12.996 18:52:29 -- common/autotest_common.sh@10 -- # set +x 00:06:12.996 ************************************ 00:06:12.996 END TEST app_repeat 00:06:12.996 ************************************ 00:06:12.996 18:52:29 -- event/event.sh@54 -- # (( SPDK_TEST_CRYPTO == 0 )) 00:06:12.996 18:52:29 -- event/event.sh@55 -- # run_test cpu_locks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:06:12.996 18:52:29 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:12.996 18:52:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:12.996 18:52:29 -- common/autotest_common.sh@10 -- # set +x 00:06:12.996 ************************************ 00:06:12.996 START TEST cpu_locks 00:06:12.996 ************************************ 00:06:12.996 18:52:29 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:06:12.996 * Looking for test storage... 00:06:12.996 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:06:12.996 18:52:29 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:12.996 18:52:29 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:12.996 18:52:29 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:12.996 18:52:29 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:12.996 18:52:29 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:12.996 18:52:29 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:12.996 18:52:29 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:12.996 18:52:29 -- scripts/common.sh@335 -- # IFS=.-: 00:06:12.996 18:52:29 -- scripts/common.sh@335 -- # read -ra ver1 00:06:12.996 18:52:29 -- scripts/common.sh@336 -- # IFS=.-: 00:06:12.996 18:52:29 -- scripts/common.sh@336 -- # read -ra ver2 00:06:12.996 18:52:29 -- scripts/common.sh@337 -- # local 'op=<' 00:06:12.996 18:52:29 -- scripts/common.sh@339 -- # ver1_l=2 00:06:12.996 18:52:29 -- scripts/common.sh@340 -- # ver2_l=1 00:06:12.996 18:52:29 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:12.996 18:52:29 -- scripts/common.sh@343 -- # case "$op" in 00:06:12.996 18:52:29 -- scripts/common.sh@344 -- # : 1 00:06:12.996 18:52:29 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:12.996 18:52:29 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:12.996 18:52:29 -- scripts/common.sh@364 -- # decimal 1 00:06:12.996 18:52:29 -- scripts/common.sh@352 -- # local d=1 00:06:12.996 18:52:29 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:12.996 18:52:29 -- scripts/common.sh@354 -- # echo 1 00:06:12.996 18:52:29 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:12.996 18:52:29 -- scripts/common.sh@365 -- # decimal 2 00:06:12.996 18:52:29 -- scripts/common.sh@352 -- # local d=2 00:06:12.996 18:52:29 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:12.996 18:52:29 -- scripts/common.sh@354 -- # echo 2 00:06:12.996 18:52:29 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:12.996 18:52:29 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:12.996 18:52:29 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:12.996 18:52:29 -- scripts/common.sh@367 -- # return 0 00:06:12.996 18:52:29 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:12.996 18:52:29 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:12.996 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:12.996 --rc genhtml_branch_coverage=1 00:06:12.996 --rc genhtml_function_coverage=1 00:06:12.996 --rc genhtml_legend=1 00:06:12.996 --rc geninfo_all_blocks=1 00:06:12.996 --rc geninfo_unexecuted_blocks=1 00:06:12.996 00:06:12.996 ' 00:06:12.996 18:52:29 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:12.996 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:12.996 --rc genhtml_branch_coverage=1 00:06:12.996 --rc genhtml_function_coverage=1 00:06:12.996 --rc genhtml_legend=1 00:06:12.996 --rc geninfo_all_blocks=1 00:06:12.996 --rc geninfo_unexecuted_blocks=1 00:06:12.996 00:06:12.996 ' 00:06:12.996 18:52:29 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:12.996 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:12.996 --rc genhtml_branch_coverage=1 00:06:12.996 --rc genhtml_function_coverage=1 00:06:12.996 --rc genhtml_legend=1 00:06:12.996 --rc geninfo_all_blocks=1 00:06:12.996 --rc geninfo_unexecuted_blocks=1 00:06:12.996 00:06:12.996 ' 00:06:12.996 18:52:29 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:12.996 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:12.996 --rc genhtml_branch_coverage=1 00:06:12.996 --rc genhtml_function_coverage=1 00:06:12.996 --rc genhtml_legend=1 00:06:12.996 --rc geninfo_all_blocks=1 00:06:12.996 --rc geninfo_unexecuted_blocks=1 00:06:12.996 00:06:12.996 ' 00:06:12.996 18:52:29 -- event/cpu_locks.sh@11 -- # rpc_sock1=/var/tmp/spdk.sock 00:06:12.996 18:52:29 -- event/cpu_locks.sh@12 -- # rpc_sock2=/var/tmp/spdk2.sock 00:06:12.996 18:52:29 -- event/cpu_locks.sh@164 -- # trap cleanup EXIT SIGTERM SIGINT 00:06:12.996 18:52:29 -- event/cpu_locks.sh@166 -- # run_test default_locks default_locks 00:06:12.997 18:52:29 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:12.997 18:52:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:12.997 18:52:29 -- common/autotest_common.sh@10 -- # set +x 00:06:12.997 ************************************ 00:06:12.997 START TEST default_locks 00:06:12.997 ************************************ 00:06:12.997 18:52:29 -- common/autotest_common.sh@1114 -- # default_locks 00:06:12.997 18:52:29 -- event/cpu_locks.sh@46 -- # spdk_tgt_pid=2930296 00:06:12.997 18:52:29 -- event/cpu_locks.sh@47 -- # waitforlisten 2930296 00:06:12.997 18:52:29 -- common/autotest_common.sh@829 -- # '[' -z 2930296 ']' 00:06:12.997 18:52:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:12.997 18:52:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:12.997 18:52:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:12.997 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:12.997 18:52:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:12.997 18:52:29 -- common/autotest_common.sh@10 -- # set +x 00:06:12.997 18:52:29 -- event/cpu_locks.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:12.997 [2024-11-26 18:52:29.852350] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:12.997 [2024-11-26 18:52:29.852402] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2930296 ] 00:06:12.997 EAL: No free 2048 kB hugepages reported on node 1 00:06:12.997 [2024-11-26 18:52:29.907288] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:13.256 [2024-11-26 18:52:29.946615] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:13.256 [2024-11-26 18:52:29.946752] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:13.825 18:52:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:13.825 18:52:30 -- common/autotest_common.sh@862 -- # return 0 00:06:13.825 18:52:30 -- event/cpu_locks.sh@49 -- # locks_exist 2930296 00:06:13.825 18:52:30 -- event/cpu_locks.sh@22 -- # lslocks -p 2930296 00:06:13.825 18:52:30 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:14.084 lslocks: write error 00:06:14.084 18:52:30 -- event/cpu_locks.sh@50 -- # killprocess 2930296 00:06:14.084 18:52:30 -- common/autotest_common.sh@936 -- # '[' -z 2930296 ']' 00:06:14.084 18:52:30 -- common/autotest_common.sh@940 -- # kill -0 2930296 00:06:14.084 18:52:30 -- common/autotest_common.sh@941 -- # uname 00:06:14.084 18:52:30 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:14.084 18:52:30 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2930296 00:06:14.084 18:52:30 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:14.084 18:52:30 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:14.084 18:52:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2930296' 00:06:14.084 killing process with pid 2930296 00:06:14.084 18:52:30 -- common/autotest_common.sh@955 -- # kill 2930296 00:06:14.084 18:52:30 -- common/autotest_common.sh@960 -- # wait 2930296 00:06:14.652 18:52:31 -- event/cpu_locks.sh@52 -- # NOT waitforlisten 2930296 00:06:14.652 18:52:31 -- common/autotest_common.sh@650 -- # local es=0 00:06:14.653 18:52:31 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 2930296 00:06:14.653 18:52:31 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:06:14.653 18:52:31 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:14.653 18:52:31 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:06:14.653 18:52:31 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:14.653 18:52:31 -- common/autotest_common.sh@653 -- # waitforlisten 2930296 00:06:14.653 18:52:31 -- common/autotest_common.sh@829 -- # '[' -z 2930296 ']' 00:06:14.653 18:52:31 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:14.653 18:52:31 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:14.653 18:52:31 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:14.653 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:14.653 18:52:31 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:14.653 18:52:31 -- common/autotest_common.sh@10 -- # set +x 00:06:14.653 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (2930296) - No such process 00:06:14.653 ERROR: process (pid: 2930296) is no longer running 00:06:14.653 18:52:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:14.653 18:52:31 -- common/autotest_common.sh@862 -- # return 1 00:06:14.653 18:52:31 -- common/autotest_common.sh@653 -- # es=1 00:06:14.653 18:52:31 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:14.653 18:52:31 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:14.653 18:52:31 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:14.653 18:52:31 -- event/cpu_locks.sh@54 -- # no_locks 00:06:14.653 18:52:31 -- event/cpu_locks.sh@26 -- # lock_files=() 00:06:14.653 18:52:31 -- event/cpu_locks.sh@26 -- # local lock_files 00:06:14.653 18:52:31 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:06:14.653 00:06:14.653 real 0m1.489s 00:06:14.653 user 0m1.575s 00:06:14.653 sys 0m0.482s 00:06:14.653 18:52:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:14.653 18:52:31 -- common/autotest_common.sh@10 -- # set +x 00:06:14.653 ************************************ 00:06:14.653 END TEST default_locks 00:06:14.653 ************************************ 00:06:14.653 18:52:31 -- event/cpu_locks.sh@167 -- # run_test default_locks_via_rpc default_locks_via_rpc 00:06:14.653 18:52:31 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:14.653 18:52:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:14.653 18:52:31 -- common/autotest_common.sh@10 -- # set +x 00:06:14.653 ************************************ 00:06:14.653 START TEST default_locks_via_rpc 00:06:14.653 ************************************ 00:06:14.653 18:52:31 -- common/autotest_common.sh@1114 -- # default_locks_via_rpc 00:06:14.653 18:52:31 -- event/cpu_locks.sh@62 -- # spdk_tgt_pid=2930643 00:06:14.653 18:52:31 -- event/cpu_locks.sh@63 -- # waitforlisten 2930643 00:06:14.653 18:52:31 -- common/autotest_common.sh@829 -- # '[' -z 2930643 ']' 00:06:14.653 18:52:31 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:14.653 18:52:31 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:14.653 18:52:31 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:14.653 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:14.653 18:52:31 -- event/cpu_locks.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:14.653 18:52:31 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:14.653 18:52:31 -- common/autotest_common.sh@10 -- # set +x 00:06:14.653 [2024-11-26 18:52:31.379712] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:14.653 [2024-11-26 18:52:31.379763] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2930643 ] 00:06:14.653 EAL: No free 2048 kB hugepages reported on node 1 00:06:14.653 [2024-11-26 18:52:31.434293] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:14.653 [2024-11-26 18:52:31.473055] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:14.653 [2024-11-26 18:52:31.473181] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:15.591 18:52:32 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:15.591 18:52:32 -- common/autotest_common.sh@862 -- # return 0 00:06:15.591 18:52:32 -- event/cpu_locks.sh@65 -- # rpc_cmd framework_disable_cpumask_locks 00:06:15.591 18:52:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:15.591 18:52:32 -- common/autotest_common.sh@10 -- # set +x 00:06:15.591 18:52:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:15.591 18:52:32 -- event/cpu_locks.sh@67 -- # no_locks 00:06:15.591 18:52:32 -- event/cpu_locks.sh@26 -- # lock_files=() 00:06:15.591 18:52:32 -- event/cpu_locks.sh@26 -- # local lock_files 00:06:15.591 18:52:32 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:06:15.591 18:52:32 -- event/cpu_locks.sh@69 -- # rpc_cmd framework_enable_cpumask_locks 00:06:15.591 18:52:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:15.591 18:52:32 -- common/autotest_common.sh@10 -- # set +x 00:06:15.591 18:52:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:15.591 18:52:32 -- event/cpu_locks.sh@71 -- # locks_exist 2930643 00:06:15.591 18:52:32 -- event/cpu_locks.sh@22 -- # lslocks -p 2930643 00:06:15.591 18:52:32 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:15.591 18:52:32 -- event/cpu_locks.sh@73 -- # killprocess 2930643 00:06:15.591 18:52:32 -- common/autotest_common.sh@936 -- # '[' -z 2930643 ']' 00:06:15.591 18:52:32 -- common/autotest_common.sh@940 -- # kill -0 2930643 00:06:15.591 18:52:32 -- common/autotest_common.sh@941 -- # uname 00:06:15.591 18:52:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:15.591 18:52:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2930643 00:06:15.591 18:52:32 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:15.591 18:52:32 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:15.591 18:52:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2930643' 00:06:15.591 killing process with pid 2930643 00:06:15.592 18:52:32 -- common/autotest_common.sh@955 -- # kill 2930643 00:06:15.592 18:52:32 -- common/autotest_common.sh@960 -- # wait 2930643 00:06:15.851 00:06:15.851 real 0m1.397s 00:06:15.851 user 0m1.500s 00:06:15.851 sys 0m0.431s 00:06:15.851 18:52:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:15.851 18:52:32 -- common/autotest_common.sh@10 -- # set +x 00:06:15.851 ************************************ 00:06:15.851 END TEST default_locks_via_rpc 00:06:15.851 ************************************ 00:06:15.851 18:52:32 -- event/cpu_locks.sh@168 -- # run_test non_locking_app_on_locked_coremask non_locking_app_on_locked_coremask 00:06:15.851 18:52:32 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:15.851 18:52:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:15.851 18:52:32 -- common/autotest_common.sh@10 -- # set +x 00:06:15.851 ************************************ 00:06:15.851 START TEST non_locking_app_on_locked_coremask 00:06:15.851 ************************************ 00:06:15.851 18:52:32 -- common/autotest_common.sh@1114 -- # non_locking_app_on_locked_coremask 00:06:15.851 18:52:32 -- event/cpu_locks.sh@80 -- # spdk_tgt_pid=2930942 00:06:15.851 18:52:32 -- event/cpu_locks.sh@81 -- # waitforlisten 2930942 /var/tmp/spdk.sock 00:06:15.851 18:52:32 -- event/cpu_locks.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:15.851 18:52:32 -- common/autotest_common.sh@829 -- # '[' -z 2930942 ']' 00:06:15.851 18:52:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:15.851 18:52:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:15.851 18:52:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:15.851 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:15.851 18:52:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:15.851 18:52:32 -- common/autotest_common.sh@10 -- # set +x 00:06:16.110 [2024-11-26 18:52:32.819001] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:16.110 [2024-11-26 18:52:32.819053] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2930942 ] 00:06:16.110 EAL: No free 2048 kB hugepages reported on node 1 00:06:16.110 [2024-11-26 18:52:32.874004] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:16.110 [2024-11-26 18:52:32.913309] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:16.110 [2024-11-26 18:52:32.913433] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:17.047 18:52:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:17.047 18:52:33 -- common/autotest_common.sh@862 -- # return 0 00:06:17.047 18:52:33 -- event/cpu_locks.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks -r /var/tmp/spdk2.sock 00:06:17.047 18:52:33 -- event/cpu_locks.sh@84 -- # spdk_tgt_pid2=2931049 00:06:17.047 18:52:33 -- event/cpu_locks.sh@85 -- # waitforlisten 2931049 /var/tmp/spdk2.sock 00:06:17.047 18:52:33 -- common/autotest_common.sh@829 -- # '[' -z 2931049 ']' 00:06:17.047 18:52:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:17.047 18:52:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:17.047 18:52:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:17.047 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:17.047 18:52:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:17.047 18:52:33 -- common/autotest_common.sh@10 -- # set +x 00:06:17.047 [2024-11-26 18:52:33.677221] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:17.047 [2024-11-26 18:52:33.677269] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2931049 ] 00:06:17.047 EAL: No free 2048 kB hugepages reported on node 1 00:06:17.047 [2024-11-26 18:52:33.754280] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:17.047 [2024-11-26 18:52:33.754305] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:17.047 [2024-11-26 18:52:33.832213] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:17.047 [2024-11-26 18:52:33.832335] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:17.616 18:52:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:17.616 18:52:34 -- common/autotest_common.sh@862 -- # return 0 00:06:17.616 18:52:34 -- event/cpu_locks.sh@87 -- # locks_exist 2930942 00:06:17.616 18:52:34 -- event/cpu_locks.sh@22 -- # lslocks -p 2930942 00:06:17.616 18:52:34 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:18.553 lslocks: write error 00:06:18.553 18:52:35 -- event/cpu_locks.sh@89 -- # killprocess 2930942 00:06:18.553 18:52:35 -- common/autotest_common.sh@936 -- # '[' -z 2930942 ']' 00:06:18.553 18:52:35 -- common/autotest_common.sh@940 -- # kill -0 2930942 00:06:18.553 18:52:35 -- common/autotest_common.sh@941 -- # uname 00:06:18.553 18:52:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:18.553 18:52:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2930942 00:06:18.553 18:52:35 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:18.553 18:52:35 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:18.553 18:52:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2930942' 00:06:18.553 killing process with pid 2930942 00:06:18.553 18:52:35 -- common/autotest_common.sh@955 -- # kill 2930942 00:06:18.553 18:52:35 -- common/autotest_common.sh@960 -- # wait 2930942 00:06:19.121 18:52:35 -- event/cpu_locks.sh@90 -- # killprocess 2931049 00:06:19.121 18:52:35 -- common/autotest_common.sh@936 -- # '[' -z 2931049 ']' 00:06:19.121 18:52:35 -- common/autotest_common.sh@940 -- # kill -0 2931049 00:06:19.121 18:52:35 -- common/autotest_common.sh@941 -- # uname 00:06:19.121 18:52:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:19.121 18:52:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2931049 00:06:19.121 18:52:35 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:19.121 18:52:35 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:19.121 18:52:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2931049' 00:06:19.121 killing process with pid 2931049 00:06:19.121 18:52:35 -- common/autotest_common.sh@955 -- # kill 2931049 00:06:19.121 18:52:35 -- common/autotest_common.sh@960 -- # wait 2931049 00:06:19.380 00:06:19.380 real 0m3.418s 00:06:19.380 user 0m3.679s 00:06:19.380 sys 0m0.991s 00:06:19.380 18:52:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:19.380 18:52:36 -- common/autotest_common.sh@10 -- # set +x 00:06:19.380 ************************************ 00:06:19.380 END TEST non_locking_app_on_locked_coremask 00:06:19.380 ************************************ 00:06:19.380 18:52:36 -- event/cpu_locks.sh@169 -- # run_test locking_app_on_unlocked_coremask locking_app_on_unlocked_coremask 00:06:19.380 18:52:36 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:19.380 18:52:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:19.380 18:52:36 -- common/autotest_common.sh@10 -- # set +x 00:06:19.380 ************************************ 00:06:19.380 START TEST locking_app_on_unlocked_coremask 00:06:19.380 ************************************ 00:06:19.380 18:52:36 -- common/autotest_common.sh@1114 -- # locking_app_on_unlocked_coremask 00:06:19.380 18:52:36 -- event/cpu_locks.sh@98 -- # spdk_tgt_pid=2931550 00:06:19.380 18:52:36 -- event/cpu_locks.sh@99 -- # waitforlisten 2931550 /var/tmp/spdk.sock 00:06:19.380 18:52:36 -- event/cpu_locks.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks 00:06:19.380 18:52:36 -- common/autotest_common.sh@829 -- # '[' -z 2931550 ']' 00:06:19.380 18:52:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:19.380 18:52:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:19.380 18:52:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:19.380 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:19.380 18:52:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:19.380 18:52:36 -- common/autotest_common.sh@10 -- # set +x 00:06:19.380 [2024-11-26 18:52:36.278688] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:19.380 [2024-11-26 18:52:36.278738] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2931550 ] 00:06:19.380 EAL: No free 2048 kB hugepages reported on node 1 00:06:19.639 [2024-11-26 18:52:36.333046] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:19.639 [2024-11-26 18:52:36.333072] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:19.639 [2024-11-26 18:52:36.370376] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:19.639 [2024-11-26 18:52:36.370499] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:20.207 18:52:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:20.207 18:52:37 -- common/autotest_common.sh@862 -- # return 0 00:06:20.207 18:52:37 -- event/cpu_locks.sh@102 -- # spdk_tgt_pid2=2931786 00:06:20.207 18:52:37 -- event/cpu_locks.sh@103 -- # waitforlisten 2931786 /var/tmp/spdk2.sock 00:06:20.207 18:52:37 -- event/cpu_locks.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:06:20.207 18:52:37 -- common/autotest_common.sh@829 -- # '[' -z 2931786 ']' 00:06:20.207 18:52:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:20.207 18:52:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:20.207 18:52:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:20.207 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:20.207 18:52:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:20.207 18:52:37 -- common/autotest_common.sh@10 -- # set +x 00:06:20.466 [2024-11-26 18:52:37.137622] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:20.466 [2024-11-26 18:52:37.137669] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2931786 ] 00:06:20.466 EAL: No free 2048 kB hugepages reported on node 1 00:06:20.466 [2024-11-26 18:52:37.213062] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:20.466 [2024-11-26 18:52:37.291325] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:20.466 [2024-11-26 18:52:37.291467] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:21.034 18:52:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:21.034 18:52:37 -- common/autotest_common.sh@862 -- # return 0 00:06:21.034 18:52:37 -- event/cpu_locks.sh@105 -- # locks_exist 2931786 00:06:21.034 18:52:37 -- event/cpu_locks.sh@22 -- # lslocks -p 2931786 00:06:21.034 18:52:37 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:21.602 lslocks: write error 00:06:21.602 18:52:38 -- event/cpu_locks.sh@107 -- # killprocess 2931550 00:06:21.602 18:52:38 -- common/autotest_common.sh@936 -- # '[' -z 2931550 ']' 00:06:21.602 18:52:38 -- common/autotest_common.sh@940 -- # kill -0 2931550 00:06:21.602 18:52:38 -- common/autotest_common.sh@941 -- # uname 00:06:21.602 18:52:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:21.602 18:52:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2931550 00:06:21.602 18:52:38 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:21.602 18:52:38 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:21.602 18:52:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2931550' 00:06:21.602 killing process with pid 2931550 00:06:21.602 18:52:38 -- common/autotest_common.sh@955 -- # kill 2931550 00:06:21.602 18:52:38 -- common/autotest_common.sh@960 -- # wait 2931550 00:06:22.171 18:52:38 -- event/cpu_locks.sh@108 -- # killprocess 2931786 00:06:22.171 18:52:38 -- common/autotest_common.sh@936 -- # '[' -z 2931786 ']' 00:06:22.171 18:52:38 -- common/autotest_common.sh@940 -- # kill -0 2931786 00:06:22.171 18:52:38 -- common/autotest_common.sh@941 -- # uname 00:06:22.171 18:52:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:22.171 18:52:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2931786 00:06:22.171 18:52:39 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:22.171 18:52:39 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:22.171 18:52:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2931786' 00:06:22.171 killing process with pid 2931786 00:06:22.171 18:52:39 -- common/autotest_common.sh@955 -- # kill 2931786 00:06:22.171 18:52:39 -- common/autotest_common.sh@960 -- # wait 2931786 00:06:22.440 00:06:22.440 real 0m3.083s 00:06:22.440 user 0m3.319s 00:06:22.440 sys 0m0.889s 00:06:22.440 18:52:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:22.440 18:52:39 -- common/autotest_common.sh@10 -- # set +x 00:06:22.440 ************************************ 00:06:22.440 END TEST locking_app_on_unlocked_coremask 00:06:22.440 ************************************ 00:06:22.440 18:52:39 -- event/cpu_locks.sh@170 -- # run_test locking_app_on_locked_coremask locking_app_on_locked_coremask 00:06:22.440 18:52:39 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:22.440 18:52:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:22.440 18:52:39 -- common/autotest_common.sh@10 -- # set +x 00:06:22.440 ************************************ 00:06:22.440 START TEST locking_app_on_locked_coremask 00:06:22.440 ************************************ 00:06:22.440 18:52:39 -- common/autotest_common.sh@1114 -- # locking_app_on_locked_coremask 00:06:22.440 18:52:39 -- event/cpu_locks.sh@115 -- # spdk_tgt_pid=2932063 00:06:22.440 18:52:39 -- event/cpu_locks.sh@116 -- # waitforlisten 2932063 /var/tmp/spdk.sock 00:06:22.440 18:52:39 -- event/cpu_locks.sh@114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:22.440 18:52:39 -- common/autotest_common.sh@829 -- # '[' -z 2932063 ']' 00:06:22.440 18:52:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:22.440 18:52:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:22.440 18:52:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:22.440 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:22.440 18:52:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:22.440 18:52:39 -- common/autotest_common.sh@10 -- # set +x 00:06:22.701 [2024-11-26 18:52:39.402319] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:22.702 [2024-11-26 18:52:39.402368] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2932063 ] 00:06:22.702 EAL: No free 2048 kB hugepages reported on node 1 00:06:22.702 [2024-11-26 18:52:39.455889] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:22.702 [2024-11-26 18:52:39.490384] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:22.702 [2024-11-26 18:52:39.490530] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:23.637 18:52:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:23.637 18:52:40 -- common/autotest_common.sh@862 -- # return 0 00:06:23.637 18:52:40 -- event/cpu_locks.sh@119 -- # spdk_tgt_pid2=2932299 00:06:23.637 18:52:40 -- event/cpu_locks.sh@120 -- # NOT waitforlisten 2932299 /var/tmp/spdk2.sock 00:06:23.637 18:52:40 -- event/cpu_locks.sh@118 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:06:23.637 18:52:40 -- common/autotest_common.sh@650 -- # local es=0 00:06:23.637 18:52:40 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 2932299 /var/tmp/spdk2.sock 00:06:23.637 18:52:40 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:06:23.637 18:52:40 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:23.637 18:52:40 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:06:23.637 18:52:40 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:23.637 18:52:40 -- common/autotest_common.sh@653 -- # waitforlisten 2932299 /var/tmp/spdk2.sock 00:06:23.637 18:52:40 -- common/autotest_common.sh@829 -- # '[' -z 2932299 ']' 00:06:23.637 18:52:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:23.637 18:52:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:23.637 18:52:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:23.637 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:23.637 18:52:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:23.637 18:52:40 -- common/autotest_common.sh@10 -- # set +x 00:06:23.637 [2024-11-26 18:52:40.264299] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:23.637 [2024-11-26 18:52:40.264346] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2932299 ] 00:06:23.637 EAL: No free 2048 kB hugepages reported on node 1 00:06:23.637 [2024-11-26 18:52:40.343163] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 0, probably process 2932063 has claimed it. 00:06:23.637 [2024-11-26 18:52:40.343203] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:06:24.206 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (2932299) - No such process 00:06:24.206 ERROR: process (pid: 2932299) is no longer running 00:06:24.206 18:52:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:24.206 18:52:40 -- common/autotest_common.sh@862 -- # return 1 00:06:24.206 18:52:40 -- common/autotest_common.sh@653 -- # es=1 00:06:24.206 18:52:40 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:24.206 18:52:40 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:24.206 18:52:40 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:24.206 18:52:40 -- event/cpu_locks.sh@122 -- # locks_exist 2932063 00:06:24.206 18:52:40 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:24.206 18:52:40 -- event/cpu_locks.sh@22 -- # lslocks -p 2932063 00:06:24.465 lslocks: write error 00:06:24.465 18:52:41 -- event/cpu_locks.sh@124 -- # killprocess 2932063 00:06:24.465 18:52:41 -- common/autotest_common.sh@936 -- # '[' -z 2932063 ']' 00:06:24.465 18:52:41 -- common/autotest_common.sh@940 -- # kill -0 2932063 00:06:24.465 18:52:41 -- common/autotest_common.sh@941 -- # uname 00:06:24.465 18:52:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:24.465 18:52:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2932063 00:06:24.465 18:52:41 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:24.465 18:52:41 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:24.465 18:52:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2932063' 00:06:24.465 killing process with pid 2932063 00:06:24.465 18:52:41 -- common/autotest_common.sh@955 -- # kill 2932063 00:06:24.465 18:52:41 -- common/autotest_common.sh@960 -- # wait 2932063 00:06:25.034 00:06:25.034 real 0m2.318s 00:06:25.034 user 0m2.567s 00:06:25.034 sys 0m0.637s 00:06:25.034 18:52:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:25.034 18:52:41 -- common/autotest_common.sh@10 -- # set +x 00:06:25.034 ************************************ 00:06:25.034 END TEST locking_app_on_locked_coremask 00:06:25.034 ************************************ 00:06:25.034 18:52:41 -- event/cpu_locks.sh@171 -- # run_test locking_overlapped_coremask locking_overlapped_coremask 00:06:25.034 18:52:41 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:25.034 18:52:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:25.034 18:52:41 -- common/autotest_common.sh@10 -- # set +x 00:06:25.034 ************************************ 00:06:25.034 START TEST locking_overlapped_coremask 00:06:25.034 ************************************ 00:06:25.034 18:52:41 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask 00:06:25.034 18:52:41 -- event/cpu_locks.sh@132 -- # spdk_tgt_pid=2932557 00:06:25.034 18:52:41 -- event/cpu_locks.sh@133 -- # waitforlisten 2932557 /var/tmp/spdk.sock 00:06:25.034 18:52:41 -- event/cpu_locks.sh@131 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 00:06:25.034 18:52:41 -- common/autotest_common.sh@829 -- # '[' -z 2932557 ']' 00:06:25.034 18:52:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:25.034 18:52:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:25.034 18:52:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:25.034 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:25.034 18:52:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:25.034 18:52:41 -- common/autotest_common.sh@10 -- # set +x 00:06:25.034 [2024-11-26 18:52:41.760694] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:25.034 [2024-11-26 18:52:41.760747] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2932557 ] 00:06:25.034 EAL: No free 2048 kB hugepages reported on node 1 00:06:25.034 [2024-11-26 18:52:41.815730] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:25.034 [2024-11-26 18:52:41.854152] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:25.034 [2024-11-26 18:52:41.854314] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:25.034 [2024-11-26 18:52:41.854395] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:25.034 [2024-11-26 18:52:41.854396] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:25.971 18:52:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:25.971 18:52:42 -- common/autotest_common.sh@862 -- # return 0 00:06:25.971 18:52:42 -- event/cpu_locks.sh@135 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock 00:06:25.971 18:52:42 -- event/cpu_locks.sh@136 -- # spdk_tgt_pid2=2932770 00:06:25.971 18:52:42 -- event/cpu_locks.sh@137 -- # NOT waitforlisten 2932770 /var/tmp/spdk2.sock 00:06:25.971 18:52:42 -- common/autotest_common.sh@650 -- # local es=0 00:06:25.971 18:52:42 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 2932770 /var/tmp/spdk2.sock 00:06:25.971 18:52:42 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:06:25.971 18:52:42 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:25.971 18:52:42 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:06:25.971 18:52:42 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:25.971 18:52:42 -- common/autotest_common.sh@653 -- # waitforlisten 2932770 /var/tmp/spdk2.sock 00:06:25.971 18:52:42 -- common/autotest_common.sh@829 -- # '[' -z 2932770 ']' 00:06:25.971 18:52:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:25.971 18:52:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:25.971 18:52:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:25.971 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:25.971 18:52:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:25.971 18:52:42 -- common/autotest_common.sh@10 -- # set +x 00:06:25.971 [2024-11-26 18:52:42.611194] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:25.971 [2024-11-26 18:52:42.611241] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2932770 ] 00:06:25.971 EAL: No free 2048 kB hugepages reported on node 1 00:06:25.971 [2024-11-26 18:52:42.688207] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 2932557 has claimed it. 00:06:25.971 [2024-11-26 18:52:42.688246] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:06:26.537 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (2932770) - No such process 00:06:26.537 ERROR: process (pid: 2932770) is no longer running 00:06:26.537 18:52:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:26.537 18:52:43 -- common/autotest_common.sh@862 -- # return 1 00:06:26.537 18:52:43 -- common/autotest_common.sh@653 -- # es=1 00:06:26.537 18:52:43 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:26.537 18:52:43 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:26.537 18:52:43 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:26.537 18:52:43 -- event/cpu_locks.sh@139 -- # check_remaining_locks 00:06:26.537 18:52:43 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:06:26.537 18:52:43 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:06:26.537 18:52:43 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:06:26.537 18:52:43 -- event/cpu_locks.sh@141 -- # killprocess 2932557 00:06:26.537 18:52:43 -- common/autotest_common.sh@936 -- # '[' -z 2932557 ']' 00:06:26.537 18:52:43 -- common/autotest_common.sh@940 -- # kill -0 2932557 00:06:26.537 18:52:43 -- common/autotest_common.sh@941 -- # uname 00:06:26.537 18:52:43 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:26.537 18:52:43 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2932557 00:06:26.537 18:52:43 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:26.537 18:52:43 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:26.537 18:52:43 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2932557' 00:06:26.537 killing process with pid 2932557 00:06:26.537 18:52:43 -- common/autotest_common.sh@955 -- # kill 2932557 00:06:26.537 18:52:43 -- common/autotest_common.sh@960 -- # wait 2932557 00:06:26.796 00:06:26.796 real 0m1.905s 00:06:26.796 user 0m5.509s 00:06:26.796 sys 0m0.392s 00:06:26.796 18:52:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:26.796 18:52:43 -- common/autotest_common.sh@10 -- # set +x 00:06:26.796 ************************************ 00:06:26.796 END TEST locking_overlapped_coremask 00:06:26.796 ************************************ 00:06:26.797 18:52:43 -- event/cpu_locks.sh@172 -- # run_test locking_overlapped_coremask_via_rpc locking_overlapped_coremask_via_rpc 00:06:26.797 18:52:43 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:26.797 18:52:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:26.797 18:52:43 -- common/autotest_common.sh@10 -- # set +x 00:06:26.797 ************************************ 00:06:26.797 START TEST locking_overlapped_coremask_via_rpc 00:06:26.797 ************************************ 00:06:26.797 18:52:43 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask_via_rpc 00:06:26.797 18:52:43 -- event/cpu_locks.sh@148 -- # spdk_tgt_pid=2932856 00:06:26.797 18:52:43 -- event/cpu_locks.sh@149 -- # waitforlisten 2932856 /var/tmp/spdk.sock 00:06:26.797 18:52:43 -- event/cpu_locks.sh@147 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 --disable-cpumask-locks 00:06:26.797 18:52:43 -- common/autotest_common.sh@829 -- # '[' -z 2932856 ']' 00:06:26.797 18:52:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:26.797 18:52:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:26.797 18:52:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:26.797 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:26.797 18:52:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:26.797 18:52:43 -- common/autotest_common.sh@10 -- # set +x 00:06:26.797 [2024-11-26 18:52:43.706322] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:26.797 [2024-11-26 18:52:43.706375] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2932856 ] 00:06:27.056 EAL: No free 2048 kB hugepages reported on node 1 00:06:27.056 [2024-11-26 18:52:43.762349] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:27.056 [2024-11-26 18:52:43.762377] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:27.056 [2024-11-26 18:52:43.801435] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:27.056 [2024-11-26 18:52:43.801597] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:27.056 [2024-11-26 18:52:43.801618] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:27.056 [2024-11-26 18:52:43.801619] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:27.622 18:52:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:27.622 18:52:44 -- common/autotest_common.sh@862 -- # return 0 00:06:27.622 18:52:44 -- event/cpu_locks.sh@151 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock --disable-cpumask-locks 00:06:27.622 18:52:44 -- event/cpu_locks.sh@152 -- # spdk_tgt_pid2=2933069 00:06:27.622 18:52:44 -- event/cpu_locks.sh@153 -- # waitforlisten 2933069 /var/tmp/spdk2.sock 00:06:27.622 18:52:44 -- common/autotest_common.sh@829 -- # '[' -z 2933069 ']' 00:06:27.622 18:52:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:27.622 18:52:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:27.622 18:52:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:27.622 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:27.622 18:52:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:27.622 18:52:44 -- common/autotest_common.sh@10 -- # set +x 00:06:27.880 [2024-11-26 18:52:44.550168] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:27.881 [2024-11-26 18:52:44.550216] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2933069 ] 00:06:27.881 EAL: No free 2048 kB hugepages reported on node 1 00:06:27.881 [2024-11-26 18:52:44.627289] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:27.881 [2024-11-26 18:52:44.627318] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:27.881 [2024-11-26 18:52:44.705827] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:27.881 [2024-11-26 18:52:44.706011] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:27.881 [2024-11-26 18:52:44.709988] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:27.881 [2024-11-26 18:52:44.709989] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:06:28.812 18:52:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:28.812 18:52:45 -- common/autotest_common.sh@862 -- # return 0 00:06:28.812 18:52:45 -- event/cpu_locks.sh@155 -- # rpc_cmd framework_enable_cpumask_locks 00:06:28.812 18:52:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:28.812 18:52:45 -- common/autotest_common.sh@10 -- # set +x 00:06:28.812 18:52:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:28.812 18:52:45 -- event/cpu_locks.sh@156 -- # NOT rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:06:28.812 18:52:45 -- common/autotest_common.sh@650 -- # local es=0 00:06:28.812 18:52:45 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:06:28.812 18:52:45 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:06:28.812 18:52:45 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:28.812 18:52:45 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:06:28.812 18:52:45 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:28.812 18:52:45 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:06:28.812 18:52:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:28.812 18:52:45 -- common/autotest_common.sh@10 -- # set +x 00:06:28.812 [2024-11-26 18:52:45.407016] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 2932856 has claimed it. 00:06:28.812 request: 00:06:28.812 { 00:06:28.812 "method": "framework_enable_cpumask_locks", 00:06:28.812 "req_id": 1 00:06:28.812 } 00:06:28.812 Got JSON-RPC error response 00:06:28.812 response: 00:06:28.812 { 00:06:28.812 "code": -32603, 00:06:28.813 "message": "Failed to claim CPU core: 2" 00:06:28.813 } 00:06:28.813 18:52:45 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:06:28.813 18:52:45 -- common/autotest_common.sh@653 -- # es=1 00:06:28.813 18:52:45 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:28.813 18:52:45 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:28.813 18:52:45 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:28.813 18:52:45 -- event/cpu_locks.sh@158 -- # waitforlisten 2932856 /var/tmp/spdk.sock 00:06:28.813 18:52:45 -- common/autotest_common.sh@829 -- # '[' -z 2932856 ']' 00:06:28.813 18:52:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:28.813 18:52:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:28.813 18:52:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:28.813 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:28.813 18:52:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:28.813 18:52:45 -- common/autotest_common.sh@10 -- # set +x 00:06:28.813 18:52:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:28.813 18:52:45 -- common/autotest_common.sh@862 -- # return 0 00:06:28.813 18:52:45 -- event/cpu_locks.sh@159 -- # waitforlisten 2933069 /var/tmp/spdk2.sock 00:06:28.813 18:52:45 -- common/autotest_common.sh@829 -- # '[' -z 2933069 ']' 00:06:28.813 18:52:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:28.813 18:52:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:28.813 18:52:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:28.813 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:28.813 18:52:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:28.813 18:52:45 -- common/autotest_common.sh@10 -- # set +x 00:06:29.070 18:52:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:29.070 18:52:45 -- common/autotest_common.sh@862 -- # return 0 00:06:29.070 18:52:45 -- event/cpu_locks.sh@161 -- # check_remaining_locks 00:06:29.071 18:52:45 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:06:29.071 18:52:45 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:06:29.071 18:52:45 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:06:29.071 00:06:29.071 real 0m2.141s 00:06:29.071 user 0m0.913s 00:06:29.071 sys 0m0.153s 00:06:29.071 18:52:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:29.071 18:52:45 -- common/autotest_common.sh@10 -- # set +x 00:06:29.071 ************************************ 00:06:29.071 END TEST locking_overlapped_coremask_via_rpc 00:06:29.071 ************************************ 00:06:29.071 18:52:45 -- event/cpu_locks.sh@174 -- # cleanup 00:06:29.071 18:52:45 -- event/cpu_locks.sh@15 -- # [[ -z 2932856 ]] 00:06:29.071 18:52:45 -- event/cpu_locks.sh@15 -- # killprocess 2932856 00:06:29.071 18:52:45 -- common/autotest_common.sh@936 -- # '[' -z 2932856 ']' 00:06:29.071 18:52:45 -- common/autotest_common.sh@940 -- # kill -0 2932856 00:06:29.071 18:52:45 -- common/autotest_common.sh@941 -- # uname 00:06:29.071 18:52:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:29.071 18:52:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2932856 00:06:29.071 18:52:45 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:29.071 18:52:45 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:29.071 18:52:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2932856' 00:06:29.071 killing process with pid 2932856 00:06:29.071 18:52:45 -- common/autotest_common.sh@955 -- # kill 2932856 00:06:29.071 18:52:45 -- common/autotest_common.sh@960 -- # wait 2932856 00:06:29.329 18:52:46 -- event/cpu_locks.sh@16 -- # [[ -z 2933069 ]] 00:06:29.329 18:52:46 -- event/cpu_locks.sh@16 -- # killprocess 2933069 00:06:29.329 18:52:46 -- common/autotest_common.sh@936 -- # '[' -z 2933069 ']' 00:06:29.329 18:52:46 -- common/autotest_common.sh@940 -- # kill -0 2933069 00:06:29.329 18:52:46 -- common/autotest_common.sh@941 -- # uname 00:06:29.329 18:52:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:29.329 18:52:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2933069 00:06:29.329 18:52:46 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:06:29.329 18:52:46 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:06:29.329 18:52:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2933069' 00:06:29.329 killing process with pid 2933069 00:06:29.329 18:52:46 -- common/autotest_common.sh@955 -- # kill 2933069 00:06:29.587 18:52:46 -- common/autotest_common.sh@960 -- # wait 2933069 00:06:29.847 18:52:46 -- event/cpu_locks.sh@18 -- # rm -f 00:06:29.847 18:52:46 -- event/cpu_locks.sh@1 -- # cleanup 00:06:29.847 18:52:46 -- event/cpu_locks.sh@15 -- # [[ -z 2932856 ]] 00:06:29.847 18:52:46 -- event/cpu_locks.sh@15 -- # killprocess 2932856 00:06:29.847 18:52:46 -- common/autotest_common.sh@936 -- # '[' -z 2932856 ']' 00:06:29.847 18:52:46 -- common/autotest_common.sh@940 -- # kill -0 2932856 00:06:29.847 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (2932856) - No such process 00:06:29.847 18:52:46 -- common/autotest_common.sh@963 -- # echo 'Process with pid 2932856 is not found' 00:06:29.847 Process with pid 2932856 is not found 00:06:29.847 18:52:46 -- event/cpu_locks.sh@16 -- # [[ -z 2933069 ]] 00:06:29.847 18:52:46 -- event/cpu_locks.sh@16 -- # killprocess 2933069 00:06:29.847 18:52:46 -- common/autotest_common.sh@936 -- # '[' -z 2933069 ']' 00:06:29.847 18:52:46 -- common/autotest_common.sh@940 -- # kill -0 2933069 00:06:29.847 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (2933069) - No such process 00:06:29.847 18:52:46 -- common/autotest_common.sh@963 -- # echo 'Process with pid 2933069 is not found' 00:06:29.847 Process with pid 2933069 is not found 00:06:29.847 18:52:46 -- event/cpu_locks.sh@18 -- # rm -f 00:06:29.847 00:06:29.847 real 0m16.926s 00:06:29.848 user 0m30.012s 00:06:29.848 sys 0m4.802s 00:06:29.848 18:52:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:29.848 18:52:46 -- common/autotest_common.sh@10 -- # set +x 00:06:29.848 ************************************ 00:06:29.848 END TEST cpu_locks 00:06:29.848 ************************************ 00:06:29.848 00:06:29.848 real 0m41.699s 00:06:29.848 user 1m20.053s 00:06:29.848 sys 0m8.058s 00:06:29.848 18:52:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:29.848 18:52:46 -- common/autotest_common.sh@10 -- # set +x 00:06:29.848 ************************************ 00:06:29.848 END TEST event 00:06:29.848 ************************************ 00:06:29.848 18:52:46 -- spdk/autotest.sh@175 -- # run_test thread /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:06:29.848 18:52:46 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:29.848 18:52:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:29.848 18:52:46 -- common/autotest_common.sh@10 -- # set +x 00:06:29.848 ************************************ 00:06:29.848 START TEST thread 00:06:29.848 ************************************ 00:06:29.848 18:52:46 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:06:29.848 * Looking for test storage... 00:06:29.848 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread 00:06:29.848 18:52:46 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:29.848 18:52:46 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:29.848 18:52:46 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:30.107 18:52:46 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:30.107 18:52:46 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:30.107 18:52:46 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:30.107 18:52:46 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:30.107 18:52:46 -- scripts/common.sh@335 -- # IFS=.-: 00:06:30.107 18:52:46 -- scripts/common.sh@335 -- # read -ra ver1 00:06:30.107 18:52:46 -- scripts/common.sh@336 -- # IFS=.-: 00:06:30.107 18:52:46 -- scripts/common.sh@336 -- # read -ra ver2 00:06:30.107 18:52:46 -- scripts/common.sh@337 -- # local 'op=<' 00:06:30.107 18:52:46 -- scripts/common.sh@339 -- # ver1_l=2 00:06:30.107 18:52:46 -- scripts/common.sh@340 -- # ver2_l=1 00:06:30.107 18:52:46 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:30.107 18:52:46 -- scripts/common.sh@343 -- # case "$op" in 00:06:30.107 18:52:46 -- scripts/common.sh@344 -- # : 1 00:06:30.107 18:52:46 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:30.107 18:52:46 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:30.107 18:52:46 -- scripts/common.sh@364 -- # decimal 1 00:06:30.107 18:52:46 -- scripts/common.sh@352 -- # local d=1 00:06:30.107 18:52:46 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:30.107 18:52:46 -- scripts/common.sh@354 -- # echo 1 00:06:30.107 18:52:46 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:30.107 18:52:46 -- scripts/common.sh@365 -- # decimal 2 00:06:30.107 18:52:46 -- scripts/common.sh@352 -- # local d=2 00:06:30.107 18:52:46 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:30.107 18:52:46 -- scripts/common.sh@354 -- # echo 2 00:06:30.107 18:52:46 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:30.107 18:52:46 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:30.107 18:52:46 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:30.107 18:52:46 -- scripts/common.sh@367 -- # return 0 00:06:30.107 18:52:46 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:30.107 18:52:46 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:30.107 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:30.107 --rc genhtml_branch_coverage=1 00:06:30.107 --rc genhtml_function_coverage=1 00:06:30.107 --rc genhtml_legend=1 00:06:30.107 --rc geninfo_all_blocks=1 00:06:30.107 --rc geninfo_unexecuted_blocks=1 00:06:30.107 00:06:30.107 ' 00:06:30.107 18:52:46 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:30.107 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:30.107 --rc genhtml_branch_coverage=1 00:06:30.107 --rc genhtml_function_coverage=1 00:06:30.107 --rc genhtml_legend=1 00:06:30.107 --rc geninfo_all_blocks=1 00:06:30.107 --rc geninfo_unexecuted_blocks=1 00:06:30.107 00:06:30.107 ' 00:06:30.107 18:52:46 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:30.107 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:30.107 --rc genhtml_branch_coverage=1 00:06:30.107 --rc genhtml_function_coverage=1 00:06:30.107 --rc genhtml_legend=1 00:06:30.107 --rc geninfo_all_blocks=1 00:06:30.107 --rc geninfo_unexecuted_blocks=1 00:06:30.107 00:06:30.107 ' 00:06:30.107 18:52:46 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:30.107 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:30.107 --rc genhtml_branch_coverage=1 00:06:30.107 --rc genhtml_function_coverage=1 00:06:30.107 --rc genhtml_legend=1 00:06:30.107 --rc geninfo_all_blocks=1 00:06:30.107 --rc geninfo_unexecuted_blocks=1 00:06:30.107 00:06:30.107 ' 00:06:30.107 18:52:46 -- thread/thread.sh@11 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:06:30.107 18:52:46 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:06:30.107 18:52:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:30.107 18:52:46 -- common/autotest_common.sh@10 -- # set +x 00:06:30.107 ************************************ 00:06:30.107 START TEST thread_poller_perf 00:06:30.107 ************************************ 00:06:30.107 18:52:46 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:06:30.107 [2024-11-26 18:52:46.839017] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:30.107 [2024-11-26 18:52:46.839093] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2933631 ] 00:06:30.107 EAL: No free 2048 kB hugepages reported on node 1 00:06:30.107 [2024-11-26 18:52:46.898000] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:30.107 [2024-11-26 18:52:46.935288] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:30.107 Running 1000 pollers for 1 seconds with 1 microseconds period. 00:06:31.486 [2024-11-26T17:52:48.413Z] ====================================== 00:06:31.486 [2024-11-26T17:52:48.413Z] busy:2306216010 (cyc) 00:06:31.486 [2024-11-26T17:52:48.413Z] total_run_count: 391000 00:06:31.486 [2024-11-26T17:52:48.413Z] tsc_hz: 2300000000 (cyc) 00:06:31.486 [2024-11-26T17:52:48.413Z] ====================================== 00:06:31.486 [2024-11-26T17:52:48.413Z] poller_cost: 5898 (cyc), 2564 (nsec) 00:06:31.486 00:06:31.486 real 0m1.183s 00:06:31.486 user 0m1.111s 00:06:31.486 sys 0m0.067s 00:06:31.486 18:52:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:31.486 18:52:48 -- common/autotest_common.sh@10 -- # set +x 00:06:31.486 ************************************ 00:06:31.486 END TEST thread_poller_perf 00:06:31.486 ************************************ 00:06:31.486 18:52:48 -- thread/thread.sh@12 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:06:31.486 18:52:48 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:06:31.486 18:52:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:31.486 18:52:48 -- common/autotest_common.sh@10 -- # set +x 00:06:31.486 ************************************ 00:06:31.486 START TEST thread_poller_perf 00:06:31.486 ************************************ 00:06:31.486 18:52:48 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:06:31.486 [2024-11-26 18:52:48.054760] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:31.486 [2024-11-26 18:52:48.054841] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2933840 ] 00:06:31.486 EAL: No free 2048 kB hugepages reported on node 1 00:06:31.486 [2024-11-26 18:52:48.112349] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:31.486 [2024-11-26 18:52:48.149310] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:31.486 Running 1000 pollers for 1 seconds with 0 microseconds period. 00:06:32.421 [2024-11-26T17:52:49.348Z] ====================================== 00:06:32.421 [2024-11-26T17:52:49.348Z] busy:2301978372 (cyc) 00:06:32.421 [2024-11-26T17:52:49.348Z] total_run_count: 5536000 00:06:32.421 [2024-11-26T17:52:49.348Z] tsc_hz: 2300000000 (cyc) 00:06:32.421 [2024-11-26T17:52:49.348Z] ====================================== 00:06:32.421 [2024-11-26T17:52:49.348Z] poller_cost: 415 (cyc), 180 (nsec) 00:06:32.421 00:06:32.421 real 0m1.173s 00:06:32.421 user 0m1.094s 00:06:32.421 sys 0m0.075s 00:06:32.421 18:52:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:32.421 18:52:49 -- common/autotest_common.sh@10 -- # set +x 00:06:32.421 ************************************ 00:06:32.421 END TEST thread_poller_perf 00:06:32.421 ************************************ 00:06:32.421 18:52:49 -- thread/thread.sh@17 -- # [[ y != \y ]] 00:06:32.421 00:06:32.421 real 0m2.595s 00:06:32.421 user 0m2.335s 00:06:32.421 sys 0m0.276s 00:06:32.421 18:52:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:32.421 18:52:49 -- common/autotest_common.sh@10 -- # set +x 00:06:32.421 ************************************ 00:06:32.421 END TEST thread 00:06:32.421 ************************************ 00:06:32.421 18:52:49 -- spdk/autotest.sh@176 -- # run_test accel /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:06:32.421 18:52:49 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:32.421 18:52:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:32.421 18:52:49 -- common/autotest_common.sh@10 -- # set +x 00:06:32.421 ************************************ 00:06:32.421 START TEST accel 00:06:32.421 ************************************ 00:06:32.421 18:52:49 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:06:32.680 * Looking for test storage... 00:06:32.680 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:06:32.680 18:52:49 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:32.680 18:52:49 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:32.680 18:52:49 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:32.680 18:52:49 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:32.680 18:52:49 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:32.680 18:52:49 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:32.680 18:52:49 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:32.680 18:52:49 -- scripts/common.sh@335 -- # IFS=.-: 00:06:32.680 18:52:49 -- scripts/common.sh@335 -- # read -ra ver1 00:06:32.680 18:52:49 -- scripts/common.sh@336 -- # IFS=.-: 00:06:32.680 18:52:49 -- scripts/common.sh@336 -- # read -ra ver2 00:06:32.680 18:52:49 -- scripts/common.sh@337 -- # local 'op=<' 00:06:32.680 18:52:49 -- scripts/common.sh@339 -- # ver1_l=2 00:06:32.680 18:52:49 -- scripts/common.sh@340 -- # ver2_l=1 00:06:32.680 18:52:49 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:32.680 18:52:49 -- scripts/common.sh@343 -- # case "$op" in 00:06:32.680 18:52:49 -- scripts/common.sh@344 -- # : 1 00:06:32.680 18:52:49 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:32.680 18:52:49 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:32.680 18:52:49 -- scripts/common.sh@364 -- # decimal 1 00:06:32.680 18:52:49 -- scripts/common.sh@352 -- # local d=1 00:06:32.680 18:52:49 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:32.680 18:52:49 -- scripts/common.sh@354 -- # echo 1 00:06:32.680 18:52:49 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:32.680 18:52:49 -- scripts/common.sh@365 -- # decimal 2 00:06:32.680 18:52:49 -- scripts/common.sh@352 -- # local d=2 00:06:32.680 18:52:49 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:32.680 18:52:49 -- scripts/common.sh@354 -- # echo 2 00:06:32.680 18:52:49 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:32.680 18:52:49 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:32.680 18:52:49 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:32.680 18:52:49 -- scripts/common.sh@367 -- # return 0 00:06:32.680 18:52:49 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:32.680 18:52:49 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:32.680 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:32.680 --rc genhtml_branch_coverage=1 00:06:32.680 --rc genhtml_function_coverage=1 00:06:32.680 --rc genhtml_legend=1 00:06:32.680 --rc geninfo_all_blocks=1 00:06:32.680 --rc geninfo_unexecuted_blocks=1 00:06:32.680 00:06:32.680 ' 00:06:32.680 18:52:49 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:32.680 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:32.680 --rc genhtml_branch_coverage=1 00:06:32.680 --rc genhtml_function_coverage=1 00:06:32.680 --rc genhtml_legend=1 00:06:32.680 --rc geninfo_all_blocks=1 00:06:32.680 --rc geninfo_unexecuted_blocks=1 00:06:32.680 00:06:32.680 ' 00:06:32.680 18:52:49 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:32.680 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:32.680 --rc genhtml_branch_coverage=1 00:06:32.680 --rc genhtml_function_coverage=1 00:06:32.680 --rc genhtml_legend=1 00:06:32.680 --rc geninfo_all_blocks=1 00:06:32.680 --rc geninfo_unexecuted_blocks=1 00:06:32.680 00:06:32.680 ' 00:06:32.680 18:52:49 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:32.680 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:32.680 --rc genhtml_branch_coverage=1 00:06:32.680 --rc genhtml_function_coverage=1 00:06:32.680 --rc genhtml_legend=1 00:06:32.680 --rc geninfo_all_blocks=1 00:06:32.680 --rc geninfo_unexecuted_blocks=1 00:06:32.680 00:06:32.680 ' 00:06:32.680 18:52:49 -- accel/accel.sh@73 -- # declare -A expected_opcs 00:06:32.680 18:52:49 -- accel/accel.sh@74 -- # get_expected_opcs 00:06:32.680 18:52:49 -- accel/accel.sh@57 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:06:32.680 18:52:49 -- accel/accel.sh@59 -- # spdk_tgt_pid=2934170 00:06:32.680 18:52:49 -- accel/accel.sh@60 -- # waitforlisten 2934170 00:06:32.680 18:52:49 -- common/autotest_common.sh@829 -- # '[' -z 2934170 ']' 00:06:32.680 18:52:49 -- accel/accel.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -c /dev/fd/63 00:06:32.680 18:52:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:32.680 18:52:49 -- accel/accel.sh@58 -- # build_accel_config 00:06:32.680 18:52:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:32.680 18:52:49 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:32.680 18:52:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:32.680 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:32.680 18:52:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:32.680 18:52:49 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:32.680 18:52:49 -- common/autotest_common.sh@10 -- # set +x 00:06:32.680 18:52:49 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:32.680 18:52:49 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:32.680 18:52:49 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:32.680 18:52:49 -- accel/accel.sh@41 -- # local IFS=, 00:06:32.680 18:52:49 -- accel/accel.sh@42 -- # jq -r . 00:06:32.680 [2024-11-26 18:52:49.501477] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:32.680 [2024-11-26 18:52:49.501531] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2934170 ] 00:06:32.680 EAL: No free 2048 kB hugepages reported on node 1 00:06:32.680 [2024-11-26 18:52:49.557173] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:32.680 [2024-11-26 18:52:49.594153] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:32.680 [2024-11-26 18:52:49.594274] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:33.614 18:52:50 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:33.614 18:52:50 -- common/autotest_common.sh@862 -- # return 0 00:06:33.614 18:52:50 -- accel/accel.sh@62 -- # exp_opcs=($($rpc_py accel_get_opc_assignments | jq -r ". | to_entries | map(\"\(.key)=\(.value)\") | .[]")) 00:06:33.614 18:52:50 -- accel/accel.sh@62 -- # rpc_cmd accel_get_opc_assignments 00:06:33.614 18:52:50 -- accel/accel.sh@62 -- # jq -r '. | to_entries | map("\(.key)=\(.value)") | .[]' 00:06:33.614 18:52:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:33.614 18:52:50 -- common/autotest_common.sh@10 -- # set +x 00:06:33.614 18:52:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:33.614 18:52:50 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:33.614 18:52:50 -- accel/accel.sh@64 -- # IFS== 00:06:33.614 18:52:50 -- accel/accel.sh@64 -- # read -r opc module 00:06:33.614 18:52:50 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:33.614 18:52:50 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:33.614 18:52:50 -- accel/accel.sh@64 -- # IFS== 00:06:33.614 18:52:50 -- accel/accel.sh@64 -- # read -r opc module 00:06:33.614 18:52:50 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:33.614 18:52:50 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:33.614 18:52:50 -- accel/accel.sh@64 -- # IFS== 00:06:33.614 18:52:50 -- accel/accel.sh@64 -- # read -r opc module 00:06:33.614 18:52:50 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:33.614 18:52:50 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:33.614 18:52:50 -- accel/accel.sh@64 -- # IFS== 00:06:33.614 18:52:50 -- accel/accel.sh@64 -- # read -r opc module 00:06:33.614 18:52:50 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:33.614 18:52:50 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:33.614 18:52:50 -- accel/accel.sh@64 -- # IFS== 00:06:33.614 18:52:50 -- accel/accel.sh@64 -- # read -r opc module 00:06:33.614 18:52:50 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:33.614 18:52:50 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:33.614 18:52:50 -- accel/accel.sh@64 -- # IFS== 00:06:33.614 18:52:50 -- accel/accel.sh@64 -- # read -r opc module 00:06:33.614 18:52:50 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:33.614 18:52:50 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:33.614 18:52:50 -- accel/accel.sh@64 -- # IFS== 00:06:33.614 18:52:50 -- accel/accel.sh@64 -- # read -r opc module 00:06:33.614 18:52:50 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:33.614 18:52:50 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:33.614 18:52:50 -- accel/accel.sh@64 -- # IFS== 00:06:33.614 18:52:50 -- accel/accel.sh@64 -- # read -r opc module 00:06:33.614 18:52:50 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:33.614 18:52:50 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:33.614 18:52:50 -- accel/accel.sh@64 -- # IFS== 00:06:33.614 18:52:50 -- accel/accel.sh@64 -- # read -r opc module 00:06:33.614 18:52:50 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:33.614 18:52:50 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:33.614 18:52:50 -- accel/accel.sh@64 -- # IFS== 00:06:33.614 18:52:50 -- accel/accel.sh@64 -- # read -r opc module 00:06:33.614 18:52:50 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:33.614 18:52:50 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:33.614 18:52:50 -- accel/accel.sh@64 -- # IFS== 00:06:33.614 18:52:50 -- accel/accel.sh@64 -- # read -r opc module 00:06:33.614 18:52:50 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:33.614 18:52:50 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:33.614 18:52:50 -- accel/accel.sh@64 -- # IFS== 00:06:33.614 18:52:50 -- accel/accel.sh@64 -- # read -r opc module 00:06:33.614 18:52:50 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:33.614 18:52:50 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:33.614 18:52:50 -- accel/accel.sh@64 -- # IFS== 00:06:33.614 18:52:50 -- accel/accel.sh@64 -- # read -r opc module 00:06:33.614 18:52:50 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:33.614 18:52:50 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:33.614 18:52:50 -- accel/accel.sh@64 -- # IFS== 00:06:33.614 18:52:50 -- accel/accel.sh@64 -- # read -r opc module 00:06:33.614 18:52:50 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:33.614 18:52:50 -- accel/accel.sh@67 -- # killprocess 2934170 00:06:33.614 18:52:50 -- common/autotest_common.sh@936 -- # '[' -z 2934170 ']' 00:06:33.614 18:52:50 -- common/autotest_common.sh@940 -- # kill -0 2934170 00:06:33.614 18:52:50 -- common/autotest_common.sh@941 -- # uname 00:06:33.614 18:52:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:33.614 18:52:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2934170 00:06:33.614 18:52:50 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:33.614 18:52:50 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:33.614 18:52:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2934170' 00:06:33.614 killing process with pid 2934170 00:06:33.614 18:52:50 -- common/autotest_common.sh@955 -- # kill 2934170 00:06:33.614 18:52:50 -- common/autotest_common.sh@960 -- # wait 2934170 00:06:33.871 18:52:50 -- accel/accel.sh@68 -- # trap - ERR 00:06:33.871 18:52:50 -- accel/accel.sh@81 -- # run_test accel_help accel_perf -h 00:06:33.871 18:52:50 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:33.871 18:52:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:33.871 18:52:50 -- common/autotest_common.sh@10 -- # set +x 00:06:33.871 18:52:50 -- common/autotest_common.sh@1114 -- # accel_perf -h 00:06:33.871 18:52:50 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -h 00:06:33.871 18:52:50 -- accel/accel.sh@12 -- # build_accel_config 00:06:33.871 18:52:50 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:33.871 18:52:50 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:33.871 18:52:50 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:33.871 18:52:50 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:33.871 18:52:50 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:33.871 18:52:50 -- accel/accel.sh@41 -- # local IFS=, 00:06:33.871 18:52:50 -- accel/accel.sh@42 -- # jq -r . 00:06:33.871 18:52:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:33.871 18:52:50 -- common/autotest_common.sh@10 -- # set +x 00:06:33.871 18:52:50 -- accel/accel.sh@83 -- # run_test accel_missing_filename NOT accel_perf -t 1 -w compress 00:06:33.871 18:52:50 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:33.871 18:52:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:33.871 18:52:50 -- common/autotest_common.sh@10 -- # set +x 00:06:33.871 ************************************ 00:06:33.871 START TEST accel_missing_filename 00:06:33.871 ************************************ 00:06:33.871 18:52:50 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress 00:06:33.871 18:52:50 -- common/autotest_common.sh@650 -- # local es=0 00:06:33.871 18:52:50 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress 00:06:33.871 18:52:50 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:06:33.871 18:52:50 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:33.871 18:52:50 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:06:33.871 18:52:50 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:33.871 18:52:50 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress 00:06:33.871 18:52:50 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress 00:06:33.871 18:52:50 -- accel/accel.sh@12 -- # build_accel_config 00:06:33.871 18:52:50 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:33.871 18:52:50 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:33.871 18:52:50 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:33.871 18:52:50 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:33.871 18:52:50 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:33.871 18:52:50 -- accel/accel.sh@41 -- # local IFS=, 00:06:33.871 18:52:50 -- accel/accel.sh@42 -- # jq -r . 00:06:34.128 [2024-11-26 18:52:50.806835] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:34.128 [2024-11-26 18:52:50.806918] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2934402 ] 00:06:34.128 EAL: No free 2048 kB hugepages reported on node 1 00:06:34.128 [2024-11-26 18:52:50.865105] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:34.128 [2024-11-26 18:52:50.902551] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:34.128 [2024-11-26 18:52:50.943768] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:06:34.128 [2024-11-26 18:52:51.003484] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:06:34.385 A filename is required. 00:06:34.385 18:52:51 -- common/autotest_common.sh@653 -- # es=234 00:06:34.385 18:52:51 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:34.385 18:52:51 -- common/autotest_common.sh@662 -- # es=106 00:06:34.385 18:52:51 -- common/autotest_common.sh@663 -- # case "$es" in 00:06:34.385 18:52:51 -- common/autotest_common.sh@670 -- # es=1 00:06:34.385 18:52:51 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:34.385 00:06:34.385 real 0m0.289s 00:06:34.385 user 0m0.212s 00:06:34.385 sys 0m0.116s 00:06:34.385 18:52:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:34.385 18:52:51 -- common/autotest_common.sh@10 -- # set +x 00:06:34.385 ************************************ 00:06:34.385 END TEST accel_missing_filename 00:06:34.385 ************************************ 00:06:34.385 18:52:51 -- accel/accel.sh@85 -- # run_test accel_compress_verify NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:34.385 18:52:51 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:06:34.385 18:52:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:34.385 18:52:51 -- common/autotest_common.sh@10 -- # set +x 00:06:34.385 ************************************ 00:06:34.385 START TEST accel_compress_verify 00:06:34.385 ************************************ 00:06:34.385 18:52:51 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:34.385 18:52:51 -- common/autotest_common.sh@650 -- # local es=0 00:06:34.385 18:52:51 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:34.385 18:52:51 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:06:34.385 18:52:51 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:34.385 18:52:51 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:06:34.385 18:52:51 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:34.385 18:52:51 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:34.385 18:52:51 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:34.385 18:52:51 -- accel/accel.sh@12 -- # build_accel_config 00:06:34.385 18:52:51 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:34.385 18:52:51 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:34.385 18:52:51 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:34.385 18:52:51 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:34.385 18:52:51 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:34.385 18:52:51 -- accel/accel.sh@41 -- # local IFS=, 00:06:34.385 18:52:51 -- accel/accel.sh@42 -- # jq -r . 00:06:34.385 [2024-11-26 18:52:51.127208] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:34.385 [2024-11-26 18:52:51.127286] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2934477 ] 00:06:34.385 EAL: No free 2048 kB hugepages reported on node 1 00:06:34.385 [2024-11-26 18:52:51.183623] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:34.385 [2024-11-26 18:52:51.220863] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:34.385 [2024-11-26 18:52:51.261578] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:06:34.642 [2024-11-26 18:52:51.321372] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:06:34.642 00:06:34.642 Compression does not support the verify option, aborting. 00:06:34.642 18:52:51 -- common/autotest_common.sh@653 -- # es=161 00:06:34.642 18:52:51 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:34.642 18:52:51 -- common/autotest_common.sh@662 -- # es=33 00:06:34.642 18:52:51 -- common/autotest_common.sh@663 -- # case "$es" in 00:06:34.642 18:52:51 -- common/autotest_common.sh@670 -- # es=1 00:06:34.642 18:52:51 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:34.642 00:06:34.642 real 0m0.283s 00:06:34.642 user 0m0.211s 00:06:34.642 sys 0m0.112s 00:06:34.642 18:52:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:34.642 18:52:51 -- common/autotest_common.sh@10 -- # set +x 00:06:34.642 ************************************ 00:06:34.642 END TEST accel_compress_verify 00:06:34.642 ************************************ 00:06:34.642 18:52:51 -- accel/accel.sh@87 -- # run_test accel_wrong_workload NOT accel_perf -t 1 -w foobar 00:06:34.642 18:52:51 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:34.643 18:52:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:34.643 18:52:51 -- common/autotest_common.sh@10 -- # set +x 00:06:34.643 ************************************ 00:06:34.643 START TEST accel_wrong_workload 00:06:34.643 ************************************ 00:06:34.643 18:52:51 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w foobar 00:06:34.643 18:52:51 -- common/autotest_common.sh@650 -- # local es=0 00:06:34.643 18:52:51 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w foobar 00:06:34.643 18:52:51 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:06:34.643 18:52:51 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:34.643 18:52:51 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:06:34.643 18:52:51 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:34.643 18:52:51 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w foobar 00:06:34.643 18:52:51 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w foobar 00:06:34.643 18:52:51 -- accel/accel.sh@12 -- # build_accel_config 00:06:34.643 18:52:51 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:34.643 18:52:51 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:34.643 18:52:51 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:34.643 18:52:51 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:34.643 18:52:51 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:34.643 18:52:51 -- accel/accel.sh@41 -- # local IFS=, 00:06:34.643 18:52:51 -- accel/accel.sh@42 -- # jq -r . 00:06:34.643 Unsupported workload type: foobar 00:06:34.643 [2024-11-26 18:52:51.439534] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'w' failed: 1 00:06:34.643 accel_perf options: 00:06:34.643 [-h help message] 00:06:34.643 [-q queue depth per core] 00:06:34.643 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:06:34.643 [-T number of threads per core 00:06:34.643 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:06:34.643 [-t time in seconds] 00:06:34.643 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:06:34.643 [ dif_verify, , dif_generate, dif_generate_copy 00:06:34.643 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:06:34.643 [-l for compress/decompress workloads, name of uncompressed input file 00:06:34.643 [-S for crc32c workload, use this seed value (default 0) 00:06:34.643 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:06:34.643 [-f for fill workload, use this BYTE value (default 255) 00:06:34.643 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:06:34.643 [-y verify result if this switch is on] 00:06:34.643 [-a tasks to allocate per core (default: same value as -q)] 00:06:34.643 Can be used to spread operations across a wider range of memory. 00:06:34.643 18:52:51 -- common/autotest_common.sh@653 -- # es=1 00:06:34.643 18:52:51 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:34.643 18:52:51 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:34.643 18:52:51 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:34.643 00:06:34.643 real 0m0.029s 00:06:34.643 user 0m0.018s 00:06:34.643 sys 0m0.010s 00:06:34.643 18:52:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:34.643 18:52:51 -- common/autotest_common.sh@10 -- # set +x 00:06:34.643 ************************************ 00:06:34.643 END TEST accel_wrong_workload 00:06:34.643 ************************************ 00:06:34.643 Error: writing output failed: Broken pipe 00:06:34.643 18:52:51 -- accel/accel.sh@89 -- # run_test accel_negative_buffers NOT accel_perf -t 1 -w xor -y -x -1 00:06:34.643 18:52:51 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:06:34.643 18:52:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:34.643 18:52:51 -- common/autotest_common.sh@10 -- # set +x 00:06:34.643 ************************************ 00:06:34.643 START TEST accel_negative_buffers 00:06:34.643 ************************************ 00:06:34.643 18:52:51 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w xor -y -x -1 00:06:34.643 18:52:51 -- common/autotest_common.sh@650 -- # local es=0 00:06:34.643 18:52:51 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w xor -y -x -1 00:06:34.643 18:52:51 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:06:34.643 18:52:51 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:34.643 18:52:51 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:06:34.643 18:52:51 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:34.643 18:52:51 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w xor -y -x -1 00:06:34.643 18:52:51 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x -1 00:06:34.643 18:52:51 -- accel/accel.sh@12 -- # build_accel_config 00:06:34.643 18:52:51 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:34.643 18:52:51 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:34.643 18:52:51 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:34.643 18:52:51 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:34.643 18:52:51 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:34.643 18:52:51 -- accel/accel.sh@41 -- # local IFS=, 00:06:34.643 18:52:51 -- accel/accel.sh@42 -- # jq -r . 00:06:34.643 -x option must be non-negative. 00:06:34.643 [2024-11-26 18:52:51.509738] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'x' failed: 1 00:06:34.643 accel_perf options: 00:06:34.643 [-h help message] 00:06:34.643 [-q queue depth per core] 00:06:34.643 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:06:34.643 [-T number of threads per core 00:06:34.643 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:06:34.643 [-t time in seconds] 00:06:34.643 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:06:34.643 [ dif_verify, , dif_generate, dif_generate_copy 00:06:34.643 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:06:34.643 [-l for compress/decompress workloads, name of uncompressed input file 00:06:34.643 [-S for crc32c workload, use this seed value (default 0) 00:06:34.643 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:06:34.643 [-f for fill workload, use this BYTE value (default 255) 00:06:34.643 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:06:34.643 [-y verify result if this switch is on] 00:06:34.643 [-a tasks to allocate per core (default: same value as -q)] 00:06:34.643 Can be used to spread operations across a wider range of memory. 00:06:34.643 18:52:51 -- common/autotest_common.sh@653 -- # es=1 00:06:34.643 18:52:51 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:34.643 18:52:51 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:34.643 18:52:51 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:34.643 00:06:34.643 real 0m0.033s 00:06:34.643 user 0m0.015s 00:06:34.643 sys 0m0.018s 00:06:34.643 18:52:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:34.643 18:52:51 -- common/autotest_common.sh@10 -- # set +x 00:06:34.643 ************************************ 00:06:34.643 END TEST accel_negative_buffers 00:06:34.643 ************************************ 00:06:34.643 Error: writing output failed: Broken pipe 00:06:34.643 18:52:51 -- accel/accel.sh@93 -- # run_test accel_crc32c accel_test -t 1 -w crc32c -S 32 -y 00:06:34.643 18:52:51 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:06:34.643 18:52:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:34.643 18:52:51 -- common/autotest_common.sh@10 -- # set +x 00:06:34.643 ************************************ 00:06:34.643 START TEST accel_crc32c 00:06:34.643 ************************************ 00:06:34.643 18:52:51 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -S 32 -y 00:06:34.643 18:52:51 -- accel/accel.sh@16 -- # local accel_opc 00:06:34.643 18:52:51 -- accel/accel.sh@17 -- # local accel_module 00:06:34.643 18:52:51 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:06:34.643 18:52:51 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:06:34.643 18:52:51 -- accel/accel.sh@12 -- # build_accel_config 00:06:34.643 18:52:51 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:34.643 18:52:51 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:34.643 18:52:51 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:34.643 18:52:51 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:34.643 18:52:51 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:34.643 18:52:51 -- accel/accel.sh@41 -- # local IFS=, 00:06:34.643 18:52:51 -- accel/accel.sh@42 -- # jq -r . 00:06:34.901 [2024-11-26 18:52:51.577603] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:34.901 [2024-11-26 18:52:51.577674] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2934533 ] 00:06:34.901 EAL: No free 2048 kB hugepages reported on node 1 00:06:34.901 [2024-11-26 18:52:51.635187] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:34.902 [2024-11-26 18:52:51.673471] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:36.276 18:52:52 -- accel/accel.sh@18 -- # out=' 00:06:36.276 SPDK Configuration: 00:06:36.276 Core mask: 0x1 00:06:36.276 00:06:36.276 Accel Perf Configuration: 00:06:36.276 Workload Type: crc32c 00:06:36.276 CRC-32C seed: 32 00:06:36.276 Transfer size: 4096 bytes 00:06:36.276 Vector count 1 00:06:36.276 Module: software 00:06:36.276 Queue depth: 32 00:06:36.276 Allocate depth: 32 00:06:36.276 # threads/core: 1 00:06:36.276 Run time: 1 seconds 00:06:36.276 Verify: Yes 00:06:36.276 00:06:36.276 Running for 1 seconds... 00:06:36.276 00:06:36.276 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:36.276 ------------------------------------------------------------------------------------ 00:06:36.276 0,0 572160/s 2235 MiB/s 0 0 00:06:36.276 ==================================================================================== 00:06:36.276 Total 572160/s 2235 MiB/s 0 0' 00:06:36.276 18:52:52 -- accel/accel.sh@20 -- # IFS=: 00:06:36.276 18:52:52 -- accel/accel.sh@20 -- # read -r var val 00:06:36.276 18:52:52 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:06:36.276 18:52:52 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:06:36.276 18:52:52 -- accel/accel.sh@12 -- # build_accel_config 00:06:36.276 18:52:52 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:36.276 18:52:52 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:36.276 18:52:52 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:36.276 18:52:52 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:36.276 18:52:52 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:36.276 18:52:52 -- accel/accel.sh@41 -- # local IFS=, 00:06:36.276 18:52:52 -- accel/accel.sh@42 -- # jq -r . 00:06:36.276 [2024-11-26 18:52:52.856043] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:36.276 [2024-11-26 18:52:52.856101] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2934768 ] 00:06:36.276 EAL: No free 2048 kB hugepages reported on node 1 00:06:36.276 [2024-11-26 18:52:52.910309] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:36.276 [2024-11-26 18:52:52.946324] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:36.276 18:52:52 -- accel/accel.sh@21 -- # val= 00:06:36.276 18:52:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.276 18:52:52 -- accel/accel.sh@20 -- # IFS=: 00:06:36.276 18:52:52 -- accel/accel.sh@20 -- # read -r var val 00:06:36.276 18:52:52 -- accel/accel.sh@21 -- # val= 00:06:36.276 18:52:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.276 18:52:52 -- accel/accel.sh@20 -- # IFS=: 00:06:36.276 18:52:52 -- accel/accel.sh@20 -- # read -r var val 00:06:36.276 18:52:52 -- accel/accel.sh@21 -- # val=0x1 00:06:36.276 18:52:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.276 18:52:52 -- accel/accel.sh@20 -- # IFS=: 00:06:36.276 18:52:52 -- accel/accel.sh@20 -- # read -r var val 00:06:36.276 18:52:52 -- accel/accel.sh@21 -- # val= 00:06:36.276 18:52:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.276 18:52:52 -- accel/accel.sh@20 -- # IFS=: 00:06:36.276 18:52:52 -- accel/accel.sh@20 -- # read -r var val 00:06:36.276 18:52:52 -- accel/accel.sh@21 -- # val= 00:06:36.276 18:52:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.276 18:52:52 -- accel/accel.sh@20 -- # IFS=: 00:06:36.276 18:52:52 -- accel/accel.sh@20 -- # read -r var val 00:06:36.276 18:52:52 -- accel/accel.sh@21 -- # val=crc32c 00:06:36.276 18:52:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.276 18:52:52 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:06:36.276 18:52:52 -- accel/accel.sh@20 -- # IFS=: 00:06:36.276 18:52:52 -- accel/accel.sh@20 -- # read -r var val 00:06:36.276 18:52:52 -- accel/accel.sh@21 -- # val=32 00:06:36.276 18:52:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.276 18:52:52 -- accel/accel.sh@20 -- # IFS=: 00:06:36.276 18:52:52 -- accel/accel.sh@20 -- # read -r var val 00:06:36.276 18:52:52 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:36.276 18:52:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.276 18:52:52 -- accel/accel.sh@20 -- # IFS=: 00:06:36.276 18:52:52 -- accel/accel.sh@20 -- # read -r var val 00:06:36.276 18:52:52 -- accel/accel.sh@21 -- # val= 00:06:36.276 18:52:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.276 18:52:52 -- accel/accel.sh@20 -- # IFS=: 00:06:36.276 18:52:52 -- accel/accel.sh@20 -- # read -r var val 00:06:36.276 18:52:52 -- accel/accel.sh@21 -- # val=software 00:06:36.276 18:52:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.276 18:52:52 -- accel/accel.sh@23 -- # accel_module=software 00:06:36.276 18:52:52 -- accel/accel.sh@20 -- # IFS=: 00:06:36.276 18:52:52 -- accel/accel.sh@20 -- # read -r var val 00:06:36.276 18:52:52 -- accel/accel.sh@21 -- # val=32 00:06:36.276 18:52:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.276 18:52:52 -- accel/accel.sh@20 -- # IFS=: 00:06:36.276 18:52:52 -- accel/accel.sh@20 -- # read -r var val 00:06:36.276 18:52:52 -- accel/accel.sh@21 -- # val=32 00:06:36.276 18:52:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.276 18:52:52 -- accel/accel.sh@20 -- # IFS=: 00:06:36.276 18:52:52 -- accel/accel.sh@20 -- # read -r var val 00:06:36.276 18:52:52 -- accel/accel.sh@21 -- # val=1 00:06:36.276 18:52:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.276 18:52:52 -- accel/accel.sh@20 -- # IFS=: 00:06:36.276 18:52:52 -- accel/accel.sh@20 -- # read -r var val 00:06:36.276 18:52:52 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:36.276 18:52:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.276 18:52:52 -- accel/accel.sh@20 -- # IFS=: 00:06:36.276 18:52:52 -- accel/accel.sh@20 -- # read -r var val 00:06:36.276 18:52:52 -- accel/accel.sh@21 -- # val=Yes 00:06:36.276 18:52:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.276 18:52:52 -- accel/accel.sh@20 -- # IFS=: 00:06:36.276 18:52:52 -- accel/accel.sh@20 -- # read -r var val 00:06:36.276 18:52:52 -- accel/accel.sh@21 -- # val= 00:06:36.276 18:52:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.276 18:52:52 -- accel/accel.sh@20 -- # IFS=: 00:06:36.276 18:52:52 -- accel/accel.sh@20 -- # read -r var val 00:06:36.276 18:52:52 -- accel/accel.sh@21 -- # val= 00:06:36.276 18:52:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.276 18:52:52 -- accel/accel.sh@20 -- # IFS=: 00:06:36.276 18:52:52 -- accel/accel.sh@20 -- # read -r var val 00:06:37.210 18:52:54 -- accel/accel.sh@21 -- # val= 00:06:37.210 18:52:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:37.210 18:52:54 -- accel/accel.sh@20 -- # IFS=: 00:06:37.210 18:52:54 -- accel/accel.sh@20 -- # read -r var val 00:06:37.210 18:52:54 -- accel/accel.sh@21 -- # val= 00:06:37.210 18:52:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:37.210 18:52:54 -- accel/accel.sh@20 -- # IFS=: 00:06:37.210 18:52:54 -- accel/accel.sh@20 -- # read -r var val 00:06:37.210 18:52:54 -- accel/accel.sh@21 -- # val= 00:06:37.210 18:52:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:37.210 18:52:54 -- accel/accel.sh@20 -- # IFS=: 00:06:37.210 18:52:54 -- accel/accel.sh@20 -- # read -r var val 00:06:37.210 18:52:54 -- accel/accel.sh@21 -- # val= 00:06:37.210 18:52:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:37.210 18:52:54 -- accel/accel.sh@20 -- # IFS=: 00:06:37.210 18:52:54 -- accel/accel.sh@20 -- # read -r var val 00:06:37.210 18:52:54 -- accel/accel.sh@21 -- # val= 00:06:37.210 18:52:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:37.210 18:52:54 -- accel/accel.sh@20 -- # IFS=: 00:06:37.210 18:52:54 -- accel/accel.sh@20 -- # read -r var val 00:06:37.210 18:52:54 -- accel/accel.sh@21 -- # val= 00:06:37.210 18:52:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:37.210 18:52:54 -- accel/accel.sh@20 -- # IFS=: 00:06:37.210 18:52:54 -- accel/accel.sh@20 -- # read -r var val 00:06:37.210 18:52:54 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:37.210 18:52:54 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:06:37.210 18:52:54 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:37.210 00:06:37.210 real 0m2.562s 00:06:37.210 user 0m2.341s 00:06:37.210 sys 0m0.218s 00:06:37.210 18:52:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:37.210 18:52:54 -- common/autotest_common.sh@10 -- # set +x 00:06:37.210 ************************************ 00:06:37.210 END TEST accel_crc32c 00:06:37.210 ************************************ 00:06:37.469 18:52:54 -- accel/accel.sh@94 -- # run_test accel_crc32c_C2 accel_test -t 1 -w crc32c -y -C 2 00:06:37.469 18:52:54 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:06:37.469 18:52:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:37.469 18:52:54 -- common/autotest_common.sh@10 -- # set +x 00:06:37.469 ************************************ 00:06:37.469 START TEST accel_crc32c_C2 00:06:37.469 ************************************ 00:06:37.469 18:52:54 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -y -C 2 00:06:37.469 18:52:54 -- accel/accel.sh@16 -- # local accel_opc 00:06:37.469 18:52:54 -- accel/accel.sh@17 -- # local accel_module 00:06:37.469 18:52:54 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -y -C 2 00:06:37.469 18:52:54 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:06:37.469 18:52:54 -- accel/accel.sh@12 -- # build_accel_config 00:06:37.469 18:52:54 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:37.469 18:52:54 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:37.469 18:52:54 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:37.469 18:52:54 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:37.469 18:52:54 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:37.469 18:52:54 -- accel/accel.sh@41 -- # local IFS=, 00:06:37.469 18:52:54 -- accel/accel.sh@42 -- # jq -r . 00:06:37.469 [2024-11-26 18:52:54.170887] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:37.469 [2024-11-26 18:52:54.170972] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2935015 ] 00:06:37.469 EAL: No free 2048 kB hugepages reported on node 1 00:06:37.469 [2024-11-26 18:52:54.226738] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:37.469 [2024-11-26 18:52:54.263777] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:38.861 18:52:55 -- accel/accel.sh@18 -- # out=' 00:06:38.861 SPDK Configuration: 00:06:38.861 Core mask: 0x1 00:06:38.861 00:06:38.861 Accel Perf Configuration: 00:06:38.861 Workload Type: crc32c 00:06:38.861 CRC-32C seed: 0 00:06:38.861 Transfer size: 4096 bytes 00:06:38.861 Vector count 2 00:06:38.861 Module: software 00:06:38.861 Queue depth: 32 00:06:38.861 Allocate depth: 32 00:06:38.861 # threads/core: 1 00:06:38.861 Run time: 1 seconds 00:06:38.861 Verify: Yes 00:06:38.861 00:06:38.861 Running for 1 seconds... 00:06:38.861 00:06:38.861 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:38.861 ------------------------------------------------------------------------------------ 00:06:38.861 0,0 443168/s 3462 MiB/s 0 0 00:06:38.861 ==================================================================================== 00:06:38.861 Total 443168/s 1731 MiB/s 0 0' 00:06:38.861 18:52:55 -- accel/accel.sh@20 -- # IFS=: 00:06:38.861 18:52:55 -- accel/accel.sh@20 -- # read -r var val 00:06:38.861 18:52:55 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -y -C 2 00:06:38.861 18:52:55 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:06:38.861 18:52:55 -- accel/accel.sh@12 -- # build_accel_config 00:06:38.861 18:52:55 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:38.861 18:52:55 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:38.861 18:52:55 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:38.861 18:52:55 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:38.861 18:52:55 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:38.861 18:52:55 -- accel/accel.sh@41 -- # local IFS=, 00:06:38.861 18:52:55 -- accel/accel.sh@42 -- # jq -r . 00:06:38.861 [2024-11-26 18:52:55.455876] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:38.861 [2024-11-26 18:52:55.455940] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2935255 ] 00:06:38.861 EAL: No free 2048 kB hugepages reported on node 1 00:06:38.861 [2024-11-26 18:52:55.510775] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:38.861 [2024-11-26 18:52:55.547343] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:38.861 18:52:55 -- accel/accel.sh@21 -- # val= 00:06:38.861 18:52:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.861 18:52:55 -- accel/accel.sh@20 -- # IFS=: 00:06:38.861 18:52:55 -- accel/accel.sh@20 -- # read -r var val 00:06:38.861 18:52:55 -- accel/accel.sh@21 -- # val= 00:06:38.861 18:52:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.861 18:52:55 -- accel/accel.sh@20 -- # IFS=: 00:06:38.861 18:52:55 -- accel/accel.sh@20 -- # read -r var val 00:06:38.861 18:52:55 -- accel/accel.sh@21 -- # val=0x1 00:06:38.861 18:52:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.861 18:52:55 -- accel/accel.sh@20 -- # IFS=: 00:06:38.861 18:52:55 -- accel/accel.sh@20 -- # read -r var val 00:06:38.861 18:52:55 -- accel/accel.sh@21 -- # val= 00:06:38.861 18:52:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.861 18:52:55 -- accel/accel.sh@20 -- # IFS=: 00:06:38.861 18:52:55 -- accel/accel.sh@20 -- # read -r var val 00:06:38.861 18:52:55 -- accel/accel.sh@21 -- # val= 00:06:38.861 18:52:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.861 18:52:55 -- accel/accel.sh@20 -- # IFS=: 00:06:38.861 18:52:55 -- accel/accel.sh@20 -- # read -r var val 00:06:38.861 18:52:55 -- accel/accel.sh@21 -- # val=crc32c 00:06:38.861 18:52:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.862 18:52:55 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:06:38.862 18:52:55 -- accel/accel.sh@20 -- # IFS=: 00:06:38.862 18:52:55 -- accel/accel.sh@20 -- # read -r var val 00:06:38.862 18:52:55 -- accel/accel.sh@21 -- # val=0 00:06:38.862 18:52:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.862 18:52:55 -- accel/accel.sh@20 -- # IFS=: 00:06:38.862 18:52:55 -- accel/accel.sh@20 -- # read -r var val 00:06:38.862 18:52:55 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:38.862 18:52:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.862 18:52:55 -- accel/accel.sh@20 -- # IFS=: 00:06:38.862 18:52:55 -- accel/accel.sh@20 -- # read -r var val 00:06:38.862 18:52:55 -- accel/accel.sh@21 -- # val= 00:06:38.862 18:52:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.862 18:52:55 -- accel/accel.sh@20 -- # IFS=: 00:06:38.862 18:52:55 -- accel/accel.sh@20 -- # read -r var val 00:06:38.862 18:52:55 -- accel/accel.sh@21 -- # val=software 00:06:38.862 18:52:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.862 18:52:55 -- accel/accel.sh@23 -- # accel_module=software 00:06:38.862 18:52:55 -- accel/accel.sh@20 -- # IFS=: 00:06:38.862 18:52:55 -- accel/accel.sh@20 -- # read -r var val 00:06:38.862 18:52:55 -- accel/accel.sh@21 -- # val=32 00:06:38.862 18:52:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.862 18:52:55 -- accel/accel.sh@20 -- # IFS=: 00:06:38.862 18:52:55 -- accel/accel.sh@20 -- # read -r var val 00:06:38.862 18:52:55 -- accel/accel.sh@21 -- # val=32 00:06:38.862 18:52:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.862 18:52:55 -- accel/accel.sh@20 -- # IFS=: 00:06:38.862 18:52:55 -- accel/accel.sh@20 -- # read -r var val 00:06:38.862 18:52:55 -- accel/accel.sh@21 -- # val=1 00:06:38.862 18:52:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.862 18:52:55 -- accel/accel.sh@20 -- # IFS=: 00:06:38.862 18:52:55 -- accel/accel.sh@20 -- # read -r var val 00:06:38.862 18:52:55 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:38.862 18:52:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.862 18:52:55 -- accel/accel.sh@20 -- # IFS=: 00:06:38.862 18:52:55 -- accel/accel.sh@20 -- # read -r var val 00:06:38.862 18:52:55 -- accel/accel.sh@21 -- # val=Yes 00:06:38.862 18:52:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.862 18:52:55 -- accel/accel.sh@20 -- # IFS=: 00:06:38.862 18:52:55 -- accel/accel.sh@20 -- # read -r var val 00:06:38.862 18:52:55 -- accel/accel.sh@21 -- # val= 00:06:38.862 18:52:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.862 18:52:55 -- accel/accel.sh@20 -- # IFS=: 00:06:38.862 18:52:55 -- accel/accel.sh@20 -- # read -r var val 00:06:38.862 18:52:55 -- accel/accel.sh@21 -- # val= 00:06:38.862 18:52:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.862 18:52:55 -- accel/accel.sh@20 -- # IFS=: 00:06:38.862 18:52:55 -- accel/accel.sh@20 -- # read -r var val 00:06:39.931 18:52:56 -- accel/accel.sh@21 -- # val= 00:06:39.931 18:52:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.931 18:52:56 -- accel/accel.sh@20 -- # IFS=: 00:06:39.931 18:52:56 -- accel/accel.sh@20 -- # read -r var val 00:06:39.931 18:52:56 -- accel/accel.sh@21 -- # val= 00:06:39.931 18:52:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.931 18:52:56 -- accel/accel.sh@20 -- # IFS=: 00:06:39.931 18:52:56 -- accel/accel.sh@20 -- # read -r var val 00:06:39.931 18:52:56 -- accel/accel.sh@21 -- # val= 00:06:39.931 18:52:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.931 18:52:56 -- accel/accel.sh@20 -- # IFS=: 00:06:39.931 18:52:56 -- accel/accel.sh@20 -- # read -r var val 00:06:39.931 18:52:56 -- accel/accel.sh@21 -- # val= 00:06:39.931 18:52:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.931 18:52:56 -- accel/accel.sh@20 -- # IFS=: 00:06:39.931 18:52:56 -- accel/accel.sh@20 -- # read -r var val 00:06:39.931 18:52:56 -- accel/accel.sh@21 -- # val= 00:06:39.931 18:52:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.931 18:52:56 -- accel/accel.sh@20 -- # IFS=: 00:06:39.931 18:52:56 -- accel/accel.sh@20 -- # read -r var val 00:06:39.931 18:52:56 -- accel/accel.sh@21 -- # val= 00:06:39.931 18:52:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.931 18:52:56 -- accel/accel.sh@20 -- # IFS=: 00:06:39.931 18:52:56 -- accel/accel.sh@20 -- # read -r var val 00:06:39.931 18:52:56 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:39.931 18:52:56 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:06:39.931 18:52:56 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:39.931 00:06:39.931 real 0m2.570s 00:06:39.931 user 0m2.340s 00:06:39.931 sys 0m0.230s 00:06:39.931 18:52:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:39.931 18:52:56 -- common/autotest_common.sh@10 -- # set +x 00:06:39.931 ************************************ 00:06:39.931 END TEST accel_crc32c_C2 00:06:39.931 ************************************ 00:06:39.931 18:52:56 -- accel/accel.sh@95 -- # run_test accel_copy accel_test -t 1 -w copy -y 00:06:39.931 18:52:56 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:39.931 18:52:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:39.931 18:52:56 -- common/autotest_common.sh@10 -- # set +x 00:06:39.931 ************************************ 00:06:39.931 START TEST accel_copy 00:06:39.931 ************************************ 00:06:39.931 18:52:56 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy -y 00:06:39.931 18:52:56 -- accel/accel.sh@16 -- # local accel_opc 00:06:39.931 18:52:56 -- accel/accel.sh@17 -- # local accel_module 00:06:39.931 18:52:56 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy -y 00:06:39.931 18:52:56 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:06:39.931 18:52:56 -- accel/accel.sh@12 -- # build_accel_config 00:06:39.931 18:52:56 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:39.931 18:52:56 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:39.931 18:52:56 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:39.931 18:52:56 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:39.931 18:52:56 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:39.931 18:52:56 -- accel/accel.sh@41 -- # local IFS=, 00:06:39.931 18:52:56 -- accel/accel.sh@42 -- # jq -r . 00:06:39.931 [2024-11-26 18:52:56.778233] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:39.931 [2024-11-26 18:52:56.778311] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2935508 ] 00:06:39.931 EAL: No free 2048 kB hugepages reported on node 1 00:06:39.931 [2024-11-26 18:52:56.834537] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:40.190 [2024-11-26 18:52:56.871803] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:41.126 18:52:58 -- accel/accel.sh@18 -- # out=' 00:06:41.126 SPDK Configuration: 00:06:41.126 Core mask: 0x1 00:06:41.126 00:06:41.126 Accel Perf Configuration: 00:06:41.126 Workload Type: copy 00:06:41.126 Transfer size: 4096 bytes 00:06:41.126 Vector count 1 00:06:41.126 Module: software 00:06:41.126 Queue depth: 32 00:06:41.126 Allocate depth: 32 00:06:41.126 # threads/core: 1 00:06:41.126 Run time: 1 seconds 00:06:41.126 Verify: Yes 00:06:41.126 00:06:41.126 Running for 1 seconds... 00:06:41.126 00:06:41.126 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:41.126 ------------------------------------------------------------------------------------ 00:06:41.126 0,0 418688/s 1635 MiB/s 0 0 00:06:41.126 ==================================================================================== 00:06:41.126 Total 418688/s 1635 MiB/s 0 0' 00:06:41.126 18:52:58 -- accel/accel.sh@20 -- # IFS=: 00:06:41.126 18:52:58 -- accel/accel.sh@20 -- # read -r var val 00:06:41.126 18:52:58 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy -y 00:06:41.126 18:52:58 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:06:41.126 18:52:58 -- accel/accel.sh@12 -- # build_accel_config 00:06:41.126 18:52:58 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:41.126 18:52:58 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:41.126 18:52:58 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:41.126 18:52:58 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:41.126 18:52:58 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:41.126 18:52:58 -- accel/accel.sh@41 -- # local IFS=, 00:06:41.126 18:52:58 -- accel/accel.sh@42 -- # jq -r . 00:06:41.384 [2024-11-26 18:52:58.063768] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:41.384 [2024-11-26 18:52:58.063827] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2935745 ] 00:06:41.384 EAL: No free 2048 kB hugepages reported on node 1 00:06:41.384 [2024-11-26 18:52:58.119379] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:41.384 [2024-11-26 18:52:58.155816] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:41.384 18:52:58 -- accel/accel.sh@21 -- # val= 00:06:41.384 18:52:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.384 18:52:58 -- accel/accel.sh@20 -- # IFS=: 00:06:41.384 18:52:58 -- accel/accel.sh@20 -- # read -r var val 00:06:41.384 18:52:58 -- accel/accel.sh@21 -- # val= 00:06:41.384 18:52:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.384 18:52:58 -- accel/accel.sh@20 -- # IFS=: 00:06:41.384 18:52:58 -- accel/accel.sh@20 -- # read -r var val 00:06:41.384 18:52:58 -- accel/accel.sh@21 -- # val=0x1 00:06:41.384 18:52:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.384 18:52:58 -- accel/accel.sh@20 -- # IFS=: 00:06:41.384 18:52:58 -- accel/accel.sh@20 -- # read -r var val 00:06:41.384 18:52:58 -- accel/accel.sh@21 -- # val= 00:06:41.384 18:52:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.384 18:52:58 -- accel/accel.sh@20 -- # IFS=: 00:06:41.384 18:52:58 -- accel/accel.sh@20 -- # read -r var val 00:06:41.384 18:52:58 -- accel/accel.sh@21 -- # val= 00:06:41.384 18:52:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.384 18:52:58 -- accel/accel.sh@20 -- # IFS=: 00:06:41.384 18:52:58 -- accel/accel.sh@20 -- # read -r var val 00:06:41.384 18:52:58 -- accel/accel.sh@21 -- # val=copy 00:06:41.384 18:52:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.384 18:52:58 -- accel/accel.sh@24 -- # accel_opc=copy 00:06:41.384 18:52:58 -- accel/accel.sh@20 -- # IFS=: 00:06:41.384 18:52:58 -- accel/accel.sh@20 -- # read -r var val 00:06:41.384 18:52:58 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:41.384 18:52:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.384 18:52:58 -- accel/accel.sh@20 -- # IFS=: 00:06:41.384 18:52:58 -- accel/accel.sh@20 -- # read -r var val 00:06:41.384 18:52:58 -- accel/accel.sh@21 -- # val= 00:06:41.384 18:52:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.384 18:52:58 -- accel/accel.sh@20 -- # IFS=: 00:06:41.384 18:52:58 -- accel/accel.sh@20 -- # read -r var val 00:06:41.384 18:52:58 -- accel/accel.sh@21 -- # val=software 00:06:41.384 18:52:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.384 18:52:58 -- accel/accel.sh@23 -- # accel_module=software 00:06:41.384 18:52:58 -- accel/accel.sh@20 -- # IFS=: 00:06:41.384 18:52:58 -- accel/accel.sh@20 -- # read -r var val 00:06:41.384 18:52:58 -- accel/accel.sh@21 -- # val=32 00:06:41.384 18:52:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.384 18:52:58 -- accel/accel.sh@20 -- # IFS=: 00:06:41.384 18:52:58 -- accel/accel.sh@20 -- # read -r var val 00:06:41.384 18:52:58 -- accel/accel.sh@21 -- # val=32 00:06:41.384 18:52:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.384 18:52:58 -- accel/accel.sh@20 -- # IFS=: 00:06:41.384 18:52:58 -- accel/accel.sh@20 -- # read -r var val 00:06:41.384 18:52:58 -- accel/accel.sh@21 -- # val=1 00:06:41.384 18:52:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.384 18:52:58 -- accel/accel.sh@20 -- # IFS=: 00:06:41.384 18:52:58 -- accel/accel.sh@20 -- # read -r var val 00:06:41.384 18:52:58 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:41.384 18:52:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.384 18:52:58 -- accel/accel.sh@20 -- # IFS=: 00:06:41.384 18:52:58 -- accel/accel.sh@20 -- # read -r var val 00:06:41.384 18:52:58 -- accel/accel.sh@21 -- # val=Yes 00:06:41.384 18:52:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.384 18:52:58 -- accel/accel.sh@20 -- # IFS=: 00:06:41.384 18:52:58 -- accel/accel.sh@20 -- # read -r var val 00:06:41.384 18:52:58 -- accel/accel.sh@21 -- # val= 00:06:41.384 18:52:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.384 18:52:58 -- accel/accel.sh@20 -- # IFS=: 00:06:41.384 18:52:58 -- accel/accel.sh@20 -- # read -r var val 00:06:41.384 18:52:58 -- accel/accel.sh@21 -- # val= 00:06:41.384 18:52:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.384 18:52:58 -- accel/accel.sh@20 -- # IFS=: 00:06:41.384 18:52:58 -- accel/accel.sh@20 -- # read -r var val 00:06:42.761 18:52:59 -- accel/accel.sh@21 -- # val= 00:06:42.761 18:52:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:42.761 18:52:59 -- accel/accel.sh@20 -- # IFS=: 00:06:42.761 18:52:59 -- accel/accel.sh@20 -- # read -r var val 00:06:42.761 18:52:59 -- accel/accel.sh@21 -- # val= 00:06:42.761 18:52:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:42.761 18:52:59 -- accel/accel.sh@20 -- # IFS=: 00:06:42.761 18:52:59 -- accel/accel.sh@20 -- # read -r var val 00:06:42.761 18:52:59 -- accel/accel.sh@21 -- # val= 00:06:42.761 18:52:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:42.761 18:52:59 -- accel/accel.sh@20 -- # IFS=: 00:06:42.761 18:52:59 -- accel/accel.sh@20 -- # read -r var val 00:06:42.761 18:52:59 -- accel/accel.sh@21 -- # val= 00:06:42.761 18:52:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:42.761 18:52:59 -- accel/accel.sh@20 -- # IFS=: 00:06:42.761 18:52:59 -- accel/accel.sh@20 -- # read -r var val 00:06:42.761 18:52:59 -- accel/accel.sh@21 -- # val= 00:06:42.761 18:52:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:42.761 18:52:59 -- accel/accel.sh@20 -- # IFS=: 00:06:42.761 18:52:59 -- accel/accel.sh@20 -- # read -r var val 00:06:42.761 18:52:59 -- accel/accel.sh@21 -- # val= 00:06:42.761 18:52:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:42.761 18:52:59 -- accel/accel.sh@20 -- # IFS=: 00:06:42.761 18:52:59 -- accel/accel.sh@20 -- # read -r var val 00:06:42.761 18:52:59 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:42.761 18:52:59 -- accel/accel.sh@28 -- # [[ -n copy ]] 00:06:42.761 18:52:59 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:42.761 00:06:42.761 real 0m2.574s 00:06:42.761 user 0m2.350s 00:06:42.761 sys 0m0.223s 00:06:42.761 18:52:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:42.761 18:52:59 -- common/autotest_common.sh@10 -- # set +x 00:06:42.761 ************************************ 00:06:42.761 END TEST accel_copy 00:06:42.761 ************************************ 00:06:42.761 18:52:59 -- accel/accel.sh@96 -- # run_test accel_fill accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:42.761 18:52:59 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:06:42.761 18:52:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:42.761 18:52:59 -- common/autotest_common.sh@10 -- # set +x 00:06:42.761 ************************************ 00:06:42.761 START TEST accel_fill 00:06:42.761 ************************************ 00:06:42.761 18:52:59 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:42.761 18:52:59 -- accel/accel.sh@16 -- # local accel_opc 00:06:42.761 18:52:59 -- accel/accel.sh@17 -- # local accel_module 00:06:42.761 18:52:59 -- accel/accel.sh@18 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:42.761 18:52:59 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:42.761 18:52:59 -- accel/accel.sh@12 -- # build_accel_config 00:06:42.761 18:52:59 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:42.761 18:52:59 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:42.761 18:52:59 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:42.761 18:52:59 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:42.761 18:52:59 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:42.761 18:52:59 -- accel/accel.sh@41 -- # local IFS=, 00:06:42.761 18:52:59 -- accel/accel.sh@42 -- # jq -r . 00:06:42.761 [2024-11-26 18:52:59.387223] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:42.761 [2024-11-26 18:52:59.387301] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2935999 ] 00:06:42.761 EAL: No free 2048 kB hugepages reported on node 1 00:06:42.761 [2024-11-26 18:52:59.443362] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:42.761 [2024-11-26 18:52:59.480383] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:44.141 18:53:00 -- accel/accel.sh@18 -- # out=' 00:06:44.141 SPDK Configuration: 00:06:44.141 Core mask: 0x1 00:06:44.141 00:06:44.141 Accel Perf Configuration: 00:06:44.141 Workload Type: fill 00:06:44.141 Fill pattern: 0x80 00:06:44.141 Transfer size: 4096 bytes 00:06:44.141 Vector count 1 00:06:44.141 Module: software 00:06:44.141 Queue depth: 64 00:06:44.141 Allocate depth: 64 00:06:44.141 # threads/core: 1 00:06:44.141 Run time: 1 seconds 00:06:44.141 Verify: Yes 00:06:44.141 00:06:44.141 Running for 1 seconds... 00:06:44.141 00:06:44.141 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:44.141 ------------------------------------------------------------------------------------ 00:06:44.141 0,0 646848/s 2526 MiB/s 0 0 00:06:44.141 ==================================================================================== 00:06:44.141 Total 646848/s 2526 MiB/s 0 0' 00:06:44.141 18:53:00 -- accel/accel.sh@20 -- # IFS=: 00:06:44.141 18:53:00 -- accel/accel.sh@20 -- # read -r var val 00:06:44.141 18:53:00 -- accel/accel.sh@15 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:44.141 18:53:00 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:44.141 18:53:00 -- accel/accel.sh@12 -- # build_accel_config 00:06:44.141 18:53:00 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:44.141 18:53:00 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:44.141 18:53:00 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:44.141 18:53:00 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:44.141 18:53:00 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:44.141 18:53:00 -- accel/accel.sh@41 -- # local IFS=, 00:06:44.141 18:53:00 -- accel/accel.sh@42 -- # jq -r . 00:06:44.141 [2024-11-26 18:53:00.673232] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:44.141 [2024-11-26 18:53:00.673292] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2936231 ] 00:06:44.141 EAL: No free 2048 kB hugepages reported on node 1 00:06:44.141 [2024-11-26 18:53:00.728074] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:44.141 [2024-11-26 18:53:00.765071] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:44.141 18:53:00 -- accel/accel.sh@21 -- # val= 00:06:44.141 18:53:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:44.141 18:53:00 -- accel/accel.sh@20 -- # IFS=: 00:06:44.141 18:53:00 -- accel/accel.sh@20 -- # read -r var val 00:06:44.141 18:53:00 -- accel/accel.sh@21 -- # val= 00:06:44.141 18:53:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:44.141 18:53:00 -- accel/accel.sh@20 -- # IFS=: 00:06:44.141 18:53:00 -- accel/accel.sh@20 -- # read -r var val 00:06:44.141 18:53:00 -- accel/accel.sh@21 -- # val=0x1 00:06:44.141 18:53:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:44.141 18:53:00 -- accel/accel.sh@20 -- # IFS=: 00:06:44.141 18:53:00 -- accel/accel.sh@20 -- # read -r var val 00:06:44.141 18:53:00 -- accel/accel.sh@21 -- # val= 00:06:44.141 18:53:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:44.141 18:53:00 -- accel/accel.sh@20 -- # IFS=: 00:06:44.141 18:53:00 -- accel/accel.sh@20 -- # read -r var val 00:06:44.141 18:53:00 -- accel/accel.sh@21 -- # val= 00:06:44.141 18:53:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:44.141 18:53:00 -- accel/accel.sh@20 -- # IFS=: 00:06:44.141 18:53:00 -- accel/accel.sh@20 -- # read -r var val 00:06:44.141 18:53:00 -- accel/accel.sh@21 -- # val=fill 00:06:44.141 18:53:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:44.141 18:53:00 -- accel/accel.sh@24 -- # accel_opc=fill 00:06:44.141 18:53:00 -- accel/accel.sh@20 -- # IFS=: 00:06:44.141 18:53:00 -- accel/accel.sh@20 -- # read -r var val 00:06:44.141 18:53:00 -- accel/accel.sh@21 -- # val=0x80 00:06:44.141 18:53:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:44.141 18:53:00 -- accel/accel.sh@20 -- # IFS=: 00:06:44.141 18:53:00 -- accel/accel.sh@20 -- # read -r var val 00:06:44.141 18:53:00 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:44.141 18:53:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:44.141 18:53:00 -- accel/accel.sh@20 -- # IFS=: 00:06:44.141 18:53:00 -- accel/accel.sh@20 -- # read -r var val 00:06:44.141 18:53:00 -- accel/accel.sh@21 -- # val= 00:06:44.141 18:53:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:44.141 18:53:00 -- accel/accel.sh@20 -- # IFS=: 00:06:44.141 18:53:00 -- accel/accel.sh@20 -- # read -r var val 00:06:44.141 18:53:00 -- accel/accel.sh@21 -- # val=software 00:06:44.141 18:53:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:44.141 18:53:00 -- accel/accel.sh@23 -- # accel_module=software 00:06:44.141 18:53:00 -- accel/accel.sh@20 -- # IFS=: 00:06:44.141 18:53:00 -- accel/accel.sh@20 -- # read -r var val 00:06:44.141 18:53:00 -- accel/accel.sh@21 -- # val=64 00:06:44.141 18:53:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:44.141 18:53:00 -- accel/accel.sh@20 -- # IFS=: 00:06:44.141 18:53:00 -- accel/accel.sh@20 -- # read -r var val 00:06:44.141 18:53:00 -- accel/accel.sh@21 -- # val=64 00:06:44.141 18:53:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:44.141 18:53:00 -- accel/accel.sh@20 -- # IFS=: 00:06:44.141 18:53:00 -- accel/accel.sh@20 -- # read -r var val 00:06:44.141 18:53:00 -- accel/accel.sh@21 -- # val=1 00:06:44.141 18:53:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:44.141 18:53:00 -- accel/accel.sh@20 -- # IFS=: 00:06:44.141 18:53:00 -- accel/accel.sh@20 -- # read -r var val 00:06:44.141 18:53:00 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:44.141 18:53:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:44.141 18:53:00 -- accel/accel.sh@20 -- # IFS=: 00:06:44.141 18:53:00 -- accel/accel.sh@20 -- # read -r var val 00:06:44.141 18:53:00 -- accel/accel.sh@21 -- # val=Yes 00:06:44.141 18:53:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:44.141 18:53:00 -- accel/accel.sh@20 -- # IFS=: 00:06:44.141 18:53:00 -- accel/accel.sh@20 -- # read -r var val 00:06:44.141 18:53:00 -- accel/accel.sh@21 -- # val= 00:06:44.141 18:53:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:44.141 18:53:00 -- accel/accel.sh@20 -- # IFS=: 00:06:44.141 18:53:00 -- accel/accel.sh@20 -- # read -r var val 00:06:44.141 18:53:00 -- accel/accel.sh@21 -- # val= 00:06:44.141 18:53:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:44.141 18:53:00 -- accel/accel.sh@20 -- # IFS=: 00:06:44.141 18:53:00 -- accel/accel.sh@20 -- # read -r var val 00:06:45.080 18:53:01 -- accel/accel.sh@21 -- # val= 00:06:45.080 18:53:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.080 18:53:01 -- accel/accel.sh@20 -- # IFS=: 00:06:45.080 18:53:01 -- accel/accel.sh@20 -- # read -r var val 00:06:45.080 18:53:01 -- accel/accel.sh@21 -- # val= 00:06:45.080 18:53:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.080 18:53:01 -- accel/accel.sh@20 -- # IFS=: 00:06:45.080 18:53:01 -- accel/accel.sh@20 -- # read -r var val 00:06:45.080 18:53:01 -- accel/accel.sh@21 -- # val= 00:06:45.080 18:53:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.080 18:53:01 -- accel/accel.sh@20 -- # IFS=: 00:06:45.080 18:53:01 -- accel/accel.sh@20 -- # read -r var val 00:06:45.080 18:53:01 -- accel/accel.sh@21 -- # val= 00:06:45.080 18:53:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.080 18:53:01 -- accel/accel.sh@20 -- # IFS=: 00:06:45.080 18:53:01 -- accel/accel.sh@20 -- # read -r var val 00:06:45.080 18:53:01 -- accel/accel.sh@21 -- # val= 00:06:45.080 18:53:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.080 18:53:01 -- accel/accel.sh@20 -- # IFS=: 00:06:45.080 18:53:01 -- accel/accel.sh@20 -- # read -r var val 00:06:45.080 18:53:01 -- accel/accel.sh@21 -- # val= 00:06:45.080 18:53:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.080 18:53:01 -- accel/accel.sh@20 -- # IFS=: 00:06:45.080 18:53:01 -- accel/accel.sh@20 -- # read -r var val 00:06:45.080 18:53:01 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:45.080 18:53:01 -- accel/accel.sh@28 -- # [[ -n fill ]] 00:06:45.080 18:53:01 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:45.080 00:06:45.080 real 0m2.574s 00:06:45.080 user 0m2.352s 00:06:45.080 sys 0m0.222s 00:06:45.080 18:53:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:45.080 18:53:01 -- common/autotest_common.sh@10 -- # set +x 00:06:45.080 ************************************ 00:06:45.080 END TEST accel_fill 00:06:45.080 ************************************ 00:06:45.080 18:53:01 -- accel/accel.sh@97 -- # run_test accel_copy_crc32c accel_test -t 1 -w copy_crc32c -y 00:06:45.080 18:53:01 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:45.080 18:53:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:45.080 18:53:01 -- common/autotest_common.sh@10 -- # set +x 00:06:45.080 ************************************ 00:06:45.080 START TEST accel_copy_crc32c 00:06:45.080 ************************************ 00:06:45.080 18:53:01 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y 00:06:45.080 18:53:01 -- accel/accel.sh@16 -- # local accel_opc 00:06:45.080 18:53:01 -- accel/accel.sh@17 -- # local accel_module 00:06:45.080 18:53:01 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y 00:06:45.080 18:53:01 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:06:45.080 18:53:01 -- accel/accel.sh@12 -- # build_accel_config 00:06:45.080 18:53:01 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:45.080 18:53:01 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:45.080 18:53:01 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:45.080 18:53:01 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:45.080 18:53:01 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:45.080 18:53:01 -- accel/accel.sh@41 -- # local IFS=, 00:06:45.080 18:53:01 -- accel/accel.sh@42 -- # jq -r . 00:06:45.080 [2024-11-26 18:53:01.995512] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:45.080 [2024-11-26 18:53:01.995589] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2936481 ] 00:06:45.339 EAL: No free 2048 kB hugepages reported on node 1 00:06:45.339 [2024-11-26 18:53:02.050918] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:45.339 [2024-11-26 18:53:02.087486] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:46.719 18:53:03 -- accel/accel.sh@18 -- # out=' 00:06:46.719 SPDK Configuration: 00:06:46.719 Core mask: 0x1 00:06:46.719 00:06:46.719 Accel Perf Configuration: 00:06:46.719 Workload Type: copy_crc32c 00:06:46.719 CRC-32C seed: 0 00:06:46.719 Vector size: 4096 bytes 00:06:46.719 Transfer size: 4096 bytes 00:06:46.719 Vector count 1 00:06:46.719 Module: software 00:06:46.719 Queue depth: 32 00:06:46.719 Allocate depth: 32 00:06:46.719 # threads/core: 1 00:06:46.719 Run time: 1 seconds 00:06:46.719 Verify: Yes 00:06:46.719 00:06:46.719 Running for 1 seconds... 00:06:46.719 00:06:46.719 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:46.719 ------------------------------------------------------------------------------------ 00:06:46.719 0,0 327168/s 1278 MiB/s 0 0 00:06:46.719 ==================================================================================== 00:06:46.719 Total 327168/s 1278 MiB/s 0 0' 00:06:46.719 18:53:03 -- accel/accel.sh@20 -- # IFS=: 00:06:46.719 18:53:03 -- accel/accel.sh@20 -- # read -r var val 00:06:46.719 18:53:03 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y 00:06:46.719 18:53:03 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:06:46.719 18:53:03 -- accel/accel.sh@12 -- # build_accel_config 00:06:46.719 18:53:03 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:46.719 18:53:03 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:46.719 18:53:03 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:46.719 18:53:03 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:46.719 18:53:03 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:46.719 18:53:03 -- accel/accel.sh@41 -- # local IFS=, 00:06:46.719 18:53:03 -- accel/accel.sh@42 -- # jq -r . 00:06:46.719 [2024-11-26 18:53:03.281060] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:46.719 [2024-11-26 18:53:03.281139] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2936698 ] 00:06:46.719 EAL: No free 2048 kB hugepages reported on node 1 00:06:46.719 [2024-11-26 18:53:03.336610] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:46.719 [2024-11-26 18:53:03.372606] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:46.719 18:53:03 -- accel/accel.sh@21 -- # val= 00:06:46.719 18:53:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.719 18:53:03 -- accel/accel.sh@20 -- # IFS=: 00:06:46.719 18:53:03 -- accel/accel.sh@20 -- # read -r var val 00:06:46.719 18:53:03 -- accel/accel.sh@21 -- # val= 00:06:46.719 18:53:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.719 18:53:03 -- accel/accel.sh@20 -- # IFS=: 00:06:46.719 18:53:03 -- accel/accel.sh@20 -- # read -r var val 00:06:46.719 18:53:03 -- accel/accel.sh@21 -- # val=0x1 00:06:46.719 18:53:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.719 18:53:03 -- accel/accel.sh@20 -- # IFS=: 00:06:46.719 18:53:03 -- accel/accel.sh@20 -- # read -r var val 00:06:46.719 18:53:03 -- accel/accel.sh@21 -- # val= 00:06:46.719 18:53:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.719 18:53:03 -- accel/accel.sh@20 -- # IFS=: 00:06:46.719 18:53:03 -- accel/accel.sh@20 -- # read -r var val 00:06:46.719 18:53:03 -- accel/accel.sh@21 -- # val= 00:06:46.719 18:53:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.719 18:53:03 -- accel/accel.sh@20 -- # IFS=: 00:06:46.719 18:53:03 -- accel/accel.sh@20 -- # read -r var val 00:06:46.719 18:53:03 -- accel/accel.sh@21 -- # val=copy_crc32c 00:06:46.719 18:53:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.719 18:53:03 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:06:46.719 18:53:03 -- accel/accel.sh@20 -- # IFS=: 00:06:46.719 18:53:03 -- accel/accel.sh@20 -- # read -r var val 00:06:46.719 18:53:03 -- accel/accel.sh@21 -- # val=0 00:06:46.719 18:53:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.719 18:53:03 -- accel/accel.sh@20 -- # IFS=: 00:06:46.719 18:53:03 -- accel/accel.sh@20 -- # read -r var val 00:06:46.719 18:53:03 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:46.719 18:53:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.719 18:53:03 -- accel/accel.sh@20 -- # IFS=: 00:06:46.719 18:53:03 -- accel/accel.sh@20 -- # read -r var val 00:06:46.719 18:53:03 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:46.719 18:53:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.719 18:53:03 -- accel/accel.sh@20 -- # IFS=: 00:06:46.719 18:53:03 -- accel/accel.sh@20 -- # read -r var val 00:06:46.719 18:53:03 -- accel/accel.sh@21 -- # val= 00:06:46.719 18:53:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.719 18:53:03 -- accel/accel.sh@20 -- # IFS=: 00:06:46.719 18:53:03 -- accel/accel.sh@20 -- # read -r var val 00:06:46.719 18:53:03 -- accel/accel.sh@21 -- # val=software 00:06:46.719 18:53:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.719 18:53:03 -- accel/accel.sh@23 -- # accel_module=software 00:06:46.719 18:53:03 -- accel/accel.sh@20 -- # IFS=: 00:06:46.719 18:53:03 -- accel/accel.sh@20 -- # read -r var val 00:06:46.719 18:53:03 -- accel/accel.sh@21 -- # val=32 00:06:46.720 18:53:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.720 18:53:03 -- accel/accel.sh@20 -- # IFS=: 00:06:46.720 18:53:03 -- accel/accel.sh@20 -- # read -r var val 00:06:46.720 18:53:03 -- accel/accel.sh@21 -- # val=32 00:06:46.720 18:53:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.720 18:53:03 -- accel/accel.sh@20 -- # IFS=: 00:06:46.720 18:53:03 -- accel/accel.sh@20 -- # read -r var val 00:06:46.720 18:53:03 -- accel/accel.sh@21 -- # val=1 00:06:46.720 18:53:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.720 18:53:03 -- accel/accel.sh@20 -- # IFS=: 00:06:46.720 18:53:03 -- accel/accel.sh@20 -- # read -r var val 00:06:46.720 18:53:03 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:46.720 18:53:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.720 18:53:03 -- accel/accel.sh@20 -- # IFS=: 00:06:46.720 18:53:03 -- accel/accel.sh@20 -- # read -r var val 00:06:46.720 18:53:03 -- accel/accel.sh@21 -- # val=Yes 00:06:46.720 18:53:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.720 18:53:03 -- accel/accel.sh@20 -- # IFS=: 00:06:46.720 18:53:03 -- accel/accel.sh@20 -- # read -r var val 00:06:46.720 18:53:03 -- accel/accel.sh@21 -- # val= 00:06:46.720 18:53:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.720 18:53:03 -- accel/accel.sh@20 -- # IFS=: 00:06:46.720 18:53:03 -- accel/accel.sh@20 -- # read -r var val 00:06:46.720 18:53:03 -- accel/accel.sh@21 -- # val= 00:06:46.720 18:53:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.720 18:53:03 -- accel/accel.sh@20 -- # IFS=: 00:06:46.720 18:53:03 -- accel/accel.sh@20 -- # read -r var val 00:06:47.660 18:53:04 -- accel/accel.sh@21 -- # val= 00:06:47.660 18:53:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:47.660 18:53:04 -- accel/accel.sh@20 -- # IFS=: 00:06:47.660 18:53:04 -- accel/accel.sh@20 -- # read -r var val 00:06:47.660 18:53:04 -- accel/accel.sh@21 -- # val= 00:06:47.660 18:53:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:47.660 18:53:04 -- accel/accel.sh@20 -- # IFS=: 00:06:47.660 18:53:04 -- accel/accel.sh@20 -- # read -r var val 00:06:47.660 18:53:04 -- accel/accel.sh@21 -- # val= 00:06:47.660 18:53:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:47.660 18:53:04 -- accel/accel.sh@20 -- # IFS=: 00:06:47.660 18:53:04 -- accel/accel.sh@20 -- # read -r var val 00:06:47.660 18:53:04 -- accel/accel.sh@21 -- # val= 00:06:47.660 18:53:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:47.660 18:53:04 -- accel/accel.sh@20 -- # IFS=: 00:06:47.660 18:53:04 -- accel/accel.sh@20 -- # read -r var val 00:06:47.660 18:53:04 -- accel/accel.sh@21 -- # val= 00:06:47.660 18:53:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:47.660 18:53:04 -- accel/accel.sh@20 -- # IFS=: 00:06:47.660 18:53:04 -- accel/accel.sh@20 -- # read -r var val 00:06:47.660 18:53:04 -- accel/accel.sh@21 -- # val= 00:06:47.660 18:53:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:47.660 18:53:04 -- accel/accel.sh@20 -- # IFS=: 00:06:47.660 18:53:04 -- accel/accel.sh@20 -- # read -r var val 00:06:47.660 18:53:04 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:47.660 18:53:04 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:06:47.660 18:53:04 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:47.660 00:06:47.660 real 0m2.572s 00:06:47.660 user 0m2.347s 00:06:47.660 sys 0m0.226s 00:06:47.660 18:53:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:47.660 18:53:04 -- common/autotest_common.sh@10 -- # set +x 00:06:47.660 ************************************ 00:06:47.660 END TEST accel_copy_crc32c 00:06:47.660 ************************************ 00:06:47.660 18:53:04 -- accel/accel.sh@98 -- # run_test accel_copy_crc32c_C2 accel_test -t 1 -w copy_crc32c -y -C 2 00:06:47.660 18:53:04 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:06:47.660 18:53:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:47.660 18:53:04 -- common/autotest_common.sh@10 -- # set +x 00:06:47.660 ************************************ 00:06:47.660 START TEST accel_copy_crc32c_C2 00:06:47.660 ************************************ 00:06:47.660 18:53:04 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y -C 2 00:06:47.660 18:53:04 -- accel/accel.sh@16 -- # local accel_opc 00:06:47.660 18:53:04 -- accel/accel.sh@17 -- # local accel_module 00:06:47.660 18:53:04 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:06:47.660 18:53:04 -- accel/accel.sh@12 -- # build_accel_config 00:06:47.660 18:53:04 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:06:47.660 18:53:04 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:47.660 18:53:04 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:47.660 18:53:04 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:47.660 18:53:04 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:47.660 18:53:04 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:47.660 18:53:04 -- accel/accel.sh@41 -- # local IFS=, 00:06:47.660 18:53:04 -- accel/accel.sh@42 -- # jq -r . 00:06:47.920 [2024-11-26 18:53:04.604517] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:47.920 [2024-11-26 18:53:04.604592] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2936919 ] 00:06:47.920 EAL: No free 2048 kB hugepages reported on node 1 00:06:47.920 [2024-11-26 18:53:04.660395] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:47.920 [2024-11-26 18:53:04.697723] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:49.299 18:53:05 -- accel/accel.sh@18 -- # out=' 00:06:49.299 SPDK Configuration: 00:06:49.299 Core mask: 0x1 00:06:49.299 00:06:49.299 Accel Perf Configuration: 00:06:49.299 Workload Type: copy_crc32c 00:06:49.299 CRC-32C seed: 0 00:06:49.299 Vector size: 4096 bytes 00:06:49.299 Transfer size: 8192 bytes 00:06:49.299 Vector count 2 00:06:49.299 Module: software 00:06:49.299 Queue depth: 32 00:06:49.299 Allocate depth: 32 00:06:49.299 # threads/core: 1 00:06:49.299 Run time: 1 seconds 00:06:49.299 Verify: Yes 00:06:49.299 00:06:49.299 Running for 1 seconds... 00:06:49.299 00:06:49.299 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:49.299 ------------------------------------------------------------------------------------ 00:06:49.299 0,0 234528/s 1832 MiB/s 0 0 00:06:49.299 ==================================================================================== 00:06:49.299 Total 234528/s 916 MiB/s 0 0' 00:06:49.299 18:53:05 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:06:49.299 18:53:05 -- accel/accel.sh@20 -- # IFS=: 00:06:49.299 18:53:05 -- accel/accel.sh@20 -- # read -r var val 00:06:49.299 18:53:05 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:06:49.299 18:53:05 -- accel/accel.sh@12 -- # build_accel_config 00:06:49.299 18:53:05 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:49.299 18:53:05 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:49.299 18:53:05 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:49.299 18:53:05 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:49.299 18:53:05 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:49.299 18:53:05 -- accel/accel.sh@41 -- # local IFS=, 00:06:49.299 18:53:05 -- accel/accel.sh@42 -- # jq -r . 00:06:49.299 [2024-11-26 18:53:05.877184] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:49.299 [2024-11-26 18:53:05.877232] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2937097 ] 00:06:49.299 EAL: No free 2048 kB hugepages reported on node 1 00:06:49.299 [2024-11-26 18:53:05.926319] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:49.299 [2024-11-26 18:53:05.963192] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:49.299 18:53:06 -- accel/accel.sh@21 -- # val= 00:06:49.299 18:53:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.299 18:53:06 -- accel/accel.sh@20 -- # IFS=: 00:06:49.299 18:53:06 -- accel/accel.sh@20 -- # read -r var val 00:06:49.299 18:53:06 -- accel/accel.sh@21 -- # val= 00:06:49.299 18:53:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.299 18:53:06 -- accel/accel.sh@20 -- # IFS=: 00:06:49.299 18:53:06 -- accel/accel.sh@20 -- # read -r var val 00:06:49.299 18:53:06 -- accel/accel.sh@21 -- # val=0x1 00:06:49.299 18:53:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.299 18:53:06 -- accel/accel.sh@20 -- # IFS=: 00:06:49.299 18:53:06 -- accel/accel.sh@20 -- # read -r var val 00:06:49.299 18:53:06 -- accel/accel.sh@21 -- # val= 00:06:49.299 18:53:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.299 18:53:06 -- accel/accel.sh@20 -- # IFS=: 00:06:49.299 18:53:06 -- accel/accel.sh@20 -- # read -r var val 00:06:49.299 18:53:06 -- accel/accel.sh@21 -- # val= 00:06:49.299 18:53:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.299 18:53:06 -- accel/accel.sh@20 -- # IFS=: 00:06:49.299 18:53:06 -- accel/accel.sh@20 -- # read -r var val 00:06:49.299 18:53:06 -- accel/accel.sh@21 -- # val=copy_crc32c 00:06:49.299 18:53:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.299 18:53:06 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:06:49.299 18:53:06 -- accel/accel.sh@20 -- # IFS=: 00:06:49.299 18:53:06 -- accel/accel.sh@20 -- # read -r var val 00:06:49.299 18:53:06 -- accel/accel.sh@21 -- # val=0 00:06:49.299 18:53:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.299 18:53:06 -- accel/accel.sh@20 -- # IFS=: 00:06:49.299 18:53:06 -- accel/accel.sh@20 -- # read -r var val 00:06:49.299 18:53:06 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:49.299 18:53:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.299 18:53:06 -- accel/accel.sh@20 -- # IFS=: 00:06:49.299 18:53:06 -- accel/accel.sh@20 -- # read -r var val 00:06:49.299 18:53:06 -- accel/accel.sh@21 -- # val='8192 bytes' 00:06:49.299 18:53:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.299 18:53:06 -- accel/accel.sh@20 -- # IFS=: 00:06:49.299 18:53:06 -- accel/accel.sh@20 -- # read -r var val 00:06:49.299 18:53:06 -- accel/accel.sh@21 -- # val= 00:06:49.299 18:53:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.299 18:53:06 -- accel/accel.sh@20 -- # IFS=: 00:06:49.299 18:53:06 -- accel/accel.sh@20 -- # read -r var val 00:06:49.299 18:53:06 -- accel/accel.sh@21 -- # val=software 00:06:49.299 18:53:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.299 18:53:06 -- accel/accel.sh@23 -- # accel_module=software 00:06:49.299 18:53:06 -- accel/accel.sh@20 -- # IFS=: 00:06:49.300 18:53:06 -- accel/accel.sh@20 -- # read -r var val 00:06:49.300 18:53:06 -- accel/accel.sh@21 -- # val=32 00:06:49.300 18:53:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.300 18:53:06 -- accel/accel.sh@20 -- # IFS=: 00:06:49.300 18:53:06 -- accel/accel.sh@20 -- # read -r var val 00:06:49.300 18:53:06 -- accel/accel.sh@21 -- # val=32 00:06:49.300 18:53:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.300 18:53:06 -- accel/accel.sh@20 -- # IFS=: 00:06:49.300 18:53:06 -- accel/accel.sh@20 -- # read -r var val 00:06:49.300 18:53:06 -- accel/accel.sh@21 -- # val=1 00:06:49.300 18:53:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.300 18:53:06 -- accel/accel.sh@20 -- # IFS=: 00:06:49.300 18:53:06 -- accel/accel.sh@20 -- # read -r var val 00:06:49.300 18:53:06 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:49.300 18:53:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.300 18:53:06 -- accel/accel.sh@20 -- # IFS=: 00:06:49.300 18:53:06 -- accel/accel.sh@20 -- # read -r var val 00:06:49.300 18:53:06 -- accel/accel.sh@21 -- # val=Yes 00:06:49.300 18:53:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.300 18:53:06 -- accel/accel.sh@20 -- # IFS=: 00:06:49.300 18:53:06 -- accel/accel.sh@20 -- # read -r var val 00:06:49.300 18:53:06 -- accel/accel.sh@21 -- # val= 00:06:49.300 18:53:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.300 18:53:06 -- accel/accel.sh@20 -- # IFS=: 00:06:49.300 18:53:06 -- accel/accel.sh@20 -- # read -r var val 00:06:49.300 18:53:06 -- accel/accel.sh@21 -- # val= 00:06:49.300 18:53:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.300 18:53:06 -- accel/accel.sh@20 -- # IFS=: 00:06:49.300 18:53:06 -- accel/accel.sh@20 -- # read -r var val 00:06:50.238 18:53:07 -- accel/accel.sh@21 -- # val= 00:06:50.238 18:53:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:50.239 18:53:07 -- accel/accel.sh@20 -- # IFS=: 00:06:50.239 18:53:07 -- accel/accel.sh@20 -- # read -r var val 00:06:50.239 18:53:07 -- accel/accel.sh@21 -- # val= 00:06:50.239 18:53:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:50.239 18:53:07 -- accel/accel.sh@20 -- # IFS=: 00:06:50.239 18:53:07 -- accel/accel.sh@20 -- # read -r var val 00:06:50.239 18:53:07 -- accel/accel.sh@21 -- # val= 00:06:50.239 18:53:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:50.239 18:53:07 -- accel/accel.sh@20 -- # IFS=: 00:06:50.239 18:53:07 -- accel/accel.sh@20 -- # read -r var val 00:06:50.239 18:53:07 -- accel/accel.sh@21 -- # val= 00:06:50.239 18:53:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:50.239 18:53:07 -- accel/accel.sh@20 -- # IFS=: 00:06:50.239 18:53:07 -- accel/accel.sh@20 -- # read -r var val 00:06:50.239 18:53:07 -- accel/accel.sh@21 -- # val= 00:06:50.239 18:53:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:50.239 18:53:07 -- accel/accel.sh@20 -- # IFS=: 00:06:50.239 18:53:07 -- accel/accel.sh@20 -- # read -r var val 00:06:50.239 18:53:07 -- accel/accel.sh@21 -- # val= 00:06:50.239 18:53:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:50.239 18:53:07 -- accel/accel.sh@20 -- # IFS=: 00:06:50.239 18:53:07 -- accel/accel.sh@20 -- # read -r var val 00:06:50.239 18:53:07 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:50.239 18:53:07 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:06:50.239 18:53:07 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:50.239 00:06:50.239 real 0m2.558s 00:06:50.239 user 0m2.353s 00:06:50.239 sys 0m0.215s 00:06:50.239 18:53:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:50.239 18:53:07 -- common/autotest_common.sh@10 -- # set +x 00:06:50.239 ************************************ 00:06:50.239 END TEST accel_copy_crc32c_C2 00:06:50.239 ************************************ 00:06:50.239 18:53:07 -- accel/accel.sh@99 -- # run_test accel_dualcast accel_test -t 1 -w dualcast -y 00:06:50.239 18:53:07 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:50.239 18:53:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:50.239 18:53:07 -- common/autotest_common.sh@10 -- # set +x 00:06:50.498 ************************************ 00:06:50.498 START TEST accel_dualcast 00:06:50.498 ************************************ 00:06:50.498 18:53:07 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dualcast -y 00:06:50.498 18:53:07 -- accel/accel.sh@16 -- # local accel_opc 00:06:50.498 18:53:07 -- accel/accel.sh@17 -- # local accel_module 00:06:50.498 18:53:07 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dualcast -y 00:06:50.498 18:53:07 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:06:50.498 18:53:07 -- accel/accel.sh@12 -- # build_accel_config 00:06:50.498 18:53:07 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:50.498 18:53:07 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:50.498 18:53:07 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:50.498 18:53:07 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:50.498 18:53:07 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:50.498 18:53:07 -- accel/accel.sh@41 -- # local IFS=, 00:06:50.498 18:53:07 -- accel/accel.sh@42 -- # jq -r . 00:06:50.498 [2024-11-26 18:53:07.192489] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:50.498 [2024-11-26 18:53:07.192563] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2937295 ] 00:06:50.498 EAL: No free 2048 kB hugepages reported on node 1 00:06:50.498 [2024-11-26 18:53:07.248093] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:50.498 [2024-11-26 18:53:07.285637] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:51.877 18:53:08 -- accel/accel.sh@18 -- # out=' 00:06:51.878 SPDK Configuration: 00:06:51.878 Core mask: 0x1 00:06:51.878 00:06:51.878 Accel Perf Configuration: 00:06:51.878 Workload Type: dualcast 00:06:51.878 Transfer size: 4096 bytes 00:06:51.878 Vector count 1 00:06:51.878 Module: software 00:06:51.878 Queue depth: 32 00:06:51.878 Allocate depth: 32 00:06:51.878 # threads/core: 1 00:06:51.878 Run time: 1 seconds 00:06:51.878 Verify: Yes 00:06:51.878 00:06:51.878 Running for 1 seconds... 00:06:51.878 00:06:51.878 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:51.878 ------------------------------------------------------------------------------------ 00:06:51.878 0,0 497760/s 1944 MiB/s 0 0 00:06:51.878 ==================================================================================== 00:06:51.878 Total 497760/s 1944 MiB/s 0 0' 00:06:51.878 18:53:08 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dualcast -y 00:06:51.878 18:53:08 -- accel/accel.sh@20 -- # IFS=: 00:06:51.878 18:53:08 -- accel/accel.sh@20 -- # read -r var val 00:06:51.878 18:53:08 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:06:51.878 18:53:08 -- accel/accel.sh@12 -- # build_accel_config 00:06:51.878 18:53:08 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:51.878 18:53:08 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:51.878 18:53:08 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:51.878 18:53:08 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:51.878 18:53:08 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:51.878 18:53:08 -- accel/accel.sh@41 -- # local IFS=, 00:06:51.878 18:53:08 -- accel/accel.sh@42 -- # jq -r . 00:06:51.878 [2024-11-26 18:53:08.468433] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:51.878 [2024-11-26 18:53:08.468488] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2937481 ] 00:06:51.878 EAL: No free 2048 kB hugepages reported on node 1 00:06:51.878 [2024-11-26 18:53:08.522723] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:51.878 [2024-11-26 18:53:08.559335] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:51.878 18:53:08 -- accel/accel.sh@21 -- # val= 00:06:51.878 18:53:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.878 18:53:08 -- accel/accel.sh@20 -- # IFS=: 00:06:51.878 18:53:08 -- accel/accel.sh@20 -- # read -r var val 00:06:51.878 18:53:08 -- accel/accel.sh@21 -- # val= 00:06:51.878 18:53:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.878 18:53:08 -- accel/accel.sh@20 -- # IFS=: 00:06:51.878 18:53:08 -- accel/accel.sh@20 -- # read -r var val 00:06:51.878 18:53:08 -- accel/accel.sh@21 -- # val=0x1 00:06:51.878 18:53:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.878 18:53:08 -- accel/accel.sh@20 -- # IFS=: 00:06:51.878 18:53:08 -- accel/accel.sh@20 -- # read -r var val 00:06:51.878 18:53:08 -- accel/accel.sh@21 -- # val= 00:06:51.878 18:53:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.878 18:53:08 -- accel/accel.sh@20 -- # IFS=: 00:06:51.878 18:53:08 -- accel/accel.sh@20 -- # read -r var val 00:06:51.878 18:53:08 -- accel/accel.sh@21 -- # val= 00:06:51.878 18:53:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.878 18:53:08 -- accel/accel.sh@20 -- # IFS=: 00:06:51.878 18:53:08 -- accel/accel.sh@20 -- # read -r var val 00:06:51.878 18:53:08 -- accel/accel.sh@21 -- # val=dualcast 00:06:51.878 18:53:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.878 18:53:08 -- accel/accel.sh@24 -- # accel_opc=dualcast 00:06:51.878 18:53:08 -- accel/accel.sh@20 -- # IFS=: 00:06:51.878 18:53:08 -- accel/accel.sh@20 -- # read -r var val 00:06:51.878 18:53:08 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:51.878 18:53:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.878 18:53:08 -- accel/accel.sh@20 -- # IFS=: 00:06:51.878 18:53:08 -- accel/accel.sh@20 -- # read -r var val 00:06:51.878 18:53:08 -- accel/accel.sh@21 -- # val= 00:06:51.878 18:53:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.878 18:53:08 -- accel/accel.sh@20 -- # IFS=: 00:06:51.878 18:53:08 -- accel/accel.sh@20 -- # read -r var val 00:06:51.878 18:53:08 -- accel/accel.sh@21 -- # val=software 00:06:51.878 18:53:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.878 18:53:08 -- accel/accel.sh@23 -- # accel_module=software 00:06:51.878 18:53:08 -- accel/accel.sh@20 -- # IFS=: 00:06:51.878 18:53:08 -- accel/accel.sh@20 -- # read -r var val 00:06:51.878 18:53:08 -- accel/accel.sh@21 -- # val=32 00:06:51.878 18:53:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.878 18:53:08 -- accel/accel.sh@20 -- # IFS=: 00:06:51.878 18:53:08 -- accel/accel.sh@20 -- # read -r var val 00:06:51.878 18:53:08 -- accel/accel.sh@21 -- # val=32 00:06:51.878 18:53:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.878 18:53:08 -- accel/accel.sh@20 -- # IFS=: 00:06:51.878 18:53:08 -- accel/accel.sh@20 -- # read -r var val 00:06:51.878 18:53:08 -- accel/accel.sh@21 -- # val=1 00:06:51.878 18:53:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.878 18:53:08 -- accel/accel.sh@20 -- # IFS=: 00:06:51.878 18:53:08 -- accel/accel.sh@20 -- # read -r var val 00:06:51.878 18:53:08 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:51.878 18:53:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.878 18:53:08 -- accel/accel.sh@20 -- # IFS=: 00:06:51.878 18:53:08 -- accel/accel.sh@20 -- # read -r var val 00:06:51.878 18:53:08 -- accel/accel.sh@21 -- # val=Yes 00:06:51.878 18:53:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.878 18:53:08 -- accel/accel.sh@20 -- # IFS=: 00:06:51.878 18:53:08 -- accel/accel.sh@20 -- # read -r var val 00:06:51.878 18:53:08 -- accel/accel.sh@21 -- # val= 00:06:51.878 18:53:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.878 18:53:08 -- accel/accel.sh@20 -- # IFS=: 00:06:51.878 18:53:08 -- accel/accel.sh@20 -- # read -r var val 00:06:51.878 18:53:08 -- accel/accel.sh@21 -- # val= 00:06:51.878 18:53:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.878 18:53:08 -- accel/accel.sh@20 -- # IFS=: 00:06:51.878 18:53:08 -- accel/accel.sh@20 -- # read -r var val 00:06:52.812 18:53:09 -- accel/accel.sh@21 -- # val= 00:06:52.812 18:53:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.812 18:53:09 -- accel/accel.sh@20 -- # IFS=: 00:06:52.812 18:53:09 -- accel/accel.sh@20 -- # read -r var val 00:06:52.812 18:53:09 -- accel/accel.sh@21 -- # val= 00:06:52.812 18:53:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.812 18:53:09 -- accel/accel.sh@20 -- # IFS=: 00:06:52.812 18:53:09 -- accel/accel.sh@20 -- # read -r var val 00:06:52.812 18:53:09 -- accel/accel.sh@21 -- # val= 00:06:52.812 18:53:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.812 18:53:09 -- accel/accel.sh@20 -- # IFS=: 00:06:52.812 18:53:09 -- accel/accel.sh@20 -- # read -r var val 00:06:52.812 18:53:09 -- accel/accel.sh@21 -- # val= 00:06:52.812 18:53:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.812 18:53:09 -- accel/accel.sh@20 -- # IFS=: 00:06:52.812 18:53:09 -- accel/accel.sh@20 -- # read -r var val 00:06:52.812 18:53:09 -- accel/accel.sh@21 -- # val= 00:06:52.812 18:53:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.812 18:53:09 -- accel/accel.sh@20 -- # IFS=: 00:06:52.812 18:53:09 -- accel/accel.sh@20 -- # read -r var val 00:06:52.812 18:53:09 -- accel/accel.sh@21 -- # val= 00:06:52.812 18:53:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.812 18:53:09 -- accel/accel.sh@20 -- # IFS=: 00:06:52.812 18:53:09 -- accel/accel.sh@20 -- # read -r var val 00:06:52.812 18:53:09 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:52.812 18:53:09 -- accel/accel.sh@28 -- # [[ -n dualcast ]] 00:06:52.812 18:53:09 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:52.812 00:06:52.812 real 0m2.566s 00:06:52.812 user 0m2.355s 00:06:52.812 sys 0m0.220s 00:06:52.812 18:53:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:52.812 18:53:09 -- common/autotest_common.sh@10 -- # set +x 00:06:52.812 ************************************ 00:06:52.812 END TEST accel_dualcast 00:06:52.812 ************************************ 00:06:53.071 18:53:09 -- accel/accel.sh@100 -- # run_test accel_compare accel_test -t 1 -w compare -y 00:06:53.071 18:53:09 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:53.071 18:53:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:53.071 18:53:09 -- common/autotest_common.sh@10 -- # set +x 00:06:53.071 ************************************ 00:06:53.071 START TEST accel_compare 00:06:53.071 ************************************ 00:06:53.071 18:53:09 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compare -y 00:06:53.071 18:53:09 -- accel/accel.sh@16 -- # local accel_opc 00:06:53.071 18:53:09 -- accel/accel.sh@17 -- # local accel_module 00:06:53.071 18:53:09 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compare -y 00:06:53.072 18:53:09 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:06:53.072 18:53:09 -- accel/accel.sh@12 -- # build_accel_config 00:06:53.072 18:53:09 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:53.072 18:53:09 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:53.072 18:53:09 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:53.072 18:53:09 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:53.072 18:53:09 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:53.072 18:53:09 -- accel/accel.sh@41 -- # local IFS=, 00:06:53.072 18:53:09 -- accel/accel.sh@42 -- # jq -r . 00:06:53.072 [2024-11-26 18:53:09.790640] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:53.072 [2024-11-26 18:53:09.790698] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2937727 ] 00:06:53.072 EAL: No free 2048 kB hugepages reported on node 1 00:06:53.072 [2024-11-26 18:53:09.846312] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:53.072 [2024-11-26 18:53:09.884182] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:54.450 18:53:11 -- accel/accel.sh@18 -- # out=' 00:06:54.450 SPDK Configuration: 00:06:54.450 Core mask: 0x1 00:06:54.450 00:06:54.450 Accel Perf Configuration: 00:06:54.450 Workload Type: compare 00:06:54.450 Transfer size: 4096 bytes 00:06:54.450 Vector count 1 00:06:54.450 Module: software 00:06:54.450 Queue depth: 32 00:06:54.450 Allocate depth: 32 00:06:54.450 # threads/core: 1 00:06:54.450 Run time: 1 seconds 00:06:54.450 Verify: Yes 00:06:54.450 00:06:54.450 Running for 1 seconds... 00:06:54.450 00:06:54.450 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:54.450 ------------------------------------------------------------------------------------ 00:06:54.450 0,0 592064/s 2312 MiB/s 0 0 00:06:54.450 ==================================================================================== 00:06:54.450 Total 592064/s 2312 MiB/s 0 0' 00:06:54.450 18:53:11 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compare -y 00:06:54.450 18:53:11 -- accel/accel.sh@20 -- # IFS=: 00:06:54.450 18:53:11 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:06:54.450 18:53:11 -- accel/accel.sh@20 -- # read -r var val 00:06:54.450 18:53:11 -- accel/accel.sh@12 -- # build_accel_config 00:06:54.450 18:53:11 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:54.450 18:53:11 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:54.450 18:53:11 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:54.450 18:53:11 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:54.450 18:53:11 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:54.450 18:53:11 -- accel/accel.sh@41 -- # local IFS=, 00:06:54.450 18:53:11 -- accel/accel.sh@42 -- # jq -r . 00:06:54.450 [2024-11-26 18:53:11.065271] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:54.450 [2024-11-26 18:53:11.065318] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2937963 ] 00:06:54.450 EAL: No free 2048 kB hugepages reported on node 1 00:06:54.450 [2024-11-26 18:53:11.113480] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:54.450 [2024-11-26 18:53:11.150647] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:54.450 18:53:11 -- accel/accel.sh@21 -- # val= 00:06:54.450 18:53:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.450 18:53:11 -- accel/accel.sh@20 -- # IFS=: 00:06:54.450 18:53:11 -- accel/accel.sh@20 -- # read -r var val 00:06:54.450 18:53:11 -- accel/accel.sh@21 -- # val= 00:06:54.451 18:53:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.451 18:53:11 -- accel/accel.sh@20 -- # IFS=: 00:06:54.451 18:53:11 -- accel/accel.sh@20 -- # read -r var val 00:06:54.451 18:53:11 -- accel/accel.sh@21 -- # val=0x1 00:06:54.451 18:53:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.451 18:53:11 -- accel/accel.sh@20 -- # IFS=: 00:06:54.451 18:53:11 -- accel/accel.sh@20 -- # read -r var val 00:06:54.451 18:53:11 -- accel/accel.sh@21 -- # val= 00:06:54.451 18:53:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.451 18:53:11 -- accel/accel.sh@20 -- # IFS=: 00:06:54.451 18:53:11 -- accel/accel.sh@20 -- # read -r var val 00:06:54.451 18:53:11 -- accel/accel.sh@21 -- # val= 00:06:54.451 18:53:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.451 18:53:11 -- accel/accel.sh@20 -- # IFS=: 00:06:54.451 18:53:11 -- accel/accel.sh@20 -- # read -r var val 00:06:54.451 18:53:11 -- accel/accel.sh@21 -- # val=compare 00:06:54.451 18:53:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.451 18:53:11 -- accel/accel.sh@24 -- # accel_opc=compare 00:06:54.451 18:53:11 -- accel/accel.sh@20 -- # IFS=: 00:06:54.451 18:53:11 -- accel/accel.sh@20 -- # read -r var val 00:06:54.451 18:53:11 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:54.451 18:53:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.451 18:53:11 -- accel/accel.sh@20 -- # IFS=: 00:06:54.451 18:53:11 -- accel/accel.sh@20 -- # read -r var val 00:06:54.451 18:53:11 -- accel/accel.sh@21 -- # val= 00:06:54.451 18:53:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.451 18:53:11 -- accel/accel.sh@20 -- # IFS=: 00:06:54.451 18:53:11 -- accel/accel.sh@20 -- # read -r var val 00:06:54.451 18:53:11 -- accel/accel.sh@21 -- # val=software 00:06:54.451 18:53:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.451 18:53:11 -- accel/accel.sh@23 -- # accel_module=software 00:06:54.451 18:53:11 -- accel/accel.sh@20 -- # IFS=: 00:06:54.451 18:53:11 -- accel/accel.sh@20 -- # read -r var val 00:06:54.451 18:53:11 -- accel/accel.sh@21 -- # val=32 00:06:54.451 18:53:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.451 18:53:11 -- accel/accel.sh@20 -- # IFS=: 00:06:54.451 18:53:11 -- accel/accel.sh@20 -- # read -r var val 00:06:54.451 18:53:11 -- accel/accel.sh@21 -- # val=32 00:06:54.451 18:53:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.451 18:53:11 -- accel/accel.sh@20 -- # IFS=: 00:06:54.451 18:53:11 -- accel/accel.sh@20 -- # read -r var val 00:06:54.451 18:53:11 -- accel/accel.sh@21 -- # val=1 00:06:54.451 18:53:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.451 18:53:11 -- accel/accel.sh@20 -- # IFS=: 00:06:54.451 18:53:11 -- accel/accel.sh@20 -- # read -r var val 00:06:54.451 18:53:11 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:54.451 18:53:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.451 18:53:11 -- accel/accel.sh@20 -- # IFS=: 00:06:54.451 18:53:11 -- accel/accel.sh@20 -- # read -r var val 00:06:54.451 18:53:11 -- accel/accel.sh@21 -- # val=Yes 00:06:54.451 18:53:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.451 18:53:11 -- accel/accel.sh@20 -- # IFS=: 00:06:54.451 18:53:11 -- accel/accel.sh@20 -- # read -r var val 00:06:54.451 18:53:11 -- accel/accel.sh@21 -- # val= 00:06:54.451 18:53:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.451 18:53:11 -- accel/accel.sh@20 -- # IFS=: 00:06:54.451 18:53:11 -- accel/accel.sh@20 -- # read -r var val 00:06:54.451 18:53:11 -- accel/accel.sh@21 -- # val= 00:06:54.451 18:53:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.451 18:53:11 -- accel/accel.sh@20 -- # IFS=: 00:06:54.451 18:53:11 -- accel/accel.sh@20 -- # read -r var val 00:06:55.831 18:53:12 -- accel/accel.sh@21 -- # val= 00:06:55.831 18:53:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.831 18:53:12 -- accel/accel.sh@20 -- # IFS=: 00:06:55.831 18:53:12 -- accel/accel.sh@20 -- # read -r var val 00:06:55.831 18:53:12 -- accel/accel.sh@21 -- # val= 00:06:55.831 18:53:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.831 18:53:12 -- accel/accel.sh@20 -- # IFS=: 00:06:55.831 18:53:12 -- accel/accel.sh@20 -- # read -r var val 00:06:55.831 18:53:12 -- accel/accel.sh@21 -- # val= 00:06:55.831 18:53:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.831 18:53:12 -- accel/accel.sh@20 -- # IFS=: 00:06:55.831 18:53:12 -- accel/accel.sh@20 -- # read -r var val 00:06:55.831 18:53:12 -- accel/accel.sh@21 -- # val= 00:06:55.831 18:53:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.831 18:53:12 -- accel/accel.sh@20 -- # IFS=: 00:06:55.831 18:53:12 -- accel/accel.sh@20 -- # read -r var val 00:06:55.831 18:53:12 -- accel/accel.sh@21 -- # val= 00:06:55.831 18:53:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.831 18:53:12 -- accel/accel.sh@20 -- # IFS=: 00:06:55.831 18:53:12 -- accel/accel.sh@20 -- # read -r var val 00:06:55.831 18:53:12 -- accel/accel.sh@21 -- # val= 00:06:55.831 18:53:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.831 18:53:12 -- accel/accel.sh@20 -- # IFS=: 00:06:55.831 18:53:12 -- accel/accel.sh@20 -- # read -r var val 00:06:55.831 18:53:12 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:55.831 18:53:12 -- accel/accel.sh@28 -- # [[ -n compare ]] 00:06:55.831 18:53:12 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:55.831 00:06:55.831 real 0m2.559s 00:06:55.831 user 0m2.348s 00:06:55.831 sys 0m0.217s 00:06:55.831 18:53:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:55.831 18:53:12 -- common/autotest_common.sh@10 -- # set +x 00:06:55.831 ************************************ 00:06:55.831 END TEST accel_compare 00:06:55.831 ************************************ 00:06:55.831 18:53:12 -- accel/accel.sh@101 -- # run_test accel_xor accel_test -t 1 -w xor -y 00:06:55.831 18:53:12 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:55.831 18:53:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:55.831 18:53:12 -- common/autotest_common.sh@10 -- # set +x 00:06:55.831 ************************************ 00:06:55.831 START TEST accel_xor 00:06:55.831 ************************************ 00:06:55.831 18:53:12 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y 00:06:55.831 18:53:12 -- accel/accel.sh@16 -- # local accel_opc 00:06:55.831 18:53:12 -- accel/accel.sh@17 -- # local accel_module 00:06:55.831 18:53:12 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y 00:06:55.831 18:53:12 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:06:55.831 18:53:12 -- accel/accel.sh@12 -- # build_accel_config 00:06:55.831 18:53:12 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:55.831 18:53:12 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:55.831 18:53:12 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:55.831 18:53:12 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:55.831 18:53:12 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:55.831 18:53:12 -- accel/accel.sh@41 -- # local IFS=, 00:06:55.831 18:53:12 -- accel/accel.sh@42 -- # jq -r . 00:06:55.831 [2024-11-26 18:53:12.385644] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:55.831 [2024-11-26 18:53:12.385720] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2938211 ] 00:06:55.831 EAL: No free 2048 kB hugepages reported on node 1 00:06:55.831 [2024-11-26 18:53:12.442559] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:55.831 [2024-11-26 18:53:12.479410] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:56.768 18:53:13 -- accel/accel.sh@18 -- # out=' 00:06:56.768 SPDK Configuration: 00:06:56.768 Core mask: 0x1 00:06:56.768 00:06:56.768 Accel Perf Configuration: 00:06:56.768 Workload Type: xor 00:06:56.768 Source buffers: 2 00:06:56.768 Transfer size: 4096 bytes 00:06:56.768 Vector count 1 00:06:56.768 Module: software 00:06:56.768 Queue depth: 32 00:06:56.768 Allocate depth: 32 00:06:56.768 # threads/core: 1 00:06:56.768 Run time: 1 seconds 00:06:56.768 Verify: Yes 00:06:56.768 00:06:56.768 Running for 1 seconds... 00:06:56.768 00:06:56.768 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:56.768 ------------------------------------------------------------------------------------ 00:06:56.768 0,0 483360/s 1888 MiB/s 0 0 00:06:56.768 ==================================================================================== 00:06:56.768 Total 483360/s 1888 MiB/s 0 0' 00:06:56.768 18:53:13 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y 00:06:56.768 18:53:13 -- accel/accel.sh@20 -- # IFS=: 00:06:56.768 18:53:13 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:06:56.768 18:53:13 -- accel/accel.sh@20 -- # read -r var val 00:06:56.768 18:53:13 -- accel/accel.sh@12 -- # build_accel_config 00:06:56.768 18:53:13 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:56.768 18:53:13 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:56.768 18:53:13 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:56.768 18:53:13 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:56.768 18:53:13 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:56.768 18:53:13 -- accel/accel.sh@41 -- # local IFS=, 00:06:56.768 18:53:13 -- accel/accel.sh@42 -- # jq -r . 00:06:56.768 [2024-11-26 18:53:13.659349] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:56.768 [2024-11-26 18:53:13.659401] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2938451 ] 00:06:56.768 EAL: No free 2048 kB hugepages reported on node 1 00:06:57.028 [2024-11-26 18:53:13.707929] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:57.028 [2024-11-26 18:53:13.744653] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:57.028 18:53:13 -- accel/accel.sh@21 -- # val= 00:06:57.028 18:53:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.028 18:53:13 -- accel/accel.sh@20 -- # IFS=: 00:06:57.028 18:53:13 -- accel/accel.sh@20 -- # read -r var val 00:06:57.028 18:53:13 -- accel/accel.sh@21 -- # val= 00:06:57.028 18:53:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.028 18:53:13 -- accel/accel.sh@20 -- # IFS=: 00:06:57.028 18:53:13 -- accel/accel.sh@20 -- # read -r var val 00:06:57.028 18:53:13 -- accel/accel.sh@21 -- # val=0x1 00:06:57.028 18:53:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.028 18:53:13 -- accel/accel.sh@20 -- # IFS=: 00:06:57.028 18:53:13 -- accel/accel.sh@20 -- # read -r var val 00:06:57.028 18:53:13 -- accel/accel.sh@21 -- # val= 00:06:57.028 18:53:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.028 18:53:13 -- accel/accel.sh@20 -- # IFS=: 00:06:57.028 18:53:13 -- accel/accel.sh@20 -- # read -r var val 00:06:57.028 18:53:13 -- accel/accel.sh@21 -- # val= 00:06:57.028 18:53:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.028 18:53:13 -- accel/accel.sh@20 -- # IFS=: 00:06:57.028 18:53:13 -- accel/accel.sh@20 -- # read -r var val 00:06:57.028 18:53:13 -- accel/accel.sh@21 -- # val=xor 00:06:57.028 18:53:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.028 18:53:13 -- accel/accel.sh@24 -- # accel_opc=xor 00:06:57.028 18:53:13 -- accel/accel.sh@20 -- # IFS=: 00:06:57.028 18:53:13 -- accel/accel.sh@20 -- # read -r var val 00:06:57.028 18:53:13 -- accel/accel.sh@21 -- # val=2 00:06:57.028 18:53:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.028 18:53:13 -- accel/accel.sh@20 -- # IFS=: 00:06:57.028 18:53:13 -- accel/accel.sh@20 -- # read -r var val 00:06:57.028 18:53:13 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:57.028 18:53:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.028 18:53:13 -- accel/accel.sh@20 -- # IFS=: 00:06:57.028 18:53:13 -- accel/accel.sh@20 -- # read -r var val 00:06:57.028 18:53:13 -- accel/accel.sh@21 -- # val= 00:06:57.028 18:53:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.028 18:53:13 -- accel/accel.sh@20 -- # IFS=: 00:06:57.028 18:53:13 -- accel/accel.sh@20 -- # read -r var val 00:06:57.028 18:53:13 -- accel/accel.sh@21 -- # val=software 00:06:57.028 18:53:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.028 18:53:13 -- accel/accel.sh@23 -- # accel_module=software 00:06:57.028 18:53:13 -- accel/accel.sh@20 -- # IFS=: 00:06:57.028 18:53:13 -- accel/accel.sh@20 -- # read -r var val 00:06:57.028 18:53:13 -- accel/accel.sh@21 -- # val=32 00:06:57.028 18:53:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.028 18:53:13 -- accel/accel.sh@20 -- # IFS=: 00:06:57.028 18:53:13 -- accel/accel.sh@20 -- # read -r var val 00:06:57.028 18:53:13 -- accel/accel.sh@21 -- # val=32 00:06:57.028 18:53:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.028 18:53:13 -- accel/accel.sh@20 -- # IFS=: 00:06:57.028 18:53:13 -- accel/accel.sh@20 -- # read -r var val 00:06:57.028 18:53:13 -- accel/accel.sh@21 -- # val=1 00:06:57.028 18:53:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.028 18:53:13 -- accel/accel.sh@20 -- # IFS=: 00:06:57.028 18:53:13 -- accel/accel.sh@20 -- # read -r var val 00:06:57.028 18:53:13 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:57.028 18:53:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.028 18:53:13 -- accel/accel.sh@20 -- # IFS=: 00:06:57.028 18:53:13 -- accel/accel.sh@20 -- # read -r var val 00:06:57.028 18:53:13 -- accel/accel.sh@21 -- # val=Yes 00:06:57.028 18:53:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.028 18:53:13 -- accel/accel.sh@20 -- # IFS=: 00:06:57.028 18:53:13 -- accel/accel.sh@20 -- # read -r var val 00:06:57.028 18:53:13 -- accel/accel.sh@21 -- # val= 00:06:57.028 18:53:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.028 18:53:13 -- accel/accel.sh@20 -- # IFS=: 00:06:57.028 18:53:13 -- accel/accel.sh@20 -- # read -r var val 00:06:57.028 18:53:13 -- accel/accel.sh@21 -- # val= 00:06:57.028 18:53:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.028 18:53:13 -- accel/accel.sh@20 -- # IFS=: 00:06:57.028 18:53:13 -- accel/accel.sh@20 -- # read -r var val 00:06:58.407 18:53:14 -- accel/accel.sh@21 -- # val= 00:06:58.407 18:53:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.407 18:53:14 -- accel/accel.sh@20 -- # IFS=: 00:06:58.407 18:53:14 -- accel/accel.sh@20 -- # read -r var val 00:06:58.407 18:53:14 -- accel/accel.sh@21 -- # val= 00:06:58.407 18:53:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.407 18:53:14 -- accel/accel.sh@20 -- # IFS=: 00:06:58.407 18:53:14 -- accel/accel.sh@20 -- # read -r var val 00:06:58.407 18:53:14 -- accel/accel.sh@21 -- # val= 00:06:58.407 18:53:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.407 18:53:14 -- accel/accel.sh@20 -- # IFS=: 00:06:58.407 18:53:14 -- accel/accel.sh@20 -- # read -r var val 00:06:58.407 18:53:14 -- accel/accel.sh@21 -- # val= 00:06:58.407 18:53:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.407 18:53:14 -- accel/accel.sh@20 -- # IFS=: 00:06:58.407 18:53:14 -- accel/accel.sh@20 -- # read -r var val 00:06:58.407 18:53:14 -- accel/accel.sh@21 -- # val= 00:06:58.407 18:53:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.407 18:53:14 -- accel/accel.sh@20 -- # IFS=: 00:06:58.407 18:53:14 -- accel/accel.sh@20 -- # read -r var val 00:06:58.407 18:53:14 -- accel/accel.sh@21 -- # val= 00:06:58.407 18:53:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.407 18:53:14 -- accel/accel.sh@20 -- # IFS=: 00:06:58.407 18:53:14 -- accel/accel.sh@20 -- # read -r var val 00:06:58.407 18:53:14 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:58.407 18:53:14 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:06:58.407 18:53:14 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:58.407 00:06:58.407 real 0m2.560s 00:06:58.407 user 0m2.353s 00:06:58.407 sys 0m0.216s 00:06:58.407 18:53:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:58.407 18:53:14 -- common/autotest_common.sh@10 -- # set +x 00:06:58.407 ************************************ 00:06:58.407 END TEST accel_xor 00:06:58.407 ************************************ 00:06:58.407 18:53:14 -- accel/accel.sh@102 -- # run_test accel_xor accel_test -t 1 -w xor -y -x 3 00:06:58.407 18:53:14 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:06:58.407 18:53:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:58.407 18:53:14 -- common/autotest_common.sh@10 -- # set +x 00:06:58.407 ************************************ 00:06:58.407 START TEST accel_xor 00:06:58.407 ************************************ 00:06:58.407 18:53:14 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y -x 3 00:06:58.407 18:53:14 -- accel/accel.sh@16 -- # local accel_opc 00:06:58.407 18:53:14 -- accel/accel.sh@17 -- # local accel_module 00:06:58.407 18:53:14 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y -x 3 00:06:58.407 18:53:14 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:06:58.407 18:53:14 -- accel/accel.sh@12 -- # build_accel_config 00:06:58.407 18:53:14 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:58.407 18:53:14 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:58.407 18:53:14 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:58.407 18:53:14 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:58.407 18:53:14 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:58.407 18:53:14 -- accel/accel.sh@41 -- # local IFS=, 00:06:58.407 18:53:14 -- accel/accel.sh@42 -- # jq -r . 00:06:58.407 [2024-11-26 18:53:14.977898] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:58.407 [2024-11-26 18:53:14.977977] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2938698 ] 00:06:58.407 EAL: No free 2048 kB hugepages reported on node 1 00:06:58.407 [2024-11-26 18:53:15.034940] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:58.407 [2024-11-26 18:53:15.071825] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:59.344 18:53:16 -- accel/accel.sh@18 -- # out=' 00:06:59.344 SPDK Configuration: 00:06:59.344 Core mask: 0x1 00:06:59.344 00:06:59.344 Accel Perf Configuration: 00:06:59.344 Workload Type: xor 00:06:59.344 Source buffers: 3 00:06:59.344 Transfer size: 4096 bytes 00:06:59.344 Vector count 1 00:06:59.344 Module: software 00:06:59.344 Queue depth: 32 00:06:59.344 Allocate depth: 32 00:06:59.344 # threads/core: 1 00:06:59.344 Run time: 1 seconds 00:06:59.344 Verify: Yes 00:06:59.344 00:06:59.344 Running for 1 seconds... 00:06:59.344 00:06:59.344 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:59.344 ------------------------------------------------------------------------------------ 00:06:59.344 0,0 452416/s 1767 MiB/s 0 0 00:06:59.344 ==================================================================================== 00:06:59.344 Total 452416/s 1767 MiB/s 0 0' 00:06:59.344 18:53:16 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y -x 3 00:06:59.344 18:53:16 -- accel/accel.sh@20 -- # IFS=: 00:06:59.344 18:53:16 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:06:59.344 18:53:16 -- accel/accel.sh@20 -- # read -r var val 00:06:59.344 18:53:16 -- accel/accel.sh@12 -- # build_accel_config 00:06:59.344 18:53:16 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:59.344 18:53:16 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:59.344 18:53:16 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:59.344 18:53:16 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:59.345 18:53:16 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:59.345 18:53:16 -- accel/accel.sh@41 -- # local IFS=, 00:06:59.345 18:53:16 -- accel/accel.sh@42 -- # jq -r . 00:06:59.345 [2024-11-26 18:53:16.251574] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:59.345 [2024-11-26 18:53:16.251620] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2938932 ] 00:06:59.604 EAL: No free 2048 kB hugepages reported on node 1 00:06:59.604 [2024-11-26 18:53:16.299552] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:59.604 [2024-11-26 18:53:16.336245] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:59.604 18:53:16 -- accel/accel.sh@21 -- # val= 00:06:59.604 18:53:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.604 18:53:16 -- accel/accel.sh@20 -- # IFS=: 00:06:59.604 18:53:16 -- accel/accel.sh@20 -- # read -r var val 00:06:59.604 18:53:16 -- accel/accel.sh@21 -- # val= 00:06:59.604 18:53:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.604 18:53:16 -- accel/accel.sh@20 -- # IFS=: 00:06:59.604 18:53:16 -- accel/accel.sh@20 -- # read -r var val 00:06:59.604 18:53:16 -- accel/accel.sh@21 -- # val=0x1 00:06:59.604 18:53:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.604 18:53:16 -- accel/accel.sh@20 -- # IFS=: 00:06:59.604 18:53:16 -- accel/accel.sh@20 -- # read -r var val 00:06:59.604 18:53:16 -- accel/accel.sh@21 -- # val= 00:06:59.604 18:53:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.604 18:53:16 -- accel/accel.sh@20 -- # IFS=: 00:06:59.604 18:53:16 -- accel/accel.sh@20 -- # read -r var val 00:06:59.604 18:53:16 -- accel/accel.sh@21 -- # val= 00:06:59.604 18:53:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.604 18:53:16 -- accel/accel.sh@20 -- # IFS=: 00:06:59.604 18:53:16 -- accel/accel.sh@20 -- # read -r var val 00:06:59.604 18:53:16 -- accel/accel.sh@21 -- # val=xor 00:06:59.604 18:53:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.604 18:53:16 -- accel/accel.sh@24 -- # accel_opc=xor 00:06:59.604 18:53:16 -- accel/accel.sh@20 -- # IFS=: 00:06:59.604 18:53:16 -- accel/accel.sh@20 -- # read -r var val 00:06:59.604 18:53:16 -- accel/accel.sh@21 -- # val=3 00:06:59.604 18:53:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.604 18:53:16 -- accel/accel.sh@20 -- # IFS=: 00:06:59.604 18:53:16 -- accel/accel.sh@20 -- # read -r var val 00:06:59.604 18:53:16 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:59.604 18:53:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.604 18:53:16 -- accel/accel.sh@20 -- # IFS=: 00:06:59.604 18:53:16 -- accel/accel.sh@20 -- # read -r var val 00:06:59.604 18:53:16 -- accel/accel.sh@21 -- # val= 00:06:59.604 18:53:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.604 18:53:16 -- accel/accel.sh@20 -- # IFS=: 00:06:59.604 18:53:16 -- accel/accel.sh@20 -- # read -r var val 00:06:59.604 18:53:16 -- accel/accel.sh@21 -- # val=software 00:06:59.604 18:53:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.604 18:53:16 -- accel/accel.sh@23 -- # accel_module=software 00:06:59.604 18:53:16 -- accel/accel.sh@20 -- # IFS=: 00:06:59.604 18:53:16 -- accel/accel.sh@20 -- # read -r var val 00:06:59.604 18:53:16 -- accel/accel.sh@21 -- # val=32 00:06:59.604 18:53:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.604 18:53:16 -- accel/accel.sh@20 -- # IFS=: 00:06:59.604 18:53:16 -- accel/accel.sh@20 -- # read -r var val 00:06:59.604 18:53:16 -- accel/accel.sh@21 -- # val=32 00:06:59.604 18:53:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.604 18:53:16 -- accel/accel.sh@20 -- # IFS=: 00:06:59.604 18:53:16 -- accel/accel.sh@20 -- # read -r var val 00:06:59.604 18:53:16 -- accel/accel.sh@21 -- # val=1 00:06:59.604 18:53:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.604 18:53:16 -- accel/accel.sh@20 -- # IFS=: 00:06:59.604 18:53:16 -- accel/accel.sh@20 -- # read -r var val 00:06:59.604 18:53:16 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:59.604 18:53:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.604 18:53:16 -- accel/accel.sh@20 -- # IFS=: 00:06:59.604 18:53:16 -- accel/accel.sh@20 -- # read -r var val 00:06:59.604 18:53:16 -- accel/accel.sh@21 -- # val=Yes 00:06:59.604 18:53:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.604 18:53:16 -- accel/accel.sh@20 -- # IFS=: 00:06:59.604 18:53:16 -- accel/accel.sh@20 -- # read -r var val 00:06:59.604 18:53:16 -- accel/accel.sh@21 -- # val= 00:06:59.604 18:53:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.604 18:53:16 -- accel/accel.sh@20 -- # IFS=: 00:06:59.604 18:53:16 -- accel/accel.sh@20 -- # read -r var val 00:06:59.604 18:53:16 -- accel/accel.sh@21 -- # val= 00:06:59.604 18:53:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.604 18:53:16 -- accel/accel.sh@20 -- # IFS=: 00:06:59.604 18:53:16 -- accel/accel.sh@20 -- # read -r var val 00:07:00.980 18:53:17 -- accel/accel.sh@21 -- # val= 00:07:00.980 18:53:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.980 18:53:17 -- accel/accel.sh@20 -- # IFS=: 00:07:00.980 18:53:17 -- accel/accel.sh@20 -- # read -r var val 00:07:00.980 18:53:17 -- accel/accel.sh@21 -- # val= 00:07:00.980 18:53:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.980 18:53:17 -- accel/accel.sh@20 -- # IFS=: 00:07:00.980 18:53:17 -- accel/accel.sh@20 -- # read -r var val 00:07:00.980 18:53:17 -- accel/accel.sh@21 -- # val= 00:07:00.980 18:53:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.980 18:53:17 -- accel/accel.sh@20 -- # IFS=: 00:07:00.980 18:53:17 -- accel/accel.sh@20 -- # read -r var val 00:07:00.980 18:53:17 -- accel/accel.sh@21 -- # val= 00:07:00.980 18:53:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.980 18:53:17 -- accel/accel.sh@20 -- # IFS=: 00:07:00.980 18:53:17 -- accel/accel.sh@20 -- # read -r var val 00:07:00.980 18:53:17 -- accel/accel.sh@21 -- # val= 00:07:00.980 18:53:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.980 18:53:17 -- accel/accel.sh@20 -- # IFS=: 00:07:00.980 18:53:17 -- accel/accel.sh@20 -- # read -r var val 00:07:00.980 18:53:17 -- accel/accel.sh@21 -- # val= 00:07:00.980 18:53:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.980 18:53:17 -- accel/accel.sh@20 -- # IFS=: 00:07:00.980 18:53:17 -- accel/accel.sh@20 -- # read -r var val 00:07:00.980 18:53:17 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:00.980 18:53:17 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:07:00.980 18:53:17 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:00.980 00:07:00.980 real 0m2.558s 00:07:00.980 user 0m2.343s 00:07:00.980 sys 0m0.222s 00:07:00.980 18:53:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:00.980 18:53:17 -- common/autotest_common.sh@10 -- # set +x 00:07:00.980 ************************************ 00:07:00.980 END TEST accel_xor 00:07:00.980 ************************************ 00:07:00.980 18:53:17 -- accel/accel.sh@103 -- # run_test accel_dif_verify accel_test -t 1 -w dif_verify 00:07:00.980 18:53:17 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:07:00.980 18:53:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:00.980 18:53:17 -- common/autotest_common.sh@10 -- # set +x 00:07:00.980 ************************************ 00:07:00.980 START TEST accel_dif_verify 00:07:00.980 ************************************ 00:07:00.980 18:53:17 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_verify 00:07:00.980 18:53:17 -- accel/accel.sh@16 -- # local accel_opc 00:07:00.980 18:53:17 -- accel/accel.sh@17 -- # local accel_module 00:07:00.980 18:53:17 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_verify 00:07:00.980 18:53:17 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:07:00.980 18:53:17 -- accel/accel.sh@12 -- # build_accel_config 00:07:00.980 18:53:17 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:00.980 18:53:17 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:00.980 18:53:17 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:00.980 18:53:17 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:00.980 18:53:17 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:00.980 18:53:17 -- accel/accel.sh@41 -- # local IFS=, 00:07:00.980 18:53:17 -- accel/accel.sh@42 -- # jq -r . 00:07:00.980 [2024-11-26 18:53:17.570417] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:00.980 [2024-11-26 18:53:17.570477] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2939181 ] 00:07:00.980 EAL: No free 2048 kB hugepages reported on node 1 00:07:00.980 [2024-11-26 18:53:17.625189] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:00.980 [2024-11-26 18:53:17.662085] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:01.914 18:53:18 -- accel/accel.sh@18 -- # out=' 00:07:01.914 SPDK Configuration: 00:07:01.914 Core mask: 0x1 00:07:01.914 00:07:01.914 Accel Perf Configuration: 00:07:01.914 Workload Type: dif_verify 00:07:01.914 Vector size: 4096 bytes 00:07:01.914 Transfer size: 4096 bytes 00:07:01.914 Block size: 512 bytes 00:07:01.914 Metadata size: 8 bytes 00:07:01.914 Vector count 1 00:07:01.914 Module: software 00:07:01.914 Queue depth: 32 00:07:01.914 Allocate depth: 32 00:07:01.914 # threads/core: 1 00:07:01.914 Run time: 1 seconds 00:07:01.914 Verify: No 00:07:01.914 00:07:01.914 Running for 1 seconds... 00:07:01.914 00:07:01.914 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:01.914 ------------------------------------------------------------------------------------ 00:07:01.914 0,0 130784/s 518 MiB/s 0 0 00:07:01.914 ==================================================================================== 00:07:01.914 Total 130784/s 510 MiB/s 0 0' 00:07:01.914 18:53:18 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_verify 00:07:01.914 18:53:18 -- accel/accel.sh@20 -- # IFS=: 00:07:01.914 18:53:18 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:07:01.914 18:53:18 -- accel/accel.sh@20 -- # read -r var val 00:07:01.914 18:53:18 -- accel/accel.sh@12 -- # build_accel_config 00:07:01.914 18:53:18 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:01.914 18:53:18 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:01.914 18:53:18 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:01.914 18:53:18 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:01.914 18:53:18 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:01.914 18:53:18 -- accel/accel.sh@41 -- # local IFS=, 00:07:01.914 18:53:18 -- accel/accel.sh@42 -- # jq -r . 00:07:02.172 [2024-11-26 18:53:18.842221] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:02.173 [2024-11-26 18:53:18.842267] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2939420 ] 00:07:02.173 EAL: No free 2048 kB hugepages reported on node 1 00:07:02.173 [2024-11-26 18:53:18.891188] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:02.173 [2024-11-26 18:53:18.928200] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:02.173 18:53:18 -- accel/accel.sh@21 -- # val= 00:07:02.173 18:53:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.173 18:53:18 -- accel/accel.sh@20 -- # IFS=: 00:07:02.173 18:53:18 -- accel/accel.sh@20 -- # read -r var val 00:07:02.173 18:53:18 -- accel/accel.sh@21 -- # val= 00:07:02.173 18:53:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.173 18:53:18 -- accel/accel.sh@20 -- # IFS=: 00:07:02.173 18:53:18 -- accel/accel.sh@20 -- # read -r var val 00:07:02.173 18:53:18 -- accel/accel.sh@21 -- # val=0x1 00:07:02.173 18:53:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.173 18:53:18 -- accel/accel.sh@20 -- # IFS=: 00:07:02.173 18:53:18 -- accel/accel.sh@20 -- # read -r var val 00:07:02.173 18:53:18 -- accel/accel.sh@21 -- # val= 00:07:02.173 18:53:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.173 18:53:18 -- accel/accel.sh@20 -- # IFS=: 00:07:02.173 18:53:18 -- accel/accel.sh@20 -- # read -r var val 00:07:02.173 18:53:18 -- accel/accel.sh@21 -- # val= 00:07:02.173 18:53:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.173 18:53:18 -- accel/accel.sh@20 -- # IFS=: 00:07:02.173 18:53:18 -- accel/accel.sh@20 -- # read -r var val 00:07:02.173 18:53:18 -- accel/accel.sh@21 -- # val=dif_verify 00:07:02.173 18:53:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.173 18:53:18 -- accel/accel.sh@24 -- # accel_opc=dif_verify 00:07:02.173 18:53:18 -- accel/accel.sh@20 -- # IFS=: 00:07:02.173 18:53:18 -- accel/accel.sh@20 -- # read -r var val 00:07:02.173 18:53:18 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:02.173 18:53:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.173 18:53:18 -- accel/accel.sh@20 -- # IFS=: 00:07:02.173 18:53:18 -- accel/accel.sh@20 -- # read -r var val 00:07:02.173 18:53:18 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:02.173 18:53:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.173 18:53:18 -- accel/accel.sh@20 -- # IFS=: 00:07:02.173 18:53:18 -- accel/accel.sh@20 -- # read -r var val 00:07:02.173 18:53:18 -- accel/accel.sh@21 -- # val='512 bytes' 00:07:02.173 18:53:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.173 18:53:18 -- accel/accel.sh@20 -- # IFS=: 00:07:02.173 18:53:18 -- accel/accel.sh@20 -- # read -r var val 00:07:02.173 18:53:18 -- accel/accel.sh@21 -- # val='8 bytes' 00:07:02.173 18:53:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.173 18:53:18 -- accel/accel.sh@20 -- # IFS=: 00:07:02.173 18:53:18 -- accel/accel.sh@20 -- # read -r var val 00:07:02.173 18:53:18 -- accel/accel.sh@21 -- # val= 00:07:02.173 18:53:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.173 18:53:18 -- accel/accel.sh@20 -- # IFS=: 00:07:02.173 18:53:18 -- accel/accel.sh@20 -- # read -r var val 00:07:02.173 18:53:18 -- accel/accel.sh@21 -- # val=software 00:07:02.173 18:53:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.173 18:53:18 -- accel/accel.sh@23 -- # accel_module=software 00:07:02.173 18:53:18 -- accel/accel.sh@20 -- # IFS=: 00:07:02.173 18:53:18 -- accel/accel.sh@20 -- # read -r var val 00:07:02.173 18:53:18 -- accel/accel.sh@21 -- # val=32 00:07:02.173 18:53:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.173 18:53:18 -- accel/accel.sh@20 -- # IFS=: 00:07:02.173 18:53:18 -- accel/accel.sh@20 -- # read -r var val 00:07:02.173 18:53:18 -- accel/accel.sh@21 -- # val=32 00:07:02.173 18:53:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.173 18:53:18 -- accel/accel.sh@20 -- # IFS=: 00:07:02.173 18:53:18 -- accel/accel.sh@20 -- # read -r var val 00:07:02.173 18:53:18 -- accel/accel.sh@21 -- # val=1 00:07:02.173 18:53:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.173 18:53:18 -- accel/accel.sh@20 -- # IFS=: 00:07:02.173 18:53:18 -- accel/accel.sh@20 -- # read -r var val 00:07:02.173 18:53:18 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:02.173 18:53:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.173 18:53:18 -- accel/accel.sh@20 -- # IFS=: 00:07:02.173 18:53:18 -- accel/accel.sh@20 -- # read -r var val 00:07:02.173 18:53:18 -- accel/accel.sh@21 -- # val=No 00:07:02.173 18:53:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.173 18:53:18 -- accel/accel.sh@20 -- # IFS=: 00:07:02.173 18:53:18 -- accel/accel.sh@20 -- # read -r var val 00:07:02.173 18:53:18 -- accel/accel.sh@21 -- # val= 00:07:02.173 18:53:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.173 18:53:18 -- accel/accel.sh@20 -- # IFS=: 00:07:02.173 18:53:18 -- accel/accel.sh@20 -- # read -r var val 00:07:02.173 18:53:18 -- accel/accel.sh@21 -- # val= 00:07:02.173 18:53:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.173 18:53:18 -- accel/accel.sh@20 -- # IFS=: 00:07:02.173 18:53:18 -- accel/accel.sh@20 -- # read -r var val 00:07:03.547 18:53:20 -- accel/accel.sh@21 -- # val= 00:07:03.547 18:53:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.547 18:53:20 -- accel/accel.sh@20 -- # IFS=: 00:07:03.547 18:53:20 -- accel/accel.sh@20 -- # read -r var val 00:07:03.547 18:53:20 -- accel/accel.sh@21 -- # val= 00:07:03.547 18:53:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.547 18:53:20 -- accel/accel.sh@20 -- # IFS=: 00:07:03.547 18:53:20 -- accel/accel.sh@20 -- # read -r var val 00:07:03.547 18:53:20 -- accel/accel.sh@21 -- # val= 00:07:03.547 18:53:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.547 18:53:20 -- accel/accel.sh@20 -- # IFS=: 00:07:03.547 18:53:20 -- accel/accel.sh@20 -- # read -r var val 00:07:03.547 18:53:20 -- accel/accel.sh@21 -- # val= 00:07:03.547 18:53:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.547 18:53:20 -- accel/accel.sh@20 -- # IFS=: 00:07:03.547 18:53:20 -- accel/accel.sh@20 -- # read -r var val 00:07:03.547 18:53:20 -- accel/accel.sh@21 -- # val= 00:07:03.547 18:53:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.547 18:53:20 -- accel/accel.sh@20 -- # IFS=: 00:07:03.547 18:53:20 -- accel/accel.sh@20 -- # read -r var val 00:07:03.547 18:53:20 -- accel/accel.sh@21 -- # val= 00:07:03.547 18:53:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.547 18:53:20 -- accel/accel.sh@20 -- # IFS=: 00:07:03.547 18:53:20 -- accel/accel.sh@20 -- # read -r var val 00:07:03.547 18:53:20 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:03.547 18:53:20 -- accel/accel.sh@28 -- # [[ -n dif_verify ]] 00:07:03.547 18:53:20 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:03.547 00:07:03.547 real 0m2.557s 00:07:03.547 user 0m2.347s 00:07:03.547 sys 0m0.221s 00:07:03.547 18:53:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:03.547 18:53:20 -- common/autotest_common.sh@10 -- # set +x 00:07:03.547 ************************************ 00:07:03.547 END TEST accel_dif_verify 00:07:03.547 ************************************ 00:07:03.547 18:53:20 -- accel/accel.sh@104 -- # run_test accel_dif_generate accel_test -t 1 -w dif_generate 00:07:03.547 18:53:20 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:07:03.547 18:53:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:03.547 18:53:20 -- common/autotest_common.sh@10 -- # set +x 00:07:03.547 ************************************ 00:07:03.547 START TEST accel_dif_generate 00:07:03.547 ************************************ 00:07:03.547 18:53:20 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate 00:07:03.547 18:53:20 -- accel/accel.sh@16 -- # local accel_opc 00:07:03.547 18:53:20 -- accel/accel.sh@17 -- # local accel_module 00:07:03.547 18:53:20 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate 00:07:03.547 18:53:20 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:07:03.547 18:53:20 -- accel/accel.sh@12 -- # build_accel_config 00:07:03.547 18:53:20 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:03.547 18:53:20 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:03.547 18:53:20 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:03.547 18:53:20 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:03.547 18:53:20 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:03.547 18:53:20 -- accel/accel.sh@41 -- # local IFS=, 00:07:03.547 18:53:20 -- accel/accel.sh@42 -- # jq -r . 00:07:03.547 [2024-11-26 18:53:20.162819] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:03.547 [2024-11-26 18:53:20.162900] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2939669 ] 00:07:03.547 EAL: No free 2048 kB hugepages reported on node 1 00:07:03.547 [2024-11-26 18:53:20.221015] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:03.547 [2024-11-26 18:53:20.258594] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:04.924 18:53:21 -- accel/accel.sh@18 -- # out=' 00:07:04.924 SPDK Configuration: 00:07:04.924 Core mask: 0x1 00:07:04.924 00:07:04.924 Accel Perf Configuration: 00:07:04.924 Workload Type: dif_generate 00:07:04.924 Vector size: 4096 bytes 00:07:04.924 Transfer size: 4096 bytes 00:07:04.924 Block size: 512 bytes 00:07:04.924 Metadata size: 8 bytes 00:07:04.924 Vector count 1 00:07:04.924 Module: software 00:07:04.924 Queue depth: 32 00:07:04.924 Allocate depth: 32 00:07:04.924 # threads/core: 1 00:07:04.924 Run time: 1 seconds 00:07:04.924 Verify: No 00:07:04.924 00:07:04.924 Running for 1 seconds... 00:07:04.924 00:07:04.924 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:04.924 ------------------------------------------------------------------------------------ 00:07:04.924 0,0 156960/s 622 MiB/s 0 0 00:07:04.924 ==================================================================================== 00:07:04.924 Total 156960/s 613 MiB/s 0 0' 00:07:04.924 18:53:21 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate 00:07:04.924 18:53:21 -- accel/accel.sh@20 -- # IFS=: 00:07:04.924 18:53:21 -- accel/accel.sh@20 -- # read -r var val 00:07:04.924 18:53:21 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:07:04.924 18:53:21 -- accel/accel.sh@12 -- # build_accel_config 00:07:04.924 18:53:21 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:04.924 18:53:21 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:04.924 18:53:21 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:04.924 18:53:21 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:04.924 18:53:21 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:04.924 18:53:21 -- accel/accel.sh@41 -- # local IFS=, 00:07:04.924 18:53:21 -- accel/accel.sh@42 -- # jq -r . 00:07:04.924 [2024-11-26 18:53:21.441824] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:04.924 [2024-11-26 18:53:21.441873] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2939901 ] 00:07:04.924 EAL: No free 2048 kB hugepages reported on node 1 00:07:04.924 [2024-11-26 18:53:21.494794] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:04.924 [2024-11-26 18:53:21.530969] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:04.924 18:53:21 -- accel/accel.sh@21 -- # val= 00:07:04.924 18:53:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.924 18:53:21 -- accel/accel.sh@20 -- # IFS=: 00:07:04.924 18:53:21 -- accel/accel.sh@20 -- # read -r var val 00:07:04.924 18:53:21 -- accel/accel.sh@21 -- # val= 00:07:04.924 18:53:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.924 18:53:21 -- accel/accel.sh@20 -- # IFS=: 00:07:04.924 18:53:21 -- accel/accel.sh@20 -- # read -r var val 00:07:04.924 18:53:21 -- accel/accel.sh@21 -- # val=0x1 00:07:04.924 18:53:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.924 18:53:21 -- accel/accel.sh@20 -- # IFS=: 00:07:04.924 18:53:21 -- accel/accel.sh@20 -- # read -r var val 00:07:04.924 18:53:21 -- accel/accel.sh@21 -- # val= 00:07:04.924 18:53:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.924 18:53:21 -- accel/accel.sh@20 -- # IFS=: 00:07:04.924 18:53:21 -- accel/accel.sh@20 -- # read -r var val 00:07:04.924 18:53:21 -- accel/accel.sh@21 -- # val= 00:07:04.924 18:53:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.924 18:53:21 -- accel/accel.sh@20 -- # IFS=: 00:07:04.924 18:53:21 -- accel/accel.sh@20 -- # read -r var val 00:07:04.924 18:53:21 -- accel/accel.sh@21 -- # val=dif_generate 00:07:04.924 18:53:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.924 18:53:21 -- accel/accel.sh@24 -- # accel_opc=dif_generate 00:07:04.924 18:53:21 -- accel/accel.sh@20 -- # IFS=: 00:07:04.924 18:53:21 -- accel/accel.sh@20 -- # read -r var val 00:07:04.924 18:53:21 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:04.924 18:53:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.924 18:53:21 -- accel/accel.sh@20 -- # IFS=: 00:07:04.924 18:53:21 -- accel/accel.sh@20 -- # read -r var val 00:07:04.924 18:53:21 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:04.924 18:53:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.924 18:53:21 -- accel/accel.sh@20 -- # IFS=: 00:07:04.924 18:53:21 -- accel/accel.sh@20 -- # read -r var val 00:07:04.924 18:53:21 -- accel/accel.sh@21 -- # val='512 bytes' 00:07:04.924 18:53:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.924 18:53:21 -- accel/accel.sh@20 -- # IFS=: 00:07:04.924 18:53:21 -- accel/accel.sh@20 -- # read -r var val 00:07:04.924 18:53:21 -- accel/accel.sh@21 -- # val='8 bytes' 00:07:04.924 18:53:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.924 18:53:21 -- accel/accel.sh@20 -- # IFS=: 00:07:04.924 18:53:21 -- accel/accel.sh@20 -- # read -r var val 00:07:04.924 18:53:21 -- accel/accel.sh@21 -- # val= 00:07:04.924 18:53:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.924 18:53:21 -- accel/accel.sh@20 -- # IFS=: 00:07:04.924 18:53:21 -- accel/accel.sh@20 -- # read -r var val 00:07:04.924 18:53:21 -- accel/accel.sh@21 -- # val=software 00:07:04.924 18:53:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.924 18:53:21 -- accel/accel.sh@23 -- # accel_module=software 00:07:04.924 18:53:21 -- accel/accel.sh@20 -- # IFS=: 00:07:04.924 18:53:21 -- accel/accel.sh@20 -- # read -r var val 00:07:04.924 18:53:21 -- accel/accel.sh@21 -- # val=32 00:07:04.924 18:53:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.924 18:53:21 -- accel/accel.sh@20 -- # IFS=: 00:07:04.924 18:53:21 -- accel/accel.sh@20 -- # read -r var val 00:07:04.924 18:53:21 -- accel/accel.sh@21 -- # val=32 00:07:04.924 18:53:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.924 18:53:21 -- accel/accel.sh@20 -- # IFS=: 00:07:04.924 18:53:21 -- accel/accel.sh@20 -- # read -r var val 00:07:04.924 18:53:21 -- accel/accel.sh@21 -- # val=1 00:07:04.924 18:53:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.924 18:53:21 -- accel/accel.sh@20 -- # IFS=: 00:07:04.924 18:53:21 -- accel/accel.sh@20 -- # read -r var val 00:07:04.924 18:53:21 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:04.924 18:53:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.924 18:53:21 -- accel/accel.sh@20 -- # IFS=: 00:07:04.924 18:53:21 -- accel/accel.sh@20 -- # read -r var val 00:07:04.924 18:53:21 -- accel/accel.sh@21 -- # val=No 00:07:04.924 18:53:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.924 18:53:21 -- accel/accel.sh@20 -- # IFS=: 00:07:04.924 18:53:21 -- accel/accel.sh@20 -- # read -r var val 00:07:04.924 18:53:21 -- accel/accel.sh@21 -- # val= 00:07:04.924 18:53:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.924 18:53:21 -- accel/accel.sh@20 -- # IFS=: 00:07:04.924 18:53:21 -- accel/accel.sh@20 -- # read -r var val 00:07:04.924 18:53:21 -- accel/accel.sh@21 -- # val= 00:07:04.924 18:53:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.924 18:53:21 -- accel/accel.sh@20 -- # IFS=: 00:07:04.924 18:53:21 -- accel/accel.sh@20 -- # read -r var val 00:07:05.860 18:53:22 -- accel/accel.sh@21 -- # val= 00:07:05.860 18:53:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.860 18:53:22 -- accel/accel.sh@20 -- # IFS=: 00:07:05.860 18:53:22 -- accel/accel.sh@20 -- # read -r var val 00:07:05.860 18:53:22 -- accel/accel.sh@21 -- # val= 00:07:05.860 18:53:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.860 18:53:22 -- accel/accel.sh@20 -- # IFS=: 00:07:05.860 18:53:22 -- accel/accel.sh@20 -- # read -r var val 00:07:05.860 18:53:22 -- accel/accel.sh@21 -- # val= 00:07:05.860 18:53:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.860 18:53:22 -- accel/accel.sh@20 -- # IFS=: 00:07:05.860 18:53:22 -- accel/accel.sh@20 -- # read -r var val 00:07:05.860 18:53:22 -- accel/accel.sh@21 -- # val= 00:07:05.860 18:53:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.860 18:53:22 -- accel/accel.sh@20 -- # IFS=: 00:07:05.860 18:53:22 -- accel/accel.sh@20 -- # read -r var val 00:07:05.860 18:53:22 -- accel/accel.sh@21 -- # val= 00:07:05.860 18:53:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.860 18:53:22 -- accel/accel.sh@20 -- # IFS=: 00:07:05.860 18:53:22 -- accel/accel.sh@20 -- # read -r var val 00:07:05.860 18:53:22 -- accel/accel.sh@21 -- # val= 00:07:05.860 18:53:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.860 18:53:22 -- accel/accel.sh@20 -- # IFS=: 00:07:05.860 18:53:22 -- accel/accel.sh@20 -- # read -r var val 00:07:05.860 18:53:22 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:05.860 18:53:22 -- accel/accel.sh@28 -- # [[ -n dif_generate ]] 00:07:05.860 18:53:22 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:05.860 00:07:05.860 real 0m2.568s 00:07:05.860 user 0m2.357s 00:07:05.860 sys 0m0.222s 00:07:05.860 18:53:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:05.860 18:53:22 -- common/autotest_common.sh@10 -- # set +x 00:07:05.860 ************************************ 00:07:05.860 END TEST accel_dif_generate 00:07:05.860 ************************************ 00:07:05.860 18:53:22 -- accel/accel.sh@105 -- # run_test accel_dif_generate_copy accel_test -t 1 -w dif_generate_copy 00:07:05.860 18:53:22 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:07:05.860 18:53:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:05.860 18:53:22 -- common/autotest_common.sh@10 -- # set +x 00:07:05.860 ************************************ 00:07:05.860 START TEST accel_dif_generate_copy 00:07:05.860 ************************************ 00:07:05.860 18:53:22 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate_copy 00:07:05.860 18:53:22 -- accel/accel.sh@16 -- # local accel_opc 00:07:05.860 18:53:22 -- accel/accel.sh@17 -- # local accel_module 00:07:05.860 18:53:22 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate_copy 00:07:05.860 18:53:22 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:07:05.860 18:53:22 -- accel/accel.sh@12 -- # build_accel_config 00:07:05.860 18:53:22 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:05.860 18:53:22 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:05.860 18:53:22 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:05.860 18:53:22 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:05.860 18:53:22 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:05.860 18:53:22 -- accel/accel.sh@41 -- # local IFS=, 00:07:05.860 18:53:22 -- accel/accel.sh@42 -- # jq -r . 00:07:05.860 [2024-11-26 18:53:22.763472] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:05.860 [2024-11-26 18:53:22.763535] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2940150 ] 00:07:06.119 EAL: No free 2048 kB hugepages reported on node 1 00:07:06.119 [2024-11-26 18:53:22.818002] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:06.119 [2024-11-26 18:53:22.855074] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:07.497 18:53:24 -- accel/accel.sh@18 -- # out=' 00:07:07.497 SPDK Configuration: 00:07:07.497 Core mask: 0x1 00:07:07.497 00:07:07.497 Accel Perf Configuration: 00:07:07.497 Workload Type: dif_generate_copy 00:07:07.497 Vector size: 4096 bytes 00:07:07.497 Transfer size: 4096 bytes 00:07:07.497 Vector count 1 00:07:07.497 Module: software 00:07:07.497 Queue depth: 32 00:07:07.497 Allocate depth: 32 00:07:07.497 # threads/core: 1 00:07:07.497 Run time: 1 seconds 00:07:07.497 Verify: No 00:07:07.497 00:07:07.497 Running for 1 seconds... 00:07:07.497 00:07:07.497 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:07.497 ------------------------------------------------------------------------------------ 00:07:07.498 0,0 121728/s 482 MiB/s 0 0 00:07:07.498 ==================================================================================== 00:07:07.498 Total 121728/s 475 MiB/s 0 0' 00:07:07.498 18:53:24 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate_copy 00:07:07.498 18:53:24 -- accel/accel.sh@20 -- # IFS=: 00:07:07.498 18:53:24 -- accel/accel.sh@20 -- # read -r var val 00:07:07.498 18:53:24 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:07:07.498 18:53:24 -- accel/accel.sh@12 -- # build_accel_config 00:07:07.498 18:53:24 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:07.498 18:53:24 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:07.498 18:53:24 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:07.498 18:53:24 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:07.498 18:53:24 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:07.498 18:53:24 -- accel/accel.sh@41 -- # local IFS=, 00:07:07.498 18:53:24 -- accel/accel.sh@42 -- # jq -r . 00:07:07.498 [2024-11-26 18:53:24.036517] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:07.498 [2024-11-26 18:53:24.036566] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2940390 ] 00:07:07.498 EAL: No free 2048 kB hugepages reported on node 1 00:07:07.498 [2024-11-26 18:53:24.085447] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:07.498 [2024-11-26 18:53:24.122278] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:07.498 18:53:24 -- accel/accel.sh@21 -- # val= 00:07:07.498 18:53:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.498 18:53:24 -- accel/accel.sh@20 -- # IFS=: 00:07:07.498 18:53:24 -- accel/accel.sh@20 -- # read -r var val 00:07:07.498 18:53:24 -- accel/accel.sh@21 -- # val= 00:07:07.498 18:53:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.498 18:53:24 -- accel/accel.sh@20 -- # IFS=: 00:07:07.498 18:53:24 -- accel/accel.sh@20 -- # read -r var val 00:07:07.498 18:53:24 -- accel/accel.sh@21 -- # val=0x1 00:07:07.498 18:53:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.498 18:53:24 -- accel/accel.sh@20 -- # IFS=: 00:07:07.498 18:53:24 -- accel/accel.sh@20 -- # read -r var val 00:07:07.498 18:53:24 -- accel/accel.sh@21 -- # val= 00:07:07.498 18:53:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.498 18:53:24 -- accel/accel.sh@20 -- # IFS=: 00:07:07.498 18:53:24 -- accel/accel.sh@20 -- # read -r var val 00:07:07.498 18:53:24 -- accel/accel.sh@21 -- # val= 00:07:07.498 18:53:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.498 18:53:24 -- accel/accel.sh@20 -- # IFS=: 00:07:07.498 18:53:24 -- accel/accel.sh@20 -- # read -r var val 00:07:07.498 18:53:24 -- accel/accel.sh@21 -- # val=dif_generate_copy 00:07:07.498 18:53:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.498 18:53:24 -- accel/accel.sh@24 -- # accel_opc=dif_generate_copy 00:07:07.498 18:53:24 -- accel/accel.sh@20 -- # IFS=: 00:07:07.498 18:53:24 -- accel/accel.sh@20 -- # read -r var val 00:07:07.498 18:53:24 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:07.498 18:53:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.498 18:53:24 -- accel/accel.sh@20 -- # IFS=: 00:07:07.498 18:53:24 -- accel/accel.sh@20 -- # read -r var val 00:07:07.498 18:53:24 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:07.498 18:53:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.498 18:53:24 -- accel/accel.sh@20 -- # IFS=: 00:07:07.498 18:53:24 -- accel/accel.sh@20 -- # read -r var val 00:07:07.498 18:53:24 -- accel/accel.sh@21 -- # val= 00:07:07.498 18:53:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.498 18:53:24 -- accel/accel.sh@20 -- # IFS=: 00:07:07.498 18:53:24 -- accel/accel.sh@20 -- # read -r var val 00:07:07.498 18:53:24 -- accel/accel.sh@21 -- # val=software 00:07:07.498 18:53:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.498 18:53:24 -- accel/accel.sh@23 -- # accel_module=software 00:07:07.498 18:53:24 -- accel/accel.sh@20 -- # IFS=: 00:07:07.498 18:53:24 -- accel/accel.sh@20 -- # read -r var val 00:07:07.498 18:53:24 -- accel/accel.sh@21 -- # val=32 00:07:07.498 18:53:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.498 18:53:24 -- accel/accel.sh@20 -- # IFS=: 00:07:07.498 18:53:24 -- accel/accel.sh@20 -- # read -r var val 00:07:07.498 18:53:24 -- accel/accel.sh@21 -- # val=32 00:07:07.498 18:53:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.498 18:53:24 -- accel/accel.sh@20 -- # IFS=: 00:07:07.498 18:53:24 -- accel/accel.sh@20 -- # read -r var val 00:07:07.498 18:53:24 -- accel/accel.sh@21 -- # val=1 00:07:07.498 18:53:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.498 18:53:24 -- accel/accel.sh@20 -- # IFS=: 00:07:07.498 18:53:24 -- accel/accel.sh@20 -- # read -r var val 00:07:07.498 18:53:24 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:07.498 18:53:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.498 18:53:24 -- accel/accel.sh@20 -- # IFS=: 00:07:07.498 18:53:24 -- accel/accel.sh@20 -- # read -r var val 00:07:07.498 18:53:24 -- accel/accel.sh@21 -- # val=No 00:07:07.498 18:53:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.498 18:53:24 -- accel/accel.sh@20 -- # IFS=: 00:07:07.498 18:53:24 -- accel/accel.sh@20 -- # read -r var val 00:07:07.498 18:53:24 -- accel/accel.sh@21 -- # val= 00:07:07.498 18:53:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.498 18:53:24 -- accel/accel.sh@20 -- # IFS=: 00:07:07.498 18:53:24 -- accel/accel.sh@20 -- # read -r var val 00:07:07.498 18:53:24 -- accel/accel.sh@21 -- # val= 00:07:07.498 18:53:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.498 18:53:24 -- accel/accel.sh@20 -- # IFS=: 00:07:07.498 18:53:24 -- accel/accel.sh@20 -- # read -r var val 00:07:08.431 18:53:25 -- accel/accel.sh@21 -- # val= 00:07:08.431 18:53:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.431 18:53:25 -- accel/accel.sh@20 -- # IFS=: 00:07:08.431 18:53:25 -- accel/accel.sh@20 -- # read -r var val 00:07:08.431 18:53:25 -- accel/accel.sh@21 -- # val= 00:07:08.431 18:53:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.431 18:53:25 -- accel/accel.sh@20 -- # IFS=: 00:07:08.431 18:53:25 -- accel/accel.sh@20 -- # read -r var val 00:07:08.431 18:53:25 -- accel/accel.sh@21 -- # val= 00:07:08.431 18:53:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.431 18:53:25 -- accel/accel.sh@20 -- # IFS=: 00:07:08.431 18:53:25 -- accel/accel.sh@20 -- # read -r var val 00:07:08.431 18:53:25 -- accel/accel.sh@21 -- # val= 00:07:08.431 18:53:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.431 18:53:25 -- accel/accel.sh@20 -- # IFS=: 00:07:08.431 18:53:25 -- accel/accel.sh@20 -- # read -r var val 00:07:08.431 18:53:25 -- accel/accel.sh@21 -- # val= 00:07:08.431 18:53:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.431 18:53:25 -- accel/accel.sh@20 -- # IFS=: 00:07:08.431 18:53:25 -- accel/accel.sh@20 -- # read -r var val 00:07:08.431 18:53:25 -- accel/accel.sh@21 -- # val= 00:07:08.431 18:53:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.431 18:53:25 -- accel/accel.sh@20 -- # IFS=: 00:07:08.431 18:53:25 -- accel/accel.sh@20 -- # read -r var val 00:07:08.431 18:53:25 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:08.431 18:53:25 -- accel/accel.sh@28 -- # [[ -n dif_generate_copy ]] 00:07:08.431 18:53:25 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:08.431 00:07:08.431 real 0m2.558s 00:07:08.431 user 0m2.344s 00:07:08.431 sys 0m0.223s 00:07:08.431 18:53:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:08.431 18:53:25 -- common/autotest_common.sh@10 -- # set +x 00:07:08.431 ************************************ 00:07:08.431 END TEST accel_dif_generate_copy 00:07:08.431 ************************************ 00:07:08.431 18:53:25 -- accel/accel.sh@107 -- # [[ y == y ]] 00:07:08.431 18:53:25 -- accel/accel.sh@108 -- # run_test accel_comp accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:08.431 18:53:25 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:07:08.431 18:53:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:08.431 18:53:25 -- common/autotest_common.sh@10 -- # set +x 00:07:08.431 ************************************ 00:07:08.431 START TEST accel_comp 00:07:08.431 ************************************ 00:07:08.431 18:53:25 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:08.431 18:53:25 -- accel/accel.sh@16 -- # local accel_opc 00:07:08.431 18:53:25 -- accel/accel.sh@17 -- # local accel_module 00:07:08.431 18:53:25 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:08.431 18:53:25 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:08.431 18:53:25 -- accel/accel.sh@12 -- # build_accel_config 00:07:08.431 18:53:25 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:08.431 18:53:25 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:08.431 18:53:25 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:08.431 18:53:25 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:08.431 18:53:25 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:08.431 18:53:25 -- accel/accel.sh@41 -- # local IFS=, 00:07:08.432 18:53:25 -- accel/accel.sh@42 -- # jq -r . 00:07:08.689 [2024-11-26 18:53:25.357376] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:08.689 [2024-11-26 18:53:25.357430] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2940608 ] 00:07:08.689 EAL: No free 2048 kB hugepages reported on node 1 00:07:08.689 [2024-11-26 18:53:25.428273] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:08.689 [2024-11-26 18:53:25.465379] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:10.060 18:53:26 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:10.060 00:07:10.060 SPDK Configuration: 00:07:10.060 Core mask: 0x1 00:07:10.060 00:07:10.060 Accel Perf Configuration: 00:07:10.060 Workload Type: compress 00:07:10.060 Transfer size: 4096 bytes 00:07:10.060 Vector count 1 00:07:10.060 Module: software 00:07:10.060 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:10.060 Queue depth: 32 00:07:10.060 Allocate depth: 32 00:07:10.060 # threads/core: 1 00:07:10.060 Run time: 1 seconds 00:07:10.060 Verify: No 00:07:10.060 00:07:10.060 Running for 1 seconds... 00:07:10.060 00:07:10.060 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:10.060 ------------------------------------------------------------------------------------ 00:07:10.060 0,0 61888/s 257 MiB/s 0 0 00:07:10.060 ==================================================================================== 00:07:10.060 Total 61888/s 241 MiB/s 0 0' 00:07:10.060 18:53:26 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:10.061 18:53:26 -- accel/accel.sh@20 -- # IFS=: 00:07:10.061 18:53:26 -- accel/accel.sh@20 -- # read -r var val 00:07:10.061 18:53:26 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:10.061 18:53:26 -- accel/accel.sh@12 -- # build_accel_config 00:07:10.061 18:53:26 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:10.061 18:53:26 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:10.061 18:53:26 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:10.061 18:53:26 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:10.061 18:53:26 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:10.061 18:53:26 -- accel/accel.sh@41 -- # local IFS=, 00:07:10.061 18:53:26 -- accel/accel.sh@42 -- # jq -r . 00:07:10.061 [2024-11-26 18:53:26.649056] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:10.061 [2024-11-26 18:53:26.649104] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2940791 ] 00:07:10.061 EAL: No free 2048 kB hugepages reported on node 1 00:07:10.061 [2024-11-26 18:53:26.698850] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:10.061 [2024-11-26 18:53:26.735793] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:10.061 18:53:26 -- accel/accel.sh@21 -- # val= 00:07:10.061 18:53:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.061 18:53:26 -- accel/accel.sh@20 -- # IFS=: 00:07:10.061 18:53:26 -- accel/accel.sh@20 -- # read -r var val 00:07:10.061 18:53:26 -- accel/accel.sh@21 -- # val= 00:07:10.061 18:53:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.061 18:53:26 -- accel/accel.sh@20 -- # IFS=: 00:07:10.061 18:53:26 -- accel/accel.sh@20 -- # read -r var val 00:07:10.061 18:53:26 -- accel/accel.sh@21 -- # val= 00:07:10.061 18:53:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.061 18:53:26 -- accel/accel.sh@20 -- # IFS=: 00:07:10.061 18:53:26 -- accel/accel.sh@20 -- # read -r var val 00:07:10.061 18:53:26 -- accel/accel.sh@21 -- # val=0x1 00:07:10.061 18:53:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.061 18:53:26 -- accel/accel.sh@20 -- # IFS=: 00:07:10.061 18:53:26 -- accel/accel.sh@20 -- # read -r var val 00:07:10.061 18:53:26 -- accel/accel.sh@21 -- # val= 00:07:10.061 18:53:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.061 18:53:26 -- accel/accel.sh@20 -- # IFS=: 00:07:10.061 18:53:26 -- accel/accel.sh@20 -- # read -r var val 00:07:10.061 18:53:26 -- accel/accel.sh@21 -- # val= 00:07:10.061 18:53:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.061 18:53:26 -- accel/accel.sh@20 -- # IFS=: 00:07:10.061 18:53:26 -- accel/accel.sh@20 -- # read -r var val 00:07:10.061 18:53:26 -- accel/accel.sh@21 -- # val=compress 00:07:10.061 18:53:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.061 18:53:26 -- accel/accel.sh@24 -- # accel_opc=compress 00:07:10.061 18:53:26 -- accel/accel.sh@20 -- # IFS=: 00:07:10.061 18:53:26 -- accel/accel.sh@20 -- # read -r var val 00:07:10.061 18:53:26 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:10.061 18:53:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.061 18:53:26 -- accel/accel.sh@20 -- # IFS=: 00:07:10.061 18:53:26 -- accel/accel.sh@20 -- # read -r var val 00:07:10.061 18:53:26 -- accel/accel.sh@21 -- # val= 00:07:10.061 18:53:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.061 18:53:26 -- accel/accel.sh@20 -- # IFS=: 00:07:10.061 18:53:26 -- accel/accel.sh@20 -- # read -r var val 00:07:10.061 18:53:26 -- accel/accel.sh@21 -- # val=software 00:07:10.061 18:53:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.061 18:53:26 -- accel/accel.sh@23 -- # accel_module=software 00:07:10.061 18:53:26 -- accel/accel.sh@20 -- # IFS=: 00:07:10.061 18:53:26 -- accel/accel.sh@20 -- # read -r var val 00:07:10.061 18:53:26 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:10.061 18:53:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.061 18:53:26 -- accel/accel.sh@20 -- # IFS=: 00:07:10.061 18:53:26 -- accel/accel.sh@20 -- # read -r var val 00:07:10.061 18:53:26 -- accel/accel.sh@21 -- # val=32 00:07:10.061 18:53:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.061 18:53:26 -- accel/accel.sh@20 -- # IFS=: 00:07:10.061 18:53:26 -- accel/accel.sh@20 -- # read -r var val 00:07:10.061 18:53:26 -- accel/accel.sh@21 -- # val=32 00:07:10.061 18:53:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.061 18:53:26 -- accel/accel.sh@20 -- # IFS=: 00:07:10.061 18:53:26 -- accel/accel.sh@20 -- # read -r var val 00:07:10.061 18:53:26 -- accel/accel.sh@21 -- # val=1 00:07:10.061 18:53:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.061 18:53:26 -- accel/accel.sh@20 -- # IFS=: 00:07:10.061 18:53:26 -- accel/accel.sh@20 -- # read -r var val 00:07:10.061 18:53:26 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:10.061 18:53:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.061 18:53:26 -- accel/accel.sh@20 -- # IFS=: 00:07:10.061 18:53:26 -- accel/accel.sh@20 -- # read -r var val 00:07:10.061 18:53:26 -- accel/accel.sh@21 -- # val=No 00:07:10.061 18:53:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.061 18:53:26 -- accel/accel.sh@20 -- # IFS=: 00:07:10.061 18:53:26 -- accel/accel.sh@20 -- # read -r var val 00:07:10.061 18:53:26 -- accel/accel.sh@21 -- # val= 00:07:10.061 18:53:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.061 18:53:26 -- accel/accel.sh@20 -- # IFS=: 00:07:10.061 18:53:26 -- accel/accel.sh@20 -- # read -r var val 00:07:10.061 18:53:26 -- accel/accel.sh@21 -- # val= 00:07:10.061 18:53:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.061 18:53:26 -- accel/accel.sh@20 -- # IFS=: 00:07:10.061 18:53:26 -- accel/accel.sh@20 -- # read -r var val 00:07:10.993 18:53:27 -- accel/accel.sh@21 -- # val= 00:07:10.993 18:53:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.993 18:53:27 -- accel/accel.sh@20 -- # IFS=: 00:07:10.993 18:53:27 -- accel/accel.sh@20 -- # read -r var val 00:07:10.993 18:53:27 -- accel/accel.sh@21 -- # val= 00:07:10.993 18:53:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.993 18:53:27 -- accel/accel.sh@20 -- # IFS=: 00:07:10.993 18:53:27 -- accel/accel.sh@20 -- # read -r var val 00:07:10.993 18:53:27 -- accel/accel.sh@21 -- # val= 00:07:10.993 18:53:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.993 18:53:27 -- accel/accel.sh@20 -- # IFS=: 00:07:10.993 18:53:27 -- accel/accel.sh@20 -- # read -r var val 00:07:10.993 18:53:27 -- accel/accel.sh@21 -- # val= 00:07:10.993 18:53:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.993 18:53:27 -- accel/accel.sh@20 -- # IFS=: 00:07:10.993 18:53:27 -- accel/accel.sh@20 -- # read -r var val 00:07:10.994 18:53:27 -- accel/accel.sh@21 -- # val= 00:07:10.994 18:53:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.994 18:53:27 -- accel/accel.sh@20 -- # IFS=: 00:07:10.994 18:53:27 -- accel/accel.sh@20 -- # read -r var val 00:07:10.994 18:53:27 -- accel/accel.sh@21 -- # val= 00:07:10.994 18:53:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.994 18:53:27 -- accel/accel.sh@20 -- # IFS=: 00:07:10.994 18:53:27 -- accel/accel.sh@20 -- # read -r var val 00:07:10.994 18:53:27 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:10.994 18:53:27 -- accel/accel.sh@28 -- # [[ -n compress ]] 00:07:10.994 18:53:27 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:10.994 00:07:10.994 real 0m2.581s 00:07:10.994 user 0m2.360s 00:07:10.994 sys 0m0.230s 00:07:10.994 18:53:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:10.994 18:53:27 -- common/autotest_common.sh@10 -- # set +x 00:07:10.994 ************************************ 00:07:10.994 END TEST accel_comp 00:07:10.994 ************************************ 00:07:11.252 18:53:27 -- accel/accel.sh@109 -- # run_test accel_decomp accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:11.252 18:53:27 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:07:11.252 18:53:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:11.252 18:53:27 -- common/autotest_common.sh@10 -- # set +x 00:07:11.252 ************************************ 00:07:11.252 START TEST accel_decomp 00:07:11.252 ************************************ 00:07:11.252 18:53:27 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:11.252 18:53:27 -- accel/accel.sh@16 -- # local accel_opc 00:07:11.252 18:53:27 -- accel/accel.sh@17 -- # local accel_module 00:07:11.252 18:53:27 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:11.252 18:53:27 -- accel/accel.sh@12 -- # build_accel_config 00:07:11.252 18:53:27 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:11.252 18:53:27 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:11.252 18:53:27 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:11.252 18:53:27 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:11.252 18:53:27 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:11.252 18:53:27 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:11.252 18:53:27 -- accel/accel.sh@41 -- # local IFS=, 00:07:11.252 18:53:27 -- accel/accel.sh@42 -- # jq -r . 00:07:11.252 [2024-11-26 18:53:27.977945] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:11.252 [2024-11-26 18:53:27.978053] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2941002 ] 00:07:11.252 EAL: No free 2048 kB hugepages reported on node 1 00:07:11.252 [2024-11-26 18:53:28.036327] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:11.252 [2024-11-26 18:53:28.073448] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:12.624 18:53:29 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:12.624 00:07:12.624 SPDK Configuration: 00:07:12.624 Core mask: 0x1 00:07:12.624 00:07:12.624 Accel Perf Configuration: 00:07:12.624 Workload Type: decompress 00:07:12.624 Transfer size: 4096 bytes 00:07:12.624 Vector count 1 00:07:12.624 Module: software 00:07:12.624 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:12.624 Queue depth: 32 00:07:12.624 Allocate depth: 32 00:07:12.624 # threads/core: 1 00:07:12.624 Run time: 1 seconds 00:07:12.624 Verify: Yes 00:07:12.624 00:07:12.624 Running for 1 seconds... 00:07:12.624 00:07:12.624 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:12.624 ------------------------------------------------------------------------------------ 00:07:12.624 0,0 74752/s 137 MiB/s 0 0 00:07:12.624 ==================================================================================== 00:07:12.624 Total 74752/s 292 MiB/s 0 0' 00:07:12.624 18:53:29 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:12.624 18:53:29 -- accel/accel.sh@20 -- # IFS=: 00:07:12.624 18:53:29 -- accel/accel.sh@20 -- # read -r var val 00:07:12.624 18:53:29 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:12.624 18:53:29 -- accel/accel.sh@12 -- # build_accel_config 00:07:12.624 18:53:29 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:12.624 18:53:29 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:12.624 18:53:29 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:12.624 18:53:29 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:12.624 18:53:29 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:12.624 18:53:29 -- accel/accel.sh@41 -- # local IFS=, 00:07:12.625 18:53:29 -- accel/accel.sh@42 -- # jq -r . 00:07:12.625 [2024-11-26 18:53:29.256478] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:12.625 [2024-11-26 18:53:29.256526] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2941183 ] 00:07:12.625 EAL: No free 2048 kB hugepages reported on node 1 00:07:12.625 [2024-11-26 18:53:29.305202] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:12.625 [2024-11-26 18:53:29.341788] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:12.625 18:53:29 -- accel/accel.sh@21 -- # val= 00:07:12.625 18:53:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.625 18:53:29 -- accel/accel.sh@20 -- # IFS=: 00:07:12.625 18:53:29 -- accel/accel.sh@20 -- # read -r var val 00:07:12.625 18:53:29 -- accel/accel.sh@21 -- # val= 00:07:12.625 18:53:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.625 18:53:29 -- accel/accel.sh@20 -- # IFS=: 00:07:12.625 18:53:29 -- accel/accel.sh@20 -- # read -r var val 00:07:12.625 18:53:29 -- accel/accel.sh@21 -- # val= 00:07:12.625 18:53:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.625 18:53:29 -- accel/accel.sh@20 -- # IFS=: 00:07:12.625 18:53:29 -- accel/accel.sh@20 -- # read -r var val 00:07:12.625 18:53:29 -- accel/accel.sh@21 -- # val=0x1 00:07:12.625 18:53:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.625 18:53:29 -- accel/accel.sh@20 -- # IFS=: 00:07:12.625 18:53:29 -- accel/accel.sh@20 -- # read -r var val 00:07:12.625 18:53:29 -- accel/accel.sh@21 -- # val= 00:07:12.625 18:53:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.625 18:53:29 -- accel/accel.sh@20 -- # IFS=: 00:07:12.625 18:53:29 -- accel/accel.sh@20 -- # read -r var val 00:07:12.625 18:53:29 -- accel/accel.sh@21 -- # val= 00:07:12.625 18:53:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.625 18:53:29 -- accel/accel.sh@20 -- # IFS=: 00:07:12.625 18:53:29 -- accel/accel.sh@20 -- # read -r var val 00:07:12.625 18:53:29 -- accel/accel.sh@21 -- # val=decompress 00:07:12.625 18:53:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.625 18:53:29 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:12.625 18:53:29 -- accel/accel.sh@20 -- # IFS=: 00:07:12.625 18:53:29 -- accel/accel.sh@20 -- # read -r var val 00:07:12.625 18:53:29 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:12.625 18:53:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.625 18:53:29 -- accel/accel.sh@20 -- # IFS=: 00:07:12.625 18:53:29 -- accel/accel.sh@20 -- # read -r var val 00:07:12.625 18:53:29 -- accel/accel.sh@21 -- # val= 00:07:12.625 18:53:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.625 18:53:29 -- accel/accel.sh@20 -- # IFS=: 00:07:12.625 18:53:29 -- accel/accel.sh@20 -- # read -r var val 00:07:12.625 18:53:29 -- accel/accel.sh@21 -- # val=software 00:07:12.625 18:53:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.625 18:53:29 -- accel/accel.sh@23 -- # accel_module=software 00:07:12.625 18:53:29 -- accel/accel.sh@20 -- # IFS=: 00:07:12.625 18:53:29 -- accel/accel.sh@20 -- # read -r var val 00:07:12.625 18:53:29 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:12.625 18:53:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.625 18:53:29 -- accel/accel.sh@20 -- # IFS=: 00:07:12.625 18:53:29 -- accel/accel.sh@20 -- # read -r var val 00:07:12.625 18:53:29 -- accel/accel.sh@21 -- # val=32 00:07:12.625 18:53:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.625 18:53:29 -- accel/accel.sh@20 -- # IFS=: 00:07:12.625 18:53:29 -- accel/accel.sh@20 -- # read -r var val 00:07:12.625 18:53:29 -- accel/accel.sh@21 -- # val=32 00:07:12.625 18:53:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.625 18:53:29 -- accel/accel.sh@20 -- # IFS=: 00:07:12.625 18:53:29 -- accel/accel.sh@20 -- # read -r var val 00:07:12.625 18:53:29 -- accel/accel.sh@21 -- # val=1 00:07:12.625 18:53:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.625 18:53:29 -- accel/accel.sh@20 -- # IFS=: 00:07:12.625 18:53:29 -- accel/accel.sh@20 -- # read -r var val 00:07:12.625 18:53:29 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:12.625 18:53:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.625 18:53:29 -- accel/accel.sh@20 -- # IFS=: 00:07:12.625 18:53:29 -- accel/accel.sh@20 -- # read -r var val 00:07:12.625 18:53:29 -- accel/accel.sh@21 -- # val=Yes 00:07:12.625 18:53:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.625 18:53:29 -- accel/accel.sh@20 -- # IFS=: 00:07:12.625 18:53:29 -- accel/accel.sh@20 -- # read -r var val 00:07:12.625 18:53:29 -- accel/accel.sh@21 -- # val= 00:07:12.625 18:53:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.625 18:53:29 -- accel/accel.sh@20 -- # IFS=: 00:07:12.625 18:53:29 -- accel/accel.sh@20 -- # read -r var val 00:07:12.625 18:53:29 -- accel/accel.sh@21 -- # val= 00:07:12.625 18:53:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.625 18:53:29 -- accel/accel.sh@20 -- # IFS=: 00:07:12.625 18:53:29 -- accel/accel.sh@20 -- # read -r var val 00:07:14.000 18:53:30 -- accel/accel.sh@21 -- # val= 00:07:14.000 18:53:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.000 18:53:30 -- accel/accel.sh@20 -- # IFS=: 00:07:14.000 18:53:30 -- accel/accel.sh@20 -- # read -r var val 00:07:14.000 18:53:30 -- accel/accel.sh@21 -- # val= 00:07:14.000 18:53:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.000 18:53:30 -- accel/accel.sh@20 -- # IFS=: 00:07:14.000 18:53:30 -- accel/accel.sh@20 -- # read -r var val 00:07:14.000 18:53:30 -- accel/accel.sh@21 -- # val= 00:07:14.000 18:53:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.000 18:53:30 -- accel/accel.sh@20 -- # IFS=: 00:07:14.000 18:53:30 -- accel/accel.sh@20 -- # read -r var val 00:07:14.000 18:53:30 -- accel/accel.sh@21 -- # val= 00:07:14.000 18:53:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.000 18:53:30 -- accel/accel.sh@20 -- # IFS=: 00:07:14.000 18:53:30 -- accel/accel.sh@20 -- # read -r var val 00:07:14.000 18:53:30 -- accel/accel.sh@21 -- # val= 00:07:14.000 18:53:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.000 18:53:30 -- accel/accel.sh@20 -- # IFS=: 00:07:14.000 18:53:30 -- accel/accel.sh@20 -- # read -r var val 00:07:14.000 18:53:30 -- accel/accel.sh@21 -- # val= 00:07:14.000 18:53:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.000 18:53:30 -- accel/accel.sh@20 -- # IFS=: 00:07:14.000 18:53:30 -- accel/accel.sh@20 -- # read -r var val 00:07:14.000 18:53:30 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:14.000 18:53:30 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:14.000 18:53:30 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:14.000 00:07:14.000 real 0m2.567s 00:07:14.000 user 0m2.357s 00:07:14.000 sys 0m0.220s 00:07:14.000 18:53:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:14.000 18:53:30 -- common/autotest_common.sh@10 -- # set +x 00:07:14.000 ************************************ 00:07:14.000 END TEST accel_decomp 00:07:14.000 ************************************ 00:07:14.000 18:53:30 -- accel/accel.sh@110 -- # run_test accel_decmop_full accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:14.000 18:53:30 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:07:14.000 18:53:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:14.000 18:53:30 -- common/autotest_common.sh@10 -- # set +x 00:07:14.000 ************************************ 00:07:14.000 START TEST accel_decmop_full 00:07:14.000 ************************************ 00:07:14.000 18:53:30 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:14.000 18:53:30 -- accel/accel.sh@16 -- # local accel_opc 00:07:14.000 18:53:30 -- accel/accel.sh@17 -- # local accel_module 00:07:14.000 18:53:30 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:14.000 18:53:30 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:14.000 18:53:30 -- accel/accel.sh@12 -- # build_accel_config 00:07:14.000 18:53:30 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:14.000 18:53:30 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:14.000 18:53:30 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:14.000 18:53:30 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:14.000 18:53:30 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:14.000 18:53:30 -- accel/accel.sh@41 -- # local IFS=, 00:07:14.000 18:53:30 -- accel/accel.sh@42 -- # jq -r . 00:07:14.000 [2024-11-26 18:53:30.580180] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:14.000 [2024-11-26 18:53:30.580239] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2941409 ] 00:07:14.000 EAL: No free 2048 kB hugepages reported on node 1 00:07:14.000 [2024-11-26 18:53:30.636556] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:14.000 [2024-11-26 18:53:30.674122] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:14.933 18:53:31 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:14.933 00:07:14.933 SPDK Configuration: 00:07:14.933 Core mask: 0x1 00:07:14.933 00:07:14.933 Accel Perf Configuration: 00:07:14.933 Workload Type: decompress 00:07:14.933 Transfer size: 111250 bytes 00:07:14.933 Vector count 1 00:07:14.933 Module: software 00:07:14.933 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:14.933 Queue depth: 32 00:07:14.933 Allocate depth: 32 00:07:14.933 # threads/core: 1 00:07:14.933 Run time: 1 seconds 00:07:14.933 Verify: Yes 00:07:14.933 00:07:14.933 Running for 1 seconds... 00:07:14.933 00:07:14.933 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:14.933 ------------------------------------------------------------------------------------ 00:07:14.933 0,0 4960/s 204 MiB/s 0 0 00:07:14.933 ==================================================================================== 00:07:14.933 Total 4960/s 526 MiB/s 0 0' 00:07:15.191 18:53:31 -- accel/accel.sh@20 -- # IFS=: 00:07:15.191 18:53:31 -- accel/accel.sh@20 -- # read -r var val 00:07:15.191 18:53:31 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:15.191 18:53:31 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:15.191 18:53:31 -- accel/accel.sh@12 -- # build_accel_config 00:07:15.191 18:53:31 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:15.191 18:53:31 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:15.191 18:53:31 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:15.191 18:53:31 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:15.191 18:53:31 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:15.191 18:53:31 -- accel/accel.sh@41 -- # local IFS=, 00:07:15.191 18:53:31 -- accel/accel.sh@42 -- # jq -r . 00:07:15.191 [2024-11-26 18:53:31.881919] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:15.191 [2024-11-26 18:53:31.882001] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2941634 ] 00:07:15.191 EAL: No free 2048 kB hugepages reported on node 1 00:07:15.191 [2024-11-26 18:53:31.939288] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:15.191 [2024-11-26 18:53:31.975856] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:15.191 18:53:32 -- accel/accel.sh@21 -- # val= 00:07:15.191 18:53:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.191 18:53:32 -- accel/accel.sh@20 -- # IFS=: 00:07:15.192 18:53:32 -- accel/accel.sh@20 -- # read -r var val 00:07:15.192 18:53:32 -- accel/accel.sh@21 -- # val= 00:07:15.192 18:53:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.192 18:53:32 -- accel/accel.sh@20 -- # IFS=: 00:07:15.192 18:53:32 -- accel/accel.sh@20 -- # read -r var val 00:07:15.192 18:53:32 -- accel/accel.sh@21 -- # val= 00:07:15.192 18:53:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.192 18:53:32 -- accel/accel.sh@20 -- # IFS=: 00:07:15.192 18:53:32 -- accel/accel.sh@20 -- # read -r var val 00:07:15.192 18:53:32 -- accel/accel.sh@21 -- # val=0x1 00:07:15.192 18:53:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.192 18:53:32 -- accel/accel.sh@20 -- # IFS=: 00:07:15.192 18:53:32 -- accel/accel.sh@20 -- # read -r var val 00:07:15.192 18:53:32 -- accel/accel.sh@21 -- # val= 00:07:15.192 18:53:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.192 18:53:32 -- accel/accel.sh@20 -- # IFS=: 00:07:15.192 18:53:32 -- accel/accel.sh@20 -- # read -r var val 00:07:15.192 18:53:32 -- accel/accel.sh@21 -- # val= 00:07:15.192 18:53:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.192 18:53:32 -- accel/accel.sh@20 -- # IFS=: 00:07:15.192 18:53:32 -- accel/accel.sh@20 -- # read -r var val 00:07:15.192 18:53:32 -- accel/accel.sh@21 -- # val=decompress 00:07:15.192 18:53:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.192 18:53:32 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:15.192 18:53:32 -- accel/accel.sh@20 -- # IFS=: 00:07:15.192 18:53:32 -- accel/accel.sh@20 -- # read -r var val 00:07:15.192 18:53:32 -- accel/accel.sh@21 -- # val='111250 bytes' 00:07:15.192 18:53:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.192 18:53:32 -- accel/accel.sh@20 -- # IFS=: 00:07:15.192 18:53:32 -- accel/accel.sh@20 -- # read -r var val 00:07:15.192 18:53:32 -- accel/accel.sh@21 -- # val= 00:07:15.192 18:53:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.192 18:53:32 -- accel/accel.sh@20 -- # IFS=: 00:07:15.192 18:53:32 -- accel/accel.sh@20 -- # read -r var val 00:07:15.192 18:53:32 -- accel/accel.sh@21 -- # val=software 00:07:15.192 18:53:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.192 18:53:32 -- accel/accel.sh@23 -- # accel_module=software 00:07:15.192 18:53:32 -- accel/accel.sh@20 -- # IFS=: 00:07:15.192 18:53:32 -- accel/accel.sh@20 -- # read -r var val 00:07:15.192 18:53:32 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:15.192 18:53:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.192 18:53:32 -- accel/accel.sh@20 -- # IFS=: 00:07:15.192 18:53:32 -- accel/accel.sh@20 -- # read -r var val 00:07:15.192 18:53:32 -- accel/accel.sh@21 -- # val=32 00:07:15.192 18:53:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.192 18:53:32 -- accel/accel.sh@20 -- # IFS=: 00:07:15.192 18:53:32 -- accel/accel.sh@20 -- # read -r var val 00:07:15.192 18:53:32 -- accel/accel.sh@21 -- # val=32 00:07:15.192 18:53:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.192 18:53:32 -- accel/accel.sh@20 -- # IFS=: 00:07:15.192 18:53:32 -- accel/accel.sh@20 -- # read -r var val 00:07:15.192 18:53:32 -- accel/accel.sh@21 -- # val=1 00:07:15.192 18:53:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.192 18:53:32 -- accel/accel.sh@20 -- # IFS=: 00:07:15.192 18:53:32 -- accel/accel.sh@20 -- # read -r var val 00:07:15.192 18:53:32 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:15.192 18:53:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.192 18:53:32 -- accel/accel.sh@20 -- # IFS=: 00:07:15.192 18:53:32 -- accel/accel.sh@20 -- # read -r var val 00:07:15.192 18:53:32 -- accel/accel.sh@21 -- # val=Yes 00:07:15.192 18:53:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.192 18:53:32 -- accel/accel.sh@20 -- # IFS=: 00:07:15.192 18:53:32 -- accel/accel.sh@20 -- # read -r var val 00:07:15.192 18:53:32 -- accel/accel.sh@21 -- # val= 00:07:15.192 18:53:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.192 18:53:32 -- accel/accel.sh@20 -- # IFS=: 00:07:15.192 18:53:32 -- accel/accel.sh@20 -- # read -r var val 00:07:15.192 18:53:32 -- accel/accel.sh@21 -- # val= 00:07:15.192 18:53:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.192 18:53:32 -- accel/accel.sh@20 -- # IFS=: 00:07:15.192 18:53:32 -- accel/accel.sh@20 -- # read -r var val 00:07:16.565 18:53:33 -- accel/accel.sh@21 -- # val= 00:07:16.565 18:53:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.565 18:53:33 -- accel/accel.sh@20 -- # IFS=: 00:07:16.565 18:53:33 -- accel/accel.sh@20 -- # read -r var val 00:07:16.565 18:53:33 -- accel/accel.sh@21 -- # val= 00:07:16.565 18:53:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.565 18:53:33 -- accel/accel.sh@20 -- # IFS=: 00:07:16.565 18:53:33 -- accel/accel.sh@20 -- # read -r var val 00:07:16.565 18:53:33 -- accel/accel.sh@21 -- # val= 00:07:16.565 18:53:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.565 18:53:33 -- accel/accel.sh@20 -- # IFS=: 00:07:16.565 18:53:33 -- accel/accel.sh@20 -- # read -r var val 00:07:16.565 18:53:33 -- accel/accel.sh@21 -- # val= 00:07:16.565 18:53:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.565 18:53:33 -- accel/accel.sh@20 -- # IFS=: 00:07:16.565 18:53:33 -- accel/accel.sh@20 -- # read -r var val 00:07:16.565 18:53:33 -- accel/accel.sh@21 -- # val= 00:07:16.565 18:53:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.565 18:53:33 -- accel/accel.sh@20 -- # IFS=: 00:07:16.565 18:53:33 -- accel/accel.sh@20 -- # read -r var val 00:07:16.565 18:53:33 -- accel/accel.sh@21 -- # val= 00:07:16.565 18:53:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.565 18:53:33 -- accel/accel.sh@20 -- # IFS=: 00:07:16.565 18:53:33 -- accel/accel.sh@20 -- # read -r var val 00:07:16.565 18:53:33 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:16.565 18:53:33 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:16.565 18:53:33 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:16.565 00:07:16.565 real 0m2.607s 00:07:16.565 user 0m2.393s 00:07:16.565 sys 0m0.223s 00:07:16.565 18:53:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:16.565 18:53:33 -- common/autotest_common.sh@10 -- # set +x 00:07:16.565 ************************************ 00:07:16.565 END TEST accel_decmop_full 00:07:16.565 ************************************ 00:07:16.565 18:53:33 -- accel/accel.sh@111 -- # run_test accel_decomp_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:16.565 18:53:33 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:07:16.565 18:53:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:16.565 18:53:33 -- common/autotest_common.sh@10 -- # set +x 00:07:16.565 ************************************ 00:07:16.565 START TEST accel_decomp_mcore 00:07:16.565 ************************************ 00:07:16.565 18:53:33 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:16.565 18:53:33 -- accel/accel.sh@16 -- # local accel_opc 00:07:16.565 18:53:33 -- accel/accel.sh@17 -- # local accel_module 00:07:16.565 18:53:33 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:16.565 18:53:33 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:16.565 18:53:33 -- accel/accel.sh@12 -- # build_accel_config 00:07:16.565 18:53:33 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:16.565 18:53:33 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:16.565 18:53:33 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:16.565 18:53:33 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:16.565 18:53:33 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:16.565 18:53:33 -- accel/accel.sh@41 -- # local IFS=, 00:07:16.565 18:53:33 -- accel/accel.sh@42 -- # jq -r . 00:07:16.565 [2024-11-26 18:53:33.221501] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:16.565 [2024-11-26 18:53:33.221564] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2941887 ] 00:07:16.565 EAL: No free 2048 kB hugepages reported on node 1 00:07:16.565 [2024-11-26 18:53:33.276650] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:16.565 [2024-11-26 18:53:33.316548] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:16.565 [2024-11-26 18:53:33.316647] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:16.565 [2024-11-26 18:53:33.316709] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:16.565 [2024-11-26 18:53:33.316711] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:17.941 18:53:34 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:17.941 00:07:17.941 SPDK Configuration: 00:07:17.941 Core mask: 0xf 00:07:17.941 00:07:17.941 Accel Perf Configuration: 00:07:17.941 Workload Type: decompress 00:07:17.941 Transfer size: 4096 bytes 00:07:17.941 Vector count 1 00:07:17.941 Module: software 00:07:17.941 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:17.941 Queue depth: 32 00:07:17.941 Allocate depth: 32 00:07:17.941 # threads/core: 1 00:07:17.941 Run time: 1 seconds 00:07:17.941 Verify: Yes 00:07:17.941 00:07:17.941 Running for 1 seconds... 00:07:17.941 00:07:17.941 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:17.941 ------------------------------------------------------------------------------------ 00:07:17.941 0,0 60864/s 112 MiB/s 0 0 00:07:17.941 3,0 61376/s 113 MiB/s 0 0 00:07:17.941 2,0 61376/s 113 MiB/s 0 0 00:07:17.941 1,0 61248/s 112 MiB/s 0 0 00:07:17.941 ==================================================================================== 00:07:17.941 Total 244864/s 956 MiB/s 0 0' 00:07:17.941 18:53:34 -- accel/accel.sh@20 -- # IFS=: 00:07:17.941 18:53:34 -- accel/accel.sh@20 -- # read -r var val 00:07:17.941 18:53:34 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:17.941 18:53:34 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:17.941 18:53:34 -- accel/accel.sh@12 -- # build_accel_config 00:07:17.941 18:53:34 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:17.941 18:53:34 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:17.941 18:53:34 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:17.941 18:53:34 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:17.941 18:53:34 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:17.941 18:53:34 -- accel/accel.sh@41 -- # local IFS=, 00:07:17.941 18:53:34 -- accel/accel.sh@42 -- # jq -r . 00:07:17.941 [2024-11-26 18:53:34.519125] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:17.941 [2024-11-26 18:53:34.519201] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2942124 ] 00:07:17.941 EAL: No free 2048 kB hugepages reported on node 1 00:07:17.941 [2024-11-26 18:53:34.577028] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:17.941 [2024-11-26 18:53:34.615466] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:17.941 [2024-11-26 18:53:34.615560] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:17.941 [2024-11-26 18:53:34.615650] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:17.941 [2024-11-26 18:53:34.615651] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:17.941 18:53:34 -- accel/accel.sh@21 -- # val= 00:07:17.941 18:53:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.941 18:53:34 -- accel/accel.sh@20 -- # IFS=: 00:07:17.941 18:53:34 -- accel/accel.sh@20 -- # read -r var val 00:07:17.941 18:53:34 -- accel/accel.sh@21 -- # val= 00:07:17.941 18:53:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.941 18:53:34 -- accel/accel.sh@20 -- # IFS=: 00:07:17.941 18:53:34 -- accel/accel.sh@20 -- # read -r var val 00:07:17.941 18:53:34 -- accel/accel.sh@21 -- # val= 00:07:17.941 18:53:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.941 18:53:34 -- accel/accel.sh@20 -- # IFS=: 00:07:17.941 18:53:34 -- accel/accel.sh@20 -- # read -r var val 00:07:17.941 18:53:34 -- accel/accel.sh@21 -- # val=0xf 00:07:17.941 18:53:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.941 18:53:34 -- accel/accel.sh@20 -- # IFS=: 00:07:17.941 18:53:34 -- accel/accel.sh@20 -- # read -r var val 00:07:17.941 18:53:34 -- accel/accel.sh@21 -- # val= 00:07:17.941 18:53:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.941 18:53:34 -- accel/accel.sh@20 -- # IFS=: 00:07:17.941 18:53:34 -- accel/accel.sh@20 -- # read -r var val 00:07:17.941 18:53:34 -- accel/accel.sh@21 -- # val= 00:07:17.941 18:53:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.941 18:53:34 -- accel/accel.sh@20 -- # IFS=: 00:07:17.941 18:53:34 -- accel/accel.sh@20 -- # read -r var val 00:07:17.941 18:53:34 -- accel/accel.sh@21 -- # val=decompress 00:07:17.941 18:53:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.942 18:53:34 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:17.942 18:53:34 -- accel/accel.sh@20 -- # IFS=: 00:07:17.942 18:53:34 -- accel/accel.sh@20 -- # read -r var val 00:07:17.942 18:53:34 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:17.942 18:53:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.942 18:53:34 -- accel/accel.sh@20 -- # IFS=: 00:07:17.942 18:53:34 -- accel/accel.sh@20 -- # read -r var val 00:07:17.942 18:53:34 -- accel/accel.sh@21 -- # val= 00:07:17.942 18:53:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.942 18:53:34 -- accel/accel.sh@20 -- # IFS=: 00:07:17.942 18:53:34 -- accel/accel.sh@20 -- # read -r var val 00:07:17.942 18:53:34 -- accel/accel.sh@21 -- # val=software 00:07:17.942 18:53:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.942 18:53:34 -- accel/accel.sh@23 -- # accel_module=software 00:07:17.942 18:53:34 -- accel/accel.sh@20 -- # IFS=: 00:07:17.942 18:53:34 -- accel/accel.sh@20 -- # read -r var val 00:07:17.942 18:53:34 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:17.942 18:53:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.942 18:53:34 -- accel/accel.sh@20 -- # IFS=: 00:07:17.942 18:53:34 -- accel/accel.sh@20 -- # read -r var val 00:07:17.942 18:53:34 -- accel/accel.sh@21 -- # val=32 00:07:17.942 18:53:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.942 18:53:34 -- accel/accel.sh@20 -- # IFS=: 00:07:17.942 18:53:34 -- accel/accel.sh@20 -- # read -r var val 00:07:17.942 18:53:34 -- accel/accel.sh@21 -- # val=32 00:07:17.942 18:53:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.942 18:53:34 -- accel/accel.sh@20 -- # IFS=: 00:07:17.942 18:53:34 -- accel/accel.sh@20 -- # read -r var val 00:07:17.942 18:53:34 -- accel/accel.sh@21 -- # val=1 00:07:17.942 18:53:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.942 18:53:34 -- accel/accel.sh@20 -- # IFS=: 00:07:17.942 18:53:34 -- accel/accel.sh@20 -- # read -r var val 00:07:17.942 18:53:34 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:17.942 18:53:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.942 18:53:34 -- accel/accel.sh@20 -- # IFS=: 00:07:17.942 18:53:34 -- accel/accel.sh@20 -- # read -r var val 00:07:17.942 18:53:34 -- accel/accel.sh@21 -- # val=Yes 00:07:17.942 18:53:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.942 18:53:34 -- accel/accel.sh@20 -- # IFS=: 00:07:17.942 18:53:34 -- accel/accel.sh@20 -- # read -r var val 00:07:17.942 18:53:34 -- accel/accel.sh@21 -- # val= 00:07:17.942 18:53:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.942 18:53:34 -- accel/accel.sh@20 -- # IFS=: 00:07:17.942 18:53:34 -- accel/accel.sh@20 -- # read -r var val 00:07:17.942 18:53:34 -- accel/accel.sh@21 -- # val= 00:07:17.942 18:53:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.942 18:53:34 -- accel/accel.sh@20 -- # IFS=: 00:07:17.942 18:53:34 -- accel/accel.sh@20 -- # read -r var val 00:07:18.879 18:53:35 -- accel/accel.sh@21 -- # val= 00:07:18.879 18:53:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.879 18:53:35 -- accel/accel.sh@20 -- # IFS=: 00:07:18.879 18:53:35 -- accel/accel.sh@20 -- # read -r var val 00:07:18.879 18:53:35 -- accel/accel.sh@21 -- # val= 00:07:18.879 18:53:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.879 18:53:35 -- accel/accel.sh@20 -- # IFS=: 00:07:18.879 18:53:35 -- accel/accel.sh@20 -- # read -r var val 00:07:18.879 18:53:35 -- accel/accel.sh@21 -- # val= 00:07:18.879 18:53:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.879 18:53:35 -- accel/accel.sh@20 -- # IFS=: 00:07:18.879 18:53:35 -- accel/accel.sh@20 -- # read -r var val 00:07:18.879 18:53:35 -- accel/accel.sh@21 -- # val= 00:07:18.879 18:53:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.879 18:53:35 -- accel/accel.sh@20 -- # IFS=: 00:07:18.879 18:53:35 -- accel/accel.sh@20 -- # read -r var val 00:07:18.879 18:53:35 -- accel/accel.sh@21 -- # val= 00:07:18.879 18:53:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.879 18:53:35 -- accel/accel.sh@20 -- # IFS=: 00:07:18.879 18:53:35 -- accel/accel.sh@20 -- # read -r var val 00:07:18.879 18:53:35 -- accel/accel.sh@21 -- # val= 00:07:18.879 18:53:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.879 18:53:35 -- accel/accel.sh@20 -- # IFS=: 00:07:18.879 18:53:35 -- accel/accel.sh@20 -- # read -r var val 00:07:18.879 18:53:35 -- accel/accel.sh@21 -- # val= 00:07:18.879 18:53:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.879 18:53:35 -- accel/accel.sh@20 -- # IFS=: 00:07:18.879 18:53:35 -- accel/accel.sh@20 -- # read -r var val 00:07:18.879 18:53:35 -- accel/accel.sh@21 -- # val= 00:07:18.879 18:53:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.879 18:53:35 -- accel/accel.sh@20 -- # IFS=: 00:07:18.879 18:53:35 -- accel/accel.sh@20 -- # read -r var val 00:07:18.879 18:53:35 -- accel/accel.sh@21 -- # val= 00:07:18.879 18:53:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.879 18:53:35 -- accel/accel.sh@20 -- # IFS=: 00:07:18.879 18:53:35 -- accel/accel.sh@20 -- # read -r var val 00:07:18.879 18:53:35 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:18.879 18:53:35 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:18.879 18:53:35 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:18.879 00:07:18.879 real 0m2.603s 00:07:18.879 user 0m9.028s 00:07:18.879 sys 0m0.238s 00:07:18.879 18:53:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:18.879 18:53:35 -- common/autotest_common.sh@10 -- # set +x 00:07:18.879 ************************************ 00:07:18.879 END TEST accel_decomp_mcore 00:07:18.879 ************************************ 00:07:19.139 18:53:35 -- accel/accel.sh@112 -- # run_test accel_decomp_full_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:19.139 18:53:35 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:07:19.139 18:53:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:19.139 18:53:35 -- common/autotest_common.sh@10 -- # set +x 00:07:19.139 ************************************ 00:07:19.139 START TEST accel_decomp_full_mcore 00:07:19.139 ************************************ 00:07:19.139 18:53:35 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:19.139 18:53:35 -- accel/accel.sh@16 -- # local accel_opc 00:07:19.139 18:53:35 -- accel/accel.sh@17 -- # local accel_module 00:07:19.140 18:53:35 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:19.140 18:53:35 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:19.140 18:53:35 -- accel/accel.sh@12 -- # build_accel_config 00:07:19.140 18:53:35 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:19.140 18:53:35 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:19.140 18:53:35 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:19.140 18:53:35 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:19.140 18:53:35 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:19.140 18:53:35 -- accel/accel.sh@41 -- # local IFS=, 00:07:19.140 18:53:35 -- accel/accel.sh@42 -- # jq -r . 00:07:19.140 [2024-11-26 18:53:35.849660] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:19.140 [2024-11-26 18:53:35.849706] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2942375 ] 00:07:19.140 EAL: No free 2048 kB hugepages reported on node 1 00:07:19.140 [2024-11-26 18:53:35.903275] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:19.140 [2024-11-26 18:53:35.942865] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:19.140 [2024-11-26 18:53:35.942972] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:19.140 [2024-11-26 18:53:35.943040] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:19.140 [2024-11-26 18:53:35.943041] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:20.517 18:53:37 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:20.517 00:07:20.517 SPDK Configuration: 00:07:20.517 Core mask: 0xf 00:07:20.517 00:07:20.517 Accel Perf Configuration: 00:07:20.517 Workload Type: decompress 00:07:20.517 Transfer size: 111250 bytes 00:07:20.517 Vector count 1 00:07:20.517 Module: software 00:07:20.517 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:20.517 Queue depth: 32 00:07:20.517 Allocate depth: 32 00:07:20.517 # threads/core: 1 00:07:20.517 Run time: 1 seconds 00:07:20.517 Verify: Yes 00:07:20.517 00:07:20.517 Running for 1 seconds... 00:07:20.517 00:07:20.517 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:20.517 ------------------------------------------------------------------------------------ 00:07:20.517 0,0 4640/s 191 MiB/s 0 0 00:07:20.517 3,0 4640/s 191 MiB/s 0 0 00:07:20.517 2,0 4640/s 191 MiB/s 0 0 00:07:20.517 1,0 4640/s 191 MiB/s 0 0 00:07:20.517 ==================================================================================== 00:07:20.517 Total 18560/s 1969 MiB/s 0 0' 00:07:20.517 18:53:37 -- accel/accel.sh@20 -- # IFS=: 00:07:20.517 18:53:37 -- accel/accel.sh@20 -- # read -r var val 00:07:20.517 18:53:37 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:20.517 18:53:37 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:20.517 18:53:37 -- accel/accel.sh@12 -- # build_accel_config 00:07:20.517 18:53:37 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:20.517 18:53:37 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:20.517 18:53:37 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:20.517 18:53:37 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:20.517 18:53:37 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:20.517 18:53:37 -- accel/accel.sh@41 -- # local IFS=, 00:07:20.517 18:53:37 -- accel/accel.sh@42 -- # jq -r . 00:07:20.517 [2024-11-26 18:53:37.158250] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:20.517 [2024-11-26 18:53:37.158324] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2942615 ] 00:07:20.517 EAL: No free 2048 kB hugepages reported on node 1 00:07:20.517 [2024-11-26 18:53:37.215915] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:20.517 [2024-11-26 18:53:37.254935] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:20.517 [2024-11-26 18:53:37.255033] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:20.517 [2024-11-26 18:53:37.255052] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:20.517 [2024-11-26 18:53:37.255053] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:20.517 18:53:37 -- accel/accel.sh@21 -- # val= 00:07:20.517 18:53:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.517 18:53:37 -- accel/accel.sh@20 -- # IFS=: 00:07:20.517 18:53:37 -- accel/accel.sh@20 -- # read -r var val 00:07:20.517 18:53:37 -- accel/accel.sh@21 -- # val= 00:07:20.517 18:53:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.517 18:53:37 -- accel/accel.sh@20 -- # IFS=: 00:07:20.517 18:53:37 -- accel/accel.sh@20 -- # read -r var val 00:07:20.517 18:53:37 -- accel/accel.sh@21 -- # val= 00:07:20.517 18:53:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.517 18:53:37 -- accel/accel.sh@20 -- # IFS=: 00:07:20.517 18:53:37 -- accel/accel.sh@20 -- # read -r var val 00:07:20.517 18:53:37 -- accel/accel.sh@21 -- # val=0xf 00:07:20.517 18:53:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.517 18:53:37 -- accel/accel.sh@20 -- # IFS=: 00:07:20.517 18:53:37 -- accel/accel.sh@20 -- # read -r var val 00:07:20.517 18:53:37 -- accel/accel.sh@21 -- # val= 00:07:20.517 18:53:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.517 18:53:37 -- accel/accel.sh@20 -- # IFS=: 00:07:20.517 18:53:37 -- accel/accel.sh@20 -- # read -r var val 00:07:20.517 18:53:37 -- accel/accel.sh@21 -- # val= 00:07:20.517 18:53:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.517 18:53:37 -- accel/accel.sh@20 -- # IFS=: 00:07:20.517 18:53:37 -- accel/accel.sh@20 -- # read -r var val 00:07:20.517 18:53:37 -- accel/accel.sh@21 -- # val=decompress 00:07:20.517 18:53:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.517 18:53:37 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:20.517 18:53:37 -- accel/accel.sh@20 -- # IFS=: 00:07:20.517 18:53:37 -- accel/accel.sh@20 -- # read -r var val 00:07:20.517 18:53:37 -- accel/accel.sh@21 -- # val='111250 bytes' 00:07:20.517 18:53:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.517 18:53:37 -- accel/accel.sh@20 -- # IFS=: 00:07:20.517 18:53:37 -- accel/accel.sh@20 -- # read -r var val 00:07:20.517 18:53:37 -- accel/accel.sh@21 -- # val= 00:07:20.517 18:53:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.517 18:53:37 -- accel/accel.sh@20 -- # IFS=: 00:07:20.517 18:53:37 -- accel/accel.sh@20 -- # read -r var val 00:07:20.517 18:53:37 -- accel/accel.sh@21 -- # val=software 00:07:20.517 18:53:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.517 18:53:37 -- accel/accel.sh@23 -- # accel_module=software 00:07:20.517 18:53:37 -- accel/accel.sh@20 -- # IFS=: 00:07:20.517 18:53:37 -- accel/accel.sh@20 -- # read -r var val 00:07:20.517 18:53:37 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:20.517 18:53:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.517 18:53:37 -- accel/accel.sh@20 -- # IFS=: 00:07:20.517 18:53:37 -- accel/accel.sh@20 -- # read -r var val 00:07:20.517 18:53:37 -- accel/accel.sh@21 -- # val=32 00:07:20.517 18:53:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.517 18:53:37 -- accel/accel.sh@20 -- # IFS=: 00:07:20.517 18:53:37 -- accel/accel.sh@20 -- # read -r var val 00:07:20.517 18:53:37 -- accel/accel.sh@21 -- # val=32 00:07:20.517 18:53:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.517 18:53:37 -- accel/accel.sh@20 -- # IFS=: 00:07:20.517 18:53:37 -- accel/accel.sh@20 -- # read -r var val 00:07:20.517 18:53:37 -- accel/accel.sh@21 -- # val=1 00:07:20.517 18:53:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.517 18:53:37 -- accel/accel.sh@20 -- # IFS=: 00:07:20.517 18:53:37 -- accel/accel.sh@20 -- # read -r var val 00:07:20.517 18:53:37 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:20.517 18:53:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.517 18:53:37 -- accel/accel.sh@20 -- # IFS=: 00:07:20.517 18:53:37 -- accel/accel.sh@20 -- # read -r var val 00:07:20.517 18:53:37 -- accel/accel.sh@21 -- # val=Yes 00:07:20.517 18:53:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.517 18:53:37 -- accel/accel.sh@20 -- # IFS=: 00:07:20.517 18:53:37 -- accel/accel.sh@20 -- # read -r var val 00:07:20.517 18:53:37 -- accel/accel.sh@21 -- # val= 00:07:20.517 18:53:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.517 18:53:37 -- accel/accel.sh@20 -- # IFS=: 00:07:20.517 18:53:37 -- accel/accel.sh@20 -- # read -r var val 00:07:20.517 18:53:37 -- accel/accel.sh@21 -- # val= 00:07:20.518 18:53:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.518 18:53:37 -- accel/accel.sh@20 -- # IFS=: 00:07:20.518 18:53:37 -- accel/accel.sh@20 -- # read -r var val 00:07:21.895 18:53:38 -- accel/accel.sh@21 -- # val= 00:07:21.895 18:53:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.895 18:53:38 -- accel/accel.sh@20 -- # IFS=: 00:07:21.895 18:53:38 -- accel/accel.sh@20 -- # read -r var val 00:07:21.895 18:53:38 -- accel/accel.sh@21 -- # val= 00:07:21.895 18:53:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.895 18:53:38 -- accel/accel.sh@20 -- # IFS=: 00:07:21.895 18:53:38 -- accel/accel.sh@20 -- # read -r var val 00:07:21.895 18:53:38 -- accel/accel.sh@21 -- # val= 00:07:21.895 18:53:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.895 18:53:38 -- accel/accel.sh@20 -- # IFS=: 00:07:21.895 18:53:38 -- accel/accel.sh@20 -- # read -r var val 00:07:21.895 18:53:38 -- accel/accel.sh@21 -- # val= 00:07:21.895 18:53:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.895 18:53:38 -- accel/accel.sh@20 -- # IFS=: 00:07:21.895 18:53:38 -- accel/accel.sh@20 -- # read -r var val 00:07:21.895 18:53:38 -- accel/accel.sh@21 -- # val= 00:07:21.895 18:53:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.895 18:53:38 -- accel/accel.sh@20 -- # IFS=: 00:07:21.895 18:53:38 -- accel/accel.sh@20 -- # read -r var val 00:07:21.895 18:53:38 -- accel/accel.sh@21 -- # val= 00:07:21.895 18:53:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.895 18:53:38 -- accel/accel.sh@20 -- # IFS=: 00:07:21.895 18:53:38 -- accel/accel.sh@20 -- # read -r var val 00:07:21.895 18:53:38 -- accel/accel.sh@21 -- # val= 00:07:21.895 18:53:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.895 18:53:38 -- accel/accel.sh@20 -- # IFS=: 00:07:21.895 18:53:38 -- accel/accel.sh@20 -- # read -r var val 00:07:21.895 18:53:38 -- accel/accel.sh@21 -- # val= 00:07:21.895 18:53:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.895 18:53:38 -- accel/accel.sh@20 -- # IFS=: 00:07:21.895 18:53:38 -- accel/accel.sh@20 -- # read -r var val 00:07:21.895 18:53:38 -- accel/accel.sh@21 -- # val= 00:07:21.895 18:53:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.895 18:53:38 -- accel/accel.sh@20 -- # IFS=: 00:07:21.896 18:53:38 -- accel/accel.sh@20 -- # read -r var val 00:07:21.896 18:53:38 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:21.896 18:53:38 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:21.896 18:53:38 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:21.896 00:07:21.896 real 0m2.616s 00:07:21.896 user 0m9.111s 00:07:21.896 sys 0m0.240s 00:07:21.896 18:53:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:21.896 18:53:38 -- common/autotest_common.sh@10 -- # set +x 00:07:21.896 ************************************ 00:07:21.896 END TEST accel_decomp_full_mcore 00:07:21.896 ************************************ 00:07:21.896 18:53:38 -- accel/accel.sh@113 -- # run_test accel_decomp_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:21.896 18:53:38 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:07:21.896 18:53:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:21.896 18:53:38 -- common/autotest_common.sh@10 -- # set +x 00:07:21.896 ************************************ 00:07:21.896 START TEST accel_decomp_mthread 00:07:21.896 ************************************ 00:07:21.896 18:53:38 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:21.896 18:53:38 -- accel/accel.sh@16 -- # local accel_opc 00:07:21.896 18:53:38 -- accel/accel.sh@17 -- # local accel_module 00:07:21.896 18:53:38 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:21.896 18:53:38 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:21.896 18:53:38 -- accel/accel.sh@12 -- # build_accel_config 00:07:21.896 18:53:38 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:21.896 18:53:38 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:21.896 18:53:38 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:21.896 18:53:38 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:21.896 18:53:38 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:21.896 18:53:38 -- accel/accel.sh@41 -- # local IFS=, 00:07:21.896 18:53:38 -- accel/accel.sh@42 -- # jq -r . 00:07:21.896 [2024-11-26 18:53:38.501058] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:21.896 [2024-11-26 18:53:38.501105] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2942871 ] 00:07:21.896 EAL: No free 2048 kB hugepages reported on node 1 00:07:21.896 [2024-11-26 18:53:38.553676] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:21.896 [2024-11-26 18:53:38.590427] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:23.274 18:53:39 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:23.274 00:07:23.274 SPDK Configuration: 00:07:23.274 Core mask: 0x1 00:07:23.274 00:07:23.274 Accel Perf Configuration: 00:07:23.274 Workload Type: decompress 00:07:23.274 Transfer size: 4096 bytes 00:07:23.274 Vector count 1 00:07:23.274 Module: software 00:07:23.274 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:23.274 Queue depth: 32 00:07:23.274 Allocate depth: 32 00:07:23.274 # threads/core: 2 00:07:23.274 Run time: 1 seconds 00:07:23.274 Verify: Yes 00:07:23.274 00:07:23.274 Running for 1 seconds... 00:07:23.274 00:07:23.274 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:23.274 ------------------------------------------------------------------------------------ 00:07:23.274 0,1 37888/s 69 MiB/s 0 0 00:07:23.274 0,0 37760/s 69 MiB/s 0 0 00:07:23.274 ==================================================================================== 00:07:23.274 Total 75648/s 295 MiB/s 0 0' 00:07:23.274 18:53:39 -- accel/accel.sh@20 -- # IFS=: 00:07:23.274 18:53:39 -- accel/accel.sh@20 -- # read -r var val 00:07:23.274 18:53:39 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:23.274 18:53:39 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:23.274 18:53:39 -- accel/accel.sh@12 -- # build_accel_config 00:07:23.274 18:53:39 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:23.274 18:53:39 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:23.274 18:53:39 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:23.274 18:53:39 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:23.274 18:53:39 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:23.274 18:53:39 -- accel/accel.sh@41 -- # local IFS=, 00:07:23.274 18:53:39 -- accel/accel.sh@42 -- # jq -r . 00:07:23.274 [2024-11-26 18:53:39.789237] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:23.274 [2024-11-26 18:53:39.789313] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2943103 ] 00:07:23.274 EAL: No free 2048 kB hugepages reported on node 1 00:07:23.274 [2024-11-26 18:53:39.844860] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:23.274 [2024-11-26 18:53:39.881041] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:23.274 18:53:39 -- accel/accel.sh@21 -- # val= 00:07:23.274 18:53:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.274 18:53:39 -- accel/accel.sh@20 -- # IFS=: 00:07:23.274 18:53:39 -- accel/accel.sh@20 -- # read -r var val 00:07:23.274 18:53:39 -- accel/accel.sh@21 -- # val= 00:07:23.274 18:53:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.274 18:53:39 -- accel/accel.sh@20 -- # IFS=: 00:07:23.274 18:53:39 -- accel/accel.sh@20 -- # read -r var val 00:07:23.274 18:53:39 -- accel/accel.sh@21 -- # val= 00:07:23.274 18:53:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.274 18:53:39 -- accel/accel.sh@20 -- # IFS=: 00:07:23.274 18:53:39 -- accel/accel.sh@20 -- # read -r var val 00:07:23.274 18:53:39 -- accel/accel.sh@21 -- # val=0x1 00:07:23.274 18:53:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.274 18:53:39 -- accel/accel.sh@20 -- # IFS=: 00:07:23.274 18:53:39 -- accel/accel.sh@20 -- # read -r var val 00:07:23.274 18:53:39 -- accel/accel.sh@21 -- # val= 00:07:23.274 18:53:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.274 18:53:39 -- accel/accel.sh@20 -- # IFS=: 00:07:23.274 18:53:39 -- accel/accel.sh@20 -- # read -r var val 00:07:23.274 18:53:39 -- accel/accel.sh@21 -- # val= 00:07:23.274 18:53:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.274 18:53:39 -- accel/accel.sh@20 -- # IFS=: 00:07:23.274 18:53:39 -- accel/accel.sh@20 -- # read -r var val 00:07:23.274 18:53:39 -- accel/accel.sh@21 -- # val=decompress 00:07:23.274 18:53:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.274 18:53:39 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:23.274 18:53:39 -- accel/accel.sh@20 -- # IFS=: 00:07:23.274 18:53:39 -- accel/accel.sh@20 -- # read -r var val 00:07:23.274 18:53:39 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:23.274 18:53:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.274 18:53:39 -- accel/accel.sh@20 -- # IFS=: 00:07:23.274 18:53:39 -- accel/accel.sh@20 -- # read -r var val 00:07:23.274 18:53:39 -- accel/accel.sh@21 -- # val= 00:07:23.274 18:53:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.274 18:53:39 -- accel/accel.sh@20 -- # IFS=: 00:07:23.274 18:53:39 -- accel/accel.sh@20 -- # read -r var val 00:07:23.274 18:53:39 -- accel/accel.sh@21 -- # val=software 00:07:23.274 18:53:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.274 18:53:39 -- accel/accel.sh@23 -- # accel_module=software 00:07:23.274 18:53:39 -- accel/accel.sh@20 -- # IFS=: 00:07:23.274 18:53:39 -- accel/accel.sh@20 -- # read -r var val 00:07:23.274 18:53:39 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:23.274 18:53:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.274 18:53:39 -- accel/accel.sh@20 -- # IFS=: 00:07:23.274 18:53:39 -- accel/accel.sh@20 -- # read -r var val 00:07:23.274 18:53:39 -- accel/accel.sh@21 -- # val=32 00:07:23.274 18:53:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.274 18:53:39 -- accel/accel.sh@20 -- # IFS=: 00:07:23.274 18:53:39 -- accel/accel.sh@20 -- # read -r var val 00:07:23.274 18:53:39 -- accel/accel.sh@21 -- # val=32 00:07:23.274 18:53:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.274 18:53:39 -- accel/accel.sh@20 -- # IFS=: 00:07:23.274 18:53:39 -- accel/accel.sh@20 -- # read -r var val 00:07:23.274 18:53:39 -- accel/accel.sh@21 -- # val=2 00:07:23.274 18:53:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.274 18:53:39 -- accel/accel.sh@20 -- # IFS=: 00:07:23.274 18:53:39 -- accel/accel.sh@20 -- # read -r var val 00:07:23.274 18:53:39 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:23.274 18:53:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.274 18:53:39 -- accel/accel.sh@20 -- # IFS=: 00:07:23.274 18:53:39 -- accel/accel.sh@20 -- # read -r var val 00:07:23.274 18:53:39 -- accel/accel.sh@21 -- # val=Yes 00:07:23.274 18:53:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.274 18:53:39 -- accel/accel.sh@20 -- # IFS=: 00:07:23.274 18:53:39 -- accel/accel.sh@20 -- # read -r var val 00:07:23.274 18:53:39 -- accel/accel.sh@21 -- # val= 00:07:23.274 18:53:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.274 18:53:39 -- accel/accel.sh@20 -- # IFS=: 00:07:23.274 18:53:39 -- accel/accel.sh@20 -- # read -r var val 00:07:23.274 18:53:39 -- accel/accel.sh@21 -- # val= 00:07:23.274 18:53:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.274 18:53:39 -- accel/accel.sh@20 -- # IFS=: 00:07:23.274 18:53:39 -- accel/accel.sh@20 -- # read -r var val 00:07:24.211 18:53:41 -- accel/accel.sh@21 -- # val= 00:07:24.211 18:53:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.211 18:53:41 -- accel/accel.sh@20 -- # IFS=: 00:07:24.211 18:53:41 -- accel/accel.sh@20 -- # read -r var val 00:07:24.211 18:53:41 -- accel/accel.sh@21 -- # val= 00:07:24.211 18:53:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.211 18:53:41 -- accel/accel.sh@20 -- # IFS=: 00:07:24.211 18:53:41 -- accel/accel.sh@20 -- # read -r var val 00:07:24.211 18:53:41 -- accel/accel.sh@21 -- # val= 00:07:24.211 18:53:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.211 18:53:41 -- accel/accel.sh@20 -- # IFS=: 00:07:24.211 18:53:41 -- accel/accel.sh@20 -- # read -r var val 00:07:24.211 18:53:41 -- accel/accel.sh@21 -- # val= 00:07:24.211 18:53:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.211 18:53:41 -- accel/accel.sh@20 -- # IFS=: 00:07:24.211 18:53:41 -- accel/accel.sh@20 -- # read -r var val 00:07:24.211 18:53:41 -- accel/accel.sh@21 -- # val= 00:07:24.211 18:53:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.211 18:53:41 -- accel/accel.sh@20 -- # IFS=: 00:07:24.211 18:53:41 -- accel/accel.sh@20 -- # read -r var val 00:07:24.211 18:53:41 -- accel/accel.sh@21 -- # val= 00:07:24.211 18:53:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.211 18:53:41 -- accel/accel.sh@20 -- # IFS=: 00:07:24.211 18:53:41 -- accel/accel.sh@20 -- # read -r var val 00:07:24.211 18:53:41 -- accel/accel.sh@21 -- # val= 00:07:24.211 18:53:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.211 18:53:41 -- accel/accel.sh@20 -- # IFS=: 00:07:24.211 18:53:41 -- accel/accel.sh@20 -- # read -r var val 00:07:24.211 18:53:41 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:24.211 18:53:41 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:24.211 18:53:41 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:24.211 00:07:24.211 real 0m2.572s 00:07:24.211 user 0m2.364s 00:07:24.211 sys 0m0.218s 00:07:24.211 18:53:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:24.211 18:53:41 -- common/autotest_common.sh@10 -- # set +x 00:07:24.211 ************************************ 00:07:24.211 END TEST accel_decomp_mthread 00:07:24.211 ************************************ 00:07:24.211 18:53:41 -- accel/accel.sh@114 -- # run_test accel_deomp_full_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:24.211 18:53:41 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:07:24.211 18:53:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:24.211 18:53:41 -- common/autotest_common.sh@10 -- # set +x 00:07:24.211 ************************************ 00:07:24.211 START TEST accel_deomp_full_mthread 00:07:24.211 ************************************ 00:07:24.211 18:53:41 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:24.211 18:53:41 -- accel/accel.sh@16 -- # local accel_opc 00:07:24.211 18:53:41 -- accel/accel.sh@17 -- # local accel_module 00:07:24.211 18:53:41 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:24.212 18:53:41 -- accel/accel.sh@12 -- # build_accel_config 00:07:24.212 18:53:41 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:24.212 18:53:41 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:24.212 18:53:41 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:24.212 18:53:41 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:24.212 18:53:41 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:24.212 18:53:41 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:24.212 18:53:41 -- accel/accel.sh@41 -- # local IFS=, 00:07:24.212 18:53:41 -- accel/accel.sh@42 -- # jq -r . 00:07:24.212 [2024-11-26 18:53:41.124515] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:24.212 [2024-11-26 18:53:41.124591] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2943352 ] 00:07:24.543 EAL: No free 2048 kB hugepages reported on node 1 00:07:24.543 [2024-11-26 18:53:41.182800] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:24.543 [2024-11-26 18:53:41.220227] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:25.550 18:53:42 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:25.550 00:07:25.550 SPDK Configuration: 00:07:25.550 Core mask: 0x1 00:07:25.550 00:07:25.550 Accel Perf Configuration: 00:07:25.550 Workload Type: decompress 00:07:25.550 Transfer size: 111250 bytes 00:07:25.550 Vector count 1 00:07:25.550 Module: software 00:07:25.550 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:25.550 Queue depth: 32 00:07:25.550 Allocate depth: 32 00:07:25.550 # threads/core: 2 00:07:25.550 Run time: 1 seconds 00:07:25.550 Verify: Yes 00:07:25.550 00:07:25.550 Running for 1 seconds... 00:07:25.550 00:07:25.550 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:25.550 ------------------------------------------------------------------------------------ 00:07:25.550 0,1 2464/s 101 MiB/s 0 0 00:07:25.550 0,0 2464/s 101 MiB/s 0 0 00:07:25.550 ==================================================================================== 00:07:25.550 Total 4928/s 522 MiB/s 0 0' 00:07:25.550 18:53:42 -- accel/accel.sh@20 -- # IFS=: 00:07:25.550 18:53:42 -- accel/accel.sh@20 -- # read -r var val 00:07:25.550 18:53:42 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:25.550 18:53:42 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:25.550 18:53:42 -- accel/accel.sh@12 -- # build_accel_config 00:07:25.550 18:53:42 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:25.550 18:53:42 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:25.550 18:53:42 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:25.550 18:53:42 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:25.550 18:53:42 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:25.550 18:53:42 -- accel/accel.sh@41 -- # local IFS=, 00:07:25.550 18:53:42 -- accel/accel.sh@42 -- # jq -r . 00:07:25.550 [2024-11-26 18:53:42.439095] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:25.550 [2024-11-26 18:53:42.439174] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2943598 ] 00:07:25.550 EAL: No free 2048 kB hugepages reported on node 1 00:07:25.810 [2024-11-26 18:53:42.494156] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:25.810 [2024-11-26 18:53:42.530439] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:25.810 18:53:42 -- accel/accel.sh@21 -- # val= 00:07:25.810 18:53:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.810 18:53:42 -- accel/accel.sh@20 -- # IFS=: 00:07:25.810 18:53:42 -- accel/accel.sh@20 -- # read -r var val 00:07:25.810 18:53:42 -- accel/accel.sh@21 -- # val= 00:07:25.810 18:53:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.810 18:53:42 -- accel/accel.sh@20 -- # IFS=: 00:07:25.810 18:53:42 -- accel/accel.sh@20 -- # read -r var val 00:07:25.810 18:53:42 -- accel/accel.sh@21 -- # val= 00:07:25.810 18:53:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.810 18:53:42 -- accel/accel.sh@20 -- # IFS=: 00:07:25.810 18:53:42 -- accel/accel.sh@20 -- # read -r var val 00:07:25.810 18:53:42 -- accel/accel.sh@21 -- # val=0x1 00:07:25.810 18:53:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.810 18:53:42 -- accel/accel.sh@20 -- # IFS=: 00:07:25.810 18:53:42 -- accel/accel.sh@20 -- # read -r var val 00:07:25.810 18:53:42 -- accel/accel.sh@21 -- # val= 00:07:25.810 18:53:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.810 18:53:42 -- accel/accel.sh@20 -- # IFS=: 00:07:25.810 18:53:42 -- accel/accel.sh@20 -- # read -r var val 00:07:25.810 18:53:42 -- accel/accel.sh@21 -- # val= 00:07:25.810 18:53:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.810 18:53:42 -- accel/accel.sh@20 -- # IFS=: 00:07:25.810 18:53:42 -- accel/accel.sh@20 -- # read -r var val 00:07:25.810 18:53:42 -- accel/accel.sh@21 -- # val=decompress 00:07:25.810 18:53:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.810 18:53:42 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:25.810 18:53:42 -- accel/accel.sh@20 -- # IFS=: 00:07:25.810 18:53:42 -- accel/accel.sh@20 -- # read -r var val 00:07:25.810 18:53:42 -- accel/accel.sh@21 -- # val='111250 bytes' 00:07:25.810 18:53:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.810 18:53:42 -- accel/accel.sh@20 -- # IFS=: 00:07:25.810 18:53:42 -- accel/accel.sh@20 -- # read -r var val 00:07:25.810 18:53:42 -- accel/accel.sh@21 -- # val= 00:07:25.810 18:53:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.810 18:53:42 -- accel/accel.sh@20 -- # IFS=: 00:07:25.810 18:53:42 -- accel/accel.sh@20 -- # read -r var val 00:07:25.810 18:53:42 -- accel/accel.sh@21 -- # val=software 00:07:25.810 18:53:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.810 18:53:42 -- accel/accel.sh@23 -- # accel_module=software 00:07:25.810 18:53:42 -- accel/accel.sh@20 -- # IFS=: 00:07:25.810 18:53:42 -- accel/accel.sh@20 -- # read -r var val 00:07:25.810 18:53:42 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:25.810 18:53:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.810 18:53:42 -- accel/accel.sh@20 -- # IFS=: 00:07:25.810 18:53:42 -- accel/accel.sh@20 -- # read -r var val 00:07:25.810 18:53:42 -- accel/accel.sh@21 -- # val=32 00:07:25.810 18:53:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.810 18:53:42 -- accel/accel.sh@20 -- # IFS=: 00:07:25.810 18:53:42 -- accel/accel.sh@20 -- # read -r var val 00:07:25.810 18:53:42 -- accel/accel.sh@21 -- # val=32 00:07:25.810 18:53:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.810 18:53:42 -- accel/accel.sh@20 -- # IFS=: 00:07:25.810 18:53:42 -- accel/accel.sh@20 -- # read -r var val 00:07:25.810 18:53:42 -- accel/accel.sh@21 -- # val=2 00:07:25.810 18:53:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.810 18:53:42 -- accel/accel.sh@20 -- # IFS=: 00:07:25.810 18:53:42 -- accel/accel.sh@20 -- # read -r var val 00:07:25.810 18:53:42 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:25.810 18:53:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.810 18:53:42 -- accel/accel.sh@20 -- # IFS=: 00:07:25.810 18:53:42 -- accel/accel.sh@20 -- # read -r var val 00:07:25.810 18:53:42 -- accel/accel.sh@21 -- # val=Yes 00:07:25.810 18:53:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.810 18:53:42 -- accel/accel.sh@20 -- # IFS=: 00:07:25.810 18:53:42 -- accel/accel.sh@20 -- # read -r var val 00:07:25.810 18:53:42 -- accel/accel.sh@21 -- # val= 00:07:25.810 18:53:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.810 18:53:42 -- accel/accel.sh@20 -- # IFS=: 00:07:25.810 18:53:42 -- accel/accel.sh@20 -- # read -r var val 00:07:25.810 18:53:42 -- accel/accel.sh@21 -- # val= 00:07:25.810 18:53:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.810 18:53:42 -- accel/accel.sh@20 -- # IFS=: 00:07:25.810 18:53:42 -- accel/accel.sh@20 -- # read -r var val 00:07:27.185 18:53:43 -- accel/accel.sh@21 -- # val= 00:07:27.185 18:53:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.185 18:53:43 -- accel/accel.sh@20 -- # IFS=: 00:07:27.185 18:53:43 -- accel/accel.sh@20 -- # read -r var val 00:07:27.185 18:53:43 -- accel/accel.sh@21 -- # val= 00:07:27.185 18:53:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.185 18:53:43 -- accel/accel.sh@20 -- # IFS=: 00:07:27.185 18:53:43 -- accel/accel.sh@20 -- # read -r var val 00:07:27.185 18:53:43 -- accel/accel.sh@21 -- # val= 00:07:27.185 18:53:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.185 18:53:43 -- accel/accel.sh@20 -- # IFS=: 00:07:27.185 18:53:43 -- accel/accel.sh@20 -- # read -r var val 00:07:27.185 18:53:43 -- accel/accel.sh@21 -- # val= 00:07:27.185 18:53:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.185 18:53:43 -- accel/accel.sh@20 -- # IFS=: 00:07:27.185 18:53:43 -- accel/accel.sh@20 -- # read -r var val 00:07:27.185 18:53:43 -- accel/accel.sh@21 -- # val= 00:07:27.185 18:53:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.185 18:53:43 -- accel/accel.sh@20 -- # IFS=: 00:07:27.185 18:53:43 -- accel/accel.sh@20 -- # read -r var val 00:07:27.185 18:53:43 -- accel/accel.sh@21 -- # val= 00:07:27.185 18:53:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.185 18:53:43 -- accel/accel.sh@20 -- # IFS=: 00:07:27.185 18:53:43 -- accel/accel.sh@20 -- # read -r var val 00:07:27.185 18:53:43 -- accel/accel.sh@21 -- # val= 00:07:27.185 18:53:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.185 18:53:43 -- accel/accel.sh@20 -- # IFS=: 00:07:27.185 18:53:43 -- accel/accel.sh@20 -- # read -r var val 00:07:27.185 18:53:43 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:27.185 18:53:43 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:27.185 18:53:43 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:27.185 00:07:27.185 real 0m2.631s 00:07:27.185 user 0m2.413s 00:07:27.185 sys 0m0.226s 00:07:27.185 18:53:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:27.185 18:53:43 -- common/autotest_common.sh@10 -- # set +x 00:07:27.185 ************************************ 00:07:27.185 END TEST accel_deomp_full_mthread 00:07:27.185 ************************************ 00:07:27.185 18:53:43 -- accel/accel.sh@116 -- # [[ n == y ]] 00:07:27.185 18:53:43 -- accel/accel.sh@129 -- # run_test accel_dif_functional_tests /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:07:27.185 18:53:43 -- accel/accel.sh@129 -- # build_accel_config 00:07:27.185 18:53:43 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:27.185 18:53:43 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:27.185 18:53:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:27.185 18:53:43 -- common/autotest_common.sh@10 -- # set +x 00:07:27.185 18:53:43 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:27.185 18:53:43 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:27.185 18:53:43 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:27.185 18:53:43 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:27.185 18:53:43 -- accel/accel.sh@41 -- # local IFS=, 00:07:27.185 18:53:43 -- accel/accel.sh@42 -- # jq -r . 00:07:27.185 ************************************ 00:07:27.185 START TEST accel_dif_functional_tests 00:07:27.185 ************************************ 00:07:27.185 18:53:43 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:07:27.185 [2024-11-26 18:53:43.796608] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:27.185 [2024-11-26 18:53:43.796655] [ DPDK EAL parameters: DIF --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2943849 ] 00:07:27.185 EAL: No free 2048 kB hugepages reported on node 1 00:07:27.185 [2024-11-26 18:53:43.849792] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:07:27.185 [2024-11-26 18:53:43.888204] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:27.185 [2024-11-26 18:53:43.888301] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:27.185 [2024-11-26 18:53:43.888302] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:27.185 00:07:27.185 00:07:27.185 CUnit - A unit testing framework for C - Version 2.1-3 00:07:27.185 http://cunit.sourceforge.net/ 00:07:27.185 00:07:27.185 00:07:27.185 Suite: accel_dif 00:07:27.185 Test: verify: DIF generated, GUARD check ...passed 00:07:27.185 Test: verify: DIF generated, APPTAG check ...passed 00:07:27.185 Test: verify: DIF generated, REFTAG check ...passed 00:07:27.185 Test: verify: DIF not generated, GUARD check ...[2024-11-26 18:53:43.951632] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:07:27.185 [2024-11-26 18:53:43.951681] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:07:27.185 passed 00:07:27.185 Test: verify: DIF not generated, APPTAG check ...[2024-11-26 18:53:43.951728] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:07:27.185 [2024-11-26 18:53:43.951743] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:07:27.185 passed 00:07:27.185 Test: verify: DIF not generated, REFTAG check ...[2024-11-26 18:53:43.951763] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:07:27.185 [2024-11-26 18:53:43.951778] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:07:27.185 passed 00:07:27.185 Test: verify: APPTAG correct, APPTAG check ...passed 00:07:27.185 Test: verify: APPTAG incorrect, APPTAG check ...[2024-11-26 18:53:43.951815] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=30, Expected=28, Actual=14 00:07:27.185 passed 00:07:27.185 Test: verify: APPTAG incorrect, no APPTAG check ...passed 00:07:27.185 Test: verify: REFTAG incorrect, REFTAG ignore ...passed 00:07:27.185 Test: verify: REFTAG_INIT correct, REFTAG check ...passed 00:07:27.185 Test: verify: REFTAG_INIT incorrect, REFTAG check ...[2024-11-26 18:53:43.951911] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=10 00:07:27.185 passed 00:07:27.185 Test: generate copy: DIF generated, GUARD check ...passed 00:07:27.186 Test: generate copy: DIF generated, APTTAG check ...passed 00:07:27.186 Test: generate copy: DIF generated, REFTAG check ...passed 00:07:27.186 Test: generate copy: DIF generated, no GUARD check flag set ...passed 00:07:27.186 Test: generate copy: DIF generated, no APPTAG check flag set ...passed 00:07:27.186 Test: generate copy: DIF generated, no REFTAG check flag set ...passed 00:07:27.186 Test: generate copy: iovecs-len validate ...[2024-11-26 18:53:43.952090] dif.c:1167:spdk_dif_generate_copy: *ERROR*: Size of bounce_iovs arrays are not valid or misaligned with block_size. 00:07:27.186 passed 00:07:27.186 Test: generate copy: buffer alignment validate ...passed 00:07:27.186 00:07:27.186 Run Summary: Type Total Ran Passed Failed Inactive 00:07:27.186 suites 1 1 n/a 0 0 00:07:27.186 tests 20 20 20 0 0 00:07:27.186 asserts 204 204 204 0 n/a 00:07:27.186 00:07:27.186 Elapsed time = 0.002 seconds 00:07:27.443 00:07:27.443 real 0m0.344s 00:07:27.443 user 0m0.542s 00:07:27.443 sys 0m0.142s 00:07:27.443 18:53:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:27.443 18:53:44 -- common/autotest_common.sh@10 -- # set +x 00:07:27.443 ************************************ 00:07:27.443 END TEST accel_dif_functional_tests 00:07:27.443 ************************************ 00:07:27.443 00:07:27.443 real 0m54.865s 00:07:27.443 user 1m3.472s 00:07:27.443 sys 0m6.034s 00:07:27.443 18:53:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:27.443 18:53:44 -- common/autotest_common.sh@10 -- # set +x 00:07:27.443 ************************************ 00:07:27.443 END TEST accel 00:07:27.443 ************************************ 00:07:27.443 18:53:44 -- spdk/autotest.sh@177 -- # run_test accel_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:07:27.443 18:53:44 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:27.443 18:53:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:27.443 18:53:44 -- common/autotest_common.sh@10 -- # set +x 00:07:27.443 ************************************ 00:07:27.443 START TEST accel_rpc 00:07:27.443 ************************************ 00:07:27.443 18:53:44 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:07:27.443 * Looking for test storage... 00:07:27.443 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:07:27.443 18:53:44 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:27.443 18:53:44 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:27.443 18:53:44 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:27.443 18:53:44 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:27.443 18:53:44 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:27.443 18:53:44 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:27.443 18:53:44 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:27.443 18:53:44 -- scripts/common.sh@335 -- # IFS=.-: 00:07:27.443 18:53:44 -- scripts/common.sh@335 -- # read -ra ver1 00:07:27.443 18:53:44 -- scripts/common.sh@336 -- # IFS=.-: 00:07:27.443 18:53:44 -- scripts/common.sh@336 -- # read -ra ver2 00:07:27.443 18:53:44 -- scripts/common.sh@337 -- # local 'op=<' 00:07:27.443 18:53:44 -- scripts/common.sh@339 -- # ver1_l=2 00:07:27.443 18:53:44 -- scripts/common.sh@340 -- # ver2_l=1 00:07:27.443 18:53:44 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:27.443 18:53:44 -- scripts/common.sh@343 -- # case "$op" in 00:07:27.443 18:53:44 -- scripts/common.sh@344 -- # : 1 00:07:27.443 18:53:44 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:27.443 18:53:44 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:27.443 18:53:44 -- scripts/common.sh@364 -- # decimal 1 00:07:27.443 18:53:44 -- scripts/common.sh@352 -- # local d=1 00:07:27.443 18:53:44 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:27.443 18:53:44 -- scripts/common.sh@354 -- # echo 1 00:07:27.443 18:53:44 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:27.443 18:53:44 -- scripts/common.sh@365 -- # decimal 2 00:07:27.443 18:53:44 -- scripts/common.sh@352 -- # local d=2 00:07:27.443 18:53:44 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:27.443 18:53:44 -- scripts/common.sh@354 -- # echo 2 00:07:27.443 18:53:44 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:27.443 18:53:44 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:27.443 18:53:44 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:27.443 18:53:44 -- scripts/common.sh@367 -- # return 0 00:07:27.443 18:53:44 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:27.443 18:53:44 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:27.443 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:27.443 --rc genhtml_branch_coverage=1 00:07:27.443 --rc genhtml_function_coverage=1 00:07:27.443 --rc genhtml_legend=1 00:07:27.443 --rc geninfo_all_blocks=1 00:07:27.443 --rc geninfo_unexecuted_blocks=1 00:07:27.443 00:07:27.443 ' 00:07:27.443 18:53:44 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:27.443 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:27.443 --rc genhtml_branch_coverage=1 00:07:27.443 --rc genhtml_function_coverage=1 00:07:27.443 --rc genhtml_legend=1 00:07:27.443 --rc geninfo_all_blocks=1 00:07:27.443 --rc geninfo_unexecuted_blocks=1 00:07:27.443 00:07:27.443 ' 00:07:27.443 18:53:44 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:27.443 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:27.443 --rc genhtml_branch_coverage=1 00:07:27.443 --rc genhtml_function_coverage=1 00:07:27.443 --rc genhtml_legend=1 00:07:27.443 --rc geninfo_all_blocks=1 00:07:27.443 --rc geninfo_unexecuted_blocks=1 00:07:27.443 00:07:27.443 ' 00:07:27.443 18:53:44 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:27.443 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:27.443 --rc genhtml_branch_coverage=1 00:07:27.443 --rc genhtml_function_coverage=1 00:07:27.443 --rc genhtml_legend=1 00:07:27.443 --rc geninfo_all_blocks=1 00:07:27.443 --rc geninfo_unexecuted_blocks=1 00:07:27.443 00:07:27.443 ' 00:07:27.443 18:53:44 -- accel/accel_rpc.sh@11 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:07:27.443 18:53:44 -- accel/accel_rpc.sh@14 -- # spdk_tgt_pid=2943926 00:07:27.443 18:53:44 -- accel/accel_rpc.sh@15 -- # waitforlisten 2943926 00:07:27.443 18:53:44 -- common/autotest_common.sh@829 -- # '[' -z 2943926 ']' 00:07:27.443 18:53:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:27.443 18:53:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:27.443 18:53:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:27.443 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:27.443 18:53:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:27.443 18:53:44 -- common/autotest_common.sh@10 -- # set +x 00:07:27.443 18:53:44 -- accel/accel_rpc.sh@13 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --wait-for-rpc 00:07:27.700 [2024-11-26 18:53:44.393083] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:27.700 [2024-11-26 18:53:44.393134] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2943926 ] 00:07:27.700 EAL: No free 2048 kB hugepages reported on node 1 00:07:27.700 [2024-11-26 18:53:44.447223] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:27.700 [2024-11-26 18:53:44.485831] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:27.700 [2024-11-26 18:53:44.485970] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:27.700 18:53:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:27.700 18:53:44 -- common/autotest_common.sh@862 -- # return 0 00:07:27.700 18:53:44 -- accel/accel_rpc.sh@45 -- # [[ y == y ]] 00:07:27.700 18:53:44 -- accel/accel_rpc.sh@45 -- # [[ 0 -gt 0 ]] 00:07:27.700 18:53:44 -- accel/accel_rpc.sh@49 -- # [[ y == y ]] 00:07:27.700 18:53:44 -- accel/accel_rpc.sh@49 -- # [[ 0 -gt 0 ]] 00:07:27.700 18:53:44 -- accel/accel_rpc.sh@53 -- # run_test accel_assign_opcode accel_assign_opcode_test_suite 00:07:27.700 18:53:44 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:27.700 18:53:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:27.700 18:53:44 -- common/autotest_common.sh@10 -- # set +x 00:07:27.700 ************************************ 00:07:27.700 START TEST accel_assign_opcode 00:07:27.700 ************************************ 00:07:27.700 18:53:44 -- common/autotest_common.sh@1114 -- # accel_assign_opcode_test_suite 00:07:27.700 18:53:44 -- accel/accel_rpc.sh@38 -- # rpc_cmd accel_assign_opc -o copy -m incorrect 00:07:27.700 18:53:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:27.700 18:53:44 -- common/autotest_common.sh@10 -- # set +x 00:07:27.700 [2024-11-26 18:53:44.534354] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module incorrect 00:07:27.700 18:53:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:27.700 18:53:44 -- accel/accel_rpc.sh@40 -- # rpc_cmd accel_assign_opc -o copy -m software 00:07:27.700 18:53:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:27.700 18:53:44 -- common/autotest_common.sh@10 -- # set +x 00:07:27.700 [2024-11-26 18:53:44.542368] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module software 00:07:27.700 18:53:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:27.700 18:53:44 -- accel/accel_rpc.sh@41 -- # rpc_cmd framework_start_init 00:07:27.700 18:53:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:27.700 18:53:44 -- common/autotest_common.sh@10 -- # set +x 00:07:27.957 18:53:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:27.957 18:53:44 -- accel/accel_rpc.sh@42 -- # grep software 00:07:27.957 18:53:44 -- accel/accel_rpc.sh@42 -- # rpc_cmd accel_get_opc_assignments 00:07:27.957 18:53:44 -- accel/accel_rpc.sh@42 -- # jq -r .copy 00:07:27.957 18:53:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:27.957 18:53:44 -- common/autotest_common.sh@10 -- # set +x 00:07:27.957 18:53:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:27.957 software 00:07:27.957 00:07:27.957 real 0m0.225s 00:07:27.957 user 0m0.041s 00:07:27.957 sys 0m0.008s 00:07:27.957 18:53:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:27.957 18:53:44 -- common/autotest_common.sh@10 -- # set +x 00:07:27.957 ************************************ 00:07:27.957 END TEST accel_assign_opcode 00:07:27.957 ************************************ 00:07:27.957 18:53:44 -- accel/accel_rpc.sh@55 -- # killprocess 2943926 00:07:27.957 18:53:44 -- common/autotest_common.sh@936 -- # '[' -z 2943926 ']' 00:07:27.957 18:53:44 -- common/autotest_common.sh@940 -- # kill -0 2943926 00:07:27.957 18:53:44 -- common/autotest_common.sh@941 -- # uname 00:07:27.957 18:53:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:27.957 18:53:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2943926 00:07:27.957 18:53:44 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:27.957 18:53:44 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:27.957 18:53:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2943926' 00:07:27.957 killing process with pid 2943926 00:07:27.957 18:53:44 -- common/autotest_common.sh@955 -- # kill 2943926 00:07:27.957 18:53:44 -- common/autotest_common.sh@960 -- # wait 2943926 00:07:28.214 00:07:28.214 real 0m0.950s 00:07:28.214 user 0m0.867s 00:07:28.214 sys 0m0.396s 00:07:28.214 18:53:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:28.214 18:53:45 -- common/autotest_common.sh@10 -- # set +x 00:07:28.214 ************************************ 00:07:28.214 END TEST accel_rpc 00:07:28.214 ************************************ 00:07:28.471 18:53:45 -- spdk/autotest.sh@178 -- # run_test app_cmdline /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:07:28.471 18:53:45 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:28.471 18:53:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:28.471 18:53:45 -- common/autotest_common.sh@10 -- # set +x 00:07:28.471 ************************************ 00:07:28.471 START TEST app_cmdline 00:07:28.471 ************************************ 00:07:28.471 18:53:45 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:07:28.471 * Looking for test storage... 00:07:28.471 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:07:28.471 18:53:45 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:28.471 18:53:45 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:28.471 18:53:45 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:28.471 18:53:45 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:28.471 18:53:45 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:28.471 18:53:45 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:28.471 18:53:45 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:28.471 18:53:45 -- scripts/common.sh@335 -- # IFS=.-: 00:07:28.471 18:53:45 -- scripts/common.sh@335 -- # read -ra ver1 00:07:28.471 18:53:45 -- scripts/common.sh@336 -- # IFS=.-: 00:07:28.471 18:53:45 -- scripts/common.sh@336 -- # read -ra ver2 00:07:28.471 18:53:45 -- scripts/common.sh@337 -- # local 'op=<' 00:07:28.471 18:53:45 -- scripts/common.sh@339 -- # ver1_l=2 00:07:28.471 18:53:45 -- scripts/common.sh@340 -- # ver2_l=1 00:07:28.471 18:53:45 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:28.471 18:53:45 -- scripts/common.sh@343 -- # case "$op" in 00:07:28.471 18:53:45 -- scripts/common.sh@344 -- # : 1 00:07:28.471 18:53:45 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:28.471 18:53:45 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:28.471 18:53:45 -- scripts/common.sh@364 -- # decimal 1 00:07:28.471 18:53:45 -- scripts/common.sh@352 -- # local d=1 00:07:28.471 18:53:45 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:28.471 18:53:45 -- scripts/common.sh@354 -- # echo 1 00:07:28.471 18:53:45 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:28.471 18:53:45 -- scripts/common.sh@365 -- # decimal 2 00:07:28.471 18:53:45 -- scripts/common.sh@352 -- # local d=2 00:07:28.471 18:53:45 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:28.471 18:53:45 -- scripts/common.sh@354 -- # echo 2 00:07:28.471 18:53:45 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:28.471 18:53:45 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:28.471 18:53:45 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:28.471 18:53:45 -- scripts/common.sh@367 -- # return 0 00:07:28.471 18:53:45 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:28.471 18:53:45 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:28.471 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:28.471 --rc genhtml_branch_coverage=1 00:07:28.471 --rc genhtml_function_coverage=1 00:07:28.471 --rc genhtml_legend=1 00:07:28.471 --rc geninfo_all_blocks=1 00:07:28.471 --rc geninfo_unexecuted_blocks=1 00:07:28.471 00:07:28.471 ' 00:07:28.471 18:53:45 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:28.471 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:28.471 --rc genhtml_branch_coverage=1 00:07:28.471 --rc genhtml_function_coverage=1 00:07:28.471 --rc genhtml_legend=1 00:07:28.471 --rc geninfo_all_blocks=1 00:07:28.471 --rc geninfo_unexecuted_blocks=1 00:07:28.471 00:07:28.471 ' 00:07:28.471 18:53:45 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:28.471 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:28.471 --rc genhtml_branch_coverage=1 00:07:28.471 --rc genhtml_function_coverage=1 00:07:28.471 --rc genhtml_legend=1 00:07:28.471 --rc geninfo_all_blocks=1 00:07:28.471 --rc geninfo_unexecuted_blocks=1 00:07:28.471 00:07:28.471 ' 00:07:28.471 18:53:45 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:28.471 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:28.471 --rc genhtml_branch_coverage=1 00:07:28.471 --rc genhtml_function_coverage=1 00:07:28.471 --rc genhtml_legend=1 00:07:28.471 --rc geninfo_all_blocks=1 00:07:28.471 --rc geninfo_unexecuted_blocks=1 00:07:28.471 00:07:28.471 ' 00:07:28.471 18:53:45 -- app/cmdline.sh@14 -- # trap 'killprocess $spdk_tgt_pid' EXIT 00:07:28.471 18:53:45 -- app/cmdline.sh@17 -- # spdk_tgt_pid=2944220 00:07:28.471 18:53:45 -- app/cmdline.sh@18 -- # waitforlisten 2944220 00:07:28.471 18:53:45 -- common/autotest_common.sh@829 -- # '[' -z 2944220 ']' 00:07:28.471 18:53:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:28.471 18:53:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:28.471 18:53:45 -- app/cmdline.sh@16 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --rpcs-allowed spdk_get_version,rpc_get_methods 00:07:28.471 18:53:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:28.471 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:28.471 18:53:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:28.471 18:53:45 -- common/autotest_common.sh@10 -- # set +x 00:07:28.471 [2024-11-26 18:53:45.384395] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:28.471 [2024-11-26 18:53:45.384444] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2944220 ] 00:07:28.728 EAL: No free 2048 kB hugepages reported on node 1 00:07:28.728 [2024-11-26 18:53:45.438355] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:28.728 [2024-11-26 18:53:45.477122] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:28.728 [2024-11-26 18:53:45.477244] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:29.292 18:53:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:29.292 18:53:46 -- common/autotest_common.sh@862 -- # return 0 00:07:29.292 18:53:46 -- app/cmdline.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py spdk_get_version 00:07:29.548 { 00:07:29.548 "version": "SPDK v24.01.1-pre git sha1 c13c99a5e", 00:07:29.549 "fields": { 00:07:29.549 "major": 24, 00:07:29.549 "minor": 1, 00:07:29.549 "patch": 1, 00:07:29.549 "suffix": "-pre", 00:07:29.549 "commit": "c13c99a5e" 00:07:29.549 } 00:07:29.549 } 00:07:29.549 18:53:46 -- app/cmdline.sh@22 -- # expected_methods=() 00:07:29.549 18:53:46 -- app/cmdline.sh@23 -- # expected_methods+=("rpc_get_methods") 00:07:29.549 18:53:46 -- app/cmdline.sh@24 -- # expected_methods+=("spdk_get_version") 00:07:29.549 18:53:46 -- app/cmdline.sh@26 -- # methods=($(rpc_cmd rpc_get_methods | jq -r ".[]" | sort)) 00:07:29.549 18:53:46 -- app/cmdline.sh@26 -- # rpc_cmd rpc_get_methods 00:07:29.549 18:53:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:29.549 18:53:46 -- common/autotest_common.sh@10 -- # set +x 00:07:29.549 18:53:46 -- app/cmdline.sh@26 -- # jq -r '.[]' 00:07:29.549 18:53:46 -- app/cmdline.sh@26 -- # sort 00:07:29.549 18:53:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:29.549 18:53:46 -- app/cmdline.sh@27 -- # (( 2 == 2 )) 00:07:29.549 18:53:46 -- app/cmdline.sh@28 -- # [[ rpc_get_methods spdk_get_version == \r\p\c\_\g\e\t\_\m\e\t\h\o\d\s\ \s\p\d\k\_\g\e\t\_\v\e\r\s\i\o\n ]] 00:07:29.549 18:53:46 -- app/cmdline.sh@30 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:07:29.549 18:53:46 -- common/autotest_common.sh@650 -- # local es=0 00:07:29.549 18:53:46 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:07:29.549 18:53:46 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:29.549 18:53:46 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:29.549 18:53:46 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:29.549 18:53:46 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:29.549 18:53:46 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:29.549 18:53:46 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:29.549 18:53:46 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:29.549 18:53:46 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:07:29.549 18:53:46 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:07:29.806 request: 00:07:29.806 { 00:07:29.806 "method": "env_dpdk_get_mem_stats", 00:07:29.806 "req_id": 1 00:07:29.806 } 00:07:29.806 Got JSON-RPC error response 00:07:29.806 response: 00:07:29.806 { 00:07:29.806 "code": -32601, 00:07:29.806 "message": "Method not found" 00:07:29.806 } 00:07:29.806 18:53:46 -- common/autotest_common.sh@653 -- # es=1 00:07:29.806 18:53:46 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:07:29.806 18:53:46 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:07:29.806 18:53:46 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:07:29.806 18:53:46 -- app/cmdline.sh@1 -- # killprocess 2944220 00:07:29.806 18:53:46 -- common/autotest_common.sh@936 -- # '[' -z 2944220 ']' 00:07:29.806 18:53:46 -- common/autotest_common.sh@940 -- # kill -0 2944220 00:07:29.806 18:53:46 -- common/autotest_common.sh@941 -- # uname 00:07:29.806 18:53:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:29.806 18:53:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2944220 00:07:29.806 18:53:46 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:29.806 18:53:46 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:29.806 18:53:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2944220' 00:07:29.806 killing process with pid 2944220 00:07:29.806 18:53:46 -- common/autotest_common.sh@955 -- # kill 2944220 00:07:29.806 18:53:46 -- common/autotest_common.sh@960 -- # wait 2944220 00:07:30.064 00:07:30.064 real 0m1.743s 00:07:30.064 user 0m2.081s 00:07:30.064 sys 0m0.420s 00:07:30.064 18:53:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:30.064 18:53:46 -- common/autotest_common.sh@10 -- # set +x 00:07:30.064 ************************************ 00:07:30.064 END TEST app_cmdline 00:07:30.064 ************************************ 00:07:30.064 18:53:46 -- spdk/autotest.sh@179 -- # run_test version /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:07:30.064 18:53:46 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:30.064 18:53:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:30.064 18:53:46 -- common/autotest_common.sh@10 -- # set +x 00:07:30.064 ************************************ 00:07:30.064 START TEST version 00:07:30.064 ************************************ 00:07:30.064 18:53:46 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:07:30.322 * Looking for test storage... 00:07:30.322 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:07:30.322 18:53:47 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:30.322 18:53:47 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:30.322 18:53:47 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:30.322 18:53:47 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:30.322 18:53:47 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:30.322 18:53:47 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:30.322 18:53:47 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:30.322 18:53:47 -- scripts/common.sh@335 -- # IFS=.-: 00:07:30.322 18:53:47 -- scripts/common.sh@335 -- # read -ra ver1 00:07:30.322 18:53:47 -- scripts/common.sh@336 -- # IFS=.-: 00:07:30.322 18:53:47 -- scripts/common.sh@336 -- # read -ra ver2 00:07:30.322 18:53:47 -- scripts/common.sh@337 -- # local 'op=<' 00:07:30.322 18:53:47 -- scripts/common.sh@339 -- # ver1_l=2 00:07:30.322 18:53:47 -- scripts/common.sh@340 -- # ver2_l=1 00:07:30.322 18:53:47 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:30.322 18:53:47 -- scripts/common.sh@343 -- # case "$op" in 00:07:30.322 18:53:47 -- scripts/common.sh@344 -- # : 1 00:07:30.322 18:53:47 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:30.322 18:53:47 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:30.322 18:53:47 -- scripts/common.sh@364 -- # decimal 1 00:07:30.322 18:53:47 -- scripts/common.sh@352 -- # local d=1 00:07:30.322 18:53:47 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:30.322 18:53:47 -- scripts/common.sh@354 -- # echo 1 00:07:30.322 18:53:47 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:30.322 18:53:47 -- scripts/common.sh@365 -- # decimal 2 00:07:30.322 18:53:47 -- scripts/common.sh@352 -- # local d=2 00:07:30.322 18:53:47 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:30.322 18:53:47 -- scripts/common.sh@354 -- # echo 2 00:07:30.322 18:53:47 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:30.322 18:53:47 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:30.322 18:53:47 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:30.322 18:53:47 -- scripts/common.sh@367 -- # return 0 00:07:30.322 18:53:47 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:30.322 18:53:47 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:30.322 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:30.322 --rc genhtml_branch_coverage=1 00:07:30.322 --rc genhtml_function_coverage=1 00:07:30.322 --rc genhtml_legend=1 00:07:30.322 --rc geninfo_all_blocks=1 00:07:30.322 --rc geninfo_unexecuted_blocks=1 00:07:30.322 00:07:30.322 ' 00:07:30.322 18:53:47 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:30.322 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:30.322 --rc genhtml_branch_coverage=1 00:07:30.322 --rc genhtml_function_coverage=1 00:07:30.322 --rc genhtml_legend=1 00:07:30.322 --rc geninfo_all_blocks=1 00:07:30.322 --rc geninfo_unexecuted_blocks=1 00:07:30.322 00:07:30.322 ' 00:07:30.322 18:53:47 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:30.322 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:30.322 --rc genhtml_branch_coverage=1 00:07:30.322 --rc genhtml_function_coverage=1 00:07:30.322 --rc genhtml_legend=1 00:07:30.322 --rc geninfo_all_blocks=1 00:07:30.322 --rc geninfo_unexecuted_blocks=1 00:07:30.322 00:07:30.322 ' 00:07:30.322 18:53:47 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:30.322 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:30.322 --rc genhtml_branch_coverage=1 00:07:30.322 --rc genhtml_function_coverage=1 00:07:30.322 --rc genhtml_legend=1 00:07:30.322 --rc geninfo_all_blocks=1 00:07:30.322 --rc geninfo_unexecuted_blocks=1 00:07:30.322 00:07:30.322 ' 00:07:30.322 18:53:47 -- app/version.sh@17 -- # get_header_version major 00:07:30.322 18:53:47 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MAJOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:07:30.322 18:53:47 -- app/version.sh@14 -- # cut -f2 00:07:30.322 18:53:47 -- app/version.sh@14 -- # tr -d '"' 00:07:30.322 18:53:47 -- app/version.sh@17 -- # major=24 00:07:30.322 18:53:47 -- app/version.sh@18 -- # get_header_version minor 00:07:30.322 18:53:47 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MINOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:07:30.322 18:53:47 -- app/version.sh@14 -- # cut -f2 00:07:30.322 18:53:47 -- app/version.sh@14 -- # tr -d '"' 00:07:30.322 18:53:47 -- app/version.sh@18 -- # minor=1 00:07:30.322 18:53:47 -- app/version.sh@19 -- # get_header_version patch 00:07:30.322 18:53:47 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_PATCH[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:07:30.322 18:53:47 -- app/version.sh@14 -- # cut -f2 00:07:30.322 18:53:47 -- app/version.sh@14 -- # tr -d '"' 00:07:30.322 18:53:47 -- app/version.sh@19 -- # patch=1 00:07:30.322 18:53:47 -- app/version.sh@20 -- # get_header_version suffix 00:07:30.322 18:53:47 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_SUFFIX[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:07:30.322 18:53:47 -- app/version.sh@14 -- # cut -f2 00:07:30.322 18:53:47 -- app/version.sh@14 -- # tr -d '"' 00:07:30.322 18:53:47 -- app/version.sh@20 -- # suffix=-pre 00:07:30.322 18:53:47 -- app/version.sh@22 -- # version=24.1 00:07:30.322 18:53:47 -- app/version.sh@25 -- # (( patch != 0 )) 00:07:30.322 18:53:47 -- app/version.sh@25 -- # version=24.1.1 00:07:30.322 18:53:47 -- app/version.sh@28 -- # version=24.1.1rc0 00:07:30.322 18:53:47 -- app/version.sh@30 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:07:30.322 18:53:47 -- app/version.sh@30 -- # python3 -c 'import spdk; print(spdk.__version__)' 00:07:30.322 18:53:47 -- app/version.sh@30 -- # py_version=24.1.1rc0 00:07:30.322 18:53:47 -- app/version.sh@31 -- # [[ 24.1.1rc0 == \2\4\.\1\.\1\r\c\0 ]] 00:07:30.322 00:07:30.322 real 0m0.237s 00:07:30.322 user 0m0.137s 00:07:30.322 sys 0m0.136s 00:07:30.322 18:53:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:30.322 18:53:47 -- common/autotest_common.sh@10 -- # set +x 00:07:30.322 ************************************ 00:07:30.322 END TEST version 00:07:30.322 ************************************ 00:07:30.322 18:53:47 -- spdk/autotest.sh@181 -- # '[' 0 -eq 1 ']' 00:07:30.322 18:53:47 -- spdk/autotest.sh@191 -- # uname -s 00:07:30.322 18:53:47 -- spdk/autotest.sh@191 -- # [[ Linux == Linux ]] 00:07:30.322 18:53:47 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:07:30.322 18:53:47 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:07:30.322 18:53:47 -- spdk/autotest.sh@204 -- # '[' 0 -eq 1 ']' 00:07:30.322 18:53:47 -- spdk/autotest.sh@251 -- # '[' 0 -eq 1 ']' 00:07:30.322 18:53:47 -- spdk/autotest.sh@255 -- # timing_exit lib 00:07:30.322 18:53:47 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:30.322 18:53:47 -- common/autotest_common.sh@10 -- # set +x 00:07:30.580 18:53:47 -- spdk/autotest.sh@257 -- # '[' 0 -eq 1 ']' 00:07:30.580 18:53:47 -- spdk/autotest.sh@265 -- # '[' 0 -eq 1 ']' 00:07:30.580 18:53:47 -- spdk/autotest.sh@274 -- # '[' 1 -eq 1 ']' 00:07:30.580 18:53:47 -- spdk/autotest.sh@275 -- # export NET_TYPE 00:07:30.580 18:53:47 -- spdk/autotest.sh@278 -- # '[' tcp = rdma ']' 00:07:30.580 18:53:47 -- spdk/autotest.sh@281 -- # '[' tcp = tcp ']' 00:07:30.580 18:53:47 -- spdk/autotest.sh@282 -- # run_test nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:07:30.580 18:53:47 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:30.580 18:53:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:30.580 18:53:47 -- common/autotest_common.sh@10 -- # set +x 00:07:30.580 ************************************ 00:07:30.580 START TEST nvmf_tcp 00:07:30.580 ************************************ 00:07:30.580 18:53:47 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:07:30.580 * Looking for test storage... 00:07:30.580 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf 00:07:30.580 18:53:47 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:30.580 18:53:47 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:30.580 18:53:47 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:30.580 18:53:47 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:30.580 18:53:47 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:30.580 18:53:47 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:30.580 18:53:47 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:30.580 18:53:47 -- scripts/common.sh@335 -- # IFS=.-: 00:07:30.580 18:53:47 -- scripts/common.sh@335 -- # read -ra ver1 00:07:30.580 18:53:47 -- scripts/common.sh@336 -- # IFS=.-: 00:07:30.580 18:53:47 -- scripts/common.sh@336 -- # read -ra ver2 00:07:30.580 18:53:47 -- scripts/common.sh@337 -- # local 'op=<' 00:07:30.580 18:53:47 -- scripts/common.sh@339 -- # ver1_l=2 00:07:30.580 18:53:47 -- scripts/common.sh@340 -- # ver2_l=1 00:07:30.580 18:53:47 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:30.580 18:53:47 -- scripts/common.sh@343 -- # case "$op" in 00:07:30.580 18:53:47 -- scripts/common.sh@344 -- # : 1 00:07:30.580 18:53:47 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:30.580 18:53:47 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:30.580 18:53:47 -- scripts/common.sh@364 -- # decimal 1 00:07:30.580 18:53:47 -- scripts/common.sh@352 -- # local d=1 00:07:30.580 18:53:47 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:30.580 18:53:47 -- scripts/common.sh@354 -- # echo 1 00:07:30.580 18:53:47 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:30.580 18:53:47 -- scripts/common.sh@365 -- # decimal 2 00:07:30.580 18:53:47 -- scripts/common.sh@352 -- # local d=2 00:07:30.580 18:53:47 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:30.580 18:53:47 -- scripts/common.sh@354 -- # echo 2 00:07:30.580 18:53:47 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:30.580 18:53:47 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:30.580 18:53:47 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:30.580 18:53:47 -- scripts/common.sh@367 -- # return 0 00:07:30.580 18:53:47 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:30.580 18:53:47 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:30.580 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:30.580 --rc genhtml_branch_coverage=1 00:07:30.580 --rc genhtml_function_coverage=1 00:07:30.580 --rc genhtml_legend=1 00:07:30.580 --rc geninfo_all_blocks=1 00:07:30.580 --rc geninfo_unexecuted_blocks=1 00:07:30.580 00:07:30.580 ' 00:07:30.580 18:53:47 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:30.580 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:30.580 --rc genhtml_branch_coverage=1 00:07:30.580 --rc genhtml_function_coverage=1 00:07:30.580 --rc genhtml_legend=1 00:07:30.580 --rc geninfo_all_blocks=1 00:07:30.580 --rc geninfo_unexecuted_blocks=1 00:07:30.580 00:07:30.580 ' 00:07:30.580 18:53:47 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:30.580 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:30.580 --rc genhtml_branch_coverage=1 00:07:30.580 --rc genhtml_function_coverage=1 00:07:30.580 --rc genhtml_legend=1 00:07:30.580 --rc geninfo_all_blocks=1 00:07:30.580 --rc geninfo_unexecuted_blocks=1 00:07:30.580 00:07:30.580 ' 00:07:30.580 18:53:47 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:30.580 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:30.580 --rc genhtml_branch_coverage=1 00:07:30.580 --rc genhtml_function_coverage=1 00:07:30.580 --rc genhtml_legend=1 00:07:30.580 --rc geninfo_all_blocks=1 00:07:30.580 --rc geninfo_unexecuted_blocks=1 00:07:30.580 00:07:30.580 ' 00:07:30.580 18:53:47 -- nvmf/nvmf.sh@10 -- # uname -s 00:07:30.580 18:53:47 -- nvmf/nvmf.sh@10 -- # '[' '!' Linux = Linux ']' 00:07:30.580 18:53:47 -- nvmf/nvmf.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:30.580 18:53:47 -- nvmf/common.sh@7 -- # uname -s 00:07:30.580 18:53:47 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:30.580 18:53:47 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:30.580 18:53:47 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:30.580 18:53:47 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:30.580 18:53:47 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:30.580 18:53:47 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:30.580 18:53:47 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:30.580 18:53:47 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:30.580 18:53:47 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:30.580 18:53:47 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:30.580 18:53:47 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:07:30.580 18:53:47 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:07:30.580 18:53:47 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:30.581 18:53:47 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:30.581 18:53:47 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:30.581 18:53:47 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:30.581 18:53:47 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:30.581 18:53:47 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:30.581 18:53:47 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:30.581 18:53:47 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:30.581 18:53:47 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:30.581 18:53:47 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:30.581 18:53:47 -- paths/export.sh@5 -- # export PATH 00:07:30.581 18:53:47 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:30.581 18:53:47 -- nvmf/common.sh@46 -- # : 0 00:07:30.581 18:53:47 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:30.581 18:53:47 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:30.581 18:53:47 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:30.581 18:53:47 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:30.581 18:53:47 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:30.581 18:53:47 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:30.581 18:53:47 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:30.581 18:53:47 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:30.581 18:53:47 -- nvmf/nvmf.sh@16 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:07:30.581 18:53:47 -- nvmf/nvmf.sh@18 -- # TEST_ARGS=("$@") 00:07:30.581 18:53:47 -- nvmf/nvmf.sh@20 -- # timing_enter target 00:07:30.581 18:53:47 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:30.581 18:53:47 -- common/autotest_common.sh@10 -- # set +x 00:07:30.581 18:53:47 -- nvmf/nvmf.sh@22 -- # [[ 0 -eq 0 ]] 00:07:30.581 18:53:47 -- nvmf/nvmf.sh@23 -- # run_test nvmf_example /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:07:30.581 18:53:47 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:30.581 18:53:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:30.581 18:53:47 -- common/autotest_common.sh@10 -- # set +x 00:07:30.581 ************************************ 00:07:30.581 START TEST nvmf_example 00:07:30.581 ************************************ 00:07:30.581 18:53:47 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:07:30.839 * Looking for test storage... 00:07:30.839 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:30.839 18:53:47 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:30.839 18:53:47 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:30.839 18:53:47 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:30.839 18:53:47 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:30.839 18:53:47 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:30.839 18:53:47 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:30.839 18:53:47 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:30.839 18:53:47 -- scripts/common.sh@335 -- # IFS=.-: 00:07:30.839 18:53:47 -- scripts/common.sh@335 -- # read -ra ver1 00:07:30.839 18:53:47 -- scripts/common.sh@336 -- # IFS=.-: 00:07:30.839 18:53:47 -- scripts/common.sh@336 -- # read -ra ver2 00:07:30.839 18:53:47 -- scripts/common.sh@337 -- # local 'op=<' 00:07:30.839 18:53:47 -- scripts/common.sh@339 -- # ver1_l=2 00:07:30.839 18:53:47 -- scripts/common.sh@340 -- # ver2_l=1 00:07:30.839 18:53:47 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:30.839 18:53:47 -- scripts/common.sh@343 -- # case "$op" in 00:07:30.839 18:53:47 -- scripts/common.sh@344 -- # : 1 00:07:30.839 18:53:47 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:30.839 18:53:47 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:30.839 18:53:47 -- scripts/common.sh@364 -- # decimal 1 00:07:30.839 18:53:47 -- scripts/common.sh@352 -- # local d=1 00:07:30.839 18:53:47 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:30.839 18:53:47 -- scripts/common.sh@354 -- # echo 1 00:07:30.839 18:53:47 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:30.839 18:53:47 -- scripts/common.sh@365 -- # decimal 2 00:07:30.839 18:53:47 -- scripts/common.sh@352 -- # local d=2 00:07:30.839 18:53:47 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:30.839 18:53:47 -- scripts/common.sh@354 -- # echo 2 00:07:30.839 18:53:47 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:30.839 18:53:47 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:30.839 18:53:47 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:30.839 18:53:47 -- scripts/common.sh@367 -- # return 0 00:07:30.839 18:53:47 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:30.839 18:53:47 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:30.839 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:30.839 --rc genhtml_branch_coverage=1 00:07:30.839 --rc genhtml_function_coverage=1 00:07:30.839 --rc genhtml_legend=1 00:07:30.839 --rc geninfo_all_blocks=1 00:07:30.839 --rc geninfo_unexecuted_blocks=1 00:07:30.839 00:07:30.839 ' 00:07:30.839 18:53:47 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:30.839 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:30.839 --rc genhtml_branch_coverage=1 00:07:30.839 --rc genhtml_function_coverage=1 00:07:30.839 --rc genhtml_legend=1 00:07:30.839 --rc geninfo_all_blocks=1 00:07:30.839 --rc geninfo_unexecuted_blocks=1 00:07:30.839 00:07:30.839 ' 00:07:30.839 18:53:47 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:30.839 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:30.839 --rc genhtml_branch_coverage=1 00:07:30.839 --rc genhtml_function_coverage=1 00:07:30.839 --rc genhtml_legend=1 00:07:30.839 --rc geninfo_all_blocks=1 00:07:30.839 --rc geninfo_unexecuted_blocks=1 00:07:30.839 00:07:30.839 ' 00:07:30.839 18:53:47 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:30.839 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:30.839 --rc genhtml_branch_coverage=1 00:07:30.839 --rc genhtml_function_coverage=1 00:07:30.839 --rc genhtml_legend=1 00:07:30.839 --rc geninfo_all_blocks=1 00:07:30.839 --rc geninfo_unexecuted_blocks=1 00:07:30.839 00:07:30.839 ' 00:07:30.839 18:53:47 -- target/nvmf_example.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:30.839 18:53:47 -- nvmf/common.sh@7 -- # uname -s 00:07:30.839 18:53:47 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:30.839 18:53:47 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:30.839 18:53:47 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:30.839 18:53:47 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:30.839 18:53:47 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:30.839 18:53:47 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:30.839 18:53:47 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:30.839 18:53:47 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:30.839 18:53:47 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:30.839 18:53:47 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:30.839 18:53:47 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:07:30.839 18:53:47 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:07:30.839 18:53:47 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:30.839 18:53:47 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:30.839 18:53:47 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:30.839 18:53:47 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:30.839 18:53:47 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:30.839 18:53:47 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:30.839 18:53:47 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:30.839 18:53:47 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:30.839 18:53:47 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:30.839 18:53:47 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:30.839 18:53:47 -- paths/export.sh@5 -- # export PATH 00:07:30.839 18:53:47 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:30.839 18:53:47 -- nvmf/common.sh@46 -- # : 0 00:07:30.839 18:53:47 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:30.839 18:53:47 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:30.839 18:53:47 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:30.839 18:53:47 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:30.839 18:53:47 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:30.839 18:53:47 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:30.839 18:53:47 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:30.839 18:53:47 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:30.839 18:53:47 -- target/nvmf_example.sh@11 -- # NVMF_EXAMPLE=("$SPDK_EXAMPLE_DIR/nvmf") 00:07:30.839 18:53:47 -- target/nvmf_example.sh@13 -- # MALLOC_BDEV_SIZE=64 00:07:30.839 18:53:47 -- target/nvmf_example.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:07:30.839 18:53:47 -- target/nvmf_example.sh@24 -- # build_nvmf_example_args 00:07:30.839 18:53:47 -- target/nvmf_example.sh@17 -- # '[' 0 -eq 1 ']' 00:07:30.839 18:53:47 -- target/nvmf_example.sh@20 -- # NVMF_EXAMPLE+=(-i "$NVMF_APP_SHM_ID" -g 10000) 00:07:30.839 18:53:47 -- target/nvmf_example.sh@21 -- # NVMF_EXAMPLE+=("${NO_HUGE[@]}") 00:07:30.839 18:53:47 -- target/nvmf_example.sh@40 -- # timing_enter nvmf_example_test 00:07:30.839 18:53:47 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:30.839 18:53:47 -- common/autotest_common.sh@10 -- # set +x 00:07:30.839 18:53:47 -- target/nvmf_example.sh@41 -- # nvmftestinit 00:07:30.839 18:53:47 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:30.839 18:53:47 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:30.839 18:53:47 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:30.839 18:53:47 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:30.839 18:53:47 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:30.839 18:53:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:30.839 18:53:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:30.839 18:53:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:30.839 18:53:47 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:30.839 18:53:47 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:30.839 18:53:47 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:30.839 18:53:47 -- common/autotest_common.sh@10 -- # set +x 00:07:36.104 18:53:52 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:36.104 18:53:52 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:36.104 18:53:52 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:36.104 18:53:52 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:36.104 18:53:52 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:36.104 18:53:52 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:36.104 18:53:52 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:36.104 18:53:52 -- nvmf/common.sh@294 -- # net_devs=() 00:07:36.104 18:53:52 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:36.104 18:53:52 -- nvmf/common.sh@295 -- # e810=() 00:07:36.104 18:53:52 -- nvmf/common.sh@295 -- # local -ga e810 00:07:36.104 18:53:52 -- nvmf/common.sh@296 -- # x722=() 00:07:36.104 18:53:52 -- nvmf/common.sh@296 -- # local -ga x722 00:07:36.104 18:53:52 -- nvmf/common.sh@297 -- # mlx=() 00:07:36.104 18:53:52 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:36.104 18:53:52 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:36.104 18:53:52 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:36.104 18:53:52 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:36.104 18:53:52 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:36.104 18:53:52 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:36.104 18:53:52 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:36.104 18:53:52 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:36.104 18:53:52 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:36.104 18:53:52 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:36.104 18:53:52 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:36.104 18:53:52 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:36.104 18:53:52 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:36.104 18:53:52 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:36.104 18:53:52 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:36.104 18:53:52 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:36.104 18:53:52 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:36.104 18:53:52 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:36.104 18:53:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:36.104 18:53:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:07:36.104 Found 0000:86:00.0 (0x8086 - 0x159b) 00:07:36.104 18:53:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:36.104 18:53:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:36.104 18:53:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:36.104 18:53:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:36.104 18:53:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:36.104 18:53:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:36.104 18:53:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:07:36.104 Found 0000:86:00.1 (0x8086 - 0x159b) 00:07:36.104 18:53:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:36.104 18:53:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:36.104 18:53:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:36.104 18:53:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:36.104 18:53:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:36.104 18:53:52 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:36.104 18:53:52 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:36.104 18:53:52 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:36.104 18:53:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:36.104 18:53:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:36.104 18:53:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:36.104 18:53:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:36.104 18:53:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:07:36.104 Found net devices under 0000:86:00.0: cvl_0_0 00:07:36.104 18:53:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:36.104 18:53:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:36.104 18:53:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:36.104 18:53:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:36.104 18:53:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:36.104 18:53:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:07:36.104 Found net devices under 0000:86:00.1: cvl_0_1 00:07:36.104 18:53:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:36.104 18:53:52 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:36.104 18:53:52 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:36.104 18:53:52 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:36.104 18:53:52 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:36.104 18:53:52 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:36.104 18:53:52 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:36.104 18:53:52 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:36.104 18:53:52 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:36.104 18:53:52 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:36.104 18:53:52 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:36.104 18:53:52 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:36.104 18:53:52 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:36.104 18:53:52 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:36.104 18:53:52 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:36.104 18:53:52 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:36.104 18:53:52 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:36.104 18:53:52 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:36.104 18:53:52 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:36.105 18:53:52 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:36.105 18:53:52 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:36.105 18:53:52 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:36.105 18:53:52 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:36.105 18:53:52 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:36.105 18:53:52 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:36.105 18:53:52 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:36.105 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:36.105 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.424 ms 00:07:36.105 00:07:36.105 --- 10.0.0.2 ping statistics --- 00:07:36.105 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:36.105 rtt min/avg/max/mdev = 0.424/0.424/0.424/0.000 ms 00:07:36.105 18:53:52 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:36.105 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:36.105 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.195 ms 00:07:36.105 00:07:36.105 --- 10.0.0.1 ping statistics --- 00:07:36.105 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:36.105 rtt min/avg/max/mdev = 0.195/0.195/0.195/0.000 ms 00:07:36.105 18:53:52 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:36.105 18:53:52 -- nvmf/common.sh@410 -- # return 0 00:07:36.105 18:53:52 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:36.105 18:53:52 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:36.105 18:53:52 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:36.105 18:53:52 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:36.105 18:53:52 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:36.105 18:53:52 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:36.105 18:53:52 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:36.105 18:53:52 -- target/nvmf_example.sh@42 -- # nvmfexamplestart '-m 0xF' 00:07:36.105 18:53:52 -- target/nvmf_example.sh@27 -- # timing_enter start_nvmf_example 00:07:36.105 18:53:52 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:36.105 18:53:52 -- common/autotest_common.sh@10 -- # set +x 00:07:36.105 18:53:52 -- target/nvmf_example.sh@29 -- # '[' tcp == tcp ']' 00:07:36.105 18:53:52 -- target/nvmf_example.sh@30 -- # NVMF_EXAMPLE=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_EXAMPLE[@]}") 00:07:36.105 18:53:52 -- target/nvmf_example.sh@34 -- # nvmfpid=2947656 00:07:36.105 18:53:52 -- target/nvmf_example.sh@35 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:07:36.105 18:53:52 -- target/nvmf_example.sh@36 -- # waitforlisten 2947656 00:07:36.105 18:53:52 -- common/autotest_common.sh@829 -- # '[' -z 2947656 ']' 00:07:36.105 18:53:52 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:36.105 18:53:52 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:36.105 18:53:52 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:36.105 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:36.105 18:53:52 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:36.105 18:53:52 -- common/autotest_common.sh@10 -- # set +x 00:07:36.105 18:53:52 -- target/nvmf_example.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/nvmf -i 0 -g 10000 -m 0xF 00:07:36.105 EAL: No free 2048 kB hugepages reported on node 1 00:07:36.671 18:53:53 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:36.671 18:53:53 -- common/autotest_common.sh@862 -- # return 0 00:07:36.671 18:53:53 -- target/nvmf_example.sh@37 -- # timing_exit start_nvmf_example 00:07:36.671 18:53:53 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:36.671 18:53:53 -- common/autotest_common.sh@10 -- # set +x 00:07:36.671 18:53:53 -- target/nvmf_example.sh@45 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:07:36.671 18:53:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:36.671 18:53:53 -- common/autotest_common.sh@10 -- # set +x 00:07:36.671 18:53:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:36.671 18:53:53 -- target/nvmf_example.sh@47 -- # rpc_cmd bdev_malloc_create 64 512 00:07:36.671 18:53:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:36.671 18:53:53 -- common/autotest_common.sh@10 -- # set +x 00:07:36.671 18:53:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:36.671 18:53:53 -- target/nvmf_example.sh@47 -- # malloc_bdevs='Malloc0 ' 00:07:36.671 18:53:53 -- target/nvmf_example.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:07:36.671 18:53:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:36.671 18:53:53 -- common/autotest_common.sh@10 -- # set +x 00:07:36.671 18:53:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:36.671 18:53:53 -- target/nvmf_example.sh@52 -- # for malloc_bdev in $malloc_bdevs 00:07:36.671 18:53:53 -- target/nvmf_example.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:07:36.671 18:53:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:36.671 18:53:53 -- common/autotest_common.sh@10 -- # set +x 00:07:36.671 18:53:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:36.671 18:53:53 -- target/nvmf_example.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:36.671 18:53:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:36.671 18:53:53 -- common/autotest_common.sh@10 -- # set +x 00:07:36.671 18:53:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:36.671 18:53:53 -- target/nvmf_example.sh@59 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:07:36.671 18:53:53 -- target/nvmf_example.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:07:36.671 EAL: No free 2048 kB hugepages reported on node 1 00:07:48.872 Initializing NVMe Controllers 00:07:48.872 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:07:48.872 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:07:48.872 Initialization complete. Launching workers. 00:07:48.872 ======================================================== 00:07:48.872 Latency(us) 00:07:48.872 Device Information : IOPS MiB/s Average min max 00:07:48.872 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 18145.10 70.88 3528.37 692.65 15482.50 00:07:48.872 ======================================================== 00:07:48.872 Total : 18145.10 70.88 3528.37 692.65 15482.50 00:07:48.872 00:07:48.872 18:54:03 -- target/nvmf_example.sh@65 -- # trap - SIGINT SIGTERM EXIT 00:07:48.872 18:54:03 -- target/nvmf_example.sh@66 -- # nvmftestfini 00:07:48.872 18:54:03 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:48.872 18:54:03 -- nvmf/common.sh@116 -- # sync 00:07:48.872 18:54:03 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:48.872 18:54:03 -- nvmf/common.sh@119 -- # set +e 00:07:48.872 18:54:03 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:48.872 18:54:03 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:48.872 rmmod nvme_tcp 00:07:48.872 rmmod nvme_fabrics 00:07:48.872 rmmod nvme_keyring 00:07:48.872 18:54:03 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:48.872 18:54:03 -- nvmf/common.sh@123 -- # set -e 00:07:48.872 18:54:03 -- nvmf/common.sh@124 -- # return 0 00:07:48.872 18:54:03 -- nvmf/common.sh@477 -- # '[' -n 2947656 ']' 00:07:48.872 18:54:03 -- nvmf/common.sh@478 -- # killprocess 2947656 00:07:48.872 18:54:03 -- common/autotest_common.sh@936 -- # '[' -z 2947656 ']' 00:07:48.872 18:54:03 -- common/autotest_common.sh@940 -- # kill -0 2947656 00:07:48.872 18:54:03 -- common/autotest_common.sh@941 -- # uname 00:07:48.872 18:54:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:48.872 18:54:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2947656 00:07:48.872 18:54:03 -- common/autotest_common.sh@942 -- # process_name=nvmf 00:07:48.872 18:54:03 -- common/autotest_common.sh@946 -- # '[' nvmf = sudo ']' 00:07:48.872 18:54:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2947656' 00:07:48.872 killing process with pid 2947656 00:07:48.872 18:54:03 -- common/autotest_common.sh@955 -- # kill 2947656 00:07:48.872 18:54:03 -- common/autotest_common.sh@960 -- # wait 2947656 00:07:48.872 nvmf threads initialize successfully 00:07:48.872 bdev subsystem init successfully 00:07:48.872 created a nvmf target service 00:07:48.872 create targets's poll groups done 00:07:48.872 all subsystems of target started 00:07:48.872 nvmf target is running 00:07:48.872 all subsystems of target stopped 00:07:48.872 destroy targets's poll groups done 00:07:48.872 destroyed the nvmf target service 00:07:48.872 bdev subsystem finish successfully 00:07:48.872 nvmf threads destroy successfully 00:07:48.872 18:54:04 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:48.872 18:54:04 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:48.872 18:54:04 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:48.872 18:54:04 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:48.872 18:54:04 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:48.872 18:54:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:48.872 18:54:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:48.872 18:54:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:49.440 18:54:06 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:49.440 18:54:06 -- target/nvmf_example.sh@67 -- # timing_exit nvmf_example_test 00:07:49.440 18:54:06 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:49.440 18:54:06 -- common/autotest_common.sh@10 -- # set +x 00:07:49.440 00:07:49.440 real 0m18.732s 00:07:49.441 user 0m45.728s 00:07:49.441 sys 0m5.334s 00:07:49.441 18:54:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:49.441 18:54:06 -- common/autotest_common.sh@10 -- # set +x 00:07:49.441 ************************************ 00:07:49.441 END TEST nvmf_example 00:07:49.441 ************************************ 00:07:49.441 18:54:06 -- nvmf/nvmf.sh@24 -- # run_test nvmf_filesystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:07:49.441 18:54:06 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:49.441 18:54:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:49.441 18:54:06 -- common/autotest_common.sh@10 -- # set +x 00:07:49.441 ************************************ 00:07:49.441 START TEST nvmf_filesystem 00:07:49.441 ************************************ 00:07:49.441 18:54:06 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:07:49.441 * Looking for test storage... 00:07:49.441 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:49.441 18:54:06 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:49.441 18:54:06 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:49.441 18:54:06 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:49.703 18:54:06 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:49.703 18:54:06 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:49.703 18:54:06 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:49.703 18:54:06 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:49.703 18:54:06 -- scripts/common.sh@335 -- # IFS=.-: 00:07:49.703 18:54:06 -- scripts/common.sh@335 -- # read -ra ver1 00:07:49.703 18:54:06 -- scripts/common.sh@336 -- # IFS=.-: 00:07:49.703 18:54:06 -- scripts/common.sh@336 -- # read -ra ver2 00:07:49.703 18:54:06 -- scripts/common.sh@337 -- # local 'op=<' 00:07:49.703 18:54:06 -- scripts/common.sh@339 -- # ver1_l=2 00:07:49.703 18:54:06 -- scripts/common.sh@340 -- # ver2_l=1 00:07:49.703 18:54:06 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:49.703 18:54:06 -- scripts/common.sh@343 -- # case "$op" in 00:07:49.703 18:54:06 -- scripts/common.sh@344 -- # : 1 00:07:49.703 18:54:06 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:49.703 18:54:06 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:49.703 18:54:06 -- scripts/common.sh@364 -- # decimal 1 00:07:49.703 18:54:06 -- scripts/common.sh@352 -- # local d=1 00:07:49.703 18:54:06 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:49.703 18:54:06 -- scripts/common.sh@354 -- # echo 1 00:07:49.703 18:54:06 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:49.703 18:54:06 -- scripts/common.sh@365 -- # decimal 2 00:07:49.703 18:54:06 -- scripts/common.sh@352 -- # local d=2 00:07:49.703 18:54:06 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:49.703 18:54:06 -- scripts/common.sh@354 -- # echo 2 00:07:49.703 18:54:06 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:49.703 18:54:06 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:49.703 18:54:06 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:49.703 18:54:06 -- scripts/common.sh@367 -- # return 0 00:07:49.703 18:54:06 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:49.703 18:54:06 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:49.703 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:49.703 --rc genhtml_branch_coverage=1 00:07:49.703 --rc genhtml_function_coverage=1 00:07:49.703 --rc genhtml_legend=1 00:07:49.703 --rc geninfo_all_blocks=1 00:07:49.703 --rc geninfo_unexecuted_blocks=1 00:07:49.703 00:07:49.703 ' 00:07:49.703 18:54:06 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:49.703 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:49.703 --rc genhtml_branch_coverage=1 00:07:49.703 --rc genhtml_function_coverage=1 00:07:49.703 --rc genhtml_legend=1 00:07:49.703 --rc geninfo_all_blocks=1 00:07:49.703 --rc geninfo_unexecuted_blocks=1 00:07:49.703 00:07:49.703 ' 00:07:49.703 18:54:06 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:49.703 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:49.703 --rc genhtml_branch_coverage=1 00:07:49.703 --rc genhtml_function_coverage=1 00:07:49.703 --rc genhtml_legend=1 00:07:49.703 --rc geninfo_all_blocks=1 00:07:49.703 --rc geninfo_unexecuted_blocks=1 00:07:49.703 00:07:49.703 ' 00:07:49.703 18:54:06 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:49.703 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:49.703 --rc genhtml_branch_coverage=1 00:07:49.703 --rc genhtml_function_coverage=1 00:07:49.703 --rc genhtml_legend=1 00:07:49.703 --rc geninfo_all_blocks=1 00:07:49.703 --rc geninfo_unexecuted_blocks=1 00:07:49.703 00:07:49.703 ' 00:07:49.703 18:54:06 -- target/filesystem.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh 00:07:49.703 18:54:06 -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:07:49.703 18:54:06 -- common/autotest_common.sh@34 -- # set -e 00:07:49.703 18:54:06 -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:07:49.703 18:54:06 -- common/autotest_common.sh@36 -- # shopt -s extglob 00:07:49.703 18:54:06 -- common/autotest_common.sh@38 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh ]] 00:07:49.703 18:54:06 -- common/autotest_common.sh@39 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh 00:07:49.703 18:54:06 -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:07:49.703 18:54:06 -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:07:49.703 18:54:06 -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:07:49.703 18:54:06 -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:07:49.703 18:54:06 -- common/build_config.sh@5 -- # CONFIG_USDT=n 00:07:49.703 18:54:06 -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:07:49.703 18:54:06 -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:07:49.703 18:54:06 -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:07:49.703 18:54:06 -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:07:49.703 18:54:06 -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:07:49.703 18:54:06 -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:07:49.703 18:54:06 -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:07:49.703 18:54:06 -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:07:49.703 18:54:06 -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:07:49.703 18:54:06 -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:07:49.703 18:54:06 -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:07:49.703 18:54:06 -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:07:49.703 18:54:06 -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:07:49.703 18:54:06 -- common/build_config.sh@19 -- # CONFIG_ENV=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:07:49.703 18:54:06 -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:07:49.703 18:54:06 -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:07:49.703 18:54:06 -- common/build_config.sh@22 -- # CONFIG_CET=n 00:07:49.703 18:54:06 -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:07:49.703 18:54:06 -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:07:49.703 18:54:06 -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:07:49.703 18:54:06 -- common/build_config.sh@26 -- # CONFIG_HAVE_ARC4RANDOM=y 00:07:49.703 18:54:06 -- common/build_config.sh@27 -- # CONFIG_HAVE_LIBARCHIVE=n 00:07:49.703 18:54:06 -- common/build_config.sh@28 -- # CONFIG_UBLK=y 00:07:49.703 18:54:06 -- common/build_config.sh@29 -- # CONFIG_ISAL_CRYPTO=y 00:07:49.703 18:54:06 -- common/build_config.sh@30 -- # CONFIG_OPENSSL_PATH= 00:07:49.703 18:54:06 -- common/build_config.sh@31 -- # CONFIG_OCF=n 00:07:49.703 18:54:06 -- common/build_config.sh@32 -- # CONFIG_FUSE=n 00:07:49.703 18:54:06 -- common/build_config.sh@33 -- # CONFIG_VTUNE_DIR= 00:07:49.703 18:54:06 -- common/build_config.sh@34 -- # CONFIG_FUZZER_LIB= 00:07:49.703 18:54:06 -- common/build_config.sh@35 -- # CONFIG_FUZZER=n 00:07:49.703 18:54:06 -- common/build_config.sh@36 -- # CONFIG_DPDK_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:07:49.703 18:54:06 -- common/build_config.sh@37 -- # CONFIG_CRYPTO=n 00:07:49.704 18:54:06 -- common/build_config.sh@38 -- # CONFIG_PGO_USE=n 00:07:49.704 18:54:06 -- common/build_config.sh@39 -- # CONFIG_VHOST=y 00:07:49.704 18:54:06 -- common/build_config.sh@40 -- # CONFIG_DAOS=n 00:07:49.704 18:54:06 -- common/build_config.sh@41 -- # CONFIG_DPDK_INC_DIR=//var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:07:49.704 18:54:06 -- common/build_config.sh@42 -- # CONFIG_DAOS_DIR= 00:07:49.704 18:54:06 -- common/build_config.sh@43 -- # CONFIG_UNIT_TESTS=n 00:07:49.704 18:54:06 -- common/build_config.sh@44 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:07:49.704 18:54:06 -- common/build_config.sh@45 -- # CONFIG_VIRTIO=y 00:07:49.704 18:54:06 -- common/build_config.sh@46 -- # CONFIG_COVERAGE=y 00:07:49.704 18:54:06 -- common/build_config.sh@47 -- # CONFIG_RDMA=y 00:07:49.704 18:54:06 -- common/build_config.sh@48 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:07:49.704 18:54:06 -- common/build_config.sh@49 -- # CONFIG_URING_PATH= 00:07:49.704 18:54:06 -- common/build_config.sh@50 -- # CONFIG_XNVME=n 00:07:49.704 18:54:06 -- common/build_config.sh@51 -- # CONFIG_VFIO_USER=y 00:07:49.704 18:54:06 -- common/build_config.sh@52 -- # CONFIG_ARCH=native 00:07:49.704 18:54:06 -- common/build_config.sh@53 -- # CONFIG_URING_ZNS=n 00:07:49.704 18:54:06 -- common/build_config.sh@54 -- # CONFIG_WERROR=y 00:07:49.704 18:54:06 -- common/build_config.sh@55 -- # CONFIG_HAVE_LIBBSD=n 00:07:49.704 18:54:06 -- common/build_config.sh@56 -- # CONFIG_UBSAN=y 00:07:49.704 18:54:06 -- common/build_config.sh@57 -- # CONFIG_IPSEC_MB_DIR= 00:07:49.704 18:54:06 -- common/build_config.sh@58 -- # CONFIG_GOLANG=n 00:07:49.704 18:54:06 -- common/build_config.sh@59 -- # CONFIG_ISAL=y 00:07:49.704 18:54:06 -- common/build_config.sh@60 -- # CONFIG_IDXD_KERNEL=y 00:07:49.704 18:54:06 -- common/build_config.sh@61 -- # CONFIG_DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:07:49.704 18:54:06 -- common/build_config.sh@62 -- # CONFIG_RDMA_PROV=verbs 00:07:49.704 18:54:06 -- common/build_config.sh@63 -- # CONFIG_APPS=y 00:07:49.704 18:54:06 -- common/build_config.sh@64 -- # CONFIG_SHARED=y 00:07:49.704 18:54:06 -- common/build_config.sh@65 -- # CONFIG_FC_PATH= 00:07:49.704 18:54:06 -- common/build_config.sh@66 -- # CONFIG_DPDK_PKG_CONFIG=n 00:07:49.704 18:54:06 -- common/build_config.sh@67 -- # CONFIG_FC=n 00:07:49.704 18:54:06 -- common/build_config.sh@68 -- # CONFIG_AVAHI=n 00:07:49.704 18:54:06 -- common/build_config.sh@69 -- # CONFIG_FIO_PLUGIN=y 00:07:49.704 18:54:06 -- common/build_config.sh@70 -- # CONFIG_RAID5F=n 00:07:49.704 18:54:06 -- common/build_config.sh@71 -- # CONFIG_EXAMPLES=y 00:07:49.704 18:54:06 -- common/build_config.sh@72 -- # CONFIG_TESTS=y 00:07:49.704 18:54:06 -- common/build_config.sh@73 -- # CONFIG_CRYPTO_MLX5=n 00:07:49.704 18:54:06 -- common/build_config.sh@74 -- # CONFIG_MAX_LCORES= 00:07:49.704 18:54:06 -- common/build_config.sh@75 -- # CONFIG_IPSEC_MB=n 00:07:49.704 18:54:06 -- common/build_config.sh@76 -- # CONFIG_DEBUG=y 00:07:49.704 18:54:06 -- common/build_config.sh@77 -- # CONFIG_DPDK_COMPRESSDEV=n 00:07:49.704 18:54:06 -- common/build_config.sh@78 -- # CONFIG_CROSS_PREFIX= 00:07:49.704 18:54:06 -- common/build_config.sh@79 -- # CONFIG_URING=n 00:07:49.704 18:54:06 -- common/autotest_common.sh@48 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:07:49.704 18:54:06 -- common/applications.sh@8 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:07:49.704 18:54:06 -- common/applications.sh@8 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:07:49.704 18:54:06 -- common/applications.sh@8 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:07:49.704 18:54:06 -- common/applications.sh@9 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:07:49.704 18:54:06 -- common/applications.sh@10 -- # _app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:07:49.704 18:54:06 -- common/applications.sh@11 -- # _test_app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:07:49.704 18:54:06 -- common/applications.sh@12 -- # _examples_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:07:49.704 18:54:06 -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:07:49.704 18:54:06 -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:07:49.704 18:54:06 -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:07:49.704 18:54:06 -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:07:49.704 18:54:06 -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:07:49.704 18:54:06 -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:07:49.704 18:54:06 -- common/applications.sh@22 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/config.h ]] 00:07:49.704 18:54:06 -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:07:49.704 #define SPDK_CONFIG_H 00:07:49.704 #define SPDK_CONFIG_APPS 1 00:07:49.704 #define SPDK_CONFIG_ARCH native 00:07:49.704 #undef SPDK_CONFIG_ASAN 00:07:49.704 #undef SPDK_CONFIG_AVAHI 00:07:49.704 #undef SPDK_CONFIG_CET 00:07:49.704 #define SPDK_CONFIG_COVERAGE 1 00:07:49.704 #define SPDK_CONFIG_CROSS_PREFIX 00:07:49.704 #undef SPDK_CONFIG_CRYPTO 00:07:49.704 #undef SPDK_CONFIG_CRYPTO_MLX5 00:07:49.704 #undef SPDK_CONFIG_CUSTOMOCF 00:07:49.704 #undef SPDK_CONFIG_DAOS 00:07:49.704 #define SPDK_CONFIG_DAOS_DIR 00:07:49.704 #define SPDK_CONFIG_DEBUG 1 00:07:49.704 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:07:49.704 #define SPDK_CONFIG_DPDK_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:07:49.704 #define SPDK_CONFIG_DPDK_INC_DIR //var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:07:49.704 #define SPDK_CONFIG_DPDK_LIB_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:07:49.704 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:07:49.704 #define SPDK_CONFIG_ENV /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:07:49.704 #define SPDK_CONFIG_EXAMPLES 1 00:07:49.704 #undef SPDK_CONFIG_FC 00:07:49.704 #define SPDK_CONFIG_FC_PATH 00:07:49.704 #define SPDK_CONFIG_FIO_PLUGIN 1 00:07:49.704 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:07:49.704 #undef SPDK_CONFIG_FUSE 00:07:49.704 #undef SPDK_CONFIG_FUZZER 00:07:49.704 #define SPDK_CONFIG_FUZZER_LIB 00:07:49.704 #undef SPDK_CONFIG_GOLANG 00:07:49.704 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:07:49.704 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:07:49.704 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:07:49.704 #undef SPDK_CONFIG_HAVE_LIBBSD 00:07:49.704 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:07:49.704 #define SPDK_CONFIG_IDXD 1 00:07:49.704 #define SPDK_CONFIG_IDXD_KERNEL 1 00:07:49.704 #undef SPDK_CONFIG_IPSEC_MB 00:07:49.704 #define SPDK_CONFIG_IPSEC_MB_DIR 00:07:49.704 #define SPDK_CONFIG_ISAL 1 00:07:49.704 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:07:49.704 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:07:49.704 #define SPDK_CONFIG_LIBDIR 00:07:49.704 #undef SPDK_CONFIG_LTO 00:07:49.704 #define SPDK_CONFIG_MAX_LCORES 00:07:49.704 #define SPDK_CONFIG_NVME_CUSE 1 00:07:49.704 #undef SPDK_CONFIG_OCF 00:07:49.704 #define SPDK_CONFIG_OCF_PATH 00:07:49.704 #define SPDK_CONFIG_OPENSSL_PATH 00:07:49.704 #undef SPDK_CONFIG_PGO_CAPTURE 00:07:49.704 #undef SPDK_CONFIG_PGO_USE 00:07:49.704 #define SPDK_CONFIG_PREFIX /usr/local 00:07:49.704 #undef SPDK_CONFIG_RAID5F 00:07:49.704 #undef SPDK_CONFIG_RBD 00:07:49.704 #define SPDK_CONFIG_RDMA 1 00:07:49.704 #define SPDK_CONFIG_RDMA_PROV verbs 00:07:49.704 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:07:49.704 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:07:49.704 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:07:49.704 #define SPDK_CONFIG_SHARED 1 00:07:49.704 #undef SPDK_CONFIG_SMA 00:07:49.704 #define SPDK_CONFIG_TESTS 1 00:07:49.704 #undef SPDK_CONFIG_TSAN 00:07:49.704 #define SPDK_CONFIG_UBLK 1 00:07:49.704 #define SPDK_CONFIG_UBSAN 1 00:07:49.704 #undef SPDK_CONFIG_UNIT_TESTS 00:07:49.704 #undef SPDK_CONFIG_URING 00:07:49.704 #define SPDK_CONFIG_URING_PATH 00:07:49.704 #undef SPDK_CONFIG_URING_ZNS 00:07:49.704 #undef SPDK_CONFIG_USDT 00:07:49.704 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:07:49.704 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:07:49.704 #define SPDK_CONFIG_VFIO_USER 1 00:07:49.704 #define SPDK_CONFIG_VFIO_USER_DIR 00:07:49.704 #define SPDK_CONFIG_VHOST 1 00:07:49.704 #define SPDK_CONFIG_VIRTIO 1 00:07:49.704 #undef SPDK_CONFIG_VTUNE 00:07:49.704 #define SPDK_CONFIG_VTUNE_DIR 00:07:49.704 #define SPDK_CONFIG_WERROR 1 00:07:49.705 #define SPDK_CONFIG_WPDK_DIR 00:07:49.705 #undef SPDK_CONFIG_XNVME 00:07:49.705 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:07:49.705 18:54:06 -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:07:49.705 18:54:06 -- common/autotest_common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:49.705 18:54:06 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:49.705 18:54:06 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:49.705 18:54:06 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:49.705 18:54:06 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:49.705 18:54:06 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:49.705 18:54:06 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:49.705 18:54:06 -- paths/export.sh@5 -- # export PATH 00:07:49.705 18:54:06 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:49.705 18:54:06 -- common/autotest_common.sh@50 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:07:49.705 18:54:06 -- pm/common@6 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:07:49.705 18:54:06 -- pm/common@6 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:07:49.705 18:54:06 -- pm/common@6 -- # _pmdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:07:49.705 18:54:06 -- pm/common@7 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/../../../ 00:07:49.705 18:54:06 -- pm/common@7 -- # _pmrootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:07:49.705 18:54:06 -- pm/common@16 -- # TEST_TAG=N/A 00:07:49.705 18:54:06 -- pm/common@17 -- # TEST_TAG_FILE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/.run_test_name 00:07:49.705 18:54:06 -- common/autotest_common.sh@52 -- # : 1 00:07:49.705 18:54:06 -- common/autotest_common.sh@53 -- # export RUN_NIGHTLY 00:07:49.705 18:54:06 -- common/autotest_common.sh@56 -- # : 0 00:07:49.705 18:54:06 -- common/autotest_common.sh@57 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:07:49.705 18:54:06 -- common/autotest_common.sh@58 -- # : 0 00:07:49.705 18:54:06 -- common/autotest_common.sh@59 -- # export SPDK_RUN_VALGRIND 00:07:49.705 18:54:06 -- common/autotest_common.sh@60 -- # : 1 00:07:49.705 18:54:06 -- common/autotest_common.sh@61 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:07:49.705 18:54:06 -- common/autotest_common.sh@62 -- # : 0 00:07:49.705 18:54:06 -- common/autotest_common.sh@63 -- # export SPDK_TEST_UNITTEST 00:07:49.705 18:54:06 -- common/autotest_common.sh@64 -- # : 00:07:49.705 18:54:06 -- common/autotest_common.sh@65 -- # export SPDK_TEST_AUTOBUILD 00:07:49.705 18:54:06 -- common/autotest_common.sh@66 -- # : 0 00:07:49.705 18:54:06 -- common/autotest_common.sh@67 -- # export SPDK_TEST_RELEASE_BUILD 00:07:49.705 18:54:06 -- common/autotest_common.sh@68 -- # : 0 00:07:49.705 18:54:06 -- common/autotest_common.sh@69 -- # export SPDK_TEST_ISAL 00:07:49.705 18:54:06 -- common/autotest_common.sh@70 -- # : 0 00:07:49.705 18:54:06 -- common/autotest_common.sh@71 -- # export SPDK_TEST_ISCSI 00:07:49.705 18:54:06 -- common/autotest_common.sh@72 -- # : 0 00:07:49.705 18:54:06 -- common/autotest_common.sh@73 -- # export SPDK_TEST_ISCSI_INITIATOR 00:07:49.705 18:54:06 -- common/autotest_common.sh@74 -- # : 0 00:07:49.705 18:54:06 -- common/autotest_common.sh@75 -- # export SPDK_TEST_NVME 00:07:49.705 18:54:06 -- common/autotest_common.sh@76 -- # : 0 00:07:49.705 18:54:06 -- common/autotest_common.sh@77 -- # export SPDK_TEST_NVME_PMR 00:07:49.705 18:54:06 -- common/autotest_common.sh@78 -- # : 0 00:07:49.705 18:54:06 -- common/autotest_common.sh@79 -- # export SPDK_TEST_NVME_BP 00:07:49.705 18:54:06 -- common/autotest_common.sh@80 -- # : 1 00:07:49.705 18:54:06 -- common/autotest_common.sh@81 -- # export SPDK_TEST_NVME_CLI 00:07:49.705 18:54:06 -- common/autotest_common.sh@82 -- # : 0 00:07:49.705 18:54:06 -- common/autotest_common.sh@83 -- # export SPDK_TEST_NVME_CUSE 00:07:49.705 18:54:06 -- common/autotest_common.sh@84 -- # : 0 00:07:49.705 18:54:06 -- common/autotest_common.sh@85 -- # export SPDK_TEST_NVME_FDP 00:07:49.705 18:54:06 -- common/autotest_common.sh@86 -- # : 1 00:07:49.705 18:54:06 -- common/autotest_common.sh@87 -- # export SPDK_TEST_NVMF 00:07:49.705 18:54:06 -- common/autotest_common.sh@88 -- # : 1 00:07:49.705 18:54:06 -- common/autotest_common.sh@89 -- # export SPDK_TEST_VFIOUSER 00:07:49.705 18:54:06 -- common/autotest_common.sh@90 -- # : 0 00:07:49.705 18:54:06 -- common/autotest_common.sh@91 -- # export SPDK_TEST_VFIOUSER_QEMU 00:07:49.705 18:54:06 -- common/autotest_common.sh@92 -- # : 0 00:07:49.705 18:54:06 -- common/autotest_common.sh@93 -- # export SPDK_TEST_FUZZER 00:07:49.705 18:54:06 -- common/autotest_common.sh@94 -- # : 0 00:07:49.705 18:54:06 -- common/autotest_common.sh@95 -- # export SPDK_TEST_FUZZER_SHORT 00:07:49.705 18:54:06 -- common/autotest_common.sh@96 -- # : tcp 00:07:49.705 18:54:06 -- common/autotest_common.sh@97 -- # export SPDK_TEST_NVMF_TRANSPORT 00:07:49.705 18:54:06 -- common/autotest_common.sh@98 -- # : 0 00:07:49.705 18:54:06 -- common/autotest_common.sh@99 -- # export SPDK_TEST_RBD 00:07:49.705 18:54:06 -- common/autotest_common.sh@100 -- # : 0 00:07:49.705 18:54:06 -- common/autotest_common.sh@101 -- # export SPDK_TEST_VHOST 00:07:49.705 18:54:06 -- common/autotest_common.sh@102 -- # : 0 00:07:49.705 18:54:06 -- common/autotest_common.sh@103 -- # export SPDK_TEST_BLOCKDEV 00:07:49.705 18:54:06 -- common/autotest_common.sh@104 -- # : 0 00:07:49.705 18:54:06 -- common/autotest_common.sh@105 -- # export SPDK_TEST_IOAT 00:07:49.705 18:54:06 -- common/autotest_common.sh@106 -- # : 0 00:07:49.705 18:54:06 -- common/autotest_common.sh@107 -- # export SPDK_TEST_BLOBFS 00:07:49.705 18:54:06 -- common/autotest_common.sh@108 -- # : 0 00:07:49.705 18:54:06 -- common/autotest_common.sh@109 -- # export SPDK_TEST_VHOST_INIT 00:07:49.705 18:54:06 -- common/autotest_common.sh@110 -- # : 0 00:07:49.705 18:54:06 -- common/autotest_common.sh@111 -- # export SPDK_TEST_LVOL 00:07:49.705 18:54:06 -- common/autotest_common.sh@112 -- # : 0 00:07:49.705 18:54:06 -- common/autotest_common.sh@113 -- # export SPDK_TEST_VBDEV_COMPRESS 00:07:49.705 18:54:06 -- common/autotest_common.sh@114 -- # : 0 00:07:49.705 18:54:06 -- common/autotest_common.sh@115 -- # export SPDK_RUN_ASAN 00:07:49.705 18:54:06 -- common/autotest_common.sh@116 -- # : 1 00:07:49.705 18:54:06 -- common/autotest_common.sh@117 -- # export SPDK_RUN_UBSAN 00:07:49.705 18:54:06 -- common/autotest_common.sh@118 -- # : /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:07:49.705 18:54:06 -- common/autotest_common.sh@119 -- # export SPDK_RUN_EXTERNAL_DPDK 00:07:49.705 18:54:06 -- common/autotest_common.sh@120 -- # : 0 00:07:49.705 18:54:06 -- common/autotest_common.sh@121 -- # export SPDK_RUN_NON_ROOT 00:07:49.705 18:54:06 -- common/autotest_common.sh@122 -- # : 0 00:07:49.705 18:54:06 -- common/autotest_common.sh@123 -- # export SPDK_TEST_CRYPTO 00:07:49.705 18:54:06 -- common/autotest_common.sh@124 -- # : 0 00:07:49.706 18:54:06 -- common/autotest_common.sh@125 -- # export SPDK_TEST_FTL 00:07:49.706 18:54:06 -- common/autotest_common.sh@126 -- # : 0 00:07:49.706 18:54:06 -- common/autotest_common.sh@127 -- # export SPDK_TEST_OCF 00:07:49.706 18:54:06 -- common/autotest_common.sh@128 -- # : 0 00:07:49.706 18:54:06 -- common/autotest_common.sh@129 -- # export SPDK_TEST_VMD 00:07:49.706 18:54:06 -- common/autotest_common.sh@130 -- # : 0 00:07:49.706 18:54:06 -- common/autotest_common.sh@131 -- # export SPDK_TEST_OPAL 00:07:49.706 18:54:06 -- common/autotest_common.sh@132 -- # : v22.11.4 00:07:49.706 18:54:06 -- common/autotest_common.sh@133 -- # export SPDK_TEST_NATIVE_DPDK 00:07:49.706 18:54:06 -- common/autotest_common.sh@134 -- # : true 00:07:49.706 18:54:06 -- common/autotest_common.sh@135 -- # export SPDK_AUTOTEST_X 00:07:49.706 18:54:06 -- common/autotest_common.sh@136 -- # : 0 00:07:49.706 18:54:06 -- common/autotest_common.sh@137 -- # export SPDK_TEST_RAID5 00:07:49.706 18:54:06 -- common/autotest_common.sh@138 -- # : 0 00:07:49.706 18:54:06 -- common/autotest_common.sh@139 -- # export SPDK_TEST_URING 00:07:49.706 18:54:06 -- common/autotest_common.sh@140 -- # : 0 00:07:49.706 18:54:06 -- common/autotest_common.sh@141 -- # export SPDK_TEST_USDT 00:07:49.706 18:54:06 -- common/autotest_common.sh@142 -- # : 0 00:07:49.706 18:54:06 -- common/autotest_common.sh@143 -- # export SPDK_TEST_USE_IGB_UIO 00:07:49.706 18:54:06 -- common/autotest_common.sh@144 -- # : 0 00:07:49.706 18:54:06 -- common/autotest_common.sh@145 -- # export SPDK_TEST_SCHEDULER 00:07:49.706 18:54:06 -- common/autotest_common.sh@146 -- # : 0 00:07:49.706 18:54:06 -- common/autotest_common.sh@147 -- # export SPDK_TEST_SCANBUILD 00:07:49.706 18:54:06 -- common/autotest_common.sh@148 -- # : e810 00:07:49.706 18:54:06 -- common/autotest_common.sh@149 -- # export SPDK_TEST_NVMF_NICS 00:07:49.706 18:54:06 -- common/autotest_common.sh@150 -- # : 0 00:07:49.706 18:54:06 -- common/autotest_common.sh@151 -- # export SPDK_TEST_SMA 00:07:49.706 18:54:06 -- common/autotest_common.sh@152 -- # : 0 00:07:49.706 18:54:06 -- common/autotest_common.sh@153 -- # export SPDK_TEST_DAOS 00:07:49.706 18:54:06 -- common/autotest_common.sh@154 -- # : 0 00:07:49.706 18:54:06 -- common/autotest_common.sh@155 -- # export SPDK_TEST_XNVME 00:07:49.706 18:54:06 -- common/autotest_common.sh@156 -- # : 0 00:07:49.706 18:54:06 -- common/autotest_common.sh@157 -- # export SPDK_TEST_ACCEL_DSA 00:07:49.706 18:54:06 -- common/autotest_common.sh@158 -- # : 0 00:07:49.706 18:54:06 -- common/autotest_common.sh@159 -- # export SPDK_TEST_ACCEL_IAA 00:07:49.706 18:54:06 -- common/autotest_common.sh@160 -- # : 0 00:07:49.706 18:54:06 -- common/autotest_common.sh@161 -- # export SPDK_TEST_ACCEL_IOAT 00:07:49.706 18:54:06 -- common/autotest_common.sh@163 -- # : 00:07:49.706 18:54:06 -- common/autotest_common.sh@164 -- # export SPDK_TEST_FUZZER_TARGET 00:07:49.706 18:54:06 -- common/autotest_common.sh@165 -- # : 0 00:07:49.706 18:54:06 -- common/autotest_common.sh@166 -- # export SPDK_TEST_NVMF_MDNS 00:07:49.706 18:54:06 -- common/autotest_common.sh@167 -- # : 0 00:07:49.706 18:54:06 -- common/autotest_common.sh@168 -- # export SPDK_JSONRPC_GO_CLIENT 00:07:49.706 18:54:06 -- common/autotest_common.sh@171 -- # export SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:07:49.706 18:54:06 -- common/autotest_common.sh@171 -- # SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:07:49.706 18:54:06 -- common/autotest_common.sh@172 -- # export DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:07:49.706 18:54:06 -- common/autotest_common.sh@172 -- # DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:07:49.706 18:54:06 -- common/autotest_common.sh@173 -- # export VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:07:49.706 18:54:06 -- common/autotest_common.sh@173 -- # VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:07:49.706 18:54:06 -- common/autotest_common.sh@174 -- # export LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:07:49.706 18:54:06 -- common/autotest_common.sh@174 -- # LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:07:49.706 18:54:06 -- common/autotest_common.sh@177 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:07:49.706 18:54:06 -- common/autotest_common.sh@177 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:07:49.706 18:54:06 -- common/autotest_common.sh@181 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:07:49.706 18:54:06 -- common/autotest_common.sh@181 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:07:49.706 18:54:06 -- common/autotest_common.sh@185 -- # export PYTHONDONTWRITEBYTECODE=1 00:07:49.706 18:54:06 -- common/autotest_common.sh@185 -- # PYTHONDONTWRITEBYTECODE=1 00:07:49.706 18:54:06 -- common/autotest_common.sh@189 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:07:49.706 18:54:06 -- common/autotest_common.sh@189 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:07:49.706 18:54:06 -- common/autotest_common.sh@190 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:07:49.706 18:54:06 -- common/autotest_common.sh@190 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:07:49.706 18:54:06 -- common/autotest_common.sh@194 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:07:49.706 18:54:06 -- common/autotest_common.sh@195 -- # rm -rf /var/tmp/asan_suppression_file 00:07:49.706 18:54:06 -- common/autotest_common.sh@196 -- # cat 00:07:49.706 18:54:06 -- common/autotest_common.sh@222 -- # echo leak:libfuse3.so 00:07:49.706 18:54:06 -- common/autotest_common.sh@224 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:07:49.706 18:54:06 -- common/autotest_common.sh@224 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:07:49.706 18:54:06 -- common/autotest_common.sh@226 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:07:49.706 18:54:06 -- common/autotest_common.sh@226 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:07:49.706 18:54:06 -- common/autotest_common.sh@228 -- # '[' -z /var/spdk/dependencies ']' 00:07:49.706 18:54:06 -- common/autotest_common.sh@231 -- # export DEPENDENCY_DIR 00:07:49.706 18:54:06 -- common/autotest_common.sh@235 -- # export SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:07:49.706 18:54:06 -- common/autotest_common.sh@235 -- # SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:07:49.706 18:54:06 -- common/autotest_common.sh@236 -- # export SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:07:49.706 18:54:06 -- common/autotest_common.sh@236 -- # SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:07:49.707 18:54:06 -- common/autotest_common.sh@239 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:07:49.707 18:54:06 -- common/autotest_common.sh@239 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:07:49.707 18:54:06 -- common/autotest_common.sh@240 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:07:49.707 18:54:06 -- common/autotest_common.sh@240 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:07:49.707 18:54:06 -- common/autotest_common.sh@242 -- # export AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:07:49.707 18:54:06 -- common/autotest_common.sh@242 -- # AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:07:49.707 18:54:06 -- common/autotest_common.sh@245 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:07:49.707 18:54:06 -- common/autotest_common.sh@245 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:07:49.707 18:54:06 -- common/autotest_common.sh@247 -- # _LCOV_MAIN=0 00:07:49.707 18:54:06 -- common/autotest_common.sh@248 -- # _LCOV_LLVM=1 00:07:49.707 18:54:06 -- common/autotest_common.sh@249 -- # _LCOV= 00:07:49.707 18:54:06 -- common/autotest_common.sh@250 -- # [[ '' == *clang* ]] 00:07:49.707 18:54:06 -- common/autotest_common.sh@250 -- # [[ 0 -eq 1 ]] 00:07:49.707 18:54:06 -- common/autotest_common.sh@252 -- # _lcov_opt[_LCOV_LLVM]='--gcov-tool /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/fuzz/llvm/llvm-gcov.sh' 00:07:49.707 18:54:06 -- common/autotest_common.sh@253 -- # _lcov_opt[_LCOV_MAIN]= 00:07:49.707 18:54:06 -- common/autotest_common.sh@255 -- # lcov_opt= 00:07:49.707 18:54:06 -- common/autotest_common.sh@258 -- # '[' 0 -eq 0 ']' 00:07:49.707 18:54:06 -- common/autotest_common.sh@259 -- # export valgrind= 00:07:49.707 18:54:06 -- common/autotest_common.sh@259 -- # valgrind= 00:07:49.707 18:54:06 -- common/autotest_common.sh@265 -- # uname -s 00:07:49.707 18:54:06 -- common/autotest_common.sh@265 -- # '[' Linux = Linux ']' 00:07:49.707 18:54:06 -- common/autotest_common.sh@266 -- # HUGEMEM=4096 00:07:49.707 18:54:06 -- common/autotest_common.sh@267 -- # export CLEAR_HUGE=yes 00:07:49.707 18:54:06 -- common/autotest_common.sh@267 -- # CLEAR_HUGE=yes 00:07:49.707 18:54:06 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:07:49.707 18:54:06 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:07:49.707 18:54:06 -- common/autotest_common.sh@275 -- # MAKE=make 00:07:49.707 18:54:06 -- common/autotest_common.sh@276 -- # MAKEFLAGS=-j96 00:07:49.707 18:54:06 -- common/autotest_common.sh@292 -- # export HUGEMEM=4096 00:07:49.707 18:54:06 -- common/autotest_common.sh@292 -- # HUGEMEM=4096 00:07:49.707 18:54:06 -- common/autotest_common.sh@294 -- # '[' -z /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output ']' 00:07:49.707 18:54:06 -- common/autotest_common.sh@299 -- # NO_HUGE=() 00:07:49.707 18:54:06 -- common/autotest_common.sh@300 -- # TEST_MODE= 00:07:49.707 18:54:06 -- common/autotest_common.sh@301 -- # for i in "$@" 00:07:49.707 18:54:06 -- common/autotest_common.sh@302 -- # case "$i" in 00:07:49.707 18:54:06 -- common/autotest_common.sh@307 -- # TEST_TRANSPORT=tcp 00:07:49.707 18:54:06 -- common/autotest_common.sh@319 -- # [[ -z 2950227 ]] 00:07:49.707 18:54:06 -- common/autotest_common.sh@319 -- # kill -0 2950227 00:07:49.707 18:54:06 -- common/autotest_common.sh@1675 -- # set_test_storage 2147483648 00:07:49.707 18:54:06 -- common/autotest_common.sh@329 -- # [[ -v testdir ]] 00:07:49.707 18:54:06 -- common/autotest_common.sh@331 -- # local requested_size=2147483648 00:07:49.707 18:54:06 -- common/autotest_common.sh@332 -- # local mount target_dir 00:07:49.707 18:54:06 -- common/autotest_common.sh@334 -- # local -A mounts fss sizes avails uses 00:07:49.707 18:54:06 -- common/autotest_common.sh@335 -- # local source fs size avail mount use 00:07:49.707 18:54:06 -- common/autotest_common.sh@337 -- # local storage_fallback storage_candidates 00:07:49.707 18:54:06 -- common/autotest_common.sh@339 -- # mktemp -udt spdk.XXXXXX 00:07:49.707 18:54:06 -- common/autotest_common.sh@339 -- # storage_fallback=/tmp/spdk.qNHwc0 00:07:49.707 18:54:06 -- common/autotest_common.sh@344 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:07:49.707 18:54:06 -- common/autotest_common.sh@346 -- # [[ -n '' ]] 00:07:49.707 18:54:06 -- common/autotest_common.sh@351 -- # [[ -n '' ]] 00:07:49.707 18:54:06 -- common/autotest_common.sh@356 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target /tmp/spdk.qNHwc0/tests/target /tmp/spdk.qNHwc0 00:07:49.707 18:54:06 -- common/autotest_common.sh@359 -- # requested_size=2214592512 00:07:49.707 18:54:06 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:07:49.707 18:54:06 -- common/autotest_common.sh@328 -- # df -T 00:07:49.707 18:54:06 -- common/autotest_common.sh@328 -- # grep -v Filesystem 00:07:49.707 18:54:06 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_devtmpfs 00:07:49.707 18:54:06 -- common/autotest_common.sh@362 -- # fss["$mount"]=devtmpfs 00:07:49.707 18:54:06 -- common/autotest_common.sh@363 -- # avails["$mount"]=67108864 00:07:49.707 18:54:06 -- common/autotest_common.sh@363 -- # sizes["$mount"]=67108864 00:07:49.707 18:54:06 -- common/autotest_common.sh@364 -- # uses["$mount"]=0 00:07:49.707 18:54:06 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:07:49.707 18:54:06 -- common/autotest_common.sh@362 -- # mounts["$mount"]=/dev/pmem0 00:07:49.707 18:54:06 -- common/autotest_common.sh@362 -- # fss["$mount"]=ext2 00:07:49.707 18:54:06 -- common/autotest_common.sh@363 -- # avails["$mount"]=4096 00:07:49.707 18:54:06 -- common/autotest_common.sh@363 -- # sizes["$mount"]=5284429824 00:07:49.707 18:54:06 -- common/autotest_common.sh@364 -- # uses["$mount"]=5284425728 00:07:49.707 18:54:06 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:07:49.707 18:54:06 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_root 00:07:49.707 18:54:06 -- common/autotest_common.sh@362 -- # fss["$mount"]=overlay 00:07:49.707 18:54:06 -- common/autotest_common.sh@363 -- # avails["$mount"]=187946262528 00:07:49.707 18:54:06 -- common/autotest_common.sh@363 -- # sizes["$mount"]=195963961344 00:07:49.707 18:54:06 -- common/autotest_common.sh@364 -- # uses["$mount"]=8017698816 00:07:49.707 18:54:06 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:07:49.707 18:54:06 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:07:49.707 18:54:06 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:07:49.707 18:54:06 -- common/autotest_common.sh@363 -- # avails["$mount"]=97980723200 00:07:49.707 18:54:06 -- common/autotest_common.sh@363 -- # sizes["$mount"]=97981980672 00:07:49.707 18:54:06 -- common/autotest_common.sh@364 -- # uses["$mount"]=1257472 00:07:49.707 18:54:06 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:07:49.707 18:54:06 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:07:49.707 18:54:06 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:07:49.707 18:54:06 -- common/autotest_common.sh@363 -- # avails["$mount"]=39183396864 00:07:49.707 18:54:06 -- common/autotest_common.sh@363 -- # sizes["$mount"]=39192793088 00:07:49.707 18:54:06 -- common/autotest_common.sh@364 -- # uses["$mount"]=9396224 00:07:49.707 18:54:06 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:07:49.707 18:54:06 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:07:49.707 18:54:06 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:07:49.707 18:54:06 -- common/autotest_common.sh@363 -- # avails["$mount"]=97980739584 00:07:49.707 18:54:06 -- common/autotest_common.sh@363 -- # sizes["$mount"]=97981980672 00:07:49.707 18:54:06 -- common/autotest_common.sh@364 -- # uses["$mount"]=1241088 00:07:49.707 18:54:06 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:07:49.707 18:54:06 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:07:49.707 18:54:06 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:07:49.707 18:54:06 -- common/autotest_common.sh@363 -- # avails["$mount"]=19596382208 00:07:49.707 18:54:06 -- common/autotest_common.sh@363 -- # sizes["$mount"]=19596394496 00:07:49.707 18:54:06 -- common/autotest_common.sh@364 -- # uses["$mount"]=12288 00:07:49.707 18:54:06 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:07:49.707 18:54:06 -- common/autotest_common.sh@367 -- # printf '* Looking for test storage...\n' 00:07:49.707 * Looking for test storage... 00:07:49.707 18:54:06 -- common/autotest_common.sh@369 -- # local target_space new_size 00:07:49.707 18:54:06 -- common/autotest_common.sh@370 -- # for target_dir in "${storage_candidates[@]}" 00:07:49.707 18:54:06 -- common/autotest_common.sh@373 -- # df /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:49.707 18:54:06 -- common/autotest_common.sh@373 -- # awk '$1 !~ /Filesystem/{print $6}' 00:07:49.707 18:54:06 -- common/autotest_common.sh@373 -- # mount=/ 00:07:49.707 18:54:06 -- common/autotest_common.sh@375 -- # target_space=187946262528 00:07:49.707 18:54:06 -- common/autotest_common.sh@376 -- # (( target_space == 0 || target_space < requested_size )) 00:07:49.707 18:54:06 -- common/autotest_common.sh@379 -- # (( target_space >= requested_size )) 00:07:49.707 18:54:06 -- common/autotest_common.sh@381 -- # [[ overlay == tmpfs ]] 00:07:49.708 18:54:06 -- common/autotest_common.sh@381 -- # [[ overlay == ramfs ]] 00:07:49.708 18:54:06 -- common/autotest_common.sh@381 -- # [[ / == / ]] 00:07:49.708 18:54:06 -- common/autotest_common.sh@382 -- # new_size=10232291328 00:07:49.708 18:54:06 -- common/autotest_common.sh@383 -- # (( new_size * 100 / sizes[/] > 95 )) 00:07:49.708 18:54:06 -- common/autotest_common.sh@388 -- # export SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:49.708 18:54:06 -- common/autotest_common.sh@388 -- # SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:49.708 18:54:06 -- common/autotest_common.sh@389 -- # printf '* Found test storage at %s\n' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:49.708 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:49.708 18:54:06 -- common/autotest_common.sh@390 -- # return 0 00:07:49.708 18:54:06 -- common/autotest_common.sh@1677 -- # set -o errtrace 00:07:49.708 18:54:06 -- common/autotest_common.sh@1678 -- # shopt -s extdebug 00:07:49.708 18:54:06 -- common/autotest_common.sh@1679 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:07:49.708 18:54:06 -- common/autotest_common.sh@1681 -- # PS4=' \t -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:07:49.708 18:54:06 -- common/autotest_common.sh@1682 -- # true 00:07:49.708 18:54:06 -- common/autotest_common.sh@1684 -- # xtrace_fd 00:07:49.708 18:54:06 -- common/autotest_common.sh@25 -- # [[ -n 14 ]] 00:07:49.708 18:54:06 -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/14 ]] 00:07:49.708 18:54:06 -- common/autotest_common.sh@27 -- # exec 00:07:49.708 18:54:06 -- common/autotest_common.sh@29 -- # exec 00:07:49.708 18:54:06 -- common/autotest_common.sh@31 -- # xtrace_restore 00:07:49.708 18:54:06 -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:07:49.708 18:54:06 -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:07:49.708 18:54:06 -- common/autotest_common.sh@18 -- # set -x 00:07:49.708 18:54:06 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:49.708 18:54:06 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:49.708 18:54:06 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:49.708 18:54:06 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:49.708 18:54:06 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:49.708 18:54:06 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:49.708 18:54:06 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:49.708 18:54:06 -- scripts/common.sh@335 -- # IFS=.-: 00:07:49.708 18:54:06 -- scripts/common.sh@335 -- # read -ra ver1 00:07:49.708 18:54:06 -- scripts/common.sh@336 -- # IFS=.-: 00:07:49.708 18:54:06 -- scripts/common.sh@336 -- # read -ra ver2 00:07:49.708 18:54:06 -- scripts/common.sh@337 -- # local 'op=<' 00:07:49.708 18:54:06 -- scripts/common.sh@339 -- # ver1_l=2 00:07:49.708 18:54:06 -- scripts/common.sh@340 -- # ver2_l=1 00:07:49.708 18:54:06 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:49.708 18:54:06 -- scripts/common.sh@343 -- # case "$op" in 00:07:49.708 18:54:06 -- scripts/common.sh@344 -- # : 1 00:07:49.708 18:54:06 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:49.708 18:54:06 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:49.708 18:54:06 -- scripts/common.sh@364 -- # decimal 1 00:07:49.708 18:54:06 -- scripts/common.sh@352 -- # local d=1 00:07:49.708 18:54:06 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:49.708 18:54:06 -- scripts/common.sh@354 -- # echo 1 00:07:49.708 18:54:06 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:49.708 18:54:06 -- scripts/common.sh@365 -- # decimal 2 00:07:49.708 18:54:06 -- scripts/common.sh@352 -- # local d=2 00:07:49.708 18:54:06 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:49.708 18:54:06 -- scripts/common.sh@354 -- # echo 2 00:07:49.708 18:54:06 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:49.708 18:54:06 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:49.708 18:54:06 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:49.708 18:54:06 -- scripts/common.sh@367 -- # return 0 00:07:49.708 18:54:06 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:49.708 18:54:06 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:49.708 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:49.708 --rc genhtml_branch_coverage=1 00:07:49.708 --rc genhtml_function_coverage=1 00:07:49.708 --rc genhtml_legend=1 00:07:49.708 --rc geninfo_all_blocks=1 00:07:49.708 --rc geninfo_unexecuted_blocks=1 00:07:49.708 00:07:49.708 ' 00:07:49.708 18:54:06 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:49.708 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:49.708 --rc genhtml_branch_coverage=1 00:07:49.708 --rc genhtml_function_coverage=1 00:07:49.708 --rc genhtml_legend=1 00:07:49.708 --rc geninfo_all_blocks=1 00:07:49.708 --rc geninfo_unexecuted_blocks=1 00:07:49.708 00:07:49.708 ' 00:07:49.708 18:54:06 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:49.708 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:49.708 --rc genhtml_branch_coverage=1 00:07:49.708 --rc genhtml_function_coverage=1 00:07:49.708 --rc genhtml_legend=1 00:07:49.708 --rc geninfo_all_blocks=1 00:07:49.708 --rc geninfo_unexecuted_blocks=1 00:07:49.708 00:07:49.708 ' 00:07:49.708 18:54:06 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:49.708 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:49.708 --rc genhtml_branch_coverage=1 00:07:49.708 --rc genhtml_function_coverage=1 00:07:49.708 --rc genhtml_legend=1 00:07:49.708 --rc geninfo_all_blocks=1 00:07:49.708 --rc geninfo_unexecuted_blocks=1 00:07:49.708 00:07:49.708 ' 00:07:49.708 18:54:06 -- target/filesystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:49.708 18:54:06 -- nvmf/common.sh@7 -- # uname -s 00:07:49.708 18:54:06 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:49.708 18:54:06 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:49.708 18:54:06 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:49.708 18:54:06 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:49.708 18:54:06 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:49.708 18:54:06 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:49.708 18:54:06 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:49.708 18:54:06 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:49.708 18:54:06 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:49.968 18:54:06 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:49.968 18:54:06 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:07:49.968 18:54:06 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:07:49.968 18:54:06 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:49.968 18:54:06 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:49.968 18:54:06 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:49.968 18:54:06 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:49.968 18:54:06 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:49.968 18:54:06 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:49.968 18:54:06 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:49.968 18:54:06 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:49.968 18:54:06 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:49.968 18:54:06 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:49.968 18:54:06 -- paths/export.sh@5 -- # export PATH 00:07:49.968 18:54:06 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:49.968 18:54:06 -- nvmf/common.sh@46 -- # : 0 00:07:49.968 18:54:06 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:49.968 18:54:06 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:49.968 18:54:06 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:49.968 18:54:06 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:49.968 18:54:06 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:49.968 18:54:06 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:49.968 18:54:06 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:49.968 18:54:06 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:49.968 18:54:06 -- target/filesystem.sh@12 -- # MALLOC_BDEV_SIZE=512 00:07:49.968 18:54:06 -- target/filesystem.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:07:49.968 18:54:06 -- target/filesystem.sh@15 -- # nvmftestinit 00:07:49.968 18:54:06 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:49.968 18:54:06 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:49.968 18:54:06 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:49.968 18:54:06 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:49.968 18:54:06 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:49.968 18:54:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:49.968 18:54:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:49.968 18:54:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:49.968 18:54:06 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:49.968 18:54:06 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:49.968 18:54:06 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:49.968 18:54:06 -- common/autotest_common.sh@10 -- # set +x 00:07:55.240 18:54:11 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:55.240 18:54:11 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:55.240 18:54:11 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:55.240 18:54:11 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:55.240 18:54:11 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:55.240 18:54:11 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:55.240 18:54:11 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:55.240 18:54:11 -- nvmf/common.sh@294 -- # net_devs=() 00:07:55.240 18:54:11 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:55.240 18:54:11 -- nvmf/common.sh@295 -- # e810=() 00:07:55.240 18:54:11 -- nvmf/common.sh@295 -- # local -ga e810 00:07:55.240 18:54:11 -- nvmf/common.sh@296 -- # x722=() 00:07:55.240 18:54:11 -- nvmf/common.sh@296 -- # local -ga x722 00:07:55.240 18:54:11 -- nvmf/common.sh@297 -- # mlx=() 00:07:55.240 18:54:11 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:55.240 18:54:11 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:55.240 18:54:11 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:55.240 18:54:11 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:55.240 18:54:11 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:55.240 18:54:11 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:55.240 18:54:11 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:55.240 18:54:11 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:55.240 18:54:11 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:55.240 18:54:11 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:55.240 18:54:11 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:55.240 18:54:11 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:55.240 18:54:11 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:55.240 18:54:11 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:55.240 18:54:11 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:55.240 18:54:11 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:55.240 18:54:11 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:55.240 18:54:11 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:55.240 18:54:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:55.240 18:54:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:07:55.240 Found 0000:86:00.0 (0x8086 - 0x159b) 00:07:55.240 18:54:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:55.240 18:54:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:55.240 18:54:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:55.240 18:54:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:55.240 18:54:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:55.240 18:54:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:55.240 18:54:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:07:55.240 Found 0000:86:00.1 (0x8086 - 0x159b) 00:07:55.240 18:54:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:55.240 18:54:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:55.240 18:54:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:55.240 18:54:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:55.240 18:54:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:55.240 18:54:11 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:55.240 18:54:11 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:55.240 18:54:11 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:55.240 18:54:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:55.240 18:54:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:55.240 18:54:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:55.240 18:54:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:55.240 18:54:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:07:55.240 Found net devices under 0000:86:00.0: cvl_0_0 00:07:55.240 18:54:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:55.240 18:54:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:55.240 18:54:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:55.240 18:54:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:55.240 18:54:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:55.240 18:54:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:07:55.240 Found net devices under 0000:86:00.1: cvl_0_1 00:07:55.240 18:54:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:55.240 18:54:11 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:55.240 18:54:11 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:55.240 18:54:11 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:55.240 18:54:11 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:55.240 18:54:11 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:55.240 18:54:11 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:55.240 18:54:11 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:55.240 18:54:11 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:55.240 18:54:11 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:55.240 18:54:11 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:55.240 18:54:11 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:55.240 18:54:11 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:55.240 18:54:11 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:55.240 18:54:11 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:55.240 18:54:11 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:55.240 18:54:11 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:55.240 18:54:11 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:55.240 18:54:11 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:55.240 18:54:11 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:55.240 18:54:11 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:55.240 18:54:11 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:55.240 18:54:11 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:55.240 18:54:11 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:55.240 18:54:11 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:55.240 18:54:11 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:55.240 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:55.240 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.400 ms 00:07:55.240 00:07:55.240 --- 10.0.0.2 ping statistics --- 00:07:55.240 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:55.240 rtt min/avg/max/mdev = 0.400/0.400/0.400/0.000 ms 00:07:55.240 18:54:11 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:55.240 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:55.240 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.196 ms 00:07:55.240 00:07:55.240 --- 10.0.0.1 ping statistics --- 00:07:55.240 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:55.240 rtt min/avg/max/mdev = 0.196/0.196/0.196/0.000 ms 00:07:55.240 18:54:11 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:55.240 18:54:11 -- nvmf/common.sh@410 -- # return 0 00:07:55.240 18:54:11 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:55.240 18:54:11 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:55.240 18:54:11 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:55.240 18:54:11 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:55.240 18:54:11 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:55.240 18:54:11 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:55.240 18:54:11 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:55.240 18:54:12 -- target/filesystem.sh@105 -- # run_test nvmf_filesystem_no_in_capsule nvmf_filesystem_part 0 00:07:55.240 18:54:12 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:55.240 18:54:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:55.240 18:54:12 -- common/autotest_common.sh@10 -- # set +x 00:07:55.240 ************************************ 00:07:55.240 START TEST nvmf_filesystem_no_in_capsule 00:07:55.240 ************************************ 00:07:55.240 18:54:12 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 0 00:07:55.240 18:54:12 -- target/filesystem.sh@47 -- # in_capsule=0 00:07:55.240 18:54:12 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:07:55.240 18:54:12 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:55.240 18:54:12 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:55.240 18:54:12 -- common/autotest_common.sh@10 -- # set +x 00:07:55.240 18:54:12 -- nvmf/common.sh@469 -- # nvmfpid=2953670 00:07:55.240 18:54:12 -- nvmf/common.sh@470 -- # waitforlisten 2953670 00:07:55.240 18:54:12 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:55.240 18:54:12 -- common/autotest_common.sh@829 -- # '[' -z 2953670 ']' 00:07:55.240 18:54:12 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:55.240 18:54:12 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:55.240 18:54:12 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:55.240 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:55.240 18:54:12 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:55.240 18:54:12 -- common/autotest_common.sh@10 -- # set +x 00:07:55.240 [2024-11-26 18:54:12.065830] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:55.241 [2024-11-26 18:54:12.065874] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:55.241 EAL: No free 2048 kB hugepages reported on node 1 00:07:55.241 [2024-11-26 18:54:12.124036] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:55.499 [2024-11-26 18:54:12.166027] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:55.499 [2024-11-26 18:54:12.166134] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:55.499 [2024-11-26 18:54:12.166142] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:55.499 [2024-11-26 18:54:12.166149] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:55.499 [2024-11-26 18:54:12.166190] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:55.499 [2024-11-26 18:54:12.166295] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:55.499 [2024-11-26 18:54:12.166356] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:55.499 [2024-11-26 18:54:12.166356] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:56.067 18:54:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:56.067 18:54:12 -- common/autotest_common.sh@862 -- # return 0 00:07:56.067 18:54:12 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:56.067 18:54:12 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:56.067 18:54:12 -- common/autotest_common.sh@10 -- # set +x 00:07:56.067 18:54:12 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:56.067 18:54:12 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:07:56.067 18:54:12 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:07:56.067 18:54:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:56.067 18:54:12 -- common/autotest_common.sh@10 -- # set +x 00:07:56.067 [2024-11-26 18:54:12.936556] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:56.067 18:54:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:56.067 18:54:12 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:07:56.067 18:54:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:56.067 18:54:12 -- common/autotest_common.sh@10 -- # set +x 00:07:56.327 Malloc1 00:07:56.327 18:54:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:56.327 18:54:13 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:07:56.327 18:54:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:56.327 18:54:13 -- common/autotest_common.sh@10 -- # set +x 00:07:56.327 18:54:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:56.327 18:54:13 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:07:56.327 18:54:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:56.327 18:54:13 -- common/autotest_common.sh@10 -- # set +x 00:07:56.327 18:54:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:56.327 18:54:13 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:56.327 18:54:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:56.327 18:54:13 -- common/autotest_common.sh@10 -- # set +x 00:07:56.327 [2024-11-26 18:54:13.086995] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:56.327 18:54:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:56.327 18:54:13 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:07:56.327 18:54:13 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:07:56.327 18:54:13 -- common/autotest_common.sh@1368 -- # local bdev_info 00:07:56.327 18:54:13 -- common/autotest_common.sh@1369 -- # local bs 00:07:56.327 18:54:13 -- common/autotest_common.sh@1370 -- # local nb 00:07:56.327 18:54:13 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:07:56.327 18:54:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:56.327 18:54:13 -- common/autotest_common.sh@10 -- # set +x 00:07:56.327 18:54:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:56.327 18:54:13 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:07:56.327 { 00:07:56.327 "name": "Malloc1", 00:07:56.327 "aliases": [ 00:07:56.327 "4f9cfdbe-2e39-47fa-b8dd-f76b715c252b" 00:07:56.327 ], 00:07:56.327 "product_name": "Malloc disk", 00:07:56.327 "block_size": 512, 00:07:56.327 "num_blocks": 1048576, 00:07:56.327 "uuid": "4f9cfdbe-2e39-47fa-b8dd-f76b715c252b", 00:07:56.327 "assigned_rate_limits": { 00:07:56.327 "rw_ios_per_sec": 0, 00:07:56.327 "rw_mbytes_per_sec": 0, 00:07:56.327 "r_mbytes_per_sec": 0, 00:07:56.327 "w_mbytes_per_sec": 0 00:07:56.327 }, 00:07:56.327 "claimed": true, 00:07:56.327 "claim_type": "exclusive_write", 00:07:56.327 "zoned": false, 00:07:56.327 "supported_io_types": { 00:07:56.327 "read": true, 00:07:56.327 "write": true, 00:07:56.327 "unmap": true, 00:07:56.327 "write_zeroes": true, 00:07:56.327 "flush": true, 00:07:56.327 "reset": true, 00:07:56.327 "compare": false, 00:07:56.327 "compare_and_write": false, 00:07:56.327 "abort": true, 00:07:56.327 "nvme_admin": false, 00:07:56.327 "nvme_io": false 00:07:56.327 }, 00:07:56.327 "memory_domains": [ 00:07:56.327 { 00:07:56.327 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:07:56.327 "dma_device_type": 2 00:07:56.327 } 00:07:56.327 ], 00:07:56.327 "driver_specific": {} 00:07:56.327 } 00:07:56.327 ]' 00:07:56.327 18:54:13 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:07:56.327 18:54:13 -- common/autotest_common.sh@1372 -- # bs=512 00:07:56.327 18:54:13 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:07:56.327 18:54:13 -- common/autotest_common.sh@1373 -- # nb=1048576 00:07:56.327 18:54:13 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:07:56.327 18:54:13 -- common/autotest_common.sh@1377 -- # echo 512 00:07:56.327 18:54:13 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:07:56.327 18:54:13 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:07:57.705 18:54:14 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:07:57.705 18:54:14 -- common/autotest_common.sh@1187 -- # local i=0 00:07:57.705 18:54:14 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:07:57.705 18:54:14 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:07:57.705 18:54:14 -- common/autotest_common.sh@1194 -- # sleep 2 00:07:59.608 18:54:16 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:07:59.608 18:54:16 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:07:59.608 18:54:16 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:07:59.608 18:54:16 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:07:59.608 18:54:16 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:07:59.608 18:54:16 -- common/autotest_common.sh@1197 -- # return 0 00:07:59.608 18:54:16 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:07:59.608 18:54:16 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:07:59.608 18:54:16 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:07:59.608 18:54:16 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:07:59.608 18:54:16 -- setup/common.sh@76 -- # local dev=nvme0n1 00:07:59.608 18:54:16 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:07:59.608 18:54:16 -- setup/common.sh@80 -- # echo 536870912 00:07:59.608 18:54:16 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:07:59.608 18:54:16 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:07:59.608 18:54:16 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:07:59.608 18:54:16 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:07:59.866 18:54:16 -- target/filesystem.sh@69 -- # partprobe 00:08:00.432 18:54:17 -- target/filesystem.sh@70 -- # sleep 1 00:08:01.363 18:54:18 -- target/filesystem.sh@76 -- # '[' 0 -eq 0 ']' 00:08:01.363 18:54:18 -- target/filesystem.sh@77 -- # run_test filesystem_ext4 nvmf_filesystem_create ext4 nvme0n1 00:08:01.363 18:54:18 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:01.363 18:54:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:01.363 18:54:18 -- common/autotest_common.sh@10 -- # set +x 00:08:01.363 ************************************ 00:08:01.363 START TEST filesystem_ext4 00:08:01.363 ************************************ 00:08:01.363 18:54:18 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:08:01.363 18:54:18 -- target/filesystem.sh@18 -- # fstype=ext4 00:08:01.363 18:54:18 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:01.363 18:54:18 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:08:01.363 18:54:18 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:08:01.363 18:54:18 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:01.363 18:54:18 -- common/autotest_common.sh@914 -- # local i=0 00:08:01.363 18:54:18 -- common/autotest_common.sh@915 -- # local force 00:08:01.363 18:54:18 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:08:01.363 18:54:18 -- common/autotest_common.sh@918 -- # force=-F 00:08:01.363 18:54:18 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:08:01.363 mke2fs 1.47.0 (5-Feb-2023) 00:08:01.621 Discarding device blocks: 0/522240 done 00:08:01.621 Creating filesystem with 522240 1k blocks and 130560 inodes 00:08:01.621 Filesystem UUID: 8debfd01-fe43-4974-a4c0-10a25b6edd61 00:08:01.621 Superblock backups stored on blocks: 00:08:01.621 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:08:01.621 00:08:01.621 Allocating group tables: 0/64 done 00:08:01.621 Writing inode tables: 0/64 done 00:08:01.878 Creating journal (8192 blocks): done 00:08:04.192 Writing superblocks and filesystem accounting information: 0/64 done 00:08:04.192 00:08:04.192 18:54:20 -- common/autotest_common.sh@931 -- # return 0 00:08:04.192 18:54:20 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:09.468 18:54:26 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:09.468 18:54:26 -- target/filesystem.sh@25 -- # sync 00:08:09.468 18:54:26 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:09.468 18:54:26 -- target/filesystem.sh@27 -- # sync 00:08:09.468 18:54:26 -- target/filesystem.sh@29 -- # i=0 00:08:09.468 18:54:26 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:09.468 18:54:26 -- target/filesystem.sh@37 -- # kill -0 2953670 00:08:09.468 18:54:26 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:09.468 18:54:26 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:09.468 18:54:26 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:09.468 18:54:26 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:09.468 00:08:09.468 real 0m8.059s 00:08:09.468 user 0m0.026s 00:08:09.468 sys 0m0.074s 00:08:09.468 18:54:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:09.468 18:54:26 -- common/autotest_common.sh@10 -- # set +x 00:08:09.468 ************************************ 00:08:09.468 END TEST filesystem_ext4 00:08:09.468 ************************************ 00:08:09.468 18:54:26 -- target/filesystem.sh@78 -- # run_test filesystem_btrfs nvmf_filesystem_create btrfs nvme0n1 00:08:09.468 18:54:26 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:09.468 18:54:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:09.468 18:54:26 -- common/autotest_common.sh@10 -- # set +x 00:08:09.468 ************************************ 00:08:09.468 START TEST filesystem_btrfs 00:08:09.468 ************************************ 00:08:09.468 18:54:26 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:08:09.468 18:54:26 -- target/filesystem.sh@18 -- # fstype=btrfs 00:08:09.468 18:54:26 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:09.468 18:54:26 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:08:09.468 18:54:26 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:08:09.468 18:54:26 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:09.468 18:54:26 -- common/autotest_common.sh@914 -- # local i=0 00:08:09.468 18:54:26 -- common/autotest_common.sh@915 -- # local force 00:08:09.468 18:54:26 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:08:09.468 18:54:26 -- common/autotest_common.sh@920 -- # force=-f 00:08:09.468 18:54:26 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:08:10.037 btrfs-progs v6.8.1 00:08:10.037 See https://btrfs.readthedocs.io for more information. 00:08:10.037 00:08:10.037 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:08:10.037 NOTE: several default settings have changed in version 5.15, please make sure 00:08:10.037 this does not affect your deployments: 00:08:10.037 - DUP for metadata (-m dup) 00:08:10.037 - enabled no-holes (-O no-holes) 00:08:10.037 - enabled free-space-tree (-R free-space-tree) 00:08:10.037 00:08:10.037 Label: (null) 00:08:10.037 UUID: f942993a-0fd0-4d6d-bac9-2c6fa7cf6bb5 00:08:10.037 Node size: 16384 00:08:10.037 Sector size: 4096 (CPU page size: 4096) 00:08:10.037 Filesystem size: 510.00MiB 00:08:10.037 Block group profiles: 00:08:10.037 Data: single 8.00MiB 00:08:10.037 Metadata: DUP 32.00MiB 00:08:10.037 System: DUP 8.00MiB 00:08:10.037 SSD detected: yes 00:08:10.037 Zoned device: no 00:08:10.037 Features: extref, skinny-metadata, no-holes, free-space-tree 00:08:10.037 Checksum: crc32c 00:08:10.037 Number of devices: 1 00:08:10.037 Devices: 00:08:10.037 ID SIZE PATH 00:08:10.037 1 510.00MiB /dev/nvme0n1p1 00:08:10.037 00:08:10.037 18:54:26 -- common/autotest_common.sh@931 -- # return 0 00:08:10.037 18:54:26 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:10.976 18:54:27 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:10.976 18:54:27 -- target/filesystem.sh@25 -- # sync 00:08:10.976 18:54:27 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:10.976 18:54:27 -- target/filesystem.sh@27 -- # sync 00:08:10.976 18:54:27 -- target/filesystem.sh@29 -- # i=0 00:08:10.976 18:54:27 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:10.976 18:54:27 -- target/filesystem.sh@37 -- # kill -0 2953670 00:08:10.976 18:54:27 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:10.976 18:54:27 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:10.976 18:54:27 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:10.976 18:54:27 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:10.976 00:08:10.976 real 0m1.364s 00:08:10.976 user 0m0.029s 00:08:10.976 sys 0m0.113s 00:08:10.976 18:54:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:10.976 18:54:27 -- common/autotest_common.sh@10 -- # set +x 00:08:10.976 ************************************ 00:08:10.976 END TEST filesystem_btrfs 00:08:10.976 ************************************ 00:08:10.976 18:54:27 -- target/filesystem.sh@79 -- # run_test filesystem_xfs nvmf_filesystem_create xfs nvme0n1 00:08:10.976 18:54:27 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:10.976 18:54:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:10.976 18:54:27 -- common/autotest_common.sh@10 -- # set +x 00:08:10.976 ************************************ 00:08:10.976 START TEST filesystem_xfs 00:08:10.976 ************************************ 00:08:10.976 18:54:27 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:08:10.976 18:54:27 -- target/filesystem.sh@18 -- # fstype=xfs 00:08:10.976 18:54:27 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:10.976 18:54:27 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:08:10.976 18:54:27 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:08:10.976 18:54:27 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:10.976 18:54:27 -- common/autotest_common.sh@914 -- # local i=0 00:08:10.976 18:54:27 -- common/autotest_common.sh@915 -- # local force 00:08:10.976 18:54:27 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:08:10.976 18:54:27 -- common/autotest_common.sh@920 -- # force=-f 00:08:10.976 18:54:27 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:08:11.235 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:08:11.235 = sectsz=512 attr=2, projid32bit=1 00:08:11.235 = crc=1 finobt=1, sparse=1, rmapbt=0 00:08:11.235 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:08:11.235 data = bsize=4096 blocks=130560, imaxpct=25 00:08:11.236 = sunit=0 swidth=0 blks 00:08:11.236 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:08:11.236 log =internal log bsize=4096 blocks=16384, version=2 00:08:11.236 = sectsz=512 sunit=0 blks, lazy-count=1 00:08:11.236 realtime =none extsz=4096 blocks=0, rtextents=0 00:08:12.174 Discarding blocks...Done. 00:08:12.174 18:54:28 -- common/autotest_common.sh@931 -- # return 0 00:08:12.174 18:54:28 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:14.083 18:54:30 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:14.083 18:54:30 -- target/filesystem.sh@25 -- # sync 00:08:14.083 18:54:30 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:14.083 18:54:30 -- target/filesystem.sh@27 -- # sync 00:08:14.083 18:54:30 -- target/filesystem.sh@29 -- # i=0 00:08:14.083 18:54:30 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:14.083 18:54:30 -- target/filesystem.sh@37 -- # kill -0 2953670 00:08:14.083 18:54:30 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:14.083 18:54:30 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:14.083 18:54:30 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:14.083 18:54:30 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:14.083 00:08:14.083 real 0m3.081s 00:08:14.083 user 0m0.029s 00:08:14.083 sys 0m0.068s 00:08:14.083 18:54:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:14.083 18:54:30 -- common/autotest_common.sh@10 -- # set +x 00:08:14.083 ************************************ 00:08:14.083 END TEST filesystem_xfs 00:08:14.083 ************************************ 00:08:14.083 18:54:30 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:08:14.343 18:54:31 -- target/filesystem.sh@93 -- # sync 00:08:14.343 18:54:31 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:08:14.603 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:14.603 18:54:31 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:08:14.603 18:54:31 -- common/autotest_common.sh@1208 -- # local i=0 00:08:14.603 18:54:31 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:08:14.603 18:54:31 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:14.603 18:54:31 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:08:14.603 18:54:31 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:14.603 18:54:31 -- common/autotest_common.sh@1220 -- # return 0 00:08:14.603 18:54:31 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:14.603 18:54:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:14.603 18:54:31 -- common/autotest_common.sh@10 -- # set +x 00:08:14.603 18:54:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:14.603 18:54:31 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:08:14.603 18:54:31 -- target/filesystem.sh@101 -- # killprocess 2953670 00:08:14.603 18:54:31 -- common/autotest_common.sh@936 -- # '[' -z 2953670 ']' 00:08:14.603 18:54:31 -- common/autotest_common.sh@940 -- # kill -0 2953670 00:08:14.603 18:54:31 -- common/autotest_common.sh@941 -- # uname 00:08:14.603 18:54:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:14.603 18:54:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2953670 00:08:14.603 18:54:31 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:14.603 18:54:31 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:14.603 18:54:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2953670' 00:08:14.603 killing process with pid 2953670 00:08:14.603 18:54:31 -- common/autotest_common.sh@955 -- # kill 2953670 00:08:14.603 18:54:31 -- common/autotest_common.sh@960 -- # wait 2953670 00:08:14.862 18:54:31 -- target/filesystem.sh@102 -- # nvmfpid= 00:08:14.862 00:08:14.862 real 0m19.692s 00:08:14.862 user 1m17.642s 00:08:14.862 sys 0m1.476s 00:08:14.862 18:54:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:14.862 18:54:31 -- common/autotest_common.sh@10 -- # set +x 00:08:14.862 ************************************ 00:08:14.862 END TEST nvmf_filesystem_no_in_capsule 00:08:14.862 ************************************ 00:08:14.862 18:54:31 -- target/filesystem.sh@106 -- # run_test nvmf_filesystem_in_capsule nvmf_filesystem_part 4096 00:08:14.862 18:54:31 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:14.862 18:54:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:14.862 18:54:31 -- common/autotest_common.sh@10 -- # set +x 00:08:14.862 ************************************ 00:08:14.862 START TEST nvmf_filesystem_in_capsule 00:08:14.863 ************************************ 00:08:14.863 18:54:31 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 4096 00:08:14.863 18:54:31 -- target/filesystem.sh@47 -- # in_capsule=4096 00:08:14.863 18:54:31 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:08:14.863 18:54:31 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:14.863 18:54:31 -- common/autotest_common.sh@722 -- # xtrace_disable 00:08:14.863 18:54:31 -- common/autotest_common.sh@10 -- # set +x 00:08:14.863 18:54:31 -- nvmf/common.sh@469 -- # nvmfpid=2957187 00:08:14.863 18:54:31 -- nvmf/common.sh@470 -- # waitforlisten 2957187 00:08:14.863 18:54:31 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:14.863 18:54:31 -- common/autotest_common.sh@829 -- # '[' -z 2957187 ']' 00:08:14.863 18:54:31 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:14.863 18:54:31 -- common/autotest_common.sh@834 -- # local max_retries=100 00:08:14.863 18:54:31 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:14.863 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:14.863 18:54:31 -- common/autotest_common.sh@838 -- # xtrace_disable 00:08:14.863 18:54:31 -- common/autotest_common.sh@10 -- # set +x 00:08:15.122 [2024-11-26 18:54:31.806413] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:08:15.122 [2024-11-26 18:54:31.806461] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:15.122 EAL: No free 2048 kB hugepages reported on node 1 00:08:15.122 [2024-11-26 18:54:31.864328] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:15.122 [2024-11-26 18:54:31.904176] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:15.122 [2024-11-26 18:54:31.904298] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:15.122 [2024-11-26 18:54:31.904305] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:15.122 [2024-11-26 18:54:31.904311] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:15.122 [2024-11-26 18:54:31.904360] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:15.122 [2024-11-26 18:54:31.904471] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:15.122 [2024-11-26 18:54:31.904559] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:15.122 [2024-11-26 18:54:31.904560] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:16.061 18:54:32 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:08:16.061 18:54:32 -- common/autotest_common.sh@862 -- # return 0 00:08:16.061 18:54:32 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:08:16.061 18:54:32 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:16.061 18:54:32 -- common/autotest_common.sh@10 -- # set +x 00:08:16.061 18:54:32 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:16.061 18:54:32 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:08:16.061 18:54:32 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 4096 00:08:16.061 18:54:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:16.061 18:54:32 -- common/autotest_common.sh@10 -- # set +x 00:08:16.061 [2024-11-26 18:54:32.671414] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:16.061 18:54:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:16.061 18:54:32 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:08:16.061 18:54:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:16.061 18:54:32 -- common/autotest_common.sh@10 -- # set +x 00:08:16.061 Malloc1 00:08:16.061 18:54:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:16.061 18:54:32 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:08:16.061 18:54:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:16.061 18:54:32 -- common/autotest_common.sh@10 -- # set +x 00:08:16.061 18:54:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:16.061 18:54:32 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:08:16.061 18:54:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:16.061 18:54:32 -- common/autotest_common.sh@10 -- # set +x 00:08:16.061 18:54:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:16.061 18:54:32 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:16.061 18:54:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:16.061 18:54:32 -- common/autotest_common.sh@10 -- # set +x 00:08:16.061 [2024-11-26 18:54:32.812930] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:16.061 18:54:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:16.061 18:54:32 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:08:16.061 18:54:32 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:08:16.061 18:54:32 -- common/autotest_common.sh@1368 -- # local bdev_info 00:08:16.061 18:54:32 -- common/autotest_common.sh@1369 -- # local bs 00:08:16.061 18:54:32 -- common/autotest_common.sh@1370 -- # local nb 00:08:16.061 18:54:32 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:08:16.061 18:54:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:16.061 18:54:32 -- common/autotest_common.sh@10 -- # set +x 00:08:16.061 18:54:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:16.061 18:54:32 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:08:16.061 { 00:08:16.061 "name": "Malloc1", 00:08:16.061 "aliases": [ 00:08:16.061 "fe8f9e7f-5c24-4e67-826f-0a38822e4e84" 00:08:16.061 ], 00:08:16.061 "product_name": "Malloc disk", 00:08:16.061 "block_size": 512, 00:08:16.061 "num_blocks": 1048576, 00:08:16.061 "uuid": "fe8f9e7f-5c24-4e67-826f-0a38822e4e84", 00:08:16.061 "assigned_rate_limits": { 00:08:16.061 "rw_ios_per_sec": 0, 00:08:16.061 "rw_mbytes_per_sec": 0, 00:08:16.061 "r_mbytes_per_sec": 0, 00:08:16.061 "w_mbytes_per_sec": 0 00:08:16.061 }, 00:08:16.061 "claimed": true, 00:08:16.061 "claim_type": "exclusive_write", 00:08:16.061 "zoned": false, 00:08:16.061 "supported_io_types": { 00:08:16.061 "read": true, 00:08:16.061 "write": true, 00:08:16.061 "unmap": true, 00:08:16.061 "write_zeroes": true, 00:08:16.061 "flush": true, 00:08:16.061 "reset": true, 00:08:16.061 "compare": false, 00:08:16.061 "compare_and_write": false, 00:08:16.061 "abort": true, 00:08:16.061 "nvme_admin": false, 00:08:16.061 "nvme_io": false 00:08:16.061 }, 00:08:16.061 "memory_domains": [ 00:08:16.061 { 00:08:16.061 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:08:16.061 "dma_device_type": 2 00:08:16.061 } 00:08:16.061 ], 00:08:16.061 "driver_specific": {} 00:08:16.061 } 00:08:16.061 ]' 00:08:16.061 18:54:32 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:08:16.061 18:54:32 -- common/autotest_common.sh@1372 -- # bs=512 00:08:16.061 18:54:32 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:08:16.061 18:54:32 -- common/autotest_common.sh@1373 -- # nb=1048576 00:08:16.061 18:54:32 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:08:16.061 18:54:32 -- common/autotest_common.sh@1377 -- # echo 512 00:08:16.061 18:54:32 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:08:16.061 18:54:32 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:08:17.439 18:54:34 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:08:17.439 18:54:34 -- common/autotest_common.sh@1187 -- # local i=0 00:08:17.439 18:54:34 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:08:17.439 18:54:34 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:08:17.439 18:54:34 -- common/autotest_common.sh@1194 -- # sleep 2 00:08:19.346 18:54:36 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:08:19.346 18:54:36 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:08:19.346 18:54:36 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:08:19.346 18:54:36 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:08:19.346 18:54:36 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:08:19.346 18:54:36 -- common/autotest_common.sh@1197 -- # return 0 00:08:19.346 18:54:36 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:08:19.346 18:54:36 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:08:19.346 18:54:36 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:08:19.346 18:54:36 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:08:19.346 18:54:36 -- setup/common.sh@76 -- # local dev=nvme0n1 00:08:19.346 18:54:36 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:08:19.346 18:54:36 -- setup/common.sh@80 -- # echo 536870912 00:08:19.346 18:54:36 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:08:19.346 18:54:36 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:08:19.346 18:54:36 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:08:19.346 18:54:36 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:08:19.606 18:54:36 -- target/filesystem.sh@69 -- # partprobe 00:08:20.543 18:54:37 -- target/filesystem.sh@70 -- # sleep 1 00:08:21.481 18:54:38 -- target/filesystem.sh@76 -- # '[' 4096 -eq 0 ']' 00:08:21.481 18:54:38 -- target/filesystem.sh@81 -- # run_test filesystem_in_capsule_ext4 nvmf_filesystem_create ext4 nvme0n1 00:08:21.481 18:54:38 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:21.481 18:54:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:21.481 18:54:38 -- common/autotest_common.sh@10 -- # set +x 00:08:21.481 ************************************ 00:08:21.481 START TEST filesystem_in_capsule_ext4 00:08:21.481 ************************************ 00:08:21.481 18:54:38 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:08:21.481 18:54:38 -- target/filesystem.sh@18 -- # fstype=ext4 00:08:21.481 18:54:38 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:21.481 18:54:38 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:08:21.481 18:54:38 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:08:21.481 18:54:38 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:21.481 18:54:38 -- common/autotest_common.sh@914 -- # local i=0 00:08:21.481 18:54:38 -- common/autotest_common.sh@915 -- # local force 00:08:21.481 18:54:38 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:08:21.481 18:54:38 -- common/autotest_common.sh@918 -- # force=-F 00:08:21.481 18:54:38 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:08:21.481 mke2fs 1.47.0 (5-Feb-2023) 00:08:21.481 Discarding device blocks: 0/522240 done 00:08:21.481 Creating filesystem with 522240 1k blocks and 130560 inodes 00:08:21.481 Filesystem UUID: 5aeac8d2-e5e2-413b-9887-4675921c59de 00:08:21.481 Superblock backups stored on blocks: 00:08:21.481 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:08:21.481 00:08:21.481 Allocating group tables: 0/64 done 00:08:21.481 Writing inode tables: 0/64 done 00:08:21.481 Creating journal (8192 blocks): done 00:08:23.691 Writing superblocks and filesystem accounting information: 0/64 6/64 done 00:08:23.691 00:08:23.691 18:54:40 -- common/autotest_common.sh@931 -- # return 0 00:08:23.691 18:54:40 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:30.410 18:54:46 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:30.410 18:54:46 -- target/filesystem.sh@25 -- # sync 00:08:30.410 18:54:46 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:30.410 18:54:46 -- target/filesystem.sh@27 -- # sync 00:08:30.410 18:54:46 -- target/filesystem.sh@29 -- # i=0 00:08:30.410 18:54:46 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:30.410 18:54:46 -- target/filesystem.sh@37 -- # kill -0 2957187 00:08:30.410 18:54:46 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:30.410 18:54:46 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:30.410 18:54:46 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:30.410 18:54:46 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:30.410 00:08:30.410 real 0m8.484s 00:08:30.410 user 0m0.036s 00:08:30.410 sys 0m0.063s 00:08:30.410 18:54:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:30.410 18:54:46 -- common/autotest_common.sh@10 -- # set +x 00:08:30.410 ************************************ 00:08:30.410 END TEST filesystem_in_capsule_ext4 00:08:30.410 ************************************ 00:08:30.410 18:54:46 -- target/filesystem.sh@82 -- # run_test filesystem_in_capsule_btrfs nvmf_filesystem_create btrfs nvme0n1 00:08:30.410 18:54:46 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:30.410 18:54:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:30.410 18:54:46 -- common/autotest_common.sh@10 -- # set +x 00:08:30.410 ************************************ 00:08:30.410 START TEST filesystem_in_capsule_btrfs 00:08:30.410 ************************************ 00:08:30.410 18:54:46 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:08:30.410 18:54:46 -- target/filesystem.sh@18 -- # fstype=btrfs 00:08:30.410 18:54:46 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:30.410 18:54:46 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:08:30.410 18:54:46 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:08:30.410 18:54:46 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:30.410 18:54:46 -- common/autotest_common.sh@914 -- # local i=0 00:08:30.410 18:54:46 -- common/autotest_common.sh@915 -- # local force 00:08:30.410 18:54:46 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:08:30.410 18:54:46 -- common/autotest_common.sh@920 -- # force=-f 00:08:30.410 18:54:46 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:08:30.410 btrfs-progs v6.8.1 00:08:30.410 See https://btrfs.readthedocs.io for more information. 00:08:30.410 00:08:30.410 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:08:30.410 NOTE: several default settings have changed in version 5.15, please make sure 00:08:30.410 this does not affect your deployments: 00:08:30.410 - DUP for metadata (-m dup) 00:08:30.410 - enabled no-holes (-O no-holes) 00:08:30.410 - enabled free-space-tree (-R free-space-tree) 00:08:30.410 00:08:30.410 Label: (null) 00:08:30.410 UUID: 03871688-f02b-457a-8f02-65bce09d5b71 00:08:30.410 Node size: 16384 00:08:30.410 Sector size: 4096 (CPU page size: 4096) 00:08:30.410 Filesystem size: 510.00MiB 00:08:30.410 Block group profiles: 00:08:30.410 Data: single 8.00MiB 00:08:30.410 Metadata: DUP 32.00MiB 00:08:30.410 System: DUP 8.00MiB 00:08:30.410 SSD detected: yes 00:08:30.410 Zoned device: no 00:08:30.410 Features: extref, skinny-metadata, no-holes, free-space-tree 00:08:30.410 Checksum: crc32c 00:08:30.410 Number of devices: 1 00:08:30.410 Devices: 00:08:30.410 ID SIZE PATH 00:08:30.410 1 510.00MiB /dev/nvme0n1p1 00:08:30.410 00:08:30.410 18:54:47 -- common/autotest_common.sh@931 -- # return 0 00:08:30.410 18:54:47 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:30.979 18:54:47 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:30.979 18:54:47 -- target/filesystem.sh@25 -- # sync 00:08:30.979 18:54:47 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:30.979 18:54:47 -- target/filesystem.sh@27 -- # sync 00:08:30.979 18:54:47 -- target/filesystem.sh@29 -- # i=0 00:08:30.979 18:54:47 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:30.979 18:54:47 -- target/filesystem.sh@37 -- # kill -0 2957187 00:08:30.979 18:54:47 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:30.979 18:54:47 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:30.979 18:54:47 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:30.979 18:54:47 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:30.979 00:08:30.979 real 0m1.036s 00:08:30.979 user 0m0.025s 00:08:30.979 sys 0m0.118s 00:08:30.979 18:54:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:30.979 18:54:47 -- common/autotest_common.sh@10 -- # set +x 00:08:30.979 ************************************ 00:08:30.979 END TEST filesystem_in_capsule_btrfs 00:08:30.979 ************************************ 00:08:30.979 18:54:47 -- target/filesystem.sh@83 -- # run_test filesystem_in_capsule_xfs nvmf_filesystem_create xfs nvme0n1 00:08:30.979 18:54:47 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:30.979 18:54:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:30.979 18:54:47 -- common/autotest_common.sh@10 -- # set +x 00:08:30.979 ************************************ 00:08:30.979 START TEST filesystem_in_capsule_xfs 00:08:30.979 ************************************ 00:08:30.979 18:54:47 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:08:30.979 18:54:47 -- target/filesystem.sh@18 -- # fstype=xfs 00:08:30.979 18:54:47 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:30.979 18:54:47 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:08:30.979 18:54:47 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:08:30.979 18:54:47 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:30.979 18:54:47 -- common/autotest_common.sh@914 -- # local i=0 00:08:30.979 18:54:47 -- common/autotest_common.sh@915 -- # local force 00:08:30.979 18:54:47 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:08:30.979 18:54:47 -- common/autotest_common.sh@920 -- # force=-f 00:08:30.979 18:54:47 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:08:30.979 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:08:30.979 = sectsz=512 attr=2, projid32bit=1 00:08:30.979 = crc=1 finobt=1, sparse=1, rmapbt=0 00:08:30.979 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:08:30.979 data = bsize=4096 blocks=130560, imaxpct=25 00:08:30.979 = sunit=0 swidth=0 blks 00:08:30.979 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:08:30.979 log =internal log bsize=4096 blocks=16384, version=2 00:08:30.979 = sectsz=512 sunit=0 blks, lazy-count=1 00:08:30.979 realtime =none extsz=4096 blocks=0, rtextents=0 00:08:31.917 Discarding blocks...Done. 00:08:31.917 18:54:48 -- common/autotest_common.sh@931 -- # return 0 00:08:31.917 18:54:48 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:33.830 18:54:50 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:33.830 18:54:50 -- target/filesystem.sh@25 -- # sync 00:08:33.830 18:54:50 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:33.830 18:54:50 -- target/filesystem.sh@27 -- # sync 00:08:33.830 18:54:50 -- target/filesystem.sh@29 -- # i=0 00:08:33.830 18:54:50 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:33.830 18:54:50 -- target/filesystem.sh@37 -- # kill -0 2957187 00:08:33.830 18:54:50 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:33.830 18:54:50 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:33.830 18:54:50 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:33.830 18:54:50 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:33.830 00:08:33.830 real 0m2.961s 00:08:33.830 user 0m0.029s 00:08:33.830 sys 0m0.070s 00:08:33.830 18:54:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:33.830 18:54:50 -- common/autotest_common.sh@10 -- # set +x 00:08:33.830 ************************************ 00:08:33.830 END TEST filesystem_in_capsule_xfs 00:08:33.830 ************************************ 00:08:34.089 18:54:50 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:08:34.089 18:54:50 -- target/filesystem.sh@93 -- # sync 00:08:34.089 18:54:50 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:08:34.089 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:34.089 18:54:50 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:08:34.089 18:54:50 -- common/autotest_common.sh@1208 -- # local i=0 00:08:34.089 18:54:50 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:08:34.089 18:54:50 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:34.089 18:54:50 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:08:34.089 18:54:50 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:34.089 18:54:50 -- common/autotest_common.sh@1220 -- # return 0 00:08:34.089 18:54:50 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:34.089 18:54:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:34.089 18:54:50 -- common/autotest_common.sh@10 -- # set +x 00:08:34.089 18:54:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:34.089 18:54:50 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:08:34.089 18:54:50 -- target/filesystem.sh@101 -- # killprocess 2957187 00:08:34.089 18:54:50 -- common/autotest_common.sh@936 -- # '[' -z 2957187 ']' 00:08:34.089 18:54:50 -- common/autotest_common.sh@940 -- # kill -0 2957187 00:08:34.089 18:54:50 -- common/autotest_common.sh@941 -- # uname 00:08:34.089 18:54:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:34.089 18:54:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2957187 00:08:34.089 18:54:50 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:34.089 18:54:50 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:34.089 18:54:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2957187' 00:08:34.089 killing process with pid 2957187 00:08:34.089 18:54:50 -- common/autotest_common.sh@955 -- # kill 2957187 00:08:34.089 18:54:50 -- common/autotest_common.sh@960 -- # wait 2957187 00:08:34.658 18:54:51 -- target/filesystem.sh@102 -- # nvmfpid= 00:08:34.658 00:08:34.658 real 0m19.554s 00:08:34.658 user 1m17.066s 00:08:34.658 sys 0m1.491s 00:08:34.658 18:54:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:34.658 18:54:51 -- common/autotest_common.sh@10 -- # set +x 00:08:34.658 ************************************ 00:08:34.658 END TEST nvmf_filesystem_in_capsule 00:08:34.658 ************************************ 00:08:34.658 18:54:51 -- target/filesystem.sh@108 -- # nvmftestfini 00:08:34.658 18:54:51 -- nvmf/common.sh@476 -- # nvmfcleanup 00:08:34.658 18:54:51 -- nvmf/common.sh@116 -- # sync 00:08:34.658 18:54:51 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:08:34.658 18:54:51 -- nvmf/common.sh@119 -- # set +e 00:08:34.658 18:54:51 -- nvmf/common.sh@120 -- # for i in {1..20} 00:08:34.658 18:54:51 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:08:34.658 rmmod nvme_tcp 00:08:34.658 rmmod nvme_fabrics 00:08:34.658 rmmod nvme_keyring 00:08:34.658 18:54:51 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:08:34.658 18:54:51 -- nvmf/common.sh@123 -- # set -e 00:08:34.658 18:54:51 -- nvmf/common.sh@124 -- # return 0 00:08:34.658 18:54:51 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:08:34.658 18:54:51 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:08:34.658 18:54:51 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:08:34.658 18:54:51 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:08:34.658 18:54:51 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:08:34.658 18:54:51 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:08:34.658 18:54:51 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:34.658 18:54:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:34.658 18:54:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:36.564 18:54:53 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:08:36.564 00:08:36.564 real 0m47.216s 00:08:36.564 user 2m36.559s 00:08:36.564 sys 0m7.122s 00:08:36.564 18:54:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:36.564 18:54:53 -- common/autotest_common.sh@10 -- # set +x 00:08:36.564 ************************************ 00:08:36.564 END TEST nvmf_filesystem 00:08:36.564 ************************************ 00:08:36.824 18:54:53 -- nvmf/nvmf.sh@25 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:08:36.824 18:54:53 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:36.824 18:54:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:36.824 18:54:53 -- common/autotest_common.sh@10 -- # set +x 00:08:36.824 ************************************ 00:08:36.824 START TEST nvmf_discovery 00:08:36.824 ************************************ 00:08:36.824 18:54:53 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:08:36.824 * Looking for test storage... 00:08:36.824 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:36.824 18:54:53 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:36.824 18:54:53 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:36.824 18:54:53 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:36.824 18:54:53 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:36.824 18:54:53 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:36.824 18:54:53 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:36.824 18:54:53 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:36.824 18:54:53 -- scripts/common.sh@335 -- # IFS=.-: 00:08:36.824 18:54:53 -- scripts/common.sh@335 -- # read -ra ver1 00:08:36.824 18:54:53 -- scripts/common.sh@336 -- # IFS=.-: 00:08:36.824 18:54:53 -- scripts/common.sh@336 -- # read -ra ver2 00:08:36.824 18:54:53 -- scripts/common.sh@337 -- # local 'op=<' 00:08:36.824 18:54:53 -- scripts/common.sh@339 -- # ver1_l=2 00:08:36.824 18:54:53 -- scripts/common.sh@340 -- # ver2_l=1 00:08:36.824 18:54:53 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:36.824 18:54:53 -- scripts/common.sh@343 -- # case "$op" in 00:08:36.824 18:54:53 -- scripts/common.sh@344 -- # : 1 00:08:36.824 18:54:53 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:36.824 18:54:53 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:36.824 18:54:53 -- scripts/common.sh@364 -- # decimal 1 00:08:36.824 18:54:53 -- scripts/common.sh@352 -- # local d=1 00:08:36.824 18:54:53 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:36.824 18:54:53 -- scripts/common.sh@354 -- # echo 1 00:08:36.824 18:54:53 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:36.824 18:54:53 -- scripts/common.sh@365 -- # decimal 2 00:08:36.824 18:54:53 -- scripts/common.sh@352 -- # local d=2 00:08:36.824 18:54:53 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:36.824 18:54:53 -- scripts/common.sh@354 -- # echo 2 00:08:36.824 18:54:53 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:36.824 18:54:53 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:36.824 18:54:53 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:36.824 18:54:53 -- scripts/common.sh@367 -- # return 0 00:08:36.824 18:54:53 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:36.824 18:54:53 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:36.824 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:36.824 --rc genhtml_branch_coverage=1 00:08:36.824 --rc genhtml_function_coverage=1 00:08:36.824 --rc genhtml_legend=1 00:08:36.824 --rc geninfo_all_blocks=1 00:08:36.824 --rc geninfo_unexecuted_blocks=1 00:08:36.824 00:08:36.824 ' 00:08:36.824 18:54:53 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:36.824 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:36.824 --rc genhtml_branch_coverage=1 00:08:36.824 --rc genhtml_function_coverage=1 00:08:36.824 --rc genhtml_legend=1 00:08:36.824 --rc geninfo_all_blocks=1 00:08:36.824 --rc geninfo_unexecuted_blocks=1 00:08:36.824 00:08:36.824 ' 00:08:36.824 18:54:53 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:36.824 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:36.824 --rc genhtml_branch_coverage=1 00:08:36.824 --rc genhtml_function_coverage=1 00:08:36.824 --rc genhtml_legend=1 00:08:36.824 --rc geninfo_all_blocks=1 00:08:36.824 --rc geninfo_unexecuted_blocks=1 00:08:36.824 00:08:36.824 ' 00:08:36.824 18:54:53 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:36.824 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:36.824 --rc genhtml_branch_coverage=1 00:08:36.824 --rc genhtml_function_coverage=1 00:08:36.824 --rc genhtml_legend=1 00:08:36.824 --rc geninfo_all_blocks=1 00:08:36.824 --rc geninfo_unexecuted_blocks=1 00:08:36.824 00:08:36.824 ' 00:08:36.824 18:54:53 -- target/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:36.824 18:54:53 -- nvmf/common.sh@7 -- # uname -s 00:08:36.824 18:54:53 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:36.824 18:54:53 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:36.824 18:54:53 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:36.824 18:54:53 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:36.824 18:54:53 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:36.824 18:54:53 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:36.824 18:54:53 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:36.824 18:54:53 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:36.824 18:54:53 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:36.824 18:54:53 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:36.824 18:54:53 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:08:36.824 18:54:53 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:08:36.824 18:54:53 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:36.824 18:54:53 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:36.824 18:54:53 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:36.824 18:54:53 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:36.824 18:54:53 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:36.824 18:54:53 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:36.824 18:54:53 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:36.824 18:54:53 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:36.824 18:54:53 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:36.824 18:54:53 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:36.824 18:54:53 -- paths/export.sh@5 -- # export PATH 00:08:36.824 18:54:53 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:36.824 18:54:53 -- nvmf/common.sh@46 -- # : 0 00:08:36.824 18:54:53 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:08:36.824 18:54:53 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:08:36.824 18:54:53 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:08:36.824 18:54:53 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:36.824 18:54:53 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:36.824 18:54:53 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:08:36.824 18:54:53 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:08:36.824 18:54:53 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:08:36.824 18:54:53 -- target/discovery.sh@11 -- # NULL_BDEV_SIZE=102400 00:08:36.824 18:54:53 -- target/discovery.sh@12 -- # NULL_BLOCK_SIZE=512 00:08:36.824 18:54:53 -- target/discovery.sh@13 -- # NVMF_PORT_REFERRAL=4430 00:08:36.824 18:54:53 -- target/discovery.sh@15 -- # hash nvme 00:08:36.824 18:54:53 -- target/discovery.sh@20 -- # nvmftestinit 00:08:36.824 18:54:53 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:08:36.824 18:54:53 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:36.824 18:54:53 -- nvmf/common.sh@436 -- # prepare_net_devs 00:08:36.824 18:54:53 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:08:36.824 18:54:53 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:08:36.824 18:54:53 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:36.824 18:54:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:36.824 18:54:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:36.824 18:54:53 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:08:36.824 18:54:53 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:08:36.824 18:54:53 -- nvmf/common.sh@284 -- # xtrace_disable 00:08:36.824 18:54:53 -- common/autotest_common.sh@10 -- # set +x 00:08:43.397 18:54:59 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:43.397 18:54:59 -- nvmf/common.sh@290 -- # pci_devs=() 00:08:43.397 18:54:59 -- nvmf/common.sh@290 -- # local -a pci_devs 00:08:43.397 18:54:59 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:08:43.397 18:54:59 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:08:43.397 18:54:59 -- nvmf/common.sh@292 -- # pci_drivers=() 00:08:43.397 18:54:59 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:08:43.397 18:54:59 -- nvmf/common.sh@294 -- # net_devs=() 00:08:43.397 18:54:59 -- nvmf/common.sh@294 -- # local -ga net_devs 00:08:43.397 18:54:59 -- nvmf/common.sh@295 -- # e810=() 00:08:43.397 18:54:59 -- nvmf/common.sh@295 -- # local -ga e810 00:08:43.397 18:54:59 -- nvmf/common.sh@296 -- # x722=() 00:08:43.397 18:54:59 -- nvmf/common.sh@296 -- # local -ga x722 00:08:43.397 18:54:59 -- nvmf/common.sh@297 -- # mlx=() 00:08:43.397 18:54:59 -- nvmf/common.sh@297 -- # local -ga mlx 00:08:43.398 18:54:59 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:43.398 18:54:59 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:43.398 18:54:59 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:43.398 18:54:59 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:43.398 18:54:59 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:43.398 18:54:59 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:43.398 18:54:59 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:43.398 18:54:59 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:43.398 18:54:59 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:43.398 18:54:59 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:43.398 18:54:59 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:43.398 18:54:59 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:08:43.398 18:54:59 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:08:43.398 18:54:59 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:08:43.398 18:54:59 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:08:43.398 18:54:59 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:08:43.398 18:54:59 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:08:43.398 18:54:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:43.398 18:54:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:08:43.398 Found 0000:86:00.0 (0x8086 - 0x159b) 00:08:43.398 18:54:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:43.398 18:54:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:43.398 18:54:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:43.398 18:54:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:43.398 18:54:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:43.398 18:54:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:43.398 18:54:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:08:43.398 Found 0000:86:00.1 (0x8086 - 0x159b) 00:08:43.398 18:54:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:43.398 18:54:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:43.398 18:54:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:43.398 18:54:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:43.398 18:54:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:43.398 18:54:59 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:08:43.398 18:54:59 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:08:43.398 18:54:59 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:08:43.398 18:54:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:43.398 18:54:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:43.398 18:54:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:43.398 18:54:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:43.398 18:54:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:08:43.398 Found net devices under 0000:86:00.0: cvl_0_0 00:08:43.398 18:54:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:43.398 18:54:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:43.398 18:54:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:43.398 18:54:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:43.398 18:54:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:43.398 18:54:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:08:43.398 Found net devices under 0000:86:00.1: cvl_0_1 00:08:43.398 18:54:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:43.398 18:54:59 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:08:43.398 18:54:59 -- nvmf/common.sh@402 -- # is_hw=yes 00:08:43.398 18:54:59 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:08:43.398 18:54:59 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:08:43.398 18:54:59 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:08:43.398 18:54:59 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:43.398 18:54:59 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:08:43.398 18:54:59 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:08:43.398 18:54:59 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:08:43.398 18:54:59 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:08:43.398 18:54:59 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:08:43.398 18:54:59 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:08:43.398 18:54:59 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:08:43.398 18:54:59 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:43.398 18:54:59 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:08:43.398 18:54:59 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:08:43.398 18:54:59 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:08:43.398 18:54:59 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:08:43.398 18:54:59 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:08:43.398 18:54:59 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:08:43.398 18:54:59 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:08:43.398 18:54:59 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:08:43.398 18:54:59 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:08:43.398 18:54:59 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:08:43.398 18:54:59 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:08:43.398 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:43.398 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.205 ms 00:08:43.398 00:08:43.398 --- 10.0.0.2 ping statistics --- 00:08:43.398 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:43.398 rtt min/avg/max/mdev = 0.205/0.205/0.205/0.000 ms 00:08:43.398 18:54:59 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:08:43.398 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:43.398 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.195 ms 00:08:43.398 00:08:43.398 --- 10.0.0.1 ping statistics --- 00:08:43.398 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:43.398 rtt min/avg/max/mdev = 0.195/0.195/0.195/0.000 ms 00:08:43.398 18:54:59 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:43.398 18:54:59 -- nvmf/common.sh@410 -- # return 0 00:08:43.398 18:54:59 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:08:43.398 18:54:59 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:43.398 18:54:59 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:08:43.398 18:54:59 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:08:43.398 18:54:59 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:43.398 18:54:59 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:08:43.398 18:54:59 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:08:43.398 18:54:59 -- target/discovery.sh@21 -- # nvmfappstart -m 0xF 00:08:43.398 18:54:59 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:43.398 18:54:59 -- common/autotest_common.sh@722 -- # xtrace_disable 00:08:43.398 18:54:59 -- common/autotest_common.sh@10 -- # set +x 00:08:43.398 18:54:59 -- nvmf/common.sh@469 -- # nvmfpid=2964257 00:08:43.398 18:54:59 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:43.398 18:54:59 -- nvmf/common.sh@470 -- # waitforlisten 2964257 00:08:43.398 18:54:59 -- common/autotest_common.sh@829 -- # '[' -z 2964257 ']' 00:08:43.398 18:54:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:43.398 18:54:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:08:43.398 18:54:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:43.398 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:43.398 18:54:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:08:43.398 18:54:59 -- common/autotest_common.sh@10 -- # set +x 00:08:43.398 [2024-11-26 18:54:59.539241] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:08:43.399 [2024-11-26 18:54:59.539280] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:43.399 EAL: No free 2048 kB hugepages reported on node 1 00:08:43.399 [2024-11-26 18:54:59.597855] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:43.399 [2024-11-26 18:54:59.636401] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:43.399 [2024-11-26 18:54:59.636531] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:43.399 [2024-11-26 18:54:59.636539] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:43.399 [2024-11-26 18:54:59.636546] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:43.399 [2024-11-26 18:54:59.636656] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:43.399 [2024-11-26 18:54:59.636757] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:43.399 [2024-11-26 18:54:59.636831] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:43.399 [2024-11-26 18:54:59.636833] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:43.657 18:55:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:08:43.657 18:55:00 -- common/autotest_common.sh@862 -- # return 0 00:08:43.657 18:55:00 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:08:43.657 18:55:00 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:43.657 18:55:00 -- common/autotest_common.sh@10 -- # set +x 00:08:43.657 18:55:00 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:43.657 18:55:00 -- target/discovery.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:08:43.657 18:55:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:43.657 18:55:00 -- common/autotest_common.sh@10 -- # set +x 00:08:43.657 [2024-11-26 18:55:00.404396] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:43.657 18:55:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:43.657 18:55:00 -- target/discovery.sh@26 -- # seq 1 4 00:08:43.657 18:55:00 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:43.657 18:55:00 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null1 102400 512 00:08:43.657 18:55:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:43.657 18:55:00 -- common/autotest_common.sh@10 -- # set +x 00:08:43.657 Null1 00:08:43.657 18:55:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:43.657 18:55:00 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:08:43.657 18:55:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:43.657 18:55:00 -- common/autotest_common.sh@10 -- # set +x 00:08:43.657 18:55:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:43.657 18:55:00 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Null1 00:08:43.657 18:55:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:43.657 18:55:00 -- common/autotest_common.sh@10 -- # set +x 00:08:43.657 18:55:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:43.657 18:55:00 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:43.657 18:55:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:43.657 18:55:00 -- common/autotest_common.sh@10 -- # set +x 00:08:43.657 [2024-11-26 18:55:00.450062] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:43.657 18:55:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:43.657 18:55:00 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:43.657 18:55:00 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null2 102400 512 00:08:43.657 18:55:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:43.657 18:55:00 -- common/autotest_common.sh@10 -- # set +x 00:08:43.657 Null2 00:08:43.657 18:55:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:43.657 18:55:00 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:08:43.657 18:55:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:43.657 18:55:00 -- common/autotest_common.sh@10 -- # set +x 00:08:43.657 18:55:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:43.657 18:55:00 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Null2 00:08:43.657 18:55:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:43.657 18:55:00 -- common/autotest_common.sh@10 -- # set +x 00:08:43.657 18:55:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:43.657 18:55:00 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:08:43.657 18:55:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:43.657 18:55:00 -- common/autotest_common.sh@10 -- # set +x 00:08:43.657 18:55:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:43.657 18:55:00 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:43.657 18:55:00 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null3 102400 512 00:08:43.657 18:55:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:43.657 18:55:00 -- common/autotest_common.sh@10 -- # set +x 00:08:43.657 Null3 00:08:43.657 18:55:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:43.657 18:55:00 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:08:43.657 18:55:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:43.657 18:55:00 -- common/autotest_common.sh@10 -- # set +x 00:08:43.657 18:55:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:43.657 18:55:00 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Null3 00:08:43.657 18:55:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:43.657 18:55:00 -- common/autotest_common.sh@10 -- # set +x 00:08:43.657 18:55:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:43.657 18:55:00 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:08:43.657 18:55:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:43.657 18:55:00 -- common/autotest_common.sh@10 -- # set +x 00:08:43.658 18:55:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:43.658 18:55:00 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:43.658 18:55:00 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null4 102400 512 00:08:43.658 18:55:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:43.658 18:55:00 -- common/autotest_common.sh@10 -- # set +x 00:08:43.658 Null4 00:08:43.658 18:55:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:43.658 18:55:00 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:08:43.658 18:55:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:43.658 18:55:00 -- common/autotest_common.sh@10 -- # set +x 00:08:43.658 18:55:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:43.658 18:55:00 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Null4 00:08:43.658 18:55:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:43.658 18:55:00 -- common/autotest_common.sh@10 -- # set +x 00:08:43.658 18:55:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:43.658 18:55:00 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:08:43.658 18:55:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:43.658 18:55:00 -- common/autotest_common.sh@10 -- # set +x 00:08:43.658 18:55:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:43.658 18:55:00 -- target/discovery.sh@32 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:08:43.658 18:55:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:43.658 18:55:00 -- common/autotest_common.sh@10 -- # set +x 00:08:43.658 18:55:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:43.658 18:55:00 -- target/discovery.sh@35 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 10.0.0.2 -s 4430 00:08:43.658 18:55:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:43.658 18:55:00 -- common/autotest_common.sh@10 -- # set +x 00:08:43.658 18:55:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:43.658 18:55:00 -- target/discovery.sh@37 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -a 10.0.0.2 -s 4420 00:08:43.916 00:08:43.916 Discovery Log Number of Records 6, Generation counter 6 00:08:43.916 =====Discovery Log Entry 0====== 00:08:43.916 trtype: tcp 00:08:43.916 adrfam: ipv4 00:08:43.916 subtype: current discovery subsystem 00:08:43.916 treq: not required 00:08:43.916 portid: 0 00:08:43.916 trsvcid: 4420 00:08:43.916 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:08:43.916 traddr: 10.0.0.2 00:08:43.916 eflags: explicit discovery connections, duplicate discovery information 00:08:43.916 sectype: none 00:08:43.916 =====Discovery Log Entry 1====== 00:08:43.916 trtype: tcp 00:08:43.916 adrfam: ipv4 00:08:43.916 subtype: nvme subsystem 00:08:43.916 treq: not required 00:08:43.916 portid: 0 00:08:43.916 trsvcid: 4420 00:08:43.916 subnqn: nqn.2016-06.io.spdk:cnode1 00:08:43.916 traddr: 10.0.0.2 00:08:43.916 eflags: none 00:08:43.916 sectype: none 00:08:43.916 =====Discovery Log Entry 2====== 00:08:43.916 trtype: tcp 00:08:43.916 adrfam: ipv4 00:08:43.916 subtype: nvme subsystem 00:08:43.916 treq: not required 00:08:43.916 portid: 0 00:08:43.916 trsvcid: 4420 00:08:43.916 subnqn: nqn.2016-06.io.spdk:cnode2 00:08:43.916 traddr: 10.0.0.2 00:08:43.916 eflags: none 00:08:43.916 sectype: none 00:08:43.916 =====Discovery Log Entry 3====== 00:08:43.916 trtype: tcp 00:08:43.916 adrfam: ipv4 00:08:43.916 subtype: nvme subsystem 00:08:43.916 treq: not required 00:08:43.916 portid: 0 00:08:43.916 trsvcid: 4420 00:08:43.916 subnqn: nqn.2016-06.io.spdk:cnode3 00:08:43.916 traddr: 10.0.0.2 00:08:43.916 eflags: none 00:08:43.916 sectype: none 00:08:43.916 =====Discovery Log Entry 4====== 00:08:43.916 trtype: tcp 00:08:43.916 adrfam: ipv4 00:08:43.916 subtype: nvme subsystem 00:08:43.916 treq: not required 00:08:43.916 portid: 0 00:08:43.916 trsvcid: 4420 00:08:43.916 subnqn: nqn.2016-06.io.spdk:cnode4 00:08:43.916 traddr: 10.0.0.2 00:08:43.916 eflags: none 00:08:43.916 sectype: none 00:08:43.916 =====Discovery Log Entry 5====== 00:08:43.916 trtype: tcp 00:08:43.916 adrfam: ipv4 00:08:43.916 subtype: discovery subsystem referral 00:08:43.916 treq: not required 00:08:43.916 portid: 0 00:08:43.916 trsvcid: 4430 00:08:43.916 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:08:43.916 traddr: 10.0.0.2 00:08:43.916 eflags: none 00:08:43.916 sectype: none 00:08:43.916 18:55:00 -- target/discovery.sh@39 -- # echo 'Perform nvmf subsystem discovery via RPC' 00:08:43.916 Perform nvmf subsystem discovery via RPC 00:08:43.916 18:55:00 -- target/discovery.sh@40 -- # rpc_cmd nvmf_get_subsystems 00:08:43.916 18:55:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:43.916 18:55:00 -- common/autotest_common.sh@10 -- # set +x 00:08:43.916 [2024-11-26 18:55:00.746863] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:08:43.916 [ 00:08:43.916 { 00:08:43.916 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:08:43.916 "subtype": "Discovery", 00:08:43.916 "listen_addresses": [ 00:08:43.916 { 00:08:43.916 "transport": "TCP", 00:08:43.916 "trtype": "TCP", 00:08:43.916 "adrfam": "IPv4", 00:08:43.916 "traddr": "10.0.0.2", 00:08:43.916 "trsvcid": "4420" 00:08:43.916 } 00:08:43.916 ], 00:08:43.916 "allow_any_host": true, 00:08:43.916 "hosts": [] 00:08:43.916 }, 00:08:43.916 { 00:08:43.916 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:08:43.916 "subtype": "NVMe", 00:08:43.916 "listen_addresses": [ 00:08:43.916 { 00:08:43.916 "transport": "TCP", 00:08:43.916 "trtype": "TCP", 00:08:43.916 "adrfam": "IPv4", 00:08:43.916 "traddr": "10.0.0.2", 00:08:43.916 "trsvcid": "4420" 00:08:43.916 } 00:08:43.916 ], 00:08:43.916 "allow_any_host": true, 00:08:43.916 "hosts": [], 00:08:43.916 "serial_number": "SPDK00000000000001", 00:08:43.917 "model_number": "SPDK bdev Controller", 00:08:43.917 "max_namespaces": 32, 00:08:43.917 "min_cntlid": 1, 00:08:43.917 "max_cntlid": 65519, 00:08:43.917 "namespaces": [ 00:08:43.917 { 00:08:43.917 "nsid": 1, 00:08:43.917 "bdev_name": "Null1", 00:08:43.917 "name": "Null1", 00:08:43.917 "nguid": "44425EC04E824526A51CE6B7F24D3DF2", 00:08:43.917 "uuid": "44425ec0-4e82-4526-a51c-e6b7f24d3df2" 00:08:43.917 } 00:08:43.917 ] 00:08:43.917 }, 00:08:43.917 { 00:08:43.917 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:08:43.917 "subtype": "NVMe", 00:08:43.917 "listen_addresses": [ 00:08:43.917 { 00:08:43.917 "transport": "TCP", 00:08:43.917 "trtype": "TCP", 00:08:43.917 "adrfam": "IPv4", 00:08:43.917 "traddr": "10.0.0.2", 00:08:43.917 "trsvcid": "4420" 00:08:43.917 } 00:08:43.917 ], 00:08:43.917 "allow_any_host": true, 00:08:43.917 "hosts": [], 00:08:43.917 "serial_number": "SPDK00000000000002", 00:08:43.917 "model_number": "SPDK bdev Controller", 00:08:43.917 "max_namespaces": 32, 00:08:43.917 "min_cntlid": 1, 00:08:43.917 "max_cntlid": 65519, 00:08:43.917 "namespaces": [ 00:08:43.917 { 00:08:43.917 "nsid": 1, 00:08:43.917 "bdev_name": "Null2", 00:08:43.917 "name": "Null2", 00:08:43.917 "nguid": "FC3E03E132E8493FB0FBC7125CDED6F4", 00:08:43.917 "uuid": "fc3e03e1-32e8-493f-b0fb-c7125cded6f4" 00:08:43.917 } 00:08:43.917 ] 00:08:43.917 }, 00:08:43.917 { 00:08:43.917 "nqn": "nqn.2016-06.io.spdk:cnode3", 00:08:43.917 "subtype": "NVMe", 00:08:43.917 "listen_addresses": [ 00:08:43.917 { 00:08:43.917 "transport": "TCP", 00:08:43.917 "trtype": "TCP", 00:08:43.917 "adrfam": "IPv4", 00:08:43.917 "traddr": "10.0.0.2", 00:08:43.917 "trsvcid": "4420" 00:08:43.917 } 00:08:43.917 ], 00:08:43.917 "allow_any_host": true, 00:08:43.917 "hosts": [], 00:08:43.917 "serial_number": "SPDK00000000000003", 00:08:43.917 "model_number": "SPDK bdev Controller", 00:08:43.917 "max_namespaces": 32, 00:08:43.917 "min_cntlid": 1, 00:08:43.917 "max_cntlid": 65519, 00:08:43.917 "namespaces": [ 00:08:43.917 { 00:08:43.917 "nsid": 1, 00:08:43.917 "bdev_name": "Null3", 00:08:43.917 "name": "Null3", 00:08:43.917 "nguid": "E1B0332B43B640388804C41820A8EB7D", 00:08:43.917 "uuid": "e1b0332b-43b6-4038-8804-c41820a8eb7d" 00:08:43.917 } 00:08:43.917 ] 00:08:43.917 }, 00:08:43.917 { 00:08:43.917 "nqn": "nqn.2016-06.io.spdk:cnode4", 00:08:43.917 "subtype": "NVMe", 00:08:43.917 "listen_addresses": [ 00:08:43.917 { 00:08:43.917 "transport": "TCP", 00:08:43.917 "trtype": "TCP", 00:08:43.917 "adrfam": "IPv4", 00:08:43.917 "traddr": "10.0.0.2", 00:08:43.917 "trsvcid": "4420" 00:08:43.917 } 00:08:43.917 ], 00:08:43.917 "allow_any_host": true, 00:08:43.917 "hosts": [], 00:08:43.917 "serial_number": "SPDK00000000000004", 00:08:43.917 "model_number": "SPDK bdev Controller", 00:08:43.917 "max_namespaces": 32, 00:08:43.917 "min_cntlid": 1, 00:08:43.917 "max_cntlid": 65519, 00:08:43.917 "namespaces": [ 00:08:43.917 { 00:08:43.917 "nsid": 1, 00:08:43.917 "bdev_name": "Null4", 00:08:43.917 "name": "Null4", 00:08:43.917 "nguid": "BAEF0A18A3D0431DB0E0C52D6A1212D9", 00:08:43.917 "uuid": "baef0a18-a3d0-431d-b0e0-c52d6a1212d9" 00:08:43.917 } 00:08:43.917 ] 00:08:43.917 } 00:08:43.917 ] 00:08:43.917 18:55:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:43.917 18:55:00 -- target/discovery.sh@42 -- # seq 1 4 00:08:43.917 18:55:00 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:43.917 18:55:00 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:43.917 18:55:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:43.917 18:55:00 -- common/autotest_common.sh@10 -- # set +x 00:08:43.917 18:55:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:43.917 18:55:00 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null1 00:08:43.917 18:55:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:43.917 18:55:00 -- common/autotest_common.sh@10 -- # set +x 00:08:43.917 18:55:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:43.917 18:55:00 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:43.917 18:55:00 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:08:43.917 18:55:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:43.917 18:55:00 -- common/autotest_common.sh@10 -- # set +x 00:08:43.917 18:55:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:43.917 18:55:00 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null2 00:08:43.917 18:55:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:43.917 18:55:00 -- common/autotest_common.sh@10 -- # set +x 00:08:43.917 18:55:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:43.917 18:55:00 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:43.917 18:55:00 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:08:43.917 18:55:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:43.917 18:55:00 -- common/autotest_common.sh@10 -- # set +x 00:08:43.917 18:55:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:43.917 18:55:00 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null3 00:08:43.917 18:55:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:43.917 18:55:00 -- common/autotest_common.sh@10 -- # set +x 00:08:43.917 18:55:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:43.917 18:55:00 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:43.917 18:55:00 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:08:43.917 18:55:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:43.917 18:55:00 -- common/autotest_common.sh@10 -- # set +x 00:08:43.917 18:55:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:43.917 18:55:00 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null4 00:08:43.917 18:55:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:43.917 18:55:00 -- common/autotest_common.sh@10 -- # set +x 00:08:43.917 18:55:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:44.175 18:55:00 -- target/discovery.sh@47 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 10.0.0.2 -s 4430 00:08:44.175 18:55:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:44.175 18:55:00 -- common/autotest_common.sh@10 -- # set +x 00:08:44.175 18:55:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:44.175 18:55:00 -- target/discovery.sh@49 -- # rpc_cmd bdev_get_bdevs 00:08:44.175 18:55:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:44.175 18:55:00 -- target/discovery.sh@49 -- # jq -r '.[].name' 00:08:44.175 18:55:00 -- common/autotest_common.sh@10 -- # set +x 00:08:44.175 18:55:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:44.175 18:55:00 -- target/discovery.sh@49 -- # check_bdevs= 00:08:44.175 18:55:00 -- target/discovery.sh@50 -- # '[' -n '' ']' 00:08:44.175 18:55:00 -- target/discovery.sh@55 -- # trap - SIGINT SIGTERM EXIT 00:08:44.175 18:55:00 -- target/discovery.sh@57 -- # nvmftestfini 00:08:44.175 18:55:00 -- nvmf/common.sh@476 -- # nvmfcleanup 00:08:44.175 18:55:00 -- nvmf/common.sh@116 -- # sync 00:08:44.175 18:55:00 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:08:44.175 18:55:00 -- nvmf/common.sh@119 -- # set +e 00:08:44.175 18:55:00 -- nvmf/common.sh@120 -- # for i in {1..20} 00:08:44.175 18:55:00 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:08:44.175 rmmod nvme_tcp 00:08:44.175 rmmod nvme_fabrics 00:08:44.175 rmmod nvme_keyring 00:08:44.175 18:55:00 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:08:44.175 18:55:00 -- nvmf/common.sh@123 -- # set -e 00:08:44.175 18:55:00 -- nvmf/common.sh@124 -- # return 0 00:08:44.175 18:55:00 -- nvmf/common.sh@477 -- # '[' -n 2964257 ']' 00:08:44.175 18:55:00 -- nvmf/common.sh@478 -- # killprocess 2964257 00:08:44.175 18:55:00 -- common/autotest_common.sh@936 -- # '[' -z 2964257 ']' 00:08:44.175 18:55:00 -- common/autotest_common.sh@940 -- # kill -0 2964257 00:08:44.175 18:55:00 -- common/autotest_common.sh@941 -- # uname 00:08:44.175 18:55:00 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:44.175 18:55:00 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2964257 00:08:44.175 18:55:00 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:44.175 18:55:00 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:44.175 18:55:00 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2964257' 00:08:44.175 killing process with pid 2964257 00:08:44.175 18:55:00 -- common/autotest_common.sh@955 -- # kill 2964257 00:08:44.175 [2024-11-26 18:55:00.999219] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:08:44.175 18:55:00 -- common/autotest_common.sh@960 -- # wait 2964257 00:08:44.465 18:55:01 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:08:44.466 18:55:01 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:08:44.466 18:55:01 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:08:44.466 18:55:01 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:08:44.466 18:55:01 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:08:44.466 18:55:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:44.466 18:55:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:44.466 18:55:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:46.369 18:55:03 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:08:46.369 00:08:46.369 real 0m9.734s 00:08:46.369 user 0m7.990s 00:08:46.369 sys 0m4.706s 00:08:46.369 18:55:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:46.369 18:55:03 -- common/autotest_common.sh@10 -- # set +x 00:08:46.369 ************************************ 00:08:46.369 END TEST nvmf_discovery 00:08:46.369 ************************************ 00:08:46.369 18:55:03 -- nvmf/nvmf.sh@26 -- # run_test nvmf_referrals /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:08:46.369 18:55:03 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:46.369 18:55:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:46.369 18:55:03 -- common/autotest_common.sh@10 -- # set +x 00:08:46.369 ************************************ 00:08:46.369 START TEST nvmf_referrals 00:08:46.369 ************************************ 00:08:46.369 18:55:03 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:08:46.628 * Looking for test storage... 00:08:46.628 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:46.628 18:55:03 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:46.628 18:55:03 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:46.628 18:55:03 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:46.628 18:55:03 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:46.628 18:55:03 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:46.628 18:55:03 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:46.628 18:55:03 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:46.628 18:55:03 -- scripts/common.sh@335 -- # IFS=.-: 00:08:46.628 18:55:03 -- scripts/common.sh@335 -- # read -ra ver1 00:08:46.628 18:55:03 -- scripts/common.sh@336 -- # IFS=.-: 00:08:46.628 18:55:03 -- scripts/common.sh@336 -- # read -ra ver2 00:08:46.628 18:55:03 -- scripts/common.sh@337 -- # local 'op=<' 00:08:46.628 18:55:03 -- scripts/common.sh@339 -- # ver1_l=2 00:08:46.628 18:55:03 -- scripts/common.sh@340 -- # ver2_l=1 00:08:46.628 18:55:03 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:46.628 18:55:03 -- scripts/common.sh@343 -- # case "$op" in 00:08:46.628 18:55:03 -- scripts/common.sh@344 -- # : 1 00:08:46.628 18:55:03 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:46.628 18:55:03 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:46.628 18:55:03 -- scripts/common.sh@364 -- # decimal 1 00:08:46.628 18:55:03 -- scripts/common.sh@352 -- # local d=1 00:08:46.628 18:55:03 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:46.628 18:55:03 -- scripts/common.sh@354 -- # echo 1 00:08:46.628 18:55:03 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:46.628 18:55:03 -- scripts/common.sh@365 -- # decimal 2 00:08:46.628 18:55:03 -- scripts/common.sh@352 -- # local d=2 00:08:46.628 18:55:03 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:46.628 18:55:03 -- scripts/common.sh@354 -- # echo 2 00:08:46.628 18:55:03 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:46.628 18:55:03 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:46.628 18:55:03 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:46.628 18:55:03 -- scripts/common.sh@367 -- # return 0 00:08:46.628 18:55:03 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:46.629 18:55:03 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:46.629 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:46.629 --rc genhtml_branch_coverage=1 00:08:46.629 --rc genhtml_function_coverage=1 00:08:46.629 --rc genhtml_legend=1 00:08:46.629 --rc geninfo_all_blocks=1 00:08:46.629 --rc geninfo_unexecuted_blocks=1 00:08:46.629 00:08:46.629 ' 00:08:46.629 18:55:03 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:46.629 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:46.629 --rc genhtml_branch_coverage=1 00:08:46.629 --rc genhtml_function_coverage=1 00:08:46.629 --rc genhtml_legend=1 00:08:46.629 --rc geninfo_all_blocks=1 00:08:46.629 --rc geninfo_unexecuted_blocks=1 00:08:46.629 00:08:46.629 ' 00:08:46.629 18:55:03 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:46.629 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:46.629 --rc genhtml_branch_coverage=1 00:08:46.629 --rc genhtml_function_coverage=1 00:08:46.629 --rc genhtml_legend=1 00:08:46.629 --rc geninfo_all_blocks=1 00:08:46.629 --rc geninfo_unexecuted_blocks=1 00:08:46.629 00:08:46.629 ' 00:08:46.629 18:55:03 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:46.629 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:46.629 --rc genhtml_branch_coverage=1 00:08:46.629 --rc genhtml_function_coverage=1 00:08:46.629 --rc genhtml_legend=1 00:08:46.629 --rc geninfo_all_blocks=1 00:08:46.629 --rc geninfo_unexecuted_blocks=1 00:08:46.629 00:08:46.629 ' 00:08:46.629 18:55:03 -- target/referrals.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:46.629 18:55:03 -- nvmf/common.sh@7 -- # uname -s 00:08:46.629 18:55:03 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:46.629 18:55:03 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:46.629 18:55:03 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:46.629 18:55:03 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:46.629 18:55:03 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:46.629 18:55:03 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:46.629 18:55:03 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:46.629 18:55:03 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:46.629 18:55:03 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:46.629 18:55:03 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:46.629 18:55:03 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:08:46.629 18:55:03 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:08:46.629 18:55:03 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:46.629 18:55:03 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:46.629 18:55:03 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:46.629 18:55:03 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:46.629 18:55:03 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:46.629 18:55:03 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:46.629 18:55:03 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:46.629 18:55:03 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:46.629 18:55:03 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:46.629 18:55:03 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:46.629 18:55:03 -- paths/export.sh@5 -- # export PATH 00:08:46.629 18:55:03 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:46.629 18:55:03 -- nvmf/common.sh@46 -- # : 0 00:08:46.629 18:55:03 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:08:46.629 18:55:03 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:08:46.629 18:55:03 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:08:46.629 18:55:03 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:46.629 18:55:03 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:46.629 18:55:03 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:08:46.629 18:55:03 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:08:46.629 18:55:03 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:08:46.629 18:55:03 -- target/referrals.sh@11 -- # NVMF_REFERRAL_IP_1=127.0.0.2 00:08:46.629 18:55:03 -- target/referrals.sh@12 -- # NVMF_REFERRAL_IP_2=127.0.0.3 00:08:46.629 18:55:03 -- target/referrals.sh@13 -- # NVMF_REFERRAL_IP_3=127.0.0.4 00:08:46.629 18:55:03 -- target/referrals.sh@14 -- # NVMF_PORT_REFERRAL=4430 00:08:46.629 18:55:03 -- target/referrals.sh@15 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:08:46.629 18:55:03 -- target/referrals.sh@16 -- # NQN=nqn.2016-06.io.spdk:cnode1 00:08:46.629 18:55:03 -- target/referrals.sh@37 -- # nvmftestinit 00:08:46.629 18:55:03 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:08:46.629 18:55:03 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:46.629 18:55:03 -- nvmf/common.sh@436 -- # prepare_net_devs 00:08:46.629 18:55:03 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:08:46.629 18:55:03 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:08:46.629 18:55:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:46.629 18:55:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:46.629 18:55:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:46.629 18:55:03 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:08:46.629 18:55:03 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:08:46.629 18:55:03 -- nvmf/common.sh@284 -- # xtrace_disable 00:08:46.629 18:55:03 -- common/autotest_common.sh@10 -- # set +x 00:08:51.905 18:55:08 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:51.905 18:55:08 -- nvmf/common.sh@290 -- # pci_devs=() 00:08:51.905 18:55:08 -- nvmf/common.sh@290 -- # local -a pci_devs 00:08:51.905 18:55:08 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:08:51.905 18:55:08 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:08:51.905 18:55:08 -- nvmf/common.sh@292 -- # pci_drivers=() 00:08:51.905 18:55:08 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:08:51.905 18:55:08 -- nvmf/common.sh@294 -- # net_devs=() 00:08:51.905 18:55:08 -- nvmf/common.sh@294 -- # local -ga net_devs 00:08:51.905 18:55:08 -- nvmf/common.sh@295 -- # e810=() 00:08:51.905 18:55:08 -- nvmf/common.sh@295 -- # local -ga e810 00:08:51.905 18:55:08 -- nvmf/common.sh@296 -- # x722=() 00:08:51.905 18:55:08 -- nvmf/common.sh@296 -- # local -ga x722 00:08:51.905 18:55:08 -- nvmf/common.sh@297 -- # mlx=() 00:08:51.905 18:55:08 -- nvmf/common.sh@297 -- # local -ga mlx 00:08:51.905 18:55:08 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:51.905 18:55:08 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:51.905 18:55:08 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:51.905 18:55:08 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:51.905 18:55:08 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:51.905 18:55:08 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:51.905 18:55:08 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:51.905 18:55:08 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:51.905 18:55:08 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:51.905 18:55:08 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:51.906 18:55:08 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:51.906 18:55:08 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:08:51.906 18:55:08 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:08:51.906 18:55:08 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:08:51.906 18:55:08 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:08:51.906 18:55:08 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:08:51.906 18:55:08 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:08:51.906 18:55:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:51.906 18:55:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:08:51.906 Found 0000:86:00.0 (0x8086 - 0x159b) 00:08:51.906 18:55:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:51.906 18:55:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:51.906 18:55:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:51.906 18:55:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:51.906 18:55:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:51.906 18:55:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:51.906 18:55:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:08:51.906 Found 0000:86:00.1 (0x8086 - 0x159b) 00:08:51.906 18:55:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:51.906 18:55:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:51.906 18:55:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:51.906 18:55:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:51.906 18:55:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:51.906 18:55:08 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:08:51.906 18:55:08 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:08:51.906 18:55:08 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:08:51.906 18:55:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:51.906 18:55:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:51.906 18:55:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:51.906 18:55:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:51.906 18:55:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:08:51.906 Found net devices under 0000:86:00.0: cvl_0_0 00:08:51.906 18:55:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:51.906 18:55:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:51.906 18:55:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:51.906 18:55:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:51.906 18:55:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:51.906 18:55:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:08:51.906 Found net devices under 0000:86:00.1: cvl_0_1 00:08:51.906 18:55:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:51.906 18:55:08 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:08:51.906 18:55:08 -- nvmf/common.sh@402 -- # is_hw=yes 00:08:51.906 18:55:08 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:08:51.906 18:55:08 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:08:51.906 18:55:08 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:08:51.906 18:55:08 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:51.906 18:55:08 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:08:51.906 18:55:08 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:08:51.906 18:55:08 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:08:51.906 18:55:08 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:08:51.906 18:55:08 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:08:51.906 18:55:08 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:08:51.906 18:55:08 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:08:51.906 18:55:08 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:51.906 18:55:08 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:08:51.906 18:55:08 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:08:51.906 18:55:08 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:08:51.906 18:55:08 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:08:52.166 18:55:08 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:08:52.166 18:55:08 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:08:52.166 18:55:08 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:08:52.166 18:55:08 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:08:52.166 18:55:08 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:08:52.166 18:55:08 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:08:52.166 18:55:08 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:08:52.166 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:52.166 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.478 ms 00:08:52.166 00:08:52.166 --- 10.0.0.2 ping statistics --- 00:08:52.166 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:52.166 rtt min/avg/max/mdev = 0.478/0.478/0.478/0.000 ms 00:08:52.166 18:55:08 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:08:52.166 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:52.166 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.190 ms 00:08:52.166 00:08:52.166 --- 10.0.0.1 ping statistics --- 00:08:52.166 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:52.166 rtt min/avg/max/mdev = 0.190/0.190/0.190/0.000 ms 00:08:52.166 18:55:08 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:52.166 18:55:08 -- nvmf/common.sh@410 -- # return 0 00:08:52.166 18:55:08 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:08:52.166 18:55:08 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:52.166 18:55:08 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:08:52.166 18:55:08 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:08:52.166 18:55:08 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:52.166 18:55:08 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:08:52.166 18:55:08 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:08:52.166 18:55:08 -- target/referrals.sh@38 -- # nvmfappstart -m 0xF 00:08:52.166 18:55:08 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:52.166 18:55:08 -- common/autotest_common.sh@722 -- # xtrace_disable 00:08:52.166 18:55:08 -- common/autotest_common.sh@10 -- # set +x 00:08:52.166 18:55:09 -- nvmf/common.sh@469 -- # nvmfpid=2968063 00:08:52.166 18:55:09 -- nvmf/common.sh@470 -- # waitforlisten 2968063 00:08:52.166 18:55:09 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:52.166 18:55:09 -- common/autotest_common.sh@829 -- # '[' -z 2968063 ']' 00:08:52.166 18:55:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:52.166 18:55:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:08:52.166 18:55:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:52.166 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:52.166 18:55:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:08:52.166 18:55:09 -- common/autotest_common.sh@10 -- # set +x 00:08:52.166 [2024-11-26 18:55:09.051672] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:08:52.166 [2024-11-26 18:55:09.051716] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:52.166 EAL: No free 2048 kB hugepages reported on node 1 00:08:52.436 [2024-11-26 18:55:09.111229] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:52.436 [2024-11-26 18:55:09.151508] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:52.436 [2024-11-26 18:55:09.151624] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:52.436 [2024-11-26 18:55:09.151632] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:52.436 [2024-11-26 18:55:09.151639] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:52.436 [2024-11-26 18:55:09.151673] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:52.436 [2024-11-26 18:55:09.151689] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:52.436 [2024-11-26 18:55:09.151777] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:52.436 [2024-11-26 18:55:09.151778] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:53.004 18:55:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:08:53.004 18:55:09 -- common/autotest_common.sh@862 -- # return 0 00:08:53.004 18:55:09 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:08:53.004 18:55:09 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:53.004 18:55:09 -- common/autotest_common.sh@10 -- # set +x 00:08:53.004 18:55:09 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:53.004 18:55:09 -- target/referrals.sh@40 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:08:53.004 18:55:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:53.004 18:55:09 -- common/autotest_common.sh@10 -- # set +x 00:08:53.263 [2024-11-26 18:55:09.931450] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:53.263 18:55:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:53.263 18:55:09 -- target/referrals.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener -t tcp -a 10.0.0.2 -s 8009 discovery 00:08:53.263 18:55:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:53.263 18:55:09 -- common/autotest_common.sh@10 -- # set +x 00:08:53.263 [2024-11-26 18:55:09.944912] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:08:53.263 18:55:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:53.263 18:55:09 -- target/referrals.sh@44 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 00:08:53.263 18:55:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:53.263 18:55:09 -- common/autotest_common.sh@10 -- # set +x 00:08:53.263 18:55:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:53.263 18:55:09 -- target/referrals.sh@45 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.3 -s 4430 00:08:53.263 18:55:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:53.263 18:55:09 -- common/autotest_common.sh@10 -- # set +x 00:08:53.263 18:55:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:53.263 18:55:09 -- target/referrals.sh@46 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.4 -s 4430 00:08:53.263 18:55:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:53.263 18:55:09 -- common/autotest_common.sh@10 -- # set +x 00:08:53.263 18:55:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:53.263 18:55:09 -- target/referrals.sh@48 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:53.263 18:55:09 -- target/referrals.sh@48 -- # jq length 00:08:53.263 18:55:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:53.263 18:55:09 -- common/autotest_common.sh@10 -- # set +x 00:08:53.263 18:55:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:53.263 18:55:10 -- target/referrals.sh@48 -- # (( 3 == 3 )) 00:08:53.263 18:55:10 -- target/referrals.sh@49 -- # get_referral_ips rpc 00:08:53.263 18:55:10 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:08:53.263 18:55:10 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:53.263 18:55:10 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:08:53.263 18:55:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:53.263 18:55:10 -- target/referrals.sh@21 -- # sort 00:08:53.263 18:55:10 -- common/autotest_common.sh@10 -- # set +x 00:08:53.263 18:55:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:53.263 18:55:10 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:08:53.263 18:55:10 -- target/referrals.sh@49 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:08:53.263 18:55:10 -- target/referrals.sh@50 -- # get_referral_ips nvme 00:08:53.263 18:55:10 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:53.263 18:55:10 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:53.263 18:55:10 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:53.263 18:55:10 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:53.263 18:55:10 -- target/referrals.sh@26 -- # sort 00:08:53.522 18:55:10 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:08:53.522 18:55:10 -- target/referrals.sh@50 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:08:53.522 18:55:10 -- target/referrals.sh@52 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 00:08:53.522 18:55:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:53.522 18:55:10 -- common/autotest_common.sh@10 -- # set +x 00:08:53.522 18:55:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:53.522 18:55:10 -- target/referrals.sh@53 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.3 -s 4430 00:08:53.522 18:55:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:53.522 18:55:10 -- common/autotest_common.sh@10 -- # set +x 00:08:53.522 18:55:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:53.522 18:55:10 -- target/referrals.sh@54 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.4 -s 4430 00:08:53.522 18:55:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:53.522 18:55:10 -- common/autotest_common.sh@10 -- # set +x 00:08:53.522 18:55:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:53.522 18:55:10 -- target/referrals.sh@56 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:53.522 18:55:10 -- target/referrals.sh@56 -- # jq length 00:08:53.522 18:55:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:53.522 18:55:10 -- common/autotest_common.sh@10 -- # set +x 00:08:53.522 18:55:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:53.522 18:55:10 -- target/referrals.sh@56 -- # (( 0 == 0 )) 00:08:53.522 18:55:10 -- target/referrals.sh@57 -- # get_referral_ips nvme 00:08:53.522 18:55:10 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:53.522 18:55:10 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:53.522 18:55:10 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:53.522 18:55:10 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:53.522 18:55:10 -- target/referrals.sh@26 -- # sort 00:08:53.779 18:55:10 -- target/referrals.sh@26 -- # echo 00:08:53.779 18:55:10 -- target/referrals.sh@57 -- # [[ '' == '' ]] 00:08:53.779 18:55:10 -- target/referrals.sh@60 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n discovery 00:08:53.779 18:55:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:53.780 18:55:10 -- common/autotest_common.sh@10 -- # set +x 00:08:53.780 18:55:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:53.780 18:55:10 -- target/referrals.sh@62 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:08:53.780 18:55:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:53.780 18:55:10 -- common/autotest_common.sh@10 -- # set +x 00:08:53.780 18:55:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:53.780 18:55:10 -- target/referrals.sh@65 -- # get_referral_ips rpc 00:08:53.780 18:55:10 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:08:53.780 18:55:10 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:53.780 18:55:10 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:08:53.780 18:55:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:53.780 18:55:10 -- target/referrals.sh@21 -- # sort 00:08:53.780 18:55:10 -- common/autotest_common.sh@10 -- # set +x 00:08:53.780 18:55:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:53.780 18:55:10 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.2 00:08:53.780 18:55:10 -- target/referrals.sh@65 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:08:53.780 18:55:10 -- target/referrals.sh@66 -- # get_referral_ips nvme 00:08:53.780 18:55:10 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:53.780 18:55:10 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:53.780 18:55:10 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:53.780 18:55:10 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:53.780 18:55:10 -- target/referrals.sh@26 -- # sort 00:08:54.037 18:55:10 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.2 00:08:54.037 18:55:10 -- target/referrals.sh@66 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:08:54.037 18:55:10 -- target/referrals.sh@67 -- # get_discovery_entries 'nvme subsystem' 00:08:54.037 18:55:10 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:08:54.037 18:55:10 -- target/referrals.sh@67 -- # jq -r .subnqn 00:08:54.037 18:55:10 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:54.037 18:55:10 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:08:54.037 18:55:10 -- target/referrals.sh@67 -- # [[ nqn.2016-06.io.spdk:cnode1 == \n\q\n\.\2\0\1\6\-\0\6\.\i\o\.\s\p\d\k\:\c\n\o\d\e\1 ]] 00:08:54.296 18:55:10 -- target/referrals.sh@68 -- # get_discovery_entries 'discovery subsystem referral' 00:08:54.296 18:55:10 -- target/referrals.sh@68 -- # jq -r .subnqn 00:08:54.296 18:55:10 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:08:54.296 18:55:10 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:54.296 18:55:10 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:08:54.296 18:55:11 -- target/referrals.sh@68 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:08:54.296 18:55:11 -- target/referrals.sh@71 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:08:54.296 18:55:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:54.296 18:55:11 -- common/autotest_common.sh@10 -- # set +x 00:08:54.296 18:55:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:54.296 18:55:11 -- target/referrals.sh@73 -- # get_referral_ips rpc 00:08:54.296 18:55:11 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:08:54.296 18:55:11 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:08:54.296 18:55:11 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:54.296 18:55:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:54.296 18:55:11 -- target/referrals.sh@21 -- # sort 00:08:54.296 18:55:11 -- common/autotest_common.sh@10 -- # set +x 00:08:54.296 18:55:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:54.555 18:55:11 -- target/referrals.sh@21 -- # echo 127.0.0.2 00:08:54.555 18:55:11 -- target/referrals.sh@73 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:08:54.555 18:55:11 -- target/referrals.sh@74 -- # get_referral_ips nvme 00:08:54.555 18:55:11 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:54.555 18:55:11 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:54.555 18:55:11 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:54.555 18:55:11 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:54.556 18:55:11 -- target/referrals.sh@26 -- # sort 00:08:54.556 18:55:11 -- target/referrals.sh@26 -- # echo 127.0.0.2 00:08:54.556 18:55:11 -- target/referrals.sh@74 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:08:54.556 18:55:11 -- target/referrals.sh@75 -- # get_discovery_entries 'nvme subsystem' 00:08:54.556 18:55:11 -- target/referrals.sh@75 -- # jq -r .subnqn 00:08:54.556 18:55:11 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:08:54.556 18:55:11 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:54.556 18:55:11 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:08:54.815 18:55:11 -- target/referrals.sh@75 -- # [[ '' == '' ]] 00:08:54.815 18:55:11 -- target/referrals.sh@76 -- # get_discovery_entries 'discovery subsystem referral' 00:08:54.815 18:55:11 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:08:54.815 18:55:11 -- target/referrals.sh@76 -- # jq -r .subnqn 00:08:54.815 18:55:11 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:54.815 18:55:11 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:08:55.074 18:55:11 -- target/referrals.sh@76 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:08:55.074 18:55:11 -- target/referrals.sh@79 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2014-08.org.nvmexpress.discovery 00:08:55.074 18:55:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:55.074 18:55:11 -- common/autotest_common.sh@10 -- # set +x 00:08:55.074 18:55:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:55.074 18:55:11 -- target/referrals.sh@82 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:55.074 18:55:11 -- target/referrals.sh@82 -- # jq length 00:08:55.074 18:55:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:55.074 18:55:11 -- common/autotest_common.sh@10 -- # set +x 00:08:55.074 18:55:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:55.074 18:55:11 -- target/referrals.sh@82 -- # (( 0 == 0 )) 00:08:55.074 18:55:11 -- target/referrals.sh@83 -- # get_referral_ips nvme 00:08:55.074 18:55:11 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:55.074 18:55:11 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:55.074 18:55:11 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:55.074 18:55:11 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:55.074 18:55:11 -- target/referrals.sh@26 -- # sort 00:08:55.332 18:55:12 -- target/referrals.sh@26 -- # echo 00:08:55.332 18:55:12 -- target/referrals.sh@83 -- # [[ '' == '' ]] 00:08:55.332 18:55:12 -- target/referrals.sh@85 -- # trap - SIGINT SIGTERM EXIT 00:08:55.332 18:55:12 -- target/referrals.sh@86 -- # nvmftestfini 00:08:55.332 18:55:12 -- nvmf/common.sh@476 -- # nvmfcleanup 00:08:55.332 18:55:12 -- nvmf/common.sh@116 -- # sync 00:08:55.332 18:55:12 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:08:55.332 18:55:12 -- nvmf/common.sh@119 -- # set +e 00:08:55.332 18:55:12 -- nvmf/common.sh@120 -- # for i in {1..20} 00:08:55.332 18:55:12 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:08:55.332 rmmod nvme_tcp 00:08:55.332 rmmod nvme_fabrics 00:08:55.332 rmmod nvme_keyring 00:08:55.332 18:55:12 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:08:55.332 18:55:12 -- nvmf/common.sh@123 -- # set -e 00:08:55.332 18:55:12 -- nvmf/common.sh@124 -- # return 0 00:08:55.332 18:55:12 -- nvmf/common.sh@477 -- # '[' -n 2968063 ']' 00:08:55.332 18:55:12 -- nvmf/common.sh@478 -- # killprocess 2968063 00:08:55.332 18:55:12 -- common/autotest_common.sh@936 -- # '[' -z 2968063 ']' 00:08:55.332 18:55:12 -- common/autotest_common.sh@940 -- # kill -0 2968063 00:08:55.332 18:55:12 -- common/autotest_common.sh@941 -- # uname 00:08:55.332 18:55:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:55.332 18:55:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2968063 00:08:55.332 18:55:12 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:55.332 18:55:12 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:55.332 18:55:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2968063' 00:08:55.332 killing process with pid 2968063 00:08:55.332 18:55:12 -- common/autotest_common.sh@955 -- # kill 2968063 00:08:55.332 18:55:12 -- common/autotest_common.sh@960 -- # wait 2968063 00:08:55.590 18:55:12 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:08:55.590 18:55:12 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:08:55.590 18:55:12 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:08:55.590 18:55:12 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:08:55.590 18:55:12 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:08:55.590 18:55:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:55.590 18:55:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:55.590 18:55:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:57.496 18:55:14 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:08:57.496 00:08:57.496 real 0m11.136s 00:08:57.496 user 0m15.323s 00:08:57.496 sys 0m4.845s 00:08:57.756 18:55:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:57.756 18:55:14 -- common/autotest_common.sh@10 -- # set +x 00:08:57.756 ************************************ 00:08:57.756 END TEST nvmf_referrals 00:08:57.756 ************************************ 00:08:57.756 18:55:14 -- nvmf/nvmf.sh@27 -- # run_test nvmf_connect_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:08:57.756 18:55:14 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:57.756 18:55:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:57.756 18:55:14 -- common/autotest_common.sh@10 -- # set +x 00:08:57.756 ************************************ 00:08:57.756 START TEST nvmf_connect_disconnect 00:08:57.756 ************************************ 00:08:57.756 18:55:14 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:08:57.756 * Looking for test storage... 00:08:57.756 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:57.756 18:55:14 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:57.756 18:55:14 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:57.756 18:55:14 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:57.756 18:55:14 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:57.756 18:55:14 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:57.756 18:55:14 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:57.756 18:55:14 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:57.756 18:55:14 -- scripts/common.sh@335 -- # IFS=.-: 00:08:57.756 18:55:14 -- scripts/common.sh@335 -- # read -ra ver1 00:08:57.756 18:55:14 -- scripts/common.sh@336 -- # IFS=.-: 00:08:57.756 18:55:14 -- scripts/common.sh@336 -- # read -ra ver2 00:08:57.756 18:55:14 -- scripts/common.sh@337 -- # local 'op=<' 00:08:57.756 18:55:14 -- scripts/common.sh@339 -- # ver1_l=2 00:08:57.756 18:55:14 -- scripts/common.sh@340 -- # ver2_l=1 00:08:57.756 18:55:14 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:57.756 18:55:14 -- scripts/common.sh@343 -- # case "$op" in 00:08:57.756 18:55:14 -- scripts/common.sh@344 -- # : 1 00:08:57.756 18:55:14 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:57.756 18:55:14 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:57.756 18:55:14 -- scripts/common.sh@364 -- # decimal 1 00:08:57.756 18:55:14 -- scripts/common.sh@352 -- # local d=1 00:08:57.756 18:55:14 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:57.756 18:55:14 -- scripts/common.sh@354 -- # echo 1 00:08:57.756 18:55:14 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:57.756 18:55:14 -- scripts/common.sh@365 -- # decimal 2 00:08:57.756 18:55:14 -- scripts/common.sh@352 -- # local d=2 00:08:57.756 18:55:14 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:57.756 18:55:14 -- scripts/common.sh@354 -- # echo 2 00:08:57.756 18:55:14 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:57.756 18:55:14 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:57.756 18:55:14 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:57.756 18:55:14 -- scripts/common.sh@367 -- # return 0 00:08:57.756 18:55:14 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:57.756 18:55:14 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:57.756 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:57.756 --rc genhtml_branch_coverage=1 00:08:57.756 --rc genhtml_function_coverage=1 00:08:57.756 --rc genhtml_legend=1 00:08:57.756 --rc geninfo_all_blocks=1 00:08:57.756 --rc geninfo_unexecuted_blocks=1 00:08:57.756 00:08:57.756 ' 00:08:57.756 18:55:14 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:57.756 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:57.756 --rc genhtml_branch_coverage=1 00:08:57.756 --rc genhtml_function_coverage=1 00:08:57.756 --rc genhtml_legend=1 00:08:57.756 --rc geninfo_all_blocks=1 00:08:57.756 --rc geninfo_unexecuted_blocks=1 00:08:57.756 00:08:57.756 ' 00:08:57.756 18:55:14 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:57.756 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:57.756 --rc genhtml_branch_coverage=1 00:08:57.756 --rc genhtml_function_coverage=1 00:08:57.756 --rc genhtml_legend=1 00:08:57.756 --rc geninfo_all_blocks=1 00:08:57.756 --rc geninfo_unexecuted_blocks=1 00:08:57.756 00:08:57.756 ' 00:08:57.756 18:55:14 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:57.756 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:57.756 --rc genhtml_branch_coverage=1 00:08:57.756 --rc genhtml_function_coverage=1 00:08:57.756 --rc genhtml_legend=1 00:08:57.756 --rc geninfo_all_blocks=1 00:08:57.756 --rc geninfo_unexecuted_blocks=1 00:08:57.756 00:08:57.756 ' 00:08:57.756 18:55:14 -- target/connect_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:57.756 18:55:14 -- nvmf/common.sh@7 -- # uname -s 00:08:57.756 18:55:14 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:57.757 18:55:14 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:57.757 18:55:14 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:57.757 18:55:14 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:57.757 18:55:14 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:57.757 18:55:14 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:57.757 18:55:14 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:57.757 18:55:14 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:57.757 18:55:14 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:57.757 18:55:14 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:57.757 18:55:14 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:08:57.757 18:55:14 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:08:57.757 18:55:14 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:57.757 18:55:14 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:57.757 18:55:14 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:57.757 18:55:14 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:57.757 18:55:14 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:57.757 18:55:14 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:57.757 18:55:14 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:57.757 18:55:14 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:57.757 18:55:14 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:57.757 18:55:14 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:57.757 18:55:14 -- paths/export.sh@5 -- # export PATH 00:08:57.757 18:55:14 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:57.757 18:55:14 -- nvmf/common.sh@46 -- # : 0 00:08:57.757 18:55:14 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:08:57.757 18:55:14 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:08:57.757 18:55:14 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:08:57.757 18:55:14 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:57.757 18:55:14 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:57.757 18:55:14 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:08:57.757 18:55:14 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:08:57.757 18:55:14 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:08:57.757 18:55:14 -- target/connect_disconnect.sh@11 -- # MALLOC_BDEV_SIZE=64 00:08:57.757 18:55:14 -- target/connect_disconnect.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:08:57.757 18:55:14 -- target/connect_disconnect.sh@15 -- # nvmftestinit 00:08:57.757 18:55:14 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:08:57.757 18:55:14 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:57.757 18:55:14 -- nvmf/common.sh@436 -- # prepare_net_devs 00:08:57.757 18:55:14 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:08:57.757 18:55:14 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:08:57.757 18:55:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:57.757 18:55:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:57.757 18:55:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:57.757 18:55:14 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:08:57.757 18:55:14 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:08:57.757 18:55:14 -- nvmf/common.sh@284 -- # xtrace_disable 00:08:57.757 18:55:14 -- common/autotest_common.sh@10 -- # set +x 00:09:04.330 18:55:20 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:09:04.330 18:55:20 -- nvmf/common.sh@290 -- # pci_devs=() 00:09:04.330 18:55:20 -- nvmf/common.sh@290 -- # local -a pci_devs 00:09:04.330 18:55:20 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:09:04.330 18:55:20 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:09:04.330 18:55:20 -- nvmf/common.sh@292 -- # pci_drivers=() 00:09:04.330 18:55:20 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:09:04.330 18:55:20 -- nvmf/common.sh@294 -- # net_devs=() 00:09:04.330 18:55:20 -- nvmf/common.sh@294 -- # local -ga net_devs 00:09:04.330 18:55:20 -- nvmf/common.sh@295 -- # e810=() 00:09:04.330 18:55:20 -- nvmf/common.sh@295 -- # local -ga e810 00:09:04.330 18:55:20 -- nvmf/common.sh@296 -- # x722=() 00:09:04.330 18:55:20 -- nvmf/common.sh@296 -- # local -ga x722 00:09:04.330 18:55:20 -- nvmf/common.sh@297 -- # mlx=() 00:09:04.330 18:55:20 -- nvmf/common.sh@297 -- # local -ga mlx 00:09:04.330 18:55:20 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:09:04.330 18:55:20 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:09:04.330 18:55:20 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:09:04.331 18:55:20 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:09:04.331 18:55:20 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:09:04.331 18:55:20 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:09:04.331 18:55:20 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:09:04.331 18:55:20 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:09:04.331 18:55:20 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:09:04.331 18:55:20 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:09:04.331 18:55:20 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:09:04.331 18:55:20 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:09:04.331 18:55:20 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:09:04.331 18:55:20 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:09:04.331 18:55:20 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:09:04.331 18:55:20 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:09:04.331 18:55:20 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:09:04.331 18:55:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:09:04.331 18:55:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:09:04.331 Found 0000:86:00.0 (0x8086 - 0x159b) 00:09:04.331 18:55:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:09:04.331 18:55:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:09:04.331 18:55:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:09:04.331 18:55:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:09:04.331 18:55:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:09:04.331 18:55:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:09:04.331 18:55:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:09:04.331 Found 0000:86:00.1 (0x8086 - 0x159b) 00:09:04.331 18:55:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:09:04.331 18:55:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:09:04.331 18:55:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:09:04.331 18:55:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:09:04.331 18:55:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:09:04.331 18:55:20 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:09:04.331 18:55:20 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:09:04.331 18:55:20 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:09:04.331 18:55:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:09:04.331 18:55:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:04.331 18:55:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:09:04.331 18:55:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:04.331 18:55:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:09:04.331 Found net devices under 0000:86:00.0: cvl_0_0 00:09:04.331 18:55:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:09:04.331 18:55:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:09:04.331 18:55:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:04.331 18:55:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:09:04.331 18:55:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:04.331 18:55:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:09:04.331 Found net devices under 0000:86:00.1: cvl_0_1 00:09:04.331 18:55:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:09:04.331 18:55:20 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:09:04.331 18:55:20 -- nvmf/common.sh@402 -- # is_hw=yes 00:09:04.331 18:55:20 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:09:04.331 18:55:20 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:09:04.331 18:55:20 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:09:04.331 18:55:20 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:09:04.331 18:55:20 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:09:04.331 18:55:20 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:09:04.331 18:55:20 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:09:04.331 18:55:20 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:09:04.331 18:55:20 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:09:04.331 18:55:20 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:09:04.331 18:55:20 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:09:04.331 18:55:20 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:09:04.331 18:55:20 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:09:04.331 18:55:20 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:09:04.331 18:55:20 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:09:04.331 18:55:20 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:09:04.331 18:55:20 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:09:04.331 18:55:20 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:09:04.331 18:55:20 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:09:04.331 18:55:20 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:09:04.331 18:55:20 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:09:04.331 18:55:20 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:09:04.331 18:55:20 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:09:04.331 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:09:04.331 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.433 ms 00:09:04.331 00:09:04.331 --- 10.0.0.2 ping statistics --- 00:09:04.331 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:04.331 rtt min/avg/max/mdev = 0.433/0.433/0.433/0.000 ms 00:09:04.331 18:55:20 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:09:04.331 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:09:04.331 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.220 ms 00:09:04.331 00:09:04.331 --- 10.0.0.1 ping statistics --- 00:09:04.331 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:04.331 rtt min/avg/max/mdev = 0.220/0.220/0.220/0.000 ms 00:09:04.331 18:55:20 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:09:04.331 18:55:20 -- nvmf/common.sh@410 -- # return 0 00:09:04.331 18:55:20 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:09:04.331 18:55:20 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:09:04.331 18:55:20 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:09:04.331 18:55:20 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:09:04.331 18:55:20 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:09:04.331 18:55:20 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:09:04.331 18:55:20 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:09:04.331 18:55:20 -- target/connect_disconnect.sh@16 -- # nvmfappstart -m 0xF 00:09:04.331 18:55:20 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:09:04.331 18:55:20 -- common/autotest_common.sh@722 -- # xtrace_disable 00:09:04.331 18:55:20 -- common/autotest_common.sh@10 -- # set +x 00:09:04.331 18:55:20 -- nvmf/common.sh@469 -- # nvmfpid=2972183 00:09:04.331 18:55:20 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:09:04.331 18:55:20 -- nvmf/common.sh@470 -- # waitforlisten 2972183 00:09:04.331 18:55:20 -- common/autotest_common.sh@829 -- # '[' -z 2972183 ']' 00:09:04.331 18:55:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:04.331 18:55:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:09:04.331 18:55:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:04.331 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:04.331 18:55:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:09:04.331 18:55:20 -- common/autotest_common.sh@10 -- # set +x 00:09:04.331 [2024-11-26 18:55:20.458689] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:09:04.331 [2024-11-26 18:55:20.458744] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:09:04.331 EAL: No free 2048 kB hugepages reported on node 1 00:09:04.331 [2024-11-26 18:55:20.522114] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:09:04.331 [2024-11-26 18:55:20.564939] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:09:04.331 [2024-11-26 18:55:20.565068] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:09:04.331 [2024-11-26 18:55:20.565077] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:09:04.331 [2024-11-26 18:55:20.565084] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:09:04.331 [2024-11-26 18:55:20.565129] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:09:04.331 [2024-11-26 18:55:20.565223] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:09:04.331 [2024-11-26 18:55:20.565310] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:09:04.331 [2024-11-26 18:55:20.565311] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:09:04.590 18:55:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:09:04.590 18:55:21 -- common/autotest_common.sh@862 -- # return 0 00:09:04.590 18:55:21 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:09:04.590 18:55:21 -- common/autotest_common.sh@728 -- # xtrace_disable 00:09:04.590 18:55:21 -- common/autotest_common.sh@10 -- # set +x 00:09:04.590 18:55:21 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:09:04.590 18:55:21 -- target/connect_disconnect.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:09:04.590 18:55:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:04.590 18:55:21 -- common/autotest_common.sh@10 -- # set +x 00:09:04.590 [2024-11-26 18:55:21.328424] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:09:04.590 18:55:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:04.590 18:55:21 -- target/connect_disconnect.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 00:09:04.590 18:55:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:04.590 18:55:21 -- common/autotest_common.sh@10 -- # set +x 00:09:04.590 18:55:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:04.590 18:55:21 -- target/connect_disconnect.sh@20 -- # bdev=Malloc0 00:09:04.590 18:55:21 -- target/connect_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:09:04.590 18:55:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:04.590 18:55:21 -- common/autotest_common.sh@10 -- # set +x 00:09:04.590 18:55:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:04.591 18:55:21 -- target/connect_disconnect.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:09:04.591 18:55:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:04.591 18:55:21 -- common/autotest_common.sh@10 -- # set +x 00:09:04.591 18:55:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:04.591 18:55:21 -- target/connect_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:09:04.591 18:55:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:04.591 18:55:21 -- common/autotest_common.sh@10 -- # set +x 00:09:04.591 [2024-11-26 18:55:21.380472] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:09:04.591 18:55:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:04.591 18:55:21 -- target/connect_disconnect.sh@26 -- # '[' 1 -eq 1 ']' 00:09:04.591 18:55:21 -- target/connect_disconnect.sh@27 -- # num_iterations=100 00:09:04.591 18:55:21 -- target/connect_disconnect.sh@29 -- # NVME_CONNECT='nvme connect -i 8' 00:09:04.591 18:55:21 -- target/connect_disconnect.sh@34 -- # set +x 00:09:07.183 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:09.088 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:11.625 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:14.160 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:16.067 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:18.605 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:21.141 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:23.047 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:25.585 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:27.492 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:30.028 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:32.563 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:34.468 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:37.004 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:39.535 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:41.434 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:43.967 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:46.500 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:48.402 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:50.935 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:52.840 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:55.450 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:57.979 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:59.876 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:02.406 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:04.312 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:06.845 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:09.376 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:11.903 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:13.803 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:16.337 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:18.240 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:20.775 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:22.680 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:25.210 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:27.745 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:29.647 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:32.179 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:34.712 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:36.727 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:39.262 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:41.169 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:43.699 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:46.235 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:48.192 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:50.724 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:53.260 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:55.165 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:57.704 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:59.778 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:02.332 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:04.866 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:06.771 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:09.306 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:11.839 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:13.747 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:16.280 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:18.815 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:20.719 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:23.255 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:25.786 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:27.691 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:30.222 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:32.755 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:34.659 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:37.194 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:39.098 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:41.634 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:44.168 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:46.074 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:48.613 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:50.515 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:53.065 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:55.604 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:57.511 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:00.041 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:02.573 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:04.475 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:07.010 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:09.548 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:11.455 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:13.990 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:16.527 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:18.432 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:20.969 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:23.507 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:25.413 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:27.953 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:29.860 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:32.499 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:34.521 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:37.056 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:39.590 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:41.491 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:44.029 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:46.565 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:48.469 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:51.001 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:53.535 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:55.438 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:55.438 18:59:12 -- target/connect_disconnect.sh@43 -- # trap - SIGINT SIGTERM EXIT 00:12:55.438 18:59:12 -- target/connect_disconnect.sh@45 -- # nvmftestfini 00:12:55.438 18:59:12 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:55.438 18:59:12 -- nvmf/common.sh@116 -- # sync 00:12:55.438 18:59:12 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:55.438 18:59:12 -- nvmf/common.sh@119 -- # set +e 00:12:55.438 18:59:12 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:55.439 18:59:12 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:55.439 rmmod nvme_tcp 00:12:55.439 rmmod nvme_fabrics 00:12:55.439 rmmod nvme_keyring 00:12:55.439 18:59:12 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:55.439 18:59:12 -- nvmf/common.sh@123 -- # set -e 00:12:55.439 18:59:12 -- nvmf/common.sh@124 -- # return 0 00:12:55.439 18:59:12 -- nvmf/common.sh@477 -- # '[' -n 2972183 ']' 00:12:55.439 18:59:12 -- nvmf/common.sh@478 -- # killprocess 2972183 00:12:55.439 18:59:12 -- common/autotest_common.sh@936 -- # '[' -z 2972183 ']' 00:12:55.439 18:59:12 -- common/autotest_common.sh@940 -- # kill -0 2972183 00:12:55.439 18:59:12 -- common/autotest_common.sh@941 -- # uname 00:12:55.439 18:59:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:55.439 18:59:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2972183 00:12:55.439 18:59:12 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:12:55.439 18:59:12 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:12:55.439 18:59:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2972183' 00:12:55.439 killing process with pid 2972183 00:12:55.439 18:59:12 -- common/autotest_common.sh@955 -- # kill 2972183 00:12:55.439 18:59:12 -- common/autotest_common.sh@960 -- # wait 2972183 00:12:55.698 18:59:12 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:55.698 18:59:12 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:55.698 18:59:12 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:55.698 18:59:12 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:55.698 18:59:12 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:55.698 18:59:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:55.698 18:59:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:55.698 18:59:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:58.235 18:59:14 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:58.235 00:12:58.235 real 4m0.081s 00:12:58.235 user 15m17.256s 00:12:58.235 sys 0m25.242s 00:12:58.235 18:59:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:58.235 18:59:14 -- common/autotest_common.sh@10 -- # set +x 00:12:58.235 ************************************ 00:12:58.235 END TEST nvmf_connect_disconnect 00:12:58.235 ************************************ 00:12:58.235 18:59:14 -- nvmf/nvmf.sh@28 -- # run_test nvmf_multitarget /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:12:58.235 18:59:14 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:58.235 18:59:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:58.235 18:59:14 -- common/autotest_common.sh@10 -- # set +x 00:12:58.235 ************************************ 00:12:58.235 START TEST nvmf_multitarget 00:12:58.235 ************************************ 00:12:58.235 18:59:14 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:12:58.235 * Looking for test storage... 00:12:58.235 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:58.235 18:59:14 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:58.235 18:59:14 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:58.235 18:59:14 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:58.235 18:59:14 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:58.235 18:59:14 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:58.235 18:59:14 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:58.235 18:59:14 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:58.235 18:59:14 -- scripts/common.sh@335 -- # IFS=.-: 00:12:58.235 18:59:14 -- scripts/common.sh@335 -- # read -ra ver1 00:12:58.235 18:59:14 -- scripts/common.sh@336 -- # IFS=.-: 00:12:58.235 18:59:14 -- scripts/common.sh@336 -- # read -ra ver2 00:12:58.235 18:59:14 -- scripts/common.sh@337 -- # local 'op=<' 00:12:58.235 18:59:14 -- scripts/common.sh@339 -- # ver1_l=2 00:12:58.235 18:59:14 -- scripts/common.sh@340 -- # ver2_l=1 00:12:58.235 18:59:14 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:58.235 18:59:14 -- scripts/common.sh@343 -- # case "$op" in 00:12:58.235 18:59:14 -- scripts/common.sh@344 -- # : 1 00:12:58.235 18:59:14 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:58.235 18:59:14 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:58.235 18:59:14 -- scripts/common.sh@364 -- # decimal 1 00:12:58.235 18:59:14 -- scripts/common.sh@352 -- # local d=1 00:12:58.235 18:59:14 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:58.235 18:59:14 -- scripts/common.sh@354 -- # echo 1 00:12:58.235 18:59:14 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:58.235 18:59:14 -- scripts/common.sh@365 -- # decimal 2 00:12:58.235 18:59:14 -- scripts/common.sh@352 -- # local d=2 00:12:58.235 18:59:14 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:58.235 18:59:14 -- scripts/common.sh@354 -- # echo 2 00:12:58.235 18:59:14 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:58.235 18:59:14 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:58.236 18:59:14 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:58.236 18:59:14 -- scripts/common.sh@367 -- # return 0 00:12:58.236 18:59:14 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:58.236 18:59:14 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:58.236 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:58.236 --rc genhtml_branch_coverage=1 00:12:58.236 --rc genhtml_function_coverage=1 00:12:58.236 --rc genhtml_legend=1 00:12:58.236 --rc geninfo_all_blocks=1 00:12:58.236 --rc geninfo_unexecuted_blocks=1 00:12:58.236 00:12:58.236 ' 00:12:58.236 18:59:14 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:58.236 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:58.236 --rc genhtml_branch_coverage=1 00:12:58.236 --rc genhtml_function_coverage=1 00:12:58.236 --rc genhtml_legend=1 00:12:58.236 --rc geninfo_all_blocks=1 00:12:58.236 --rc geninfo_unexecuted_blocks=1 00:12:58.236 00:12:58.236 ' 00:12:58.236 18:59:14 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:58.236 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:58.236 --rc genhtml_branch_coverage=1 00:12:58.236 --rc genhtml_function_coverage=1 00:12:58.236 --rc genhtml_legend=1 00:12:58.236 --rc geninfo_all_blocks=1 00:12:58.236 --rc geninfo_unexecuted_blocks=1 00:12:58.236 00:12:58.236 ' 00:12:58.236 18:59:14 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:58.236 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:58.236 --rc genhtml_branch_coverage=1 00:12:58.236 --rc genhtml_function_coverage=1 00:12:58.236 --rc genhtml_legend=1 00:12:58.236 --rc geninfo_all_blocks=1 00:12:58.236 --rc geninfo_unexecuted_blocks=1 00:12:58.236 00:12:58.236 ' 00:12:58.236 18:59:14 -- target/multitarget.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:58.236 18:59:14 -- nvmf/common.sh@7 -- # uname -s 00:12:58.236 18:59:14 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:58.236 18:59:14 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:58.236 18:59:14 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:58.236 18:59:14 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:58.236 18:59:14 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:58.236 18:59:14 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:58.236 18:59:14 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:58.236 18:59:14 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:58.236 18:59:14 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:58.236 18:59:14 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:58.236 18:59:14 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:12:58.236 18:59:14 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:12:58.236 18:59:14 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:58.236 18:59:14 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:58.236 18:59:14 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:58.236 18:59:14 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:58.236 18:59:14 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:58.236 18:59:14 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:58.236 18:59:14 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:58.236 18:59:14 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:58.236 18:59:14 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:58.236 18:59:14 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:58.236 18:59:14 -- paths/export.sh@5 -- # export PATH 00:12:58.236 18:59:14 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:58.236 18:59:14 -- nvmf/common.sh@46 -- # : 0 00:12:58.236 18:59:14 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:58.236 18:59:14 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:58.236 18:59:14 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:58.236 18:59:14 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:58.236 18:59:14 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:58.236 18:59:14 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:58.236 18:59:14 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:58.236 18:59:14 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:58.236 18:59:14 -- target/multitarget.sh@13 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:12:58.236 18:59:14 -- target/multitarget.sh@15 -- # nvmftestinit 00:12:58.236 18:59:14 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:58.236 18:59:14 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:58.236 18:59:14 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:58.236 18:59:14 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:58.236 18:59:14 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:58.236 18:59:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:58.236 18:59:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:58.236 18:59:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:58.236 18:59:14 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:58.236 18:59:14 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:58.236 18:59:14 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:58.236 18:59:14 -- common/autotest_common.sh@10 -- # set +x 00:13:03.506 18:59:19 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:03.506 18:59:19 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:03.506 18:59:19 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:03.506 18:59:19 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:03.506 18:59:19 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:03.506 18:59:19 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:03.506 18:59:19 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:03.506 18:59:19 -- nvmf/common.sh@294 -- # net_devs=() 00:13:03.506 18:59:19 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:03.506 18:59:19 -- nvmf/common.sh@295 -- # e810=() 00:13:03.506 18:59:19 -- nvmf/common.sh@295 -- # local -ga e810 00:13:03.506 18:59:19 -- nvmf/common.sh@296 -- # x722=() 00:13:03.506 18:59:19 -- nvmf/common.sh@296 -- # local -ga x722 00:13:03.506 18:59:19 -- nvmf/common.sh@297 -- # mlx=() 00:13:03.506 18:59:19 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:03.506 18:59:19 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:03.506 18:59:19 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:03.506 18:59:19 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:03.506 18:59:19 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:03.506 18:59:19 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:03.506 18:59:19 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:03.506 18:59:19 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:03.506 18:59:19 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:03.506 18:59:19 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:03.506 18:59:19 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:03.506 18:59:19 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:03.506 18:59:19 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:03.506 18:59:19 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:03.506 18:59:19 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:03.506 18:59:19 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:03.506 18:59:19 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:03.506 18:59:19 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:03.506 18:59:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:03.506 18:59:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:13:03.506 Found 0000:86:00.0 (0x8086 - 0x159b) 00:13:03.506 18:59:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:03.506 18:59:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:03.506 18:59:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:03.506 18:59:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:03.506 18:59:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:03.506 18:59:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:03.506 18:59:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:13:03.506 Found 0000:86:00.1 (0x8086 - 0x159b) 00:13:03.506 18:59:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:03.506 18:59:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:03.506 18:59:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:03.506 18:59:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:03.506 18:59:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:03.506 18:59:19 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:03.506 18:59:19 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:03.506 18:59:19 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:03.506 18:59:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:03.506 18:59:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:03.506 18:59:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:03.506 18:59:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:03.506 18:59:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:13:03.506 Found net devices under 0000:86:00.0: cvl_0_0 00:13:03.506 18:59:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:03.506 18:59:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:03.506 18:59:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:03.506 18:59:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:03.507 18:59:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:03.507 18:59:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:13:03.507 Found net devices under 0000:86:00.1: cvl_0_1 00:13:03.507 18:59:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:03.507 18:59:19 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:03.507 18:59:19 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:03.507 18:59:19 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:03.507 18:59:19 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:03.507 18:59:19 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:03.507 18:59:19 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:03.507 18:59:19 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:03.507 18:59:19 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:03.507 18:59:19 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:03.507 18:59:19 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:03.507 18:59:19 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:03.507 18:59:19 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:03.507 18:59:19 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:03.507 18:59:19 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:03.507 18:59:19 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:03.507 18:59:19 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:03.507 18:59:19 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:03.507 18:59:19 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:03.507 18:59:19 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:03.507 18:59:19 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:03.507 18:59:19 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:03.507 18:59:19 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:03.507 18:59:19 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:03.507 18:59:19 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:03.507 18:59:19 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:03.507 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:03.507 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.392 ms 00:13:03.507 00:13:03.507 --- 10.0.0.2 ping statistics --- 00:13:03.507 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:03.507 rtt min/avg/max/mdev = 0.392/0.392/0.392/0.000 ms 00:13:03.507 18:59:19 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:03.507 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:03.507 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.242 ms 00:13:03.507 00:13:03.507 --- 10.0.0.1 ping statistics --- 00:13:03.507 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:03.507 rtt min/avg/max/mdev = 0.242/0.242/0.242/0.000 ms 00:13:03.507 18:59:19 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:03.507 18:59:19 -- nvmf/common.sh@410 -- # return 0 00:13:03.507 18:59:19 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:03.507 18:59:19 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:03.507 18:59:19 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:03.507 18:59:19 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:03.507 18:59:19 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:03.507 18:59:19 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:03.507 18:59:19 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:03.507 18:59:19 -- target/multitarget.sh@16 -- # nvmfappstart -m 0xF 00:13:03.507 18:59:19 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:03.507 18:59:19 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:03.507 18:59:19 -- common/autotest_common.sh@10 -- # set +x 00:13:03.507 18:59:19 -- nvmf/common.sh@469 -- # nvmfpid=3016404 00:13:03.507 18:59:19 -- nvmf/common.sh@470 -- # waitforlisten 3016404 00:13:03.507 18:59:19 -- common/autotest_common.sh@829 -- # '[' -z 3016404 ']' 00:13:03.507 18:59:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:03.507 18:59:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:03.507 18:59:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:03.507 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:03.507 18:59:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:03.507 18:59:19 -- common/autotest_common.sh@10 -- # set +x 00:13:03.507 18:59:19 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:13:03.507 [2024-11-26 18:59:19.673482] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:13:03.507 [2024-11-26 18:59:19.673525] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:03.507 EAL: No free 2048 kB hugepages reported on node 1 00:13:03.507 [2024-11-26 18:59:19.731951] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:03.507 [2024-11-26 18:59:19.771435] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:03.507 [2024-11-26 18:59:19.771552] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:03.507 [2024-11-26 18:59:19.771560] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:03.507 [2024-11-26 18:59:19.771568] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:03.507 [2024-11-26 18:59:19.771614] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:03.507 [2024-11-26 18:59:19.771711] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:03.507 [2024-11-26 18:59:19.771801] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:03.507 [2024-11-26 18:59:19.771802] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:03.766 18:59:20 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:03.766 18:59:20 -- common/autotest_common.sh@862 -- # return 0 00:13:03.766 18:59:20 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:03.766 18:59:20 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:03.766 18:59:20 -- common/autotest_common.sh@10 -- # set +x 00:13:03.766 18:59:20 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:03.766 18:59:20 -- target/multitarget.sh@18 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:13:03.766 18:59:20 -- target/multitarget.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:13:03.766 18:59:20 -- target/multitarget.sh@21 -- # jq length 00:13:03.766 18:59:20 -- target/multitarget.sh@21 -- # '[' 1 '!=' 1 ']' 00:13:03.766 18:59:20 -- target/multitarget.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_1 -s 32 00:13:04.025 "nvmf_tgt_1" 00:13:04.025 18:59:20 -- target/multitarget.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_2 -s 32 00:13:04.025 "nvmf_tgt_2" 00:13:04.025 18:59:20 -- target/multitarget.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:13:04.025 18:59:20 -- target/multitarget.sh@28 -- # jq length 00:13:04.283 18:59:20 -- target/multitarget.sh@28 -- # '[' 3 '!=' 3 ']' 00:13:04.283 18:59:20 -- target/multitarget.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_1 00:13:04.283 true 00:13:04.283 18:59:21 -- target/multitarget.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_2 00:13:04.283 true 00:13:04.283 18:59:21 -- target/multitarget.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:13:04.283 18:59:21 -- target/multitarget.sh@35 -- # jq length 00:13:04.542 18:59:21 -- target/multitarget.sh@35 -- # '[' 1 '!=' 1 ']' 00:13:04.542 18:59:21 -- target/multitarget.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:13:04.542 18:59:21 -- target/multitarget.sh@41 -- # nvmftestfini 00:13:04.542 18:59:21 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:04.542 18:59:21 -- nvmf/common.sh@116 -- # sync 00:13:04.542 18:59:21 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:04.542 18:59:21 -- nvmf/common.sh@119 -- # set +e 00:13:04.542 18:59:21 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:04.542 18:59:21 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:04.542 rmmod nvme_tcp 00:13:04.542 rmmod nvme_fabrics 00:13:04.542 rmmod nvme_keyring 00:13:04.542 18:59:21 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:04.542 18:59:21 -- nvmf/common.sh@123 -- # set -e 00:13:04.542 18:59:21 -- nvmf/common.sh@124 -- # return 0 00:13:04.542 18:59:21 -- nvmf/common.sh@477 -- # '[' -n 3016404 ']' 00:13:04.542 18:59:21 -- nvmf/common.sh@478 -- # killprocess 3016404 00:13:04.542 18:59:21 -- common/autotest_common.sh@936 -- # '[' -z 3016404 ']' 00:13:04.542 18:59:21 -- common/autotest_common.sh@940 -- # kill -0 3016404 00:13:04.542 18:59:21 -- common/autotest_common.sh@941 -- # uname 00:13:04.542 18:59:21 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:04.542 18:59:21 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3016404 00:13:04.542 18:59:21 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:04.542 18:59:21 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:04.542 18:59:21 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3016404' 00:13:04.542 killing process with pid 3016404 00:13:04.542 18:59:21 -- common/autotest_common.sh@955 -- # kill 3016404 00:13:04.542 18:59:21 -- common/autotest_common.sh@960 -- # wait 3016404 00:13:04.801 18:59:21 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:04.801 18:59:21 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:04.801 18:59:21 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:04.801 18:59:21 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:04.801 18:59:21 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:04.801 18:59:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:04.801 18:59:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:04.801 18:59:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:07.336 18:59:23 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:07.336 00:13:07.336 real 0m9.049s 00:13:07.336 user 0m9.244s 00:13:07.336 sys 0m4.103s 00:13:07.336 18:59:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:07.336 18:59:23 -- common/autotest_common.sh@10 -- # set +x 00:13:07.336 ************************************ 00:13:07.336 END TEST nvmf_multitarget 00:13:07.336 ************************************ 00:13:07.336 18:59:23 -- nvmf/nvmf.sh@29 -- # run_test nvmf_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:13:07.336 18:59:23 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:07.336 18:59:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:07.336 18:59:23 -- common/autotest_common.sh@10 -- # set +x 00:13:07.336 ************************************ 00:13:07.336 START TEST nvmf_rpc 00:13:07.336 ************************************ 00:13:07.336 18:59:23 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:13:07.336 * Looking for test storage... 00:13:07.336 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:07.336 18:59:23 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:07.336 18:59:23 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:07.336 18:59:23 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:07.336 18:59:23 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:07.336 18:59:23 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:07.336 18:59:23 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:07.336 18:59:23 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:07.336 18:59:23 -- scripts/common.sh@335 -- # IFS=.-: 00:13:07.336 18:59:23 -- scripts/common.sh@335 -- # read -ra ver1 00:13:07.336 18:59:23 -- scripts/common.sh@336 -- # IFS=.-: 00:13:07.336 18:59:23 -- scripts/common.sh@336 -- # read -ra ver2 00:13:07.336 18:59:23 -- scripts/common.sh@337 -- # local 'op=<' 00:13:07.336 18:59:23 -- scripts/common.sh@339 -- # ver1_l=2 00:13:07.336 18:59:23 -- scripts/common.sh@340 -- # ver2_l=1 00:13:07.336 18:59:23 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:07.336 18:59:23 -- scripts/common.sh@343 -- # case "$op" in 00:13:07.336 18:59:23 -- scripts/common.sh@344 -- # : 1 00:13:07.336 18:59:23 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:07.336 18:59:23 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:07.337 18:59:23 -- scripts/common.sh@364 -- # decimal 1 00:13:07.337 18:59:23 -- scripts/common.sh@352 -- # local d=1 00:13:07.337 18:59:23 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:07.337 18:59:23 -- scripts/common.sh@354 -- # echo 1 00:13:07.337 18:59:23 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:07.337 18:59:23 -- scripts/common.sh@365 -- # decimal 2 00:13:07.337 18:59:23 -- scripts/common.sh@352 -- # local d=2 00:13:07.337 18:59:23 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:07.337 18:59:23 -- scripts/common.sh@354 -- # echo 2 00:13:07.337 18:59:23 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:07.337 18:59:23 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:07.337 18:59:23 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:07.337 18:59:23 -- scripts/common.sh@367 -- # return 0 00:13:07.337 18:59:23 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:07.337 18:59:23 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:07.337 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:07.337 --rc genhtml_branch_coverage=1 00:13:07.337 --rc genhtml_function_coverage=1 00:13:07.337 --rc genhtml_legend=1 00:13:07.337 --rc geninfo_all_blocks=1 00:13:07.337 --rc geninfo_unexecuted_blocks=1 00:13:07.337 00:13:07.337 ' 00:13:07.337 18:59:23 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:07.337 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:07.337 --rc genhtml_branch_coverage=1 00:13:07.337 --rc genhtml_function_coverage=1 00:13:07.337 --rc genhtml_legend=1 00:13:07.337 --rc geninfo_all_blocks=1 00:13:07.337 --rc geninfo_unexecuted_blocks=1 00:13:07.337 00:13:07.337 ' 00:13:07.337 18:59:23 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:07.337 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:07.337 --rc genhtml_branch_coverage=1 00:13:07.337 --rc genhtml_function_coverage=1 00:13:07.337 --rc genhtml_legend=1 00:13:07.337 --rc geninfo_all_blocks=1 00:13:07.337 --rc geninfo_unexecuted_blocks=1 00:13:07.337 00:13:07.337 ' 00:13:07.337 18:59:23 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:07.337 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:07.337 --rc genhtml_branch_coverage=1 00:13:07.337 --rc genhtml_function_coverage=1 00:13:07.337 --rc genhtml_legend=1 00:13:07.337 --rc geninfo_all_blocks=1 00:13:07.337 --rc geninfo_unexecuted_blocks=1 00:13:07.337 00:13:07.337 ' 00:13:07.337 18:59:23 -- target/rpc.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:07.337 18:59:23 -- nvmf/common.sh@7 -- # uname -s 00:13:07.337 18:59:23 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:07.337 18:59:23 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:07.337 18:59:23 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:07.337 18:59:23 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:07.337 18:59:23 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:07.337 18:59:23 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:07.337 18:59:23 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:07.337 18:59:23 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:07.337 18:59:23 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:07.337 18:59:23 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:07.337 18:59:23 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:13:07.337 18:59:23 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:13:07.337 18:59:23 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:07.337 18:59:23 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:07.337 18:59:23 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:07.337 18:59:23 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:07.337 18:59:23 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:07.337 18:59:23 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:07.337 18:59:23 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:07.337 18:59:23 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:07.337 18:59:23 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:07.337 18:59:23 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:07.337 18:59:23 -- paths/export.sh@5 -- # export PATH 00:13:07.337 18:59:23 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:07.337 18:59:23 -- nvmf/common.sh@46 -- # : 0 00:13:07.337 18:59:23 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:07.337 18:59:23 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:07.337 18:59:23 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:07.337 18:59:23 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:07.337 18:59:23 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:07.337 18:59:23 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:07.337 18:59:23 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:07.337 18:59:23 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:07.337 18:59:23 -- target/rpc.sh@11 -- # loops=5 00:13:07.337 18:59:23 -- target/rpc.sh@23 -- # nvmftestinit 00:13:07.337 18:59:23 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:07.337 18:59:23 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:07.337 18:59:23 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:07.337 18:59:23 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:07.337 18:59:23 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:07.337 18:59:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:07.337 18:59:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:07.337 18:59:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:07.337 18:59:23 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:07.337 18:59:23 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:07.337 18:59:23 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:07.337 18:59:23 -- common/autotest_common.sh@10 -- # set +x 00:13:12.626 18:59:29 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:12.626 18:59:29 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:12.626 18:59:29 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:12.626 18:59:29 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:12.626 18:59:29 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:12.626 18:59:29 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:12.626 18:59:29 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:12.626 18:59:29 -- nvmf/common.sh@294 -- # net_devs=() 00:13:12.626 18:59:29 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:12.626 18:59:29 -- nvmf/common.sh@295 -- # e810=() 00:13:12.626 18:59:29 -- nvmf/common.sh@295 -- # local -ga e810 00:13:12.626 18:59:29 -- nvmf/common.sh@296 -- # x722=() 00:13:12.626 18:59:29 -- nvmf/common.sh@296 -- # local -ga x722 00:13:12.626 18:59:29 -- nvmf/common.sh@297 -- # mlx=() 00:13:12.626 18:59:29 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:12.626 18:59:29 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:12.626 18:59:29 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:12.626 18:59:29 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:12.626 18:59:29 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:12.626 18:59:29 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:12.626 18:59:29 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:12.626 18:59:29 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:12.626 18:59:29 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:12.626 18:59:29 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:12.626 18:59:29 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:12.626 18:59:29 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:12.626 18:59:29 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:12.626 18:59:29 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:12.626 18:59:29 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:12.626 18:59:29 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:12.626 18:59:29 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:12.626 18:59:29 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:12.626 18:59:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:12.626 18:59:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:13:12.626 Found 0000:86:00.0 (0x8086 - 0x159b) 00:13:12.626 18:59:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:12.626 18:59:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:12.626 18:59:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:12.626 18:59:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:12.626 18:59:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:12.626 18:59:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:12.626 18:59:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:13:12.626 Found 0000:86:00.1 (0x8086 - 0x159b) 00:13:12.626 18:59:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:12.626 18:59:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:12.626 18:59:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:12.626 18:59:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:12.626 18:59:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:12.626 18:59:29 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:12.626 18:59:29 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:12.626 18:59:29 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:12.626 18:59:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:12.626 18:59:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:12.626 18:59:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:12.626 18:59:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:12.626 18:59:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:13:12.626 Found net devices under 0000:86:00.0: cvl_0_0 00:13:12.626 18:59:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:12.626 18:59:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:12.626 18:59:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:12.626 18:59:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:12.626 18:59:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:12.626 18:59:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:13:12.626 Found net devices under 0000:86:00.1: cvl_0_1 00:13:12.626 18:59:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:12.626 18:59:29 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:12.626 18:59:29 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:12.626 18:59:29 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:12.626 18:59:29 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:12.626 18:59:29 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:12.626 18:59:29 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:12.626 18:59:29 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:12.626 18:59:29 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:12.626 18:59:29 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:12.626 18:59:29 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:12.626 18:59:29 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:12.626 18:59:29 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:12.626 18:59:29 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:12.626 18:59:29 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:12.627 18:59:29 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:12.627 18:59:29 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:12.627 18:59:29 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:12.627 18:59:29 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:12.627 18:59:29 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:12.627 18:59:29 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:12.627 18:59:29 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:12.627 18:59:29 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:12.627 18:59:29 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:12.627 18:59:29 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:12.627 18:59:29 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:12.627 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:12.627 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.349 ms 00:13:12.627 00:13:12.627 --- 10.0.0.2 ping statistics --- 00:13:12.627 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:12.627 rtt min/avg/max/mdev = 0.349/0.349/0.349/0.000 ms 00:13:12.627 18:59:29 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:12.627 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:12.627 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.142 ms 00:13:12.627 00:13:12.627 --- 10.0.0.1 ping statistics --- 00:13:12.627 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:12.627 rtt min/avg/max/mdev = 0.142/0.142/0.142/0.000 ms 00:13:12.627 18:59:29 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:12.627 18:59:29 -- nvmf/common.sh@410 -- # return 0 00:13:12.627 18:59:29 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:12.627 18:59:29 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:12.627 18:59:29 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:12.627 18:59:29 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:12.627 18:59:29 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:12.627 18:59:29 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:12.627 18:59:29 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:12.627 18:59:29 -- target/rpc.sh@24 -- # nvmfappstart -m 0xF 00:13:12.627 18:59:29 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:12.627 18:59:29 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:12.627 18:59:29 -- common/autotest_common.sh@10 -- # set +x 00:13:12.627 18:59:29 -- nvmf/common.sh@469 -- # nvmfpid=3020222 00:13:12.627 18:59:29 -- nvmf/common.sh@470 -- # waitforlisten 3020222 00:13:12.627 18:59:29 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:13:12.627 18:59:29 -- common/autotest_common.sh@829 -- # '[' -z 3020222 ']' 00:13:12.627 18:59:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:12.627 18:59:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:12.627 18:59:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:12.627 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:12.627 18:59:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:12.627 18:59:29 -- common/autotest_common.sh@10 -- # set +x 00:13:12.887 [2024-11-26 18:59:29.581465] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:13:12.887 [2024-11-26 18:59:29.581507] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:12.887 EAL: No free 2048 kB hugepages reported on node 1 00:13:12.887 [2024-11-26 18:59:29.641584] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:12.887 [2024-11-26 18:59:29.679919] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:12.887 [2024-11-26 18:59:29.680048] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:12.887 [2024-11-26 18:59:29.680057] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:12.887 [2024-11-26 18:59:29.680063] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:12.887 [2024-11-26 18:59:29.680112] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:12.887 [2024-11-26 18:59:29.680218] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:12.887 [2024-11-26 18:59:29.680285] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:12.887 [2024-11-26 18:59:29.680286] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:13.824 18:59:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:13.824 18:59:30 -- common/autotest_common.sh@862 -- # return 0 00:13:13.824 18:59:30 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:13.824 18:59:30 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:13.824 18:59:30 -- common/autotest_common.sh@10 -- # set +x 00:13:13.824 18:59:30 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:13.824 18:59:30 -- target/rpc.sh@26 -- # rpc_cmd nvmf_get_stats 00:13:13.824 18:59:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:13.824 18:59:30 -- common/autotest_common.sh@10 -- # set +x 00:13:13.824 18:59:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:13.824 18:59:30 -- target/rpc.sh@26 -- # stats='{ 00:13:13.824 "tick_rate": 2300000000, 00:13:13.824 "poll_groups": [ 00:13:13.824 { 00:13:13.824 "name": "nvmf_tgt_poll_group_0", 00:13:13.824 "admin_qpairs": 0, 00:13:13.824 "io_qpairs": 0, 00:13:13.824 "current_admin_qpairs": 0, 00:13:13.824 "current_io_qpairs": 0, 00:13:13.824 "pending_bdev_io": 0, 00:13:13.824 "completed_nvme_io": 0, 00:13:13.824 "transports": [] 00:13:13.824 }, 00:13:13.824 { 00:13:13.825 "name": "nvmf_tgt_poll_group_1", 00:13:13.825 "admin_qpairs": 0, 00:13:13.825 "io_qpairs": 0, 00:13:13.825 "current_admin_qpairs": 0, 00:13:13.825 "current_io_qpairs": 0, 00:13:13.825 "pending_bdev_io": 0, 00:13:13.825 "completed_nvme_io": 0, 00:13:13.825 "transports": [] 00:13:13.825 }, 00:13:13.825 { 00:13:13.825 "name": "nvmf_tgt_poll_group_2", 00:13:13.825 "admin_qpairs": 0, 00:13:13.825 "io_qpairs": 0, 00:13:13.825 "current_admin_qpairs": 0, 00:13:13.825 "current_io_qpairs": 0, 00:13:13.825 "pending_bdev_io": 0, 00:13:13.825 "completed_nvme_io": 0, 00:13:13.825 "transports": [] 00:13:13.825 }, 00:13:13.825 { 00:13:13.825 "name": "nvmf_tgt_poll_group_3", 00:13:13.825 "admin_qpairs": 0, 00:13:13.825 "io_qpairs": 0, 00:13:13.825 "current_admin_qpairs": 0, 00:13:13.825 "current_io_qpairs": 0, 00:13:13.825 "pending_bdev_io": 0, 00:13:13.825 "completed_nvme_io": 0, 00:13:13.825 "transports": [] 00:13:13.825 } 00:13:13.825 ] 00:13:13.825 }' 00:13:13.825 18:59:30 -- target/rpc.sh@28 -- # jcount '.poll_groups[].name' 00:13:13.825 18:59:30 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[].name' 00:13:13.825 18:59:30 -- target/rpc.sh@15 -- # jq '.poll_groups[].name' 00:13:13.825 18:59:30 -- target/rpc.sh@15 -- # wc -l 00:13:13.825 18:59:30 -- target/rpc.sh@28 -- # (( 4 == 4 )) 00:13:13.825 18:59:30 -- target/rpc.sh@29 -- # jq '.poll_groups[0].transports[0]' 00:13:13.825 18:59:30 -- target/rpc.sh@29 -- # [[ null == null ]] 00:13:13.825 18:59:30 -- target/rpc.sh@31 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:13.825 18:59:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:13.825 18:59:30 -- common/autotest_common.sh@10 -- # set +x 00:13:13.825 [2024-11-26 18:59:30.558933] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:13.825 18:59:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:13.825 18:59:30 -- target/rpc.sh@33 -- # rpc_cmd nvmf_get_stats 00:13:13.825 18:59:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:13.825 18:59:30 -- common/autotest_common.sh@10 -- # set +x 00:13:13.825 18:59:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:13.825 18:59:30 -- target/rpc.sh@33 -- # stats='{ 00:13:13.825 "tick_rate": 2300000000, 00:13:13.825 "poll_groups": [ 00:13:13.825 { 00:13:13.825 "name": "nvmf_tgt_poll_group_0", 00:13:13.825 "admin_qpairs": 0, 00:13:13.825 "io_qpairs": 0, 00:13:13.825 "current_admin_qpairs": 0, 00:13:13.825 "current_io_qpairs": 0, 00:13:13.825 "pending_bdev_io": 0, 00:13:13.825 "completed_nvme_io": 0, 00:13:13.825 "transports": [ 00:13:13.825 { 00:13:13.825 "trtype": "TCP" 00:13:13.825 } 00:13:13.825 ] 00:13:13.825 }, 00:13:13.825 { 00:13:13.825 "name": "nvmf_tgt_poll_group_1", 00:13:13.825 "admin_qpairs": 0, 00:13:13.825 "io_qpairs": 0, 00:13:13.825 "current_admin_qpairs": 0, 00:13:13.825 "current_io_qpairs": 0, 00:13:13.825 "pending_bdev_io": 0, 00:13:13.825 "completed_nvme_io": 0, 00:13:13.825 "transports": [ 00:13:13.825 { 00:13:13.825 "trtype": "TCP" 00:13:13.825 } 00:13:13.825 ] 00:13:13.825 }, 00:13:13.825 { 00:13:13.825 "name": "nvmf_tgt_poll_group_2", 00:13:13.825 "admin_qpairs": 0, 00:13:13.825 "io_qpairs": 0, 00:13:13.825 "current_admin_qpairs": 0, 00:13:13.825 "current_io_qpairs": 0, 00:13:13.825 "pending_bdev_io": 0, 00:13:13.825 "completed_nvme_io": 0, 00:13:13.825 "transports": [ 00:13:13.825 { 00:13:13.825 "trtype": "TCP" 00:13:13.825 } 00:13:13.825 ] 00:13:13.825 }, 00:13:13.825 { 00:13:13.825 "name": "nvmf_tgt_poll_group_3", 00:13:13.825 "admin_qpairs": 0, 00:13:13.825 "io_qpairs": 0, 00:13:13.825 "current_admin_qpairs": 0, 00:13:13.825 "current_io_qpairs": 0, 00:13:13.825 "pending_bdev_io": 0, 00:13:13.825 "completed_nvme_io": 0, 00:13:13.825 "transports": [ 00:13:13.825 { 00:13:13.825 "trtype": "TCP" 00:13:13.825 } 00:13:13.825 ] 00:13:13.825 } 00:13:13.825 ] 00:13:13.825 }' 00:13:13.825 18:59:30 -- target/rpc.sh@35 -- # jsum '.poll_groups[].admin_qpairs' 00:13:13.825 18:59:30 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:13:13.825 18:59:30 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:13.825 18:59:30 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:13:13.825 18:59:30 -- target/rpc.sh@35 -- # (( 0 == 0 )) 00:13:13.825 18:59:30 -- target/rpc.sh@36 -- # jsum '.poll_groups[].io_qpairs' 00:13:13.825 18:59:30 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:13:13.825 18:59:30 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:13:13.825 18:59:30 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:13.825 18:59:30 -- target/rpc.sh@36 -- # (( 0 == 0 )) 00:13:13.825 18:59:30 -- target/rpc.sh@38 -- # '[' rdma == tcp ']' 00:13:13.825 18:59:30 -- target/rpc.sh@46 -- # MALLOC_BDEV_SIZE=64 00:13:13.825 18:59:30 -- target/rpc.sh@47 -- # MALLOC_BLOCK_SIZE=512 00:13:13.825 18:59:30 -- target/rpc.sh@49 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:13:13.825 18:59:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:13.825 18:59:30 -- common/autotest_common.sh@10 -- # set +x 00:13:13.825 Malloc1 00:13:13.825 18:59:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:13.825 18:59:30 -- target/rpc.sh@52 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:13:13.825 18:59:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:13.825 18:59:30 -- common/autotest_common.sh@10 -- # set +x 00:13:13.825 18:59:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:13.825 18:59:30 -- target/rpc.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:13.825 18:59:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:13.825 18:59:30 -- common/autotest_common.sh@10 -- # set +x 00:13:13.825 18:59:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:13.825 18:59:30 -- target/rpc.sh@54 -- # rpc_cmd nvmf_subsystem_allow_any_host -d nqn.2016-06.io.spdk:cnode1 00:13:13.825 18:59:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:13.825 18:59:30 -- common/autotest_common.sh@10 -- # set +x 00:13:13.825 18:59:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:13.825 18:59:30 -- target/rpc.sh@55 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:13.825 18:59:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:13.825 18:59:30 -- common/autotest_common.sh@10 -- # set +x 00:13:13.825 [2024-11-26 18:59:30.727710] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:13.825 18:59:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:13.825 18:59:30 -- target/rpc.sh@58 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 -a 10.0.0.2 -s 4420 00:13:13.825 18:59:30 -- common/autotest_common.sh@650 -- # local es=0 00:13:13.825 18:59:30 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 -a 10.0.0.2 -s 4420 00:13:13.825 18:59:30 -- common/autotest_common.sh@638 -- # local arg=nvme 00:13:13.825 18:59:30 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:13.825 18:59:30 -- common/autotest_common.sh@642 -- # type -t nvme 00:13:13.825 18:59:30 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:13.825 18:59:30 -- common/autotest_common.sh@644 -- # type -P nvme 00:13:13.825 18:59:30 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:13.825 18:59:30 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:13:13.825 18:59:30 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:13:13.825 18:59:30 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 -a 10.0.0.2 -s 4420 00:13:14.084 [2024-11-26 18:59:30.756177] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562' 00:13:14.084 Failed to write to /dev/nvme-fabrics: Input/output error 00:13:14.084 could not add new controller: failed to write to nvme-fabrics device 00:13:14.084 18:59:30 -- common/autotest_common.sh@653 -- # es=1 00:13:14.084 18:59:30 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:13:14.084 18:59:30 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:13:14.084 18:59:30 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:13:14.084 18:59:30 -- target/rpc.sh@61 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:13:14.084 18:59:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:14.084 18:59:30 -- common/autotest_common.sh@10 -- # set +x 00:13:14.084 18:59:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:14.084 18:59:30 -- target/rpc.sh@62 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:15.460 18:59:31 -- target/rpc.sh@63 -- # waitforserial SPDKISFASTANDAWESOME 00:13:15.460 18:59:31 -- common/autotest_common.sh@1187 -- # local i=0 00:13:15.460 18:59:31 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:15.460 18:59:31 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:15.460 18:59:31 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:17.477 18:59:33 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:17.477 18:59:33 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:17.477 18:59:33 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:17.477 18:59:33 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:17.477 18:59:33 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:17.477 18:59:33 -- common/autotest_common.sh@1197 -- # return 0 00:13:17.477 18:59:33 -- target/rpc.sh@64 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:17.477 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:17.477 18:59:34 -- target/rpc.sh@65 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:17.477 18:59:34 -- common/autotest_common.sh@1208 -- # local i=0 00:13:17.477 18:59:34 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:17.477 18:59:34 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:17.477 18:59:34 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:17.477 18:59:34 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:17.477 18:59:34 -- common/autotest_common.sh@1220 -- # return 0 00:13:17.477 18:59:34 -- target/rpc.sh@68 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:13:17.477 18:59:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:17.477 18:59:34 -- common/autotest_common.sh@10 -- # set +x 00:13:17.477 18:59:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:17.477 18:59:34 -- target/rpc.sh@69 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:17.477 18:59:34 -- common/autotest_common.sh@650 -- # local es=0 00:13:17.477 18:59:34 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:17.477 18:59:34 -- common/autotest_common.sh@638 -- # local arg=nvme 00:13:17.477 18:59:34 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:17.477 18:59:34 -- common/autotest_common.sh@642 -- # type -t nvme 00:13:17.477 18:59:34 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:17.477 18:59:34 -- common/autotest_common.sh@644 -- # type -P nvme 00:13:17.477 18:59:34 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:17.477 18:59:34 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:13:17.477 18:59:34 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:13:17.477 18:59:34 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:17.477 [2024-11-26 18:59:34.110683] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562' 00:13:17.477 Failed to write to /dev/nvme-fabrics: Input/output error 00:13:17.477 could not add new controller: failed to write to nvme-fabrics device 00:13:17.477 18:59:34 -- common/autotest_common.sh@653 -- # es=1 00:13:17.477 18:59:34 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:13:17.477 18:59:34 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:13:17.477 18:59:34 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:13:17.477 18:59:34 -- target/rpc.sh@72 -- # rpc_cmd nvmf_subsystem_allow_any_host -e nqn.2016-06.io.spdk:cnode1 00:13:17.477 18:59:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:17.477 18:59:34 -- common/autotest_common.sh@10 -- # set +x 00:13:17.477 18:59:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:17.477 18:59:34 -- target/rpc.sh@73 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:18.437 18:59:35 -- target/rpc.sh@74 -- # waitforserial SPDKISFASTANDAWESOME 00:13:18.437 18:59:35 -- common/autotest_common.sh@1187 -- # local i=0 00:13:18.437 18:59:35 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:18.437 18:59:35 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:18.437 18:59:35 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:20.971 18:59:37 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:20.971 18:59:37 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:20.971 18:59:37 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:20.971 18:59:37 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:20.971 18:59:37 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:20.971 18:59:37 -- common/autotest_common.sh@1197 -- # return 0 00:13:20.971 18:59:37 -- target/rpc.sh@75 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:20.971 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:20.971 18:59:37 -- target/rpc.sh@76 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:20.971 18:59:37 -- common/autotest_common.sh@1208 -- # local i=0 00:13:20.971 18:59:37 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:20.971 18:59:37 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:20.971 18:59:37 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:20.971 18:59:37 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:20.971 18:59:37 -- common/autotest_common.sh@1220 -- # return 0 00:13:20.971 18:59:37 -- target/rpc.sh@78 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:20.971 18:59:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:20.971 18:59:37 -- common/autotest_common.sh@10 -- # set +x 00:13:20.971 18:59:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:20.971 18:59:37 -- target/rpc.sh@81 -- # seq 1 5 00:13:20.971 18:59:37 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:20.971 18:59:37 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:20.971 18:59:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:20.971 18:59:37 -- common/autotest_common.sh@10 -- # set +x 00:13:20.971 18:59:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:20.971 18:59:37 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:20.971 18:59:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:20.971 18:59:37 -- common/autotest_common.sh@10 -- # set +x 00:13:20.971 [2024-11-26 18:59:37.513214] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:20.971 18:59:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:20.971 18:59:37 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:20.971 18:59:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:20.971 18:59:37 -- common/autotest_common.sh@10 -- # set +x 00:13:20.971 18:59:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:20.971 18:59:37 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:20.971 18:59:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:20.971 18:59:37 -- common/autotest_common.sh@10 -- # set +x 00:13:20.971 18:59:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:20.972 18:59:37 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:21.908 18:59:38 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:21.908 18:59:38 -- common/autotest_common.sh@1187 -- # local i=0 00:13:21.908 18:59:38 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:21.908 18:59:38 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:21.908 18:59:38 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:23.813 18:59:40 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:23.813 18:59:40 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:23.813 18:59:40 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:23.813 18:59:40 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:23.813 18:59:40 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:23.813 18:59:40 -- common/autotest_common.sh@1197 -- # return 0 00:13:23.813 18:59:40 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:24.071 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:24.071 18:59:40 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:24.071 18:59:40 -- common/autotest_common.sh@1208 -- # local i=0 00:13:24.071 18:59:40 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:24.071 18:59:40 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:24.071 18:59:40 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:24.071 18:59:40 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:24.071 18:59:40 -- common/autotest_common.sh@1220 -- # return 0 00:13:24.071 18:59:40 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:24.071 18:59:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:24.071 18:59:40 -- common/autotest_common.sh@10 -- # set +x 00:13:24.071 18:59:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:24.071 18:59:40 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:24.071 18:59:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:24.071 18:59:40 -- common/autotest_common.sh@10 -- # set +x 00:13:24.071 18:59:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:24.071 18:59:40 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:24.071 18:59:40 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:24.071 18:59:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:24.071 18:59:40 -- common/autotest_common.sh@10 -- # set +x 00:13:24.071 18:59:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:24.071 18:59:40 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:24.071 18:59:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:24.071 18:59:40 -- common/autotest_common.sh@10 -- # set +x 00:13:24.071 [2024-11-26 18:59:40.855538] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:24.071 18:59:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:24.071 18:59:40 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:24.071 18:59:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:24.071 18:59:40 -- common/autotest_common.sh@10 -- # set +x 00:13:24.071 18:59:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:24.071 18:59:40 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:24.071 18:59:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:24.071 18:59:40 -- common/autotest_common.sh@10 -- # set +x 00:13:24.071 18:59:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:24.071 18:59:40 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:25.443 18:59:42 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:25.443 18:59:42 -- common/autotest_common.sh@1187 -- # local i=0 00:13:25.443 18:59:42 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:25.443 18:59:42 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:25.443 18:59:42 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:27.341 18:59:44 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:27.341 18:59:44 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:27.341 18:59:44 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:27.341 18:59:44 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:27.341 18:59:44 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:27.341 18:59:44 -- common/autotest_common.sh@1197 -- # return 0 00:13:27.341 18:59:44 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:27.342 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:27.342 18:59:44 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:27.342 18:59:44 -- common/autotest_common.sh@1208 -- # local i=0 00:13:27.342 18:59:44 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:27.342 18:59:44 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:27.342 18:59:44 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:27.342 18:59:44 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:27.342 18:59:44 -- common/autotest_common.sh@1220 -- # return 0 00:13:27.342 18:59:44 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:27.342 18:59:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:27.342 18:59:44 -- common/autotest_common.sh@10 -- # set +x 00:13:27.342 18:59:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:27.342 18:59:44 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:27.342 18:59:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:27.342 18:59:44 -- common/autotest_common.sh@10 -- # set +x 00:13:27.342 18:59:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:27.342 18:59:44 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:27.342 18:59:44 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:27.342 18:59:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:27.342 18:59:44 -- common/autotest_common.sh@10 -- # set +x 00:13:27.342 18:59:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:27.342 18:59:44 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:27.342 18:59:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:27.342 18:59:44 -- common/autotest_common.sh@10 -- # set +x 00:13:27.342 [2024-11-26 18:59:44.202217] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:27.342 18:59:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:27.342 18:59:44 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:27.342 18:59:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:27.342 18:59:44 -- common/autotest_common.sh@10 -- # set +x 00:13:27.342 18:59:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:27.342 18:59:44 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:27.342 18:59:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:27.342 18:59:44 -- common/autotest_common.sh@10 -- # set +x 00:13:27.342 18:59:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:27.342 18:59:44 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:28.719 18:59:45 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:28.719 18:59:45 -- common/autotest_common.sh@1187 -- # local i=0 00:13:28.719 18:59:45 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:28.719 18:59:45 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:28.719 18:59:45 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:30.623 18:59:47 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:30.624 18:59:47 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:30.624 18:59:47 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:30.624 18:59:47 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:30.624 18:59:47 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:30.624 18:59:47 -- common/autotest_common.sh@1197 -- # return 0 00:13:30.624 18:59:47 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:30.624 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:30.624 18:59:47 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:30.624 18:59:47 -- common/autotest_common.sh@1208 -- # local i=0 00:13:30.624 18:59:47 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:30.624 18:59:47 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:30.624 18:59:47 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:30.624 18:59:47 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:30.624 18:59:47 -- common/autotest_common.sh@1220 -- # return 0 00:13:30.624 18:59:47 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:30.624 18:59:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:30.624 18:59:47 -- common/autotest_common.sh@10 -- # set +x 00:13:30.624 18:59:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:30.624 18:59:47 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:30.624 18:59:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:30.624 18:59:47 -- common/autotest_common.sh@10 -- # set +x 00:13:30.624 18:59:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:30.624 18:59:47 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:30.624 18:59:47 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:30.624 18:59:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:30.624 18:59:47 -- common/autotest_common.sh@10 -- # set +x 00:13:30.882 18:59:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:30.882 18:59:47 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:30.883 18:59:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:30.883 18:59:47 -- common/autotest_common.sh@10 -- # set +x 00:13:30.883 [2024-11-26 18:59:47.557382] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:30.883 18:59:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:30.883 18:59:47 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:30.883 18:59:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:30.883 18:59:47 -- common/autotest_common.sh@10 -- # set +x 00:13:30.883 18:59:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:30.883 18:59:47 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:30.883 18:59:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:30.883 18:59:47 -- common/autotest_common.sh@10 -- # set +x 00:13:30.883 18:59:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:30.883 18:59:47 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:32.262 18:59:48 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:32.262 18:59:48 -- common/autotest_common.sh@1187 -- # local i=0 00:13:32.262 18:59:48 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:32.262 18:59:48 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:32.262 18:59:48 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:34.165 18:59:50 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:34.165 18:59:50 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:34.165 18:59:50 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:34.165 18:59:50 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:34.165 18:59:50 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:34.165 18:59:50 -- common/autotest_common.sh@1197 -- # return 0 00:13:34.165 18:59:50 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:34.165 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:34.165 18:59:50 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:34.165 18:59:50 -- common/autotest_common.sh@1208 -- # local i=0 00:13:34.165 18:59:50 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:34.165 18:59:50 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:34.165 18:59:50 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:34.165 18:59:50 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:34.165 18:59:50 -- common/autotest_common.sh@1220 -- # return 0 00:13:34.165 18:59:50 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:34.165 18:59:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.165 18:59:50 -- common/autotest_common.sh@10 -- # set +x 00:13:34.165 18:59:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.165 18:59:50 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:34.165 18:59:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.165 18:59:50 -- common/autotest_common.sh@10 -- # set +x 00:13:34.165 18:59:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.165 18:59:50 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:34.165 18:59:50 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:34.165 18:59:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.165 18:59:50 -- common/autotest_common.sh@10 -- # set +x 00:13:34.165 18:59:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.165 18:59:50 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:34.165 18:59:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.166 18:59:50 -- common/autotest_common.sh@10 -- # set +x 00:13:34.166 [2024-11-26 18:59:50.903417] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:34.166 18:59:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.166 18:59:50 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:34.166 18:59:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.166 18:59:50 -- common/autotest_common.sh@10 -- # set +x 00:13:34.166 18:59:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.166 18:59:50 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:34.166 18:59:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.166 18:59:50 -- common/autotest_common.sh@10 -- # set +x 00:13:34.166 18:59:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.166 18:59:50 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:35.102 18:59:52 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:35.102 18:59:52 -- common/autotest_common.sh@1187 -- # local i=0 00:13:35.102 18:59:52 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:35.102 18:59:52 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:35.102 18:59:52 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:37.637 18:59:54 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:37.638 18:59:54 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:37.638 18:59:54 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:37.638 18:59:54 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:37.638 18:59:54 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:37.638 18:59:54 -- common/autotest_common.sh@1197 -- # return 0 00:13:37.638 18:59:54 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:37.638 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:37.638 18:59:54 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:37.638 18:59:54 -- common/autotest_common.sh@1208 -- # local i=0 00:13:37.638 18:59:54 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:37.638 18:59:54 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:37.638 18:59:54 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:37.638 18:59:54 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:37.638 18:59:54 -- common/autotest_common.sh@1220 -- # return 0 00:13:37.638 18:59:54 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:37.638 18:59:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.638 18:59:54 -- common/autotest_common.sh@10 -- # set +x 00:13:37.638 18:59:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.638 18:59:54 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:37.638 18:59:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.638 18:59:54 -- common/autotest_common.sh@10 -- # set +x 00:13:37.638 18:59:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.638 18:59:54 -- target/rpc.sh@99 -- # seq 1 5 00:13:37.638 18:59:54 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:37.638 18:59:54 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:37.638 18:59:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.638 18:59:54 -- common/autotest_common.sh@10 -- # set +x 00:13:37.638 18:59:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.638 18:59:54 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:37.638 18:59:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.638 18:59:54 -- common/autotest_common.sh@10 -- # set +x 00:13:37.638 [2024-11-26 18:59:54.224908] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:37.638 18:59:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.638 18:59:54 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:37.638 18:59:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.638 18:59:54 -- common/autotest_common.sh@10 -- # set +x 00:13:37.638 18:59:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.638 18:59:54 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:37.638 18:59:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.638 18:59:54 -- common/autotest_common.sh@10 -- # set +x 00:13:37.638 18:59:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.638 18:59:54 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:37.638 18:59:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.638 18:59:54 -- common/autotest_common.sh@10 -- # set +x 00:13:37.638 18:59:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.638 18:59:54 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:37.638 18:59:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.638 18:59:54 -- common/autotest_common.sh@10 -- # set +x 00:13:37.638 18:59:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.638 18:59:54 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:37.638 18:59:54 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:37.638 18:59:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.638 18:59:54 -- common/autotest_common.sh@10 -- # set +x 00:13:37.638 18:59:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.638 18:59:54 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:37.638 18:59:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.638 18:59:54 -- common/autotest_common.sh@10 -- # set +x 00:13:37.638 [2024-11-26 18:59:54.273015] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:37.638 18:59:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.638 18:59:54 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:37.638 18:59:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.638 18:59:54 -- common/autotest_common.sh@10 -- # set +x 00:13:37.638 18:59:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.638 18:59:54 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:37.638 18:59:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.638 18:59:54 -- common/autotest_common.sh@10 -- # set +x 00:13:37.638 18:59:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.638 18:59:54 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:37.638 18:59:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.638 18:59:54 -- common/autotest_common.sh@10 -- # set +x 00:13:37.638 18:59:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.638 18:59:54 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:37.638 18:59:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.638 18:59:54 -- common/autotest_common.sh@10 -- # set +x 00:13:37.638 18:59:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.638 18:59:54 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:37.638 18:59:54 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:37.638 18:59:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.638 18:59:54 -- common/autotest_common.sh@10 -- # set +x 00:13:37.638 18:59:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.638 18:59:54 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:37.638 18:59:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.638 18:59:54 -- common/autotest_common.sh@10 -- # set +x 00:13:37.638 [2024-11-26 18:59:54.321158] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:37.638 18:59:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.638 18:59:54 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:37.638 18:59:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.638 18:59:54 -- common/autotest_common.sh@10 -- # set +x 00:13:37.638 18:59:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.638 18:59:54 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:37.638 18:59:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.638 18:59:54 -- common/autotest_common.sh@10 -- # set +x 00:13:37.638 18:59:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.638 18:59:54 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:37.638 18:59:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.638 18:59:54 -- common/autotest_common.sh@10 -- # set +x 00:13:37.638 18:59:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.638 18:59:54 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:37.638 18:59:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.638 18:59:54 -- common/autotest_common.sh@10 -- # set +x 00:13:37.638 18:59:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.638 18:59:54 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:37.638 18:59:54 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:37.638 18:59:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.638 18:59:54 -- common/autotest_common.sh@10 -- # set +x 00:13:37.638 18:59:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.638 18:59:54 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:37.638 18:59:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.638 18:59:54 -- common/autotest_common.sh@10 -- # set +x 00:13:37.638 [2024-11-26 18:59:54.369333] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:37.638 18:59:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.638 18:59:54 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:37.638 18:59:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.638 18:59:54 -- common/autotest_common.sh@10 -- # set +x 00:13:37.638 18:59:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.638 18:59:54 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:37.638 18:59:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.638 18:59:54 -- common/autotest_common.sh@10 -- # set +x 00:13:37.638 18:59:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.638 18:59:54 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:37.638 18:59:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.638 18:59:54 -- common/autotest_common.sh@10 -- # set +x 00:13:37.638 18:59:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.638 18:59:54 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:37.638 18:59:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.638 18:59:54 -- common/autotest_common.sh@10 -- # set +x 00:13:37.638 18:59:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.638 18:59:54 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:37.639 18:59:54 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:37.639 18:59:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.639 18:59:54 -- common/autotest_common.sh@10 -- # set +x 00:13:37.639 18:59:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.639 18:59:54 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:37.639 18:59:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.639 18:59:54 -- common/autotest_common.sh@10 -- # set +x 00:13:37.639 [2024-11-26 18:59:54.417468] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:37.639 18:59:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.639 18:59:54 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:37.639 18:59:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.639 18:59:54 -- common/autotest_common.sh@10 -- # set +x 00:13:37.639 18:59:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.639 18:59:54 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:37.639 18:59:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.639 18:59:54 -- common/autotest_common.sh@10 -- # set +x 00:13:37.639 18:59:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.639 18:59:54 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:37.639 18:59:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.639 18:59:54 -- common/autotest_common.sh@10 -- # set +x 00:13:37.639 18:59:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.639 18:59:54 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:37.639 18:59:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.639 18:59:54 -- common/autotest_common.sh@10 -- # set +x 00:13:37.639 18:59:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.639 18:59:54 -- target/rpc.sh@110 -- # rpc_cmd nvmf_get_stats 00:13:37.639 18:59:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.639 18:59:54 -- common/autotest_common.sh@10 -- # set +x 00:13:37.639 18:59:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.639 18:59:54 -- target/rpc.sh@110 -- # stats='{ 00:13:37.639 "tick_rate": 2300000000, 00:13:37.639 "poll_groups": [ 00:13:37.639 { 00:13:37.639 "name": "nvmf_tgt_poll_group_0", 00:13:37.639 "admin_qpairs": 2, 00:13:37.639 "io_qpairs": 168, 00:13:37.639 "current_admin_qpairs": 0, 00:13:37.639 "current_io_qpairs": 0, 00:13:37.639 "pending_bdev_io": 0, 00:13:37.639 "completed_nvme_io": 225, 00:13:37.639 "transports": [ 00:13:37.639 { 00:13:37.639 "trtype": "TCP" 00:13:37.639 } 00:13:37.639 ] 00:13:37.639 }, 00:13:37.639 { 00:13:37.639 "name": "nvmf_tgt_poll_group_1", 00:13:37.639 "admin_qpairs": 2, 00:13:37.639 "io_qpairs": 168, 00:13:37.639 "current_admin_qpairs": 0, 00:13:37.639 "current_io_qpairs": 0, 00:13:37.639 "pending_bdev_io": 0, 00:13:37.639 "completed_nvme_io": 267, 00:13:37.639 "transports": [ 00:13:37.639 { 00:13:37.639 "trtype": "TCP" 00:13:37.639 } 00:13:37.639 ] 00:13:37.639 }, 00:13:37.639 { 00:13:37.639 "name": "nvmf_tgt_poll_group_2", 00:13:37.639 "admin_qpairs": 1, 00:13:37.639 "io_qpairs": 168, 00:13:37.639 "current_admin_qpairs": 0, 00:13:37.639 "current_io_qpairs": 0, 00:13:37.639 "pending_bdev_io": 0, 00:13:37.639 "completed_nvme_io": 309, 00:13:37.639 "transports": [ 00:13:37.639 { 00:13:37.639 "trtype": "TCP" 00:13:37.639 } 00:13:37.639 ] 00:13:37.639 }, 00:13:37.639 { 00:13:37.639 "name": "nvmf_tgt_poll_group_3", 00:13:37.639 "admin_qpairs": 2, 00:13:37.639 "io_qpairs": 168, 00:13:37.639 "current_admin_qpairs": 0, 00:13:37.639 "current_io_qpairs": 0, 00:13:37.639 "pending_bdev_io": 0, 00:13:37.639 "completed_nvme_io": 221, 00:13:37.639 "transports": [ 00:13:37.639 { 00:13:37.639 "trtype": "TCP" 00:13:37.639 } 00:13:37.639 ] 00:13:37.639 } 00:13:37.639 ] 00:13:37.639 }' 00:13:37.639 18:59:54 -- target/rpc.sh@112 -- # jsum '.poll_groups[].admin_qpairs' 00:13:37.639 18:59:54 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:13:37.639 18:59:54 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:13:37.639 18:59:54 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:37.639 18:59:54 -- target/rpc.sh@112 -- # (( 7 > 0 )) 00:13:37.639 18:59:54 -- target/rpc.sh@113 -- # jsum '.poll_groups[].io_qpairs' 00:13:37.639 18:59:54 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:13:37.639 18:59:54 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:13:37.639 18:59:54 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:37.898 18:59:54 -- target/rpc.sh@113 -- # (( 672 > 0 )) 00:13:37.898 18:59:54 -- target/rpc.sh@115 -- # '[' rdma == tcp ']' 00:13:37.898 18:59:54 -- target/rpc.sh@121 -- # trap - SIGINT SIGTERM EXIT 00:13:37.898 18:59:54 -- target/rpc.sh@123 -- # nvmftestfini 00:13:37.898 18:59:54 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:37.898 18:59:54 -- nvmf/common.sh@116 -- # sync 00:13:37.898 18:59:54 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:37.898 18:59:54 -- nvmf/common.sh@119 -- # set +e 00:13:37.898 18:59:54 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:37.898 18:59:54 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:37.898 rmmod nvme_tcp 00:13:37.898 rmmod nvme_fabrics 00:13:37.898 rmmod nvme_keyring 00:13:37.898 18:59:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:37.898 18:59:54 -- nvmf/common.sh@123 -- # set -e 00:13:37.898 18:59:54 -- nvmf/common.sh@124 -- # return 0 00:13:37.898 18:59:54 -- nvmf/common.sh@477 -- # '[' -n 3020222 ']' 00:13:37.898 18:59:54 -- nvmf/common.sh@478 -- # killprocess 3020222 00:13:37.898 18:59:54 -- common/autotest_common.sh@936 -- # '[' -z 3020222 ']' 00:13:37.898 18:59:54 -- common/autotest_common.sh@940 -- # kill -0 3020222 00:13:37.898 18:59:54 -- common/autotest_common.sh@941 -- # uname 00:13:37.898 18:59:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:37.898 18:59:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3020222 00:13:37.898 18:59:54 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:37.898 18:59:54 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:37.898 18:59:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3020222' 00:13:37.898 killing process with pid 3020222 00:13:37.898 18:59:54 -- common/autotest_common.sh@955 -- # kill 3020222 00:13:37.898 18:59:54 -- common/autotest_common.sh@960 -- # wait 3020222 00:13:38.158 18:59:54 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:38.158 18:59:54 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:38.158 18:59:54 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:38.158 18:59:54 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:38.158 18:59:54 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:38.158 18:59:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:38.158 18:59:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:38.158 18:59:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:40.064 18:59:56 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:40.064 00:13:40.064 real 0m33.261s 00:13:40.064 user 1m42.013s 00:13:40.064 sys 0m6.313s 00:13:40.064 18:59:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:40.064 18:59:56 -- common/autotest_common.sh@10 -- # set +x 00:13:40.064 ************************************ 00:13:40.064 END TEST nvmf_rpc 00:13:40.064 ************************************ 00:13:40.064 18:59:56 -- nvmf/nvmf.sh@30 -- # run_test nvmf_invalid /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:13:40.064 18:59:56 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:40.064 18:59:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:40.064 18:59:56 -- common/autotest_common.sh@10 -- # set +x 00:13:40.064 ************************************ 00:13:40.064 START TEST nvmf_invalid 00:13:40.064 ************************************ 00:13:40.064 18:59:56 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:13:40.323 * Looking for test storage... 00:13:40.323 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:40.323 18:59:57 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:40.323 18:59:57 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:40.323 18:59:57 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:40.323 18:59:57 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:40.323 18:59:57 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:40.323 18:59:57 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:40.323 18:59:57 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:40.323 18:59:57 -- scripts/common.sh@335 -- # IFS=.-: 00:13:40.323 18:59:57 -- scripts/common.sh@335 -- # read -ra ver1 00:13:40.323 18:59:57 -- scripts/common.sh@336 -- # IFS=.-: 00:13:40.323 18:59:57 -- scripts/common.sh@336 -- # read -ra ver2 00:13:40.323 18:59:57 -- scripts/common.sh@337 -- # local 'op=<' 00:13:40.323 18:59:57 -- scripts/common.sh@339 -- # ver1_l=2 00:13:40.323 18:59:57 -- scripts/common.sh@340 -- # ver2_l=1 00:13:40.323 18:59:57 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:40.323 18:59:57 -- scripts/common.sh@343 -- # case "$op" in 00:13:40.323 18:59:57 -- scripts/common.sh@344 -- # : 1 00:13:40.323 18:59:57 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:40.323 18:59:57 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:40.323 18:59:57 -- scripts/common.sh@364 -- # decimal 1 00:13:40.323 18:59:57 -- scripts/common.sh@352 -- # local d=1 00:13:40.323 18:59:57 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:40.323 18:59:57 -- scripts/common.sh@354 -- # echo 1 00:13:40.323 18:59:57 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:40.323 18:59:57 -- scripts/common.sh@365 -- # decimal 2 00:13:40.323 18:59:57 -- scripts/common.sh@352 -- # local d=2 00:13:40.323 18:59:57 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:40.323 18:59:57 -- scripts/common.sh@354 -- # echo 2 00:13:40.323 18:59:57 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:40.323 18:59:57 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:40.323 18:59:57 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:40.323 18:59:57 -- scripts/common.sh@367 -- # return 0 00:13:40.323 18:59:57 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:40.323 18:59:57 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:40.323 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:40.323 --rc genhtml_branch_coverage=1 00:13:40.323 --rc genhtml_function_coverage=1 00:13:40.323 --rc genhtml_legend=1 00:13:40.323 --rc geninfo_all_blocks=1 00:13:40.323 --rc geninfo_unexecuted_blocks=1 00:13:40.323 00:13:40.323 ' 00:13:40.323 18:59:57 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:40.323 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:40.323 --rc genhtml_branch_coverage=1 00:13:40.323 --rc genhtml_function_coverage=1 00:13:40.323 --rc genhtml_legend=1 00:13:40.323 --rc geninfo_all_blocks=1 00:13:40.323 --rc geninfo_unexecuted_blocks=1 00:13:40.323 00:13:40.323 ' 00:13:40.323 18:59:57 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:40.323 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:40.323 --rc genhtml_branch_coverage=1 00:13:40.323 --rc genhtml_function_coverage=1 00:13:40.323 --rc genhtml_legend=1 00:13:40.323 --rc geninfo_all_blocks=1 00:13:40.323 --rc geninfo_unexecuted_blocks=1 00:13:40.323 00:13:40.323 ' 00:13:40.323 18:59:57 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:40.323 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:40.323 --rc genhtml_branch_coverage=1 00:13:40.323 --rc genhtml_function_coverage=1 00:13:40.323 --rc genhtml_legend=1 00:13:40.323 --rc geninfo_all_blocks=1 00:13:40.323 --rc geninfo_unexecuted_blocks=1 00:13:40.323 00:13:40.323 ' 00:13:40.324 18:59:57 -- target/invalid.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:40.324 18:59:57 -- nvmf/common.sh@7 -- # uname -s 00:13:40.324 18:59:57 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:40.324 18:59:57 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:40.324 18:59:57 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:40.324 18:59:57 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:40.324 18:59:57 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:40.324 18:59:57 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:40.324 18:59:57 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:40.324 18:59:57 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:40.324 18:59:57 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:40.324 18:59:57 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:40.324 18:59:57 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:13:40.324 18:59:57 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:13:40.324 18:59:57 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:40.324 18:59:57 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:40.324 18:59:57 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:40.324 18:59:57 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:40.324 18:59:57 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:40.324 18:59:57 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:40.324 18:59:57 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:40.324 18:59:57 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:40.324 18:59:57 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:40.324 18:59:57 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:40.324 18:59:57 -- paths/export.sh@5 -- # export PATH 00:13:40.324 18:59:57 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:40.324 18:59:57 -- nvmf/common.sh@46 -- # : 0 00:13:40.324 18:59:57 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:40.324 18:59:57 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:40.324 18:59:57 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:40.324 18:59:57 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:40.324 18:59:57 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:40.324 18:59:57 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:40.324 18:59:57 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:40.324 18:59:57 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:40.324 18:59:57 -- target/invalid.sh@11 -- # multi_target_rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:13:40.324 18:59:57 -- target/invalid.sh@12 -- # rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:13:40.324 18:59:57 -- target/invalid.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode 00:13:40.324 18:59:57 -- target/invalid.sh@14 -- # target=foobar 00:13:40.324 18:59:57 -- target/invalid.sh@16 -- # RANDOM=0 00:13:40.324 18:59:57 -- target/invalid.sh@34 -- # nvmftestinit 00:13:40.324 18:59:57 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:40.324 18:59:57 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:40.324 18:59:57 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:40.324 18:59:57 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:40.324 18:59:57 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:40.324 18:59:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:40.324 18:59:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:40.324 18:59:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:40.324 18:59:57 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:40.324 18:59:57 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:40.324 18:59:57 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:40.324 18:59:57 -- common/autotest_common.sh@10 -- # set +x 00:13:45.606 19:00:02 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:45.606 19:00:02 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:45.606 19:00:02 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:45.606 19:00:02 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:45.606 19:00:02 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:45.606 19:00:02 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:45.606 19:00:02 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:45.606 19:00:02 -- nvmf/common.sh@294 -- # net_devs=() 00:13:45.606 19:00:02 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:45.606 19:00:02 -- nvmf/common.sh@295 -- # e810=() 00:13:45.606 19:00:02 -- nvmf/common.sh@295 -- # local -ga e810 00:13:45.606 19:00:02 -- nvmf/common.sh@296 -- # x722=() 00:13:45.606 19:00:02 -- nvmf/common.sh@296 -- # local -ga x722 00:13:45.606 19:00:02 -- nvmf/common.sh@297 -- # mlx=() 00:13:45.606 19:00:02 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:45.606 19:00:02 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:45.606 19:00:02 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:45.606 19:00:02 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:45.606 19:00:02 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:45.606 19:00:02 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:45.606 19:00:02 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:45.606 19:00:02 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:45.606 19:00:02 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:45.606 19:00:02 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:45.606 19:00:02 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:45.606 19:00:02 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:45.606 19:00:02 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:45.606 19:00:02 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:45.606 19:00:02 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:45.606 19:00:02 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:45.606 19:00:02 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:45.606 19:00:02 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:45.606 19:00:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:45.606 19:00:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:13:45.606 Found 0000:86:00.0 (0x8086 - 0x159b) 00:13:45.606 19:00:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:45.606 19:00:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:45.606 19:00:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:45.606 19:00:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:45.606 19:00:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:45.606 19:00:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:45.606 19:00:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:13:45.606 Found 0000:86:00.1 (0x8086 - 0x159b) 00:13:45.606 19:00:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:45.606 19:00:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:45.606 19:00:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:45.606 19:00:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:45.606 19:00:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:45.606 19:00:02 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:45.606 19:00:02 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:45.606 19:00:02 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:45.606 19:00:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:45.606 19:00:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:45.606 19:00:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:45.606 19:00:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:45.606 19:00:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:13:45.606 Found net devices under 0000:86:00.0: cvl_0_0 00:13:45.606 19:00:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:45.606 19:00:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:45.606 19:00:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:45.606 19:00:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:45.606 19:00:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:45.606 19:00:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:13:45.606 Found net devices under 0000:86:00.1: cvl_0_1 00:13:45.606 19:00:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:45.606 19:00:02 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:45.606 19:00:02 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:45.606 19:00:02 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:45.606 19:00:02 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:45.606 19:00:02 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:45.606 19:00:02 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:45.606 19:00:02 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:45.606 19:00:02 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:45.606 19:00:02 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:45.606 19:00:02 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:45.606 19:00:02 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:45.606 19:00:02 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:45.606 19:00:02 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:45.606 19:00:02 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:45.606 19:00:02 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:45.606 19:00:02 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:45.606 19:00:02 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:45.606 19:00:02 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:45.606 19:00:02 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:45.606 19:00:02 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:45.866 19:00:02 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:45.866 19:00:02 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:45.866 19:00:02 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:45.866 19:00:02 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:45.866 19:00:02 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:45.866 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:45.866 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.330 ms 00:13:45.866 00:13:45.866 --- 10.0.0.2 ping statistics --- 00:13:45.866 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:45.866 rtt min/avg/max/mdev = 0.330/0.330/0.330/0.000 ms 00:13:45.866 19:00:02 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:45.866 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:45.866 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.233 ms 00:13:45.866 00:13:45.866 --- 10.0.0.1 ping statistics --- 00:13:45.866 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:45.866 rtt min/avg/max/mdev = 0.233/0.233/0.233/0.000 ms 00:13:45.866 19:00:02 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:45.866 19:00:02 -- nvmf/common.sh@410 -- # return 0 00:13:45.866 19:00:02 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:45.866 19:00:02 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:45.866 19:00:02 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:45.866 19:00:02 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:45.866 19:00:02 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:45.866 19:00:02 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:45.866 19:00:02 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:45.866 19:00:02 -- target/invalid.sh@35 -- # nvmfappstart -m 0xF 00:13:45.866 19:00:02 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:45.866 19:00:02 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:45.866 19:00:02 -- common/autotest_common.sh@10 -- # set +x 00:13:45.866 19:00:02 -- nvmf/common.sh@469 -- # nvmfpid=3028143 00:13:45.866 19:00:02 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:13:45.866 19:00:02 -- nvmf/common.sh@470 -- # waitforlisten 3028143 00:13:45.866 19:00:02 -- common/autotest_common.sh@829 -- # '[' -z 3028143 ']' 00:13:45.866 19:00:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:45.866 19:00:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:45.866 19:00:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:45.866 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:45.866 19:00:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:45.866 19:00:02 -- common/autotest_common.sh@10 -- # set +x 00:13:45.866 [2024-11-26 19:00:02.723197] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:13:45.866 [2024-11-26 19:00:02.723244] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:45.866 EAL: No free 2048 kB hugepages reported on node 1 00:13:45.866 [2024-11-26 19:00:02.781863] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:46.126 [2024-11-26 19:00:02.822222] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:46.126 [2024-11-26 19:00:02.822334] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:46.126 [2024-11-26 19:00:02.822343] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:46.126 [2024-11-26 19:00:02.822349] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:46.126 [2024-11-26 19:00:02.822390] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:46.126 [2024-11-26 19:00:02.822562] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:46.126 [2024-11-26 19:00:02.822632] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:46.126 [2024-11-26 19:00:02.822633] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:46.693 19:00:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:46.693 19:00:03 -- common/autotest_common.sh@862 -- # return 0 00:13:46.693 19:00:03 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:46.693 19:00:03 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:46.693 19:00:03 -- common/autotest_common.sh@10 -- # set +x 00:13:46.693 19:00:03 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:46.693 19:00:03 -- target/invalid.sh@37 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:13:46.693 19:00:03 -- target/invalid.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -t foobar nqn.2016-06.io.spdk:cnode1274 00:13:46.952 [2024-11-26 19:00:03.759957] nvmf_rpc.c: 401:rpc_nvmf_create_subsystem: *ERROR*: Unable to find target foobar 00:13:46.952 19:00:03 -- target/invalid.sh@40 -- # out='request: 00:13:46.952 { 00:13:46.952 "nqn": "nqn.2016-06.io.spdk:cnode1274", 00:13:46.952 "tgt_name": "foobar", 00:13:46.952 "method": "nvmf_create_subsystem", 00:13:46.952 "req_id": 1 00:13:46.952 } 00:13:46.952 Got JSON-RPC error response 00:13:46.952 response: 00:13:46.952 { 00:13:46.952 "code": -32603, 00:13:46.952 "message": "Unable to find target foobar" 00:13:46.952 }' 00:13:46.952 19:00:03 -- target/invalid.sh@41 -- # [[ request: 00:13:46.952 { 00:13:46.952 "nqn": "nqn.2016-06.io.spdk:cnode1274", 00:13:46.952 "tgt_name": "foobar", 00:13:46.952 "method": "nvmf_create_subsystem", 00:13:46.952 "req_id": 1 00:13:46.952 } 00:13:46.952 Got JSON-RPC error response 00:13:46.952 response: 00:13:46.952 { 00:13:46.952 "code": -32603, 00:13:46.952 "message": "Unable to find target foobar" 00:13:46.952 } == *\U\n\a\b\l\e\ \t\o\ \f\i\n\d\ \t\a\r\g\e\t* ]] 00:13:46.952 19:00:03 -- target/invalid.sh@45 -- # echo -e '\x1f' 00:13:46.952 19:00:03 -- target/invalid.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s $'SPDKISFASTANDAWESOME\037' nqn.2016-06.io.spdk:cnode14402 00:13:47.211 [2024-11-26 19:00:03.960667] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode14402: invalid serial number 'SPDKISFASTANDAWESOME' 00:13:47.211 19:00:03 -- target/invalid.sh@45 -- # out='request: 00:13:47.211 { 00:13:47.211 "nqn": "nqn.2016-06.io.spdk:cnode14402", 00:13:47.211 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:13:47.211 "method": "nvmf_create_subsystem", 00:13:47.211 "req_id": 1 00:13:47.211 } 00:13:47.211 Got JSON-RPC error response 00:13:47.211 response: 00:13:47.211 { 00:13:47.211 "code": -32602, 00:13:47.211 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:13:47.211 }' 00:13:47.211 19:00:03 -- target/invalid.sh@46 -- # [[ request: 00:13:47.211 { 00:13:47.211 "nqn": "nqn.2016-06.io.spdk:cnode14402", 00:13:47.211 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:13:47.211 "method": "nvmf_create_subsystem", 00:13:47.211 "req_id": 1 00:13:47.211 } 00:13:47.211 Got JSON-RPC error response 00:13:47.211 response: 00:13:47.211 { 00:13:47.211 "code": -32602, 00:13:47.211 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:13:47.211 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:13:47.211 19:00:03 -- target/invalid.sh@50 -- # echo -e '\x1f' 00:13:47.211 19:00:03 -- target/invalid.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d $'SPDK_Controller\037' nqn.2016-06.io.spdk:cnode1452 00:13:47.470 [2024-11-26 19:00:04.161303] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode1452: invalid model number 'SPDK_Controller' 00:13:47.470 19:00:04 -- target/invalid.sh@50 -- # out='request: 00:13:47.470 { 00:13:47.470 "nqn": "nqn.2016-06.io.spdk:cnode1452", 00:13:47.470 "model_number": "SPDK_Controller\u001f", 00:13:47.470 "method": "nvmf_create_subsystem", 00:13:47.470 "req_id": 1 00:13:47.470 } 00:13:47.470 Got JSON-RPC error response 00:13:47.470 response: 00:13:47.470 { 00:13:47.470 "code": -32602, 00:13:47.470 "message": "Invalid MN SPDK_Controller\u001f" 00:13:47.470 }' 00:13:47.470 19:00:04 -- target/invalid.sh@51 -- # [[ request: 00:13:47.470 { 00:13:47.470 "nqn": "nqn.2016-06.io.spdk:cnode1452", 00:13:47.470 "model_number": "SPDK_Controller\u001f", 00:13:47.470 "method": "nvmf_create_subsystem", 00:13:47.470 "req_id": 1 00:13:47.470 } 00:13:47.470 Got JSON-RPC error response 00:13:47.470 response: 00:13:47.470 { 00:13:47.470 "code": -32602, 00:13:47.470 "message": "Invalid MN SPDK_Controller\u001f" 00:13:47.470 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:13:47.470 19:00:04 -- target/invalid.sh@54 -- # gen_random_s 21 00:13:47.470 19:00:04 -- target/invalid.sh@19 -- # local length=21 ll 00:13:47.470 19:00:04 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:13:47.470 19:00:04 -- target/invalid.sh@21 -- # local chars 00:13:47.470 19:00:04 -- target/invalid.sh@22 -- # local string 00:13:47.470 19:00:04 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:13:47.470 19:00:04 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:47.470 19:00:04 -- target/invalid.sh@25 -- # printf %x 125 00:13:47.470 19:00:04 -- target/invalid.sh@25 -- # echo -e '\x7d' 00:13:47.470 19:00:04 -- target/invalid.sh@25 -- # string+='}' 00:13:47.470 19:00:04 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:47.470 19:00:04 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:47.470 19:00:04 -- target/invalid.sh@25 -- # printf %x 55 00:13:47.470 19:00:04 -- target/invalid.sh@25 -- # echo -e '\x37' 00:13:47.470 19:00:04 -- target/invalid.sh@25 -- # string+=7 00:13:47.470 19:00:04 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:47.470 19:00:04 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:47.470 19:00:04 -- target/invalid.sh@25 -- # printf %x 68 00:13:47.470 19:00:04 -- target/invalid.sh@25 -- # echo -e '\x44' 00:13:47.470 19:00:04 -- target/invalid.sh@25 -- # string+=D 00:13:47.470 19:00:04 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:47.470 19:00:04 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:47.470 19:00:04 -- target/invalid.sh@25 -- # printf %x 89 00:13:47.470 19:00:04 -- target/invalid.sh@25 -- # echo -e '\x59' 00:13:47.470 19:00:04 -- target/invalid.sh@25 -- # string+=Y 00:13:47.470 19:00:04 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:47.471 19:00:04 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:47.471 19:00:04 -- target/invalid.sh@25 -- # printf %x 119 00:13:47.471 19:00:04 -- target/invalid.sh@25 -- # echo -e '\x77' 00:13:47.471 19:00:04 -- target/invalid.sh@25 -- # string+=w 00:13:47.471 19:00:04 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:47.471 19:00:04 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:47.471 19:00:04 -- target/invalid.sh@25 -- # printf %x 106 00:13:47.471 19:00:04 -- target/invalid.sh@25 -- # echo -e '\x6a' 00:13:47.471 19:00:04 -- target/invalid.sh@25 -- # string+=j 00:13:47.471 19:00:04 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:47.471 19:00:04 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:47.471 19:00:04 -- target/invalid.sh@25 -- # printf %x 42 00:13:47.471 19:00:04 -- target/invalid.sh@25 -- # echo -e '\x2a' 00:13:47.471 19:00:04 -- target/invalid.sh@25 -- # string+='*' 00:13:47.471 19:00:04 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:47.471 19:00:04 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:47.471 19:00:04 -- target/invalid.sh@25 -- # printf %x 121 00:13:47.471 19:00:04 -- target/invalid.sh@25 -- # echo -e '\x79' 00:13:47.471 19:00:04 -- target/invalid.sh@25 -- # string+=y 00:13:47.471 19:00:04 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:47.471 19:00:04 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:47.471 19:00:04 -- target/invalid.sh@25 -- # printf %x 85 00:13:47.471 19:00:04 -- target/invalid.sh@25 -- # echo -e '\x55' 00:13:47.471 19:00:04 -- target/invalid.sh@25 -- # string+=U 00:13:47.471 19:00:04 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:47.471 19:00:04 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:47.471 19:00:04 -- target/invalid.sh@25 -- # printf %x 34 00:13:47.471 19:00:04 -- target/invalid.sh@25 -- # echo -e '\x22' 00:13:47.471 19:00:04 -- target/invalid.sh@25 -- # string+='"' 00:13:47.471 19:00:04 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:47.471 19:00:04 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:47.471 19:00:04 -- target/invalid.sh@25 -- # printf %x 60 00:13:47.471 19:00:04 -- target/invalid.sh@25 -- # echo -e '\x3c' 00:13:47.471 19:00:04 -- target/invalid.sh@25 -- # string+='<' 00:13:47.471 19:00:04 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:47.471 19:00:04 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:47.471 19:00:04 -- target/invalid.sh@25 -- # printf %x 98 00:13:47.471 19:00:04 -- target/invalid.sh@25 -- # echo -e '\x62' 00:13:47.471 19:00:04 -- target/invalid.sh@25 -- # string+=b 00:13:47.471 19:00:04 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:47.471 19:00:04 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:47.471 19:00:04 -- target/invalid.sh@25 -- # printf %x 97 00:13:47.471 19:00:04 -- target/invalid.sh@25 -- # echo -e '\x61' 00:13:47.471 19:00:04 -- target/invalid.sh@25 -- # string+=a 00:13:47.471 19:00:04 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:47.471 19:00:04 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:47.471 19:00:04 -- target/invalid.sh@25 -- # printf %x 80 00:13:47.471 19:00:04 -- target/invalid.sh@25 -- # echo -e '\x50' 00:13:47.471 19:00:04 -- target/invalid.sh@25 -- # string+=P 00:13:47.471 19:00:04 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:47.471 19:00:04 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:47.471 19:00:04 -- target/invalid.sh@25 -- # printf %x 45 00:13:47.471 19:00:04 -- target/invalid.sh@25 -- # echo -e '\x2d' 00:13:47.471 19:00:04 -- target/invalid.sh@25 -- # string+=- 00:13:47.471 19:00:04 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:47.471 19:00:04 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:47.471 19:00:04 -- target/invalid.sh@25 -- # printf %x 33 00:13:47.471 19:00:04 -- target/invalid.sh@25 -- # echo -e '\x21' 00:13:47.471 19:00:04 -- target/invalid.sh@25 -- # string+='!' 00:13:47.471 19:00:04 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:47.471 19:00:04 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:47.471 19:00:04 -- target/invalid.sh@25 -- # printf %x 49 00:13:47.471 19:00:04 -- target/invalid.sh@25 -- # echo -e '\x31' 00:13:47.471 19:00:04 -- target/invalid.sh@25 -- # string+=1 00:13:47.471 19:00:04 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:47.471 19:00:04 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:47.471 19:00:04 -- target/invalid.sh@25 -- # printf %x 85 00:13:47.471 19:00:04 -- target/invalid.sh@25 -- # echo -e '\x55' 00:13:47.471 19:00:04 -- target/invalid.sh@25 -- # string+=U 00:13:47.471 19:00:04 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:47.471 19:00:04 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:47.471 19:00:04 -- target/invalid.sh@25 -- # printf %x 92 00:13:47.471 19:00:04 -- target/invalid.sh@25 -- # echo -e '\x5c' 00:13:47.471 19:00:04 -- target/invalid.sh@25 -- # string+='\' 00:13:47.471 19:00:04 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:47.471 19:00:04 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:47.471 19:00:04 -- target/invalid.sh@25 -- # printf %x 58 00:13:47.471 19:00:04 -- target/invalid.sh@25 -- # echo -e '\x3a' 00:13:47.471 19:00:04 -- target/invalid.sh@25 -- # string+=: 00:13:47.471 19:00:04 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:47.471 19:00:04 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:47.471 19:00:04 -- target/invalid.sh@25 -- # printf %x 116 00:13:47.471 19:00:04 -- target/invalid.sh@25 -- # echo -e '\x74' 00:13:47.471 19:00:04 -- target/invalid.sh@25 -- # string+=t 00:13:47.471 19:00:04 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:47.471 19:00:04 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:47.471 19:00:04 -- target/invalid.sh@28 -- # [[ } == \- ]] 00:13:47.471 19:00:04 -- target/invalid.sh@31 -- # echo '}7DYwj*yU" /dev/null' 00:13:50.320 19:00:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:52.224 19:00:09 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:52.224 00:13:52.224 real 0m12.082s 00:13:52.224 user 0m20.715s 00:13:52.224 sys 0m5.132s 00:13:52.224 19:00:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:52.224 19:00:09 -- common/autotest_common.sh@10 -- # set +x 00:13:52.224 ************************************ 00:13:52.224 END TEST nvmf_invalid 00:13:52.224 ************************************ 00:13:52.224 19:00:09 -- nvmf/nvmf.sh@31 -- # run_test nvmf_abort /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:13:52.224 19:00:09 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:52.224 19:00:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:52.224 19:00:09 -- common/autotest_common.sh@10 -- # set +x 00:13:52.224 ************************************ 00:13:52.224 START TEST nvmf_abort 00:13:52.224 ************************************ 00:13:52.224 19:00:09 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:13:52.482 * Looking for test storage... 00:13:52.482 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:52.482 19:00:09 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:52.482 19:00:09 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:52.482 19:00:09 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:52.482 19:00:09 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:52.482 19:00:09 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:52.482 19:00:09 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:52.482 19:00:09 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:52.482 19:00:09 -- scripts/common.sh@335 -- # IFS=.-: 00:13:52.482 19:00:09 -- scripts/common.sh@335 -- # read -ra ver1 00:13:52.482 19:00:09 -- scripts/common.sh@336 -- # IFS=.-: 00:13:52.482 19:00:09 -- scripts/common.sh@336 -- # read -ra ver2 00:13:52.482 19:00:09 -- scripts/common.sh@337 -- # local 'op=<' 00:13:52.482 19:00:09 -- scripts/common.sh@339 -- # ver1_l=2 00:13:52.482 19:00:09 -- scripts/common.sh@340 -- # ver2_l=1 00:13:52.482 19:00:09 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:52.482 19:00:09 -- scripts/common.sh@343 -- # case "$op" in 00:13:52.482 19:00:09 -- scripts/common.sh@344 -- # : 1 00:13:52.482 19:00:09 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:52.482 19:00:09 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:52.482 19:00:09 -- scripts/common.sh@364 -- # decimal 1 00:13:52.482 19:00:09 -- scripts/common.sh@352 -- # local d=1 00:13:52.482 19:00:09 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:52.482 19:00:09 -- scripts/common.sh@354 -- # echo 1 00:13:52.482 19:00:09 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:52.482 19:00:09 -- scripts/common.sh@365 -- # decimal 2 00:13:52.482 19:00:09 -- scripts/common.sh@352 -- # local d=2 00:13:52.482 19:00:09 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:52.482 19:00:09 -- scripts/common.sh@354 -- # echo 2 00:13:52.482 19:00:09 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:52.482 19:00:09 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:52.482 19:00:09 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:52.482 19:00:09 -- scripts/common.sh@367 -- # return 0 00:13:52.482 19:00:09 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:52.482 19:00:09 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:52.482 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:52.482 --rc genhtml_branch_coverage=1 00:13:52.482 --rc genhtml_function_coverage=1 00:13:52.482 --rc genhtml_legend=1 00:13:52.482 --rc geninfo_all_blocks=1 00:13:52.482 --rc geninfo_unexecuted_blocks=1 00:13:52.482 00:13:52.482 ' 00:13:52.482 19:00:09 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:52.482 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:52.482 --rc genhtml_branch_coverage=1 00:13:52.482 --rc genhtml_function_coverage=1 00:13:52.482 --rc genhtml_legend=1 00:13:52.482 --rc geninfo_all_blocks=1 00:13:52.482 --rc geninfo_unexecuted_blocks=1 00:13:52.482 00:13:52.482 ' 00:13:52.482 19:00:09 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:52.482 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:52.482 --rc genhtml_branch_coverage=1 00:13:52.482 --rc genhtml_function_coverage=1 00:13:52.482 --rc genhtml_legend=1 00:13:52.482 --rc geninfo_all_blocks=1 00:13:52.482 --rc geninfo_unexecuted_blocks=1 00:13:52.482 00:13:52.482 ' 00:13:52.482 19:00:09 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:52.482 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:52.482 --rc genhtml_branch_coverage=1 00:13:52.482 --rc genhtml_function_coverage=1 00:13:52.482 --rc genhtml_legend=1 00:13:52.482 --rc geninfo_all_blocks=1 00:13:52.482 --rc geninfo_unexecuted_blocks=1 00:13:52.482 00:13:52.482 ' 00:13:52.482 19:00:09 -- target/abort.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:52.482 19:00:09 -- nvmf/common.sh@7 -- # uname -s 00:13:52.482 19:00:09 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:52.482 19:00:09 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:52.482 19:00:09 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:52.482 19:00:09 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:52.482 19:00:09 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:52.482 19:00:09 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:52.482 19:00:09 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:52.482 19:00:09 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:52.482 19:00:09 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:52.482 19:00:09 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:52.482 19:00:09 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:13:52.482 19:00:09 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:13:52.482 19:00:09 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:52.482 19:00:09 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:52.482 19:00:09 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:52.482 19:00:09 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:52.482 19:00:09 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:52.482 19:00:09 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:52.482 19:00:09 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:52.482 19:00:09 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:52.482 19:00:09 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:52.482 19:00:09 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:52.482 19:00:09 -- paths/export.sh@5 -- # export PATH 00:13:52.482 19:00:09 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:52.482 19:00:09 -- nvmf/common.sh@46 -- # : 0 00:13:52.482 19:00:09 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:52.482 19:00:09 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:52.482 19:00:09 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:52.482 19:00:09 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:52.482 19:00:09 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:52.482 19:00:09 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:52.482 19:00:09 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:52.482 19:00:09 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:52.482 19:00:09 -- target/abort.sh@11 -- # MALLOC_BDEV_SIZE=64 00:13:52.482 19:00:09 -- target/abort.sh@12 -- # MALLOC_BLOCK_SIZE=4096 00:13:52.482 19:00:09 -- target/abort.sh@14 -- # nvmftestinit 00:13:52.482 19:00:09 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:52.482 19:00:09 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:52.482 19:00:09 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:52.482 19:00:09 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:52.482 19:00:09 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:52.482 19:00:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:52.482 19:00:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:52.482 19:00:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:52.482 19:00:09 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:52.482 19:00:09 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:52.482 19:00:09 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:52.482 19:00:09 -- common/autotest_common.sh@10 -- # set +x 00:13:57.750 19:00:14 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:57.750 19:00:14 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:57.750 19:00:14 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:57.750 19:00:14 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:57.750 19:00:14 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:57.750 19:00:14 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:57.750 19:00:14 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:57.750 19:00:14 -- nvmf/common.sh@294 -- # net_devs=() 00:13:57.750 19:00:14 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:57.750 19:00:14 -- nvmf/common.sh@295 -- # e810=() 00:13:57.750 19:00:14 -- nvmf/common.sh@295 -- # local -ga e810 00:13:57.750 19:00:14 -- nvmf/common.sh@296 -- # x722=() 00:13:57.750 19:00:14 -- nvmf/common.sh@296 -- # local -ga x722 00:13:57.750 19:00:14 -- nvmf/common.sh@297 -- # mlx=() 00:13:57.750 19:00:14 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:57.750 19:00:14 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:57.750 19:00:14 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:57.750 19:00:14 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:57.750 19:00:14 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:57.750 19:00:14 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:57.750 19:00:14 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:57.750 19:00:14 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:57.750 19:00:14 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:57.750 19:00:14 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:57.750 19:00:14 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:57.750 19:00:14 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:57.750 19:00:14 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:57.750 19:00:14 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:57.750 19:00:14 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:57.750 19:00:14 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:57.750 19:00:14 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:57.750 19:00:14 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:57.750 19:00:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:57.750 19:00:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:13:57.750 Found 0000:86:00.0 (0x8086 - 0x159b) 00:13:57.750 19:00:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:57.750 19:00:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:57.750 19:00:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:57.750 19:00:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:57.750 19:00:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:57.750 19:00:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:57.750 19:00:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:13:57.750 Found 0000:86:00.1 (0x8086 - 0x159b) 00:13:57.750 19:00:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:57.750 19:00:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:57.750 19:00:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:57.750 19:00:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:57.750 19:00:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:57.750 19:00:14 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:57.750 19:00:14 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:57.750 19:00:14 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:57.750 19:00:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:57.750 19:00:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:57.750 19:00:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:57.750 19:00:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:57.750 19:00:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:13:57.750 Found net devices under 0000:86:00.0: cvl_0_0 00:13:57.751 19:00:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:57.751 19:00:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:57.751 19:00:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:57.751 19:00:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:57.751 19:00:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:57.751 19:00:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:13:57.751 Found net devices under 0000:86:00.1: cvl_0_1 00:13:57.751 19:00:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:57.751 19:00:14 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:57.751 19:00:14 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:57.751 19:00:14 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:57.751 19:00:14 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:57.751 19:00:14 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:57.751 19:00:14 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:57.751 19:00:14 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:57.751 19:00:14 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:57.751 19:00:14 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:57.751 19:00:14 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:57.751 19:00:14 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:57.751 19:00:14 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:57.751 19:00:14 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:57.751 19:00:14 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:57.751 19:00:14 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:57.751 19:00:14 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:57.751 19:00:14 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:57.751 19:00:14 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:57.751 19:00:14 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:57.751 19:00:14 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:57.751 19:00:14 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:57.751 19:00:14 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:57.751 19:00:14 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:57.751 19:00:14 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:57.751 19:00:14 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:57.751 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:57.751 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.349 ms 00:13:57.751 00:13:57.751 --- 10.0.0.2 ping statistics --- 00:13:57.751 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:57.751 rtt min/avg/max/mdev = 0.349/0.349/0.349/0.000 ms 00:13:57.751 19:00:14 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:57.751 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:57.751 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.142 ms 00:13:57.751 00:13:57.751 --- 10.0.0.1 ping statistics --- 00:13:57.751 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:57.751 rtt min/avg/max/mdev = 0.142/0.142/0.142/0.000 ms 00:13:57.751 19:00:14 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:57.751 19:00:14 -- nvmf/common.sh@410 -- # return 0 00:13:57.751 19:00:14 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:57.751 19:00:14 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:57.751 19:00:14 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:57.751 19:00:14 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:57.751 19:00:14 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:57.751 19:00:14 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:57.751 19:00:14 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:57.751 19:00:14 -- target/abort.sh@15 -- # nvmfappstart -m 0xE 00:13:57.751 19:00:14 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:57.751 19:00:14 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:57.751 19:00:14 -- common/autotest_common.sh@10 -- # set +x 00:13:57.751 19:00:14 -- nvmf/common.sh@469 -- # nvmfpid=3032860 00:13:57.751 19:00:14 -- nvmf/common.sh@470 -- # waitforlisten 3032860 00:13:57.751 19:00:14 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:13:57.751 19:00:14 -- common/autotest_common.sh@829 -- # '[' -z 3032860 ']' 00:13:57.751 19:00:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:57.751 19:00:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:57.751 19:00:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:57.751 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:57.751 19:00:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:57.751 19:00:14 -- common/autotest_common.sh@10 -- # set +x 00:13:58.010 [2024-11-26 19:00:14.680896] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:13:58.010 [2024-11-26 19:00:14.680940] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:58.010 EAL: No free 2048 kB hugepages reported on node 1 00:13:58.010 [2024-11-26 19:00:14.743408] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:13:58.010 [2024-11-26 19:00:14.782157] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:58.010 [2024-11-26 19:00:14.782269] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:58.010 [2024-11-26 19:00:14.782278] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:58.010 [2024-11-26 19:00:14.782284] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:58.010 [2024-11-26 19:00:14.782390] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:58.010 [2024-11-26 19:00:14.782410] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:58.010 [2024-11-26 19:00:14.782417] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:58.946 19:00:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:58.946 19:00:15 -- common/autotest_common.sh@862 -- # return 0 00:13:58.946 19:00:15 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:58.946 19:00:15 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:58.946 19:00:15 -- common/autotest_common.sh@10 -- # set +x 00:13:58.946 19:00:15 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:58.946 19:00:15 -- target/abort.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -a 256 00:13:58.946 19:00:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:58.946 19:00:15 -- common/autotest_common.sh@10 -- # set +x 00:13:58.946 [2024-11-26 19:00:15.581492] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:58.946 19:00:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:58.946 19:00:15 -- target/abort.sh@20 -- # rpc_cmd bdev_malloc_create 64 4096 -b Malloc0 00:13:58.946 19:00:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:58.946 19:00:15 -- common/autotest_common.sh@10 -- # set +x 00:13:58.946 Malloc0 00:13:58.946 19:00:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:58.946 19:00:15 -- target/abort.sh@21 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:13:58.946 19:00:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:58.946 19:00:15 -- common/autotest_common.sh@10 -- # set +x 00:13:58.946 Delay0 00:13:58.946 19:00:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:58.946 19:00:15 -- target/abort.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:13:58.946 19:00:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:58.946 19:00:15 -- common/autotest_common.sh@10 -- # set +x 00:13:58.946 19:00:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:58.946 19:00:15 -- target/abort.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Delay0 00:13:58.946 19:00:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:58.946 19:00:15 -- common/autotest_common.sh@10 -- # set +x 00:13:58.946 19:00:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:58.946 19:00:15 -- target/abort.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:13:58.946 19:00:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:58.946 19:00:15 -- common/autotest_common.sh@10 -- # set +x 00:13:58.946 [2024-11-26 19:00:15.653617] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:58.946 19:00:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:58.946 19:00:15 -- target/abort.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:13:58.946 19:00:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:58.946 19:00:15 -- common/autotest_common.sh@10 -- # set +x 00:13:58.947 19:00:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:58.947 19:00:15 -- target/abort.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0x1 -t 1 -l warning -q 128 00:13:58.947 EAL: No free 2048 kB hugepages reported on node 1 00:13:58.947 [2024-11-26 19:00:15.717697] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:14:01.481 Initializing NVMe Controllers 00:14:01.481 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:14:01.481 controller IO queue size 128 less than required 00:14:01.481 Consider using lower queue depth or small IO size because IO requests may be queued at the NVMe driver. 00:14:01.481 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:14:01.481 Initialization complete. Launching workers. 00:14:01.481 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 I/O completed: 126, failed: 43110 00:14:01.481 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) abort submitted 43174, failed to submit 62 00:14:01.481 success 43110, unsuccess 64, failed 0 00:14:01.481 19:00:17 -- target/abort.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:14:01.481 19:00:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:01.481 19:00:17 -- common/autotest_common.sh@10 -- # set +x 00:14:01.481 19:00:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:01.481 19:00:17 -- target/abort.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:14:01.481 19:00:17 -- target/abort.sh@38 -- # nvmftestfini 00:14:01.481 19:00:17 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:01.481 19:00:17 -- nvmf/common.sh@116 -- # sync 00:14:01.481 19:00:17 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:01.481 19:00:17 -- nvmf/common.sh@119 -- # set +e 00:14:01.481 19:00:17 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:01.481 19:00:17 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:01.481 rmmod nvme_tcp 00:14:01.481 rmmod nvme_fabrics 00:14:01.481 rmmod nvme_keyring 00:14:01.481 19:00:17 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:01.481 19:00:17 -- nvmf/common.sh@123 -- # set -e 00:14:01.481 19:00:17 -- nvmf/common.sh@124 -- # return 0 00:14:01.481 19:00:17 -- nvmf/common.sh@477 -- # '[' -n 3032860 ']' 00:14:01.481 19:00:17 -- nvmf/common.sh@478 -- # killprocess 3032860 00:14:01.481 19:00:17 -- common/autotest_common.sh@936 -- # '[' -z 3032860 ']' 00:14:01.481 19:00:17 -- common/autotest_common.sh@940 -- # kill -0 3032860 00:14:01.481 19:00:17 -- common/autotest_common.sh@941 -- # uname 00:14:01.481 19:00:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:01.481 19:00:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3032860 00:14:01.481 19:00:17 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:01.481 19:00:17 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:01.481 19:00:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3032860' 00:14:01.481 killing process with pid 3032860 00:14:01.481 19:00:17 -- common/autotest_common.sh@955 -- # kill 3032860 00:14:01.481 19:00:17 -- common/autotest_common.sh@960 -- # wait 3032860 00:14:01.481 19:00:18 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:01.481 19:00:18 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:01.481 19:00:18 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:01.482 19:00:18 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:01.482 19:00:18 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:01.482 19:00:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:01.482 19:00:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:01.482 19:00:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:03.391 19:00:20 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:03.391 00:14:03.391 real 0m11.119s 00:14:03.391 user 0m13.502s 00:14:03.391 sys 0m4.862s 00:14:03.391 19:00:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:03.391 19:00:20 -- common/autotest_common.sh@10 -- # set +x 00:14:03.391 ************************************ 00:14:03.391 END TEST nvmf_abort 00:14:03.391 ************************************ 00:14:03.391 19:00:20 -- nvmf/nvmf.sh@32 -- # run_test nvmf_ns_hotplug_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:14:03.391 19:00:20 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:03.391 19:00:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:03.391 19:00:20 -- common/autotest_common.sh@10 -- # set +x 00:14:03.391 ************************************ 00:14:03.391 START TEST nvmf_ns_hotplug_stress 00:14:03.391 ************************************ 00:14:03.391 19:00:20 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:14:03.651 * Looking for test storage... 00:14:03.651 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:03.651 19:00:20 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:03.651 19:00:20 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:03.651 19:00:20 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:03.651 19:00:20 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:03.651 19:00:20 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:03.651 19:00:20 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:03.651 19:00:20 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:03.651 19:00:20 -- scripts/common.sh@335 -- # IFS=.-: 00:14:03.651 19:00:20 -- scripts/common.sh@335 -- # read -ra ver1 00:14:03.651 19:00:20 -- scripts/common.sh@336 -- # IFS=.-: 00:14:03.651 19:00:20 -- scripts/common.sh@336 -- # read -ra ver2 00:14:03.651 19:00:20 -- scripts/common.sh@337 -- # local 'op=<' 00:14:03.651 19:00:20 -- scripts/common.sh@339 -- # ver1_l=2 00:14:03.651 19:00:20 -- scripts/common.sh@340 -- # ver2_l=1 00:14:03.651 19:00:20 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:03.651 19:00:20 -- scripts/common.sh@343 -- # case "$op" in 00:14:03.651 19:00:20 -- scripts/common.sh@344 -- # : 1 00:14:03.651 19:00:20 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:03.651 19:00:20 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:03.651 19:00:20 -- scripts/common.sh@364 -- # decimal 1 00:14:03.651 19:00:20 -- scripts/common.sh@352 -- # local d=1 00:14:03.651 19:00:20 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:03.651 19:00:20 -- scripts/common.sh@354 -- # echo 1 00:14:03.651 19:00:20 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:03.651 19:00:20 -- scripts/common.sh@365 -- # decimal 2 00:14:03.651 19:00:20 -- scripts/common.sh@352 -- # local d=2 00:14:03.651 19:00:20 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:03.651 19:00:20 -- scripts/common.sh@354 -- # echo 2 00:14:03.651 19:00:20 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:03.651 19:00:20 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:03.651 19:00:20 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:03.651 19:00:20 -- scripts/common.sh@367 -- # return 0 00:14:03.651 19:00:20 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:03.651 19:00:20 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:03.651 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:03.651 --rc genhtml_branch_coverage=1 00:14:03.651 --rc genhtml_function_coverage=1 00:14:03.651 --rc genhtml_legend=1 00:14:03.651 --rc geninfo_all_blocks=1 00:14:03.651 --rc geninfo_unexecuted_blocks=1 00:14:03.651 00:14:03.651 ' 00:14:03.651 19:00:20 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:03.651 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:03.651 --rc genhtml_branch_coverage=1 00:14:03.651 --rc genhtml_function_coverage=1 00:14:03.651 --rc genhtml_legend=1 00:14:03.651 --rc geninfo_all_blocks=1 00:14:03.651 --rc geninfo_unexecuted_blocks=1 00:14:03.651 00:14:03.651 ' 00:14:03.651 19:00:20 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:03.651 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:03.651 --rc genhtml_branch_coverage=1 00:14:03.651 --rc genhtml_function_coverage=1 00:14:03.651 --rc genhtml_legend=1 00:14:03.651 --rc geninfo_all_blocks=1 00:14:03.651 --rc geninfo_unexecuted_blocks=1 00:14:03.651 00:14:03.651 ' 00:14:03.651 19:00:20 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:03.651 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:03.651 --rc genhtml_branch_coverage=1 00:14:03.651 --rc genhtml_function_coverage=1 00:14:03.651 --rc genhtml_legend=1 00:14:03.651 --rc geninfo_all_blocks=1 00:14:03.651 --rc geninfo_unexecuted_blocks=1 00:14:03.651 00:14:03.651 ' 00:14:03.651 19:00:20 -- target/ns_hotplug_stress.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:03.651 19:00:20 -- nvmf/common.sh@7 -- # uname -s 00:14:03.651 19:00:20 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:03.651 19:00:20 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:03.651 19:00:20 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:03.651 19:00:20 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:03.651 19:00:20 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:03.651 19:00:20 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:03.651 19:00:20 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:03.651 19:00:20 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:03.651 19:00:20 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:03.651 19:00:20 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:03.651 19:00:20 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:14:03.651 19:00:20 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:14:03.651 19:00:20 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:03.651 19:00:20 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:03.651 19:00:20 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:03.651 19:00:20 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:03.651 19:00:20 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:03.651 19:00:20 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:03.651 19:00:20 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:03.651 19:00:20 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:03.651 19:00:20 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:03.651 19:00:20 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:03.651 19:00:20 -- paths/export.sh@5 -- # export PATH 00:14:03.651 19:00:20 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:03.651 19:00:20 -- nvmf/common.sh@46 -- # : 0 00:14:03.651 19:00:20 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:03.651 19:00:20 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:03.651 19:00:20 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:03.651 19:00:20 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:03.651 19:00:20 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:03.651 19:00:20 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:03.651 19:00:20 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:03.651 19:00:20 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:03.651 19:00:20 -- target/ns_hotplug_stress.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:03.651 19:00:20 -- target/ns_hotplug_stress.sh@22 -- # nvmftestinit 00:14:03.651 19:00:20 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:03.652 19:00:20 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:03.652 19:00:20 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:03.652 19:00:20 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:03.652 19:00:20 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:03.652 19:00:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:03.652 19:00:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:03.652 19:00:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:03.652 19:00:20 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:03.652 19:00:20 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:03.652 19:00:20 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:03.652 19:00:20 -- common/autotest_common.sh@10 -- # set +x 00:14:08.920 19:00:25 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:08.920 19:00:25 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:08.920 19:00:25 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:08.920 19:00:25 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:08.920 19:00:25 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:08.920 19:00:25 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:08.920 19:00:25 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:08.920 19:00:25 -- nvmf/common.sh@294 -- # net_devs=() 00:14:08.920 19:00:25 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:08.920 19:00:25 -- nvmf/common.sh@295 -- # e810=() 00:14:08.920 19:00:25 -- nvmf/common.sh@295 -- # local -ga e810 00:14:08.920 19:00:25 -- nvmf/common.sh@296 -- # x722=() 00:14:08.920 19:00:25 -- nvmf/common.sh@296 -- # local -ga x722 00:14:08.920 19:00:25 -- nvmf/common.sh@297 -- # mlx=() 00:14:08.920 19:00:25 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:08.920 19:00:25 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:08.920 19:00:25 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:08.920 19:00:25 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:08.920 19:00:25 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:08.920 19:00:25 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:08.920 19:00:25 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:08.920 19:00:25 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:08.920 19:00:25 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:08.920 19:00:25 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:08.920 19:00:25 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:08.920 19:00:25 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:08.920 19:00:25 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:08.920 19:00:25 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:08.920 19:00:25 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:08.920 19:00:25 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:08.920 19:00:25 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:08.920 19:00:25 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:08.920 19:00:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:08.920 19:00:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:14:08.920 Found 0000:86:00.0 (0x8086 - 0x159b) 00:14:08.920 19:00:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:08.920 19:00:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:08.920 19:00:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:08.920 19:00:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:08.920 19:00:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:08.920 19:00:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:08.920 19:00:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:14:08.920 Found 0000:86:00.1 (0x8086 - 0x159b) 00:14:08.920 19:00:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:08.920 19:00:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:08.920 19:00:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:08.920 19:00:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:08.920 19:00:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:08.920 19:00:25 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:08.920 19:00:25 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:08.920 19:00:25 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:08.920 19:00:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:08.920 19:00:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:08.920 19:00:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:08.920 19:00:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:08.920 19:00:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:14:08.920 Found net devices under 0000:86:00.0: cvl_0_0 00:14:08.920 19:00:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:08.920 19:00:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:08.920 19:00:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:08.920 19:00:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:08.920 19:00:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:08.920 19:00:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:14:08.920 Found net devices under 0000:86:00.1: cvl_0_1 00:14:08.920 19:00:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:08.920 19:00:25 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:08.920 19:00:25 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:08.920 19:00:25 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:08.920 19:00:25 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:08.920 19:00:25 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:08.921 19:00:25 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:08.921 19:00:25 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:08.921 19:00:25 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:08.921 19:00:25 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:08.921 19:00:25 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:08.921 19:00:25 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:08.921 19:00:25 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:08.921 19:00:25 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:08.921 19:00:25 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:08.921 19:00:25 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:08.921 19:00:25 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:08.921 19:00:25 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:08.921 19:00:25 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:08.921 19:00:25 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:08.921 19:00:25 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:08.921 19:00:25 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:08.921 19:00:25 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:08.921 19:00:25 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:08.921 19:00:25 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:08.921 19:00:25 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:08.921 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:08.921 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.379 ms 00:14:08.921 00:14:08.921 --- 10.0.0.2 ping statistics --- 00:14:08.921 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:08.921 rtt min/avg/max/mdev = 0.379/0.379/0.379/0.000 ms 00:14:08.921 19:00:25 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:08.921 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:08.921 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.220 ms 00:14:08.921 00:14:08.921 --- 10.0.0.1 ping statistics --- 00:14:08.921 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:08.921 rtt min/avg/max/mdev = 0.220/0.220/0.220/0.000 ms 00:14:08.921 19:00:25 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:08.921 19:00:25 -- nvmf/common.sh@410 -- # return 0 00:14:08.921 19:00:25 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:08.921 19:00:25 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:08.921 19:00:25 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:08.921 19:00:25 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:08.921 19:00:25 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:08.921 19:00:25 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:08.921 19:00:25 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:08.921 19:00:25 -- target/ns_hotplug_stress.sh@23 -- # nvmfappstart -m 0xE 00:14:08.921 19:00:25 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:08.921 19:00:25 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:08.921 19:00:25 -- common/autotest_common.sh@10 -- # set +x 00:14:08.921 19:00:25 -- nvmf/common.sh@469 -- # nvmfpid=3036895 00:14:08.921 19:00:25 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:14:08.921 19:00:25 -- nvmf/common.sh@470 -- # waitforlisten 3036895 00:14:08.921 19:00:25 -- common/autotest_common.sh@829 -- # '[' -z 3036895 ']' 00:14:08.921 19:00:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:08.921 19:00:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:08.921 19:00:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:08.921 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:08.921 19:00:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:08.921 19:00:25 -- common/autotest_common.sh@10 -- # set +x 00:14:08.921 [2024-11-26 19:00:25.779260] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:14:08.921 [2024-11-26 19:00:25.779302] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:08.921 EAL: No free 2048 kB hugepages reported on node 1 00:14:08.921 [2024-11-26 19:00:25.836742] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:14:09.180 [2024-11-26 19:00:25.877289] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:09.180 [2024-11-26 19:00:25.877401] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:09.180 [2024-11-26 19:00:25.877409] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:09.180 [2024-11-26 19:00:25.877416] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:09.180 [2024-11-26 19:00:25.877472] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:09.180 [2024-11-26 19:00:25.877557] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:09.180 [2024-11-26 19:00:25.877559] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:09.749 19:00:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:09.749 19:00:26 -- common/autotest_common.sh@862 -- # return 0 00:14:09.749 19:00:26 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:09.749 19:00:26 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:09.749 19:00:26 -- common/autotest_common.sh@10 -- # set +x 00:14:09.749 19:00:26 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:09.749 19:00:26 -- target/ns_hotplug_stress.sh@25 -- # null_size=1000 00:14:09.749 19:00:26 -- target/ns_hotplug_stress.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:14:10.008 [2024-11-26 19:00:26.818289] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:10.008 19:00:26 -- target/ns_hotplug_stress.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:14:10.267 19:00:27 -- target/ns_hotplug_stress.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:10.526 [2024-11-26 19:00:27.195722] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:10.526 19:00:27 -- target/ns_hotplug_stress.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:10.526 19:00:27 -- target/ns_hotplug_stress.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 512 -b Malloc0 00:14:10.785 Malloc0 00:14:10.785 19:00:27 -- target/ns_hotplug_stress.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:14:11.043 Delay0 00:14:11.043 19:00:27 -- target/ns_hotplug_stress.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:11.303 19:00:27 -- target/ns_hotplug_stress.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create NULL1 1000 512 00:14:11.303 NULL1 00:14:11.303 19:00:28 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:14:11.562 19:00:28 -- target/ns_hotplug_stress.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 30 -q 128 -w randread -o 512 -Q 1000 00:14:11.562 19:00:28 -- target/ns_hotplug_stress.sh@42 -- # PERF_PID=3037387 00:14:11.562 19:00:28 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3037387 00:14:11.562 19:00:28 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:11.562 EAL: No free 2048 kB hugepages reported on node 1 00:14:11.821 19:00:28 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:11.821 19:00:28 -- target/ns_hotplug_stress.sh@49 -- # null_size=1001 00:14:11.821 19:00:28 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1001 00:14:12.079 true 00:14:12.079 19:00:28 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3037387 00:14:12.079 19:00:28 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:12.337 19:00:29 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:12.597 19:00:29 -- target/ns_hotplug_stress.sh@49 -- # null_size=1002 00:14:12.597 19:00:29 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1002 00:14:12.597 true 00:14:12.597 19:00:29 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3037387 00:14:12.597 19:00:29 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:13.974 Read completed with error (sct=0, sc=11) 00:14:13.974 19:00:30 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:13.974 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:13.974 19:00:30 -- target/ns_hotplug_stress.sh@49 -- # null_size=1003 00:14:13.974 19:00:30 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1003 00:14:14.233 true 00:14:14.233 19:00:30 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3037387 00:14:14.233 19:00:30 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:14.492 19:00:31 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:14.492 19:00:31 -- target/ns_hotplug_stress.sh@49 -- # null_size=1004 00:14:14.492 19:00:31 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1004 00:14:14.751 true 00:14:14.751 19:00:31 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3037387 00:14:14.751 19:00:31 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:16.128 19:00:32 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:16.128 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:16.128 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:16.128 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:16.128 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:16.128 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:16.128 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:16.128 19:00:32 -- target/ns_hotplug_stress.sh@49 -- # null_size=1005 00:14:16.128 19:00:32 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1005 00:14:16.128 true 00:14:16.128 19:00:33 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3037387 00:14:16.128 19:00:33 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:17.195 19:00:33 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:17.195 19:00:34 -- target/ns_hotplug_stress.sh@49 -- # null_size=1006 00:14:17.195 19:00:34 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1006 00:14:17.510 true 00:14:17.510 19:00:34 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3037387 00:14:17.510 19:00:34 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:17.510 19:00:34 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:17.767 19:00:34 -- target/ns_hotplug_stress.sh@49 -- # null_size=1007 00:14:17.767 19:00:34 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1007 00:14:18.025 true 00:14:18.025 19:00:34 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3037387 00:14:18.025 19:00:34 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:18.957 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:18.957 19:00:35 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:19.215 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:19.215 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:19.215 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:19.215 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:19.215 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:19.215 19:00:36 -- target/ns_hotplug_stress.sh@49 -- # null_size=1008 00:14:19.215 19:00:36 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1008 00:14:19.472 true 00:14:19.472 19:00:36 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3037387 00:14:19.472 19:00:36 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:20.408 19:00:37 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:20.408 19:00:37 -- target/ns_hotplug_stress.sh@49 -- # null_size=1009 00:14:20.408 19:00:37 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1009 00:14:20.666 true 00:14:20.666 19:00:37 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3037387 00:14:20.666 19:00:37 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:20.925 19:00:37 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:20.925 19:00:37 -- target/ns_hotplug_stress.sh@49 -- # null_size=1010 00:14:20.925 19:00:37 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1010 00:14:21.182 true 00:14:21.182 19:00:38 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3037387 00:14:21.182 19:00:38 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:22.553 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:22.553 19:00:39 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:22.553 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:22.553 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:22.553 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:22.553 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:22.553 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:22.553 19:00:39 -- target/ns_hotplug_stress.sh@49 -- # null_size=1011 00:14:22.553 19:00:39 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1011 00:14:22.811 true 00:14:22.811 19:00:39 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3037387 00:14:22.811 19:00:39 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:23.748 19:00:40 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:23.748 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:23.748 19:00:40 -- target/ns_hotplug_stress.sh@49 -- # null_size=1012 00:14:23.748 19:00:40 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1012 00:14:24.006 true 00:14:24.006 19:00:40 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3037387 00:14:24.006 19:00:40 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:24.006 19:00:40 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:24.265 19:00:41 -- target/ns_hotplug_stress.sh@49 -- # null_size=1013 00:14:24.265 19:00:41 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1013 00:14:24.524 true 00:14:24.524 19:00:41 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3037387 00:14:24.524 19:00:41 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:25.460 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:25.460 19:00:42 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:25.719 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:25.719 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:25.719 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:25.719 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:25.719 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:25.719 19:00:42 -- target/ns_hotplug_stress.sh@49 -- # null_size=1014 00:14:25.719 19:00:42 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1014 00:14:25.978 true 00:14:25.978 19:00:42 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3037387 00:14:25.978 19:00:42 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:26.914 19:00:43 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:26.915 19:00:43 -- target/ns_hotplug_stress.sh@49 -- # null_size=1015 00:14:26.915 19:00:43 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1015 00:14:27.174 true 00:14:27.174 19:00:43 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3037387 00:14:27.174 19:00:43 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:27.434 19:00:44 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:27.434 19:00:44 -- target/ns_hotplug_stress.sh@49 -- # null_size=1016 00:14:27.434 19:00:44 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1016 00:14:27.692 true 00:14:27.692 19:00:44 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3037387 00:14:27.692 19:00:44 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:29.068 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:29.068 19:00:45 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:29.068 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:29.068 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:29.068 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:29.068 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:29.068 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:29.068 19:00:45 -- target/ns_hotplug_stress.sh@49 -- # null_size=1017 00:14:29.068 19:00:45 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1017 00:14:29.068 true 00:14:29.326 19:00:46 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3037387 00:14:29.326 19:00:46 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:29.895 19:00:46 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:30.154 19:00:46 -- target/ns_hotplug_stress.sh@49 -- # null_size=1018 00:14:30.154 19:00:46 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1018 00:14:30.413 true 00:14:30.413 19:00:47 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3037387 00:14:30.413 19:00:47 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:30.672 19:00:47 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:30.672 19:00:47 -- target/ns_hotplug_stress.sh@49 -- # null_size=1019 00:14:30.672 19:00:47 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1019 00:14:30.930 true 00:14:30.930 19:00:47 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3037387 00:14:30.930 19:00:47 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:32.304 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:32.304 19:00:48 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:32.304 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:32.304 19:00:49 -- target/ns_hotplug_stress.sh@49 -- # null_size=1020 00:14:32.304 19:00:49 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1020 00:14:32.304 true 00:14:32.304 19:00:49 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3037387 00:14:32.304 19:00:49 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:32.562 19:00:49 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:32.819 19:00:49 -- target/ns_hotplug_stress.sh@49 -- # null_size=1021 00:14:32.819 19:00:49 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1021 00:14:32.819 true 00:14:33.077 19:00:49 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3037387 00:14:33.077 19:00:49 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:33.077 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:33.077 19:00:49 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:33.077 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:33.335 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:33.335 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:33.335 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:33.335 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:33.335 19:00:50 -- target/ns_hotplug_stress.sh@49 -- # null_size=1022 00:14:33.335 19:00:50 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1022 00:14:33.593 true 00:14:33.593 19:00:50 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3037387 00:14:33.593 19:00:50 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:34.527 19:00:51 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:34.527 19:00:51 -- target/ns_hotplug_stress.sh@49 -- # null_size=1023 00:14:34.527 19:00:51 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1023 00:14:34.785 true 00:14:34.785 19:00:51 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3037387 00:14:34.785 19:00:51 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:35.043 19:00:51 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:35.043 19:00:51 -- target/ns_hotplug_stress.sh@49 -- # null_size=1024 00:14:35.043 19:00:51 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1024 00:14:35.302 true 00:14:35.302 19:00:52 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3037387 00:14:35.302 19:00:52 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:36.677 19:00:53 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:36.677 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:36.677 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:36.677 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:36.677 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:36.677 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:36.677 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:36.677 19:00:53 -- target/ns_hotplug_stress.sh@49 -- # null_size=1025 00:14:36.677 19:00:53 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1025 00:14:36.677 true 00:14:36.677 19:00:53 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3037387 00:14:36.677 19:00:53 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:37.612 19:00:54 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:37.612 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:37.870 19:00:54 -- target/ns_hotplug_stress.sh@49 -- # null_size=1026 00:14:37.870 19:00:54 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1026 00:14:37.870 true 00:14:37.870 19:00:54 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3037387 00:14:37.870 19:00:54 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:38.128 19:00:54 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:38.387 19:00:55 -- target/ns_hotplug_stress.sh@49 -- # null_size=1027 00:14:38.387 19:00:55 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1027 00:14:38.387 true 00:14:38.646 19:00:55 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3037387 00:14:38.646 19:00:55 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:39.581 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:39.581 19:00:56 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:39.839 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:39.839 19:00:56 -- target/ns_hotplug_stress.sh@49 -- # null_size=1028 00:14:39.839 19:00:56 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1028 00:14:40.097 true 00:14:40.097 19:00:56 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3037387 00:14:40.097 19:00:56 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:40.355 19:00:57 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:40.355 19:00:57 -- target/ns_hotplug_stress.sh@49 -- # null_size=1029 00:14:40.355 19:00:57 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1029 00:14:40.613 true 00:14:40.613 19:00:57 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3037387 00:14:40.613 19:00:57 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:40.871 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:40.871 19:00:57 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:40.871 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:40.871 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:40.871 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:40.871 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:41.130 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:41.130 19:00:57 -- target/ns_hotplug_stress.sh@49 -- # null_size=1030 00:14:41.130 19:00:57 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1030 00:14:41.130 true 00:14:41.130 19:00:58 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3037387 00:14:41.130 19:00:58 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:42.064 19:00:58 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:42.064 Initializing NVMe Controllers 00:14:42.064 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:14:42.064 Controller IO queue size 128, less than required. 00:14:42.064 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:42.064 Controller IO queue size 128, less than required. 00:14:42.064 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:42.064 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:14:42.064 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:14:42.064 Initialization complete. Launching workers. 00:14:42.064 ======================================================== 00:14:42.064 Latency(us) 00:14:42.065 Device Information : IOPS MiB/s Average min max 00:14:42.065 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1915.90 0.94 43368.92 1819.69 1032511.75 00:14:42.065 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 18196.90 8.89 7016.62 1332.01 432406.32 00:14:42.065 ======================================================== 00:14:42.065 Total : 20112.80 9.82 10479.46 1332.01 1032511.75 00:14:42.065 00:14:42.323 19:00:59 -- target/ns_hotplug_stress.sh@49 -- # null_size=1031 00:14:42.323 19:00:59 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1031 00:14:42.323 true 00:14:42.323 19:00:59 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3037387 00:14:42.323 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh: line 44: kill: (3037387) - No such process 00:14:42.323 19:00:59 -- target/ns_hotplug_stress.sh@53 -- # wait 3037387 00:14:42.323 19:00:59 -- target/ns_hotplug_stress.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:42.583 19:00:59 -- target/ns_hotplug_stress.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:42.842 19:00:59 -- target/ns_hotplug_stress.sh@58 -- # nthreads=8 00:14:42.842 19:00:59 -- target/ns_hotplug_stress.sh@58 -- # pids=() 00:14:42.842 19:00:59 -- target/ns_hotplug_stress.sh@59 -- # (( i = 0 )) 00:14:42.842 19:00:59 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:42.842 19:00:59 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null0 100 4096 00:14:43.100 null0 00:14:43.100 19:00:59 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:43.100 19:00:59 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:43.100 19:00:59 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null1 100 4096 00:14:43.100 null1 00:14:43.100 19:00:59 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:43.100 19:00:59 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:43.100 19:00:59 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null2 100 4096 00:14:43.359 null2 00:14:43.359 19:01:00 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:43.359 19:01:00 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:43.359 19:01:00 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null3 100 4096 00:14:43.617 null3 00:14:43.617 19:01:00 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:43.617 19:01:00 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:43.617 19:01:00 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null4 100 4096 00:14:43.877 null4 00:14:43.877 19:01:00 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:43.877 19:01:00 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:43.877 19:01:00 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null5 100 4096 00:14:43.877 null5 00:14:43.877 19:01:00 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:43.877 19:01:00 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:43.877 19:01:00 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null6 100 4096 00:14:44.135 null6 00:14:44.135 19:01:00 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:44.135 19:01:00 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:44.135 19:01:00 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null7 100 4096 00:14:44.394 null7 00:14:44.394 19:01:01 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:44.394 19:01:01 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:44.394 19:01:01 -- target/ns_hotplug_stress.sh@62 -- # (( i = 0 )) 00:14:44.394 19:01:01 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:44.394 19:01:01 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:44.394 19:01:01 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:44.394 19:01:01 -- target/ns_hotplug_stress.sh@63 -- # add_remove 1 null0 00:14:44.394 19:01:01 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:44.394 19:01:01 -- target/ns_hotplug_stress.sh@14 -- # local nsid=1 bdev=null0 00:14:44.394 19:01:01 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:44.394 19:01:01 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:44.394 19:01:01 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:44.394 19:01:01 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:44.394 19:01:01 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:44.394 19:01:01 -- target/ns_hotplug_stress.sh@63 -- # add_remove 2 null1 00:14:44.394 19:01:01 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:44.395 19:01:01 -- target/ns_hotplug_stress.sh@14 -- # local nsid=2 bdev=null1 00:14:44.395 19:01:01 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:44.395 19:01:01 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:44.395 19:01:01 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:44.395 19:01:01 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:44.395 19:01:01 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:44.395 19:01:01 -- target/ns_hotplug_stress.sh@63 -- # add_remove 3 null2 00:14:44.395 19:01:01 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:44.395 19:01:01 -- target/ns_hotplug_stress.sh@14 -- # local nsid=3 bdev=null2 00:14:44.395 19:01:01 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:44.395 19:01:01 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:44.395 19:01:01 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:44.395 19:01:01 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:44.395 19:01:01 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:44.395 19:01:01 -- target/ns_hotplug_stress.sh@63 -- # add_remove 4 null3 00:14:44.395 19:01:01 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:44.395 19:01:01 -- target/ns_hotplug_stress.sh@14 -- # local nsid=4 bdev=null3 00:14:44.395 19:01:01 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:44.395 19:01:01 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:44.395 19:01:01 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:44.395 19:01:01 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:44.395 19:01:01 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:44.395 19:01:01 -- target/ns_hotplug_stress.sh@63 -- # add_remove 5 null4 00:14:44.395 19:01:01 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:44.395 19:01:01 -- target/ns_hotplug_stress.sh@14 -- # local nsid=5 bdev=null4 00:14:44.395 19:01:01 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:44.395 19:01:01 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:44.395 19:01:01 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:44.395 19:01:01 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:44.395 19:01:01 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:44.395 19:01:01 -- target/ns_hotplug_stress.sh@63 -- # add_remove 6 null5 00:14:44.395 19:01:01 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:44.395 19:01:01 -- target/ns_hotplug_stress.sh@14 -- # local nsid=6 bdev=null5 00:14:44.395 19:01:01 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:44.395 19:01:01 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:44.395 19:01:01 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:44.395 19:01:01 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:44.395 19:01:01 -- target/ns_hotplug_stress.sh@63 -- # add_remove 7 null6 00:14:44.395 19:01:01 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:44.395 19:01:01 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:44.395 19:01:01 -- target/ns_hotplug_stress.sh@14 -- # local nsid=7 bdev=null6 00:14:44.395 19:01:01 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:44.395 19:01:01 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:44.395 19:01:01 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:44.395 19:01:01 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:44.395 19:01:01 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:44.395 19:01:01 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:44.395 19:01:01 -- target/ns_hotplug_stress.sh@63 -- # add_remove 8 null7 00:14:44.395 19:01:01 -- target/ns_hotplug_stress.sh@66 -- # wait 3042900 3042902 3042905 3042908 3042911 3042914 3042917 3042920 00:14:44.395 19:01:01 -- target/ns_hotplug_stress.sh@14 -- # local nsid=8 bdev=null7 00:14:44.395 19:01:01 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:44.395 19:01:01 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:44.395 19:01:01 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:44.653 19:01:01 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:44.653 19:01:01 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:44.653 19:01:01 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:44.653 19:01:01 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:44.653 19:01:01 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:44.653 19:01:01 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:44.653 19:01:01 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:44.653 19:01:01 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:44.653 19:01:01 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:44.653 19:01:01 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:44.653 19:01:01 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:44.653 19:01:01 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:44.653 19:01:01 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:44.653 19:01:01 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:44.653 19:01:01 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:44.653 19:01:01 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:44.653 19:01:01 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:44.653 19:01:01 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:44.653 19:01:01 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:44.653 19:01:01 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:44.653 19:01:01 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:44.653 19:01:01 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:44.653 19:01:01 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:44.653 19:01:01 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:44.653 19:01:01 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:44.653 19:01:01 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:44.913 19:01:01 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:44.913 19:01:01 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:44.913 19:01:01 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:44.913 19:01:01 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:44.913 19:01:01 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:44.913 19:01:01 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:44.913 19:01:01 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:44.913 19:01:01 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:44.913 19:01:01 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:44.913 19:01:01 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:44.913 19:01:01 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:44.913 19:01:01 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:44.913 19:01:01 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:44.913 19:01:01 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:45.172 19:01:01 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:45.173 19:01:01 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:45.173 19:01:01 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:45.173 19:01:01 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:45.173 19:01:01 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:45.173 19:01:01 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:45.173 19:01:01 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:45.173 19:01:01 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:45.173 19:01:01 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:45.173 19:01:01 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:45.173 19:01:01 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:45.173 19:01:01 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:45.173 19:01:01 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:45.173 19:01:01 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:45.173 19:01:01 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:45.173 19:01:01 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:45.173 19:01:01 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:45.173 19:01:01 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:45.173 19:01:01 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:45.173 19:01:01 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:45.173 19:01:01 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:45.173 19:01:01 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:45.173 19:01:01 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:45.173 19:01:01 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:45.432 19:01:02 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:45.432 19:01:02 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:45.432 19:01:02 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:45.432 19:01:02 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:45.432 19:01:02 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:45.432 19:01:02 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:45.432 19:01:02 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:45.432 19:01:02 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:45.432 19:01:02 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:45.432 19:01:02 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:45.432 19:01:02 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:45.691 19:01:02 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:45.691 19:01:02 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:45.691 19:01:02 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:45.691 19:01:02 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:45.691 19:01:02 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:45.691 19:01:02 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:45.691 19:01:02 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:45.691 19:01:02 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:45.691 19:01:02 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:45.691 19:01:02 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:45.691 19:01:02 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:45.691 19:01:02 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:45.691 19:01:02 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:45.691 19:01:02 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:45.691 19:01:02 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:45.691 19:01:02 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:45.691 19:01:02 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:45.691 19:01:02 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:45.691 19:01:02 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:45.691 19:01:02 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:45.691 19:01:02 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:45.691 19:01:02 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:45.691 19:01:02 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:45.691 19:01:02 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:45.691 19:01:02 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:45.691 19:01:02 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:45.691 19:01:02 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:45.691 19:01:02 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:45.691 19:01:02 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:45.950 19:01:02 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:45.950 19:01:02 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:45.950 19:01:02 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:45.950 19:01:02 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:45.950 19:01:02 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:45.950 19:01:02 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:45.950 19:01:02 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:45.950 19:01:02 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:45.950 19:01:02 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:45.950 19:01:02 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:45.950 19:01:02 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:45.950 19:01:02 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:45.950 19:01:02 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:45.950 19:01:02 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:45.950 19:01:02 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:45.950 19:01:02 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:45.950 19:01:02 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:45.950 19:01:02 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:45.950 19:01:02 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:45.950 19:01:02 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:45.950 19:01:02 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:45.950 19:01:02 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:45.950 19:01:02 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:45.951 19:01:02 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:46.210 19:01:02 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:46.210 19:01:02 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:46.210 19:01:02 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:46.210 19:01:02 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:46.210 19:01:02 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:46.210 19:01:02 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:46.210 19:01:02 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:46.210 19:01:02 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:46.470 19:01:03 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:46.470 19:01:03 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:46.470 19:01:03 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:46.470 19:01:03 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:46.470 19:01:03 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:46.470 19:01:03 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:46.470 19:01:03 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:46.470 19:01:03 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:46.470 19:01:03 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:46.470 19:01:03 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:46.470 19:01:03 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:46.470 19:01:03 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:46.470 19:01:03 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:46.470 19:01:03 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:46.470 19:01:03 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:46.470 19:01:03 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:46.470 19:01:03 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:46.470 19:01:03 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:46.470 19:01:03 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:46.470 19:01:03 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:46.470 19:01:03 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:46.470 19:01:03 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:46.470 19:01:03 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:46.470 19:01:03 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:46.470 19:01:03 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:46.470 19:01:03 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:46.470 19:01:03 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:46.470 19:01:03 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:46.470 19:01:03 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:46.470 19:01:03 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:46.470 19:01:03 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:46.470 19:01:03 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:46.729 19:01:03 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:46.729 19:01:03 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:46.729 19:01:03 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:46.729 19:01:03 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:46.729 19:01:03 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:46.729 19:01:03 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:46.729 19:01:03 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:46.729 19:01:03 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:46.729 19:01:03 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:46.729 19:01:03 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:46.729 19:01:03 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:46.729 19:01:03 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:46.729 19:01:03 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:46.729 19:01:03 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:46.729 19:01:03 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:46.729 19:01:03 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:46.729 19:01:03 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:46.729 19:01:03 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:46.729 19:01:03 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:46.729 19:01:03 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:46.729 19:01:03 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:46.729 19:01:03 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:46.729 19:01:03 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:46.729 19:01:03 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:46.988 19:01:03 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:46.988 19:01:03 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:46.988 19:01:03 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:46.988 19:01:03 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:46.988 19:01:03 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:46.988 19:01:03 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:46.988 19:01:03 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:46.988 19:01:03 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:47.248 19:01:03 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:47.248 19:01:03 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:47.248 19:01:03 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:47.248 19:01:03 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:47.248 19:01:03 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:47.248 19:01:03 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:47.248 19:01:03 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:47.248 19:01:03 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:47.248 19:01:03 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:47.248 19:01:03 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:47.248 19:01:03 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:47.248 19:01:03 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:47.248 19:01:03 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:47.248 19:01:03 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:47.248 19:01:03 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:47.248 19:01:03 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:47.248 19:01:03 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:47.248 19:01:03 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:47.248 19:01:03 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:47.248 19:01:03 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:47.248 19:01:03 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:47.248 19:01:03 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:47.248 19:01:03 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:47.248 19:01:03 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:47.248 19:01:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:47.248 19:01:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:47.248 19:01:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:47.248 19:01:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:47.508 19:01:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:47.508 19:01:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:47.508 19:01:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:47.508 19:01:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:47.508 19:01:04 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:47.508 19:01:04 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:47.508 19:01:04 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:47.508 19:01:04 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:47.508 19:01:04 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:47.508 19:01:04 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:47.508 19:01:04 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:47.508 19:01:04 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:47.508 19:01:04 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:47.508 19:01:04 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:47.508 19:01:04 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:47.508 19:01:04 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:47.508 19:01:04 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:47.508 19:01:04 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:47.508 19:01:04 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:47.508 19:01:04 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:47.508 19:01:04 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:47.508 19:01:04 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:47.508 19:01:04 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:47.508 19:01:04 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:47.508 19:01:04 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:47.508 19:01:04 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:47.508 19:01:04 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:47.508 19:01:04 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:47.768 19:01:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:47.768 19:01:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:47.768 19:01:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:47.768 19:01:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:47.768 19:01:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:47.768 19:01:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:47.768 19:01:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:47.768 19:01:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:48.027 19:01:04 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:48.027 19:01:04 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:48.027 19:01:04 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:48.027 19:01:04 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:48.027 19:01:04 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:48.027 19:01:04 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:48.027 19:01:04 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:48.027 19:01:04 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:48.027 19:01:04 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:48.027 19:01:04 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:48.027 19:01:04 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:48.027 19:01:04 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:48.027 19:01:04 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:48.027 19:01:04 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:48.027 19:01:04 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:48.027 19:01:04 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:48.027 19:01:04 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:48.027 19:01:04 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:48.027 19:01:04 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:48.027 19:01:04 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:48.027 19:01:04 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:48.027 19:01:04 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:48.027 19:01:04 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:48.027 19:01:04 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:48.027 19:01:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:48.027 19:01:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:48.027 19:01:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:48.027 19:01:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:48.027 19:01:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:48.286 19:01:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:48.286 19:01:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:48.286 19:01:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:48.287 19:01:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:48.287 19:01:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:48.287 19:01:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:48.287 19:01:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:48.287 19:01:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:48.287 19:01:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:48.287 19:01:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:48.287 19:01:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:48.287 19:01:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:48.287 19:01:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:48.287 19:01:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:48.287 19:01:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:48.287 19:01:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:48.287 19:01:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:48.287 19:01:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:48.287 19:01:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:48.287 19:01:05 -- target/ns_hotplug_stress.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:14:48.287 19:01:05 -- target/ns_hotplug_stress.sh@70 -- # nvmftestfini 00:14:48.287 19:01:05 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:48.287 19:01:05 -- nvmf/common.sh@116 -- # sync 00:14:48.287 19:01:05 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:48.287 19:01:05 -- nvmf/common.sh@119 -- # set +e 00:14:48.287 19:01:05 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:48.287 19:01:05 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:48.287 rmmod nvme_tcp 00:14:48.287 rmmod nvme_fabrics 00:14:48.287 rmmod nvme_keyring 00:14:48.546 19:01:05 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:48.546 19:01:05 -- nvmf/common.sh@123 -- # set -e 00:14:48.546 19:01:05 -- nvmf/common.sh@124 -- # return 0 00:14:48.546 19:01:05 -- nvmf/common.sh@477 -- # '[' -n 3036895 ']' 00:14:48.546 19:01:05 -- nvmf/common.sh@478 -- # killprocess 3036895 00:14:48.547 19:01:05 -- common/autotest_common.sh@936 -- # '[' -z 3036895 ']' 00:14:48.547 19:01:05 -- common/autotest_common.sh@940 -- # kill -0 3036895 00:14:48.547 19:01:05 -- common/autotest_common.sh@941 -- # uname 00:14:48.547 19:01:05 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:48.547 19:01:05 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3036895 00:14:48.547 19:01:05 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:48.547 19:01:05 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:48.547 19:01:05 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3036895' 00:14:48.547 killing process with pid 3036895 00:14:48.547 19:01:05 -- common/autotest_common.sh@955 -- # kill 3036895 00:14:48.547 19:01:05 -- common/autotest_common.sh@960 -- # wait 3036895 00:14:48.547 19:01:05 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:48.547 19:01:05 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:48.547 19:01:05 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:48.547 19:01:05 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:48.547 19:01:05 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:48.547 19:01:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:48.547 19:01:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:48.547 19:01:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:51.082 19:01:07 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:51.082 00:14:51.082 real 0m47.260s 00:14:51.082 user 3m12.815s 00:14:51.082 sys 0m14.761s 00:14:51.082 19:01:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:51.082 19:01:07 -- common/autotest_common.sh@10 -- # set +x 00:14:51.082 ************************************ 00:14:51.082 END TEST nvmf_ns_hotplug_stress 00:14:51.082 ************************************ 00:14:51.082 19:01:07 -- nvmf/nvmf.sh@33 -- # run_test nvmf_connect_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:14:51.082 19:01:07 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:51.082 19:01:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:51.082 19:01:07 -- common/autotest_common.sh@10 -- # set +x 00:14:51.082 ************************************ 00:14:51.082 START TEST nvmf_connect_stress 00:14:51.082 ************************************ 00:14:51.082 19:01:07 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:14:51.082 * Looking for test storage... 00:14:51.082 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:51.082 19:01:07 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:51.082 19:01:07 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:51.082 19:01:07 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:51.082 19:01:07 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:51.082 19:01:07 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:51.082 19:01:07 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:51.082 19:01:07 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:51.082 19:01:07 -- scripts/common.sh@335 -- # IFS=.-: 00:14:51.082 19:01:07 -- scripts/common.sh@335 -- # read -ra ver1 00:14:51.082 19:01:07 -- scripts/common.sh@336 -- # IFS=.-: 00:14:51.082 19:01:07 -- scripts/common.sh@336 -- # read -ra ver2 00:14:51.082 19:01:07 -- scripts/common.sh@337 -- # local 'op=<' 00:14:51.082 19:01:07 -- scripts/common.sh@339 -- # ver1_l=2 00:14:51.082 19:01:07 -- scripts/common.sh@340 -- # ver2_l=1 00:14:51.082 19:01:07 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:51.082 19:01:07 -- scripts/common.sh@343 -- # case "$op" in 00:14:51.082 19:01:07 -- scripts/common.sh@344 -- # : 1 00:14:51.082 19:01:07 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:51.082 19:01:07 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:51.082 19:01:07 -- scripts/common.sh@364 -- # decimal 1 00:14:51.082 19:01:07 -- scripts/common.sh@352 -- # local d=1 00:14:51.082 19:01:07 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:51.082 19:01:07 -- scripts/common.sh@354 -- # echo 1 00:14:51.082 19:01:07 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:51.082 19:01:07 -- scripts/common.sh@365 -- # decimal 2 00:14:51.082 19:01:07 -- scripts/common.sh@352 -- # local d=2 00:14:51.082 19:01:07 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:51.082 19:01:07 -- scripts/common.sh@354 -- # echo 2 00:14:51.082 19:01:07 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:51.082 19:01:07 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:51.082 19:01:07 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:51.082 19:01:07 -- scripts/common.sh@367 -- # return 0 00:14:51.082 19:01:07 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:51.082 19:01:07 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:51.082 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:51.082 --rc genhtml_branch_coverage=1 00:14:51.082 --rc genhtml_function_coverage=1 00:14:51.082 --rc genhtml_legend=1 00:14:51.082 --rc geninfo_all_blocks=1 00:14:51.082 --rc geninfo_unexecuted_blocks=1 00:14:51.082 00:14:51.082 ' 00:14:51.082 19:01:07 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:51.082 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:51.082 --rc genhtml_branch_coverage=1 00:14:51.082 --rc genhtml_function_coverage=1 00:14:51.082 --rc genhtml_legend=1 00:14:51.082 --rc geninfo_all_blocks=1 00:14:51.082 --rc geninfo_unexecuted_blocks=1 00:14:51.082 00:14:51.082 ' 00:14:51.082 19:01:07 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:51.082 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:51.082 --rc genhtml_branch_coverage=1 00:14:51.082 --rc genhtml_function_coverage=1 00:14:51.082 --rc genhtml_legend=1 00:14:51.082 --rc geninfo_all_blocks=1 00:14:51.082 --rc geninfo_unexecuted_blocks=1 00:14:51.082 00:14:51.082 ' 00:14:51.082 19:01:07 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:51.082 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:51.082 --rc genhtml_branch_coverage=1 00:14:51.082 --rc genhtml_function_coverage=1 00:14:51.083 --rc genhtml_legend=1 00:14:51.083 --rc geninfo_all_blocks=1 00:14:51.083 --rc geninfo_unexecuted_blocks=1 00:14:51.083 00:14:51.083 ' 00:14:51.083 19:01:07 -- target/connect_stress.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:51.083 19:01:07 -- nvmf/common.sh@7 -- # uname -s 00:14:51.083 19:01:07 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:51.083 19:01:07 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:51.083 19:01:07 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:51.083 19:01:07 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:51.083 19:01:07 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:51.083 19:01:07 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:51.083 19:01:07 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:51.083 19:01:07 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:51.083 19:01:07 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:51.083 19:01:07 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:51.083 19:01:07 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:14:51.083 19:01:07 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:14:51.083 19:01:07 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:51.083 19:01:07 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:51.083 19:01:07 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:51.083 19:01:07 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:51.083 19:01:07 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:51.083 19:01:07 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:51.083 19:01:07 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:51.083 19:01:07 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:51.083 19:01:07 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:51.083 19:01:07 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:51.083 19:01:07 -- paths/export.sh@5 -- # export PATH 00:14:51.083 19:01:07 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:51.083 19:01:07 -- nvmf/common.sh@46 -- # : 0 00:14:51.083 19:01:07 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:51.083 19:01:07 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:51.083 19:01:07 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:51.083 19:01:07 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:51.083 19:01:07 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:51.083 19:01:07 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:51.083 19:01:07 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:51.083 19:01:07 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:51.083 19:01:07 -- target/connect_stress.sh@12 -- # nvmftestinit 00:14:51.083 19:01:07 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:51.083 19:01:07 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:51.083 19:01:07 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:51.083 19:01:07 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:51.083 19:01:07 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:51.083 19:01:07 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:51.083 19:01:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:51.083 19:01:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:51.083 19:01:07 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:51.083 19:01:07 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:51.083 19:01:07 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:51.083 19:01:07 -- common/autotest_common.sh@10 -- # set +x 00:14:56.358 19:01:12 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:56.358 19:01:12 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:56.358 19:01:12 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:56.358 19:01:12 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:56.358 19:01:12 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:56.358 19:01:12 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:56.358 19:01:12 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:56.358 19:01:12 -- nvmf/common.sh@294 -- # net_devs=() 00:14:56.358 19:01:12 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:56.358 19:01:12 -- nvmf/common.sh@295 -- # e810=() 00:14:56.358 19:01:12 -- nvmf/common.sh@295 -- # local -ga e810 00:14:56.358 19:01:12 -- nvmf/common.sh@296 -- # x722=() 00:14:56.358 19:01:12 -- nvmf/common.sh@296 -- # local -ga x722 00:14:56.358 19:01:12 -- nvmf/common.sh@297 -- # mlx=() 00:14:56.358 19:01:12 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:56.358 19:01:12 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:56.358 19:01:12 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:56.358 19:01:12 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:56.358 19:01:12 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:56.358 19:01:12 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:56.358 19:01:12 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:56.358 19:01:12 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:56.358 19:01:12 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:56.358 19:01:12 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:56.358 19:01:12 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:56.359 19:01:12 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:56.359 19:01:12 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:56.359 19:01:12 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:56.359 19:01:12 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:56.359 19:01:12 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:56.359 19:01:12 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:56.359 19:01:12 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:56.359 19:01:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:56.359 19:01:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:14:56.359 Found 0000:86:00.0 (0x8086 - 0x159b) 00:14:56.359 19:01:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:56.359 19:01:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:56.359 19:01:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:56.359 19:01:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:56.359 19:01:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:56.359 19:01:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:56.359 19:01:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:14:56.359 Found 0000:86:00.1 (0x8086 - 0x159b) 00:14:56.359 19:01:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:56.359 19:01:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:56.359 19:01:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:56.359 19:01:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:56.359 19:01:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:56.359 19:01:12 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:56.359 19:01:12 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:56.359 19:01:12 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:56.359 19:01:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:56.359 19:01:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:56.359 19:01:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:56.359 19:01:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:56.359 19:01:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:14:56.359 Found net devices under 0000:86:00.0: cvl_0_0 00:14:56.359 19:01:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:56.359 19:01:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:56.359 19:01:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:56.359 19:01:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:56.359 19:01:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:56.359 19:01:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:14:56.359 Found net devices under 0000:86:00.1: cvl_0_1 00:14:56.359 19:01:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:56.359 19:01:12 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:56.359 19:01:12 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:56.359 19:01:12 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:56.359 19:01:12 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:56.359 19:01:12 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:56.359 19:01:12 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:56.359 19:01:12 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:56.359 19:01:12 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:56.359 19:01:12 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:56.359 19:01:12 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:56.359 19:01:12 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:56.359 19:01:12 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:56.359 19:01:12 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:56.359 19:01:12 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:56.359 19:01:12 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:56.359 19:01:12 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:56.359 19:01:12 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:56.359 19:01:12 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:56.359 19:01:12 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:56.359 19:01:13 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:56.359 19:01:13 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:56.359 19:01:13 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:56.359 19:01:13 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:56.359 19:01:13 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:56.359 19:01:13 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:56.359 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:56.359 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.474 ms 00:14:56.359 00:14:56.359 --- 10.0.0.2 ping statistics --- 00:14:56.359 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:56.359 rtt min/avg/max/mdev = 0.474/0.474/0.474/0.000 ms 00:14:56.359 19:01:13 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:56.359 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:56.359 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.213 ms 00:14:56.359 00:14:56.359 --- 10.0.0.1 ping statistics --- 00:14:56.359 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:56.359 rtt min/avg/max/mdev = 0.213/0.213/0.213/0.000 ms 00:14:56.359 19:01:13 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:56.359 19:01:13 -- nvmf/common.sh@410 -- # return 0 00:14:56.359 19:01:13 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:56.359 19:01:13 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:56.359 19:01:13 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:56.359 19:01:13 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:56.359 19:01:13 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:56.359 19:01:13 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:56.359 19:01:13 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:56.359 19:01:13 -- target/connect_stress.sh@13 -- # nvmfappstart -m 0xE 00:14:56.359 19:01:13 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:56.359 19:01:13 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:56.359 19:01:13 -- common/autotest_common.sh@10 -- # set +x 00:14:56.359 19:01:13 -- nvmf/common.sh@469 -- # nvmfpid=3047256 00:14:56.359 19:01:13 -- nvmf/common.sh@470 -- # waitforlisten 3047256 00:14:56.359 19:01:13 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:14:56.359 19:01:13 -- common/autotest_common.sh@829 -- # '[' -z 3047256 ']' 00:14:56.359 19:01:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:56.359 19:01:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:56.359 19:01:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:56.359 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:56.359 19:01:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:56.359 19:01:13 -- common/autotest_common.sh@10 -- # set +x 00:14:56.359 [2024-11-26 19:01:13.207302] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:14:56.359 [2024-11-26 19:01:13.207351] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:56.359 EAL: No free 2048 kB hugepages reported on node 1 00:14:56.359 [2024-11-26 19:01:13.268580] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:14:56.618 [2024-11-26 19:01:13.310675] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:56.618 [2024-11-26 19:01:13.310788] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:56.618 [2024-11-26 19:01:13.310795] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:56.618 [2024-11-26 19:01:13.310801] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:56.618 [2024-11-26 19:01:13.310899] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:56.618 [2024-11-26 19:01:13.310982] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:56.618 [2024-11-26 19:01:13.310984] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:57.186 19:01:14 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:57.186 19:01:14 -- common/autotest_common.sh@862 -- # return 0 00:14:57.186 19:01:14 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:57.186 19:01:14 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:57.186 19:01:14 -- common/autotest_common.sh@10 -- # set +x 00:14:57.186 19:01:14 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:57.186 19:01:14 -- target/connect_stress.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:57.186 19:01:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:57.186 19:01:14 -- common/autotest_common.sh@10 -- # set +x 00:14:57.186 [2024-11-26 19:01:14.079288] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:57.186 19:01:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:57.186 19:01:14 -- target/connect_stress.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:14:57.186 19:01:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:57.186 19:01:14 -- common/autotest_common.sh@10 -- # set +x 00:14:57.186 19:01:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:57.186 19:01:14 -- target/connect_stress.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:57.186 19:01:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:57.186 19:01:14 -- common/autotest_common.sh@10 -- # set +x 00:14:57.186 [2024-11-26 19:01:14.110075] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:57.445 19:01:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:57.445 19:01:14 -- target/connect_stress.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:14:57.445 19:01:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:57.445 19:01:14 -- common/autotest_common.sh@10 -- # set +x 00:14:57.445 NULL1 00:14:57.445 19:01:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:57.445 19:01:14 -- target/connect_stress.sh@21 -- # PERF_PID=3047507 00:14:57.445 19:01:14 -- target/connect_stress.sh@23 -- # rpcs=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:14:57.445 19:01:14 -- target/connect_stress.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/connect_stress/connect_stress -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -t 10 00:14:57.445 19:01:14 -- target/connect_stress.sh@25 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:14:57.445 19:01:14 -- target/connect_stress.sh@27 -- # seq 1 20 00:14:57.445 19:01:14 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:57.445 19:01:14 -- target/connect_stress.sh@28 -- # cat 00:14:57.445 19:01:14 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:57.445 19:01:14 -- target/connect_stress.sh@28 -- # cat 00:14:57.445 19:01:14 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:57.445 19:01:14 -- target/connect_stress.sh@28 -- # cat 00:14:57.445 19:01:14 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:57.445 19:01:14 -- target/connect_stress.sh@28 -- # cat 00:14:57.445 19:01:14 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:57.445 19:01:14 -- target/connect_stress.sh@28 -- # cat 00:14:57.445 19:01:14 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:57.445 19:01:14 -- target/connect_stress.sh@28 -- # cat 00:14:57.445 EAL: No free 2048 kB hugepages reported on node 1 00:14:57.445 19:01:14 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:57.445 19:01:14 -- target/connect_stress.sh@28 -- # cat 00:14:57.445 19:01:14 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:57.445 19:01:14 -- target/connect_stress.sh@28 -- # cat 00:14:57.445 19:01:14 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:57.445 19:01:14 -- target/connect_stress.sh@28 -- # cat 00:14:57.445 19:01:14 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:57.445 19:01:14 -- target/connect_stress.sh@28 -- # cat 00:14:57.445 19:01:14 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:57.445 19:01:14 -- target/connect_stress.sh@28 -- # cat 00:14:57.445 19:01:14 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:57.445 19:01:14 -- target/connect_stress.sh@28 -- # cat 00:14:57.445 19:01:14 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:57.445 19:01:14 -- target/connect_stress.sh@28 -- # cat 00:14:57.445 19:01:14 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:57.445 19:01:14 -- target/connect_stress.sh@28 -- # cat 00:14:57.445 19:01:14 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:57.445 19:01:14 -- target/connect_stress.sh@28 -- # cat 00:14:57.445 19:01:14 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:57.445 19:01:14 -- target/connect_stress.sh@28 -- # cat 00:14:57.445 19:01:14 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:57.445 19:01:14 -- target/connect_stress.sh@28 -- # cat 00:14:57.445 19:01:14 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:57.445 19:01:14 -- target/connect_stress.sh@28 -- # cat 00:14:57.445 19:01:14 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:57.445 19:01:14 -- target/connect_stress.sh@28 -- # cat 00:14:57.445 19:01:14 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:57.445 19:01:14 -- target/connect_stress.sh@28 -- # cat 00:14:57.445 19:01:14 -- target/connect_stress.sh@34 -- # kill -0 3047507 00:14:57.445 19:01:14 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:57.445 19:01:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:57.445 19:01:14 -- common/autotest_common.sh@10 -- # set +x 00:14:57.704 19:01:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:57.704 19:01:14 -- target/connect_stress.sh@34 -- # kill -0 3047507 00:14:57.704 19:01:14 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:57.704 19:01:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:57.704 19:01:14 -- common/autotest_common.sh@10 -- # set +x 00:14:57.996 19:01:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:57.996 19:01:14 -- target/connect_stress.sh@34 -- # kill -0 3047507 00:14:57.996 19:01:14 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:57.996 19:01:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:57.996 19:01:14 -- common/autotest_common.sh@10 -- # set +x 00:14:58.299 19:01:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:58.299 19:01:15 -- target/connect_stress.sh@34 -- # kill -0 3047507 00:14:58.299 19:01:15 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:58.299 19:01:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:58.299 19:01:15 -- common/autotest_common.sh@10 -- # set +x 00:14:58.867 19:01:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:58.867 19:01:15 -- target/connect_stress.sh@34 -- # kill -0 3047507 00:14:58.867 19:01:15 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:58.867 19:01:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:58.867 19:01:15 -- common/autotest_common.sh@10 -- # set +x 00:14:59.125 19:01:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:59.125 19:01:15 -- target/connect_stress.sh@34 -- # kill -0 3047507 00:14:59.125 19:01:15 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:59.125 19:01:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:59.125 19:01:15 -- common/autotest_common.sh@10 -- # set +x 00:14:59.383 19:01:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:59.383 19:01:16 -- target/connect_stress.sh@34 -- # kill -0 3047507 00:14:59.383 19:01:16 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:59.383 19:01:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:59.383 19:01:16 -- common/autotest_common.sh@10 -- # set +x 00:14:59.640 19:01:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:59.640 19:01:16 -- target/connect_stress.sh@34 -- # kill -0 3047507 00:14:59.640 19:01:16 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:59.640 19:01:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:59.640 19:01:16 -- common/autotest_common.sh@10 -- # set +x 00:14:59.897 19:01:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:59.897 19:01:16 -- target/connect_stress.sh@34 -- # kill -0 3047507 00:14:59.897 19:01:16 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:59.897 19:01:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:00.154 19:01:16 -- common/autotest_common.sh@10 -- # set +x 00:15:00.411 19:01:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:00.411 19:01:17 -- target/connect_stress.sh@34 -- # kill -0 3047507 00:15:00.411 19:01:17 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:00.411 19:01:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:00.411 19:01:17 -- common/autotest_common.sh@10 -- # set +x 00:15:00.668 19:01:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:00.668 19:01:17 -- target/connect_stress.sh@34 -- # kill -0 3047507 00:15:00.668 19:01:17 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:00.668 19:01:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:00.668 19:01:17 -- common/autotest_common.sh@10 -- # set +x 00:15:00.925 19:01:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:00.925 19:01:17 -- target/connect_stress.sh@34 -- # kill -0 3047507 00:15:00.925 19:01:17 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:00.925 19:01:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:00.925 19:01:17 -- common/autotest_common.sh@10 -- # set +x 00:15:01.488 19:01:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:01.488 19:01:18 -- target/connect_stress.sh@34 -- # kill -0 3047507 00:15:01.488 19:01:18 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:01.488 19:01:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:01.488 19:01:18 -- common/autotest_common.sh@10 -- # set +x 00:15:01.746 19:01:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:01.746 19:01:18 -- target/connect_stress.sh@34 -- # kill -0 3047507 00:15:01.746 19:01:18 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:01.746 19:01:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:01.746 19:01:18 -- common/autotest_common.sh@10 -- # set +x 00:15:02.003 19:01:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:02.003 19:01:18 -- target/connect_stress.sh@34 -- # kill -0 3047507 00:15:02.003 19:01:18 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:02.003 19:01:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:02.003 19:01:18 -- common/autotest_common.sh@10 -- # set +x 00:15:02.261 19:01:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:02.261 19:01:19 -- target/connect_stress.sh@34 -- # kill -0 3047507 00:15:02.261 19:01:19 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:02.261 19:01:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:02.261 19:01:19 -- common/autotest_common.sh@10 -- # set +x 00:15:02.519 19:01:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:02.519 19:01:19 -- target/connect_stress.sh@34 -- # kill -0 3047507 00:15:02.519 19:01:19 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:02.519 19:01:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:02.519 19:01:19 -- common/autotest_common.sh@10 -- # set +x 00:15:03.085 19:01:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:03.085 19:01:19 -- target/connect_stress.sh@34 -- # kill -0 3047507 00:15:03.085 19:01:19 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:03.085 19:01:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:03.085 19:01:19 -- common/autotest_common.sh@10 -- # set +x 00:15:03.344 19:01:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:03.344 19:01:20 -- target/connect_stress.sh@34 -- # kill -0 3047507 00:15:03.344 19:01:20 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:03.344 19:01:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:03.344 19:01:20 -- common/autotest_common.sh@10 -- # set +x 00:15:03.603 19:01:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:03.603 19:01:20 -- target/connect_stress.sh@34 -- # kill -0 3047507 00:15:03.603 19:01:20 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:03.603 19:01:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:03.603 19:01:20 -- common/autotest_common.sh@10 -- # set +x 00:15:03.861 19:01:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:03.862 19:01:20 -- target/connect_stress.sh@34 -- # kill -0 3047507 00:15:03.862 19:01:20 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:03.862 19:01:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:03.862 19:01:20 -- common/autotest_common.sh@10 -- # set +x 00:15:04.120 19:01:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:04.120 19:01:21 -- target/connect_stress.sh@34 -- # kill -0 3047507 00:15:04.120 19:01:21 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:04.120 19:01:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:04.120 19:01:21 -- common/autotest_common.sh@10 -- # set +x 00:15:04.687 19:01:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:04.687 19:01:21 -- target/connect_stress.sh@34 -- # kill -0 3047507 00:15:04.687 19:01:21 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:04.687 19:01:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:04.687 19:01:21 -- common/autotest_common.sh@10 -- # set +x 00:15:04.945 19:01:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:04.945 19:01:21 -- target/connect_stress.sh@34 -- # kill -0 3047507 00:15:04.945 19:01:21 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:04.945 19:01:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:04.945 19:01:21 -- common/autotest_common.sh@10 -- # set +x 00:15:05.204 19:01:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:05.204 19:01:22 -- target/connect_stress.sh@34 -- # kill -0 3047507 00:15:05.204 19:01:22 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:05.204 19:01:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:05.204 19:01:22 -- common/autotest_common.sh@10 -- # set +x 00:15:05.463 19:01:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:05.463 19:01:22 -- target/connect_stress.sh@34 -- # kill -0 3047507 00:15:05.463 19:01:22 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:05.463 19:01:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:05.463 19:01:22 -- common/autotest_common.sh@10 -- # set +x 00:15:06.029 19:01:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:06.029 19:01:22 -- target/connect_stress.sh@34 -- # kill -0 3047507 00:15:06.029 19:01:22 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:06.029 19:01:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:06.029 19:01:22 -- common/autotest_common.sh@10 -- # set +x 00:15:06.287 19:01:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:06.287 19:01:23 -- target/connect_stress.sh@34 -- # kill -0 3047507 00:15:06.287 19:01:23 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:06.287 19:01:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:06.287 19:01:23 -- common/autotest_common.sh@10 -- # set +x 00:15:06.544 19:01:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:06.544 19:01:23 -- target/connect_stress.sh@34 -- # kill -0 3047507 00:15:06.544 19:01:23 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:06.544 19:01:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:06.544 19:01:23 -- common/autotest_common.sh@10 -- # set +x 00:15:06.801 19:01:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:06.801 19:01:23 -- target/connect_stress.sh@34 -- # kill -0 3047507 00:15:06.801 19:01:23 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:06.801 19:01:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:06.801 19:01:23 -- common/autotest_common.sh@10 -- # set +x 00:15:07.367 19:01:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:07.367 19:01:23 -- target/connect_stress.sh@34 -- # kill -0 3047507 00:15:07.367 19:01:23 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:07.367 19:01:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:07.367 19:01:23 -- common/autotest_common.sh@10 -- # set +x 00:15:07.625 19:01:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:07.625 19:01:24 -- target/connect_stress.sh@34 -- # kill -0 3047507 00:15:07.625 19:01:24 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:07.625 19:01:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:07.625 19:01:24 -- common/autotest_common.sh@10 -- # set +x 00:15:07.625 Testing NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:15:07.884 19:01:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:07.884 19:01:24 -- target/connect_stress.sh@34 -- # kill -0 3047507 00:15:07.884 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh: line 34: kill: (3047507) - No such process 00:15:07.884 19:01:24 -- target/connect_stress.sh@38 -- # wait 3047507 00:15:07.884 19:01:24 -- target/connect_stress.sh@39 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:15:07.884 19:01:24 -- target/connect_stress.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:15:07.884 19:01:24 -- target/connect_stress.sh@43 -- # nvmftestfini 00:15:07.884 19:01:24 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:07.884 19:01:24 -- nvmf/common.sh@116 -- # sync 00:15:07.884 19:01:24 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:07.884 19:01:24 -- nvmf/common.sh@119 -- # set +e 00:15:07.884 19:01:24 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:07.884 19:01:24 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:07.884 rmmod nvme_tcp 00:15:07.884 rmmod nvme_fabrics 00:15:07.884 rmmod nvme_keyring 00:15:07.884 19:01:24 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:07.884 19:01:24 -- nvmf/common.sh@123 -- # set -e 00:15:07.884 19:01:24 -- nvmf/common.sh@124 -- # return 0 00:15:07.884 19:01:24 -- nvmf/common.sh@477 -- # '[' -n 3047256 ']' 00:15:07.884 19:01:24 -- nvmf/common.sh@478 -- # killprocess 3047256 00:15:07.884 19:01:24 -- common/autotest_common.sh@936 -- # '[' -z 3047256 ']' 00:15:07.884 19:01:24 -- common/autotest_common.sh@940 -- # kill -0 3047256 00:15:07.884 19:01:24 -- common/autotest_common.sh@941 -- # uname 00:15:07.884 19:01:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:07.884 19:01:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3047256 00:15:07.884 19:01:24 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:07.884 19:01:24 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:07.884 19:01:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3047256' 00:15:07.884 killing process with pid 3047256 00:15:07.884 19:01:24 -- common/autotest_common.sh@955 -- # kill 3047256 00:15:07.884 19:01:24 -- common/autotest_common.sh@960 -- # wait 3047256 00:15:08.143 19:01:24 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:08.143 19:01:24 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:08.143 19:01:24 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:08.143 19:01:24 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:08.143 19:01:24 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:08.143 19:01:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:08.143 19:01:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:08.143 19:01:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:10.680 19:01:27 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:10.680 00:15:10.680 real 0m19.442s 00:15:10.680 user 0m42.614s 00:15:10.680 sys 0m7.984s 00:15:10.680 19:01:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:10.680 19:01:27 -- common/autotest_common.sh@10 -- # set +x 00:15:10.680 ************************************ 00:15:10.680 END TEST nvmf_connect_stress 00:15:10.680 ************************************ 00:15:10.680 19:01:27 -- nvmf/nvmf.sh@34 -- # run_test nvmf_fused_ordering /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:15:10.680 19:01:27 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:10.680 19:01:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:10.680 19:01:27 -- common/autotest_common.sh@10 -- # set +x 00:15:10.680 ************************************ 00:15:10.680 START TEST nvmf_fused_ordering 00:15:10.680 ************************************ 00:15:10.680 19:01:27 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:15:10.680 * Looking for test storage... 00:15:10.680 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:10.680 19:01:27 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:10.680 19:01:27 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:10.680 19:01:27 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:10.680 19:01:27 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:10.680 19:01:27 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:10.680 19:01:27 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:10.680 19:01:27 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:10.680 19:01:27 -- scripts/common.sh@335 -- # IFS=.-: 00:15:10.680 19:01:27 -- scripts/common.sh@335 -- # read -ra ver1 00:15:10.680 19:01:27 -- scripts/common.sh@336 -- # IFS=.-: 00:15:10.680 19:01:27 -- scripts/common.sh@336 -- # read -ra ver2 00:15:10.681 19:01:27 -- scripts/common.sh@337 -- # local 'op=<' 00:15:10.681 19:01:27 -- scripts/common.sh@339 -- # ver1_l=2 00:15:10.681 19:01:27 -- scripts/common.sh@340 -- # ver2_l=1 00:15:10.681 19:01:27 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:10.681 19:01:27 -- scripts/common.sh@343 -- # case "$op" in 00:15:10.681 19:01:27 -- scripts/common.sh@344 -- # : 1 00:15:10.681 19:01:27 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:10.681 19:01:27 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:10.681 19:01:27 -- scripts/common.sh@364 -- # decimal 1 00:15:10.681 19:01:27 -- scripts/common.sh@352 -- # local d=1 00:15:10.681 19:01:27 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:10.681 19:01:27 -- scripts/common.sh@354 -- # echo 1 00:15:10.681 19:01:27 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:10.681 19:01:27 -- scripts/common.sh@365 -- # decimal 2 00:15:10.681 19:01:27 -- scripts/common.sh@352 -- # local d=2 00:15:10.681 19:01:27 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:10.681 19:01:27 -- scripts/common.sh@354 -- # echo 2 00:15:10.681 19:01:27 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:10.681 19:01:27 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:10.681 19:01:27 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:10.681 19:01:27 -- scripts/common.sh@367 -- # return 0 00:15:10.681 19:01:27 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:10.681 19:01:27 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:10.681 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:10.681 --rc genhtml_branch_coverage=1 00:15:10.681 --rc genhtml_function_coverage=1 00:15:10.681 --rc genhtml_legend=1 00:15:10.681 --rc geninfo_all_blocks=1 00:15:10.681 --rc geninfo_unexecuted_blocks=1 00:15:10.681 00:15:10.681 ' 00:15:10.681 19:01:27 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:10.681 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:10.681 --rc genhtml_branch_coverage=1 00:15:10.681 --rc genhtml_function_coverage=1 00:15:10.681 --rc genhtml_legend=1 00:15:10.681 --rc geninfo_all_blocks=1 00:15:10.681 --rc geninfo_unexecuted_blocks=1 00:15:10.681 00:15:10.681 ' 00:15:10.681 19:01:27 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:10.681 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:10.681 --rc genhtml_branch_coverage=1 00:15:10.681 --rc genhtml_function_coverage=1 00:15:10.681 --rc genhtml_legend=1 00:15:10.681 --rc geninfo_all_blocks=1 00:15:10.681 --rc geninfo_unexecuted_blocks=1 00:15:10.681 00:15:10.681 ' 00:15:10.681 19:01:27 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:10.681 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:10.681 --rc genhtml_branch_coverage=1 00:15:10.681 --rc genhtml_function_coverage=1 00:15:10.681 --rc genhtml_legend=1 00:15:10.681 --rc geninfo_all_blocks=1 00:15:10.681 --rc geninfo_unexecuted_blocks=1 00:15:10.681 00:15:10.681 ' 00:15:10.681 19:01:27 -- target/fused_ordering.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:10.681 19:01:27 -- nvmf/common.sh@7 -- # uname -s 00:15:10.681 19:01:27 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:10.681 19:01:27 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:10.681 19:01:27 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:10.681 19:01:27 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:10.681 19:01:27 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:10.681 19:01:27 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:10.681 19:01:27 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:10.681 19:01:27 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:10.681 19:01:27 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:10.681 19:01:27 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:10.681 19:01:27 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:15:10.681 19:01:27 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:15:10.681 19:01:27 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:10.681 19:01:27 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:10.681 19:01:27 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:10.681 19:01:27 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:10.681 19:01:27 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:10.681 19:01:27 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:10.681 19:01:27 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:10.681 19:01:27 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:10.681 19:01:27 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:10.681 19:01:27 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:10.681 19:01:27 -- paths/export.sh@5 -- # export PATH 00:15:10.681 19:01:27 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:10.681 19:01:27 -- nvmf/common.sh@46 -- # : 0 00:15:10.681 19:01:27 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:10.681 19:01:27 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:10.681 19:01:27 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:10.681 19:01:27 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:10.681 19:01:27 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:10.681 19:01:27 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:10.682 19:01:27 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:10.682 19:01:27 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:10.682 19:01:27 -- target/fused_ordering.sh@12 -- # nvmftestinit 00:15:10.682 19:01:27 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:10.682 19:01:27 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:10.682 19:01:27 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:10.682 19:01:27 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:10.682 19:01:27 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:10.682 19:01:27 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:10.682 19:01:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:10.682 19:01:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:10.682 19:01:27 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:10.682 19:01:27 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:10.682 19:01:27 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:10.682 19:01:27 -- common/autotest_common.sh@10 -- # set +x 00:15:15.950 19:01:32 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:15.950 19:01:32 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:15.950 19:01:32 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:15.950 19:01:32 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:15.950 19:01:32 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:15.950 19:01:32 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:15.950 19:01:32 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:15.950 19:01:32 -- nvmf/common.sh@294 -- # net_devs=() 00:15:15.950 19:01:32 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:15.950 19:01:32 -- nvmf/common.sh@295 -- # e810=() 00:15:15.950 19:01:32 -- nvmf/common.sh@295 -- # local -ga e810 00:15:15.950 19:01:32 -- nvmf/common.sh@296 -- # x722=() 00:15:15.950 19:01:32 -- nvmf/common.sh@296 -- # local -ga x722 00:15:15.950 19:01:32 -- nvmf/common.sh@297 -- # mlx=() 00:15:15.950 19:01:32 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:15.950 19:01:32 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:15.950 19:01:32 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:15.950 19:01:32 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:15.950 19:01:32 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:15.950 19:01:32 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:15.950 19:01:32 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:15.950 19:01:32 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:15.950 19:01:32 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:15.950 19:01:32 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:15.950 19:01:32 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:15.950 19:01:32 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:15.950 19:01:32 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:15.950 19:01:32 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:15.950 19:01:32 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:15.950 19:01:32 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:15.950 19:01:32 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:15.950 19:01:32 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:15.950 19:01:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:15.950 19:01:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:15:15.950 Found 0000:86:00.0 (0x8086 - 0x159b) 00:15:15.950 19:01:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:15.950 19:01:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:15.950 19:01:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:15.950 19:01:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:15.950 19:01:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:15.950 19:01:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:15.950 19:01:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:15:15.950 Found 0000:86:00.1 (0x8086 - 0x159b) 00:15:15.950 19:01:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:15.950 19:01:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:15.950 19:01:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:15.950 19:01:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:15.950 19:01:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:15.950 19:01:32 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:15.950 19:01:32 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:15.950 19:01:32 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:15.950 19:01:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:15.951 19:01:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:15.951 19:01:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:15.951 19:01:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:15.951 19:01:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:15:15.951 Found net devices under 0000:86:00.0: cvl_0_0 00:15:15.951 19:01:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:15.951 19:01:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:15.951 19:01:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:15.951 19:01:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:15.951 19:01:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:15.951 19:01:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:15:15.951 Found net devices under 0000:86:00.1: cvl_0_1 00:15:15.951 19:01:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:15.951 19:01:32 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:15.951 19:01:32 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:15.951 19:01:32 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:15.951 19:01:32 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:15.951 19:01:32 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:15.951 19:01:32 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:15.951 19:01:32 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:15.951 19:01:32 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:15.951 19:01:32 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:15.951 19:01:32 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:15.951 19:01:32 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:15.951 19:01:32 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:15.951 19:01:32 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:15.951 19:01:32 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:15.951 19:01:32 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:15.951 19:01:32 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:15.951 19:01:32 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:15.951 19:01:32 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:15.951 19:01:32 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:15.951 19:01:32 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:15.951 19:01:32 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:15.951 19:01:32 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:15.951 19:01:32 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:15.951 19:01:32 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:15.951 19:01:32 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:15.951 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:15.951 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.401 ms 00:15:15.951 00:15:15.951 --- 10.0.0.2 ping statistics --- 00:15:15.951 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:15.951 rtt min/avg/max/mdev = 0.401/0.401/0.401/0.000 ms 00:15:15.951 19:01:32 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:15.951 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:15.951 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.214 ms 00:15:15.951 00:15:15.951 --- 10.0.0.1 ping statistics --- 00:15:15.951 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:15.951 rtt min/avg/max/mdev = 0.214/0.214/0.214/0.000 ms 00:15:15.951 19:01:32 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:15.951 19:01:32 -- nvmf/common.sh@410 -- # return 0 00:15:15.951 19:01:32 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:15.951 19:01:32 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:15.951 19:01:32 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:15.951 19:01:32 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:15.951 19:01:32 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:15.951 19:01:32 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:15.951 19:01:32 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:15.951 19:01:32 -- target/fused_ordering.sh@13 -- # nvmfappstart -m 0x2 00:15:15.951 19:01:32 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:15.951 19:01:32 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:15.951 19:01:32 -- common/autotest_common.sh@10 -- # set +x 00:15:15.951 19:01:32 -- nvmf/common.sh@469 -- # nvmfpid=3052713 00:15:15.951 19:01:32 -- nvmf/common.sh@470 -- # waitforlisten 3052713 00:15:15.951 19:01:32 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:15:15.951 19:01:32 -- common/autotest_common.sh@829 -- # '[' -z 3052713 ']' 00:15:15.951 19:01:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:15.951 19:01:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:15.951 19:01:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:15.951 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:15.951 19:01:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:15.951 19:01:32 -- common/autotest_common.sh@10 -- # set +x 00:15:15.951 [2024-11-26 19:01:32.759929] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:15:15.951 [2024-11-26 19:01:32.759992] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:15.951 EAL: No free 2048 kB hugepages reported on node 1 00:15:15.951 [2024-11-26 19:01:32.818570] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:15.951 [2024-11-26 19:01:32.858614] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:15.951 [2024-11-26 19:01:32.858724] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:15.951 [2024-11-26 19:01:32.858731] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:15.951 [2024-11-26 19:01:32.858737] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:15.951 [2024-11-26 19:01:32.858758] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:16.889 19:01:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:16.889 19:01:33 -- common/autotest_common.sh@862 -- # return 0 00:15:16.889 19:01:33 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:16.889 19:01:33 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:16.889 19:01:33 -- common/autotest_common.sh@10 -- # set +x 00:15:16.889 19:01:33 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:16.889 19:01:33 -- target/fused_ordering.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:16.889 19:01:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:16.889 19:01:33 -- common/autotest_common.sh@10 -- # set +x 00:15:16.889 [2024-11-26 19:01:33.617643] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:16.889 19:01:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:16.889 19:01:33 -- target/fused_ordering.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:15:16.889 19:01:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:16.889 19:01:33 -- common/autotest_common.sh@10 -- # set +x 00:15:16.889 19:01:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:16.889 19:01:33 -- target/fused_ordering.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:16.889 19:01:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:16.889 19:01:33 -- common/autotest_common.sh@10 -- # set +x 00:15:16.889 [2024-11-26 19:01:33.637812] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:16.889 19:01:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:16.889 19:01:33 -- target/fused_ordering.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:15:16.889 19:01:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:16.889 19:01:33 -- common/autotest_common.sh@10 -- # set +x 00:15:16.889 NULL1 00:15:16.889 19:01:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:16.889 19:01:33 -- target/fused_ordering.sh@19 -- # rpc_cmd bdev_wait_for_examine 00:15:16.889 19:01:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:16.889 19:01:33 -- common/autotest_common.sh@10 -- # set +x 00:15:16.889 19:01:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:16.889 19:01:33 -- target/fused_ordering.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:15:16.889 19:01:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:16.889 19:01:33 -- common/autotest_common.sh@10 -- # set +x 00:15:16.889 19:01:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:16.889 19:01:33 -- target/fused_ordering.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/fused_ordering/fused_ordering -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:15:16.889 [2024-11-26 19:01:33.688435] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:15:16.889 [2024-11-26 19:01:33.688479] [ DPDK EAL parameters: fused_ordering --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3052962 ] 00:15:16.889 EAL: No free 2048 kB hugepages reported on node 1 00:15:17.149 Attached to nqn.2016-06.io.spdk:cnode1 00:15:17.149 Namespace ID: 1 size: 1GB 00:15:17.149 fused_ordering(0) 00:15:17.149 fused_ordering(1) 00:15:17.149 fused_ordering(2) 00:15:17.149 fused_ordering(3) 00:15:17.149 fused_ordering(4) 00:15:17.149 fused_ordering(5) 00:15:17.149 fused_ordering(6) 00:15:17.149 fused_ordering(7) 00:15:17.149 fused_ordering(8) 00:15:17.149 fused_ordering(9) 00:15:17.149 fused_ordering(10) 00:15:17.149 fused_ordering(11) 00:15:17.149 fused_ordering(12) 00:15:17.149 fused_ordering(13) 00:15:17.149 fused_ordering(14) 00:15:17.149 fused_ordering(15) 00:15:17.149 fused_ordering(16) 00:15:17.149 fused_ordering(17) 00:15:17.149 fused_ordering(18) 00:15:17.149 fused_ordering(19) 00:15:17.149 fused_ordering(20) 00:15:17.149 fused_ordering(21) 00:15:17.149 fused_ordering(22) 00:15:17.149 fused_ordering(23) 00:15:17.149 fused_ordering(24) 00:15:17.149 fused_ordering(25) 00:15:17.149 fused_ordering(26) 00:15:17.149 fused_ordering(27) 00:15:17.149 fused_ordering(28) 00:15:17.149 fused_ordering(29) 00:15:17.149 fused_ordering(30) 00:15:17.149 fused_ordering(31) 00:15:17.149 fused_ordering(32) 00:15:17.149 fused_ordering(33) 00:15:17.149 fused_ordering(34) 00:15:17.149 fused_ordering(35) 00:15:17.149 fused_ordering(36) 00:15:17.149 fused_ordering(37) 00:15:17.149 fused_ordering(38) 00:15:17.149 fused_ordering(39) 00:15:17.149 fused_ordering(40) 00:15:17.149 fused_ordering(41) 00:15:17.149 fused_ordering(42) 00:15:17.149 fused_ordering(43) 00:15:17.149 fused_ordering(44) 00:15:17.149 fused_ordering(45) 00:15:17.149 fused_ordering(46) 00:15:17.149 fused_ordering(47) 00:15:17.149 fused_ordering(48) 00:15:17.149 fused_ordering(49) 00:15:17.149 fused_ordering(50) 00:15:17.149 fused_ordering(51) 00:15:17.149 fused_ordering(52) 00:15:17.149 fused_ordering(53) 00:15:17.149 fused_ordering(54) 00:15:17.149 fused_ordering(55) 00:15:17.149 fused_ordering(56) 00:15:17.149 fused_ordering(57) 00:15:17.149 fused_ordering(58) 00:15:17.149 fused_ordering(59) 00:15:17.149 fused_ordering(60) 00:15:17.149 fused_ordering(61) 00:15:17.149 fused_ordering(62) 00:15:17.149 fused_ordering(63) 00:15:17.149 fused_ordering(64) 00:15:17.149 fused_ordering(65) 00:15:17.149 fused_ordering(66) 00:15:17.149 fused_ordering(67) 00:15:17.149 fused_ordering(68) 00:15:17.149 fused_ordering(69) 00:15:17.149 fused_ordering(70) 00:15:17.149 fused_ordering(71) 00:15:17.149 fused_ordering(72) 00:15:17.149 fused_ordering(73) 00:15:17.149 fused_ordering(74) 00:15:17.149 fused_ordering(75) 00:15:17.149 fused_ordering(76) 00:15:17.149 fused_ordering(77) 00:15:17.149 fused_ordering(78) 00:15:17.149 fused_ordering(79) 00:15:17.149 fused_ordering(80) 00:15:17.149 fused_ordering(81) 00:15:17.149 fused_ordering(82) 00:15:17.149 fused_ordering(83) 00:15:17.149 fused_ordering(84) 00:15:17.149 fused_ordering(85) 00:15:17.149 fused_ordering(86) 00:15:17.149 fused_ordering(87) 00:15:17.149 fused_ordering(88) 00:15:17.149 fused_ordering(89) 00:15:17.149 fused_ordering(90) 00:15:17.149 fused_ordering(91) 00:15:17.149 fused_ordering(92) 00:15:17.149 fused_ordering(93) 00:15:17.149 fused_ordering(94) 00:15:17.149 fused_ordering(95) 00:15:17.149 fused_ordering(96) 00:15:17.149 fused_ordering(97) 00:15:17.149 fused_ordering(98) 00:15:17.149 fused_ordering(99) 00:15:17.149 fused_ordering(100) 00:15:17.149 fused_ordering(101) 00:15:17.149 fused_ordering(102) 00:15:17.149 fused_ordering(103) 00:15:17.149 fused_ordering(104) 00:15:17.149 fused_ordering(105) 00:15:17.149 fused_ordering(106) 00:15:17.149 fused_ordering(107) 00:15:17.149 fused_ordering(108) 00:15:17.149 fused_ordering(109) 00:15:17.149 fused_ordering(110) 00:15:17.149 fused_ordering(111) 00:15:17.149 fused_ordering(112) 00:15:17.149 fused_ordering(113) 00:15:17.149 fused_ordering(114) 00:15:17.149 fused_ordering(115) 00:15:17.149 fused_ordering(116) 00:15:17.149 fused_ordering(117) 00:15:17.149 fused_ordering(118) 00:15:17.149 fused_ordering(119) 00:15:17.149 fused_ordering(120) 00:15:17.149 fused_ordering(121) 00:15:17.149 fused_ordering(122) 00:15:17.149 fused_ordering(123) 00:15:17.149 fused_ordering(124) 00:15:17.149 fused_ordering(125) 00:15:17.149 fused_ordering(126) 00:15:17.149 fused_ordering(127) 00:15:17.149 fused_ordering(128) 00:15:17.149 fused_ordering(129) 00:15:17.149 fused_ordering(130) 00:15:17.149 fused_ordering(131) 00:15:17.149 fused_ordering(132) 00:15:17.149 fused_ordering(133) 00:15:17.149 fused_ordering(134) 00:15:17.149 fused_ordering(135) 00:15:17.149 fused_ordering(136) 00:15:17.149 fused_ordering(137) 00:15:17.149 fused_ordering(138) 00:15:17.149 fused_ordering(139) 00:15:17.149 fused_ordering(140) 00:15:17.149 fused_ordering(141) 00:15:17.149 fused_ordering(142) 00:15:17.149 fused_ordering(143) 00:15:17.149 fused_ordering(144) 00:15:17.149 fused_ordering(145) 00:15:17.149 fused_ordering(146) 00:15:17.149 fused_ordering(147) 00:15:17.149 fused_ordering(148) 00:15:17.149 fused_ordering(149) 00:15:17.149 fused_ordering(150) 00:15:17.149 fused_ordering(151) 00:15:17.149 fused_ordering(152) 00:15:17.149 fused_ordering(153) 00:15:17.149 fused_ordering(154) 00:15:17.149 fused_ordering(155) 00:15:17.149 fused_ordering(156) 00:15:17.149 fused_ordering(157) 00:15:17.149 fused_ordering(158) 00:15:17.149 fused_ordering(159) 00:15:17.149 fused_ordering(160) 00:15:17.149 fused_ordering(161) 00:15:17.149 fused_ordering(162) 00:15:17.149 fused_ordering(163) 00:15:17.149 fused_ordering(164) 00:15:17.149 fused_ordering(165) 00:15:17.149 fused_ordering(166) 00:15:17.149 fused_ordering(167) 00:15:17.149 fused_ordering(168) 00:15:17.149 fused_ordering(169) 00:15:17.149 fused_ordering(170) 00:15:17.149 fused_ordering(171) 00:15:17.149 fused_ordering(172) 00:15:17.149 fused_ordering(173) 00:15:17.149 fused_ordering(174) 00:15:17.149 fused_ordering(175) 00:15:17.149 fused_ordering(176) 00:15:17.149 fused_ordering(177) 00:15:17.149 fused_ordering(178) 00:15:17.149 fused_ordering(179) 00:15:17.149 fused_ordering(180) 00:15:17.149 fused_ordering(181) 00:15:17.149 fused_ordering(182) 00:15:17.149 fused_ordering(183) 00:15:17.149 fused_ordering(184) 00:15:17.149 fused_ordering(185) 00:15:17.149 fused_ordering(186) 00:15:17.149 fused_ordering(187) 00:15:17.149 fused_ordering(188) 00:15:17.149 fused_ordering(189) 00:15:17.149 fused_ordering(190) 00:15:17.149 fused_ordering(191) 00:15:17.149 fused_ordering(192) 00:15:17.149 fused_ordering(193) 00:15:17.149 fused_ordering(194) 00:15:17.149 fused_ordering(195) 00:15:17.150 fused_ordering(196) 00:15:17.150 fused_ordering(197) 00:15:17.150 fused_ordering(198) 00:15:17.150 fused_ordering(199) 00:15:17.150 fused_ordering(200) 00:15:17.150 fused_ordering(201) 00:15:17.150 fused_ordering(202) 00:15:17.150 fused_ordering(203) 00:15:17.150 fused_ordering(204) 00:15:17.150 fused_ordering(205) 00:15:17.409 fused_ordering(206) 00:15:17.409 fused_ordering(207) 00:15:17.409 fused_ordering(208) 00:15:17.409 fused_ordering(209) 00:15:17.409 fused_ordering(210) 00:15:17.409 fused_ordering(211) 00:15:17.409 fused_ordering(212) 00:15:17.409 fused_ordering(213) 00:15:17.409 fused_ordering(214) 00:15:17.409 fused_ordering(215) 00:15:17.409 fused_ordering(216) 00:15:17.409 fused_ordering(217) 00:15:17.409 fused_ordering(218) 00:15:17.409 fused_ordering(219) 00:15:17.409 fused_ordering(220) 00:15:17.409 fused_ordering(221) 00:15:17.409 fused_ordering(222) 00:15:17.409 fused_ordering(223) 00:15:17.409 fused_ordering(224) 00:15:17.409 fused_ordering(225) 00:15:17.409 fused_ordering(226) 00:15:17.409 fused_ordering(227) 00:15:17.409 fused_ordering(228) 00:15:17.409 fused_ordering(229) 00:15:17.409 fused_ordering(230) 00:15:17.409 fused_ordering(231) 00:15:17.409 fused_ordering(232) 00:15:17.409 fused_ordering(233) 00:15:17.409 fused_ordering(234) 00:15:17.409 fused_ordering(235) 00:15:17.409 fused_ordering(236) 00:15:17.409 fused_ordering(237) 00:15:17.409 fused_ordering(238) 00:15:17.409 fused_ordering(239) 00:15:17.409 fused_ordering(240) 00:15:17.409 fused_ordering(241) 00:15:17.409 fused_ordering(242) 00:15:17.409 fused_ordering(243) 00:15:17.409 fused_ordering(244) 00:15:17.409 fused_ordering(245) 00:15:17.409 fused_ordering(246) 00:15:17.409 fused_ordering(247) 00:15:17.409 fused_ordering(248) 00:15:17.409 fused_ordering(249) 00:15:17.409 fused_ordering(250) 00:15:17.409 fused_ordering(251) 00:15:17.409 fused_ordering(252) 00:15:17.409 fused_ordering(253) 00:15:17.409 fused_ordering(254) 00:15:17.409 fused_ordering(255) 00:15:17.409 fused_ordering(256) 00:15:17.409 fused_ordering(257) 00:15:17.409 fused_ordering(258) 00:15:17.409 fused_ordering(259) 00:15:17.409 fused_ordering(260) 00:15:17.409 fused_ordering(261) 00:15:17.409 fused_ordering(262) 00:15:17.409 fused_ordering(263) 00:15:17.409 fused_ordering(264) 00:15:17.409 fused_ordering(265) 00:15:17.409 fused_ordering(266) 00:15:17.409 fused_ordering(267) 00:15:17.409 fused_ordering(268) 00:15:17.409 fused_ordering(269) 00:15:17.409 fused_ordering(270) 00:15:17.409 fused_ordering(271) 00:15:17.409 fused_ordering(272) 00:15:17.409 fused_ordering(273) 00:15:17.409 fused_ordering(274) 00:15:17.409 fused_ordering(275) 00:15:17.409 fused_ordering(276) 00:15:17.409 fused_ordering(277) 00:15:17.409 fused_ordering(278) 00:15:17.409 fused_ordering(279) 00:15:17.409 fused_ordering(280) 00:15:17.409 fused_ordering(281) 00:15:17.409 fused_ordering(282) 00:15:17.409 fused_ordering(283) 00:15:17.409 fused_ordering(284) 00:15:17.409 fused_ordering(285) 00:15:17.409 fused_ordering(286) 00:15:17.409 fused_ordering(287) 00:15:17.409 fused_ordering(288) 00:15:17.409 fused_ordering(289) 00:15:17.409 fused_ordering(290) 00:15:17.409 fused_ordering(291) 00:15:17.409 fused_ordering(292) 00:15:17.409 fused_ordering(293) 00:15:17.409 fused_ordering(294) 00:15:17.409 fused_ordering(295) 00:15:17.409 fused_ordering(296) 00:15:17.409 fused_ordering(297) 00:15:17.409 fused_ordering(298) 00:15:17.409 fused_ordering(299) 00:15:17.409 fused_ordering(300) 00:15:17.409 fused_ordering(301) 00:15:17.409 fused_ordering(302) 00:15:17.409 fused_ordering(303) 00:15:17.409 fused_ordering(304) 00:15:17.409 fused_ordering(305) 00:15:17.409 fused_ordering(306) 00:15:17.409 fused_ordering(307) 00:15:17.409 fused_ordering(308) 00:15:17.409 fused_ordering(309) 00:15:17.409 fused_ordering(310) 00:15:17.409 fused_ordering(311) 00:15:17.409 fused_ordering(312) 00:15:17.409 fused_ordering(313) 00:15:17.409 fused_ordering(314) 00:15:17.409 fused_ordering(315) 00:15:17.409 fused_ordering(316) 00:15:17.409 fused_ordering(317) 00:15:17.409 fused_ordering(318) 00:15:17.409 fused_ordering(319) 00:15:17.409 fused_ordering(320) 00:15:17.409 fused_ordering(321) 00:15:17.409 fused_ordering(322) 00:15:17.409 fused_ordering(323) 00:15:17.409 fused_ordering(324) 00:15:17.409 fused_ordering(325) 00:15:17.409 fused_ordering(326) 00:15:17.409 fused_ordering(327) 00:15:17.409 fused_ordering(328) 00:15:17.409 fused_ordering(329) 00:15:17.409 fused_ordering(330) 00:15:17.409 fused_ordering(331) 00:15:17.409 fused_ordering(332) 00:15:17.409 fused_ordering(333) 00:15:17.409 fused_ordering(334) 00:15:17.409 fused_ordering(335) 00:15:17.409 fused_ordering(336) 00:15:17.409 fused_ordering(337) 00:15:17.409 fused_ordering(338) 00:15:17.409 fused_ordering(339) 00:15:17.409 fused_ordering(340) 00:15:17.409 fused_ordering(341) 00:15:17.409 fused_ordering(342) 00:15:17.409 fused_ordering(343) 00:15:17.409 fused_ordering(344) 00:15:17.409 fused_ordering(345) 00:15:17.409 fused_ordering(346) 00:15:17.409 fused_ordering(347) 00:15:17.409 fused_ordering(348) 00:15:17.409 fused_ordering(349) 00:15:17.409 fused_ordering(350) 00:15:17.409 fused_ordering(351) 00:15:17.409 fused_ordering(352) 00:15:17.409 fused_ordering(353) 00:15:17.409 fused_ordering(354) 00:15:17.409 fused_ordering(355) 00:15:17.409 fused_ordering(356) 00:15:17.409 fused_ordering(357) 00:15:17.409 fused_ordering(358) 00:15:17.409 fused_ordering(359) 00:15:17.409 fused_ordering(360) 00:15:17.409 fused_ordering(361) 00:15:17.409 fused_ordering(362) 00:15:17.409 fused_ordering(363) 00:15:17.409 fused_ordering(364) 00:15:17.409 fused_ordering(365) 00:15:17.409 fused_ordering(366) 00:15:17.409 fused_ordering(367) 00:15:17.409 fused_ordering(368) 00:15:17.409 fused_ordering(369) 00:15:17.409 fused_ordering(370) 00:15:17.409 fused_ordering(371) 00:15:17.409 fused_ordering(372) 00:15:17.409 fused_ordering(373) 00:15:17.409 fused_ordering(374) 00:15:17.409 fused_ordering(375) 00:15:17.409 fused_ordering(376) 00:15:17.409 fused_ordering(377) 00:15:17.409 fused_ordering(378) 00:15:17.409 fused_ordering(379) 00:15:17.409 fused_ordering(380) 00:15:17.409 fused_ordering(381) 00:15:17.409 fused_ordering(382) 00:15:17.409 fused_ordering(383) 00:15:17.409 fused_ordering(384) 00:15:17.409 fused_ordering(385) 00:15:17.409 fused_ordering(386) 00:15:17.409 fused_ordering(387) 00:15:17.409 fused_ordering(388) 00:15:17.409 fused_ordering(389) 00:15:17.409 fused_ordering(390) 00:15:17.409 fused_ordering(391) 00:15:17.409 fused_ordering(392) 00:15:17.409 fused_ordering(393) 00:15:17.409 fused_ordering(394) 00:15:17.409 fused_ordering(395) 00:15:17.409 fused_ordering(396) 00:15:17.409 fused_ordering(397) 00:15:17.409 fused_ordering(398) 00:15:17.409 fused_ordering(399) 00:15:17.409 fused_ordering(400) 00:15:17.409 fused_ordering(401) 00:15:17.409 fused_ordering(402) 00:15:17.409 fused_ordering(403) 00:15:17.409 fused_ordering(404) 00:15:17.409 fused_ordering(405) 00:15:17.409 fused_ordering(406) 00:15:17.409 fused_ordering(407) 00:15:17.409 fused_ordering(408) 00:15:17.409 fused_ordering(409) 00:15:17.410 fused_ordering(410) 00:15:17.976 fused_ordering(411) 00:15:17.976 fused_ordering(412) 00:15:17.976 fused_ordering(413) 00:15:17.976 fused_ordering(414) 00:15:17.976 fused_ordering(415) 00:15:17.976 fused_ordering(416) 00:15:17.976 fused_ordering(417) 00:15:17.976 fused_ordering(418) 00:15:17.976 fused_ordering(419) 00:15:17.976 fused_ordering(420) 00:15:17.976 fused_ordering(421) 00:15:17.976 fused_ordering(422) 00:15:17.976 fused_ordering(423) 00:15:17.976 fused_ordering(424) 00:15:17.976 fused_ordering(425) 00:15:17.976 fused_ordering(426) 00:15:17.976 fused_ordering(427) 00:15:17.976 fused_ordering(428) 00:15:17.976 fused_ordering(429) 00:15:17.976 fused_ordering(430) 00:15:17.976 fused_ordering(431) 00:15:17.976 fused_ordering(432) 00:15:17.976 fused_ordering(433) 00:15:17.976 fused_ordering(434) 00:15:17.976 fused_ordering(435) 00:15:17.976 fused_ordering(436) 00:15:17.976 fused_ordering(437) 00:15:17.976 fused_ordering(438) 00:15:17.976 fused_ordering(439) 00:15:17.976 fused_ordering(440) 00:15:17.976 fused_ordering(441) 00:15:17.976 fused_ordering(442) 00:15:17.976 fused_ordering(443) 00:15:17.976 fused_ordering(444) 00:15:17.976 fused_ordering(445) 00:15:17.976 fused_ordering(446) 00:15:17.976 fused_ordering(447) 00:15:17.976 fused_ordering(448) 00:15:17.976 fused_ordering(449) 00:15:17.976 fused_ordering(450) 00:15:17.976 fused_ordering(451) 00:15:17.976 fused_ordering(452) 00:15:17.976 fused_ordering(453) 00:15:17.976 fused_ordering(454) 00:15:17.976 fused_ordering(455) 00:15:17.976 fused_ordering(456) 00:15:17.976 fused_ordering(457) 00:15:17.976 fused_ordering(458) 00:15:17.976 fused_ordering(459) 00:15:17.976 fused_ordering(460) 00:15:17.976 fused_ordering(461) 00:15:17.976 fused_ordering(462) 00:15:17.976 fused_ordering(463) 00:15:17.976 fused_ordering(464) 00:15:17.976 fused_ordering(465) 00:15:17.976 fused_ordering(466) 00:15:17.976 fused_ordering(467) 00:15:17.976 fused_ordering(468) 00:15:17.976 fused_ordering(469) 00:15:17.976 fused_ordering(470) 00:15:17.976 fused_ordering(471) 00:15:17.976 fused_ordering(472) 00:15:17.976 fused_ordering(473) 00:15:17.976 fused_ordering(474) 00:15:17.976 fused_ordering(475) 00:15:17.976 fused_ordering(476) 00:15:17.976 fused_ordering(477) 00:15:17.976 fused_ordering(478) 00:15:17.976 fused_ordering(479) 00:15:17.976 fused_ordering(480) 00:15:17.976 fused_ordering(481) 00:15:17.976 fused_ordering(482) 00:15:17.976 fused_ordering(483) 00:15:17.976 fused_ordering(484) 00:15:17.976 fused_ordering(485) 00:15:17.976 fused_ordering(486) 00:15:17.976 fused_ordering(487) 00:15:17.976 fused_ordering(488) 00:15:17.976 fused_ordering(489) 00:15:17.976 fused_ordering(490) 00:15:17.976 fused_ordering(491) 00:15:17.976 fused_ordering(492) 00:15:17.976 fused_ordering(493) 00:15:17.976 fused_ordering(494) 00:15:17.976 fused_ordering(495) 00:15:17.976 fused_ordering(496) 00:15:17.976 fused_ordering(497) 00:15:17.976 fused_ordering(498) 00:15:17.976 fused_ordering(499) 00:15:17.976 fused_ordering(500) 00:15:17.976 fused_ordering(501) 00:15:17.976 fused_ordering(502) 00:15:17.976 fused_ordering(503) 00:15:17.976 fused_ordering(504) 00:15:17.976 fused_ordering(505) 00:15:17.976 fused_ordering(506) 00:15:17.976 fused_ordering(507) 00:15:17.976 fused_ordering(508) 00:15:17.976 fused_ordering(509) 00:15:17.976 fused_ordering(510) 00:15:17.976 fused_ordering(511) 00:15:17.976 fused_ordering(512) 00:15:17.976 fused_ordering(513) 00:15:17.976 fused_ordering(514) 00:15:17.976 fused_ordering(515) 00:15:17.976 fused_ordering(516) 00:15:17.976 fused_ordering(517) 00:15:17.976 fused_ordering(518) 00:15:17.976 fused_ordering(519) 00:15:17.976 fused_ordering(520) 00:15:17.976 fused_ordering(521) 00:15:17.976 fused_ordering(522) 00:15:17.976 fused_ordering(523) 00:15:17.976 fused_ordering(524) 00:15:17.976 fused_ordering(525) 00:15:17.976 fused_ordering(526) 00:15:17.976 fused_ordering(527) 00:15:17.976 fused_ordering(528) 00:15:17.976 fused_ordering(529) 00:15:17.976 fused_ordering(530) 00:15:17.976 fused_ordering(531) 00:15:17.976 fused_ordering(532) 00:15:17.976 fused_ordering(533) 00:15:17.976 fused_ordering(534) 00:15:17.976 fused_ordering(535) 00:15:17.976 fused_ordering(536) 00:15:17.976 fused_ordering(537) 00:15:17.976 fused_ordering(538) 00:15:17.976 fused_ordering(539) 00:15:17.976 fused_ordering(540) 00:15:17.976 fused_ordering(541) 00:15:17.976 fused_ordering(542) 00:15:17.976 fused_ordering(543) 00:15:17.976 fused_ordering(544) 00:15:17.976 fused_ordering(545) 00:15:17.976 fused_ordering(546) 00:15:17.976 fused_ordering(547) 00:15:17.976 fused_ordering(548) 00:15:17.976 fused_ordering(549) 00:15:17.976 fused_ordering(550) 00:15:17.976 fused_ordering(551) 00:15:17.976 fused_ordering(552) 00:15:17.976 fused_ordering(553) 00:15:17.976 fused_ordering(554) 00:15:17.976 fused_ordering(555) 00:15:17.976 fused_ordering(556) 00:15:17.976 fused_ordering(557) 00:15:17.976 fused_ordering(558) 00:15:17.976 fused_ordering(559) 00:15:17.976 fused_ordering(560) 00:15:17.976 fused_ordering(561) 00:15:17.976 fused_ordering(562) 00:15:17.976 fused_ordering(563) 00:15:17.976 fused_ordering(564) 00:15:17.976 fused_ordering(565) 00:15:17.976 fused_ordering(566) 00:15:17.976 fused_ordering(567) 00:15:17.976 fused_ordering(568) 00:15:17.976 fused_ordering(569) 00:15:17.976 fused_ordering(570) 00:15:17.976 fused_ordering(571) 00:15:17.976 fused_ordering(572) 00:15:17.976 fused_ordering(573) 00:15:17.976 fused_ordering(574) 00:15:17.977 fused_ordering(575) 00:15:17.977 fused_ordering(576) 00:15:17.977 fused_ordering(577) 00:15:17.977 fused_ordering(578) 00:15:17.977 fused_ordering(579) 00:15:17.977 fused_ordering(580) 00:15:17.977 fused_ordering(581) 00:15:17.977 fused_ordering(582) 00:15:17.977 fused_ordering(583) 00:15:17.977 fused_ordering(584) 00:15:17.977 fused_ordering(585) 00:15:17.977 fused_ordering(586) 00:15:17.977 fused_ordering(587) 00:15:17.977 fused_ordering(588) 00:15:17.977 fused_ordering(589) 00:15:17.977 fused_ordering(590) 00:15:17.977 fused_ordering(591) 00:15:17.977 fused_ordering(592) 00:15:17.977 fused_ordering(593) 00:15:17.977 fused_ordering(594) 00:15:17.977 fused_ordering(595) 00:15:17.977 fused_ordering(596) 00:15:17.977 fused_ordering(597) 00:15:17.977 fused_ordering(598) 00:15:17.977 fused_ordering(599) 00:15:17.977 fused_ordering(600) 00:15:17.977 fused_ordering(601) 00:15:17.977 fused_ordering(602) 00:15:17.977 fused_ordering(603) 00:15:17.977 fused_ordering(604) 00:15:17.977 fused_ordering(605) 00:15:17.977 fused_ordering(606) 00:15:17.977 fused_ordering(607) 00:15:17.977 fused_ordering(608) 00:15:17.977 fused_ordering(609) 00:15:17.977 fused_ordering(610) 00:15:17.977 fused_ordering(611) 00:15:17.977 fused_ordering(612) 00:15:17.977 fused_ordering(613) 00:15:17.977 fused_ordering(614) 00:15:17.977 fused_ordering(615) 00:15:18.235 fused_ordering(616) 00:15:18.235 fused_ordering(617) 00:15:18.235 fused_ordering(618) 00:15:18.235 fused_ordering(619) 00:15:18.235 fused_ordering(620) 00:15:18.235 fused_ordering(621) 00:15:18.235 fused_ordering(622) 00:15:18.235 fused_ordering(623) 00:15:18.235 fused_ordering(624) 00:15:18.235 fused_ordering(625) 00:15:18.235 fused_ordering(626) 00:15:18.235 fused_ordering(627) 00:15:18.235 fused_ordering(628) 00:15:18.235 fused_ordering(629) 00:15:18.235 fused_ordering(630) 00:15:18.235 fused_ordering(631) 00:15:18.235 fused_ordering(632) 00:15:18.235 fused_ordering(633) 00:15:18.235 fused_ordering(634) 00:15:18.235 fused_ordering(635) 00:15:18.235 fused_ordering(636) 00:15:18.235 fused_ordering(637) 00:15:18.235 fused_ordering(638) 00:15:18.235 fused_ordering(639) 00:15:18.235 fused_ordering(640) 00:15:18.235 fused_ordering(641) 00:15:18.235 fused_ordering(642) 00:15:18.235 fused_ordering(643) 00:15:18.235 fused_ordering(644) 00:15:18.235 fused_ordering(645) 00:15:18.235 fused_ordering(646) 00:15:18.235 fused_ordering(647) 00:15:18.235 fused_ordering(648) 00:15:18.235 fused_ordering(649) 00:15:18.235 fused_ordering(650) 00:15:18.235 fused_ordering(651) 00:15:18.235 fused_ordering(652) 00:15:18.235 fused_ordering(653) 00:15:18.235 fused_ordering(654) 00:15:18.235 fused_ordering(655) 00:15:18.235 fused_ordering(656) 00:15:18.235 fused_ordering(657) 00:15:18.235 fused_ordering(658) 00:15:18.235 fused_ordering(659) 00:15:18.235 fused_ordering(660) 00:15:18.235 fused_ordering(661) 00:15:18.235 fused_ordering(662) 00:15:18.235 fused_ordering(663) 00:15:18.235 fused_ordering(664) 00:15:18.235 fused_ordering(665) 00:15:18.235 fused_ordering(666) 00:15:18.235 fused_ordering(667) 00:15:18.235 fused_ordering(668) 00:15:18.235 fused_ordering(669) 00:15:18.235 fused_ordering(670) 00:15:18.235 fused_ordering(671) 00:15:18.235 fused_ordering(672) 00:15:18.235 fused_ordering(673) 00:15:18.235 fused_ordering(674) 00:15:18.235 fused_ordering(675) 00:15:18.235 fused_ordering(676) 00:15:18.235 fused_ordering(677) 00:15:18.235 fused_ordering(678) 00:15:18.235 fused_ordering(679) 00:15:18.235 fused_ordering(680) 00:15:18.235 fused_ordering(681) 00:15:18.235 fused_ordering(682) 00:15:18.235 fused_ordering(683) 00:15:18.235 fused_ordering(684) 00:15:18.235 fused_ordering(685) 00:15:18.235 fused_ordering(686) 00:15:18.235 fused_ordering(687) 00:15:18.235 fused_ordering(688) 00:15:18.235 fused_ordering(689) 00:15:18.235 fused_ordering(690) 00:15:18.235 fused_ordering(691) 00:15:18.235 fused_ordering(692) 00:15:18.235 fused_ordering(693) 00:15:18.235 fused_ordering(694) 00:15:18.235 fused_ordering(695) 00:15:18.235 fused_ordering(696) 00:15:18.235 fused_ordering(697) 00:15:18.235 fused_ordering(698) 00:15:18.235 fused_ordering(699) 00:15:18.235 fused_ordering(700) 00:15:18.235 fused_ordering(701) 00:15:18.235 fused_ordering(702) 00:15:18.235 fused_ordering(703) 00:15:18.235 fused_ordering(704) 00:15:18.235 fused_ordering(705) 00:15:18.235 fused_ordering(706) 00:15:18.235 fused_ordering(707) 00:15:18.235 fused_ordering(708) 00:15:18.235 fused_ordering(709) 00:15:18.235 fused_ordering(710) 00:15:18.235 fused_ordering(711) 00:15:18.235 fused_ordering(712) 00:15:18.235 fused_ordering(713) 00:15:18.235 fused_ordering(714) 00:15:18.235 fused_ordering(715) 00:15:18.235 fused_ordering(716) 00:15:18.235 fused_ordering(717) 00:15:18.235 fused_ordering(718) 00:15:18.235 fused_ordering(719) 00:15:18.235 fused_ordering(720) 00:15:18.235 fused_ordering(721) 00:15:18.235 fused_ordering(722) 00:15:18.235 fused_ordering(723) 00:15:18.235 fused_ordering(724) 00:15:18.235 fused_ordering(725) 00:15:18.235 fused_ordering(726) 00:15:18.235 fused_ordering(727) 00:15:18.235 fused_ordering(728) 00:15:18.235 fused_ordering(729) 00:15:18.235 fused_ordering(730) 00:15:18.235 fused_ordering(731) 00:15:18.235 fused_ordering(732) 00:15:18.235 fused_ordering(733) 00:15:18.235 fused_ordering(734) 00:15:18.235 fused_ordering(735) 00:15:18.235 fused_ordering(736) 00:15:18.235 fused_ordering(737) 00:15:18.235 fused_ordering(738) 00:15:18.235 fused_ordering(739) 00:15:18.235 fused_ordering(740) 00:15:18.235 fused_ordering(741) 00:15:18.235 fused_ordering(742) 00:15:18.235 fused_ordering(743) 00:15:18.235 fused_ordering(744) 00:15:18.235 fused_ordering(745) 00:15:18.235 fused_ordering(746) 00:15:18.235 fused_ordering(747) 00:15:18.235 fused_ordering(748) 00:15:18.235 fused_ordering(749) 00:15:18.235 fused_ordering(750) 00:15:18.235 fused_ordering(751) 00:15:18.235 fused_ordering(752) 00:15:18.235 fused_ordering(753) 00:15:18.235 fused_ordering(754) 00:15:18.235 fused_ordering(755) 00:15:18.235 fused_ordering(756) 00:15:18.235 fused_ordering(757) 00:15:18.235 fused_ordering(758) 00:15:18.235 fused_ordering(759) 00:15:18.235 fused_ordering(760) 00:15:18.235 fused_ordering(761) 00:15:18.235 fused_ordering(762) 00:15:18.235 fused_ordering(763) 00:15:18.235 fused_ordering(764) 00:15:18.235 fused_ordering(765) 00:15:18.235 fused_ordering(766) 00:15:18.235 fused_ordering(767) 00:15:18.235 fused_ordering(768) 00:15:18.235 fused_ordering(769) 00:15:18.235 fused_ordering(770) 00:15:18.235 fused_ordering(771) 00:15:18.235 fused_ordering(772) 00:15:18.235 fused_ordering(773) 00:15:18.235 fused_ordering(774) 00:15:18.235 fused_ordering(775) 00:15:18.235 fused_ordering(776) 00:15:18.235 fused_ordering(777) 00:15:18.235 fused_ordering(778) 00:15:18.235 fused_ordering(779) 00:15:18.235 fused_ordering(780) 00:15:18.235 fused_ordering(781) 00:15:18.235 fused_ordering(782) 00:15:18.235 fused_ordering(783) 00:15:18.235 fused_ordering(784) 00:15:18.235 fused_ordering(785) 00:15:18.235 fused_ordering(786) 00:15:18.235 fused_ordering(787) 00:15:18.235 fused_ordering(788) 00:15:18.235 fused_ordering(789) 00:15:18.235 fused_ordering(790) 00:15:18.235 fused_ordering(791) 00:15:18.235 fused_ordering(792) 00:15:18.235 fused_ordering(793) 00:15:18.235 fused_ordering(794) 00:15:18.235 fused_ordering(795) 00:15:18.235 fused_ordering(796) 00:15:18.235 fused_ordering(797) 00:15:18.235 fused_ordering(798) 00:15:18.235 fused_ordering(799) 00:15:18.235 fused_ordering(800) 00:15:18.235 fused_ordering(801) 00:15:18.235 fused_ordering(802) 00:15:18.235 fused_ordering(803) 00:15:18.235 fused_ordering(804) 00:15:18.235 fused_ordering(805) 00:15:18.235 fused_ordering(806) 00:15:18.235 fused_ordering(807) 00:15:18.235 fused_ordering(808) 00:15:18.235 fused_ordering(809) 00:15:18.235 fused_ordering(810) 00:15:18.235 fused_ordering(811) 00:15:18.235 fused_ordering(812) 00:15:18.235 fused_ordering(813) 00:15:18.235 fused_ordering(814) 00:15:18.235 fused_ordering(815) 00:15:18.235 fused_ordering(816) 00:15:18.235 fused_ordering(817) 00:15:18.235 fused_ordering(818) 00:15:18.235 fused_ordering(819) 00:15:18.235 fused_ordering(820) 00:15:18.804 fused_o[2024-11-26 19:01:35.484999] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10317e0 is same with the state(5) to be set 00:15:18.804 rdering(821) 00:15:18.805 fused_ordering(822) 00:15:18.805 fused_ordering(823) 00:15:18.805 fused_ordering(824) 00:15:18.805 fused_ordering(825) 00:15:18.805 fused_ordering(826) 00:15:18.805 fused_ordering(827) 00:15:18.805 fused_ordering(828) 00:15:18.805 fused_ordering(829) 00:15:18.805 fused_ordering(830) 00:15:18.805 fused_ordering(831) 00:15:18.805 fused_ordering(832) 00:15:18.805 fused_ordering(833) 00:15:18.805 fused_ordering(834) 00:15:18.805 fused_ordering(835) 00:15:18.805 fused_ordering(836) 00:15:18.805 fused_ordering(837) 00:15:18.805 fused_ordering(838) 00:15:18.805 fused_ordering(839) 00:15:18.805 fused_ordering(840) 00:15:18.805 fused_ordering(841) 00:15:18.805 fused_ordering(842) 00:15:18.805 fused_ordering(843) 00:15:18.805 fused_ordering(844) 00:15:18.805 fused_ordering(845) 00:15:18.805 fused_ordering(846) 00:15:18.805 fused_ordering(847) 00:15:18.805 fused_ordering(848) 00:15:18.805 fused_ordering(849) 00:15:18.805 fused_ordering(850) 00:15:18.805 fused_ordering(851) 00:15:18.805 fused_ordering(852) 00:15:18.805 fused_ordering(853) 00:15:18.805 fused_ordering(854) 00:15:18.805 fused_ordering(855) 00:15:18.805 fused_ordering(856) 00:15:18.805 fused_ordering(857) 00:15:18.805 fused_ordering(858) 00:15:18.805 fused_ordering(859) 00:15:18.805 fused_ordering(860) 00:15:18.805 fused_ordering(861) 00:15:18.805 fused_ordering(862) 00:15:18.805 fused_ordering(863) 00:15:18.805 fused_ordering(864) 00:15:18.805 fused_ordering(865) 00:15:18.805 fused_ordering(866) 00:15:18.805 fused_ordering(867) 00:15:18.805 fused_ordering(868) 00:15:18.805 fused_ordering(869) 00:15:18.805 fused_ordering(870) 00:15:18.805 fused_ordering(871) 00:15:18.805 fused_ordering(872) 00:15:18.805 fused_ordering(873) 00:15:18.805 fused_ordering(874) 00:15:18.805 fused_ordering(875) 00:15:18.805 fused_ordering(876) 00:15:18.805 fused_ordering(877) 00:15:18.805 fused_ordering(878) 00:15:18.805 fused_ordering(879) 00:15:18.805 fused_ordering(880) 00:15:18.805 fused_ordering(881) 00:15:18.805 fused_ordering(882) 00:15:18.805 fused_ordering(883) 00:15:18.805 fused_ordering(884) 00:15:18.805 fused_ordering(885) 00:15:18.805 fused_ordering(886) 00:15:18.805 fused_ordering(887) 00:15:18.805 fused_ordering(888) 00:15:18.805 fused_ordering(889) 00:15:18.805 fused_ordering(890) 00:15:18.805 fused_ordering(891) 00:15:18.805 fused_ordering(892) 00:15:18.805 fused_ordering(893) 00:15:18.805 fused_ordering(894) 00:15:18.805 fused_ordering(895) 00:15:18.805 fused_ordering(896) 00:15:18.805 fused_ordering(897) 00:15:18.805 fused_ordering(898) 00:15:18.805 fused_ordering(899) 00:15:18.805 fused_ordering(900) 00:15:18.805 fused_ordering(901) 00:15:18.805 fused_ordering(902) 00:15:18.805 fused_ordering(903) 00:15:18.805 fused_ordering(904) 00:15:18.805 fused_ordering(905) 00:15:18.805 fused_ordering(906) 00:15:18.805 fused_ordering(907) 00:15:18.805 fused_ordering(908) 00:15:18.805 fused_ordering(909) 00:15:18.805 fused_ordering(910) 00:15:18.805 fused_ordering(911) 00:15:18.805 fused_ordering(912) 00:15:18.805 fused_ordering(913) 00:15:18.805 fused_ordering(914) 00:15:18.805 fused_ordering(915) 00:15:18.805 fused_ordering(916) 00:15:18.805 fused_ordering(917) 00:15:18.805 fused_ordering(918) 00:15:18.805 fused_ordering(919) 00:15:18.805 fused_ordering(920) 00:15:18.805 fused_ordering(921) 00:15:18.805 fused_ordering(922) 00:15:18.805 fused_ordering(923) 00:15:18.805 fused_ordering(924) 00:15:18.805 fused_ordering(925) 00:15:18.805 fused_ordering(926) 00:15:18.805 fused_ordering(927) 00:15:18.805 fused_ordering(928) 00:15:18.805 fused_ordering(929) 00:15:18.805 fused_ordering(930) 00:15:18.805 fused_ordering(931) 00:15:18.805 fused_ordering(932) 00:15:18.805 fused_ordering(933) 00:15:18.805 fused_ordering(934) 00:15:18.805 fused_ordering(935) 00:15:18.805 fused_ordering(936) 00:15:18.805 fused_ordering(937) 00:15:18.805 fused_ordering(938) 00:15:18.805 fused_ordering(939) 00:15:18.805 fused_ordering(940) 00:15:18.805 fused_ordering(941) 00:15:18.805 fused_ordering(942) 00:15:18.805 fused_ordering(943) 00:15:18.805 fused_ordering(944) 00:15:18.805 fused_ordering(945) 00:15:18.805 fused_ordering(946) 00:15:18.805 fused_ordering(947) 00:15:18.805 fused_ordering(948) 00:15:18.805 fused_ordering(949) 00:15:18.805 fused_ordering(950) 00:15:18.805 fused_ordering(951) 00:15:18.805 fused_ordering(952) 00:15:18.805 fused_ordering(953) 00:15:18.805 fused_ordering(954) 00:15:18.805 fused_ordering(955) 00:15:18.805 fused_ordering(956) 00:15:18.805 fused_ordering(957) 00:15:18.805 fused_ordering(958) 00:15:18.805 fused_ordering(959) 00:15:18.805 fused_ordering(960) 00:15:18.805 fused_ordering(961) 00:15:18.805 fused_ordering(962) 00:15:18.805 fused_ordering(963) 00:15:18.805 fused_ordering(964) 00:15:18.805 fused_ordering(965) 00:15:18.805 fused_ordering(966) 00:15:18.805 fused_ordering(967) 00:15:18.805 fused_ordering(968) 00:15:18.805 fused_ordering(969) 00:15:18.805 fused_ordering(970) 00:15:18.805 fused_ordering(971) 00:15:18.805 fused_ordering(972) 00:15:18.805 fused_ordering(973) 00:15:18.805 fused_ordering(974) 00:15:18.805 fused_ordering(975) 00:15:18.805 fused_ordering(976) 00:15:18.805 fused_ordering(977) 00:15:18.805 fused_ordering(978) 00:15:18.805 fused_ordering(979) 00:15:18.805 fused_ordering(980) 00:15:18.805 fused_ordering(981) 00:15:18.805 fused_ordering(982) 00:15:18.805 fused_ordering(983) 00:15:18.805 fused_ordering(984) 00:15:18.805 fused_ordering(985) 00:15:18.805 fused_ordering(986) 00:15:18.805 fused_ordering(987) 00:15:18.805 fused_ordering(988) 00:15:18.805 fused_ordering(989) 00:15:18.805 fused_ordering(990) 00:15:18.805 fused_ordering(991) 00:15:18.805 fused_ordering(992) 00:15:18.805 fused_ordering(993) 00:15:18.805 fused_ordering(994) 00:15:18.805 fused_ordering(995) 00:15:18.805 fused_ordering(996) 00:15:18.805 fused_ordering(997) 00:15:18.805 fused_ordering(998) 00:15:18.805 fused_ordering(999) 00:15:18.805 fused_ordering(1000) 00:15:18.805 fused_ordering(1001) 00:15:18.805 fused_ordering(1002) 00:15:18.805 fused_ordering(1003) 00:15:18.805 fused_ordering(1004) 00:15:18.805 fused_ordering(1005) 00:15:18.805 fused_ordering(1006) 00:15:18.805 fused_ordering(1007) 00:15:18.805 fused_ordering(1008) 00:15:18.805 fused_ordering(1009) 00:15:18.805 fused_ordering(1010) 00:15:18.805 fused_ordering(1011) 00:15:18.806 fused_ordering(1012) 00:15:18.806 fused_ordering(1013) 00:15:18.806 fused_ordering(1014) 00:15:18.806 fused_ordering(1015) 00:15:18.806 fused_ordering(1016) 00:15:18.806 fused_ordering(1017) 00:15:18.806 fused_ordering(1018) 00:15:18.806 fused_ordering(1019) 00:15:18.806 fused_ordering(1020) 00:15:18.806 fused_ordering(1021) 00:15:18.806 fused_ordering(1022) 00:15:18.806 fused_ordering(1023) 00:15:18.806 19:01:35 -- target/fused_ordering.sh@23 -- # trap - SIGINT SIGTERM EXIT 00:15:18.806 19:01:35 -- target/fused_ordering.sh@25 -- # nvmftestfini 00:15:18.806 19:01:35 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:18.806 19:01:35 -- nvmf/common.sh@116 -- # sync 00:15:18.806 19:01:35 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:18.806 19:01:35 -- nvmf/common.sh@119 -- # set +e 00:15:18.806 19:01:35 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:18.806 19:01:35 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:18.806 rmmod nvme_tcp 00:15:18.806 rmmod nvme_fabrics 00:15:18.806 rmmod nvme_keyring 00:15:18.806 19:01:35 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:18.806 19:01:35 -- nvmf/common.sh@123 -- # set -e 00:15:18.806 19:01:35 -- nvmf/common.sh@124 -- # return 0 00:15:18.806 19:01:35 -- nvmf/common.sh@477 -- # '[' -n 3052713 ']' 00:15:18.806 19:01:35 -- nvmf/common.sh@478 -- # killprocess 3052713 00:15:18.806 19:01:35 -- common/autotest_common.sh@936 -- # '[' -z 3052713 ']' 00:15:18.806 19:01:35 -- common/autotest_common.sh@940 -- # kill -0 3052713 00:15:18.806 19:01:35 -- common/autotest_common.sh@941 -- # uname 00:15:18.806 19:01:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:18.806 19:01:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3052713 00:15:18.806 19:01:35 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:18.806 19:01:35 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:18.806 19:01:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3052713' 00:15:18.806 killing process with pid 3052713 00:15:18.806 19:01:35 -- common/autotest_common.sh@955 -- # kill 3052713 00:15:18.806 19:01:35 -- common/autotest_common.sh@960 -- # wait 3052713 00:15:19.066 19:01:35 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:19.066 19:01:35 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:19.066 19:01:35 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:19.066 19:01:35 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:19.066 19:01:35 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:19.066 19:01:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:19.066 19:01:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:19.066 19:01:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:20.971 19:01:37 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:20.971 00:15:20.971 real 0m10.800s 00:15:20.971 user 0m5.682s 00:15:20.971 sys 0m5.431s 00:15:20.971 19:01:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:20.971 19:01:37 -- common/autotest_common.sh@10 -- # set +x 00:15:20.971 ************************************ 00:15:20.971 END TEST nvmf_fused_ordering 00:15:20.971 ************************************ 00:15:20.971 19:01:37 -- nvmf/nvmf.sh@35 -- # run_test nvmf_delete_subsystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:15:20.971 19:01:37 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:20.971 19:01:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:20.971 19:01:37 -- common/autotest_common.sh@10 -- # set +x 00:15:20.971 ************************************ 00:15:20.971 START TEST nvmf_delete_subsystem 00:15:20.971 ************************************ 00:15:20.971 19:01:37 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:15:21.231 * Looking for test storage... 00:15:21.231 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:21.231 19:01:37 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:21.231 19:01:37 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:21.231 19:01:37 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:21.231 19:01:38 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:21.231 19:01:38 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:21.231 19:01:38 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:21.231 19:01:38 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:21.231 19:01:38 -- scripts/common.sh@335 -- # IFS=.-: 00:15:21.231 19:01:38 -- scripts/common.sh@335 -- # read -ra ver1 00:15:21.231 19:01:38 -- scripts/common.sh@336 -- # IFS=.-: 00:15:21.231 19:01:38 -- scripts/common.sh@336 -- # read -ra ver2 00:15:21.231 19:01:38 -- scripts/common.sh@337 -- # local 'op=<' 00:15:21.231 19:01:38 -- scripts/common.sh@339 -- # ver1_l=2 00:15:21.231 19:01:38 -- scripts/common.sh@340 -- # ver2_l=1 00:15:21.231 19:01:38 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:21.231 19:01:38 -- scripts/common.sh@343 -- # case "$op" in 00:15:21.231 19:01:38 -- scripts/common.sh@344 -- # : 1 00:15:21.231 19:01:38 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:21.231 19:01:38 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:21.231 19:01:38 -- scripts/common.sh@364 -- # decimal 1 00:15:21.231 19:01:38 -- scripts/common.sh@352 -- # local d=1 00:15:21.231 19:01:38 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:21.231 19:01:38 -- scripts/common.sh@354 -- # echo 1 00:15:21.231 19:01:38 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:21.231 19:01:38 -- scripts/common.sh@365 -- # decimal 2 00:15:21.231 19:01:38 -- scripts/common.sh@352 -- # local d=2 00:15:21.231 19:01:38 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:21.231 19:01:38 -- scripts/common.sh@354 -- # echo 2 00:15:21.231 19:01:38 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:21.231 19:01:38 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:21.231 19:01:38 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:21.231 19:01:38 -- scripts/common.sh@367 -- # return 0 00:15:21.231 19:01:38 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:21.231 19:01:38 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:21.231 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:21.231 --rc genhtml_branch_coverage=1 00:15:21.231 --rc genhtml_function_coverage=1 00:15:21.231 --rc genhtml_legend=1 00:15:21.231 --rc geninfo_all_blocks=1 00:15:21.231 --rc geninfo_unexecuted_blocks=1 00:15:21.231 00:15:21.231 ' 00:15:21.231 19:01:38 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:21.231 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:21.231 --rc genhtml_branch_coverage=1 00:15:21.231 --rc genhtml_function_coverage=1 00:15:21.231 --rc genhtml_legend=1 00:15:21.231 --rc geninfo_all_blocks=1 00:15:21.231 --rc geninfo_unexecuted_blocks=1 00:15:21.231 00:15:21.231 ' 00:15:21.231 19:01:38 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:21.231 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:21.231 --rc genhtml_branch_coverage=1 00:15:21.231 --rc genhtml_function_coverage=1 00:15:21.231 --rc genhtml_legend=1 00:15:21.231 --rc geninfo_all_blocks=1 00:15:21.231 --rc geninfo_unexecuted_blocks=1 00:15:21.231 00:15:21.231 ' 00:15:21.231 19:01:38 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:21.231 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:21.231 --rc genhtml_branch_coverage=1 00:15:21.231 --rc genhtml_function_coverage=1 00:15:21.231 --rc genhtml_legend=1 00:15:21.231 --rc geninfo_all_blocks=1 00:15:21.231 --rc geninfo_unexecuted_blocks=1 00:15:21.231 00:15:21.231 ' 00:15:21.231 19:01:38 -- target/delete_subsystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:21.231 19:01:38 -- nvmf/common.sh@7 -- # uname -s 00:15:21.231 19:01:38 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:21.231 19:01:38 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:21.231 19:01:38 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:21.231 19:01:38 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:21.231 19:01:38 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:21.231 19:01:38 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:21.231 19:01:38 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:21.231 19:01:38 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:21.231 19:01:38 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:21.231 19:01:38 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:21.231 19:01:38 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:15:21.231 19:01:38 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:15:21.231 19:01:38 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:21.231 19:01:38 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:21.231 19:01:38 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:21.231 19:01:38 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:21.231 19:01:38 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:21.231 19:01:38 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:21.231 19:01:38 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:21.231 19:01:38 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:21.231 19:01:38 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:21.231 19:01:38 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:21.231 19:01:38 -- paths/export.sh@5 -- # export PATH 00:15:21.231 19:01:38 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:21.232 19:01:38 -- nvmf/common.sh@46 -- # : 0 00:15:21.232 19:01:38 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:21.232 19:01:38 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:21.232 19:01:38 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:21.232 19:01:38 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:21.232 19:01:38 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:21.232 19:01:38 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:21.232 19:01:38 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:21.232 19:01:38 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:21.232 19:01:38 -- target/delete_subsystem.sh@12 -- # nvmftestinit 00:15:21.232 19:01:38 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:21.232 19:01:38 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:21.232 19:01:38 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:21.232 19:01:38 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:21.232 19:01:38 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:21.232 19:01:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:21.232 19:01:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:21.232 19:01:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:21.232 19:01:38 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:21.232 19:01:38 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:21.232 19:01:38 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:21.232 19:01:38 -- common/autotest_common.sh@10 -- # set +x 00:15:26.501 19:01:43 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:26.501 19:01:43 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:26.501 19:01:43 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:26.501 19:01:43 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:26.501 19:01:43 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:26.501 19:01:43 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:26.502 19:01:43 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:26.502 19:01:43 -- nvmf/common.sh@294 -- # net_devs=() 00:15:26.502 19:01:43 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:26.502 19:01:43 -- nvmf/common.sh@295 -- # e810=() 00:15:26.502 19:01:43 -- nvmf/common.sh@295 -- # local -ga e810 00:15:26.502 19:01:43 -- nvmf/common.sh@296 -- # x722=() 00:15:26.502 19:01:43 -- nvmf/common.sh@296 -- # local -ga x722 00:15:26.502 19:01:43 -- nvmf/common.sh@297 -- # mlx=() 00:15:26.502 19:01:43 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:26.502 19:01:43 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:26.502 19:01:43 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:26.502 19:01:43 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:26.502 19:01:43 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:26.502 19:01:43 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:26.502 19:01:43 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:26.502 19:01:43 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:26.502 19:01:43 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:26.502 19:01:43 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:26.502 19:01:43 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:26.502 19:01:43 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:26.502 19:01:43 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:26.502 19:01:43 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:26.502 19:01:43 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:26.502 19:01:43 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:26.502 19:01:43 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:26.502 19:01:43 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:26.502 19:01:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:26.502 19:01:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:15:26.502 Found 0000:86:00.0 (0x8086 - 0x159b) 00:15:26.502 19:01:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:26.502 19:01:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:26.502 19:01:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:26.502 19:01:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:26.502 19:01:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:26.502 19:01:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:26.502 19:01:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:15:26.502 Found 0000:86:00.1 (0x8086 - 0x159b) 00:15:26.502 19:01:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:26.502 19:01:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:26.502 19:01:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:26.502 19:01:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:26.502 19:01:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:26.502 19:01:43 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:26.502 19:01:43 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:26.502 19:01:43 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:26.502 19:01:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:26.502 19:01:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:26.502 19:01:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:26.502 19:01:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:26.502 19:01:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:15:26.502 Found net devices under 0000:86:00.0: cvl_0_0 00:15:26.502 19:01:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:26.502 19:01:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:26.502 19:01:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:26.502 19:01:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:26.502 19:01:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:26.502 19:01:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:15:26.502 Found net devices under 0000:86:00.1: cvl_0_1 00:15:26.502 19:01:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:26.502 19:01:43 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:26.502 19:01:43 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:26.502 19:01:43 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:26.502 19:01:43 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:26.502 19:01:43 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:26.502 19:01:43 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:26.502 19:01:43 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:26.502 19:01:43 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:26.502 19:01:43 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:26.502 19:01:43 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:26.502 19:01:43 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:26.502 19:01:43 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:26.502 19:01:43 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:26.502 19:01:43 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:26.502 19:01:43 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:26.502 19:01:43 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:26.502 19:01:43 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:26.502 19:01:43 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:26.502 19:01:43 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:26.502 19:01:43 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:26.761 19:01:43 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:26.761 19:01:43 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:26.761 19:01:43 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:26.761 19:01:43 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:26.761 19:01:43 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:26.761 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:26.761 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.440 ms 00:15:26.761 00:15:26.761 --- 10.0.0.2 ping statistics --- 00:15:26.761 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:26.761 rtt min/avg/max/mdev = 0.440/0.440/0.440/0.000 ms 00:15:26.761 19:01:43 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:26.761 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:26.761 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.220 ms 00:15:26.761 00:15:26.761 --- 10.0.0.1 ping statistics --- 00:15:26.761 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:26.761 rtt min/avg/max/mdev = 0.220/0.220/0.220/0.000 ms 00:15:26.761 19:01:43 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:26.761 19:01:43 -- nvmf/common.sh@410 -- # return 0 00:15:26.761 19:01:43 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:26.761 19:01:43 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:26.761 19:01:43 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:26.761 19:01:43 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:26.761 19:01:43 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:26.761 19:01:43 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:26.761 19:01:43 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:26.761 19:01:43 -- target/delete_subsystem.sh@13 -- # nvmfappstart -m 0x3 00:15:26.761 19:01:43 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:26.761 19:01:43 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:26.761 19:01:43 -- common/autotest_common.sh@10 -- # set +x 00:15:26.761 19:01:43 -- nvmf/common.sh@469 -- # nvmfpid=3056733 00:15:26.761 19:01:43 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:15:26.761 19:01:43 -- nvmf/common.sh@470 -- # waitforlisten 3056733 00:15:26.761 19:01:43 -- common/autotest_common.sh@829 -- # '[' -z 3056733 ']' 00:15:26.761 19:01:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:26.761 19:01:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:26.761 19:01:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:26.761 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:26.761 19:01:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:26.761 19:01:43 -- common/autotest_common.sh@10 -- # set +x 00:15:26.761 [2024-11-26 19:01:43.625066] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:15:26.761 [2024-11-26 19:01:43.625111] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:26.761 EAL: No free 2048 kB hugepages reported on node 1 00:15:26.761 [2024-11-26 19:01:43.684103] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:15:27.019 [2024-11-26 19:01:43.723333] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:27.019 [2024-11-26 19:01:43.723444] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:27.019 [2024-11-26 19:01:43.723452] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:27.019 [2024-11-26 19:01:43.723459] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:27.019 [2024-11-26 19:01:43.723496] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:27.019 [2024-11-26 19:01:43.723499] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:27.585 19:01:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:27.585 19:01:44 -- common/autotest_common.sh@862 -- # return 0 00:15:27.585 19:01:44 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:27.585 19:01:44 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:27.585 19:01:44 -- common/autotest_common.sh@10 -- # set +x 00:15:27.585 19:01:44 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:27.585 19:01:44 -- target/delete_subsystem.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:27.585 19:01:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:27.585 19:01:44 -- common/autotest_common.sh@10 -- # set +x 00:15:27.585 [2024-11-26 19:01:44.484469] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:27.585 19:01:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:27.585 19:01:44 -- target/delete_subsystem.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:15:27.585 19:01:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:27.585 19:01:44 -- common/autotest_common.sh@10 -- # set +x 00:15:27.585 19:01:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:27.585 19:01:44 -- target/delete_subsystem.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:27.585 19:01:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:27.585 19:01:44 -- common/autotest_common.sh@10 -- # set +x 00:15:27.585 [2024-11-26 19:01:44.500626] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:27.585 19:01:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:27.585 19:01:44 -- target/delete_subsystem.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:15:27.585 19:01:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:27.585 19:01:44 -- common/autotest_common.sh@10 -- # set +x 00:15:27.843 NULL1 00:15:27.843 19:01:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:27.843 19:01:44 -- target/delete_subsystem.sh@23 -- # rpc_cmd bdev_delay_create -b NULL1 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:15:27.843 19:01:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:27.843 19:01:44 -- common/autotest_common.sh@10 -- # set +x 00:15:27.843 Delay0 00:15:27.843 19:01:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:27.843 19:01:44 -- target/delete_subsystem.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:27.843 19:01:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:27.843 19:01:44 -- common/autotest_common.sh@10 -- # set +x 00:15:27.843 19:01:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:27.843 19:01:44 -- target/delete_subsystem.sh@28 -- # perf_pid=3056839 00:15:27.843 19:01:44 -- target/delete_subsystem.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 5 -q 128 -w randrw -M 70 -o 512 -P 4 00:15:27.843 19:01:44 -- target/delete_subsystem.sh@30 -- # sleep 2 00:15:27.843 EAL: No free 2048 kB hugepages reported on node 1 00:15:27.843 [2024-11-26 19:01:44.575133] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:15:29.753 19:01:46 -- target/delete_subsystem.sh@32 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:29.753 19:01:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:29.753 19:01:46 -- common/autotest_common.sh@10 -- # set +x 00:15:30.012 Write completed with error (sct=0, sc=8) 00:15:30.012 Read completed with error (sct=0, sc=8) 00:15:30.012 Read completed with error (sct=0, sc=8) 00:15:30.013 starting I/O failed: -6 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 starting I/O failed: -6 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Write completed with error (sct=0, sc=8) 00:15:30.013 starting I/O failed: -6 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Write completed with error (sct=0, sc=8) 00:15:30.013 Write completed with error (sct=0, sc=8) 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 starting I/O failed: -6 00:15:30.013 starting I/O failed: -6 00:15:30.013 Write completed with error (sct=0, sc=8) 00:15:30.013 Write completed with error (sct=0, sc=8) 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Write completed with error (sct=0, sc=8) 00:15:30.013 Write completed with error (sct=0, sc=8) 00:15:30.013 Write completed with error (sct=0, sc=8) 00:15:30.013 starting I/O failed: -6 00:15:30.013 starting I/O failed: -6 00:15:30.013 Write completed with error (sct=0, sc=8) 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Write completed with error (sct=0, sc=8) 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Write completed with error (sct=0, sc=8) 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 starting I/O failed: -6 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 starting I/O failed: -6 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Write completed with error (sct=0, sc=8) 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Write completed with error (sct=0, sc=8) 00:15:30.013 starting I/O failed: -6 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 starting I/O failed: -6 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 starting I/O failed: -6 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 starting I/O failed: -6 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 starting I/O failed: -6 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Write completed with error (sct=0, sc=8) 00:15:30.013 starting I/O failed: -6 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Write completed with error (sct=0, sc=8) 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Write completed with error (sct=0, sc=8) 00:15:30.013 starting I/O failed: -6 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 starting I/O failed: -6 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 starting I/O failed: -6 00:15:30.013 Write completed with error (sct=0, sc=8) 00:15:30.013 Write completed with error (sct=0, sc=8) 00:15:30.013 Write completed with error (sct=0, sc=8) 00:15:30.013 starting I/O failed: -6 00:15:30.013 Write completed with error (sct=0, sc=8) 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Write completed with error (sct=0, sc=8) 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Write completed with error (sct=0, sc=8) 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 starting I/O failed: -6 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 starting I/O failed: -6 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Write completed with error (sct=0, sc=8) 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Write completed with error (sct=0, sc=8) 00:15:30.013 starting I/O failed: -6 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Write completed with error (sct=0, sc=8) 00:15:30.013 starting I/O failed: -6 00:15:30.013 Write completed with error (sct=0, sc=8) 00:15:30.013 Write completed with error (sct=0, sc=8) 00:15:30.013 Write completed with error (sct=0, sc=8) 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Write completed with error (sct=0, sc=8) 00:15:30.013 starting I/O failed: -6 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 starting I/O failed: -6 00:15:30.013 Write completed with error (sct=0, sc=8) 00:15:30.013 starting I/O failed: -6 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Write completed with error (sct=0, sc=8) 00:15:30.013 [2024-11-26 19:01:46.735517] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f1b340 is same with the state(5) to be set 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 starting I/O failed: -6 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 starting I/O failed: -6 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 starting I/O failed: -6 00:15:30.013 Write completed with error (sct=0, sc=8) 00:15:30.013 starting I/O failed: -6 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 starting I/O failed: -6 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 starting I/O failed: -6 00:15:30.013 Write completed with error (sct=0, sc=8) 00:15:30.013 Write completed with error (sct=0, sc=8) 00:15:30.013 Write completed with error (sct=0, sc=8) 00:15:30.013 starting I/O failed: -6 00:15:30.013 Write completed with error (sct=0, sc=8) 00:15:30.013 starting I/O failed: -6 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 starting I/O failed: -6 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 starting I/O failed: -6 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Write completed with error (sct=0, sc=8) 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 starting I/O failed: -6 00:15:30.013 Write completed with error (sct=0, sc=8) 00:15:30.013 starting I/O failed: -6 00:15:30.013 Write completed with error (sct=0, sc=8) 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 starting I/O failed: -6 00:15:30.013 Write completed with error (sct=0, sc=8) 00:15:30.013 starting I/O failed: -6 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 starting I/O failed: -6 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 starting I/O failed: -6 00:15:30.013 Write completed with error (sct=0, sc=8) 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 starting I/O failed: -6 00:15:30.013 Write completed with error (sct=0, sc=8) 00:15:30.013 starting I/O failed: -6 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Write completed with error (sct=0, sc=8) 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 starting I/O failed: -6 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 starting I/O failed: -6 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Write completed with error (sct=0, sc=8) 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 starting I/O failed: -6 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 starting I/O failed: -6 00:15:30.013 Write completed with error (sct=0, sc=8) 00:15:30.013 Write completed with error (sct=0, sc=8) 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 starting I/O failed: -6 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 starting I/O failed: -6 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 starting I/O failed: -6 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 starting I/O failed: -6 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 starting I/O failed: -6 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 starting I/O failed: -6 00:15:30.013 Write completed with error (sct=0, sc=8) 00:15:30.013 starting I/O failed: -6 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 starting I/O failed: -6 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.013 starting I/O failed: -6 00:15:30.013 Read completed with error (sct=0, sc=8) 00:15:30.014 starting I/O failed: -6 00:15:30.014 Read completed with error (sct=0, sc=8) 00:15:30.014 starting I/O failed: -6 00:15:30.014 Read completed with error (sct=0, sc=8) 00:15:30.014 Write completed with error (sct=0, sc=8) 00:15:30.014 starting I/O failed: -6 00:15:30.014 Write completed with error (sct=0, sc=8) 00:15:30.014 starting I/O failed: -6 00:15:30.014 Read completed with error (sct=0, sc=8) 00:15:30.014 starting I/O failed: -6 00:15:30.014 Write completed with error (sct=0, sc=8) 00:15:30.014 Read completed with error (sct=0, sc=8) 00:15:30.014 starting I/O failed: -6 00:15:30.014 Write completed with error (sct=0, sc=8) 00:15:30.014 starting I/O failed: -6 00:15:30.014 Read completed with error (sct=0, sc=8) 00:15:30.014 starting I/O failed: -6 00:15:30.014 Read completed with error (sct=0, sc=8) 00:15:30.014 Read completed with error (sct=0, sc=8) 00:15:30.014 starting I/O failed: -6 00:15:30.014 Read completed with error (sct=0, sc=8) 00:15:30.014 starting I/O failed: -6 00:15:30.014 Read completed with error (sct=0, sc=8) 00:15:30.014 starting I/O failed: -6 00:15:30.014 Write completed with error (sct=0, sc=8) 00:15:30.014 Write completed with error (sct=0, sc=8) 00:15:30.014 starting I/O failed: -6 00:15:30.014 Read completed with error (sct=0, sc=8) 00:15:30.014 starting I/O failed: -6 00:15:30.014 Read completed with error (sct=0, sc=8) 00:15:30.014 starting I/O failed: -6 00:15:30.014 Write completed with error (sct=0, sc=8) 00:15:30.014 Read completed with error (sct=0, sc=8) 00:15:30.014 starting I/O failed: -6 00:15:30.014 Read completed with error (sct=0, sc=8) 00:15:30.014 starting I/O failed: -6 00:15:30.014 Write completed with error (sct=0, sc=8) 00:15:30.014 starting I/O failed: -6 00:15:30.014 Read completed with error (sct=0, sc=8) 00:15:30.014 Read completed with error (sct=0, sc=8) 00:15:30.014 starting I/O failed: -6 00:15:30.014 Read completed with error (sct=0, sc=8) 00:15:30.014 starting I/O failed: -6 00:15:30.014 Write completed with error (sct=0, sc=8) 00:15:30.014 starting I/O failed: -6 00:15:30.014 Read completed with error (sct=0, sc=8) 00:15:30.014 Read completed with error (sct=0, sc=8) 00:15:30.014 starting I/O failed: -6 00:15:30.014 Read completed with error (sct=0, sc=8) 00:15:30.014 starting I/O failed: -6 00:15:30.014 Read completed with error (sct=0, sc=8) 00:15:30.014 starting I/O failed: -6 00:15:30.014 Write completed with error (sct=0, sc=8) 00:15:30.014 Read completed with error (sct=0, sc=8) 00:15:30.014 starting I/O failed: -6 00:15:30.014 Read completed with error (sct=0, sc=8) 00:15:30.014 starting I/O failed: -6 00:15:30.014 Read completed with error (sct=0, sc=8) 00:15:30.014 starting I/O failed: -6 00:15:30.014 Read completed with error (sct=0, sc=8) 00:15:30.014 Read completed with error (sct=0, sc=8) 00:15:30.014 starting I/O failed: -6 00:15:30.014 Write completed with error (sct=0, sc=8) 00:15:30.014 starting I/O failed: -6 00:15:30.014 Write completed with error (sct=0, sc=8) 00:15:30.014 starting I/O failed: -6 00:15:30.014 Read completed with error (sct=0, sc=8) 00:15:30.014 Read completed with error (sct=0, sc=8) 00:15:30.014 starting I/O failed: -6 00:15:30.014 Read completed with error (sct=0, sc=8) 00:15:30.014 starting I/O failed: -6 00:15:30.014 Read completed with error (sct=0, sc=8) 00:15:30.014 starting I/O failed: -6 00:15:30.014 Write completed with error (sct=0, sc=8) 00:15:30.014 Read completed with error (sct=0, sc=8) 00:15:30.014 starting I/O failed: -6 00:15:30.014 Read completed with error (sct=0, sc=8) 00:15:30.014 starting I/O failed: -6 00:15:30.014 Write completed with error (sct=0, sc=8) 00:15:30.014 starting I/O failed: -6 00:15:30.014 Read completed with error (sct=0, sc=8) 00:15:30.014 Write completed with error (sct=0, sc=8) 00:15:30.014 starting I/O failed: -6 00:15:30.014 Write completed with error (sct=0, sc=8) 00:15:30.014 starting I/O failed: -6 00:15:30.014 Read completed with error (sct=0, sc=8) 00:15:30.014 starting I/O failed: -6 00:15:30.014 Read completed with error (sct=0, sc=8) 00:15:30.014 Read completed with error (sct=0, sc=8) 00:15:30.014 starting I/O failed: -6 00:15:30.951 [2024-11-26 19:01:47.710408] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f1e4d0 is same with the state(5) to be set 00:15:30.951 Read completed with error (sct=0, sc=8) 00:15:30.951 Read completed with error (sct=0, sc=8) 00:15:30.951 Read completed with error (sct=0, sc=8) 00:15:30.951 Read completed with error (sct=0, sc=8) 00:15:30.951 Read completed with error (sct=0, sc=8) 00:15:30.951 Read completed with error (sct=0, sc=8) 00:15:30.951 Read completed with error (sct=0, sc=8) 00:15:30.951 Read completed with error (sct=0, sc=8) 00:15:30.951 Write completed with error (sct=0, sc=8) 00:15:30.951 Read completed with error (sct=0, sc=8) 00:15:30.951 Write completed with error (sct=0, sc=8) 00:15:30.951 Read completed with error (sct=0, sc=8) 00:15:30.951 Read completed with error (sct=0, sc=8) 00:15:30.951 Read completed with error (sct=0, sc=8) 00:15:30.951 Write completed with error (sct=0, sc=8) 00:15:30.951 Read completed with error (sct=0, sc=8) 00:15:30.951 Read completed with error (sct=0, sc=8) 00:15:30.951 Write completed with error (sct=0, sc=8) 00:15:30.951 Read completed with error (sct=0, sc=8) 00:15:30.951 Write completed with error (sct=0, sc=8) 00:15:30.951 Read completed with error (sct=0, sc=8) 00:15:30.951 Write completed with error (sct=0, sc=8) 00:15:30.951 Read completed with error (sct=0, sc=8) 00:15:30.951 Read completed with error (sct=0, sc=8) 00:15:30.951 Read completed with error (sct=0, sc=8) 00:15:30.951 Write completed with error (sct=0, sc=8) 00:15:30.951 Read completed with error (sct=0, sc=8) 00:15:30.951 Write completed with error (sct=0, sc=8) 00:15:30.951 Read completed with error (sct=0, sc=8) 00:15:30.951 Read completed with error (sct=0, sc=8) 00:15:30.951 Read completed with error (sct=0, sc=8) 00:15:30.951 Read completed with error (sct=0, sc=8) 00:15:30.951 Read completed with error (sct=0, sc=8) 00:15:30.951 Read completed with error (sct=0, sc=8) 00:15:30.951 Read completed with error (sct=0, sc=8) 00:15:30.951 Write completed with error (sct=0, sc=8) 00:15:30.951 Read completed with error (sct=0, sc=8) 00:15:30.951 Read completed with error (sct=0, sc=8) 00:15:30.951 [2024-11-26 19:01:47.737280] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f1b090 is same with the state(5) to be set 00:15:30.951 Write completed with error (sct=0, sc=8) 00:15:30.951 Write completed with error (sct=0, sc=8) 00:15:30.951 Read completed with error (sct=0, sc=8) 00:15:30.951 Read completed with error (sct=0, sc=8) 00:15:30.951 Read completed with error (sct=0, sc=8) 00:15:30.951 Read completed with error (sct=0, sc=8) 00:15:30.951 Write completed with error (sct=0, sc=8) 00:15:30.951 Read completed with error (sct=0, sc=8) 00:15:30.951 Write completed with error (sct=0, sc=8) 00:15:30.951 Read completed with error (sct=0, sc=8) 00:15:30.951 Read completed with error (sct=0, sc=8) 00:15:30.951 Write completed with error (sct=0, sc=8) 00:15:30.951 Write completed with error (sct=0, sc=8) 00:15:30.951 Read completed with error (sct=0, sc=8) 00:15:30.951 Read completed with error (sct=0, sc=8) 00:15:30.951 Read completed with error (sct=0, sc=8) 00:15:30.951 Read completed with error (sct=0, sc=8) 00:15:30.951 Read completed with error (sct=0, sc=8) 00:15:30.951 Read completed with error (sct=0, sc=8) 00:15:30.951 Read completed with error (sct=0, sc=8) 00:15:30.951 Read completed with error (sct=0, sc=8) 00:15:30.951 Read completed with error (sct=0, sc=8) 00:15:30.951 Read completed with error (sct=0, sc=8) 00:15:30.951 Read completed with error (sct=0, sc=8) 00:15:30.951 Read completed with error (sct=0, sc=8) 00:15:30.951 Read completed with error (sct=0, sc=8) 00:15:30.951 Read completed with error (sct=0, sc=8) 00:15:30.951 Read completed with error (sct=0, sc=8) 00:15:30.951 Write completed with error (sct=0, sc=8) 00:15:30.951 Read completed with error (sct=0, sc=8) 00:15:30.951 Read completed with error (sct=0, sc=8) 00:15:30.951 Read completed with error (sct=0, sc=8) 00:15:30.951 Write completed with error (sct=0, sc=8) 00:15:30.951 Read completed with error (sct=0, sc=8) 00:15:30.951 Write completed with error (sct=0, sc=8) 00:15:30.951 Read completed with error (sct=0, sc=8) 00:15:30.951 Read completed with error (sct=0, sc=8) 00:15:30.951 Read completed with error (sct=0, sc=8) 00:15:30.951 [2024-11-26 19:01:47.737441] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f1ac70 is same with the state(5) to be set 00:15:30.951 Write completed with error (sct=0, sc=8) 00:15:30.951 Read completed with error (sct=0, sc=8) 00:15:30.951 Read completed with error (sct=0, sc=8) 00:15:30.951 Read completed with error (sct=0, sc=8) 00:15:30.951 Write completed with error (sct=0, sc=8) 00:15:30.951 Read completed with error (sct=0, sc=8) 00:15:30.951 Read completed with error (sct=0, sc=8) 00:15:30.951 Write completed with error (sct=0, sc=8) 00:15:30.951 Read completed with error (sct=0, sc=8) 00:15:30.951 Read completed with error (sct=0, sc=8) 00:15:30.951 Write completed with error (sct=0, sc=8) 00:15:30.951 Read completed with error (sct=0, sc=8) 00:15:30.951 Read completed with error (sct=0, sc=8) 00:15:30.951 Read completed with error (sct=0, sc=8) 00:15:30.951 Write completed with error (sct=0, sc=8) 00:15:30.952 Read completed with error (sct=0, sc=8) 00:15:30.952 Write completed with error (sct=0, sc=8) 00:15:30.952 Read completed with error (sct=0, sc=8) 00:15:30.952 Write completed with error (sct=0, sc=8) 00:15:30.952 Read completed with error (sct=0, sc=8) 00:15:30.952 Read completed with error (sct=0, sc=8) 00:15:30.952 Write completed with error (sct=0, sc=8) 00:15:30.952 Read completed with error (sct=0, sc=8) 00:15:30.952 Read completed with error (sct=0, sc=8) 00:15:30.952 Read completed with error (sct=0, sc=8) 00:15:30.952 Read completed with error (sct=0, sc=8) 00:15:30.952 Read completed with error (sct=0, sc=8) 00:15:30.952 Read completed with error (sct=0, sc=8) 00:15:30.952 Write completed with error (sct=0, sc=8) 00:15:30.952 Read completed with error (sct=0, sc=8) 00:15:30.952 Write completed with error (sct=0, sc=8) 00:15:30.952 Write completed with error (sct=0, sc=8) 00:15:30.952 Write completed with error (sct=0, sc=8) 00:15:30.952 Write completed with error (sct=0, sc=8) 00:15:30.952 Read completed with error (sct=0, sc=8) 00:15:30.952 Read completed with error (sct=0, sc=8) 00:15:30.952 Read completed with error (sct=0, sc=8) 00:15:30.952 Write completed with error (sct=0, sc=8) 00:15:30.952 [2024-11-26 19:01:47.737596] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f1b5f0 is same with the state(5) to be set 00:15:30.952 Read completed with error (sct=0, sc=8) 00:15:30.952 Read completed with error (sct=0, sc=8) 00:15:30.952 Write completed with error (sct=0, sc=8) 00:15:30.952 Read completed with error (sct=0, sc=8) 00:15:30.952 Read completed with error (sct=0, sc=8) 00:15:30.952 Read completed with error (sct=0, sc=8) 00:15:30.952 Read completed with error (sct=0, sc=8) 00:15:30.952 Write completed with error (sct=0, sc=8) 00:15:30.952 Write completed with error (sct=0, sc=8) 00:15:30.952 Read completed with error (sct=0, sc=8) 00:15:30.952 Read completed with error (sct=0, sc=8) 00:15:30.952 Read completed with error (sct=0, sc=8) 00:15:30.952 Read completed with error (sct=0, sc=8) 00:15:30.952 Write completed with error (sct=0, sc=8) 00:15:30.952 Read completed with error (sct=0, sc=8) 00:15:30.952 Write completed with error (sct=0, sc=8) 00:15:30.952 Write completed with error (sct=0, sc=8) 00:15:30.952 Write completed with error (sct=0, sc=8) 00:15:30.952 Read completed with error (sct=0, sc=8) 00:15:30.952 Read completed with error (sct=0, sc=8) 00:15:30.952 Read completed with error (sct=0, sc=8) 00:15:30.952 Read completed with error (sct=0, sc=8) 00:15:30.952 Read completed with error (sct=0, sc=8) 00:15:30.952 Read completed with error (sct=0, sc=8) 00:15:30.952 Read completed with error (sct=0, sc=8) 00:15:30.952 Read completed with error (sct=0, sc=8) 00:15:30.952 Read completed with error (sct=0, sc=8) 00:15:30.952 Read completed with error (sct=0, sc=8) 00:15:30.952 Write completed with error (sct=0, sc=8) 00:15:30.952 Write completed with error (sct=0, sc=8) 00:15:30.952 Write completed with error (sct=0, sc=8) 00:15:30.952 Read completed with error (sct=0, sc=8) 00:15:30.952 Write completed with error (sct=0, sc=8) 00:15:30.952 Read completed with error (sct=0, sc=8) 00:15:30.952 Write completed with error (sct=0, sc=8) 00:15:30.952 Read completed with error (sct=0, sc=8) 00:15:30.952 Read completed with error (sct=0, sc=8) 00:15:30.952 Read completed with error (sct=0, sc=8) 00:15:30.952 Read completed with error (sct=0, sc=8) 00:15:30.952 Write completed with error (sct=0, sc=8) 00:15:30.952 Write completed with error (sct=0, sc=8) 00:15:30.952 Write completed with error (sct=0, sc=8) 00:15:30.952 Read completed with error (sct=0, sc=8) 00:15:30.952 Write completed with error (sct=0, sc=8) 00:15:30.952 Read completed with error (sct=0, sc=8) 00:15:30.952 Read completed with error (sct=0, sc=8) 00:15:30.952 [2024-11-26 19:01:47.737776] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7fce2000c1d0 is same with the state(5) to be set 00:15:30.952 [2024-11-26 19:01:47.738517] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1f1e4d0 (9): Bad file descriptor 00:15:30.952 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf: errors occurred 00:15:30.952 19:01:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:30.952 19:01:47 -- target/delete_subsystem.sh@34 -- # delay=0 00:15:30.952 19:01:47 -- target/delete_subsystem.sh@35 -- # kill -0 3056839 00:15:30.952 19:01:47 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:15:30.952 Initializing NVMe Controllers 00:15:30.952 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:15:30.952 Controller IO queue size 128, less than required. 00:15:30.952 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:15:30.952 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:15:30.952 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:15:30.952 Initialization complete. Launching workers. 00:15:30.952 ======================================================== 00:15:30.952 Latency(us) 00:15:30.952 Device Information : IOPS MiB/s Average min max 00:15:30.952 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 195.68 0.10 943341.81 1242.12 1010777.43 00:15:30.952 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 177.80 0.09 848445.30 369.32 1011740.10 00:15:30.952 ======================================================== 00:15:30.952 Total : 373.48 0.18 898165.01 369.32 1011740.10 00:15:30.952 00:15:31.521 19:01:48 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:15:31.521 19:01:48 -- target/delete_subsystem.sh@35 -- # kill -0 3056839 00:15:31.521 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 35: kill: (3056839) - No such process 00:15:31.521 19:01:48 -- target/delete_subsystem.sh@45 -- # NOT wait 3056839 00:15:31.521 19:01:48 -- common/autotest_common.sh@650 -- # local es=0 00:15:31.521 19:01:48 -- common/autotest_common.sh@652 -- # valid_exec_arg wait 3056839 00:15:31.521 19:01:48 -- common/autotest_common.sh@638 -- # local arg=wait 00:15:31.521 19:01:48 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:31.521 19:01:48 -- common/autotest_common.sh@642 -- # type -t wait 00:15:31.521 19:01:48 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:31.521 19:01:48 -- common/autotest_common.sh@653 -- # wait 3056839 00:15:31.521 19:01:48 -- common/autotest_common.sh@653 -- # es=1 00:15:31.521 19:01:48 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:15:31.521 19:01:48 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:15:31.521 19:01:48 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:15:31.521 19:01:48 -- target/delete_subsystem.sh@48 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:15:31.521 19:01:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:31.521 19:01:48 -- common/autotest_common.sh@10 -- # set +x 00:15:31.521 19:01:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:31.521 19:01:48 -- target/delete_subsystem.sh@49 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:31.521 19:01:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:31.521 19:01:48 -- common/autotest_common.sh@10 -- # set +x 00:15:31.521 [2024-11-26 19:01:48.266559] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:31.521 19:01:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:31.521 19:01:48 -- target/delete_subsystem.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:31.521 19:01:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:31.521 19:01:48 -- common/autotest_common.sh@10 -- # set +x 00:15:31.521 19:01:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:31.521 19:01:48 -- target/delete_subsystem.sh@54 -- # perf_pid=3057468 00:15:31.521 19:01:48 -- target/delete_subsystem.sh@56 -- # delay=0 00:15:31.521 19:01:48 -- target/delete_subsystem.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 3 -q 128 -w randrw -M 70 -o 512 -P 4 00:15:31.521 19:01:48 -- target/delete_subsystem.sh@57 -- # kill -0 3057468 00:15:31.521 19:01:48 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:31.521 EAL: No free 2048 kB hugepages reported on node 1 00:15:31.521 [2024-11-26 19:01:48.327568] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:15:32.089 19:01:48 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:32.089 19:01:48 -- target/delete_subsystem.sh@57 -- # kill -0 3057468 00:15:32.089 19:01:48 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:32.655 19:01:49 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:32.655 19:01:49 -- target/delete_subsystem.sh@57 -- # kill -0 3057468 00:15:32.655 19:01:49 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:32.914 19:01:49 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:32.914 19:01:49 -- target/delete_subsystem.sh@57 -- # kill -0 3057468 00:15:32.914 19:01:49 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:33.481 19:01:50 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:33.481 19:01:50 -- target/delete_subsystem.sh@57 -- # kill -0 3057468 00:15:33.481 19:01:50 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:34.048 19:01:50 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:34.048 19:01:50 -- target/delete_subsystem.sh@57 -- # kill -0 3057468 00:15:34.048 19:01:50 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:34.615 19:01:51 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:34.615 19:01:51 -- target/delete_subsystem.sh@57 -- # kill -0 3057468 00:15:34.615 19:01:51 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:34.874 Initializing NVMe Controllers 00:15:34.874 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:15:34.874 Controller IO queue size 128, less than required. 00:15:34.874 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:15:34.874 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:15:34.874 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:15:34.874 Initialization complete. Launching workers. 00:15:34.874 ======================================================== 00:15:34.874 Latency(us) 00:15:34.874 Device Information : IOPS MiB/s Average min max 00:15:34.874 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 128.00 0.06 1002991.47 1000136.24 1009537.59 00:15:34.874 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 128.00 0.06 1004472.51 1000207.12 1011629.95 00:15:34.874 ======================================================== 00:15:34.874 Total : 256.00 0.12 1003731.99 1000136.24 1011629.95 00:15:34.874 00:15:35.133 19:01:51 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:35.133 19:01:51 -- target/delete_subsystem.sh@57 -- # kill -0 3057468 00:15:35.133 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 57: kill: (3057468) - No such process 00:15:35.133 19:01:51 -- target/delete_subsystem.sh@67 -- # wait 3057468 00:15:35.133 19:01:51 -- target/delete_subsystem.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:15:35.133 19:01:51 -- target/delete_subsystem.sh@71 -- # nvmftestfini 00:15:35.133 19:01:51 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:35.133 19:01:51 -- nvmf/common.sh@116 -- # sync 00:15:35.133 19:01:51 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:35.133 19:01:51 -- nvmf/common.sh@119 -- # set +e 00:15:35.133 19:01:51 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:35.133 19:01:51 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:35.133 rmmod nvme_tcp 00:15:35.133 rmmod nvme_fabrics 00:15:35.133 rmmod nvme_keyring 00:15:35.133 19:01:51 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:35.133 19:01:51 -- nvmf/common.sh@123 -- # set -e 00:15:35.133 19:01:51 -- nvmf/common.sh@124 -- # return 0 00:15:35.133 19:01:51 -- nvmf/common.sh@477 -- # '[' -n 3056733 ']' 00:15:35.133 19:01:51 -- nvmf/common.sh@478 -- # killprocess 3056733 00:15:35.133 19:01:51 -- common/autotest_common.sh@936 -- # '[' -z 3056733 ']' 00:15:35.133 19:01:51 -- common/autotest_common.sh@940 -- # kill -0 3056733 00:15:35.133 19:01:51 -- common/autotest_common.sh@941 -- # uname 00:15:35.133 19:01:51 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:35.133 19:01:51 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3056733 00:15:35.133 19:01:51 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:35.133 19:01:51 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:35.133 19:01:51 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3056733' 00:15:35.133 killing process with pid 3056733 00:15:35.133 19:01:51 -- common/autotest_common.sh@955 -- # kill 3056733 00:15:35.133 19:01:51 -- common/autotest_common.sh@960 -- # wait 3056733 00:15:35.392 19:01:52 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:35.392 19:01:52 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:35.392 19:01:52 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:35.392 19:01:52 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:35.392 19:01:52 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:35.392 19:01:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:35.392 19:01:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:35.392 19:01:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:37.299 19:01:54 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:37.299 00:15:37.299 real 0m16.282s 00:15:37.299 user 0m30.451s 00:15:37.299 sys 0m5.244s 00:15:37.299 19:01:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:37.299 19:01:54 -- common/autotest_common.sh@10 -- # set +x 00:15:37.299 ************************************ 00:15:37.299 END TEST nvmf_delete_subsystem 00:15:37.299 ************************************ 00:15:37.299 19:01:54 -- nvmf/nvmf.sh@36 -- # [[ 1 -eq 1 ]] 00:15:37.299 19:01:54 -- nvmf/nvmf.sh@37 -- # run_test nvmf_nvme_cli /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:15:37.299 19:01:54 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:37.300 19:01:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:37.300 19:01:54 -- common/autotest_common.sh@10 -- # set +x 00:15:37.300 ************************************ 00:15:37.300 START TEST nvmf_nvme_cli 00:15:37.300 ************************************ 00:15:37.300 19:01:54 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:15:37.558 * Looking for test storage... 00:15:37.558 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:37.558 19:01:54 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:37.558 19:01:54 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:37.558 19:01:54 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:37.558 19:01:54 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:37.558 19:01:54 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:37.558 19:01:54 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:37.558 19:01:54 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:37.558 19:01:54 -- scripts/common.sh@335 -- # IFS=.-: 00:15:37.558 19:01:54 -- scripts/common.sh@335 -- # read -ra ver1 00:15:37.558 19:01:54 -- scripts/common.sh@336 -- # IFS=.-: 00:15:37.558 19:01:54 -- scripts/common.sh@336 -- # read -ra ver2 00:15:37.558 19:01:54 -- scripts/common.sh@337 -- # local 'op=<' 00:15:37.558 19:01:54 -- scripts/common.sh@339 -- # ver1_l=2 00:15:37.558 19:01:54 -- scripts/common.sh@340 -- # ver2_l=1 00:15:37.558 19:01:54 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:37.558 19:01:54 -- scripts/common.sh@343 -- # case "$op" in 00:15:37.558 19:01:54 -- scripts/common.sh@344 -- # : 1 00:15:37.558 19:01:54 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:37.558 19:01:54 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:37.558 19:01:54 -- scripts/common.sh@364 -- # decimal 1 00:15:37.558 19:01:54 -- scripts/common.sh@352 -- # local d=1 00:15:37.558 19:01:54 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:37.558 19:01:54 -- scripts/common.sh@354 -- # echo 1 00:15:37.558 19:01:54 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:37.558 19:01:54 -- scripts/common.sh@365 -- # decimal 2 00:15:37.558 19:01:54 -- scripts/common.sh@352 -- # local d=2 00:15:37.558 19:01:54 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:37.558 19:01:54 -- scripts/common.sh@354 -- # echo 2 00:15:37.558 19:01:54 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:37.558 19:01:54 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:37.558 19:01:54 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:37.558 19:01:54 -- scripts/common.sh@367 -- # return 0 00:15:37.558 19:01:54 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:37.558 19:01:54 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:37.558 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:37.558 --rc genhtml_branch_coverage=1 00:15:37.558 --rc genhtml_function_coverage=1 00:15:37.558 --rc genhtml_legend=1 00:15:37.558 --rc geninfo_all_blocks=1 00:15:37.558 --rc geninfo_unexecuted_blocks=1 00:15:37.558 00:15:37.558 ' 00:15:37.558 19:01:54 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:37.558 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:37.558 --rc genhtml_branch_coverage=1 00:15:37.558 --rc genhtml_function_coverage=1 00:15:37.558 --rc genhtml_legend=1 00:15:37.558 --rc geninfo_all_blocks=1 00:15:37.558 --rc geninfo_unexecuted_blocks=1 00:15:37.558 00:15:37.558 ' 00:15:37.558 19:01:54 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:37.558 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:37.558 --rc genhtml_branch_coverage=1 00:15:37.558 --rc genhtml_function_coverage=1 00:15:37.558 --rc genhtml_legend=1 00:15:37.558 --rc geninfo_all_blocks=1 00:15:37.558 --rc geninfo_unexecuted_blocks=1 00:15:37.558 00:15:37.558 ' 00:15:37.558 19:01:54 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:37.558 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:37.558 --rc genhtml_branch_coverage=1 00:15:37.558 --rc genhtml_function_coverage=1 00:15:37.558 --rc genhtml_legend=1 00:15:37.558 --rc geninfo_all_blocks=1 00:15:37.558 --rc geninfo_unexecuted_blocks=1 00:15:37.558 00:15:37.558 ' 00:15:37.558 19:01:54 -- target/nvme_cli.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:37.558 19:01:54 -- nvmf/common.sh@7 -- # uname -s 00:15:37.558 19:01:54 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:37.558 19:01:54 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:37.558 19:01:54 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:37.558 19:01:54 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:37.559 19:01:54 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:37.559 19:01:54 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:37.559 19:01:54 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:37.559 19:01:54 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:37.559 19:01:54 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:37.559 19:01:54 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:37.559 19:01:54 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:15:37.559 19:01:54 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:15:37.559 19:01:54 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:37.559 19:01:54 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:37.559 19:01:54 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:37.559 19:01:54 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:37.559 19:01:54 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:37.559 19:01:54 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:37.559 19:01:54 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:37.559 19:01:54 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:37.559 19:01:54 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:37.559 19:01:54 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:37.559 19:01:54 -- paths/export.sh@5 -- # export PATH 00:15:37.559 19:01:54 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:37.559 19:01:54 -- nvmf/common.sh@46 -- # : 0 00:15:37.559 19:01:54 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:37.559 19:01:54 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:37.559 19:01:54 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:37.559 19:01:54 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:37.559 19:01:54 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:37.559 19:01:54 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:37.559 19:01:54 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:37.559 19:01:54 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:37.559 19:01:54 -- target/nvme_cli.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:37.559 19:01:54 -- target/nvme_cli.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:37.559 19:01:54 -- target/nvme_cli.sh@14 -- # devs=() 00:15:37.559 19:01:54 -- target/nvme_cli.sh@16 -- # nvmftestinit 00:15:37.559 19:01:54 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:37.559 19:01:54 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:37.559 19:01:54 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:37.559 19:01:54 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:37.559 19:01:54 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:37.559 19:01:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:37.559 19:01:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:37.559 19:01:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:37.559 19:01:54 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:37.559 19:01:54 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:37.559 19:01:54 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:37.559 19:01:54 -- common/autotest_common.sh@10 -- # set +x 00:15:42.833 19:01:59 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:42.833 19:01:59 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:42.833 19:01:59 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:42.833 19:01:59 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:42.833 19:01:59 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:42.833 19:01:59 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:42.833 19:01:59 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:42.833 19:01:59 -- nvmf/common.sh@294 -- # net_devs=() 00:15:42.833 19:01:59 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:42.833 19:01:59 -- nvmf/common.sh@295 -- # e810=() 00:15:42.833 19:01:59 -- nvmf/common.sh@295 -- # local -ga e810 00:15:42.833 19:01:59 -- nvmf/common.sh@296 -- # x722=() 00:15:42.833 19:01:59 -- nvmf/common.sh@296 -- # local -ga x722 00:15:42.833 19:01:59 -- nvmf/common.sh@297 -- # mlx=() 00:15:42.833 19:01:59 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:42.833 19:01:59 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:42.833 19:01:59 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:42.833 19:01:59 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:42.833 19:01:59 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:42.833 19:01:59 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:42.833 19:01:59 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:42.833 19:01:59 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:42.833 19:01:59 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:42.833 19:01:59 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:42.833 19:01:59 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:42.833 19:01:59 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:42.833 19:01:59 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:42.833 19:01:59 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:42.833 19:01:59 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:42.833 19:01:59 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:42.833 19:01:59 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:42.833 19:01:59 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:42.833 19:01:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:42.833 19:01:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:15:42.833 Found 0000:86:00.0 (0x8086 - 0x159b) 00:15:42.833 19:01:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:42.833 19:01:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:42.833 19:01:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:42.833 19:01:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:42.833 19:01:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:42.833 19:01:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:42.833 19:01:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:15:42.833 Found 0000:86:00.1 (0x8086 - 0x159b) 00:15:42.833 19:01:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:42.833 19:01:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:42.833 19:01:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:42.833 19:01:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:42.833 19:01:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:42.833 19:01:59 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:42.833 19:01:59 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:42.833 19:01:59 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:42.833 19:01:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:42.833 19:01:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:42.834 19:01:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:42.834 19:01:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:42.834 19:01:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:15:42.834 Found net devices under 0000:86:00.0: cvl_0_0 00:15:42.834 19:01:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:42.834 19:01:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:42.834 19:01:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:42.834 19:01:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:42.834 19:01:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:42.834 19:01:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:15:42.834 Found net devices under 0000:86:00.1: cvl_0_1 00:15:42.834 19:01:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:42.834 19:01:59 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:42.834 19:01:59 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:42.834 19:01:59 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:42.834 19:01:59 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:42.834 19:01:59 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:42.834 19:01:59 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:42.834 19:01:59 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:42.834 19:01:59 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:42.834 19:01:59 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:42.834 19:01:59 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:42.834 19:01:59 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:42.834 19:01:59 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:42.834 19:01:59 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:42.834 19:01:59 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:42.834 19:01:59 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:42.834 19:01:59 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:42.834 19:01:59 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:42.834 19:01:59 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:43.092 19:01:59 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:43.092 19:01:59 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:43.092 19:01:59 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:43.092 19:01:59 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:43.092 19:01:59 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:43.092 19:01:59 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:43.092 19:01:59 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:43.092 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:43.092 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.231 ms 00:15:43.092 00:15:43.092 --- 10.0.0.2 ping statistics --- 00:15:43.092 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:43.092 rtt min/avg/max/mdev = 0.231/0.231/0.231/0.000 ms 00:15:43.092 19:01:59 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:43.092 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:43.093 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.172 ms 00:15:43.093 00:15:43.093 --- 10.0.0.1 ping statistics --- 00:15:43.093 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:43.093 rtt min/avg/max/mdev = 0.172/0.172/0.172/0.000 ms 00:15:43.093 19:01:59 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:43.093 19:01:59 -- nvmf/common.sh@410 -- # return 0 00:15:43.093 19:01:59 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:43.093 19:01:59 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:43.093 19:01:59 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:43.093 19:01:59 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:43.093 19:01:59 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:43.093 19:01:59 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:43.093 19:01:59 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:43.093 19:01:59 -- target/nvme_cli.sh@17 -- # nvmfappstart -m 0xF 00:15:43.093 19:01:59 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:43.093 19:01:59 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:43.093 19:01:59 -- common/autotest_common.sh@10 -- # set +x 00:15:43.093 19:01:59 -- nvmf/common.sh@469 -- # nvmfpid=3061576 00:15:43.093 19:01:59 -- nvmf/common.sh@470 -- # waitforlisten 3061576 00:15:43.093 19:01:59 -- common/autotest_common.sh@829 -- # '[' -z 3061576 ']' 00:15:43.093 19:01:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:43.093 19:01:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:43.093 19:01:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:43.093 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:43.093 19:01:59 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:15:43.093 19:01:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:43.093 19:01:59 -- common/autotest_common.sh@10 -- # set +x 00:15:43.093 [2024-11-26 19:01:59.960170] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:15:43.093 [2024-11-26 19:01:59.960215] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:43.093 EAL: No free 2048 kB hugepages reported on node 1 00:15:43.352 [2024-11-26 19:02:00.020546] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:43.352 [2024-11-26 19:02:00.063659] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:43.352 [2024-11-26 19:02:00.063792] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:43.352 [2024-11-26 19:02:00.063800] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:43.352 [2024-11-26 19:02:00.063807] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:43.352 [2024-11-26 19:02:00.063851] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:43.352 [2024-11-26 19:02:00.063967] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:43.352 [2024-11-26 19:02:00.064013] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:43.352 [2024-11-26 19:02:00.064014] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:43.920 19:02:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:43.920 19:02:00 -- common/autotest_common.sh@862 -- # return 0 00:15:43.920 19:02:00 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:43.920 19:02:00 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:43.920 19:02:00 -- common/autotest_common.sh@10 -- # set +x 00:15:43.920 19:02:00 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:43.920 19:02:00 -- target/nvme_cli.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:43.920 19:02:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:43.920 19:02:00 -- common/autotest_common.sh@10 -- # set +x 00:15:44.179 [2024-11-26 19:02:00.848509] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:44.179 19:02:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:44.179 19:02:00 -- target/nvme_cli.sh@21 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:15:44.179 19:02:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:44.179 19:02:00 -- common/autotest_common.sh@10 -- # set +x 00:15:44.179 Malloc0 00:15:44.179 19:02:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:44.179 19:02:00 -- target/nvme_cli.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:15:44.179 19:02:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:44.179 19:02:00 -- common/autotest_common.sh@10 -- # set +x 00:15:44.179 Malloc1 00:15:44.179 19:02:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:44.179 19:02:00 -- target/nvme_cli.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME -d SPDK_Controller1 -i 291 00:15:44.179 19:02:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:44.179 19:02:00 -- common/autotest_common.sh@10 -- # set +x 00:15:44.179 19:02:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:44.179 19:02:00 -- target/nvme_cli.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:44.179 19:02:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:44.179 19:02:00 -- common/autotest_common.sh@10 -- # set +x 00:15:44.179 19:02:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:44.179 19:02:00 -- target/nvme_cli.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:15:44.179 19:02:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:44.179 19:02:00 -- common/autotest_common.sh@10 -- # set +x 00:15:44.179 19:02:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:44.179 19:02:00 -- target/nvme_cli.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:44.179 19:02:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:44.179 19:02:00 -- common/autotest_common.sh@10 -- # set +x 00:15:44.179 [2024-11-26 19:02:00.930343] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:44.179 19:02:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:44.179 19:02:00 -- target/nvme_cli.sh@28 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:15:44.179 19:02:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:44.179 19:02:00 -- common/autotest_common.sh@10 -- # set +x 00:15:44.179 19:02:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:44.179 19:02:00 -- target/nvme_cli.sh@30 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -a 10.0.0.2 -s 4420 00:15:44.179 00:15:44.179 Discovery Log Number of Records 2, Generation counter 2 00:15:44.179 =====Discovery Log Entry 0====== 00:15:44.179 trtype: tcp 00:15:44.179 adrfam: ipv4 00:15:44.179 subtype: current discovery subsystem 00:15:44.179 treq: not required 00:15:44.179 portid: 0 00:15:44.179 trsvcid: 4420 00:15:44.179 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:15:44.179 traddr: 10.0.0.2 00:15:44.179 eflags: explicit discovery connections, duplicate discovery information 00:15:44.179 sectype: none 00:15:44.179 =====Discovery Log Entry 1====== 00:15:44.179 trtype: tcp 00:15:44.179 adrfam: ipv4 00:15:44.179 subtype: nvme subsystem 00:15:44.179 treq: not required 00:15:44.179 portid: 0 00:15:44.179 trsvcid: 4420 00:15:44.179 subnqn: nqn.2016-06.io.spdk:cnode1 00:15:44.179 traddr: 10.0.0.2 00:15:44.179 eflags: none 00:15:44.179 sectype: none 00:15:44.179 19:02:01 -- target/nvme_cli.sh@31 -- # devs=($(get_nvme_devs)) 00:15:44.179 19:02:01 -- target/nvme_cli.sh@31 -- # get_nvme_devs 00:15:44.179 19:02:01 -- nvmf/common.sh@510 -- # local dev _ 00:15:44.179 19:02:01 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:44.179 19:02:01 -- nvmf/common.sh@509 -- # nvme list 00:15:44.179 19:02:01 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:15:44.179 19:02:01 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:44.179 19:02:01 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:15:44.180 19:02:01 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:44.180 19:02:01 -- target/nvme_cli.sh@31 -- # nvme_num_before_connection=0 00:15:44.180 19:02:01 -- target/nvme_cli.sh@32 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:15:45.559 19:02:02 -- target/nvme_cli.sh@34 -- # waitforserial SPDKISFASTANDAWESOME 2 00:15:45.559 19:02:02 -- common/autotest_common.sh@1187 -- # local i=0 00:15:45.559 19:02:02 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:15:45.559 19:02:02 -- common/autotest_common.sh@1189 -- # [[ -n 2 ]] 00:15:45.559 19:02:02 -- common/autotest_common.sh@1190 -- # nvme_device_counter=2 00:15:45.559 19:02:02 -- common/autotest_common.sh@1194 -- # sleep 2 00:15:47.466 19:02:04 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:15:47.466 19:02:04 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:15:47.466 19:02:04 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:15:47.466 19:02:04 -- common/autotest_common.sh@1196 -- # nvme_devices=2 00:15:47.466 19:02:04 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:15:47.466 19:02:04 -- common/autotest_common.sh@1197 -- # return 0 00:15:47.466 19:02:04 -- target/nvme_cli.sh@35 -- # get_nvme_devs 00:15:47.466 19:02:04 -- nvmf/common.sh@510 -- # local dev _ 00:15:47.466 19:02:04 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:47.466 19:02:04 -- nvmf/common.sh@509 -- # nvme list 00:15:47.466 19:02:04 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:15:47.466 19:02:04 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:47.466 19:02:04 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:15:47.466 19:02:04 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:47.466 19:02:04 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:15:47.466 19:02:04 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:15:47.466 19:02:04 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:47.466 19:02:04 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:15:47.466 19:02:04 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:15:47.466 19:02:04 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:47.466 19:02:04 -- target/nvme_cli.sh@35 -- # [[ -z /dev/nvme0n1 00:15:47.466 /dev/nvme0n2 ]] 00:15:47.466 19:02:04 -- target/nvme_cli.sh@59 -- # devs=($(get_nvme_devs)) 00:15:47.466 19:02:04 -- target/nvme_cli.sh@59 -- # get_nvme_devs 00:15:47.466 19:02:04 -- nvmf/common.sh@510 -- # local dev _ 00:15:47.466 19:02:04 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:47.466 19:02:04 -- nvmf/common.sh@509 -- # nvme list 00:15:47.466 19:02:04 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:15:47.466 19:02:04 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:47.466 19:02:04 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:15:47.466 19:02:04 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:47.466 19:02:04 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:15:47.466 19:02:04 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:15:47.466 19:02:04 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:47.466 19:02:04 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:15:47.466 19:02:04 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:15:47.466 19:02:04 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:47.466 19:02:04 -- target/nvme_cli.sh@59 -- # nvme_num=2 00:15:47.466 19:02:04 -- target/nvme_cli.sh@60 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:15:47.726 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:15:47.726 19:02:04 -- target/nvme_cli.sh@61 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:15:47.726 19:02:04 -- common/autotest_common.sh@1208 -- # local i=0 00:15:47.726 19:02:04 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:15:47.726 19:02:04 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:15:47.726 19:02:04 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:15:47.726 19:02:04 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:15:47.726 19:02:04 -- common/autotest_common.sh@1220 -- # return 0 00:15:47.726 19:02:04 -- target/nvme_cli.sh@62 -- # (( nvme_num <= nvme_num_before_connection )) 00:15:47.726 19:02:04 -- target/nvme_cli.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:47.726 19:02:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:47.726 19:02:04 -- common/autotest_common.sh@10 -- # set +x 00:15:47.726 19:02:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:47.726 19:02:04 -- target/nvme_cli.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:15:47.726 19:02:04 -- target/nvme_cli.sh@70 -- # nvmftestfini 00:15:47.726 19:02:04 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:47.726 19:02:04 -- nvmf/common.sh@116 -- # sync 00:15:47.726 19:02:04 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:47.726 19:02:04 -- nvmf/common.sh@119 -- # set +e 00:15:47.726 19:02:04 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:47.726 19:02:04 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:47.726 rmmod nvme_tcp 00:15:47.726 rmmod nvme_fabrics 00:15:47.726 rmmod nvme_keyring 00:15:47.726 19:02:04 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:47.726 19:02:04 -- nvmf/common.sh@123 -- # set -e 00:15:47.726 19:02:04 -- nvmf/common.sh@124 -- # return 0 00:15:47.726 19:02:04 -- nvmf/common.sh@477 -- # '[' -n 3061576 ']' 00:15:47.726 19:02:04 -- nvmf/common.sh@478 -- # killprocess 3061576 00:15:47.726 19:02:04 -- common/autotest_common.sh@936 -- # '[' -z 3061576 ']' 00:15:47.726 19:02:04 -- common/autotest_common.sh@940 -- # kill -0 3061576 00:15:47.726 19:02:04 -- common/autotest_common.sh@941 -- # uname 00:15:47.726 19:02:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:47.726 19:02:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3061576 00:15:47.726 19:02:04 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:47.726 19:02:04 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:47.726 19:02:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3061576' 00:15:47.726 killing process with pid 3061576 00:15:47.726 19:02:04 -- common/autotest_common.sh@955 -- # kill 3061576 00:15:47.726 19:02:04 -- common/autotest_common.sh@960 -- # wait 3061576 00:15:47.988 19:02:04 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:47.988 19:02:04 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:47.988 19:02:04 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:47.988 19:02:04 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:47.988 19:02:04 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:47.988 19:02:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:47.988 19:02:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:47.988 19:02:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:50.078 19:02:06 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:50.078 00:15:50.078 real 0m12.638s 00:15:50.078 user 0m20.419s 00:15:50.078 sys 0m4.815s 00:15:50.078 19:02:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:50.078 19:02:06 -- common/autotest_common.sh@10 -- # set +x 00:15:50.078 ************************************ 00:15:50.078 END TEST nvmf_nvme_cli 00:15:50.078 ************************************ 00:15:50.078 19:02:06 -- nvmf/nvmf.sh@39 -- # [[ 1 -eq 1 ]] 00:15:50.078 19:02:06 -- nvmf/nvmf.sh@40 -- # run_test nvmf_vfio_user /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_vfio_user.sh --transport=tcp 00:15:50.078 19:02:06 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:50.078 19:02:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:50.078 19:02:06 -- common/autotest_common.sh@10 -- # set +x 00:15:50.078 ************************************ 00:15:50.078 START TEST nvmf_vfio_user 00:15:50.078 ************************************ 00:15:50.078 19:02:06 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_vfio_user.sh --transport=tcp 00:15:50.078 * Looking for test storage... 00:15:50.078 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:50.078 19:02:06 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:50.078 19:02:06 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:50.078 19:02:06 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:50.338 19:02:07 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:50.338 19:02:07 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:50.338 19:02:07 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:50.338 19:02:07 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:50.338 19:02:07 -- scripts/common.sh@335 -- # IFS=.-: 00:15:50.338 19:02:07 -- scripts/common.sh@335 -- # read -ra ver1 00:15:50.338 19:02:07 -- scripts/common.sh@336 -- # IFS=.-: 00:15:50.338 19:02:07 -- scripts/common.sh@336 -- # read -ra ver2 00:15:50.338 19:02:07 -- scripts/common.sh@337 -- # local 'op=<' 00:15:50.338 19:02:07 -- scripts/common.sh@339 -- # ver1_l=2 00:15:50.338 19:02:07 -- scripts/common.sh@340 -- # ver2_l=1 00:15:50.338 19:02:07 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:50.338 19:02:07 -- scripts/common.sh@343 -- # case "$op" in 00:15:50.338 19:02:07 -- scripts/common.sh@344 -- # : 1 00:15:50.338 19:02:07 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:50.338 19:02:07 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:50.338 19:02:07 -- scripts/common.sh@364 -- # decimal 1 00:15:50.338 19:02:07 -- scripts/common.sh@352 -- # local d=1 00:15:50.338 19:02:07 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:50.338 19:02:07 -- scripts/common.sh@354 -- # echo 1 00:15:50.338 19:02:07 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:50.338 19:02:07 -- scripts/common.sh@365 -- # decimal 2 00:15:50.338 19:02:07 -- scripts/common.sh@352 -- # local d=2 00:15:50.338 19:02:07 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:50.338 19:02:07 -- scripts/common.sh@354 -- # echo 2 00:15:50.338 19:02:07 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:50.338 19:02:07 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:50.338 19:02:07 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:50.338 19:02:07 -- scripts/common.sh@367 -- # return 0 00:15:50.338 19:02:07 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:50.338 19:02:07 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:50.338 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:50.338 --rc genhtml_branch_coverage=1 00:15:50.338 --rc genhtml_function_coverage=1 00:15:50.338 --rc genhtml_legend=1 00:15:50.338 --rc geninfo_all_blocks=1 00:15:50.338 --rc geninfo_unexecuted_blocks=1 00:15:50.338 00:15:50.338 ' 00:15:50.338 19:02:07 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:50.338 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:50.338 --rc genhtml_branch_coverage=1 00:15:50.338 --rc genhtml_function_coverage=1 00:15:50.338 --rc genhtml_legend=1 00:15:50.338 --rc geninfo_all_blocks=1 00:15:50.338 --rc geninfo_unexecuted_blocks=1 00:15:50.338 00:15:50.338 ' 00:15:50.338 19:02:07 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:50.338 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:50.338 --rc genhtml_branch_coverage=1 00:15:50.338 --rc genhtml_function_coverage=1 00:15:50.338 --rc genhtml_legend=1 00:15:50.338 --rc geninfo_all_blocks=1 00:15:50.338 --rc geninfo_unexecuted_blocks=1 00:15:50.338 00:15:50.338 ' 00:15:50.338 19:02:07 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:50.338 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:50.338 --rc genhtml_branch_coverage=1 00:15:50.338 --rc genhtml_function_coverage=1 00:15:50.338 --rc genhtml_legend=1 00:15:50.338 --rc geninfo_all_blocks=1 00:15:50.338 --rc geninfo_unexecuted_blocks=1 00:15:50.338 00:15:50.338 ' 00:15:50.338 19:02:07 -- target/nvmf_vfio_user.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:50.338 19:02:07 -- nvmf/common.sh@7 -- # uname -s 00:15:50.338 19:02:07 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:50.338 19:02:07 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:50.338 19:02:07 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:50.338 19:02:07 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:50.338 19:02:07 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:50.338 19:02:07 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:50.339 19:02:07 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:50.339 19:02:07 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:50.339 19:02:07 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:50.339 19:02:07 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:50.339 19:02:07 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:15:50.339 19:02:07 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:15:50.339 19:02:07 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:50.339 19:02:07 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:50.339 19:02:07 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:50.339 19:02:07 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:50.339 19:02:07 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:50.339 19:02:07 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:50.339 19:02:07 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:50.339 19:02:07 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:50.339 19:02:07 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:50.339 19:02:07 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:50.339 19:02:07 -- paths/export.sh@5 -- # export PATH 00:15:50.339 19:02:07 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:50.339 19:02:07 -- nvmf/common.sh@46 -- # : 0 00:15:50.339 19:02:07 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:50.339 19:02:07 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:50.339 19:02:07 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:50.339 19:02:07 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:50.339 19:02:07 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:50.339 19:02:07 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:50.339 19:02:07 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:50.339 19:02:07 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:50.339 19:02:07 -- target/nvmf_vfio_user.sh@12 -- # MALLOC_BDEV_SIZE=64 00:15:50.339 19:02:07 -- target/nvmf_vfio_user.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:15:50.339 19:02:07 -- target/nvmf_vfio_user.sh@14 -- # NUM_DEVICES=2 00:15:50.339 19:02:07 -- target/nvmf_vfio_user.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:50.339 19:02:07 -- target/nvmf_vfio_user.sh@18 -- # export TEST_TRANSPORT=VFIOUSER 00:15:50.339 19:02:07 -- target/nvmf_vfio_user.sh@18 -- # TEST_TRANSPORT=VFIOUSER 00:15:50.339 19:02:07 -- target/nvmf_vfio_user.sh@47 -- # rm -rf /var/run/vfio-user 00:15:50.339 19:02:07 -- target/nvmf_vfio_user.sh@103 -- # setup_nvmf_vfio_user '' '' 00:15:50.339 19:02:07 -- target/nvmf_vfio_user.sh@51 -- # local nvmf_app_args= 00:15:50.339 19:02:07 -- target/nvmf_vfio_user.sh@52 -- # local transport_args= 00:15:50.339 19:02:07 -- target/nvmf_vfio_user.sh@55 -- # nvmfpid=3062934 00:15:50.339 19:02:07 -- target/nvmf_vfio_user.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m '[0,1,2,3]' 00:15:50.339 19:02:07 -- target/nvmf_vfio_user.sh@57 -- # echo 'Process pid: 3062934' 00:15:50.339 Process pid: 3062934 00:15:50.339 19:02:07 -- target/nvmf_vfio_user.sh@59 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:15:50.339 19:02:07 -- target/nvmf_vfio_user.sh@60 -- # waitforlisten 3062934 00:15:50.339 19:02:07 -- common/autotest_common.sh@829 -- # '[' -z 3062934 ']' 00:15:50.339 19:02:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:50.339 19:02:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:50.339 19:02:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:50.339 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:50.339 19:02:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:50.339 19:02:07 -- common/autotest_common.sh@10 -- # set +x 00:15:50.339 [2024-11-26 19:02:07.126485] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:15:50.339 [2024-11-26 19:02:07.126532] [ DPDK EAL parameters: nvmf -l 0,1,2,3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:50.339 EAL: No free 2048 kB hugepages reported on node 1 00:15:50.339 [2024-11-26 19:02:07.181067] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:50.339 [2024-11-26 19:02:07.221641] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:50.339 [2024-11-26 19:02:07.221765] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:50.339 [2024-11-26 19:02:07.221773] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:50.339 [2024-11-26 19:02:07.221779] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:50.339 [2024-11-26 19:02:07.221843] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:50.339 [2024-11-26 19:02:07.221940] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:50.339 [2024-11-26 19:02:07.222026] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:50.339 [2024-11-26 19:02:07.222027] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:51.274 19:02:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:51.274 19:02:07 -- common/autotest_common.sh@862 -- # return 0 00:15:51.274 19:02:07 -- target/nvmf_vfio_user.sh@62 -- # sleep 1 00:15:52.212 19:02:08 -- target/nvmf_vfio_user.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t VFIOUSER 00:15:52.472 19:02:09 -- target/nvmf_vfio_user.sh@66 -- # mkdir -p /var/run/vfio-user 00:15:52.472 19:02:09 -- target/nvmf_vfio_user.sh@68 -- # seq 1 2 00:15:52.472 19:02:09 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:52.472 19:02:09 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user1/1 00:15:52.472 19:02:09 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:15:52.472 Malloc1 00:15:52.472 19:02:09 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode1 -a -s SPDK1 00:15:52.732 19:02:09 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode1 Malloc1 00:15:52.991 19:02:09 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode1 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user1/1 -s 0 00:15:53.250 19:02:09 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:53.250 19:02:09 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user2/2 00:15:53.250 19:02:09 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc2 00:15:53.250 Malloc2 00:15:53.509 19:02:10 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode2 -a -s SPDK2 00:15:53.509 19:02:10 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode2 Malloc2 00:15:53.766 19:02:10 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode2 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user2/2 -s 0 00:15:54.025 19:02:10 -- target/nvmf_vfio_user.sh@104 -- # run_nvmf_vfio_user 00:15:54.025 19:02:10 -- target/nvmf_vfio_user.sh@80 -- # seq 1 2 00:15:54.025 19:02:10 -- target/nvmf_vfio_user.sh@80 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:54.025 19:02:10 -- target/nvmf_vfio_user.sh@81 -- # test_traddr=/var/run/vfio-user/domain/vfio-user1/1 00:15:54.025 19:02:10 -- target/nvmf_vfio_user.sh@82 -- # test_subnqn=nqn.2019-07.io.spdk:cnode1 00:15:54.025 19:02:10 -- target/nvmf_vfio_user.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -g -L nvme -L nvme_vfio -L vfio_pci 00:15:54.025 [2024-11-26 19:02:10.763506] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:15:54.025 [2024-11-26 19:02:10.763549] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --single-file-segments --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3063522 ] 00:15:54.025 EAL: No free 2048 kB hugepages reported on node 1 00:15:54.025 [2024-11-26 19:02:10.792330] nvme_vfio_user.c: 259:nvme_vfio_ctrlr_scan: *DEBUG*: Scan controller : /var/run/vfio-user/domain/vfio-user1/1 00:15:54.025 [2024-11-26 19:02:10.805227] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 0, Size 0x2000, Offset 0x0, Flags 0xf, Cap offset 32 00:15:54.025 [2024-11-26 19:02:10.805248] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0x1000, Offset 0x1000, Map addr 0x7f5df5895000 00:15:54.025 [2024-11-26 19:02:10.806232] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 1, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:54.025 [2024-11-26 19:02:10.807233] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 2, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:54.025 [2024-11-26 19:02:10.808237] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 3, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:54.025 [2024-11-26 19:02:10.809241] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 4, Size 0x2000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:54.025 [2024-11-26 19:02:10.810249] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 5, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:54.025 [2024-11-26 19:02:10.811258] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 6, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:54.025 [2024-11-26 19:02:10.812263] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 7, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:54.025 [2024-11-26 19:02:10.813269] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 8, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:54.025 [2024-11-26 19:02:10.814277] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 9, Size 0xc000, Offset 0x0, Flags 0xf, Cap offset 32 00:15:54.025 [2024-11-26 19:02:10.814286] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0xb000, Offset 0x1000, Map addr 0x7f5df45a0000 00:15:54.025 [2024-11-26 19:02:10.815343] vfio_user_pci.c: 65:vfio_add_mr: *DEBUG*: Add memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:15:54.025 [2024-11-26 19:02:10.825614] vfio_user_pci.c: 386:spdk_vfio_user_setup: *DEBUG*: Device vfio-user0, Path /var/run/vfio-user/domain/vfio-user1/1/cntrl Setup Successfully 00:15:54.025 [2024-11-26 19:02:10.825633] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to connect adminq (no timeout) 00:15:54.025 [2024-11-26 19:02:10.834407] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x0, value 0x201e0100ff 00:15:54.025 [2024-11-26 19:02:10.834444] nvme_pcie_common.c: 132:nvme_pcie_qpair_construct: *INFO*: max_completions_cap = 64 num_trackers = 192 00:15:54.025 [2024-11-26 19:02:10.834511] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for connect adminq (no timeout) 00:15:54.025 [2024-11-26 19:02:10.834529] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read vs (no timeout) 00:15:54.025 [2024-11-26 19:02:10.834534] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read vs wait for vs (no timeout) 00:15:54.025 [2024-11-26 19:02:10.835404] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x8, value 0x10300 00:15:54.025 [2024-11-26 19:02:10.835412] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read cap (no timeout) 00:15:54.025 [2024-11-26 19:02:10.835418] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read cap wait for cap (no timeout) 00:15:54.025 [2024-11-26 19:02:10.836407] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x0, value 0x201e0100ff 00:15:54.025 [2024-11-26 19:02:10.836414] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to check en (no timeout) 00:15:54.025 [2024-11-26 19:02:10.836421] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to check en wait for cc (timeout 15000 ms) 00:15:54.025 [2024-11-26 19:02:10.837411] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x0 00:15:54.025 [2024-11-26 19:02:10.837418] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:15:54.025 [2024-11-26 19:02:10.838416] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x1c, value 0x0 00:15:54.025 [2024-11-26 19:02:10.838424] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] CC.EN = 0 && CSTS.RDY = 0 00:15:54.025 [2024-11-26 19:02:10.838428] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to controller is disabled (timeout 15000 ms) 00:15:54.025 [2024-11-26 19:02:10.838434] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:15:54.025 [2024-11-26 19:02:10.838539] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Setting CC.EN = 1 00:15:54.025 [2024-11-26 19:02:10.838543] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:15:54.025 [2024-11-26 19:02:10.838548] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x28, value 0x2000003c0000 00:15:54.025 [2024-11-26 19:02:10.839425] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x30, value 0x2000003be000 00:15:54.025 [2024-11-26 19:02:10.840429] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x24, value 0xff00ff 00:15:54.025 [2024-11-26 19:02:10.841435] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x460001 00:15:54.025 [2024-11-26 19:02:10.842467] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:15:54.026 [2024-11-26 19:02:10.843453] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x1c, value 0x1 00:15:54.026 [2024-11-26 19:02:10.843460] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:15:54.026 [2024-11-26 19:02:10.843464] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to reset admin queue (timeout 30000 ms) 00:15:54.026 [2024-11-26 19:02:10.843482] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify controller (no timeout) 00:15:54.026 [2024-11-26 19:02:10.843493] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify controller (timeout 30000 ms) 00:15:54.026 [2024-11-26 19:02:10.843504] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:54.026 [2024-11-26 19:02:10.843508] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:54.026 [2024-11-26 19:02:10.843521] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000001 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:54.026 [2024-11-26 19:02:10.843570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0001 p:1 m:0 dnr:0 00:15:54.026 [2024-11-26 19:02:10.843578] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] transport max_xfer_size 131072 00:15:54.026 [2024-11-26 19:02:10.843582] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] MDTS max_xfer_size 131072 00:15:54.026 [2024-11-26 19:02:10.843586] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] CNTLID 0x0001 00:15:54.026 [2024-11-26 19:02:10.843590] nvme_ctrlr.c:1990:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Identify CNTLID 0x0001 != Connect CNTLID 0x0000 00:15:54.026 [2024-11-26 19:02:10.843595] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] transport max_sges 1 00:15:54.026 [2024-11-26 19:02:10.843599] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] fuses compare and write: 1 00:15:54.026 [2024-11-26 19:02:10.843603] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to configure AER (timeout 30000 ms) 00:15:54.026 [2024-11-26 19:02:10.843612] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for configure aer (timeout 30000 ms) 00:15:54.026 [2024-11-26 19:02:10.843620] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:191 cdw10:0000000b PRP1 0x0 PRP2 0x0 00:15:54.026 [2024-11-26 19:02:10.843635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0002 p:1 m:0 dnr:0 00:15:54.026 [2024-11-26 19:02:10.843646] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:190 nsid:0 cdw10:00000000 cdw11:00000000 00:15:54.026 [2024-11-26 19:02:10.843655] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:189 nsid:0 cdw10:00000000 cdw11:00000000 00:15:54.026 [2024-11-26 19:02:10.843664] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:188 nsid:0 cdw10:00000000 cdw11:00000000 00:15:54.026 [2024-11-26 19:02:10.843671] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:187 nsid:0 cdw10:00000000 cdw11:00000000 00:15:54.026 [2024-11-26 19:02:10.843676] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set keep alive timeout (timeout 30000 ms) 00:15:54.026 [2024-11-26 19:02:10.843685] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:15:54.026 [2024-11-26 19:02:10.843693] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:191 cdw10:0000000f PRP1 0x0 PRP2 0x0 00:15:54.026 [2024-11-26 19:02:10.843708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0007 p:1 m:0 dnr:0 00:15:54.026 [2024-11-26 19:02:10.843713] nvme_ctrlr.c:2878:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Controller adjusted keep alive timeout to 0 ms 00:15:54.026 [2024-11-26 19:02:10.843717] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify controller iocs specific (timeout 30000 ms) 00:15:54.026 [2024-11-26 19:02:10.843723] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set number of queues (timeout 30000 ms) 00:15:54.026 [2024-11-26 19:02:10.843730] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for set number of queues (timeout 30000 ms) 00:15:54.026 [2024-11-26 19:02:10.843738] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:15:54.026 [2024-11-26 19:02:10.843749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:0008 p:1 m:0 dnr:0 00:15:54.026 [2024-11-26 19:02:10.843798] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify active ns (timeout 30000 ms) 00:15:54.026 [2024-11-26 19:02:10.843804] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify active ns (timeout 30000 ms) 00:15:54.026 [2024-11-26 19:02:10.843811] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f9000 len:4096 00:15:54.026 [2024-11-26 19:02:10.843815] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f9000 00:15:54.026 [2024-11-26 19:02:10.843820] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000002 cdw11:00000000 PRP1 0x2000002f9000 PRP2 0x0 00:15:54.026 [2024-11-26 19:02:10.843835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0009 p:1 m:0 dnr:0 00:15:54.026 [2024-11-26 19:02:10.843848] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Namespace 1 was added 00:15:54.026 [2024-11-26 19:02:10.843856] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify ns (timeout 30000 ms) 00:15:54.026 [2024-11-26 19:02:10.843863] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify ns (timeout 30000 ms) 00:15:54.026 [2024-11-26 19:02:10.843869] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:54.026 [2024-11-26 19:02:10.843873] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:54.026 [2024-11-26 19:02:10.843879] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000000 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:54.026 [2024-11-26 19:02:10.843894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000a p:1 m:0 dnr:0 00:15:54.026 [2024-11-26 19:02:10.843907] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:15:54.026 [2024-11-26 19:02:10.843914] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:15:54.026 [2024-11-26 19:02:10.843920] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:54.026 [2024-11-26 19:02:10.843924] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:54.026 [2024-11-26 19:02:10.843929] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:54.026 [2024-11-26 19:02:10.843939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000b p:1 m:0 dnr:0 00:15:54.026 [2024-11-26 19:02:10.843946] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify ns iocs specific (timeout 30000 ms) 00:15:54.026 [2024-11-26 19:02:10.843957] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set supported log pages (timeout 30000 ms) 00:15:54.026 [2024-11-26 19:02:10.843964] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set supported features (timeout 30000 ms) 00:15:54.026 [2024-11-26 19:02:10.843969] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set doorbell buffer config (timeout 30000 ms) 00:15:54.026 [2024-11-26 19:02:10.843973] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set host ID (timeout 30000 ms) 00:15:54.026 [2024-11-26 19:02:10.843978] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] NVMe-oF transport - not sending Set Features - Host ID 00:15:54.026 [2024-11-26 19:02:10.843982] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to transport ready (timeout 30000 ms) 00:15:54.026 [2024-11-26 19:02:10.843986] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to ready (no timeout) 00:15:54.026 [2024-11-26 19:02:10.844002] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:191 cdw10:00000001 PRP1 0x0 PRP2 0x0 00:15:54.026 [2024-11-26 19:02:10.844015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000c p:1 m:0 dnr:0 00:15:54.026 [2024-11-26 19:02:10.844025] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:191 cdw10:00000002 PRP1 0x0 PRP2 0x0 00:15:54.026 [2024-11-26 19:02:10.844036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000d p:1 m:0 dnr:0 00:15:54.026 [2024-11-26 19:02:10.844045] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:191 cdw10:00000004 PRP1 0x0 PRP2 0x0 00:15:54.026 [2024-11-26 19:02:10.844054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000e p:1 m:0 dnr:0 00:15:54.026 [2024-11-26 19:02:10.844063] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:15:54.026 [2024-11-26 19:02:10.844074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:000f p:1 m:0 dnr:0 00:15:54.026 [2024-11-26 19:02:10.844083] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f6000 len:8192 00:15:54.026 [2024-11-26 19:02:10.844088] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f6000 00:15:54.026 [2024-11-26 19:02:10.844091] nvme_pcie_common.c:1235:nvme_pcie_prp_list_append: *DEBUG*: prp[0] = 0x2000002f7000 00:15:54.026 [2024-11-26 19:02:10.844094] nvme_pcie_common.c:1251:nvme_pcie_prp_list_append: *DEBUG*: prp2 = 0x2000002f7000 00:15:54.026 [2024-11-26 19:02:10.844099] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:191 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 PRP1 0x2000002f6000 PRP2 0x2000002f7000 00:15:54.026 [2024-11-26 19:02:10.844108] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fc000 len:512 00:15:54.026 [2024-11-26 19:02:10.844112] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fc000 00:15:54.026 [2024-11-26 19:02:10.844117] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:186 nsid:ffffffff cdw10:007f0002 cdw11:00000000 PRP1 0x2000002fc000 PRP2 0x0 00:15:54.026 [2024-11-26 19:02:10.844123] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:512 00:15:54.026 [2024-11-26 19:02:10.844127] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:54.026 [2024-11-26 19:02:10.844132] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:185 nsid:ffffffff cdw10:007f0003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:54.026 [2024-11-26 19:02:10.844139] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f4000 len:4096 00:15:54.026 [2024-11-26 19:02:10.844143] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f4000 00:15:54.026 [2024-11-26 19:02:10.844148] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:184 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 PRP1 0x2000002f4000 PRP2 0x0 00:15:54.026 [2024-11-26 19:02:10.844155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0010 p:1 m:0 dnr:0 00:15:54.026 [2024-11-26 19:02:10.844167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:186 cdw0:0 sqhd:0011 p:1 m:0 dnr:0 00:15:54.026 [2024-11-26 19:02:10.844175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:185 cdw0:0 sqhd:0012 p:1 m:0 dnr:0 00:15:54.026 [2024-11-26 19:02:10.844182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0013 p:1 m:0 dnr:0 00:15:54.026 ===================================================== 00:15:54.026 NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:54.026 ===================================================== 00:15:54.026 Controller Capabilities/Features 00:15:54.026 ================================ 00:15:54.026 Vendor ID: 4e58 00:15:54.026 Subsystem Vendor ID: 4e58 00:15:54.026 Serial Number: SPDK1 00:15:54.026 Model Number: SPDK bdev Controller 00:15:54.026 Firmware Version: 24.01.1 00:15:54.026 Recommended Arb Burst: 6 00:15:54.026 IEEE OUI Identifier: 8d 6b 50 00:15:54.026 Multi-path I/O 00:15:54.026 May have multiple subsystem ports: Yes 00:15:54.026 May have multiple controllers: Yes 00:15:54.026 Associated with SR-IOV VF: No 00:15:54.026 Max Data Transfer Size: 131072 00:15:54.026 Max Number of Namespaces: 32 00:15:54.026 Max Number of I/O Queues: 127 00:15:54.026 NVMe Specification Version (VS): 1.3 00:15:54.026 NVMe Specification Version (Identify): 1.3 00:15:54.026 Maximum Queue Entries: 256 00:15:54.026 Contiguous Queues Required: Yes 00:15:54.026 Arbitration Mechanisms Supported 00:15:54.026 Weighted Round Robin: Not Supported 00:15:54.026 Vendor Specific: Not Supported 00:15:54.026 Reset Timeout: 15000 ms 00:15:54.026 Doorbell Stride: 4 bytes 00:15:54.026 NVM Subsystem Reset: Not Supported 00:15:54.026 Command Sets Supported 00:15:54.026 NVM Command Set: Supported 00:15:54.026 Boot Partition: Not Supported 00:15:54.026 Memory Page Size Minimum: 4096 bytes 00:15:54.026 Memory Page Size Maximum: 4096 bytes 00:15:54.026 Persistent Memory Region: Not Supported 00:15:54.026 Optional Asynchronous Events Supported 00:15:54.026 Namespace Attribute Notices: Supported 00:15:54.026 Firmware Activation Notices: Not Supported 00:15:54.026 ANA Change Notices: Not Supported 00:15:54.026 PLE Aggregate Log Change Notices: Not Supported 00:15:54.026 LBA Status Info Alert Notices: Not Supported 00:15:54.026 EGE Aggregate Log Change Notices: Not Supported 00:15:54.026 Normal NVM Subsystem Shutdown event: Not Supported 00:15:54.026 Zone Descriptor Change Notices: Not Supported 00:15:54.026 Discovery Log Change Notices: Not Supported 00:15:54.026 Controller Attributes 00:15:54.026 128-bit Host Identifier: Supported 00:15:54.026 Non-Operational Permissive Mode: Not Supported 00:15:54.026 NVM Sets: Not Supported 00:15:54.026 Read Recovery Levels: Not Supported 00:15:54.026 Endurance Groups: Not Supported 00:15:54.026 Predictable Latency Mode: Not Supported 00:15:54.026 Traffic Based Keep ALive: Not Supported 00:15:54.026 Namespace Granularity: Not Supported 00:15:54.026 SQ Associations: Not Supported 00:15:54.026 UUID List: Not Supported 00:15:54.026 Multi-Domain Subsystem: Not Supported 00:15:54.026 Fixed Capacity Management: Not Supported 00:15:54.026 Variable Capacity Management: Not Supported 00:15:54.026 Delete Endurance Group: Not Supported 00:15:54.026 Delete NVM Set: Not Supported 00:15:54.026 Extended LBA Formats Supported: Not Supported 00:15:54.026 Flexible Data Placement Supported: Not Supported 00:15:54.026 00:15:54.026 Controller Memory Buffer Support 00:15:54.026 ================================ 00:15:54.026 Supported: No 00:15:54.026 00:15:54.026 Persistent Memory Region Support 00:15:54.026 ================================ 00:15:54.026 Supported: No 00:15:54.026 00:15:54.026 Admin Command Set Attributes 00:15:54.026 ============================ 00:15:54.026 Security Send/Receive: Not Supported 00:15:54.026 Format NVM: Not Supported 00:15:54.026 Firmware Activate/Download: Not Supported 00:15:54.026 Namespace Management: Not Supported 00:15:54.026 Device Self-Test: Not Supported 00:15:54.026 Directives: Not Supported 00:15:54.026 NVMe-MI: Not Supported 00:15:54.026 Virtualization Management: Not Supported 00:15:54.026 Doorbell Buffer Config: Not Supported 00:15:54.026 Get LBA Status Capability: Not Supported 00:15:54.026 Command & Feature Lockdown Capability: Not Supported 00:15:54.026 Abort Command Limit: 4 00:15:54.026 Async Event Request Limit: 4 00:15:54.026 Number of Firmware Slots: N/A 00:15:54.026 Firmware Slot 1 Read-Only: N/A 00:15:54.026 Firmware Activation Without Reset: N/A 00:15:54.026 Multiple Update Detection Support: N/A 00:15:54.026 Firmware Update Granularity: No Information Provided 00:15:54.026 Per-Namespace SMART Log: No 00:15:54.026 Asymmetric Namespace Access Log Page: Not Supported 00:15:54.026 Subsystem NQN: nqn.2019-07.io.spdk:cnode1 00:15:54.026 Command Effects Log Page: Supported 00:15:54.026 Get Log Page Extended Data: Supported 00:15:54.026 Telemetry Log Pages: Not Supported 00:15:54.026 Persistent Event Log Pages: Not Supported 00:15:54.026 Supported Log Pages Log Page: May Support 00:15:54.026 Commands Supported & Effects Log Page: Not Supported 00:15:54.026 Feature Identifiers & Effects Log Page:May Support 00:15:54.026 NVMe-MI Commands & Effects Log Page: May Support 00:15:54.026 Data Area 4 for Telemetry Log: Not Supported 00:15:54.026 Error Log Page Entries Supported: 128 00:15:54.026 Keep Alive: Supported 00:15:54.026 Keep Alive Granularity: 10000 ms 00:15:54.026 00:15:54.026 NVM Command Set Attributes 00:15:54.026 ========================== 00:15:54.026 Submission Queue Entry Size 00:15:54.026 Max: 64 00:15:54.026 Min: 64 00:15:54.026 Completion Queue Entry Size 00:15:54.026 Max: 16 00:15:54.026 Min: 16 00:15:54.026 Number of Namespaces: 32 00:15:54.026 Compare Command: Supported 00:15:54.026 Write Uncorrectable Command: Not Supported 00:15:54.026 Dataset Management Command: Supported 00:15:54.026 Write Zeroes Command: Supported 00:15:54.026 Set Features Save Field: Not Supported 00:15:54.026 Reservations: Not Supported 00:15:54.026 Timestamp: Not Supported 00:15:54.026 Copy: Supported 00:15:54.026 Volatile Write Cache: Present 00:15:54.026 Atomic Write Unit (Normal): 1 00:15:54.026 Atomic Write Unit (PFail): 1 00:15:54.026 Atomic Compare & Write Unit: 1 00:15:54.026 Fused Compare & Write: Supported 00:15:54.026 Scatter-Gather List 00:15:54.026 SGL Command Set: Supported (Dword aligned) 00:15:54.026 SGL Keyed: Not Supported 00:15:54.026 SGL Bit Bucket Descriptor: Not Supported 00:15:54.026 SGL Metadata Pointer: Not Supported 00:15:54.026 Oversized SGL: Not Supported 00:15:54.026 SGL Metadata Address: Not Supported 00:15:54.026 SGL Offset: Not Supported 00:15:54.026 Transport SGL Data Block: Not Supported 00:15:54.026 Replay Protected Memory Block: Not Supported 00:15:54.026 00:15:54.026 Firmware Slot Information 00:15:54.026 ========================= 00:15:54.026 Active slot: 1 00:15:54.026 Slot 1 Firmware Revision: 24.01.1 00:15:54.026 00:15:54.026 00:15:54.026 Commands Supported and Effects 00:15:54.026 ============================== 00:15:54.026 Admin Commands 00:15:54.026 -------------- 00:15:54.026 Get Log Page (02h): Supported 00:15:54.026 Identify (06h): Supported 00:15:54.026 Abort (08h): Supported 00:15:54.026 Set Features (09h): Supported 00:15:54.026 Get Features (0Ah): Supported 00:15:54.026 Asynchronous Event Request (0Ch): Supported 00:15:54.026 Keep Alive (18h): Supported 00:15:54.026 I/O Commands 00:15:54.026 ------------ 00:15:54.026 Flush (00h): Supported LBA-Change 00:15:54.026 Write (01h): Supported LBA-Change 00:15:54.026 Read (02h): Supported 00:15:54.026 Compare (05h): Supported 00:15:54.026 Write Zeroes (08h): Supported LBA-Change 00:15:54.026 Dataset Management (09h): Supported LBA-Change 00:15:54.026 Copy (19h): Supported LBA-Change 00:15:54.027 Unknown (79h): Supported LBA-Change 00:15:54.027 Unknown (7Ah): Supported 00:15:54.027 00:15:54.027 Error Log 00:15:54.027 ========= 00:15:54.027 00:15:54.027 Arbitration 00:15:54.027 =========== 00:15:54.027 Arbitration Burst: 1 00:15:54.027 00:15:54.027 Power Management 00:15:54.027 ================ 00:15:54.027 Number of Power States: 1 00:15:54.027 Current Power State: Power State #0 00:15:54.027 Power State #0: 00:15:54.027 Max Power: 0.00 W 00:15:54.027 Non-Operational State: Operational 00:15:54.027 Entry Latency: Not Reported 00:15:54.027 Exit Latency: Not Reported 00:15:54.027 Relative Read Throughput: 0 00:15:54.027 Relative Read Latency: 0 00:15:54.027 Relative Write Throughput: 0 00:15:54.027 Relative Write Latency: 0 00:15:54.027 Idle Power: Not Reported 00:15:54.027 Active Power: Not Reported 00:15:54.027 Non-Operational Permissive Mode: Not Supported 00:15:54.027 00:15:54.027 Health Information 00:15:54.027 ================== 00:15:54.027 Critical Warnings: 00:15:54.027 Available Spare Space: OK 00:15:54.027 Temperature: OK 00:15:54.027 Device Reliability: OK 00:15:54.027 Read Only: No 00:15:54.027 Volatile Memory Backup: OK 00:15:54.027 Current Temperature: 0 Kelvin[2024-11-26 19:02:10.844279] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:184 cdw10:00000005 PRP1 0x0 PRP2 0x0 00:15:54.027 [2024-11-26 19:02:10.844287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0014 p:1 m:0 dnr:0 00:15:54.027 [2024-11-26 19:02:10.844311] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Prepare to destruct SSD 00:15:54.027 [2024-11-26 19:02:10.844319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:190 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:54.027 [2024-11-26 19:02:10.844325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:189 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:54.027 [2024-11-26 19:02:10.844330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:188 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:54.027 [2024-11-26 19:02:10.844336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:187 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:54.027 [2024-11-26 19:02:10.844464] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x460001 00:15:54.027 [2024-11-26 19:02:10.844472] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x464001 00:15:54.027 [2024-11-26 19:02:10.845499] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] RTD3E = 0 us 00:15:54.027 [2024-11-26 19:02:10.845505] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] shutdown timeout = 10000 ms 00:15:54.027 [2024-11-26 19:02:10.846476] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x1c, value 0x9 00:15:54.027 [2024-11-26 19:02:10.846487] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] shutdown complete in 0 milliseconds 00:15:54.027 [2024-11-26 19:02:10.846535] vfio_user_pci.c: 399:spdk_vfio_user_release: *DEBUG*: Release file /var/run/vfio-user/domain/vfio-user1/1/cntrl 00:15:54.027 [2024-11-26 19:02:10.848512] vfio_user_pci.c: 96:vfio_remove_mr: *DEBUG*: Remove memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:15:54.027 (-273 Celsius) 00:15:54.027 Temperature Threshold: 0 Kelvin (-273 Celsius) 00:15:54.027 Available Spare: 0% 00:15:54.027 Available Spare Threshold: 0% 00:15:54.027 Life Percentage Used: 0% 00:15:54.027 Data Units Read: 0 00:15:54.027 Data Units Written: 0 00:15:54.027 Host Read Commands: 0 00:15:54.027 Host Write Commands: 0 00:15:54.027 Controller Busy Time: 0 minutes 00:15:54.027 Power Cycles: 0 00:15:54.027 Power On Hours: 0 hours 00:15:54.027 Unsafe Shutdowns: 0 00:15:54.027 Unrecoverable Media Errors: 0 00:15:54.027 Lifetime Error Log Entries: 0 00:15:54.027 Warning Temperature Time: 0 minutes 00:15:54.027 Critical Temperature Time: 0 minutes 00:15:54.027 00:15:54.027 Number of Queues 00:15:54.027 ================ 00:15:54.027 Number of I/O Submission Queues: 127 00:15:54.027 Number of I/O Completion Queues: 127 00:15:54.027 00:15:54.027 Active Namespaces 00:15:54.027 ================= 00:15:54.027 Namespace ID:1 00:15:54.027 Error Recovery Timeout: Unlimited 00:15:54.027 Command Set Identifier: NVM (00h) 00:15:54.027 Deallocate: Supported 00:15:54.027 Deallocated/Unwritten Error: Not Supported 00:15:54.027 Deallocated Read Value: Unknown 00:15:54.027 Deallocate in Write Zeroes: Not Supported 00:15:54.027 Deallocated Guard Field: 0xFFFF 00:15:54.027 Flush: Supported 00:15:54.027 Reservation: Supported 00:15:54.027 Namespace Sharing Capabilities: Multiple Controllers 00:15:54.027 Size (in LBAs): 131072 (0GiB) 00:15:54.027 Capacity (in LBAs): 131072 (0GiB) 00:15:54.027 Utilization (in LBAs): 131072 (0GiB) 00:15:54.027 NGUID: 8C0F987611CF482395453FD1D7C7B14A 00:15:54.027 UUID: 8c0f9876-11cf-4823-9545-3fd1d7c7b14a 00:15:54.027 Thin Provisioning: Not Supported 00:15:54.027 Per-NS Atomic Units: Yes 00:15:54.027 Atomic Boundary Size (Normal): 0 00:15:54.027 Atomic Boundary Size (PFail): 0 00:15:54.027 Atomic Boundary Offset: 0 00:15:54.027 Maximum Single Source Range Length: 65535 00:15:54.027 Maximum Copy Length: 65535 00:15:54.027 Maximum Source Range Count: 1 00:15:54.027 NGUID/EUI64 Never Reused: No 00:15:54.027 Namespace Write Protected: No 00:15:54.027 Number of LBA Formats: 1 00:15:54.027 Current LBA Format: LBA Format #00 00:15:54.027 LBA Format #00: Data Size: 512 Metadata Size: 0 00:15:54.027 00:15:54.027 19:02:10 -- target/nvmf_vfio_user.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -s 256 -g -q 128 -o 4096 -w read -t 5 -c 0x2 00:15:54.027 EAL: No free 2048 kB hugepages reported on node 1 00:15:59.298 Initializing NVMe Controllers 00:15:59.298 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:59.298 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 with lcore 1 00:15:59.298 Initialization complete. Launching workers. 00:15:59.298 ======================================================== 00:15:59.298 Latency(us) 00:15:59.298 Device Information : IOPS MiB/s Average min max 00:15:59.298 VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 from core 1: 39941.00 156.02 3204.80 969.99 9480.90 00:15:59.298 ======================================================== 00:15:59.299 Total : 39941.00 156.02 3204.80 969.99 9480.90 00:15:59.299 00:15:59.299 19:02:16 -- target/nvmf_vfio_user.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -s 256 -g -q 128 -o 4096 -w write -t 5 -c 0x2 00:15:59.299 EAL: No free 2048 kB hugepages reported on node 1 00:16:04.567 Initializing NVMe Controllers 00:16:04.567 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:16:04.567 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 with lcore 1 00:16:04.567 Initialization complete. Launching workers. 00:16:04.567 ======================================================== 00:16:04.567 Latency(us) 00:16:04.567 Device Information : IOPS MiB/s Average min max 00:16:04.567 VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 from core 1: 16048.80 62.69 7985.75 4987.94 15961.56 00:16:04.567 ======================================================== 00:16:04.567 Total : 16048.80 62.69 7985.75 4987.94 15961.56 00:16:04.567 00:16:04.567 19:02:21 -- target/nvmf_vfio_user.sh@86 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -g -q 32 -o 4096 -w randrw -M 50 -t 5 -c 0xE 00:16:04.567 EAL: No free 2048 kB hugepages reported on node 1 00:16:09.838 Initializing NVMe Controllers 00:16:09.838 Attaching to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:16:09.838 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:16:09.838 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) with lcore 1 00:16:09.838 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) with lcore 2 00:16:09.838 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) with lcore 3 00:16:09.838 Initialization complete. Launching workers. 00:16:09.838 Starting thread on core 2 00:16:09.838 Starting thread on core 3 00:16:09.838 Starting thread on core 1 00:16:09.838 19:02:26 -- target/nvmf_vfio_user.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -t 3 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -d 256 -g 00:16:09.838 EAL: No free 2048 kB hugepages reported on node 1 00:16:13.130 Initializing NVMe Controllers 00:16:13.130 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:16:13.130 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:16:13.130 Associating SPDK bdev Controller (SPDK1 ) with lcore 0 00:16:13.130 Associating SPDK bdev Controller (SPDK1 ) with lcore 1 00:16:13.130 Associating SPDK bdev Controller (SPDK1 ) with lcore 2 00:16:13.130 Associating SPDK bdev Controller (SPDK1 ) with lcore 3 00:16:13.130 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration run with configuration: 00:16:13.130 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -q 64 -s 131072 -w randrw -M 50 -l 0 -t 3 -c 0xf -m 0 -a 0 -b 0 -n 100000 -i -1 00:16:13.130 Initialization complete. Launching workers. 00:16:13.130 Starting thread on core 1 with urgent priority queue 00:16:13.130 Starting thread on core 2 with urgent priority queue 00:16:13.130 Starting thread on core 3 with urgent priority queue 00:16:13.130 Starting thread on core 0 with urgent priority queue 00:16:13.130 SPDK bdev Controller (SPDK1 ) core 0: 7461.67 IO/s 13.40 secs/100000 ios 00:16:13.130 SPDK bdev Controller (SPDK1 ) core 1: 6584.33 IO/s 15.19 secs/100000 ios 00:16:13.130 SPDK bdev Controller (SPDK1 ) core 2: 6924.67 IO/s 14.44 secs/100000 ios 00:16:13.130 SPDK bdev Controller (SPDK1 ) core 3: 9208.67 IO/s 10.86 secs/100000 ios 00:16:13.130 ======================================================== 00:16:13.130 00:16:13.130 19:02:30 -- target/nvmf_vfio_user.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/hello_world -d 256 -g -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' 00:16:13.389 EAL: No free 2048 kB hugepages reported on node 1 00:16:13.648 Initializing NVMe Controllers 00:16:13.648 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:16:13.648 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:16:13.648 Namespace ID: 1 size: 0GB 00:16:13.648 Initialization complete. 00:16:13.648 INFO: using host memory buffer for IO 00:16:13.648 Hello world! 00:16:13.648 19:02:30 -- target/nvmf_vfio_user.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/overhead/overhead -o 4096 -t 1 -H -g -d 256 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' 00:16:13.648 EAL: No free 2048 kB hugepages reported on node 1 00:16:15.026 Initializing NVMe Controllers 00:16:15.026 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:16:15.026 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:16:15.026 Initialization complete. Launching workers. 00:16:15.026 submit (in ns) avg, min, max = 6813.9, 3191.3, 3999456.5 00:16:15.026 complete (in ns) avg, min, max = 21798.3, 1760.0, 4996293.9 00:16:15.026 00:16:15.026 Submit histogram 00:16:15.026 ================ 00:16:15.026 Range in us Cumulative Count 00:16:15.026 3.186 - 3.200: 0.0061% ( 1) 00:16:15.026 3.200 - 3.214: 0.0182% ( 2) 00:16:15.026 3.214 - 3.228: 0.1332% ( 19) 00:16:15.026 3.228 - 3.242: 0.7509% ( 102) 00:16:15.026 3.242 - 3.256: 1.7076% ( 158) 00:16:15.026 3.256 - 3.270: 3.0943% ( 229) 00:16:15.026 3.270 - 3.283: 5.8132% ( 449) 00:16:15.026 3.283 - 3.297: 9.7554% ( 651) 00:16:15.026 3.297 - 3.311: 15.2416% ( 906) 00:16:15.026 3.311 - 3.325: 20.7400% ( 908) 00:16:15.026 3.325 - 3.339: 26.8742% ( 1013) 00:16:15.026 3.339 - 3.353: 32.6753% ( 958) 00:16:15.026 3.353 - 3.367: 37.6590% ( 823) 00:16:15.026 3.367 - 3.381: 42.6366% ( 822) 00:16:15.026 3.381 - 3.395: 47.9169% ( 872) 00:16:15.026 3.395 - 3.409: 52.6160% ( 776) 00:16:15.026 3.409 - 3.423: 57.1455% ( 748) 00:16:15.026 3.423 - 3.437: 63.3281% ( 1021) 00:16:15.026 3.437 - 3.450: 68.2633% ( 815) 00:16:15.026 3.450 - 3.464: 72.5385% ( 706) 00:16:15.026 3.464 - 3.478: 76.8197% ( 707) 00:16:15.026 3.478 - 3.492: 80.4287% ( 596) 00:16:15.026 3.492 - 3.506: 83.0689% ( 436) 00:16:15.026 3.506 - 3.520: 84.8795% ( 299) 00:16:15.026 3.520 - 3.534: 86.2541% ( 227) 00:16:15.026 3.534 - 3.548: 87.0595% ( 133) 00:16:15.026 3.548 - 3.562: 87.6711% ( 101) 00:16:15.026 3.562 - 3.590: 88.9488% ( 211) 00:16:15.026 3.590 - 3.617: 90.5353% ( 262) 00:16:15.026 3.617 - 3.645: 92.2732% ( 287) 00:16:15.026 3.645 - 3.673: 94.1080% ( 303) 00:16:15.026 3.673 - 3.701: 95.9065% ( 297) 00:16:15.026 3.701 - 3.729: 97.2145% ( 216) 00:16:15.026 3.729 - 3.757: 98.2560% ( 172) 00:16:15.026 3.757 - 3.784: 98.8737% ( 102) 00:16:15.026 3.784 - 3.812: 99.3339% ( 76) 00:16:15.026 3.812 - 3.840: 99.5640% ( 38) 00:16:15.026 3.840 - 3.868: 99.6669% ( 17) 00:16:15.026 3.868 - 3.896: 99.7093% ( 7) 00:16:15.026 5.064 - 5.092: 99.7154% ( 1) 00:16:15.026 5.148 - 5.176: 99.7275% ( 2) 00:16:15.026 5.315 - 5.343: 99.7336% ( 1) 00:16:15.026 5.343 - 5.370: 99.7396% ( 1) 00:16:15.026 5.398 - 5.426: 99.7457% ( 1) 00:16:15.026 5.454 - 5.482: 99.7517% ( 1) 00:16:15.026 5.510 - 5.537: 99.7638% ( 2) 00:16:15.026 5.621 - 5.649: 99.7759% ( 2) 00:16:15.026 5.732 - 5.760: 99.7820% ( 1) 00:16:15.026 5.983 - 6.010: 99.7881% ( 1) 00:16:15.026 6.066 - 6.094: 99.7941% ( 1) 00:16:15.026 6.289 - 6.317: 99.8062% ( 2) 00:16:15.026 6.400 - 6.428: 99.8123% ( 1) 00:16:15.026 6.595 - 6.623: 99.8183% ( 1) 00:16:15.026 6.650 - 6.678: 99.8244% ( 1) 00:16:15.026 6.817 - 6.845: 99.8304% ( 1) 00:16:15.026 6.873 - 6.901: 99.8365% ( 1) 00:16:15.026 6.929 - 6.957: 99.8426% ( 1) 00:16:15.026 7.040 - 7.068: 99.8486% ( 1) 00:16:15.026 7.068 - 7.096: 99.8607% ( 2) 00:16:15.026 7.123 - 7.179: 99.8668% ( 1) 00:16:15.026 7.179 - 7.235: 99.8728% ( 1) 00:16:15.026 7.290 - 7.346: 99.8789% ( 1) 00:16:15.026 7.346 - 7.402: 99.8849% ( 1) 00:16:15.026 7.402 - 7.457: 99.8971% ( 2) 00:16:15.026 7.736 - 7.791: 99.9031% ( 1) 00:16:15.026 8.070 - 8.125: 99.9092% ( 1) 00:16:15.026 11.520 - 11.576: 99.9152% ( 1) 00:16:15.026 3989.148 - 4017.642: 100.0000% ( 14) 00:16:15.026 00:16:15.026 Complete histogram 00:16:15.026 ================== 00:16:15.027 Range in us Cumulative Count 00:16:15.027 1.760 - 1.767: 0.0182% ( 3) 00:16:15.027 1.767 - 1.774: 0.0727% ( 9) 00:16:15.027 1.774 - 1.781: 0.1151% ( 7) 00:16:15.027 1.781 - 1.795: 0.1756% ( 10) 00:16:15.027 1.795 - 1.809: 1.3806% ( 199) 00:16:15.027 1.809 - 1.823: 9.4647% ( 1335) 00:16:15.027 1.823 - 1.837: 16.7615% ( 1205) 00:16:15.027 1.837 - 1.850: 21.9753% ( 861) 00:16:15.027 1.850 - 1.864: 42.9212% ( 3459) 00:16:15.027 1.864 - 1.878: 73.4104% ( 5035) 00:16:15.027 1.878 - 1.892: 89.7541% ( 2699) 00:16:15.027 1.892 - 1.906: 96.8330% ( 1169) 00:16:15.027 1.906 - 1.920: 98.8192% ( 328) 00:16:15.027 1.920 - 1.934: 99.2310% ( 68) 00:16:15.027 1.934 - 1.948: 99.3036% ( 12) 00:16:15.027 1.948 - 1.962: 99.3339% ( 5) 00:16:15.027 1.976 - 1.990: 99.3400% ( 1) 00:16:15.027 2.031 - 2.045: 99.3460% ( 1) 00:16:15.027 2.059 - 2.073: 99.3521% ( 1) 00:16:15.027 3.617 - 3.645: 99.3581% ( 1) 00:16:15.027 3.673 - 3.701: 99.3642% ( 1) 00:16:15.027 3.701 - 3.729: 99.3702% ( 1) 00:16:15.027 3.784 - 3.812: 99.3763% ( 1) 00:16:15.027 3.896 - 3.923: 99.3823% ( 1) 00:16:15.027 4.174 - 4.202: 99.3884% ( 1) 00:16:15.027 4.202 - 4.230: 99.3945% ( 1) 00:16:15.027 4.230 - 4.257: 99.4005% ( 1) 00:16:15.027 4.369 - 4.397: 99.4066% ( 1) 00:16:15.027 4.508 - 4.536: 99.4126% ( 1) 00:16:15.027 4.619 - 4.647: 99.4187% ( 1) 00:16:15.027 4.758 - 4.786: 99.4308% ( 2) 00:16:15.027 4.814 - 4.842: 99.4368% ( 1) 00:16:15.027 5.593 - 5.621: 99.4429% ( 1) 00:16:15.027 6.511 - 6.539: 99.4490% ( 1) 00:16:15.027 6.539 - 6.567: 99.4550% ( 1) 00:16:15.027 6.678 - 6.706: 99.4611% ( 1) 00:16:15.027 12.188 - 12.243: 99.4671% ( 1) 00:16:15.027 12.243 - 12.299: 99.4732% ( 1) 00:16:15.027 13.134 - 13.190: 99.4792% ( 1) 00:16:15.027 13.357 - 13.412: 99.4853% ( 1) 00:16:15.027 39.624 - 39.847: 99.4913% ( 1) 00:16:15.027 145.141 - 146.031: 99.4974% ( 1) 00:16:15.027 3006.108 - 3020.355: 99.5035% ( 1) 00:16:15.027 3020.355 - 3034.602: 99.5095% ( 1) 00:16:15.027 3048.849 - 3063.096: 99.5156% ( 1) 00:16:15.027 3276.800 - 3291.047: 99.5216% ( 1) 00:16:15.027 3989.148 - 4017.642: 99.9939% ( 78) 00:16:15.027 4986.435 - 5014.929: 100.0000% ( 1) 00:16:15.027 00:16:15.027 19:02:31 -- target/nvmf_vfio_user.sh@90 -- # aer_vfio_user /var/run/vfio-user/domain/vfio-user1/1 nqn.2019-07.io.spdk:cnode1 1 00:16:15.027 19:02:31 -- target/nvmf_vfio_user.sh@22 -- # local traddr=/var/run/vfio-user/domain/vfio-user1/1 00:16:15.027 19:02:31 -- target/nvmf_vfio_user.sh@23 -- # local subnqn=nqn.2019-07.io.spdk:cnode1 00:16:15.027 19:02:31 -- target/nvmf_vfio_user.sh@24 -- # local malloc_num=Malloc3 00:16:15.027 19:02:31 -- target/nvmf_vfio_user.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:16:15.027 [2024-11-26 19:02:31.776692] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:16:15.027 [ 00:16:15.027 { 00:16:15.027 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:16:15.027 "subtype": "Discovery", 00:16:15.027 "listen_addresses": [], 00:16:15.027 "allow_any_host": true, 00:16:15.027 "hosts": [] 00:16:15.027 }, 00:16:15.027 { 00:16:15.027 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:16:15.027 "subtype": "NVMe", 00:16:15.027 "listen_addresses": [ 00:16:15.027 { 00:16:15.027 "transport": "VFIOUSER", 00:16:15.027 "trtype": "VFIOUSER", 00:16:15.027 "adrfam": "IPv4", 00:16:15.027 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:16:15.027 "trsvcid": "0" 00:16:15.027 } 00:16:15.027 ], 00:16:15.027 "allow_any_host": true, 00:16:15.027 "hosts": [], 00:16:15.027 "serial_number": "SPDK1", 00:16:15.027 "model_number": "SPDK bdev Controller", 00:16:15.027 "max_namespaces": 32, 00:16:15.027 "min_cntlid": 1, 00:16:15.027 "max_cntlid": 65519, 00:16:15.027 "namespaces": [ 00:16:15.027 { 00:16:15.027 "nsid": 1, 00:16:15.027 "bdev_name": "Malloc1", 00:16:15.027 "name": "Malloc1", 00:16:15.027 "nguid": "8C0F987611CF482395453FD1D7C7B14A", 00:16:15.027 "uuid": "8c0f9876-11cf-4823-9545-3fd1d7c7b14a" 00:16:15.027 } 00:16:15.027 ] 00:16:15.027 }, 00:16:15.027 { 00:16:15.027 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:16:15.027 "subtype": "NVMe", 00:16:15.027 "listen_addresses": [ 00:16:15.027 { 00:16:15.027 "transport": "VFIOUSER", 00:16:15.027 "trtype": "VFIOUSER", 00:16:15.027 "adrfam": "IPv4", 00:16:15.027 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:16:15.027 "trsvcid": "0" 00:16:15.027 } 00:16:15.027 ], 00:16:15.027 "allow_any_host": true, 00:16:15.027 "hosts": [], 00:16:15.027 "serial_number": "SPDK2", 00:16:15.027 "model_number": "SPDK bdev Controller", 00:16:15.027 "max_namespaces": 32, 00:16:15.027 "min_cntlid": 1, 00:16:15.027 "max_cntlid": 65519, 00:16:15.027 "namespaces": [ 00:16:15.027 { 00:16:15.027 "nsid": 1, 00:16:15.027 "bdev_name": "Malloc2", 00:16:15.027 "name": "Malloc2", 00:16:15.027 "nguid": "7BB1668B88D84102811EAA64D8EC3F5D", 00:16:15.027 "uuid": "7bb1668b-88d8-4102-811e-aa64d8ec3f5d" 00:16:15.027 } 00:16:15.027 ] 00:16:15.027 } 00:16:15.027 ] 00:16:15.027 19:02:31 -- target/nvmf_vfio_user.sh@27 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:16:15.027 19:02:31 -- target/nvmf_vfio_user.sh@34 -- # aerpid=3067034 00:16:15.027 19:02:31 -- target/nvmf_vfio_user.sh@37 -- # waitforfile /tmp/aer_touch_file 00:16:15.027 19:02:31 -- target/nvmf_vfio_user.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -n 2 -g -t /tmp/aer_touch_file 00:16:15.027 19:02:31 -- common/autotest_common.sh@1254 -- # local i=0 00:16:15.027 19:02:31 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:16:15.027 19:02:31 -- common/autotest_common.sh@1261 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:16:15.027 19:02:31 -- common/autotest_common.sh@1265 -- # return 0 00:16:15.027 19:02:31 -- target/nvmf_vfio_user.sh@38 -- # rm -f /tmp/aer_touch_file 00:16:15.027 19:02:31 -- target/nvmf_vfio_user.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 --name Malloc3 00:16:15.027 EAL: No free 2048 kB hugepages reported on node 1 00:16:15.286 Malloc3 00:16:15.286 19:02:32 -- target/nvmf_vfio_user.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode1 Malloc3 -n 2 00:16:15.286 19:02:32 -- target/nvmf_vfio_user.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:16:15.545 Asynchronous Event Request test 00:16:15.545 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:16:15.545 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:16:15.545 Registering asynchronous event callbacks... 00:16:15.545 Starting namespace attribute notice tests for all controllers... 00:16:15.545 /var/run/vfio-user/domain/vfio-user1/1: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:16:15.545 aer_cb - Changed Namespace 00:16:15.545 Cleaning up... 00:16:15.545 [ 00:16:15.545 { 00:16:15.545 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:16:15.545 "subtype": "Discovery", 00:16:15.545 "listen_addresses": [], 00:16:15.545 "allow_any_host": true, 00:16:15.545 "hosts": [] 00:16:15.545 }, 00:16:15.545 { 00:16:15.545 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:16:15.545 "subtype": "NVMe", 00:16:15.545 "listen_addresses": [ 00:16:15.545 { 00:16:15.545 "transport": "VFIOUSER", 00:16:15.545 "trtype": "VFIOUSER", 00:16:15.545 "adrfam": "IPv4", 00:16:15.545 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:16:15.545 "trsvcid": "0" 00:16:15.545 } 00:16:15.545 ], 00:16:15.545 "allow_any_host": true, 00:16:15.545 "hosts": [], 00:16:15.545 "serial_number": "SPDK1", 00:16:15.545 "model_number": "SPDK bdev Controller", 00:16:15.545 "max_namespaces": 32, 00:16:15.545 "min_cntlid": 1, 00:16:15.545 "max_cntlid": 65519, 00:16:15.546 "namespaces": [ 00:16:15.546 { 00:16:15.546 "nsid": 1, 00:16:15.546 "bdev_name": "Malloc1", 00:16:15.546 "name": "Malloc1", 00:16:15.546 "nguid": "8C0F987611CF482395453FD1D7C7B14A", 00:16:15.546 "uuid": "8c0f9876-11cf-4823-9545-3fd1d7c7b14a" 00:16:15.546 }, 00:16:15.546 { 00:16:15.546 "nsid": 2, 00:16:15.546 "bdev_name": "Malloc3", 00:16:15.546 "name": "Malloc3", 00:16:15.546 "nguid": "F27C2B41A8A54416B10F4AC113F01A29", 00:16:15.546 "uuid": "f27c2b41-a8a5-4416-b10f-4ac113f01a29" 00:16:15.546 } 00:16:15.546 ] 00:16:15.546 }, 00:16:15.546 { 00:16:15.546 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:16:15.546 "subtype": "NVMe", 00:16:15.546 "listen_addresses": [ 00:16:15.546 { 00:16:15.546 "transport": "VFIOUSER", 00:16:15.546 "trtype": "VFIOUSER", 00:16:15.546 "adrfam": "IPv4", 00:16:15.546 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:16:15.546 "trsvcid": "0" 00:16:15.546 } 00:16:15.546 ], 00:16:15.546 "allow_any_host": true, 00:16:15.546 "hosts": [], 00:16:15.546 "serial_number": "SPDK2", 00:16:15.546 "model_number": "SPDK bdev Controller", 00:16:15.546 "max_namespaces": 32, 00:16:15.546 "min_cntlid": 1, 00:16:15.546 "max_cntlid": 65519, 00:16:15.546 "namespaces": [ 00:16:15.546 { 00:16:15.546 "nsid": 1, 00:16:15.546 "bdev_name": "Malloc2", 00:16:15.546 "name": "Malloc2", 00:16:15.546 "nguid": "7BB1668B88D84102811EAA64D8EC3F5D", 00:16:15.546 "uuid": "7bb1668b-88d8-4102-811e-aa64d8ec3f5d" 00:16:15.546 } 00:16:15.546 ] 00:16:15.546 } 00:16:15.546 ] 00:16:15.546 19:02:32 -- target/nvmf_vfio_user.sh@44 -- # wait 3067034 00:16:15.546 19:02:32 -- target/nvmf_vfio_user.sh@80 -- # for i in $(seq 1 $NUM_DEVICES) 00:16:15.546 19:02:32 -- target/nvmf_vfio_user.sh@81 -- # test_traddr=/var/run/vfio-user/domain/vfio-user2/2 00:16:15.546 19:02:32 -- target/nvmf_vfio_user.sh@82 -- # test_subnqn=nqn.2019-07.io.spdk:cnode2 00:16:15.546 19:02:32 -- target/nvmf_vfio_user.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -g -L nvme -L nvme_vfio -L vfio_pci 00:16:15.546 [2024-11-26 19:02:32.422930] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:16:15.546 [2024-11-26 19:02:32.422984] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --single-file-segments --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3067264 ] 00:16:15.546 EAL: No free 2048 kB hugepages reported on node 1 00:16:15.546 [2024-11-26 19:02:32.453174] nvme_vfio_user.c: 259:nvme_vfio_ctrlr_scan: *DEBUG*: Scan controller : /var/run/vfio-user/domain/vfio-user2/2 00:16:15.546 [2024-11-26 19:02:32.455381] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 0, Size 0x2000, Offset 0x0, Flags 0xf, Cap offset 32 00:16:15.546 [2024-11-26 19:02:32.455401] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0x1000, Offset 0x1000, Map addr 0x7f22866f9000 00:16:15.546 [2024-11-26 19:02:32.456383] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 1, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:16:15.546 [2024-11-26 19:02:32.457393] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 2, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:16:15.546 [2024-11-26 19:02:32.458401] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 3, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:16:15.546 [2024-11-26 19:02:32.459414] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 4, Size 0x2000, Offset 0x0, Flags 0x3, Cap offset 0 00:16:15.546 [2024-11-26 19:02:32.460423] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 5, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:16:15.546 [2024-11-26 19:02:32.461430] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 6, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:16:15.546 [2024-11-26 19:02:32.462444] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 7, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:16:15.546 [2024-11-26 19:02:32.463452] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 8, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:16:15.546 [2024-11-26 19:02:32.464456] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 9, Size 0xc000, Offset 0x0, Flags 0xf, Cap offset 32 00:16:15.546 [2024-11-26 19:02:32.464466] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0xb000, Offset 0x1000, Map addr 0x7f2285404000 00:16:15.546 [2024-11-26 19:02:32.465517] vfio_user_pci.c: 65:vfio_add_mr: *DEBUG*: Add memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:16:15.807 [2024-11-26 19:02:32.478786] vfio_user_pci.c: 386:spdk_vfio_user_setup: *DEBUG*: Device vfio-user0, Path /var/run/vfio-user/domain/vfio-user2/2/cntrl Setup Successfully 00:16:15.807 [2024-11-26 19:02:32.478805] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to connect adminq (no timeout) 00:16:15.807 [2024-11-26 19:02:32.483892] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x0, value 0x201e0100ff 00:16:15.807 [2024-11-26 19:02:32.483926] nvme_pcie_common.c: 132:nvme_pcie_qpair_construct: *INFO*: max_completions_cap = 64 num_trackers = 192 00:16:15.807 [2024-11-26 19:02:32.483996] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for connect adminq (no timeout) 00:16:15.807 [2024-11-26 19:02:32.484009] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read vs (no timeout) 00:16:15.807 [2024-11-26 19:02:32.484015] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read vs wait for vs (no timeout) 00:16:15.807 [2024-11-26 19:02:32.484889] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x8, value 0x10300 00:16:15.807 [2024-11-26 19:02:32.484898] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read cap (no timeout) 00:16:15.807 [2024-11-26 19:02:32.484908] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read cap wait for cap (no timeout) 00:16:15.807 [2024-11-26 19:02:32.485890] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x0, value 0x201e0100ff 00:16:15.807 [2024-11-26 19:02:32.485897] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to check en (no timeout) 00:16:15.807 [2024-11-26 19:02:32.485904] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to check en wait for cc (timeout 15000 ms) 00:16:15.807 [2024-11-26 19:02:32.486901] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x0 00:16:15.807 [2024-11-26 19:02:32.486909] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:16:15.807 [2024-11-26 19:02:32.487899] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x1c, value 0x0 00:16:15.807 [2024-11-26 19:02:32.487908] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] CC.EN = 0 && CSTS.RDY = 0 00:16:15.807 [2024-11-26 19:02:32.487912] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to controller is disabled (timeout 15000 ms) 00:16:15.807 [2024-11-26 19:02:32.487918] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:16:15.807 [2024-11-26 19:02:32.488023] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Setting CC.EN = 1 00:16:15.807 [2024-11-26 19:02:32.488028] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:16:15.807 [2024-11-26 19:02:32.488032] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x28, value 0x2000003c0000 00:16:15.807 [2024-11-26 19:02:32.488905] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x30, value 0x2000003be000 00:16:15.807 [2024-11-26 19:02:32.489919] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x24, value 0xff00ff 00:16:15.807 [2024-11-26 19:02:32.490920] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x460001 00:16:15.807 [2024-11-26 19:02:32.491952] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:16:15.807 [2024-11-26 19:02:32.492943] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x1c, value 0x1 00:16:15.807 [2024-11-26 19:02:32.492954] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:16:15.807 [2024-11-26 19:02:32.492959] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to reset admin queue (timeout 30000 ms) 00:16:15.807 [2024-11-26 19:02:32.492975] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify controller (no timeout) 00:16:15.807 [2024-11-26 19:02:32.492982] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify controller (timeout 30000 ms) 00:16:15.807 [2024-11-26 19:02:32.492992] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:16:15.807 [2024-11-26 19:02:32.492996] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:16:15.807 [2024-11-26 19:02:32.493007] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000001 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:16:15.807 [2024-11-26 19:02:32.501954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0001 p:1 m:0 dnr:0 00:16:15.807 [2024-11-26 19:02:32.501965] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] transport max_xfer_size 131072 00:16:15.807 [2024-11-26 19:02:32.501970] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] MDTS max_xfer_size 131072 00:16:15.807 [2024-11-26 19:02:32.501974] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] CNTLID 0x0001 00:16:15.807 [2024-11-26 19:02:32.501978] nvme_ctrlr.c:1990:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Identify CNTLID 0x0001 != Connect CNTLID 0x0000 00:16:15.807 [2024-11-26 19:02:32.501982] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] transport max_sges 1 00:16:15.807 [2024-11-26 19:02:32.501986] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] fuses compare and write: 1 00:16:15.807 [2024-11-26 19:02:32.501990] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to configure AER (timeout 30000 ms) 00:16:15.807 [2024-11-26 19:02:32.501999] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for configure aer (timeout 30000 ms) 00:16:15.807 [2024-11-26 19:02:32.502008] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:191 cdw10:0000000b PRP1 0x0 PRP2 0x0 00:16:15.807 [2024-11-26 19:02:32.509952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0002 p:1 m:0 dnr:0 00:16:15.807 [2024-11-26 19:02:32.509965] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:190 nsid:0 cdw10:00000000 cdw11:00000000 00:16:15.807 [2024-11-26 19:02:32.509972] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:189 nsid:0 cdw10:00000000 cdw11:00000000 00:16:15.807 [2024-11-26 19:02:32.509980] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:188 nsid:0 cdw10:00000000 cdw11:00000000 00:16:15.807 [2024-11-26 19:02:32.509988] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:187 nsid:0 cdw10:00000000 cdw11:00000000 00:16:15.807 [2024-11-26 19:02:32.509992] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set keep alive timeout (timeout 30000 ms) 00:16:15.807 [2024-11-26 19:02:32.509999] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:16:15.807 [2024-11-26 19:02:32.510007] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:191 cdw10:0000000f PRP1 0x0 PRP2 0x0 00:16:15.807 [2024-11-26 19:02:32.517952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0007 p:1 m:0 dnr:0 00:16:15.807 [2024-11-26 19:02:32.517959] nvme_ctrlr.c:2878:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Controller adjusted keep alive timeout to 0 ms 00:16:15.807 [2024-11-26 19:02:32.517964] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify controller iocs specific (timeout 30000 ms) 00:16:15.807 [2024-11-26 19:02:32.517970] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set number of queues (timeout 30000 ms) 00:16:15.807 [2024-11-26 19:02:32.517977] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for set number of queues (timeout 30000 ms) 00:16:15.807 [2024-11-26 19:02:32.517984] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:16:15.807 [2024-11-26 19:02:32.525953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:0008 p:1 m:0 dnr:0 00:16:15.807 [2024-11-26 19:02:32.526006] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify active ns (timeout 30000 ms) 00:16:15.807 [2024-11-26 19:02:32.526013] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify active ns (timeout 30000 ms) 00:16:15.807 [2024-11-26 19:02:32.526020] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f9000 len:4096 00:16:15.807 [2024-11-26 19:02:32.526024] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f9000 00:16:15.807 [2024-11-26 19:02:32.526030] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000002 cdw11:00000000 PRP1 0x2000002f9000 PRP2 0x0 00:16:15.807 [2024-11-26 19:02:32.533952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0009 p:1 m:0 dnr:0 00:16:15.807 [2024-11-26 19:02:32.533964] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Namespace 1 was added 00:16:15.807 [2024-11-26 19:02:32.533975] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify ns (timeout 30000 ms) 00:16:15.807 [2024-11-26 19:02:32.533981] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify ns (timeout 30000 ms) 00:16:15.807 [2024-11-26 19:02:32.533987] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:16:15.808 [2024-11-26 19:02:32.533991] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:16:15.808 [2024-11-26 19:02:32.533997] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000000 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:16:15.808 [2024-11-26 19:02:32.541955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000a p:1 m:0 dnr:0 00:16:15.808 [2024-11-26 19:02:32.541970] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify namespace id descriptors (timeout 30000 ms) 00:16:15.808 [2024-11-26 19:02:32.541976] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:16:15.808 [2024-11-26 19:02:32.541983] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:16:15.808 [2024-11-26 19:02:32.541987] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:16:15.808 [2024-11-26 19:02:32.541993] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:16:15.808 [2024-11-26 19:02:32.549951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000b p:1 m:0 dnr:0 00:16:15.808 [2024-11-26 19:02:32.549960] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify ns iocs specific (timeout 30000 ms) 00:16:15.808 [2024-11-26 19:02:32.549966] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set supported log pages (timeout 30000 ms) 00:16:15.808 [2024-11-26 19:02:32.549974] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set supported features (timeout 30000 ms) 00:16:15.808 [2024-11-26 19:02:32.549979] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set doorbell buffer config (timeout 30000 ms) 00:16:15.808 [2024-11-26 19:02:32.549983] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set host ID (timeout 30000 ms) 00:16:15.808 [2024-11-26 19:02:32.549988] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] NVMe-oF transport - not sending Set Features - Host ID 00:16:15.808 [2024-11-26 19:02:32.549994] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to transport ready (timeout 30000 ms) 00:16:15.808 [2024-11-26 19:02:32.549998] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to ready (no timeout) 00:16:15.808 [2024-11-26 19:02:32.550013] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:191 cdw10:00000001 PRP1 0x0 PRP2 0x0 00:16:15.808 [2024-11-26 19:02:32.557952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000c p:1 m:0 dnr:0 00:16:15.808 [2024-11-26 19:02:32.557965] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:191 cdw10:00000002 PRP1 0x0 PRP2 0x0 00:16:15.808 [2024-11-26 19:02:32.565953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000d p:1 m:0 dnr:0 00:16:15.808 [2024-11-26 19:02:32.565965] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:191 cdw10:00000004 PRP1 0x0 PRP2 0x0 00:16:15.808 [2024-11-26 19:02:32.573952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000e p:1 m:0 dnr:0 00:16:15.808 [2024-11-26 19:02:32.573964] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:16:15.808 [2024-11-26 19:02:32.581951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:000f p:1 m:0 dnr:0 00:16:15.808 [2024-11-26 19:02:32.581963] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f6000 len:8192 00:16:15.808 [2024-11-26 19:02:32.581967] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f6000 00:16:15.808 [2024-11-26 19:02:32.581970] nvme_pcie_common.c:1235:nvme_pcie_prp_list_append: *DEBUG*: prp[0] = 0x2000002f7000 00:16:15.808 [2024-11-26 19:02:32.581973] nvme_pcie_common.c:1251:nvme_pcie_prp_list_append: *DEBUG*: prp2 = 0x2000002f7000 00:16:15.808 [2024-11-26 19:02:32.581979] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:191 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 PRP1 0x2000002f6000 PRP2 0x2000002f7000 00:16:15.808 [2024-11-26 19:02:32.581985] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fc000 len:512 00:16:15.808 [2024-11-26 19:02:32.581989] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fc000 00:16:15.808 [2024-11-26 19:02:32.581995] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:186 nsid:ffffffff cdw10:007f0002 cdw11:00000000 PRP1 0x2000002fc000 PRP2 0x0 00:16:15.808 [2024-11-26 19:02:32.582001] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:512 00:16:15.808 [2024-11-26 19:02:32.582005] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:16:15.808 [2024-11-26 19:02:32.582010] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:185 nsid:ffffffff cdw10:007f0003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:16:15.808 [2024-11-26 19:02:32.582017] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f4000 len:4096 00:16:15.808 [2024-11-26 19:02:32.582020] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f4000 00:16:15.808 [2024-11-26 19:02:32.582026] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:184 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 PRP1 0x2000002f4000 PRP2 0x0 00:16:15.808 [2024-11-26 19:02:32.589952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0010 p:1 m:0 dnr:0 00:16:15.808 [2024-11-26 19:02:32.589966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:186 cdw0:0 sqhd:0011 p:1 m:0 dnr:0 00:16:15.808 [2024-11-26 19:02:32.589974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:185 cdw0:0 sqhd:0012 p:1 m:0 dnr:0 00:16:15.808 [2024-11-26 19:02:32.589980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0013 p:1 m:0 dnr:0 00:16:15.808 ===================================================== 00:16:15.808 NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:16:15.808 ===================================================== 00:16:15.808 Controller Capabilities/Features 00:16:15.808 ================================ 00:16:15.808 Vendor ID: 4e58 00:16:15.808 Subsystem Vendor ID: 4e58 00:16:15.808 Serial Number: SPDK2 00:16:15.808 Model Number: SPDK bdev Controller 00:16:15.808 Firmware Version: 24.01.1 00:16:15.808 Recommended Arb Burst: 6 00:16:15.808 IEEE OUI Identifier: 8d 6b 50 00:16:15.808 Multi-path I/O 00:16:15.808 May have multiple subsystem ports: Yes 00:16:15.808 May have multiple controllers: Yes 00:16:15.808 Associated with SR-IOV VF: No 00:16:15.808 Max Data Transfer Size: 131072 00:16:15.808 Max Number of Namespaces: 32 00:16:15.808 Max Number of I/O Queues: 127 00:16:15.808 NVMe Specification Version (VS): 1.3 00:16:15.808 NVMe Specification Version (Identify): 1.3 00:16:15.808 Maximum Queue Entries: 256 00:16:15.808 Contiguous Queues Required: Yes 00:16:15.808 Arbitration Mechanisms Supported 00:16:15.808 Weighted Round Robin: Not Supported 00:16:15.808 Vendor Specific: Not Supported 00:16:15.808 Reset Timeout: 15000 ms 00:16:15.808 Doorbell Stride: 4 bytes 00:16:15.808 NVM Subsystem Reset: Not Supported 00:16:15.808 Command Sets Supported 00:16:15.808 NVM Command Set: Supported 00:16:15.808 Boot Partition: Not Supported 00:16:15.808 Memory Page Size Minimum: 4096 bytes 00:16:15.808 Memory Page Size Maximum: 4096 bytes 00:16:15.808 Persistent Memory Region: Not Supported 00:16:15.808 Optional Asynchronous Events Supported 00:16:15.808 Namespace Attribute Notices: Supported 00:16:15.808 Firmware Activation Notices: Not Supported 00:16:15.808 ANA Change Notices: Not Supported 00:16:15.808 PLE Aggregate Log Change Notices: Not Supported 00:16:15.808 LBA Status Info Alert Notices: Not Supported 00:16:15.808 EGE Aggregate Log Change Notices: Not Supported 00:16:15.808 Normal NVM Subsystem Shutdown event: Not Supported 00:16:15.808 Zone Descriptor Change Notices: Not Supported 00:16:15.808 Discovery Log Change Notices: Not Supported 00:16:15.808 Controller Attributes 00:16:15.808 128-bit Host Identifier: Supported 00:16:15.808 Non-Operational Permissive Mode: Not Supported 00:16:15.808 NVM Sets: Not Supported 00:16:15.808 Read Recovery Levels: Not Supported 00:16:15.808 Endurance Groups: Not Supported 00:16:15.808 Predictable Latency Mode: Not Supported 00:16:15.808 Traffic Based Keep ALive: Not Supported 00:16:15.808 Namespace Granularity: Not Supported 00:16:15.808 SQ Associations: Not Supported 00:16:15.808 UUID List: Not Supported 00:16:15.808 Multi-Domain Subsystem: Not Supported 00:16:15.808 Fixed Capacity Management: Not Supported 00:16:15.808 Variable Capacity Management: Not Supported 00:16:15.808 Delete Endurance Group: Not Supported 00:16:15.808 Delete NVM Set: Not Supported 00:16:15.808 Extended LBA Formats Supported: Not Supported 00:16:15.808 Flexible Data Placement Supported: Not Supported 00:16:15.808 00:16:15.808 Controller Memory Buffer Support 00:16:15.808 ================================ 00:16:15.808 Supported: No 00:16:15.808 00:16:15.808 Persistent Memory Region Support 00:16:15.808 ================================ 00:16:15.808 Supported: No 00:16:15.808 00:16:15.808 Admin Command Set Attributes 00:16:15.808 ============================ 00:16:15.808 Security Send/Receive: Not Supported 00:16:15.808 Format NVM: Not Supported 00:16:15.808 Firmware Activate/Download: Not Supported 00:16:15.808 Namespace Management: Not Supported 00:16:15.808 Device Self-Test: Not Supported 00:16:15.808 Directives: Not Supported 00:16:15.808 NVMe-MI: Not Supported 00:16:15.808 Virtualization Management: Not Supported 00:16:15.808 Doorbell Buffer Config: Not Supported 00:16:15.808 Get LBA Status Capability: Not Supported 00:16:15.808 Command & Feature Lockdown Capability: Not Supported 00:16:15.808 Abort Command Limit: 4 00:16:15.808 Async Event Request Limit: 4 00:16:15.808 Number of Firmware Slots: N/A 00:16:15.808 Firmware Slot 1 Read-Only: N/A 00:16:15.808 Firmware Activation Without Reset: N/A 00:16:15.808 Multiple Update Detection Support: N/A 00:16:15.808 Firmware Update Granularity: No Information Provided 00:16:15.809 Per-Namespace SMART Log: No 00:16:15.809 Asymmetric Namespace Access Log Page: Not Supported 00:16:15.809 Subsystem NQN: nqn.2019-07.io.spdk:cnode2 00:16:15.809 Command Effects Log Page: Supported 00:16:15.809 Get Log Page Extended Data: Supported 00:16:15.809 Telemetry Log Pages: Not Supported 00:16:15.809 Persistent Event Log Pages: Not Supported 00:16:15.809 Supported Log Pages Log Page: May Support 00:16:15.809 Commands Supported & Effects Log Page: Not Supported 00:16:15.809 Feature Identifiers & Effects Log Page:May Support 00:16:15.809 NVMe-MI Commands & Effects Log Page: May Support 00:16:15.809 Data Area 4 for Telemetry Log: Not Supported 00:16:15.809 Error Log Page Entries Supported: 128 00:16:15.809 Keep Alive: Supported 00:16:15.809 Keep Alive Granularity: 10000 ms 00:16:15.809 00:16:15.809 NVM Command Set Attributes 00:16:15.809 ========================== 00:16:15.809 Submission Queue Entry Size 00:16:15.809 Max: 64 00:16:15.809 Min: 64 00:16:15.809 Completion Queue Entry Size 00:16:15.809 Max: 16 00:16:15.809 Min: 16 00:16:15.809 Number of Namespaces: 32 00:16:15.809 Compare Command: Supported 00:16:15.809 Write Uncorrectable Command: Not Supported 00:16:15.809 Dataset Management Command: Supported 00:16:15.809 Write Zeroes Command: Supported 00:16:15.809 Set Features Save Field: Not Supported 00:16:15.809 Reservations: Not Supported 00:16:15.809 Timestamp: Not Supported 00:16:15.809 Copy: Supported 00:16:15.809 Volatile Write Cache: Present 00:16:15.809 Atomic Write Unit (Normal): 1 00:16:15.809 Atomic Write Unit (PFail): 1 00:16:15.809 Atomic Compare & Write Unit: 1 00:16:15.809 Fused Compare & Write: Supported 00:16:15.809 Scatter-Gather List 00:16:15.809 SGL Command Set: Supported (Dword aligned) 00:16:15.809 SGL Keyed: Not Supported 00:16:15.809 SGL Bit Bucket Descriptor: Not Supported 00:16:15.809 SGL Metadata Pointer: Not Supported 00:16:15.809 Oversized SGL: Not Supported 00:16:15.809 SGL Metadata Address: Not Supported 00:16:15.809 SGL Offset: Not Supported 00:16:15.809 Transport SGL Data Block: Not Supported 00:16:15.809 Replay Protected Memory Block: Not Supported 00:16:15.809 00:16:15.809 Firmware Slot Information 00:16:15.809 ========================= 00:16:15.809 Active slot: 1 00:16:15.809 Slot 1 Firmware Revision: 24.01.1 00:16:15.809 00:16:15.809 00:16:15.809 Commands Supported and Effects 00:16:15.809 ============================== 00:16:15.809 Admin Commands 00:16:15.809 -------------- 00:16:15.809 Get Log Page (02h): Supported 00:16:15.809 Identify (06h): Supported 00:16:15.809 Abort (08h): Supported 00:16:15.809 Set Features (09h): Supported 00:16:15.809 Get Features (0Ah): Supported 00:16:15.809 Asynchronous Event Request (0Ch): Supported 00:16:15.809 Keep Alive (18h): Supported 00:16:15.809 I/O Commands 00:16:15.809 ------------ 00:16:15.809 Flush (00h): Supported LBA-Change 00:16:15.809 Write (01h): Supported LBA-Change 00:16:15.809 Read (02h): Supported 00:16:15.809 Compare (05h): Supported 00:16:15.809 Write Zeroes (08h): Supported LBA-Change 00:16:15.809 Dataset Management (09h): Supported LBA-Change 00:16:15.809 Copy (19h): Supported LBA-Change 00:16:15.809 Unknown (79h): Supported LBA-Change 00:16:15.809 Unknown (7Ah): Supported 00:16:15.809 00:16:15.809 Error Log 00:16:15.809 ========= 00:16:15.809 00:16:15.809 Arbitration 00:16:15.809 =========== 00:16:15.809 Arbitration Burst: 1 00:16:15.809 00:16:15.809 Power Management 00:16:15.809 ================ 00:16:15.809 Number of Power States: 1 00:16:15.809 Current Power State: Power State #0 00:16:15.809 Power State #0: 00:16:15.809 Max Power: 0.00 W 00:16:15.809 Non-Operational State: Operational 00:16:15.809 Entry Latency: Not Reported 00:16:15.809 Exit Latency: Not Reported 00:16:15.809 Relative Read Throughput: 0 00:16:15.809 Relative Read Latency: 0 00:16:15.809 Relative Write Throughput: 0 00:16:15.809 Relative Write Latency: 0 00:16:15.809 Idle Power: Not Reported 00:16:15.809 Active Power: Not Reported 00:16:15.809 Non-Operational Permissive Mode: Not Supported 00:16:15.809 00:16:15.809 Health Information 00:16:15.809 ================== 00:16:15.809 Critical Warnings: 00:16:15.809 Available Spare Space: OK 00:16:15.809 Temperature: OK 00:16:15.809 Device Reliability: OK 00:16:15.809 Read Only: No 00:16:15.809 Volatile Memory Backup: OK 00:16:15.809 Current Temperature: 0 Kelvin[2024-11-26 19:02:32.590074] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:184 cdw10:00000005 PRP1 0x0 PRP2 0x0 00:16:15.809 [2024-11-26 19:02:32.597953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0014 p:1 m:0 dnr:0 00:16:15.809 [2024-11-26 19:02:32.597979] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Prepare to destruct SSD 00:16:15.809 [2024-11-26 19:02:32.597987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:190 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:15.809 [2024-11-26 19:02:32.597993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:189 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:15.809 [2024-11-26 19:02:32.597998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:188 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:15.809 [2024-11-26 19:02:32.598004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:187 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:15.809 [2024-11-26 19:02:32.598041] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x460001 00:16:15.809 [2024-11-26 19:02:32.598051] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x464001 00:16:15.809 [2024-11-26 19:02:32.599078] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] RTD3E = 0 us 00:16:15.809 [2024-11-26 19:02:32.599085] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] shutdown timeout = 10000 ms 00:16:15.809 [2024-11-26 19:02:32.600052] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x1c, value 0x9 00:16:15.809 [2024-11-26 19:02:32.600063] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] shutdown complete in 0 milliseconds 00:16:15.809 [2024-11-26 19:02:32.600108] vfio_user_pci.c: 399:spdk_vfio_user_release: *DEBUG*: Release file /var/run/vfio-user/domain/vfio-user2/2/cntrl 00:16:15.809 [2024-11-26 19:02:32.601196] vfio_user_pci.c: 96:vfio_remove_mr: *DEBUG*: Remove memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:16:15.809 (-273 Celsius) 00:16:15.809 Temperature Threshold: 0 Kelvin (-273 Celsius) 00:16:15.809 Available Spare: 0% 00:16:15.809 Available Spare Threshold: 0% 00:16:15.809 Life Percentage Used: 0% 00:16:15.809 Data Units Read: 0 00:16:15.809 Data Units Written: 0 00:16:15.809 Host Read Commands: 0 00:16:15.809 Host Write Commands: 0 00:16:15.809 Controller Busy Time: 0 minutes 00:16:15.809 Power Cycles: 0 00:16:15.809 Power On Hours: 0 hours 00:16:15.809 Unsafe Shutdowns: 0 00:16:15.809 Unrecoverable Media Errors: 0 00:16:15.809 Lifetime Error Log Entries: 0 00:16:15.809 Warning Temperature Time: 0 minutes 00:16:15.809 Critical Temperature Time: 0 minutes 00:16:15.809 00:16:15.809 Number of Queues 00:16:15.809 ================ 00:16:15.809 Number of I/O Submission Queues: 127 00:16:15.809 Number of I/O Completion Queues: 127 00:16:15.809 00:16:15.809 Active Namespaces 00:16:15.809 ================= 00:16:15.809 Namespace ID:1 00:16:15.809 Error Recovery Timeout: Unlimited 00:16:15.809 Command Set Identifier: NVM (00h) 00:16:15.809 Deallocate: Supported 00:16:15.809 Deallocated/Unwritten Error: Not Supported 00:16:15.809 Deallocated Read Value: Unknown 00:16:15.809 Deallocate in Write Zeroes: Not Supported 00:16:15.809 Deallocated Guard Field: 0xFFFF 00:16:15.809 Flush: Supported 00:16:15.809 Reservation: Supported 00:16:15.809 Namespace Sharing Capabilities: Multiple Controllers 00:16:15.809 Size (in LBAs): 131072 (0GiB) 00:16:15.809 Capacity (in LBAs): 131072 (0GiB) 00:16:15.809 Utilization (in LBAs): 131072 (0GiB) 00:16:15.809 NGUID: 7BB1668B88D84102811EAA64D8EC3F5D 00:16:15.809 UUID: 7bb1668b-88d8-4102-811e-aa64d8ec3f5d 00:16:15.809 Thin Provisioning: Not Supported 00:16:15.809 Per-NS Atomic Units: Yes 00:16:15.809 Atomic Boundary Size (Normal): 0 00:16:15.809 Atomic Boundary Size (PFail): 0 00:16:15.809 Atomic Boundary Offset: 0 00:16:15.809 Maximum Single Source Range Length: 65535 00:16:15.809 Maximum Copy Length: 65535 00:16:15.809 Maximum Source Range Count: 1 00:16:15.809 NGUID/EUI64 Never Reused: No 00:16:15.809 Namespace Write Protected: No 00:16:15.809 Number of LBA Formats: 1 00:16:15.809 Current LBA Format: LBA Format #00 00:16:15.809 LBA Format #00: Data Size: 512 Metadata Size: 0 00:16:15.809 00:16:15.809 19:02:32 -- target/nvmf_vfio_user.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -s 256 -g -q 128 -o 4096 -w read -t 5 -c 0x2 00:16:15.809 EAL: No free 2048 kB hugepages reported on node 1 00:16:21.085 Initializing NVMe Controllers 00:16:21.085 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:16:21.085 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 with lcore 1 00:16:21.085 Initialization complete. Launching workers. 00:16:21.085 ======================================================== 00:16:21.085 Latency(us) 00:16:21.085 Device Information : IOPS MiB/s Average min max 00:16:21.085 VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 from core 1: 39927.60 155.97 3205.63 955.15 8635.58 00:16:21.085 ======================================================== 00:16:21.085 Total : 39927.60 155.97 3205.63 955.15 8635.58 00:16:21.085 00:16:21.085 19:02:37 -- target/nvmf_vfio_user.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -s 256 -g -q 128 -o 4096 -w write -t 5 -c 0x2 00:16:21.085 EAL: No free 2048 kB hugepages reported on node 1 00:16:26.368 Initializing NVMe Controllers 00:16:26.368 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:16:26.368 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 with lcore 1 00:16:26.368 Initialization complete. Launching workers. 00:16:26.368 ======================================================== 00:16:26.368 Latency(us) 00:16:26.368 Device Information : IOPS MiB/s Average min max 00:16:26.368 VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 from core 1: 39946.80 156.04 3204.36 958.25 10237.49 00:16:26.368 ======================================================== 00:16:26.368 Total : 39946.80 156.04 3204.36 958.25 10237.49 00:16:26.368 00:16:26.368 19:02:43 -- target/nvmf_vfio_user.sh@86 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -g -q 32 -o 4096 -w randrw -M 50 -t 5 -c 0xE 00:16:26.368 EAL: No free 2048 kB hugepages reported on node 1 00:16:31.645 Initializing NVMe Controllers 00:16:31.645 Attaching to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:16:31.645 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:16:31.645 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) with lcore 1 00:16:31.645 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) with lcore 2 00:16:31.645 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) with lcore 3 00:16:31.645 Initialization complete. Launching workers. 00:16:31.645 Starting thread on core 2 00:16:31.645 Starting thread on core 3 00:16:31.645 Starting thread on core 1 00:16:31.645 19:02:48 -- target/nvmf_vfio_user.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -t 3 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -d 256 -g 00:16:31.905 EAL: No free 2048 kB hugepages reported on node 1 00:16:35.197 Initializing NVMe Controllers 00:16:35.197 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:16:35.197 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:16:35.197 Associating SPDK bdev Controller (SPDK2 ) with lcore 0 00:16:35.197 Associating SPDK bdev Controller (SPDK2 ) with lcore 1 00:16:35.197 Associating SPDK bdev Controller (SPDK2 ) with lcore 2 00:16:35.197 Associating SPDK bdev Controller (SPDK2 ) with lcore 3 00:16:35.197 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration run with configuration: 00:16:35.197 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -q 64 -s 131072 -w randrw -M 50 -l 0 -t 3 -c 0xf -m 0 -a 0 -b 0 -n 100000 -i -1 00:16:35.197 Initialization complete. Launching workers. 00:16:35.197 Starting thread on core 1 with urgent priority queue 00:16:35.197 Starting thread on core 2 with urgent priority queue 00:16:35.197 Starting thread on core 3 with urgent priority queue 00:16:35.197 Starting thread on core 0 with urgent priority queue 00:16:35.197 SPDK bdev Controller (SPDK2 ) core 0: 7357.00 IO/s 13.59 secs/100000 ios 00:16:35.197 SPDK bdev Controller (SPDK2 ) core 1: 7657.33 IO/s 13.06 secs/100000 ios 00:16:35.197 SPDK bdev Controller (SPDK2 ) core 2: 7249.33 IO/s 13.79 secs/100000 ios 00:16:35.197 SPDK bdev Controller (SPDK2 ) core 3: 7333.33 IO/s 13.64 secs/100000 ios 00:16:35.197 ======================================================== 00:16:35.197 00:16:35.197 19:02:51 -- target/nvmf_vfio_user.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/hello_world -d 256 -g -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' 00:16:35.197 EAL: No free 2048 kB hugepages reported on node 1 00:16:35.456 Initializing NVMe Controllers 00:16:35.456 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:16:35.456 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:16:35.456 Namespace ID: 1 size: 0GB 00:16:35.456 Initialization complete. 00:16:35.456 INFO: using host memory buffer for IO 00:16:35.456 Hello world! 00:16:35.456 19:02:52 -- target/nvmf_vfio_user.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/overhead/overhead -o 4096 -t 1 -H -g -d 256 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' 00:16:35.456 EAL: No free 2048 kB hugepages reported on node 1 00:16:36.837 Initializing NVMe Controllers 00:16:36.837 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:16:36.837 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:16:36.837 Initialization complete. Launching workers. 00:16:36.837 submit (in ns) avg, min, max = 8532.6, 3199.1, 4000204.3 00:16:36.837 complete (in ns) avg, min, max = 21220.3, 1760.0, 4031890.4 00:16:36.837 00:16:36.837 Submit histogram 00:16:36.837 ================ 00:16:36.837 Range in us Cumulative Count 00:16:36.837 3.186 - 3.200: 0.0061% ( 1) 00:16:36.837 3.200 - 3.214: 0.0121% ( 1) 00:16:36.837 3.214 - 3.228: 0.0182% ( 1) 00:16:36.837 3.228 - 3.242: 0.0364% ( 3) 00:16:36.837 3.242 - 3.256: 0.0547% ( 3) 00:16:36.837 3.256 - 3.270: 0.5344% ( 79) 00:16:36.837 3.270 - 3.283: 3.0121% ( 408) 00:16:36.837 3.283 - 3.297: 6.9958% ( 656) 00:16:36.837 3.297 - 3.311: 12.1637% ( 851) 00:16:36.837 3.311 - 3.325: 17.7446% ( 919) 00:16:36.837 3.325 - 3.339: 23.5380% ( 954) 00:16:36.837 3.339 - 3.353: 29.1249% ( 920) 00:16:36.837 3.353 - 3.367: 34.5661% ( 896) 00:16:36.837 3.367 - 3.381: 39.5518% ( 821) 00:16:36.837 3.381 - 3.395: 44.2218% ( 769) 00:16:36.837 3.395 - 3.409: 48.3330% ( 677) 00:16:36.837 3.409 - 3.423: 53.0394% ( 775) 00:16:36.837 3.423 - 3.437: 59.3429% ( 1038) 00:16:36.837 3.437 - 3.450: 64.2072% ( 801) 00:16:36.837 3.450 - 3.464: 68.8164% ( 759) 00:16:36.837 3.464 - 3.478: 74.4519% ( 928) 00:16:36.837 3.478 - 3.492: 78.7514% ( 708) 00:16:36.837 3.492 - 3.506: 82.2433% ( 575) 00:16:36.837 3.506 - 3.520: 84.3141% ( 341) 00:16:36.837 3.520 - 3.534: 85.8566% ( 254) 00:16:36.837 3.534 - 3.548: 86.8039% ( 156) 00:16:36.837 3.548 - 3.562: 87.3262% ( 86) 00:16:36.837 3.562 - 3.590: 88.5104% ( 195) 00:16:36.837 3.590 - 3.617: 90.1075% ( 263) 00:16:36.837 3.617 - 3.645: 91.9172% ( 298) 00:16:36.837 3.645 - 3.673: 93.4839% ( 258) 00:16:36.837 3.673 - 3.701: 95.2025% ( 283) 00:16:36.837 3.701 - 3.729: 96.8786% ( 276) 00:16:36.837 3.729 - 3.757: 98.0081% ( 186) 00:16:36.837 3.757 - 3.784: 98.7247% ( 118) 00:16:36.837 3.784 - 3.812: 99.1620% ( 72) 00:16:36.837 3.812 - 3.840: 99.3927% ( 38) 00:16:36.837 3.840 - 3.868: 99.5324% ( 23) 00:16:36.837 3.868 - 3.896: 99.5688% ( 6) 00:16:36.837 3.896 - 3.923: 99.5871% ( 3) 00:16:36.837 3.923 - 3.951: 99.5992% ( 2) 00:16:36.837 3.979 - 4.007: 99.6053% ( 1) 00:16:36.837 5.092 - 5.120: 99.6113% ( 1) 00:16:36.837 5.176 - 5.203: 99.6174% ( 1) 00:16:36.837 5.398 - 5.426: 99.6296% ( 2) 00:16:36.837 5.426 - 5.454: 99.6356% ( 1) 00:16:36.837 5.510 - 5.537: 99.6417% ( 1) 00:16:36.837 5.593 - 5.621: 99.6478% ( 1) 00:16:36.837 5.677 - 5.704: 99.6539% ( 1) 00:16:36.837 5.704 - 5.732: 99.6599% ( 1) 00:16:36.837 5.760 - 5.788: 99.6660% ( 1) 00:16:36.837 5.788 - 5.816: 99.6721% ( 1) 00:16:36.837 5.816 - 5.843: 99.6781% ( 1) 00:16:36.837 5.871 - 5.899: 99.6842% ( 1) 00:16:36.837 5.927 - 5.955: 99.6903% ( 1) 00:16:36.837 6.066 - 6.094: 99.6964% ( 1) 00:16:36.837 6.205 - 6.233: 99.7024% ( 1) 00:16:36.837 6.261 - 6.289: 99.7085% ( 1) 00:16:36.837 6.289 - 6.317: 99.7146% ( 1) 00:16:36.837 6.372 - 6.400: 99.7207% ( 1) 00:16:36.837 6.400 - 6.428: 99.7267% ( 1) 00:16:36.837 6.734 - 6.762: 99.7389% ( 2) 00:16:36.837 6.762 - 6.790: 99.7510% ( 2) 00:16:36.838 6.790 - 6.817: 99.7571% ( 1) 00:16:36.838 6.873 - 6.901: 99.7692% ( 2) 00:16:36.838 6.901 - 6.929: 99.7814% ( 2) 00:16:36.838 6.984 - 7.012: 99.7935% ( 2) 00:16:36.838 7.096 - 7.123: 99.8057% ( 2) 00:16:36.838 7.290 - 7.346: 99.8117% ( 1) 00:16:36.838 7.402 - 7.457: 99.8178% ( 1) 00:16:36.838 7.569 - 7.624: 99.8300% ( 2) 00:16:36.838 7.680 - 7.736: 99.8421% ( 2) 00:16:36.838 7.736 - 7.791: 99.8482% ( 1) 00:16:36.838 7.958 - 8.014: 99.8603% ( 2) 00:16:36.838 8.515 - 8.570: 99.8664% ( 1) 00:16:36.838 8.570 - 8.626: 99.8725% ( 1) 00:16:36.838 3989.148 - 4017.642: 100.0000% ( 21) 00:16:36.838 00:16:36.838 Complete histogram 00:16:36.838 ================== 00:16:36.838 Range in us Cumulative Count 00:16:36.838 1.760 - 1.767: 0.0304% ( 5) 00:16:36.838 1.767 - 1.774: 0.0486% ( 3) 00:16:36.838 1.774 - 1.781: 0.0850% ( 6) 00:16:36.838 1.781 - 1.795: 0.1336% ( 8) 00:16:36.838 1.795 - 1.809: 0.6255% ( 81) 00:16:36.838 1.809 - 1.823: 14.2406% ( 2242) 00:16:36.838 1.823 - 1.837: 46.8209% ( 5365) 00:16:36.838 1.837 - 1.850: 70.0735% ( 3829) 00:16:36.838 1.850 - 1.864: 81.4903% ( 1880) 00:16:36.838 1.864 - 1.878: 89.7856% ( 1366) 00:16:36.838 1.878 - 1.892: 95.9130% ( 1009) 00:16:36.838 1.892 - 1.906: 98.2996% ( 393) 00:16:36.838 1.906 - 1.920: 99.1012% ( 132) 00:16:36.838 1.920 - 1.934: 99.2227% ( 20) 00:16:36.838 1.934 - 1.948: 99.2591% ( 6) 00:16:36.838 1.948 - 1.962: 99.2773% ( 3) 00:16:36.838 1.962 - 1.976: 99.3016% ( 4) 00:16:36.838 1.976 - 1.990: 99.3138% ( 2) 00:16:36.838 1.990 - 2.003: 99.3320% ( 3) 00:16:36.838 2.003 - 2.017: 99.3502% ( 3) 00:16:36.838 2.031 - 2.045: 99.3624% ( 2) 00:16:36.838 2.045 - 2.059: 99.3684% ( 1) 00:16:36.838 2.087 - 2.101: 99.3745% ( 1) 00:16:36.838 2.170 - 2.184: 99.3806% ( 1) 00:16:36.838 3.590 - 3.617: 99.3867% ( 1) 00:16:36.838 3.645 - 3.673: 99.3927% ( 1) 00:16:36.838 4.090 - 4.118: 99.3988% ( 1) 00:16:36.838 4.313 - 4.341: 99.4049% ( 1) 00:16:36.838 5.009 - 5.037: 99.4109% ( 1) 00:16:36.838 5.176 - 5.203: 99.4170% ( 1) 00:16:36.838 5.426 - 5.454: 99.4231% ( 1) 00:16:36.838 5.454 - 5.482: 99.4292% ( 1) 00:16:36.838 5.482 - 5.510: 99.4352% ( 1) 00:16:36.838 5.593 - 5.621: 99.4413% ( 1) 00:16:36.838 5.704 - 5.732: 99.4474% ( 1) 00:16:36.838 5.788 - 5.816: 99.4535% ( 1) 00:16:36.838 6.289 - 6.317: 99.4656% ( 2) 00:16:36.838 6.511 - 6.539: 99.4717% ( 1) 00:16:36.838 6.539 - 6.567: 99.4777% ( 1) 00:16:36.838 6.873 - 6.901: 99.4838% ( 1) 00:16:36.838 6.929 - 6.957: 99.4899% ( 1) 00:16:36.838 15.026 - 15.137: 99.4960% ( 1) 00:16:36.838 16.139 - 16.250: 99.5020% ( 1) 00:16:36.838 38.289 - 38.511: 99.5081% ( 1) 00:16:36.838 143.360 - 144.250: 99.5142% ( 1) 00:16:36.838 3205.565 - 3219.812: 99.5203% ( 1) 00:16:36.838 3989.148 - 4017.642: 99.9939% ( 78) 00:16:36.838 4017.642 - 4046.136: 100.0000% ( 1) 00:16:36.838 00:16:36.838 19:02:53 -- target/nvmf_vfio_user.sh@90 -- # aer_vfio_user /var/run/vfio-user/domain/vfio-user2/2 nqn.2019-07.io.spdk:cnode2 2 00:16:36.838 19:02:53 -- target/nvmf_vfio_user.sh@22 -- # local traddr=/var/run/vfio-user/domain/vfio-user2/2 00:16:36.838 19:02:53 -- target/nvmf_vfio_user.sh@23 -- # local subnqn=nqn.2019-07.io.spdk:cnode2 00:16:36.838 19:02:53 -- target/nvmf_vfio_user.sh@24 -- # local malloc_num=Malloc4 00:16:36.838 19:02:53 -- target/nvmf_vfio_user.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:16:36.838 [ 00:16:36.838 { 00:16:36.838 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:16:36.838 "subtype": "Discovery", 00:16:36.838 "listen_addresses": [], 00:16:36.838 "allow_any_host": true, 00:16:36.838 "hosts": [] 00:16:36.838 }, 00:16:36.838 { 00:16:36.838 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:16:36.838 "subtype": "NVMe", 00:16:36.838 "listen_addresses": [ 00:16:36.838 { 00:16:36.838 "transport": "VFIOUSER", 00:16:36.838 "trtype": "VFIOUSER", 00:16:36.838 "adrfam": "IPv4", 00:16:36.838 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:16:36.838 "trsvcid": "0" 00:16:36.838 } 00:16:36.838 ], 00:16:36.838 "allow_any_host": true, 00:16:36.838 "hosts": [], 00:16:36.838 "serial_number": "SPDK1", 00:16:36.838 "model_number": "SPDK bdev Controller", 00:16:36.838 "max_namespaces": 32, 00:16:36.838 "min_cntlid": 1, 00:16:36.838 "max_cntlid": 65519, 00:16:36.838 "namespaces": [ 00:16:36.838 { 00:16:36.838 "nsid": 1, 00:16:36.838 "bdev_name": "Malloc1", 00:16:36.838 "name": "Malloc1", 00:16:36.838 "nguid": "8C0F987611CF482395453FD1D7C7B14A", 00:16:36.838 "uuid": "8c0f9876-11cf-4823-9545-3fd1d7c7b14a" 00:16:36.838 }, 00:16:36.838 { 00:16:36.838 "nsid": 2, 00:16:36.838 "bdev_name": "Malloc3", 00:16:36.838 "name": "Malloc3", 00:16:36.838 "nguid": "F27C2B41A8A54416B10F4AC113F01A29", 00:16:36.838 "uuid": "f27c2b41-a8a5-4416-b10f-4ac113f01a29" 00:16:36.838 } 00:16:36.838 ] 00:16:36.838 }, 00:16:36.838 { 00:16:36.838 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:16:36.838 "subtype": "NVMe", 00:16:36.838 "listen_addresses": [ 00:16:36.838 { 00:16:36.838 "transport": "VFIOUSER", 00:16:36.838 "trtype": "VFIOUSER", 00:16:36.838 "adrfam": "IPv4", 00:16:36.838 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:16:36.838 "trsvcid": "0" 00:16:36.838 } 00:16:36.838 ], 00:16:36.838 "allow_any_host": true, 00:16:36.838 "hosts": [], 00:16:36.838 "serial_number": "SPDK2", 00:16:36.838 "model_number": "SPDK bdev Controller", 00:16:36.838 "max_namespaces": 32, 00:16:36.838 "min_cntlid": 1, 00:16:36.838 "max_cntlid": 65519, 00:16:36.838 "namespaces": [ 00:16:36.838 { 00:16:36.838 "nsid": 1, 00:16:36.838 "bdev_name": "Malloc2", 00:16:36.838 "name": "Malloc2", 00:16:36.838 "nguid": "7BB1668B88D84102811EAA64D8EC3F5D", 00:16:36.838 "uuid": "7bb1668b-88d8-4102-811e-aa64d8ec3f5d" 00:16:36.838 } 00:16:36.838 ] 00:16:36.838 } 00:16:36.838 ] 00:16:36.838 19:02:53 -- target/nvmf_vfio_user.sh@27 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:16:36.838 19:02:53 -- target/nvmf_vfio_user.sh@34 -- # aerpid=3070772 00:16:36.838 19:02:53 -- target/nvmf_vfio_user.sh@37 -- # waitforfile /tmp/aer_touch_file 00:16:36.838 19:02:53 -- target/nvmf_vfio_user.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -n 2 -g -t /tmp/aer_touch_file 00:16:36.838 19:02:53 -- common/autotest_common.sh@1254 -- # local i=0 00:16:36.838 19:02:53 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:16:36.839 19:02:53 -- common/autotest_common.sh@1261 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:16:36.839 19:02:53 -- common/autotest_common.sh@1265 -- # return 0 00:16:36.839 19:02:53 -- target/nvmf_vfio_user.sh@38 -- # rm -f /tmp/aer_touch_file 00:16:36.839 19:02:53 -- target/nvmf_vfio_user.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 --name Malloc4 00:16:36.839 EAL: No free 2048 kB hugepages reported on node 1 00:16:37.099 Malloc4 00:16:37.099 19:02:53 -- target/nvmf_vfio_user.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode2 Malloc4 -n 2 00:16:37.358 19:02:54 -- target/nvmf_vfio_user.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:16:37.358 Asynchronous Event Request test 00:16:37.358 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:16:37.358 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:16:37.358 Registering asynchronous event callbacks... 00:16:37.358 Starting namespace attribute notice tests for all controllers... 00:16:37.358 /var/run/vfio-user/domain/vfio-user2/2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:16:37.358 aer_cb - Changed Namespace 00:16:37.358 Cleaning up... 00:16:37.358 [ 00:16:37.358 { 00:16:37.358 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:16:37.358 "subtype": "Discovery", 00:16:37.358 "listen_addresses": [], 00:16:37.358 "allow_any_host": true, 00:16:37.358 "hosts": [] 00:16:37.358 }, 00:16:37.358 { 00:16:37.358 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:16:37.359 "subtype": "NVMe", 00:16:37.359 "listen_addresses": [ 00:16:37.359 { 00:16:37.359 "transport": "VFIOUSER", 00:16:37.359 "trtype": "VFIOUSER", 00:16:37.359 "adrfam": "IPv4", 00:16:37.359 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:16:37.359 "trsvcid": "0" 00:16:37.359 } 00:16:37.359 ], 00:16:37.359 "allow_any_host": true, 00:16:37.359 "hosts": [], 00:16:37.359 "serial_number": "SPDK1", 00:16:37.359 "model_number": "SPDK bdev Controller", 00:16:37.359 "max_namespaces": 32, 00:16:37.359 "min_cntlid": 1, 00:16:37.359 "max_cntlid": 65519, 00:16:37.359 "namespaces": [ 00:16:37.359 { 00:16:37.359 "nsid": 1, 00:16:37.359 "bdev_name": "Malloc1", 00:16:37.359 "name": "Malloc1", 00:16:37.359 "nguid": "8C0F987611CF482395453FD1D7C7B14A", 00:16:37.359 "uuid": "8c0f9876-11cf-4823-9545-3fd1d7c7b14a" 00:16:37.359 }, 00:16:37.359 { 00:16:37.359 "nsid": 2, 00:16:37.359 "bdev_name": "Malloc3", 00:16:37.359 "name": "Malloc3", 00:16:37.359 "nguid": "F27C2B41A8A54416B10F4AC113F01A29", 00:16:37.359 "uuid": "f27c2b41-a8a5-4416-b10f-4ac113f01a29" 00:16:37.359 } 00:16:37.359 ] 00:16:37.359 }, 00:16:37.359 { 00:16:37.359 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:16:37.359 "subtype": "NVMe", 00:16:37.359 "listen_addresses": [ 00:16:37.359 { 00:16:37.359 "transport": "VFIOUSER", 00:16:37.359 "trtype": "VFIOUSER", 00:16:37.359 "adrfam": "IPv4", 00:16:37.359 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:16:37.359 "trsvcid": "0" 00:16:37.359 } 00:16:37.359 ], 00:16:37.359 "allow_any_host": true, 00:16:37.359 "hosts": [], 00:16:37.359 "serial_number": "SPDK2", 00:16:37.359 "model_number": "SPDK bdev Controller", 00:16:37.359 "max_namespaces": 32, 00:16:37.359 "min_cntlid": 1, 00:16:37.359 "max_cntlid": 65519, 00:16:37.359 "namespaces": [ 00:16:37.359 { 00:16:37.359 "nsid": 1, 00:16:37.359 "bdev_name": "Malloc2", 00:16:37.359 "name": "Malloc2", 00:16:37.359 "nguid": "7BB1668B88D84102811EAA64D8EC3F5D", 00:16:37.359 "uuid": "7bb1668b-88d8-4102-811e-aa64d8ec3f5d" 00:16:37.359 }, 00:16:37.359 { 00:16:37.359 "nsid": 2, 00:16:37.359 "bdev_name": "Malloc4", 00:16:37.359 "name": "Malloc4", 00:16:37.359 "nguid": "B291E724758A4A3D910D09F7DB66697F", 00:16:37.359 "uuid": "b291e724-758a-4a3d-910d-09f7db66697f" 00:16:37.359 } 00:16:37.359 ] 00:16:37.359 } 00:16:37.359 ] 00:16:37.618 19:02:54 -- target/nvmf_vfio_user.sh@44 -- # wait 3070772 00:16:37.618 19:02:54 -- target/nvmf_vfio_user.sh@105 -- # stop_nvmf_vfio_user 00:16:37.618 19:02:54 -- target/nvmf_vfio_user.sh@95 -- # killprocess 3062934 00:16:37.618 19:02:54 -- common/autotest_common.sh@936 -- # '[' -z 3062934 ']' 00:16:37.618 19:02:54 -- common/autotest_common.sh@940 -- # kill -0 3062934 00:16:37.618 19:02:54 -- common/autotest_common.sh@941 -- # uname 00:16:37.618 19:02:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:37.618 19:02:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3062934 00:16:37.618 19:02:54 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:37.618 19:02:54 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:37.618 19:02:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3062934' 00:16:37.618 killing process with pid 3062934 00:16:37.618 19:02:54 -- common/autotest_common.sh@955 -- # kill 3062934 00:16:37.618 [2024-11-26 19:02:54.339698] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:16:37.618 19:02:54 -- common/autotest_common.sh@960 -- # wait 3062934 00:16:37.878 19:02:54 -- target/nvmf_vfio_user.sh@97 -- # rm -rf /var/run/vfio-user 00:16:37.878 19:02:54 -- target/nvmf_vfio_user.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:16:37.878 19:02:54 -- target/nvmf_vfio_user.sh@108 -- # setup_nvmf_vfio_user --interrupt-mode '-M -I' 00:16:37.878 19:02:54 -- target/nvmf_vfio_user.sh@51 -- # local nvmf_app_args=--interrupt-mode 00:16:37.878 19:02:54 -- target/nvmf_vfio_user.sh@52 -- # local 'transport_args=-M -I' 00:16:37.878 19:02:54 -- target/nvmf_vfio_user.sh@55 -- # nvmfpid=3070907 00:16:37.878 19:02:54 -- target/nvmf_vfio_user.sh@57 -- # echo 'Process pid: 3070907' 00:16:37.878 Process pid: 3070907 00:16:37.878 19:02:54 -- target/nvmf_vfio_user.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m '[0,1,2,3]' --interrupt-mode 00:16:37.878 19:02:54 -- target/nvmf_vfio_user.sh@59 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:16:37.878 19:02:54 -- target/nvmf_vfio_user.sh@60 -- # waitforlisten 3070907 00:16:37.878 19:02:54 -- common/autotest_common.sh@829 -- # '[' -z 3070907 ']' 00:16:37.878 19:02:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:37.878 19:02:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:37.878 19:02:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:37.878 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:37.878 19:02:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:37.878 19:02:54 -- common/autotest_common.sh@10 -- # set +x 00:16:37.878 [2024-11-26 19:02:54.639485] thread.c:2929:spdk_interrupt_mode_enable: *NOTICE*: Set SPDK running in interrupt mode. 00:16:37.878 [2024-11-26 19:02:54.640347] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:16:37.878 [2024-11-26 19:02:54.640384] [ DPDK EAL parameters: nvmf -l 0,1,2,3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:37.878 EAL: No free 2048 kB hugepages reported on node 1 00:16:37.878 [2024-11-26 19:02:54.696337] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:37.878 [2024-11-26 19:02:54.733504] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:37.878 [2024-11-26 19:02:54.733637] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:37.878 [2024-11-26 19:02:54.733646] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:37.878 [2024-11-26 19:02:54.733654] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:37.878 [2024-11-26 19:02:54.733706] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:37.878 [2024-11-26 19:02:54.733801] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:37.878 [2024-11-26 19:02:54.733890] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:37.878 [2024-11-26 19:02:54.733891] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:38.137 [2024-11-26 19:02:54.804251] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_0) to intr mode from intr mode. 00:16:38.137 [2024-11-26 19:02:54.804446] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_1) to intr mode from intr mode. 00:16:38.137 [2024-11-26 19:02:54.804639] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_2) to intr mode from intr mode. 00:16:38.137 [2024-11-26 19:02:54.805100] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (app_thread) to intr mode from intr mode. 00:16:38.137 [2024-11-26 19:02:54.805195] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_3) to intr mode from intr mode. 00:16:38.704 19:02:55 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:38.704 19:02:55 -- common/autotest_common.sh@862 -- # return 0 00:16:38.704 19:02:55 -- target/nvmf_vfio_user.sh@62 -- # sleep 1 00:16:39.641 19:02:56 -- target/nvmf_vfio_user.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t VFIOUSER -M -I 00:16:39.901 19:02:56 -- target/nvmf_vfio_user.sh@66 -- # mkdir -p /var/run/vfio-user 00:16:39.901 19:02:56 -- target/nvmf_vfio_user.sh@68 -- # seq 1 2 00:16:39.901 19:02:56 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:16:39.901 19:02:56 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user1/1 00:16:39.901 19:02:56 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:16:40.161 Malloc1 00:16:40.161 19:02:56 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode1 -a -s SPDK1 00:16:40.161 19:02:57 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode1 Malloc1 00:16:40.420 19:02:57 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode1 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user1/1 -s 0 00:16:40.680 19:02:57 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:16:40.680 19:02:57 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user2/2 00:16:40.680 19:02:57 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc2 00:16:40.680 Malloc2 00:16:40.939 19:02:57 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode2 -a -s SPDK2 00:16:40.939 19:02:57 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode2 Malloc2 00:16:41.198 19:02:57 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode2 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user2/2 -s 0 00:16:41.457 19:02:58 -- target/nvmf_vfio_user.sh@109 -- # stop_nvmf_vfio_user 00:16:41.457 19:02:58 -- target/nvmf_vfio_user.sh@95 -- # killprocess 3070907 00:16:41.457 19:02:58 -- common/autotest_common.sh@936 -- # '[' -z 3070907 ']' 00:16:41.457 19:02:58 -- common/autotest_common.sh@940 -- # kill -0 3070907 00:16:41.457 19:02:58 -- common/autotest_common.sh@941 -- # uname 00:16:41.457 19:02:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:41.457 19:02:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3070907 00:16:41.457 19:02:58 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:41.457 19:02:58 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:41.457 19:02:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3070907' 00:16:41.457 killing process with pid 3070907 00:16:41.457 19:02:58 -- common/autotest_common.sh@955 -- # kill 3070907 00:16:41.457 19:02:58 -- common/autotest_common.sh@960 -- # wait 3070907 00:16:41.717 19:02:58 -- target/nvmf_vfio_user.sh@97 -- # rm -rf /var/run/vfio-user 00:16:41.717 19:02:58 -- target/nvmf_vfio_user.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:16:41.717 00:16:41.717 real 0m51.553s 00:16:41.717 user 3m24.353s 00:16:41.717 sys 0m3.653s 00:16:41.717 19:02:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:41.717 19:02:58 -- common/autotest_common.sh@10 -- # set +x 00:16:41.717 ************************************ 00:16:41.717 END TEST nvmf_vfio_user 00:16:41.717 ************************************ 00:16:41.717 19:02:58 -- nvmf/nvmf.sh@41 -- # run_test nvmf_vfio_user_nvme_compliance /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance/compliance.sh --transport=tcp 00:16:41.717 19:02:58 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:41.717 19:02:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:41.717 19:02:58 -- common/autotest_common.sh@10 -- # set +x 00:16:41.717 ************************************ 00:16:41.717 START TEST nvmf_vfio_user_nvme_compliance 00:16:41.717 ************************************ 00:16:41.717 19:02:58 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance/compliance.sh --transport=tcp 00:16:41.717 * Looking for test storage... 00:16:41.717 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance 00:16:41.717 19:02:58 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:41.717 19:02:58 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:41.717 19:02:58 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:41.976 19:02:58 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:41.976 19:02:58 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:41.976 19:02:58 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:41.976 19:02:58 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:41.976 19:02:58 -- scripts/common.sh@335 -- # IFS=.-: 00:16:41.976 19:02:58 -- scripts/common.sh@335 -- # read -ra ver1 00:16:41.976 19:02:58 -- scripts/common.sh@336 -- # IFS=.-: 00:16:41.976 19:02:58 -- scripts/common.sh@336 -- # read -ra ver2 00:16:41.976 19:02:58 -- scripts/common.sh@337 -- # local 'op=<' 00:16:41.976 19:02:58 -- scripts/common.sh@339 -- # ver1_l=2 00:16:41.976 19:02:58 -- scripts/common.sh@340 -- # ver2_l=1 00:16:41.976 19:02:58 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:41.976 19:02:58 -- scripts/common.sh@343 -- # case "$op" in 00:16:41.976 19:02:58 -- scripts/common.sh@344 -- # : 1 00:16:41.976 19:02:58 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:41.976 19:02:58 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:41.976 19:02:58 -- scripts/common.sh@364 -- # decimal 1 00:16:41.976 19:02:58 -- scripts/common.sh@352 -- # local d=1 00:16:41.976 19:02:58 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:41.976 19:02:58 -- scripts/common.sh@354 -- # echo 1 00:16:41.976 19:02:58 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:41.976 19:02:58 -- scripts/common.sh@365 -- # decimal 2 00:16:41.976 19:02:58 -- scripts/common.sh@352 -- # local d=2 00:16:41.976 19:02:58 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:41.976 19:02:58 -- scripts/common.sh@354 -- # echo 2 00:16:41.976 19:02:58 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:41.976 19:02:58 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:41.976 19:02:58 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:41.976 19:02:58 -- scripts/common.sh@367 -- # return 0 00:16:41.976 19:02:58 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:41.976 19:02:58 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:41.976 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:41.976 --rc genhtml_branch_coverage=1 00:16:41.976 --rc genhtml_function_coverage=1 00:16:41.977 --rc genhtml_legend=1 00:16:41.977 --rc geninfo_all_blocks=1 00:16:41.977 --rc geninfo_unexecuted_blocks=1 00:16:41.977 00:16:41.977 ' 00:16:41.977 19:02:58 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:41.977 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:41.977 --rc genhtml_branch_coverage=1 00:16:41.977 --rc genhtml_function_coverage=1 00:16:41.977 --rc genhtml_legend=1 00:16:41.977 --rc geninfo_all_blocks=1 00:16:41.977 --rc geninfo_unexecuted_blocks=1 00:16:41.977 00:16:41.977 ' 00:16:41.977 19:02:58 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:41.977 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:41.977 --rc genhtml_branch_coverage=1 00:16:41.977 --rc genhtml_function_coverage=1 00:16:41.977 --rc genhtml_legend=1 00:16:41.977 --rc geninfo_all_blocks=1 00:16:41.977 --rc geninfo_unexecuted_blocks=1 00:16:41.977 00:16:41.977 ' 00:16:41.977 19:02:58 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:41.977 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:41.977 --rc genhtml_branch_coverage=1 00:16:41.977 --rc genhtml_function_coverage=1 00:16:41.977 --rc genhtml_legend=1 00:16:41.977 --rc geninfo_all_blocks=1 00:16:41.977 --rc geninfo_unexecuted_blocks=1 00:16:41.977 00:16:41.977 ' 00:16:41.977 19:02:58 -- compliance/compliance.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:41.977 19:02:58 -- nvmf/common.sh@7 -- # uname -s 00:16:41.977 19:02:58 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:41.977 19:02:58 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:41.977 19:02:58 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:41.977 19:02:58 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:41.977 19:02:58 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:41.977 19:02:58 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:41.977 19:02:58 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:41.977 19:02:58 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:41.977 19:02:58 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:41.977 19:02:58 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:41.977 19:02:58 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:16:41.977 19:02:58 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:16:41.977 19:02:58 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:41.977 19:02:58 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:41.977 19:02:58 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:41.977 19:02:58 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:41.977 19:02:58 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:41.977 19:02:58 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:41.977 19:02:58 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:41.977 19:02:58 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:41.977 19:02:58 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:41.977 19:02:58 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:41.977 19:02:58 -- paths/export.sh@5 -- # export PATH 00:16:41.977 19:02:58 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:41.977 19:02:58 -- nvmf/common.sh@46 -- # : 0 00:16:41.977 19:02:58 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:41.977 19:02:58 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:41.977 19:02:58 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:41.977 19:02:58 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:41.977 19:02:58 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:41.977 19:02:58 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:41.977 19:02:58 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:41.977 19:02:58 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:41.977 19:02:58 -- compliance/compliance.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:41.977 19:02:58 -- compliance/compliance.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:41.977 19:02:58 -- compliance/compliance.sh@14 -- # export TEST_TRANSPORT=VFIOUSER 00:16:41.977 19:02:58 -- compliance/compliance.sh@14 -- # TEST_TRANSPORT=VFIOUSER 00:16:41.977 19:02:58 -- compliance/compliance.sh@16 -- # rm -rf /var/run/vfio-user 00:16:41.977 19:02:58 -- compliance/compliance.sh@20 -- # nvmfpid=3071631 00:16:41.977 19:02:58 -- compliance/compliance.sh@21 -- # echo 'Process pid: 3071631' 00:16:41.977 Process pid: 3071631 00:16:41.977 19:02:58 -- compliance/compliance.sh@23 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:16:41.977 19:02:58 -- compliance/compliance.sh@24 -- # waitforlisten 3071631 00:16:41.977 19:02:58 -- common/autotest_common.sh@829 -- # '[' -z 3071631 ']' 00:16:41.977 19:02:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:41.977 19:02:58 -- compliance/compliance.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:16:41.977 19:02:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:41.977 19:02:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:41.977 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:41.977 19:02:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:41.977 19:02:58 -- common/autotest_common.sh@10 -- # set +x 00:16:41.977 [2024-11-26 19:02:58.730165] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:16:41.977 [2024-11-26 19:02:58.730214] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:41.977 EAL: No free 2048 kB hugepages reported on node 1 00:16:41.977 [2024-11-26 19:02:58.785967] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:16:41.977 [2024-11-26 19:02:58.825817] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:41.977 [2024-11-26 19:02:58.825963] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:41.977 [2024-11-26 19:02:58.825972] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:41.977 [2024-11-26 19:02:58.825979] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:41.977 [2024-11-26 19:02:58.826016] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:41.977 [2024-11-26 19:02:58.826126] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:41.977 [2024-11-26 19:02:58.826126] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:42.913 19:02:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:42.913 19:02:59 -- common/autotest_common.sh@862 -- # return 0 00:16:42.913 19:02:59 -- compliance/compliance.sh@26 -- # sleep 1 00:16:43.850 19:03:00 -- compliance/compliance.sh@28 -- # nqn=nqn.2021-09.io.spdk:cnode0 00:16:43.850 19:03:00 -- compliance/compliance.sh@29 -- # traddr=/var/run/vfio-user 00:16:43.850 19:03:00 -- compliance/compliance.sh@31 -- # rpc_cmd nvmf_create_transport -t VFIOUSER 00:16:43.850 19:03:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:43.850 19:03:00 -- common/autotest_common.sh@10 -- # set +x 00:16:43.850 19:03:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:43.850 19:03:00 -- compliance/compliance.sh@33 -- # mkdir -p /var/run/vfio-user 00:16:43.850 19:03:00 -- compliance/compliance.sh@35 -- # rpc_cmd bdev_malloc_create 64 512 -b malloc0 00:16:43.850 19:03:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:43.850 19:03:00 -- common/autotest_common.sh@10 -- # set +x 00:16:43.850 malloc0 00:16:43.850 19:03:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:43.850 19:03:00 -- compliance/compliance.sh@36 -- # rpc_cmd nvmf_create_subsystem nqn.2021-09.io.spdk:cnode0 -a -s spdk -m 32 00:16:43.850 19:03:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:43.850 19:03:00 -- common/autotest_common.sh@10 -- # set +x 00:16:43.850 19:03:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:43.850 19:03:00 -- compliance/compliance.sh@37 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2021-09.io.spdk:cnode0 malloc0 00:16:43.850 19:03:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:43.850 19:03:00 -- common/autotest_common.sh@10 -- # set +x 00:16:43.850 19:03:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:43.850 19:03:00 -- compliance/compliance.sh@38 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2021-09.io.spdk:cnode0 -t VFIOUSER -a /var/run/vfio-user -s 0 00:16:43.850 19:03:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:43.850 19:03:00 -- common/autotest_common.sh@10 -- # set +x 00:16:43.850 19:03:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:43.850 19:03:00 -- compliance/compliance.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance/nvme_compliance -g -r 'trtype:VFIOUSER traddr:/var/run/vfio-user subnqn:nqn.2021-09.io.spdk:cnode0' 00:16:43.850 EAL: No free 2048 kB hugepages reported on node 1 00:16:43.850 00:16:43.851 00:16:43.851 CUnit - A unit testing framework for C - Version 2.1-3 00:16:43.851 http://cunit.sourceforge.net/ 00:16:43.851 00:16:43.851 00:16:43.851 Suite: nvme_compliance 00:16:44.111 Test: admin_identify_ctrlr_verify_dptr ...[2024-11-26 19:03:00.789046] vfio_user.c: 789:nvme_cmd_map_prps: *ERROR*: no PRP2, 3072 remaining 00:16:44.111 [2024-11-26 19:03:00.789078] vfio_user.c:5484:map_admin_cmd_req: *ERROR*: /var/run/vfio-user: map Admin Opc 6 failed 00:16:44.111 [2024-11-26 19:03:00.789084] vfio_user.c:5576:handle_cmd_req: *ERROR*: /var/run/vfio-user: process NVMe command opc 0x6 failed 00:16:44.111 passed 00:16:44.111 Test: admin_identify_ctrlr_verify_fused ...passed 00:16:44.111 Test: admin_identify_ns ...[2024-11-26 19:03:01.019961] ctrlr.c:2598:_nvmf_subsystem_get_ns_safe: *ERROR*: Identify Namespace for invalid NSID 0 00:16:44.111 [2024-11-26 19:03:01.027958] ctrlr.c:2598:_nvmf_subsystem_get_ns_safe: *ERROR*: Identify Namespace for invalid NSID 4294967295 00:16:44.370 passed 00:16:44.370 Test: admin_get_features_mandatory_features ...passed 00:16:44.370 Test: admin_get_features_optional_features ...passed 00:16:44.633 Test: admin_set_features_number_of_queues ...passed 00:16:44.633 Test: admin_get_log_page_mandatory_logs ...passed 00:16:44.892 Test: admin_get_log_page_with_lpo ...[2024-11-26 19:03:01.635968] ctrlr.c:2546:nvmf_ctrlr_get_log_page: *ERROR*: Get log page: offset (516) > len (512) 00:16:44.892 passed 00:16:44.892 Test: fabric_property_get ...passed 00:16:44.892 Test: admin_delete_io_sq_use_admin_qid ...[2024-11-26 19:03:01.812366] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:0 does not exist 00:16:45.151 passed 00:16:45.151 Test: admin_delete_io_sq_delete_sq_twice ...[2024-11-26 19:03:01.978957] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:1 does not exist 00:16:45.151 [2024-11-26 19:03:01.994958] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:1 does not exist 00:16:45.151 passed 00:16:45.409 Test: admin_delete_io_cq_use_admin_qid ...[2024-11-26 19:03:02.081554] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O cqid:0 does not exist 00:16:45.409 passed 00:16:45.409 Test: admin_delete_io_cq_delete_cq_first ...[2024-11-26 19:03:02.242965] vfio_user.c:2310:handle_del_io_q: *ERROR*: /var/run/vfio-user: the associated SQ must be deleted first 00:16:45.409 [2024-11-26 19:03:02.266955] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:1 does not exist 00:16:45.409 passed 00:16:45.667 Test: admin_create_io_cq_verify_iv_pc ...[2024-11-26 19:03:02.350873] vfio_user.c:2150:handle_create_io_cq: *ERROR*: /var/run/vfio-user: IV is too big 00:16:45.667 [2024-11-26 19:03:02.350905] vfio_user.c:2144:handle_create_io_cq: *ERROR*: /var/run/vfio-user: non-PC CQ not supported 00:16:45.667 passed 00:16:45.667 Test: admin_create_io_sq_verify_qsize_cqid ...[2024-11-26 19:03:02.525963] vfio_user.c:2231:handle_create_io_q: *ERROR*: /var/run/vfio-user: invalid I/O queue size 1 00:16:45.667 [2024-11-26 19:03:02.533954] vfio_user.c:2231:handle_create_io_q: *ERROR*: /var/run/vfio-user: invalid I/O queue size 257 00:16:45.667 [2024-11-26 19:03:02.541959] vfio_user.c:2031:handle_create_io_sq: *ERROR*: /var/run/vfio-user: invalid cqid:0 00:16:45.667 [2024-11-26 19:03:02.549956] vfio_user.c:2031:handle_create_io_sq: *ERROR*: /var/run/vfio-user: invalid cqid:128 00:16:45.925 passed 00:16:45.925 Test: admin_create_io_sq_verify_pc ...[2024-11-26 19:03:02.676960] vfio_user.c:2044:handle_create_io_sq: *ERROR*: /var/run/vfio-user: non-PC SQ not supported 00:16:45.925 passed 00:16:47.426 Test: admin_create_io_qp_max_qps ...[2024-11-26 19:03:03.876958] nvme_ctrlr.c:5318:spdk_nvme_ctrlr_alloc_qid: *ERROR*: [/var/run/vfio-user] No free I/O queue IDs 00:16:47.426 passed 00:16:47.740 Test: admin_create_io_sq_shared_cq ...[2024-11-26 19:03:04.475962] vfio_user.c:2310:handle_del_io_q: *ERROR*: /var/run/vfio-user: the associated SQ must be deleted first 00:16:47.740 passed 00:16:47.740 00:16:47.740 Run Summary: Type Total Ran Passed Failed Inactive 00:16:47.740 suites 1 1 n/a 0 0 00:16:47.740 tests 18 18 18 0 0 00:16:47.740 asserts 360 360 360 0 n/a 00:16:47.740 00:16:47.741 Elapsed time = 1.537 seconds 00:16:47.741 19:03:04 -- compliance/compliance.sh@42 -- # killprocess 3071631 00:16:47.741 19:03:04 -- common/autotest_common.sh@936 -- # '[' -z 3071631 ']' 00:16:47.741 19:03:04 -- common/autotest_common.sh@940 -- # kill -0 3071631 00:16:47.741 19:03:04 -- common/autotest_common.sh@941 -- # uname 00:16:47.741 19:03:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:47.741 19:03:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3071631 00:16:47.741 19:03:04 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:47.741 19:03:04 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:47.741 19:03:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3071631' 00:16:47.741 killing process with pid 3071631 00:16:47.741 19:03:04 -- common/autotest_common.sh@955 -- # kill 3071631 00:16:47.741 19:03:04 -- common/autotest_common.sh@960 -- # wait 3071631 00:16:48.000 19:03:04 -- compliance/compliance.sh@44 -- # rm -rf /var/run/vfio-user 00:16:48.000 19:03:04 -- compliance/compliance.sh@46 -- # trap - SIGINT SIGTERM EXIT 00:16:48.000 00:16:48.000 real 0m6.307s 00:16:48.000 user 0m17.944s 00:16:48.000 sys 0m0.551s 00:16:48.000 19:03:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:48.000 19:03:04 -- common/autotest_common.sh@10 -- # set +x 00:16:48.000 ************************************ 00:16:48.000 END TEST nvmf_vfio_user_nvme_compliance 00:16:48.000 ************************************ 00:16:48.000 19:03:04 -- nvmf/nvmf.sh@42 -- # run_test nvmf_vfio_user_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/vfio_user_fuzz.sh --transport=tcp 00:16:48.000 19:03:04 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:48.000 19:03:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:48.000 19:03:04 -- common/autotest_common.sh@10 -- # set +x 00:16:48.000 ************************************ 00:16:48.000 START TEST nvmf_vfio_user_fuzz 00:16:48.000 ************************************ 00:16:48.000 19:03:04 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/vfio_user_fuzz.sh --transport=tcp 00:16:48.000 * Looking for test storage... 00:16:48.259 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:48.259 19:03:04 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:48.259 19:03:04 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:48.259 19:03:04 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:48.259 19:03:04 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:48.259 19:03:04 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:48.259 19:03:04 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:48.259 19:03:04 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:48.259 19:03:04 -- scripts/common.sh@335 -- # IFS=.-: 00:16:48.259 19:03:04 -- scripts/common.sh@335 -- # read -ra ver1 00:16:48.259 19:03:05 -- scripts/common.sh@336 -- # IFS=.-: 00:16:48.259 19:03:05 -- scripts/common.sh@336 -- # read -ra ver2 00:16:48.259 19:03:05 -- scripts/common.sh@337 -- # local 'op=<' 00:16:48.259 19:03:05 -- scripts/common.sh@339 -- # ver1_l=2 00:16:48.259 19:03:05 -- scripts/common.sh@340 -- # ver2_l=1 00:16:48.259 19:03:05 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:48.259 19:03:05 -- scripts/common.sh@343 -- # case "$op" in 00:16:48.259 19:03:05 -- scripts/common.sh@344 -- # : 1 00:16:48.259 19:03:05 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:48.259 19:03:05 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:48.259 19:03:05 -- scripts/common.sh@364 -- # decimal 1 00:16:48.259 19:03:05 -- scripts/common.sh@352 -- # local d=1 00:16:48.259 19:03:05 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:48.259 19:03:05 -- scripts/common.sh@354 -- # echo 1 00:16:48.259 19:03:05 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:48.259 19:03:05 -- scripts/common.sh@365 -- # decimal 2 00:16:48.259 19:03:05 -- scripts/common.sh@352 -- # local d=2 00:16:48.259 19:03:05 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:48.259 19:03:05 -- scripts/common.sh@354 -- # echo 2 00:16:48.259 19:03:05 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:48.259 19:03:05 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:48.259 19:03:05 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:48.259 19:03:05 -- scripts/common.sh@367 -- # return 0 00:16:48.259 19:03:05 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:48.259 19:03:05 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:48.259 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:48.259 --rc genhtml_branch_coverage=1 00:16:48.259 --rc genhtml_function_coverage=1 00:16:48.259 --rc genhtml_legend=1 00:16:48.259 --rc geninfo_all_blocks=1 00:16:48.259 --rc geninfo_unexecuted_blocks=1 00:16:48.259 00:16:48.259 ' 00:16:48.259 19:03:05 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:48.259 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:48.259 --rc genhtml_branch_coverage=1 00:16:48.259 --rc genhtml_function_coverage=1 00:16:48.259 --rc genhtml_legend=1 00:16:48.259 --rc geninfo_all_blocks=1 00:16:48.259 --rc geninfo_unexecuted_blocks=1 00:16:48.259 00:16:48.259 ' 00:16:48.259 19:03:05 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:48.259 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:48.259 --rc genhtml_branch_coverage=1 00:16:48.259 --rc genhtml_function_coverage=1 00:16:48.259 --rc genhtml_legend=1 00:16:48.259 --rc geninfo_all_blocks=1 00:16:48.259 --rc geninfo_unexecuted_blocks=1 00:16:48.259 00:16:48.259 ' 00:16:48.259 19:03:05 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:48.259 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:48.259 --rc genhtml_branch_coverage=1 00:16:48.259 --rc genhtml_function_coverage=1 00:16:48.259 --rc genhtml_legend=1 00:16:48.259 --rc geninfo_all_blocks=1 00:16:48.259 --rc geninfo_unexecuted_blocks=1 00:16:48.259 00:16:48.259 ' 00:16:48.259 19:03:05 -- target/vfio_user_fuzz.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:48.259 19:03:05 -- nvmf/common.sh@7 -- # uname -s 00:16:48.259 19:03:05 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:48.259 19:03:05 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:48.259 19:03:05 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:48.259 19:03:05 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:48.259 19:03:05 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:48.259 19:03:05 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:48.259 19:03:05 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:48.259 19:03:05 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:48.259 19:03:05 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:48.259 19:03:05 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:48.259 19:03:05 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:16:48.259 19:03:05 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:16:48.259 19:03:05 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:48.259 19:03:05 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:48.259 19:03:05 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:48.259 19:03:05 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:48.259 19:03:05 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:48.259 19:03:05 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:48.259 19:03:05 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:48.259 19:03:05 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:48.259 19:03:05 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:48.259 19:03:05 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:48.259 19:03:05 -- paths/export.sh@5 -- # export PATH 00:16:48.259 19:03:05 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:48.259 19:03:05 -- nvmf/common.sh@46 -- # : 0 00:16:48.259 19:03:05 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:48.259 19:03:05 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:48.259 19:03:05 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:48.259 19:03:05 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:48.259 19:03:05 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:48.259 19:03:05 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:48.259 19:03:05 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:48.259 19:03:05 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:48.259 19:03:05 -- target/vfio_user_fuzz.sh@12 -- # MALLOC_BDEV_SIZE=64 00:16:48.259 19:03:05 -- target/vfio_user_fuzz.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:16:48.259 19:03:05 -- target/vfio_user_fuzz.sh@15 -- # nqn=nqn.2021-09.io.spdk:cnode0 00:16:48.259 19:03:05 -- target/vfio_user_fuzz.sh@16 -- # traddr=/var/run/vfio-user 00:16:48.259 19:03:05 -- target/vfio_user_fuzz.sh@18 -- # export TEST_TRANSPORT=VFIOUSER 00:16:48.259 19:03:05 -- target/vfio_user_fuzz.sh@18 -- # TEST_TRANSPORT=VFIOUSER 00:16:48.259 19:03:05 -- target/vfio_user_fuzz.sh@20 -- # rm -rf /var/run/vfio-user 00:16:48.259 19:03:05 -- target/vfio_user_fuzz.sh@24 -- # nvmfpid=3072930 00:16:48.259 19:03:05 -- target/vfio_user_fuzz.sh@25 -- # echo 'Process pid: 3072930' 00:16:48.259 Process pid: 3072930 00:16:48.259 19:03:05 -- target/vfio_user_fuzz.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:16:48.259 19:03:05 -- target/vfio_user_fuzz.sh@27 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:16:48.259 19:03:05 -- target/vfio_user_fuzz.sh@28 -- # waitforlisten 3072930 00:16:48.259 19:03:05 -- common/autotest_common.sh@829 -- # '[' -z 3072930 ']' 00:16:48.259 19:03:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:48.259 19:03:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:48.259 19:03:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:48.259 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:48.259 19:03:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:48.259 19:03:05 -- common/autotest_common.sh@10 -- # set +x 00:16:49.196 19:03:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:49.196 19:03:05 -- common/autotest_common.sh@862 -- # return 0 00:16:49.196 19:03:05 -- target/vfio_user_fuzz.sh@30 -- # sleep 1 00:16:50.133 19:03:06 -- target/vfio_user_fuzz.sh@32 -- # rpc_cmd nvmf_create_transport -t VFIOUSER 00:16:50.133 19:03:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:50.133 19:03:06 -- common/autotest_common.sh@10 -- # set +x 00:16:50.133 19:03:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:50.133 19:03:06 -- target/vfio_user_fuzz.sh@34 -- # mkdir -p /var/run/vfio-user 00:16:50.133 19:03:06 -- target/vfio_user_fuzz.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b malloc0 00:16:50.133 19:03:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:50.133 19:03:06 -- common/autotest_common.sh@10 -- # set +x 00:16:50.133 malloc0 00:16:50.133 19:03:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:50.133 19:03:06 -- target/vfio_user_fuzz.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2021-09.io.spdk:cnode0 -a -s spdk 00:16:50.133 19:03:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:50.133 19:03:06 -- common/autotest_common.sh@10 -- # set +x 00:16:50.133 19:03:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:50.133 19:03:06 -- target/vfio_user_fuzz.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2021-09.io.spdk:cnode0 malloc0 00:16:50.133 19:03:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:50.133 19:03:06 -- common/autotest_common.sh@10 -- # set +x 00:16:50.133 19:03:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:50.133 19:03:06 -- target/vfio_user_fuzz.sh@39 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2021-09.io.spdk:cnode0 -t VFIOUSER -a /var/run/vfio-user -s 0 00:16:50.133 19:03:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:50.133 19:03:06 -- common/autotest_common.sh@10 -- # set +x 00:16:50.133 19:03:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:50.133 19:03:07 -- target/vfio_user_fuzz.sh@41 -- # trid='trtype:VFIOUSER subnqn:nqn.2021-09.io.spdk:cnode0 traddr:/var/run/vfio-user' 00:16:50.133 19:03:07 -- target/vfio_user_fuzz.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/vfio_user_fuzz -t 30 -S 123456 -F 'trtype:VFIOUSER subnqn:nqn.2021-09.io.spdk:cnode0 traddr:/var/run/vfio-user' -N -a 00:17:22.202 Fuzzing completed. Shutting down the fuzz application 00:17:22.202 00:17:22.202 Dumping successful admin opcodes: 00:17:22.202 8, 9, 10, 24, 00:17:22.202 Dumping successful io opcodes: 00:17:22.202 0, 00:17:22.202 NS: 0x200003a1ef00 I/O qp, Total commands completed: 987456, total successful commands: 3869, random_seed: 4080382528 00:17:22.202 NS: 0x200003a1ef00 admin qp, Total commands completed: 246848, total successful commands: 1989, random_seed: 3785143168 00:17:22.202 19:03:37 -- target/vfio_user_fuzz.sh@44 -- # rpc_cmd nvmf_delete_subsystem nqn.2021-09.io.spdk:cnode0 00:17:22.202 19:03:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:22.202 19:03:37 -- common/autotest_common.sh@10 -- # set +x 00:17:22.202 19:03:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:22.202 19:03:37 -- target/vfio_user_fuzz.sh@46 -- # killprocess 3072930 00:17:22.202 19:03:37 -- common/autotest_common.sh@936 -- # '[' -z 3072930 ']' 00:17:22.202 19:03:37 -- common/autotest_common.sh@940 -- # kill -0 3072930 00:17:22.202 19:03:37 -- common/autotest_common.sh@941 -- # uname 00:17:22.202 19:03:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:22.202 19:03:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3072930 00:17:22.202 19:03:37 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:17:22.202 19:03:37 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:17:22.202 19:03:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3072930' 00:17:22.202 killing process with pid 3072930 00:17:22.202 19:03:37 -- common/autotest_common.sh@955 -- # kill 3072930 00:17:22.202 19:03:37 -- common/autotest_common.sh@960 -- # wait 3072930 00:17:22.202 19:03:37 -- target/vfio_user_fuzz.sh@48 -- # rm -rf /var/run/vfio-user /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/vfio_user_fuzz_log.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/vfio_user_fuzz_tgt_output.txt 00:17:22.202 19:03:37 -- target/vfio_user_fuzz.sh@50 -- # trap - SIGINT SIGTERM EXIT 00:17:22.202 00:17:22.202 real 0m32.851s 00:17:22.202 user 0m33.906s 00:17:22.202 sys 0m27.637s 00:17:22.202 19:03:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:22.202 19:03:37 -- common/autotest_common.sh@10 -- # set +x 00:17:22.202 ************************************ 00:17:22.202 END TEST nvmf_vfio_user_fuzz 00:17:22.202 ************************************ 00:17:22.202 19:03:37 -- nvmf/nvmf.sh@46 -- # run_test nvmf_host_management /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:17:22.202 19:03:37 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:22.202 19:03:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:22.202 19:03:37 -- common/autotest_common.sh@10 -- # set +x 00:17:22.202 ************************************ 00:17:22.202 START TEST nvmf_host_management 00:17:22.202 ************************************ 00:17:22.202 19:03:37 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:17:22.202 * Looking for test storage... 00:17:22.202 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:22.202 19:03:37 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:22.202 19:03:37 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:22.202 19:03:37 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:22.202 19:03:37 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:22.202 19:03:37 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:22.202 19:03:37 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:22.202 19:03:37 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:22.202 19:03:37 -- scripts/common.sh@335 -- # IFS=.-: 00:17:22.202 19:03:37 -- scripts/common.sh@335 -- # read -ra ver1 00:17:22.202 19:03:37 -- scripts/common.sh@336 -- # IFS=.-: 00:17:22.202 19:03:37 -- scripts/common.sh@336 -- # read -ra ver2 00:17:22.202 19:03:37 -- scripts/common.sh@337 -- # local 'op=<' 00:17:22.202 19:03:37 -- scripts/common.sh@339 -- # ver1_l=2 00:17:22.202 19:03:37 -- scripts/common.sh@340 -- # ver2_l=1 00:17:22.202 19:03:37 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:22.202 19:03:37 -- scripts/common.sh@343 -- # case "$op" in 00:17:22.202 19:03:37 -- scripts/common.sh@344 -- # : 1 00:17:22.202 19:03:37 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:22.202 19:03:37 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:22.202 19:03:37 -- scripts/common.sh@364 -- # decimal 1 00:17:22.202 19:03:37 -- scripts/common.sh@352 -- # local d=1 00:17:22.202 19:03:37 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:22.202 19:03:37 -- scripts/common.sh@354 -- # echo 1 00:17:22.202 19:03:37 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:22.202 19:03:37 -- scripts/common.sh@365 -- # decimal 2 00:17:22.202 19:03:37 -- scripts/common.sh@352 -- # local d=2 00:17:22.202 19:03:37 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:22.202 19:03:37 -- scripts/common.sh@354 -- # echo 2 00:17:22.202 19:03:37 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:22.202 19:03:37 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:22.202 19:03:37 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:22.202 19:03:37 -- scripts/common.sh@367 -- # return 0 00:17:22.202 19:03:37 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:22.202 19:03:37 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:22.202 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:22.202 --rc genhtml_branch_coverage=1 00:17:22.202 --rc genhtml_function_coverage=1 00:17:22.202 --rc genhtml_legend=1 00:17:22.202 --rc geninfo_all_blocks=1 00:17:22.202 --rc geninfo_unexecuted_blocks=1 00:17:22.202 00:17:22.202 ' 00:17:22.202 19:03:37 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:22.202 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:22.202 --rc genhtml_branch_coverage=1 00:17:22.202 --rc genhtml_function_coverage=1 00:17:22.202 --rc genhtml_legend=1 00:17:22.202 --rc geninfo_all_blocks=1 00:17:22.202 --rc geninfo_unexecuted_blocks=1 00:17:22.202 00:17:22.202 ' 00:17:22.202 19:03:37 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:22.202 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:22.202 --rc genhtml_branch_coverage=1 00:17:22.202 --rc genhtml_function_coverage=1 00:17:22.202 --rc genhtml_legend=1 00:17:22.202 --rc geninfo_all_blocks=1 00:17:22.202 --rc geninfo_unexecuted_blocks=1 00:17:22.202 00:17:22.202 ' 00:17:22.202 19:03:37 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:22.202 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:22.202 --rc genhtml_branch_coverage=1 00:17:22.202 --rc genhtml_function_coverage=1 00:17:22.203 --rc genhtml_legend=1 00:17:22.203 --rc geninfo_all_blocks=1 00:17:22.203 --rc geninfo_unexecuted_blocks=1 00:17:22.203 00:17:22.203 ' 00:17:22.203 19:03:37 -- target/host_management.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:22.203 19:03:37 -- nvmf/common.sh@7 -- # uname -s 00:17:22.203 19:03:37 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:22.203 19:03:37 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:22.203 19:03:37 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:22.203 19:03:37 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:22.203 19:03:37 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:22.203 19:03:37 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:22.203 19:03:37 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:22.203 19:03:37 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:22.203 19:03:37 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:22.203 19:03:37 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:22.203 19:03:37 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:17:22.203 19:03:37 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:17:22.203 19:03:37 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:22.203 19:03:37 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:22.203 19:03:37 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:22.203 19:03:37 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:22.203 19:03:37 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:22.203 19:03:37 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:22.203 19:03:37 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:22.203 19:03:37 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:22.203 19:03:37 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:22.203 19:03:37 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:22.203 19:03:37 -- paths/export.sh@5 -- # export PATH 00:17:22.203 19:03:37 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:22.203 19:03:37 -- nvmf/common.sh@46 -- # : 0 00:17:22.203 19:03:37 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:22.203 19:03:37 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:22.203 19:03:37 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:22.203 19:03:37 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:22.203 19:03:37 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:22.203 19:03:37 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:22.203 19:03:37 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:22.203 19:03:37 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:22.203 19:03:37 -- target/host_management.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:22.203 19:03:37 -- target/host_management.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:22.203 19:03:37 -- target/host_management.sh@104 -- # nvmftestinit 00:17:22.203 19:03:37 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:22.203 19:03:37 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:22.203 19:03:37 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:22.203 19:03:37 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:22.203 19:03:37 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:22.203 19:03:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:22.203 19:03:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:22.203 19:03:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:22.203 19:03:37 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:22.203 19:03:37 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:22.203 19:03:37 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:22.203 19:03:37 -- common/autotest_common.sh@10 -- # set +x 00:17:26.388 19:03:42 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:26.388 19:03:42 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:26.388 19:03:42 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:26.388 19:03:42 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:26.388 19:03:42 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:26.388 19:03:42 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:26.388 19:03:42 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:26.388 19:03:42 -- nvmf/common.sh@294 -- # net_devs=() 00:17:26.388 19:03:42 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:26.388 19:03:42 -- nvmf/common.sh@295 -- # e810=() 00:17:26.388 19:03:42 -- nvmf/common.sh@295 -- # local -ga e810 00:17:26.388 19:03:42 -- nvmf/common.sh@296 -- # x722=() 00:17:26.388 19:03:42 -- nvmf/common.sh@296 -- # local -ga x722 00:17:26.388 19:03:42 -- nvmf/common.sh@297 -- # mlx=() 00:17:26.388 19:03:42 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:26.388 19:03:42 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:26.388 19:03:42 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:26.388 19:03:42 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:26.388 19:03:42 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:26.388 19:03:42 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:26.388 19:03:42 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:26.388 19:03:42 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:26.388 19:03:42 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:26.388 19:03:42 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:26.388 19:03:42 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:26.388 19:03:42 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:26.388 19:03:42 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:26.388 19:03:42 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:26.388 19:03:42 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:26.388 19:03:42 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:26.388 19:03:42 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:26.388 19:03:42 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:26.388 19:03:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:26.388 19:03:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:17:26.388 Found 0000:86:00.0 (0x8086 - 0x159b) 00:17:26.388 19:03:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:26.388 19:03:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:26.388 19:03:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:26.388 19:03:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:26.388 19:03:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:26.388 19:03:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:26.388 19:03:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:17:26.388 Found 0000:86:00.1 (0x8086 - 0x159b) 00:17:26.388 19:03:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:26.388 19:03:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:26.388 19:03:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:26.388 19:03:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:26.388 19:03:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:26.388 19:03:42 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:26.388 19:03:42 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:26.388 19:03:42 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:26.388 19:03:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:26.388 19:03:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:26.388 19:03:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:26.388 19:03:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:26.388 19:03:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:17:26.388 Found net devices under 0000:86:00.0: cvl_0_0 00:17:26.388 19:03:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:26.388 19:03:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:26.388 19:03:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:26.388 19:03:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:26.388 19:03:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:26.388 19:03:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:17:26.388 Found net devices under 0000:86:00.1: cvl_0_1 00:17:26.388 19:03:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:26.388 19:03:42 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:26.388 19:03:42 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:26.388 19:03:42 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:26.388 19:03:42 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:26.388 19:03:42 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:26.388 19:03:42 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:26.388 19:03:42 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:26.388 19:03:42 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:26.388 19:03:42 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:26.388 19:03:42 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:26.388 19:03:42 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:26.388 19:03:42 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:26.388 19:03:42 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:26.388 19:03:42 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:26.388 19:03:42 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:26.389 19:03:42 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:26.389 19:03:42 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:26.389 19:03:42 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:26.389 19:03:43 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:26.389 19:03:43 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:26.389 19:03:43 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:26.389 19:03:43 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:26.389 19:03:43 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:26.389 19:03:43 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:26.389 19:03:43 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:26.389 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:26.389 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.421 ms 00:17:26.389 00:17:26.389 --- 10.0.0.2 ping statistics --- 00:17:26.389 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:26.389 rtt min/avg/max/mdev = 0.421/0.421/0.421/0.000 ms 00:17:26.389 19:03:43 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:26.389 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:26.389 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.192 ms 00:17:26.389 00:17:26.389 --- 10.0.0.1 ping statistics --- 00:17:26.389 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:26.389 rtt min/avg/max/mdev = 0.192/0.192/0.192/0.000 ms 00:17:26.389 19:03:43 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:26.389 19:03:43 -- nvmf/common.sh@410 -- # return 0 00:17:26.389 19:03:43 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:26.389 19:03:43 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:26.389 19:03:43 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:26.389 19:03:43 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:26.389 19:03:43 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:26.389 19:03:43 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:26.389 19:03:43 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:26.389 19:03:43 -- target/host_management.sh@106 -- # run_test nvmf_host_management nvmf_host_management 00:17:26.389 19:03:43 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:17:26.389 19:03:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:26.389 19:03:43 -- common/autotest_common.sh@10 -- # set +x 00:17:26.389 ************************************ 00:17:26.389 START TEST nvmf_host_management 00:17:26.389 ************************************ 00:17:26.389 19:03:43 -- common/autotest_common.sh@1114 -- # nvmf_host_management 00:17:26.389 19:03:43 -- target/host_management.sh@69 -- # starttarget 00:17:26.389 19:03:43 -- target/host_management.sh@16 -- # nvmfappstart -m 0x1E 00:17:26.389 19:03:43 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:26.389 19:03:43 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:26.389 19:03:43 -- common/autotest_common.sh@10 -- # set +x 00:17:26.389 19:03:43 -- nvmf/common.sh@469 -- # nvmfpid=3081791 00:17:26.389 19:03:43 -- nvmf/common.sh@470 -- # waitforlisten 3081791 00:17:26.389 19:03:43 -- common/autotest_common.sh@829 -- # '[' -z 3081791 ']' 00:17:26.389 19:03:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:26.389 19:03:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:26.389 19:03:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:26.389 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:26.389 19:03:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:26.389 19:03:43 -- common/autotest_common.sh@10 -- # set +x 00:17:26.389 19:03:43 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:17:26.389 [2024-11-26 19:03:43.272891] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:17:26.389 [2024-11-26 19:03:43.272936] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:26.389 EAL: No free 2048 kB hugepages reported on node 1 00:17:26.647 [2024-11-26 19:03:43.332361] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:26.647 [2024-11-26 19:03:43.373541] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:26.647 [2024-11-26 19:03:43.373660] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:26.647 [2024-11-26 19:03:43.373669] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:26.647 [2024-11-26 19:03:43.373675] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:26.647 [2024-11-26 19:03:43.373780] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:26.647 [2024-11-26 19:03:43.373864] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:17:26.647 [2024-11-26 19:03:43.373985] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:26.647 [2024-11-26 19:03:43.373986] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:17:27.212 19:03:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:27.212 19:03:44 -- common/autotest_common.sh@862 -- # return 0 00:17:27.212 19:03:44 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:27.212 19:03:44 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:27.212 19:03:44 -- common/autotest_common.sh@10 -- # set +x 00:17:27.212 19:03:44 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:27.212 19:03:44 -- target/host_management.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:17:27.212 19:03:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:27.212 19:03:44 -- common/autotest_common.sh@10 -- # set +x 00:17:27.471 [2024-11-26 19:03:44.139499] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:27.471 19:03:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:27.471 19:03:44 -- target/host_management.sh@20 -- # timing_enter create_subsystem 00:17:27.471 19:03:44 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:27.471 19:03:44 -- common/autotest_common.sh@10 -- # set +x 00:17:27.471 19:03:44 -- target/host_management.sh@22 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:17:27.471 19:03:44 -- target/host_management.sh@23 -- # cat 00:17:27.471 19:03:44 -- target/host_management.sh@30 -- # rpc_cmd 00:17:27.471 19:03:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:27.471 19:03:44 -- common/autotest_common.sh@10 -- # set +x 00:17:27.471 Malloc0 00:17:27.471 [2024-11-26 19:03:44.199420] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:27.471 19:03:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:27.471 19:03:44 -- target/host_management.sh@31 -- # timing_exit create_subsystems 00:17:27.471 19:03:44 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:27.471 19:03:44 -- common/autotest_common.sh@10 -- # set +x 00:17:27.471 19:03:44 -- target/host_management.sh@73 -- # perfpid=3081996 00:17:27.471 19:03:44 -- target/host_management.sh@74 -- # waitforlisten 3081996 /var/tmp/bdevperf.sock 00:17:27.471 19:03:44 -- common/autotest_common.sh@829 -- # '[' -z 3081996 ']' 00:17:27.471 19:03:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:27.471 19:03:44 -- target/host_management.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:17:27.471 19:03:44 -- target/host_management.sh@72 -- # gen_nvmf_target_json 0 00:17:27.471 19:03:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:27.471 19:03:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:27.471 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:27.471 19:03:44 -- nvmf/common.sh@520 -- # config=() 00:17:27.472 19:03:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:27.472 19:03:44 -- nvmf/common.sh@520 -- # local subsystem config 00:17:27.472 19:03:44 -- common/autotest_common.sh@10 -- # set +x 00:17:27.472 19:03:44 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:27.472 19:03:44 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:27.472 { 00:17:27.472 "params": { 00:17:27.472 "name": "Nvme$subsystem", 00:17:27.472 "trtype": "$TEST_TRANSPORT", 00:17:27.472 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:27.472 "adrfam": "ipv4", 00:17:27.472 "trsvcid": "$NVMF_PORT", 00:17:27.472 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:27.472 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:27.472 "hdgst": ${hdgst:-false}, 00:17:27.472 "ddgst": ${ddgst:-false} 00:17:27.472 }, 00:17:27.472 "method": "bdev_nvme_attach_controller" 00:17:27.472 } 00:17:27.472 EOF 00:17:27.472 )") 00:17:27.472 19:03:44 -- nvmf/common.sh@542 -- # cat 00:17:27.472 19:03:44 -- nvmf/common.sh@544 -- # jq . 00:17:27.472 19:03:44 -- nvmf/common.sh@545 -- # IFS=, 00:17:27.472 19:03:44 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:27.472 "params": { 00:17:27.472 "name": "Nvme0", 00:17:27.472 "trtype": "tcp", 00:17:27.472 "traddr": "10.0.0.2", 00:17:27.472 "adrfam": "ipv4", 00:17:27.472 "trsvcid": "4420", 00:17:27.472 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:27.472 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:17:27.472 "hdgst": false, 00:17:27.472 "ddgst": false 00:17:27.472 }, 00:17:27.472 "method": "bdev_nvme_attach_controller" 00:17:27.472 }' 00:17:27.472 [2024-11-26 19:03:44.288084] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:17:27.472 [2024-11-26 19:03:44.288129] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3081996 ] 00:17:27.472 EAL: No free 2048 kB hugepages reported on node 1 00:17:27.472 [2024-11-26 19:03:44.344251] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:27.472 [2024-11-26 19:03:44.381871] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:27.729 Running I/O for 10 seconds... 00:17:28.295 19:03:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:28.295 19:03:45 -- common/autotest_common.sh@862 -- # return 0 00:17:28.295 19:03:45 -- target/host_management.sh@75 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:17:28.295 19:03:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:28.295 19:03:45 -- common/autotest_common.sh@10 -- # set +x 00:17:28.295 19:03:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:28.295 19:03:45 -- target/host_management.sh@78 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:28.295 19:03:45 -- target/host_management.sh@80 -- # waitforio /var/tmp/bdevperf.sock Nvme0n1 00:17:28.295 19:03:45 -- target/host_management.sh@45 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:17:28.295 19:03:45 -- target/host_management.sh@49 -- # '[' -z Nvme0n1 ']' 00:17:28.295 19:03:45 -- target/host_management.sh@52 -- # local ret=1 00:17:28.295 19:03:45 -- target/host_management.sh@53 -- # local i 00:17:28.295 19:03:45 -- target/host_management.sh@54 -- # (( i = 10 )) 00:17:28.295 19:03:45 -- target/host_management.sh@54 -- # (( i != 0 )) 00:17:28.295 19:03:45 -- target/host_management.sh@55 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme0n1 00:17:28.295 19:03:45 -- target/host_management.sh@55 -- # jq -r '.bdevs[0].num_read_ops' 00:17:28.295 19:03:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:28.295 19:03:45 -- common/autotest_common.sh@10 -- # set +x 00:17:28.295 19:03:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:28.295 19:03:45 -- target/host_management.sh@55 -- # read_io_count=2245 00:17:28.295 19:03:45 -- target/host_management.sh@58 -- # '[' 2245 -ge 100 ']' 00:17:28.295 19:03:45 -- target/host_management.sh@59 -- # ret=0 00:17:28.295 19:03:45 -- target/host_management.sh@60 -- # break 00:17:28.295 19:03:45 -- target/host_management.sh@64 -- # return 0 00:17:28.295 19:03:45 -- target/host_management.sh@84 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:17:28.295 19:03:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:28.295 19:03:45 -- common/autotest_common.sh@10 -- # set +x 00:17:28.295 [2024-11-26 19:03:45.186810] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e6f80 is same with the state(5) to be set 00:17:28.295 [2024-11-26 19:03:45.186861] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e6f80 is same with the state(5) to be set 00:17:28.295 [2024-11-26 19:03:45.186869] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e6f80 is same with the state(5) to be set 00:17:28.295 [2024-11-26 19:03:45.186876] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e6f80 is same with the state(5) to be set 00:17:28.295 [2024-11-26 19:03:45.186883] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e6f80 is same with the state(5) to be set 00:17:28.295 [2024-11-26 19:03:45.186889] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e6f80 is same with the state(5) to be set 00:17:28.295 [2024-11-26 19:03:45.186896] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e6f80 is same with the state(5) to be set 00:17:28.295 [2024-11-26 19:03:45.186903] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e6f80 is same with the state(5) to be set 00:17:28.295 [2024-11-26 19:03:45.186909] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e6f80 is same with the state(5) to be set 00:17:28.295 [2024-11-26 19:03:45.186916] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e6f80 is same with the state(5) to be set 00:17:28.295 [2024-11-26 19:03:45.186922] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e6f80 is same with the state(5) to be set 00:17:28.295 [2024-11-26 19:03:45.186928] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e6f80 is same with the state(5) to be set 00:17:28.295 [2024-11-26 19:03:45.186934] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e6f80 is same with the state(5) to be set 00:17:28.295 [2024-11-26 19:03:45.186944] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e6f80 is same with the state(5) to be set 00:17:28.295 [2024-11-26 19:03:45.186959] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e6f80 is same with the state(5) to be set 00:17:28.295 [2024-11-26 19:03:45.186967] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e6f80 is same with the state(5) to be set 00:17:28.295 [2024-11-26 19:03:45.186976] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e6f80 is same with the state(5) to be set 00:17:28.295 [2024-11-26 19:03:45.186983] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e6f80 is same with the state(5) to be set 00:17:28.295 [2024-11-26 19:03:45.186989] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e6f80 is same with the state(5) to be set 00:17:28.295 [2024-11-26 19:03:45.186995] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e6f80 is same with the state(5) to be set 00:17:28.295 [2024-11-26 19:03:45.187001] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e6f80 is same with the state(5) to be set 00:17:28.295 [2024-11-26 19:03:45.187007] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e6f80 is same with the state(5) to be set 00:17:28.295 [2024-11-26 19:03:45.187013] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e6f80 is same with the state(5) to be set 00:17:28.295 [2024-11-26 19:03:45.187020] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e6f80 is same with the state(5) to be set 00:17:28.295 [2024-11-26 19:03:45.187026] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e6f80 is same with the state(5) to be set 00:17:28.295 [2024-11-26 19:03:45.187032] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e6f80 is same with the state(5) to be set 00:17:28.295 [2024-11-26 19:03:45.187038] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e6f80 is same with the state(5) to be set 00:17:28.295 [2024-11-26 19:03:45.187044] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e6f80 is same with the state(5) to be set 00:17:28.295 [2024-11-26 19:03:45.187050] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e6f80 is same with the state(5) to be set 00:17:28.295 [2024-11-26 19:03:45.187056] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e6f80 is same with the state(5) to be set 00:17:28.295 [2024-11-26 19:03:45.187063] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e6f80 is same with the state(5) to be set 00:17:28.295 [2024-11-26 19:03:45.187068] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e6f80 is same with the state(5) to be set 00:17:28.295 [2024-11-26 19:03:45.187074] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e6f80 is same with the state(5) to be set 00:17:28.295 [2024-11-26 19:03:45.187081] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e6f80 is same with the state(5) to be set 00:17:28.295 [2024-11-26 19:03:45.187088] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e6f80 is same with the state(5) to be set 00:17:28.295 [2024-11-26 19:03:45.187094] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e6f80 is same with the state(5) to be set 00:17:28.295 [2024-11-26 19:03:45.187100] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e6f80 is same with the state(5) to be set 00:17:28.295 [2024-11-26 19:03:45.187107] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e6f80 is same with the state(5) to be set 00:17:28.295 [2024-11-26 19:03:45.187114] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e6f80 is same with the state(5) to be set 00:17:28.295 [2024-11-26 19:03:45.187121] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e6f80 is same with the state(5) to be set 00:17:28.295 [2024-11-26 19:03:45.187131] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e6f80 is same with the state(5) to be set 00:17:28.295 [2024-11-26 19:03:45.187138] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e6f80 is same with the state(5) to be set 00:17:28.295 [2024-11-26 19:03:45.187144] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e6f80 is same with the state(5) to be set 00:17:28.295 [2024-11-26 19:03:45.187150] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e6f80 is same with the state(5) to be set 00:17:28.295 [2024-11-26 19:03:45.187157] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e6f80 is same with the state(5) to be set 00:17:28.295 [2024-11-26 19:03:45.187163] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e6f80 is same with the state(5) to be set 00:17:28.295 [2024-11-26 19:03:45.187169] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e6f80 is same with the state(5) to be set 00:17:28.296 [2024-11-26 19:03:45.187175] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e6f80 is same with the state(5) to be set 00:17:28.296 [2024-11-26 19:03:45.187182] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e6f80 is same with the state(5) to be set 00:17:28.296 [2024-11-26 19:03:45.187188] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e6f80 is same with the state(5) to be set 00:17:28.296 [2024-11-26 19:03:45.187194] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e6f80 is same with the state(5) to be set 00:17:28.296 [2024-11-26 19:03:45.187201] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e6f80 is same with the state(5) to be set 00:17:28.296 [2024-11-26 19:03:45.187207] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e6f80 is same with the state(5) to be set 00:17:28.296 [2024-11-26 19:03:45.187213] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e6f80 is same with the state(5) to be set 00:17:28.296 [2024-11-26 19:03:45.187219] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e6f80 is same with the state(5) to be set 00:17:28.296 [2024-11-26 19:03:45.189201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:28.296 [2024-11-26 19:03:45.189240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:28.296 [2024-11-26 19:03:45.189256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:42112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:28.296 [2024-11-26 19:03:45.189265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:28.296 [2024-11-26 19:03:45.189274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:48000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:28.296 [2024-11-26 19:03:45.189282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:28.296 [2024-11-26 19:03:45.189293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:48128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:28.296 [2024-11-26 19:03:45.189301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:28.296 [2024-11-26 19:03:45.189310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:48256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:28.296 [2024-11-26 19:03:45.189319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:28.296 [2024-11-26 19:03:45.189328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:48384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:28.296 [2024-11-26 19:03:45.189341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:28.296 [2024-11-26 19:03:45.189350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:48512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:28.296 [2024-11-26 19:03:45.189359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:28.296 [2024-11-26 19:03:45.189368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:48640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:28.296 [2024-11-26 19:03:45.189376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:28.296 [2024-11-26 19:03:45.189386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:48768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:28.296 [2024-11-26 19:03:45.189393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:28.296 [2024-11-26 19:03:45.189402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:42496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:28.296 [2024-11-26 19:03:45.189410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:28.296 [2024-11-26 19:03:45.189419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:48896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:28.296 [2024-11-26 19:03:45.189427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:28.296 [2024-11-26 19:03:45.189437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:49024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:28.296 [2024-11-26 19:03:45.189446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:28.296 [2024-11-26 19:03:45.189455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:49152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:28.296 [2024-11-26 19:03:45.189463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:28.296 [2024-11-26 19:03:45.189472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:49280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:28.296 [2024-11-26 19:03:45.189480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:28.296 [2024-11-26 19:03:45.189490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:28.296 [2024-11-26 19:03:45.189498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:28.296 [2024-11-26 19:03:45.189508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:49408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:28.296 [2024-11-26 19:03:45.189516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:28.296 [2024-11-26 19:03:45.189525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:49536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:28.296 [2024-11-26 19:03:45.189533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:28.296 [2024-11-26 19:03:45.189543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:28.296 [2024-11-26 19:03:45.189552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:28.296 [2024-11-26 19:03:45.189564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:28.296 [2024-11-26 19:03:45.189572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:28.296 [2024-11-26 19:03:45.189581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:28.296 [2024-11-26 19:03:45.189589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:28.296 [2024-11-26 19:03:45.189598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:43392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:28.296 [2024-11-26 19:03:45.189606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:28.296 [2024-11-26 19:03:45.189615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:28.296 [2024-11-26 19:03:45.189623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:28.296 [2024-11-26 19:03:45.189632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:49664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:28.296 [2024-11-26 19:03:45.189640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:28.296 [2024-11-26 19:03:45.189649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:49792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:28.296 [2024-11-26 19:03:45.189657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:28.296 [2024-11-26 19:03:45.189666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:49920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:28.296 [2024-11-26 19:03:45.189673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:28.296 [2024-11-26 19:03:45.189682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:50048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:28.296 [2024-11-26 19:03:45.189691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:28.296 [2024-11-26 19:03:45.189699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:50176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:28.296 [2024-11-26 19:03:45.189709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:28.296 [2024-11-26 19:03:45.189718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:50304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:28.296 [2024-11-26 19:03:45.189726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:28.296 [2024-11-26 19:03:45.189736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:50432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:28.296 [2024-11-26 19:03:45.189744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:28.296 [2024-11-26 19:03:45.189753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:50560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:28.296 [2024-11-26 19:03:45.189761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:28.296 [2024-11-26 19:03:45.189772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:28.296 [2024-11-26 19:03:45.189782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:28.296 [2024-11-26 19:03:45.189792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:50688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:28.296 [2024-11-26 19:03:45.189799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:28.296 [2024-11-26 19:03:45.189810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:50816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:28.296 [2024-11-26 19:03:45.189817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:28.296 [2024-11-26 19:03:45.189827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:50944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:28.296 [2024-11-26 19:03:45.189835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:28.296 [2024-11-26 19:03:45.189846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:28.296 [2024-11-26 19:03:45.189855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:28.296 [2024-11-26 19:03:45.189865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:51072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:28.297 [2024-11-26 19:03:45.189873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:28.297 [2024-11-26 19:03:45.189882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:44672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:28.297 [2024-11-26 19:03:45.189891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:28.297 [2024-11-26 19:03:45.189901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:28.297 [2024-11-26 19:03:45.189909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:28.297 [2024-11-26 19:03:45.189919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:45312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:28.297 [2024-11-26 19:03:45.189927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:28.297 [2024-11-26 19:03:45.189937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:45440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:28.297 [2024-11-26 19:03:45.189945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:28.297 [2024-11-26 19:03:45.189960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:45568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:28.297 [2024-11-26 19:03:45.189968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:28.297 [2024-11-26 19:03:45.189977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:45696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:28.297 [2024-11-26 19:03:45.189985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:28.297 [2024-11-26 19:03:45.189995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:51200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:28.297 [2024-11-26 19:03:45.190003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:28.297 [2024-11-26 19:03:45.190015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:51328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:28.297 [2024-11-26 19:03:45.190023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:28.297 [2024-11-26 19:03:45.190033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:51456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:28.297 [2024-11-26 19:03:45.190040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:28.297 [2024-11-26 19:03:45.190050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:51584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:28.297 [2024-11-26 19:03:45.190059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:28.297 [2024-11-26 19:03:45.190069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:51712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:28.297 [2024-11-26 19:03:45.190077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:28.297 [2024-11-26 19:03:45.190087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:51840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:28.297 [2024-11-26 19:03:45.190096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:28.297 [2024-11-26 19:03:45.190105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:45952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:28.297 [2024-11-26 19:03:45.190114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:28.297 [2024-11-26 19:03:45.190124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:46208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:28.297 [2024-11-26 19:03:45.190132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:28.297 [2024-11-26 19:03:45.190142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:51968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:28.297 [2024-11-26 19:03:45.190150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:28.297 [2024-11-26 19:03:45.190160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:52096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:28.297 [2024-11-26 19:03:45.190168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:28.297 [2024-11-26 19:03:45.190178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:52224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:28.297 [2024-11-26 19:03:45.190186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:28.297 [2024-11-26 19:03:45.190197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:46336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:28.297 [2024-11-26 19:03:45.190205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:28.297 [2024-11-26 19:03:45.190215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:52352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:28.297 [2024-11-26 19:03:45.190223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:28.297 [2024-11-26 19:03:45.190232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:52480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:28.297 [2024-11-26 19:03:45.190242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:28.297 [2024-11-26 19:03:45.190251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:46848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:28.297 [2024-11-26 19:03:45.190261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:28.297 [2024-11-26 19:03:45.190270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:52608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:28.297 [2024-11-26 19:03:45.190278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:28.297 [2024-11-26 19:03:45.190288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:47104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:28.297 [2024-11-26 19:03:45.190296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:28.297 [2024-11-26 19:03:45.190305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:52736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:28.297 [2024-11-26 19:03:45.190313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:28.297 [2024-11-26 19:03:45.190323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:47232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:28.297 [2024-11-26 19:03:45.190331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:28.297 [2024-11-26 19:03:45.190340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:47360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:28.297 [2024-11-26 19:03:45.190348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:28.297 [2024-11-26 19:03:45.190357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:47488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:28.297 [2024-11-26 19:03:45.190366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:28.297 [2024-11-26 19:03:45.190375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:47744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:28.297 [2024-11-26 19:03:45.190383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:28.297 [2024-11-26 19:03:45.190467] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x933940 was disconnected and freed. reset controller. 00:17:28.297 [2024-11-26 19:03:45.191390] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:17:28.297 19:03:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:28.297 19:03:45 -- target/host_management.sh@85 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:17:28.297 19:03:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:28.297 19:03:45 -- common/autotest_common.sh@10 -- # set +x 00:17:28.297 task offset: 41984 on job bdev=Nvme0n1 fails 00:17:28.297 00:17:28.297 Latency(us) 00:17:28.297 [2024-11-26T18:03:45.224Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:28.297 [2024-11-26T18:03:45.224Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:28.297 [2024-11-26T18:03:45.224Z] Job: Nvme0n1 ended in about 0.54 seconds with error 00:17:28.297 Verification LBA range: start 0x0 length 0x400 00:17:28.297 Nvme0n1 : 0.54 4468.35 279.27 119.31 0.00 13730.35 1588.54 19147.91 00:17:28.297 [2024-11-26T18:03:45.224Z] =================================================================================================================== 00:17:28.297 [2024-11-26T18:03:45.224Z] Total : 4468.35 279.27 119.31 0.00 13730.35 1588.54 19147.91 00:17:28.297 [2024-11-26 19:03:45.193002] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:17:28.297 [2024-11-26 19:03:45.193020] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x9394e0 (9): Bad file descriptor 00:17:28.297 19:03:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:28.297 19:03:45 -- target/host_management.sh@87 -- # sleep 1 00:17:28.297 [2024-11-26 19:03:45.204371] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:17:29.667 19:03:46 -- target/host_management.sh@91 -- # kill -9 3081996 00:17:29.667 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh: line 91: kill: (3081996) - No such process 00:17:29.667 19:03:46 -- target/host_management.sh@91 -- # true 00:17:29.667 19:03:46 -- target/host_management.sh@97 -- # rm -f /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 /var/tmp/spdk_cpu_lock_003 /var/tmp/spdk_cpu_lock_004 00:17:29.667 19:03:46 -- target/host_management.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:17:29.667 19:03:46 -- target/host_management.sh@100 -- # gen_nvmf_target_json 0 00:17:29.667 19:03:46 -- nvmf/common.sh@520 -- # config=() 00:17:29.667 19:03:46 -- nvmf/common.sh@520 -- # local subsystem config 00:17:29.667 19:03:46 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:29.667 19:03:46 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:29.667 { 00:17:29.667 "params": { 00:17:29.667 "name": "Nvme$subsystem", 00:17:29.667 "trtype": "$TEST_TRANSPORT", 00:17:29.667 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:29.667 "adrfam": "ipv4", 00:17:29.667 "trsvcid": "$NVMF_PORT", 00:17:29.667 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:29.667 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:29.667 "hdgst": ${hdgst:-false}, 00:17:29.667 "ddgst": ${ddgst:-false} 00:17:29.667 }, 00:17:29.667 "method": "bdev_nvme_attach_controller" 00:17:29.667 } 00:17:29.667 EOF 00:17:29.667 )") 00:17:29.667 19:03:46 -- nvmf/common.sh@542 -- # cat 00:17:29.667 19:03:46 -- nvmf/common.sh@544 -- # jq . 00:17:29.667 19:03:46 -- nvmf/common.sh@545 -- # IFS=, 00:17:29.667 19:03:46 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:29.667 "params": { 00:17:29.667 "name": "Nvme0", 00:17:29.667 "trtype": "tcp", 00:17:29.667 "traddr": "10.0.0.2", 00:17:29.667 "adrfam": "ipv4", 00:17:29.667 "trsvcid": "4420", 00:17:29.667 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:29.667 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:17:29.667 "hdgst": false, 00:17:29.667 "ddgst": false 00:17:29.667 }, 00:17:29.667 "method": "bdev_nvme_attach_controller" 00:17:29.667 }' 00:17:29.668 [2024-11-26 19:03:46.250825] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:17:29.668 [2024-11-26 19:03:46.250875] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3082421 ] 00:17:29.668 EAL: No free 2048 kB hugepages reported on node 1 00:17:29.668 [2024-11-26 19:03:46.306629] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:29.668 [2024-11-26 19:03:46.342731] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:29.668 Running I/O for 1 seconds... 00:17:31.064 00:17:31.064 Latency(us) 00:17:31.064 [2024-11-26T18:03:47.991Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:31.064 [2024-11-26T18:03:47.991Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:31.064 Verification LBA range: start 0x0 length 0x400 00:17:31.064 Nvme0n1 : 1.01 4674.47 292.15 0.00 0.00 13484.48 844.13 18919.96 00:17:31.064 [2024-11-26T18:03:47.991Z] =================================================================================================================== 00:17:31.064 [2024-11-26T18:03:47.991Z] Total : 4674.47 292.15 0.00 0.00 13484.48 844.13 18919.96 00:17:31.064 19:03:47 -- target/host_management.sh@101 -- # stoptarget 00:17:31.064 19:03:47 -- target/host_management.sh@36 -- # rm -f ./local-job0-0-verify.state 00:17:31.064 19:03:47 -- target/host_management.sh@37 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:17:31.064 19:03:47 -- target/host_management.sh@38 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:17:31.064 19:03:47 -- target/host_management.sh@40 -- # nvmftestfini 00:17:31.064 19:03:47 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:31.064 19:03:47 -- nvmf/common.sh@116 -- # sync 00:17:31.064 19:03:47 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:31.064 19:03:47 -- nvmf/common.sh@119 -- # set +e 00:17:31.064 19:03:47 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:31.064 19:03:47 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:31.064 rmmod nvme_tcp 00:17:31.064 rmmod nvme_fabrics 00:17:31.064 rmmod nvme_keyring 00:17:31.064 19:03:47 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:31.064 19:03:47 -- nvmf/common.sh@123 -- # set -e 00:17:31.064 19:03:47 -- nvmf/common.sh@124 -- # return 0 00:17:31.064 19:03:47 -- nvmf/common.sh@477 -- # '[' -n 3081791 ']' 00:17:31.064 19:03:47 -- nvmf/common.sh@478 -- # killprocess 3081791 00:17:31.064 19:03:47 -- common/autotest_common.sh@936 -- # '[' -z 3081791 ']' 00:17:31.064 19:03:47 -- common/autotest_common.sh@940 -- # kill -0 3081791 00:17:31.064 19:03:47 -- common/autotest_common.sh@941 -- # uname 00:17:31.064 19:03:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:31.064 19:03:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3081791 00:17:31.064 19:03:47 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:31.064 19:03:47 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:31.064 19:03:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3081791' 00:17:31.064 killing process with pid 3081791 00:17:31.064 19:03:47 -- common/autotest_common.sh@955 -- # kill 3081791 00:17:31.064 19:03:47 -- common/autotest_common.sh@960 -- # wait 3081791 00:17:31.322 [2024-11-26 19:03:48.056420] app.c: 605:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 1, errno: 2 00:17:31.322 19:03:48 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:31.322 19:03:48 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:31.322 19:03:48 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:31.322 19:03:48 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:31.322 19:03:48 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:31.322 19:03:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:31.322 19:03:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:31.322 19:03:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:33.221 19:03:50 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:33.221 00:17:33.221 real 0m6.920s 00:17:33.221 user 0m21.041s 00:17:33.221 sys 0m1.313s 00:17:33.221 19:03:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:33.221 19:03:50 -- common/autotest_common.sh@10 -- # set +x 00:17:33.221 ************************************ 00:17:33.221 END TEST nvmf_host_management 00:17:33.221 ************************************ 00:17:33.479 19:03:50 -- target/host_management.sh@108 -- # trap - SIGINT SIGTERM EXIT 00:17:33.479 00:17:33.479 real 0m12.441s 00:17:33.479 user 0m22.474s 00:17:33.479 sys 0m5.402s 00:17:33.479 19:03:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:33.479 19:03:50 -- common/autotest_common.sh@10 -- # set +x 00:17:33.479 ************************************ 00:17:33.479 END TEST nvmf_host_management 00:17:33.479 ************************************ 00:17:33.479 19:03:50 -- nvmf/nvmf.sh@47 -- # run_test nvmf_lvol /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:17:33.479 19:03:50 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:33.479 19:03:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:33.479 19:03:50 -- common/autotest_common.sh@10 -- # set +x 00:17:33.479 ************************************ 00:17:33.479 START TEST nvmf_lvol 00:17:33.479 ************************************ 00:17:33.479 19:03:50 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:17:33.479 * Looking for test storage... 00:17:33.479 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:33.479 19:03:50 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:33.479 19:03:50 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:33.479 19:03:50 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:33.479 19:03:50 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:33.479 19:03:50 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:33.479 19:03:50 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:33.479 19:03:50 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:33.479 19:03:50 -- scripts/common.sh@335 -- # IFS=.-: 00:17:33.479 19:03:50 -- scripts/common.sh@335 -- # read -ra ver1 00:17:33.479 19:03:50 -- scripts/common.sh@336 -- # IFS=.-: 00:17:33.479 19:03:50 -- scripts/common.sh@336 -- # read -ra ver2 00:17:33.479 19:03:50 -- scripts/common.sh@337 -- # local 'op=<' 00:17:33.479 19:03:50 -- scripts/common.sh@339 -- # ver1_l=2 00:17:33.480 19:03:50 -- scripts/common.sh@340 -- # ver2_l=1 00:17:33.480 19:03:50 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:33.480 19:03:50 -- scripts/common.sh@343 -- # case "$op" in 00:17:33.480 19:03:50 -- scripts/common.sh@344 -- # : 1 00:17:33.480 19:03:50 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:33.480 19:03:50 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:33.480 19:03:50 -- scripts/common.sh@364 -- # decimal 1 00:17:33.480 19:03:50 -- scripts/common.sh@352 -- # local d=1 00:17:33.480 19:03:50 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:33.480 19:03:50 -- scripts/common.sh@354 -- # echo 1 00:17:33.480 19:03:50 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:33.480 19:03:50 -- scripts/common.sh@365 -- # decimal 2 00:17:33.480 19:03:50 -- scripts/common.sh@352 -- # local d=2 00:17:33.480 19:03:50 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:33.480 19:03:50 -- scripts/common.sh@354 -- # echo 2 00:17:33.480 19:03:50 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:33.480 19:03:50 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:33.480 19:03:50 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:33.480 19:03:50 -- scripts/common.sh@367 -- # return 0 00:17:33.480 19:03:50 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:33.480 19:03:50 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:33.480 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:33.480 --rc genhtml_branch_coverage=1 00:17:33.480 --rc genhtml_function_coverage=1 00:17:33.480 --rc genhtml_legend=1 00:17:33.480 --rc geninfo_all_blocks=1 00:17:33.480 --rc geninfo_unexecuted_blocks=1 00:17:33.480 00:17:33.480 ' 00:17:33.480 19:03:50 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:33.480 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:33.480 --rc genhtml_branch_coverage=1 00:17:33.480 --rc genhtml_function_coverage=1 00:17:33.480 --rc genhtml_legend=1 00:17:33.480 --rc geninfo_all_blocks=1 00:17:33.480 --rc geninfo_unexecuted_blocks=1 00:17:33.480 00:17:33.480 ' 00:17:33.480 19:03:50 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:33.480 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:33.480 --rc genhtml_branch_coverage=1 00:17:33.480 --rc genhtml_function_coverage=1 00:17:33.480 --rc genhtml_legend=1 00:17:33.480 --rc geninfo_all_blocks=1 00:17:33.480 --rc geninfo_unexecuted_blocks=1 00:17:33.480 00:17:33.480 ' 00:17:33.480 19:03:50 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:33.480 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:33.480 --rc genhtml_branch_coverage=1 00:17:33.480 --rc genhtml_function_coverage=1 00:17:33.480 --rc genhtml_legend=1 00:17:33.480 --rc geninfo_all_blocks=1 00:17:33.480 --rc geninfo_unexecuted_blocks=1 00:17:33.480 00:17:33.480 ' 00:17:33.480 19:03:50 -- target/nvmf_lvol.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:33.480 19:03:50 -- nvmf/common.sh@7 -- # uname -s 00:17:33.480 19:03:50 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:33.480 19:03:50 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:33.480 19:03:50 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:33.480 19:03:50 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:33.480 19:03:50 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:33.480 19:03:50 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:33.480 19:03:50 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:33.480 19:03:50 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:33.480 19:03:50 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:33.480 19:03:50 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:33.480 19:03:50 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:17:33.480 19:03:50 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:17:33.480 19:03:50 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:33.480 19:03:50 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:33.480 19:03:50 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:33.480 19:03:50 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:33.480 19:03:50 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:33.480 19:03:50 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:33.480 19:03:50 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:33.480 19:03:50 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:33.738 19:03:50 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:33.738 19:03:50 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:33.738 19:03:50 -- paths/export.sh@5 -- # export PATH 00:17:33.738 19:03:50 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:33.738 19:03:50 -- nvmf/common.sh@46 -- # : 0 00:17:33.738 19:03:50 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:33.738 19:03:50 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:33.738 19:03:50 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:33.738 19:03:50 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:33.738 19:03:50 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:33.738 19:03:50 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:33.738 19:03:50 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:33.738 19:03:50 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:33.738 19:03:50 -- target/nvmf_lvol.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:33.738 19:03:50 -- target/nvmf_lvol.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:33.738 19:03:50 -- target/nvmf_lvol.sh@13 -- # LVOL_BDEV_INIT_SIZE=20 00:17:33.738 19:03:50 -- target/nvmf_lvol.sh@14 -- # LVOL_BDEV_FINAL_SIZE=30 00:17:33.738 19:03:50 -- target/nvmf_lvol.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:33.738 19:03:50 -- target/nvmf_lvol.sh@18 -- # nvmftestinit 00:17:33.738 19:03:50 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:33.738 19:03:50 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:33.738 19:03:50 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:33.738 19:03:50 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:33.738 19:03:50 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:33.739 19:03:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:33.739 19:03:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:33.739 19:03:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:33.739 19:03:50 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:33.739 19:03:50 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:33.739 19:03:50 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:33.739 19:03:50 -- common/autotest_common.sh@10 -- # set +x 00:17:39.002 19:03:55 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:39.002 19:03:55 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:39.002 19:03:55 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:39.002 19:03:55 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:39.002 19:03:55 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:39.002 19:03:55 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:39.002 19:03:55 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:39.002 19:03:55 -- nvmf/common.sh@294 -- # net_devs=() 00:17:39.002 19:03:55 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:39.002 19:03:55 -- nvmf/common.sh@295 -- # e810=() 00:17:39.002 19:03:55 -- nvmf/common.sh@295 -- # local -ga e810 00:17:39.002 19:03:55 -- nvmf/common.sh@296 -- # x722=() 00:17:39.002 19:03:55 -- nvmf/common.sh@296 -- # local -ga x722 00:17:39.002 19:03:55 -- nvmf/common.sh@297 -- # mlx=() 00:17:39.002 19:03:55 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:39.002 19:03:55 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:39.002 19:03:55 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:39.002 19:03:55 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:39.002 19:03:55 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:39.002 19:03:55 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:39.002 19:03:55 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:39.002 19:03:55 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:39.002 19:03:55 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:39.002 19:03:55 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:39.002 19:03:55 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:39.002 19:03:55 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:39.002 19:03:55 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:39.002 19:03:55 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:39.002 19:03:55 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:39.002 19:03:55 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:39.002 19:03:55 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:39.002 19:03:55 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:39.002 19:03:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:39.002 19:03:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:17:39.002 Found 0000:86:00.0 (0x8086 - 0x159b) 00:17:39.002 19:03:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:39.002 19:03:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:39.002 19:03:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:39.002 19:03:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:39.002 19:03:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:39.002 19:03:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:39.002 19:03:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:17:39.002 Found 0000:86:00.1 (0x8086 - 0x159b) 00:17:39.002 19:03:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:39.002 19:03:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:39.002 19:03:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:39.003 19:03:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:39.003 19:03:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:39.003 19:03:55 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:39.003 19:03:55 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:39.003 19:03:55 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:39.003 19:03:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:39.003 19:03:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:39.003 19:03:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:39.003 19:03:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:39.003 19:03:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:17:39.003 Found net devices under 0000:86:00.0: cvl_0_0 00:17:39.003 19:03:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:39.003 19:03:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:39.003 19:03:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:39.003 19:03:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:39.003 19:03:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:39.003 19:03:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:17:39.003 Found net devices under 0000:86:00.1: cvl_0_1 00:17:39.003 19:03:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:39.003 19:03:55 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:39.003 19:03:55 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:39.003 19:03:55 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:39.003 19:03:55 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:39.003 19:03:55 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:39.003 19:03:55 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:39.003 19:03:55 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:39.003 19:03:55 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:39.003 19:03:55 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:39.003 19:03:55 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:39.003 19:03:55 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:39.003 19:03:55 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:39.003 19:03:55 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:39.003 19:03:55 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:39.003 19:03:55 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:39.003 19:03:55 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:39.003 19:03:55 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:39.003 19:03:55 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:39.003 19:03:55 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:39.003 19:03:55 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:39.003 19:03:55 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:39.003 19:03:55 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:39.003 19:03:55 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:39.003 19:03:55 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:39.003 19:03:55 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:39.003 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:39.003 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.454 ms 00:17:39.003 00:17:39.003 --- 10.0.0.2 ping statistics --- 00:17:39.003 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:39.003 rtt min/avg/max/mdev = 0.454/0.454/0.454/0.000 ms 00:17:39.003 19:03:55 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:39.003 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:39.003 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.222 ms 00:17:39.003 00:17:39.003 --- 10.0.0.1 ping statistics --- 00:17:39.003 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:39.003 rtt min/avg/max/mdev = 0.222/0.222/0.222/0.000 ms 00:17:39.003 19:03:55 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:39.003 19:03:55 -- nvmf/common.sh@410 -- # return 0 00:17:39.003 19:03:55 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:39.003 19:03:55 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:39.003 19:03:55 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:39.003 19:03:55 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:39.003 19:03:55 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:39.003 19:03:55 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:39.003 19:03:55 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:39.003 19:03:55 -- target/nvmf_lvol.sh@19 -- # nvmfappstart -m 0x7 00:17:39.003 19:03:55 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:39.003 19:03:55 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:39.003 19:03:55 -- common/autotest_common.sh@10 -- # set +x 00:17:39.003 19:03:55 -- nvmf/common.sh@469 -- # nvmfpid=3086042 00:17:39.003 19:03:55 -- nvmf/common.sh@470 -- # waitforlisten 3086042 00:17:39.003 19:03:55 -- common/autotest_common.sh@829 -- # '[' -z 3086042 ']' 00:17:39.003 19:03:55 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:39.003 19:03:55 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:39.003 19:03:55 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:39.003 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:39.003 19:03:55 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:17:39.003 19:03:55 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:39.003 19:03:55 -- common/autotest_common.sh@10 -- # set +x 00:17:39.003 [2024-11-26 19:03:55.754160] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:17:39.003 [2024-11-26 19:03:55.754206] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:39.003 EAL: No free 2048 kB hugepages reported on node 1 00:17:39.003 [2024-11-26 19:03:55.814335] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:17:39.003 [2024-11-26 19:03:55.853517] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:39.003 [2024-11-26 19:03:55.853630] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:39.003 [2024-11-26 19:03:55.853639] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:39.003 [2024-11-26 19:03:55.853645] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:39.003 [2024-11-26 19:03:55.853695] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:39.003 [2024-11-26 19:03:55.853902] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:39.003 [2024-11-26 19:03:55.853905] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:39.934 19:03:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:39.934 19:03:56 -- common/autotest_common.sh@862 -- # return 0 00:17:39.934 19:03:56 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:39.934 19:03:56 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:39.934 19:03:56 -- common/autotest_common.sh@10 -- # set +x 00:17:39.934 19:03:56 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:39.934 19:03:56 -- target/nvmf_lvol.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:17:39.934 [2024-11-26 19:03:56.767067] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:39.934 19:03:56 -- target/nvmf_lvol.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:17:40.191 19:03:56 -- target/nvmf_lvol.sh@24 -- # base_bdevs='Malloc0 ' 00:17:40.191 19:03:56 -- target/nvmf_lvol.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:17:40.449 19:03:57 -- target/nvmf_lvol.sh@25 -- # base_bdevs+=Malloc1 00:17:40.449 19:03:57 -- target/nvmf_lvol.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc0 Malloc1' 00:17:40.449 19:03:57 -- target/nvmf_lvol.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore raid0 lvs 00:17:40.707 19:03:57 -- target/nvmf_lvol.sh@29 -- # lvs=37ca9ce9-859f-46a3-ab30-9f44210ac271 00:17:40.707 19:03:57 -- target/nvmf_lvol.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 37ca9ce9-859f-46a3-ab30-9f44210ac271 lvol 20 00:17:40.965 19:03:57 -- target/nvmf_lvol.sh@32 -- # lvol=3c87d3c2-6e17-492f-ae7d-42908267577c 00:17:40.965 19:03:57 -- target/nvmf_lvol.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:17:41.220 19:03:57 -- target/nvmf_lvol.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 3c87d3c2-6e17-492f-ae7d-42908267577c 00:17:41.220 19:03:58 -- target/nvmf_lvol.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:17:41.477 [2024-11-26 19:03:58.286145] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:41.477 19:03:58 -- target/nvmf_lvol.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:17:41.735 19:03:58 -- target/nvmf_lvol.sh@42 -- # perf_pid=3086545 00:17:41.735 19:03:58 -- target/nvmf_lvol.sh@44 -- # sleep 1 00:17:41.735 19:03:58 -- target/nvmf_lvol.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -o 4096 -q 128 -s 512 -w randwrite -t 10 -c 0x18 00:17:41.735 EAL: No free 2048 kB hugepages reported on node 1 00:17:42.668 19:03:59 -- target/nvmf_lvol.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_snapshot 3c87d3c2-6e17-492f-ae7d-42908267577c MY_SNAPSHOT 00:17:42.925 19:03:59 -- target/nvmf_lvol.sh@47 -- # snapshot=944345b9-a78e-4688-90c8-f798939f34c4 00:17:42.925 19:03:59 -- target/nvmf_lvol.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_resize 3c87d3c2-6e17-492f-ae7d-42908267577c 30 00:17:43.183 19:03:59 -- target/nvmf_lvol.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_clone 944345b9-a78e-4688-90c8-f798939f34c4 MY_CLONE 00:17:43.439 19:04:00 -- target/nvmf_lvol.sh@49 -- # clone=4cfc582f-56dc-40c7-841f-f110f959d271 00:17:43.439 19:04:00 -- target/nvmf_lvol.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_inflate 4cfc582f-56dc-40c7-841f-f110f959d271 00:17:44.004 19:04:00 -- target/nvmf_lvol.sh@53 -- # wait 3086545 00:17:52.109 Initializing NVMe Controllers 00:17:52.109 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:17:52.109 Controller IO queue size 128, less than required. 00:17:52.109 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:17:52.109 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 3 00:17:52.109 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 4 00:17:52.109 Initialization complete. Launching workers. 00:17:52.109 ======================================================== 00:17:52.109 Latency(us) 00:17:52.109 Device Information : IOPS MiB/s Average min max 00:17:52.109 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 3: 12040.20 47.03 10636.16 1570.12 86736.20 00:17:52.109 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 4: 11730.60 45.82 10914.65 3120.50 40556.33 00:17:52.109 ======================================================== 00:17:52.109 Total : 23770.80 92.85 10773.59 1570.12 86736.20 00:17:52.109 00:17:52.109 19:04:08 -- target/nvmf_lvol.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:17:52.370 19:04:09 -- target/nvmf_lvol.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 3c87d3c2-6e17-492f-ae7d-42908267577c 00:17:52.628 19:04:09 -- target/nvmf_lvol.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 37ca9ce9-859f-46a3-ab30-9f44210ac271 00:17:52.628 19:04:09 -- target/nvmf_lvol.sh@60 -- # rm -f 00:17:52.628 19:04:09 -- target/nvmf_lvol.sh@62 -- # trap - SIGINT SIGTERM EXIT 00:17:52.628 19:04:09 -- target/nvmf_lvol.sh@64 -- # nvmftestfini 00:17:52.628 19:04:09 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:52.628 19:04:09 -- nvmf/common.sh@116 -- # sync 00:17:52.628 19:04:09 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:52.628 19:04:09 -- nvmf/common.sh@119 -- # set +e 00:17:52.628 19:04:09 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:52.628 19:04:09 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:52.628 rmmod nvme_tcp 00:17:52.886 rmmod nvme_fabrics 00:17:52.886 rmmod nvme_keyring 00:17:52.886 19:04:09 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:52.886 19:04:09 -- nvmf/common.sh@123 -- # set -e 00:17:52.886 19:04:09 -- nvmf/common.sh@124 -- # return 0 00:17:52.886 19:04:09 -- nvmf/common.sh@477 -- # '[' -n 3086042 ']' 00:17:52.886 19:04:09 -- nvmf/common.sh@478 -- # killprocess 3086042 00:17:52.886 19:04:09 -- common/autotest_common.sh@936 -- # '[' -z 3086042 ']' 00:17:52.886 19:04:09 -- common/autotest_common.sh@940 -- # kill -0 3086042 00:17:52.886 19:04:09 -- common/autotest_common.sh@941 -- # uname 00:17:52.886 19:04:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:52.886 19:04:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3086042 00:17:52.886 19:04:09 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:17:52.886 19:04:09 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:17:52.886 19:04:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3086042' 00:17:52.886 killing process with pid 3086042 00:17:52.886 19:04:09 -- common/autotest_common.sh@955 -- # kill 3086042 00:17:52.886 19:04:09 -- common/autotest_common.sh@960 -- # wait 3086042 00:17:53.144 19:04:09 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:53.144 19:04:09 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:53.144 19:04:09 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:53.144 19:04:09 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:53.144 19:04:09 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:53.144 19:04:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:53.144 19:04:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:53.144 19:04:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:55.048 19:04:11 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:55.048 00:17:55.048 real 0m21.722s 00:17:55.048 user 1m4.270s 00:17:55.048 sys 0m7.180s 00:17:55.048 19:04:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:55.048 19:04:11 -- common/autotest_common.sh@10 -- # set +x 00:17:55.048 ************************************ 00:17:55.048 END TEST nvmf_lvol 00:17:55.048 ************************************ 00:17:55.307 19:04:11 -- nvmf/nvmf.sh@48 -- # run_test nvmf_lvs_grow /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:17:55.307 19:04:11 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:55.307 19:04:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:55.307 19:04:11 -- common/autotest_common.sh@10 -- # set +x 00:17:55.307 ************************************ 00:17:55.307 START TEST nvmf_lvs_grow 00:17:55.307 ************************************ 00:17:55.307 19:04:11 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:17:55.307 * Looking for test storage... 00:17:55.307 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:55.307 19:04:12 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:55.307 19:04:12 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:55.307 19:04:12 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:55.307 19:04:12 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:55.307 19:04:12 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:55.307 19:04:12 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:55.307 19:04:12 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:55.307 19:04:12 -- scripts/common.sh@335 -- # IFS=.-: 00:17:55.307 19:04:12 -- scripts/common.sh@335 -- # read -ra ver1 00:17:55.307 19:04:12 -- scripts/common.sh@336 -- # IFS=.-: 00:17:55.307 19:04:12 -- scripts/common.sh@336 -- # read -ra ver2 00:17:55.307 19:04:12 -- scripts/common.sh@337 -- # local 'op=<' 00:17:55.307 19:04:12 -- scripts/common.sh@339 -- # ver1_l=2 00:17:55.307 19:04:12 -- scripts/common.sh@340 -- # ver2_l=1 00:17:55.307 19:04:12 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:55.307 19:04:12 -- scripts/common.sh@343 -- # case "$op" in 00:17:55.307 19:04:12 -- scripts/common.sh@344 -- # : 1 00:17:55.307 19:04:12 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:55.307 19:04:12 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:55.307 19:04:12 -- scripts/common.sh@364 -- # decimal 1 00:17:55.307 19:04:12 -- scripts/common.sh@352 -- # local d=1 00:17:55.307 19:04:12 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:55.307 19:04:12 -- scripts/common.sh@354 -- # echo 1 00:17:55.307 19:04:12 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:55.307 19:04:12 -- scripts/common.sh@365 -- # decimal 2 00:17:55.307 19:04:12 -- scripts/common.sh@352 -- # local d=2 00:17:55.307 19:04:12 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:55.307 19:04:12 -- scripts/common.sh@354 -- # echo 2 00:17:55.307 19:04:12 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:55.307 19:04:12 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:55.307 19:04:12 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:55.307 19:04:12 -- scripts/common.sh@367 -- # return 0 00:17:55.307 19:04:12 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:55.307 19:04:12 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:55.307 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:55.307 --rc genhtml_branch_coverage=1 00:17:55.307 --rc genhtml_function_coverage=1 00:17:55.307 --rc genhtml_legend=1 00:17:55.307 --rc geninfo_all_blocks=1 00:17:55.307 --rc geninfo_unexecuted_blocks=1 00:17:55.307 00:17:55.307 ' 00:17:55.307 19:04:12 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:55.307 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:55.307 --rc genhtml_branch_coverage=1 00:17:55.307 --rc genhtml_function_coverage=1 00:17:55.307 --rc genhtml_legend=1 00:17:55.307 --rc geninfo_all_blocks=1 00:17:55.307 --rc geninfo_unexecuted_blocks=1 00:17:55.307 00:17:55.307 ' 00:17:55.307 19:04:12 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:55.307 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:55.307 --rc genhtml_branch_coverage=1 00:17:55.307 --rc genhtml_function_coverage=1 00:17:55.307 --rc genhtml_legend=1 00:17:55.307 --rc geninfo_all_blocks=1 00:17:55.307 --rc geninfo_unexecuted_blocks=1 00:17:55.307 00:17:55.307 ' 00:17:55.307 19:04:12 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:55.307 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:55.307 --rc genhtml_branch_coverage=1 00:17:55.307 --rc genhtml_function_coverage=1 00:17:55.307 --rc genhtml_legend=1 00:17:55.307 --rc geninfo_all_blocks=1 00:17:55.307 --rc geninfo_unexecuted_blocks=1 00:17:55.307 00:17:55.307 ' 00:17:55.307 19:04:12 -- target/nvmf_lvs_grow.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:55.307 19:04:12 -- nvmf/common.sh@7 -- # uname -s 00:17:55.307 19:04:12 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:55.307 19:04:12 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:55.307 19:04:12 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:55.307 19:04:12 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:55.307 19:04:12 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:55.307 19:04:12 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:55.307 19:04:12 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:55.307 19:04:12 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:55.307 19:04:12 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:55.307 19:04:12 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:55.307 19:04:12 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:17:55.307 19:04:12 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:17:55.307 19:04:12 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:55.307 19:04:12 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:55.307 19:04:12 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:55.307 19:04:12 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:55.307 19:04:12 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:55.307 19:04:12 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:55.307 19:04:12 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:55.307 19:04:12 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:55.307 19:04:12 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:55.307 19:04:12 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:55.307 19:04:12 -- paths/export.sh@5 -- # export PATH 00:17:55.307 19:04:12 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:55.307 19:04:12 -- nvmf/common.sh@46 -- # : 0 00:17:55.307 19:04:12 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:55.307 19:04:12 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:55.307 19:04:12 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:55.307 19:04:12 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:55.307 19:04:12 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:55.307 19:04:12 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:55.307 19:04:12 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:55.307 19:04:12 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:55.308 19:04:12 -- target/nvmf_lvs_grow.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:55.308 19:04:12 -- target/nvmf_lvs_grow.sh@12 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:55.308 19:04:12 -- target/nvmf_lvs_grow.sh@97 -- # nvmftestinit 00:17:55.308 19:04:12 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:55.308 19:04:12 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:55.308 19:04:12 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:55.308 19:04:12 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:55.308 19:04:12 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:55.308 19:04:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:55.308 19:04:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:55.308 19:04:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:55.308 19:04:12 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:55.308 19:04:12 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:55.308 19:04:12 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:55.308 19:04:12 -- common/autotest_common.sh@10 -- # set +x 00:18:00.584 19:04:16 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:00.584 19:04:16 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:00.584 19:04:16 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:00.584 19:04:16 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:00.584 19:04:16 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:00.584 19:04:16 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:00.584 19:04:16 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:00.584 19:04:16 -- nvmf/common.sh@294 -- # net_devs=() 00:18:00.584 19:04:16 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:00.584 19:04:16 -- nvmf/common.sh@295 -- # e810=() 00:18:00.584 19:04:16 -- nvmf/common.sh@295 -- # local -ga e810 00:18:00.584 19:04:16 -- nvmf/common.sh@296 -- # x722=() 00:18:00.584 19:04:16 -- nvmf/common.sh@296 -- # local -ga x722 00:18:00.584 19:04:16 -- nvmf/common.sh@297 -- # mlx=() 00:18:00.584 19:04:16 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:00.584 19:04:16 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:00.584 19:04:16 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:00.584 19:04:16 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:00.584 19:04:16 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:00.584 19:04:16 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:00.584 19:04:16 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:00.584 19:04:16 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:00.584 19:04:16 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:00.584 19:04:16 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:00.584 19:04:16 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:00.584 19:04:16 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:00.584 19:04:16 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:00.584 19:04:16 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:00.584 19:04:16 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:00.584 19:04:16 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:00.584 19:04:16 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:00.584 19:04:16 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:00.584 19:04:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:00.584 19:04:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:18:00.584 Found 0000:86:00.0 (0x8086 - 0x159b) 00:18:00.584 19:04:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:00.584 19:04:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:00.584 19:04:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:00.584 19:04:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:00.585 19:04:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:00.585 19:04:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:00.585 19:04:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:18:00.585 Found 0000:86:00.1 (0x8086 - 0x159b) 00:18:00.585 19:04:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:00.585 19:04:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:00.585 19:04:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:00.585 19:04:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:00.585 19:04:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:00.585 19:04:16 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:00.585 19:04:16 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:00.585 19:04:16 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:00.585 19:04:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:00.585 19:04:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:00.585 19:04:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:00.585 19:04:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:00.585 19:04:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:18:00.585 Found net devices under 0000:86:00.0: cvl_0_0 00:18:00.585 19:04:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:00.585 19:04:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:00.585 19:04:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:00.585 19:04:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:00.585 19:04:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:00.585 19:04:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:18:00.585 Found net devices under 0000:86:00.1: cvl_0_1 00:18:00.585 19:04:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:00.585 19:04:16 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:00.585 19:04:16 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:00.585 19:04:16 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:00.585 19:04:16 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:00.585 19:04:16 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:00.585 19:04:16 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:00.585 19:04:16 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:00.585 19:04:16 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:00.585 19:04:16 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:00.585 19:04:16 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:00.585 19:04:16 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:00.585 19:04:16 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:00.585 19:04:16 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:00.585 19:04:16 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:00.585 19:04:16 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:00.585 19:04:16 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:00.585 19:04:16 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:00.585 19:04:16 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:00.585 19:04:17 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:00.585 19:04:17 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:00.585 19:04:17 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:00.585 19:04:17 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:00.585 19:04:17 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:00.585 19:04:17 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:00.585 19:04:17 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:00.585 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:00.585 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.433 ms 00:18:00.585 00:18:00.585 --- 10.0.0.2 ping statistics --- 00:18:00.585 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:00.585 rtt min/avg/max/mdev = 0.433/0.433/0.433/0.000 ms 00:18:00.585 19:04:17 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:00.585 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:00.585 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.217 ms 00:18:00.585 00:18:00.585 --- 10.0.0.1 ping statistics --- 00:18:00.585 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:00.585 rtt min/avg/max/mdev = 0.217/0.217/0.217/0.000 ms 00:18:00.585 19:04:17 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:00.585 19:04:17 -- nvmf/common.sh@410 -- # return 0 00:18:00.585 19:04:17 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:00.585 19:04:17 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:00.585 19:04:17 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:00.585 19:04:17 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:00.585 19:04:17 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:00.585 19:04:17 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:00.585 19:04:17 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:00.585 19:04:17 -- target/nvmf_lvs_grow.sh@98 -- # nvmfappstart -m 0x1 00:18:00.585 19:04:17 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:00.585 19:04:17 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:00.585 19:04:17 -- common/autotest_common.sh@10 -- # set +x 00:18:00.585 19:04:17 -- nvmf/common.sh@469 -- # nvmfpid=3091911 00:18:00.585 19:04:17 -- nvmf/common.sh@470 -- # waitforlisten 3091911 00:18:00.585 19:04:17 -- common/autotest_common.sh@829 -- # '[' -z 3091911 ']' 00:18:00.585 19:04:17 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:00.585 19:04:17 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:00.585 19:04:17 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:00.585 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:00.585 19:04:17 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:00.585 19:04:17 -- common/autotest_common.sh@10 -- # set +x 00:18:00.585 19:04:17 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:18:00.585 [2024-11-26 19:04:17.243057] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:00.585 [2024-11-26 19:04:17.243101] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:00.585 EAL: No free 2048 kB hugepages reported on node 1 00:18:00.585 [2024-11-26 19:04:17.301860] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:00.585 [2024-11-26 19:04:17.340429] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:00.585 [2024-11-26 19:04:17.340541] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:00.585 [2024-11-26 19:04:17.340548] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:00.585 [2024-11-26 19:04:17.340555] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:00.585 [2024-11-26 19:04:17.340572] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:01.149 19:04:18 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:01.149 19:04:18 -- common/autotest_common.sh@862 -- # return 0 00:18:01.149 19:04:18 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:01.149 19:04:18 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:01.149 19:04:18 -- common/autotest_common.sh@10 -- # set +x 00:18:01.408 19:04:18 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:01.408 19:04:18 -- target/nvmf_lvs_grow.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:18:01.408 [2024-11-26 19:04:18.248037] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:01.408 19:04:18 -- target/nvmf_lvs_grow.sh@101 -- # run_test lvs_grow_clean lvs_grow 00:18:01.408 19:04:18 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:18:01.408 19:04:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:01.408 19:04:18 -- common/autotest_common.sh@10 -- # set +x 00:18:01.408 ************************************ 00:18:01.408 START TEST lvs_grow_clean 00:18:01.408 ************************************ 00:18:01.408 19:04:18 -- common/autotest_common.sh@1114 -- # lvs_grow 00:18:01.408 19:04:18 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:18:01.408 19:04:18 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:18:01.408 19:04:18 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:18:01.408 19:04:18 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:18:01.408 19:04:18 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:18:01.408 19:04:18 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:18:01.408 19:04:18 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:18:01.408 19:04:18 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:18:01.408 19:04:18 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:18:01.667 19:04:18 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:18:01.667 19:04:18 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:18:01.925 19:04:18 -- target/nvmf_lvs_grow.sh@28 -- # lvs=c70637fb-e70b-45f9-8a77-16fece1f214d 00:18:01.925 19:04:18 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:18:01.925 19:04:18 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c70637fb-e70b-45f9-8a77-16fece1f214d 00:18:01.925 19:04:18 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:18:01.925 19:04:18 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:18:01.925 19:04:18 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u c70637fb-e70b-45f9-8a77-16fece1f214d lvol 150 00:18:02.183 19:04:19 -- target/nvmf_lvs_grow.sh@33 -- # lvol=e0ccac68-fc8e-41a8-aa20-6738c04e96b0 00:18:02.183 19:04:19 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:18:02.183 19:04:19 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:18:02.451 [2024-11-26 19:04:19.185748] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:18:02.451 [2024-11-26 19:04:19.185798] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:18:02.451 true 00:18:02.451 19:04:19 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c70637fb-e70b-45f9-8a77-16fece1f214d 00:18:02.451 19:04:19 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:18:02.451 19:04:19 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:18:02.451 19:04:19 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:18:02.714 19:04:19 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 e0ccac68-fc8e-41a8-aa20-6738c04e96b0 00:18:02.972 19:04:19 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:18:02.972 [2024-11-26 19:04:19.867823] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:02.972 19:04:19 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:18:03.231 19:04:20 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=3092451 00:18:03.231 19:04:20 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:03.231 19:04:20 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 3092451 /var/tmp/bdevperf.sock 00:18:03.231 19:04:20 -- common/autotest_common.sh@829 -- # '[' -z 3092451 ']' 00:18:03.231 19:04:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:03.231 19:04:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:03.231 19:04:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:03.232 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:03.232 19:04:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:03.232 19:04:20 -- common/autotest_common.sh@10 -- # set +x 00:18:03.232 19:04:20 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:18:03.232 [2024-11-26 19:04:20.112575] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:03.232 [2024-11-26 19:04:20.112629] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3092451 ] 00:18:03.232 EAL: No free 2048 kB hugepages reported on node 1 00:18:03.491 [2024-11-26 19:04:20.168535] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:03.491 [2024-11-26 19:04:20.207774] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:04.058 19:04:20 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:04.058 19:04:20 -- common/autotest_common.sh@862 -- # return 0 00:18:04.058 19:04:20 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:18:04.626 Nvme0n1 00:18:04.626 19:04:21 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:18:04.626 [ 00:18:04.626 { 00:18:04.626 "name": "Nvme0n1", 00:18:04.626 "aliases": [ 00:18:04.626 "e0ccac68-fc8e-41a8-aa20-6738c04e96b0" 00:18:04.626 ], 00:18:04.626 "product_name": "NVMe disk", 00:18:04.626 "block_size": 4096, 00:18:04.626 "num_blocks": 38912, 00:18:04.626 "uuid": "e0ccac68-fc8e-41a8-aa20-6738c04e96b0", 00:18:04.626 "assigned_rate_limits": { 00:18:04.626 "rw_ios_per_sec": 0, 00:18:04.626 "rw_mbytes_per_sec": 0, 00:18:04.626 "r_mbytes_per_sec": 0, 00:18:04.626 "w_mbytes_per_sec": 0 00:18:04.626 }, 00:18:04.626 "claimed": false, 00:18:04.626 "zoned": false, 00:18:04.626 "supported_io_types": { 00:18:04.626 "read": true, 00:18:04.626 "write": true, 00:18:04.626 "unmap": true, 00:18:04.626 "write_zeroes": true, 00:18:04.626 "flush": true, 00:18:04.626 "reset": true, 00:18:04.626 "compare": true, 00:18:04.626 "compare_and_write": true, 00:18:04.626 "abort": true, 00:18:04.626 "nvme_admin": true, 00:18:04.626 "nvme_io": true 00:18:04.626 }, 00:18:04.626 "driver_specific": { 00:18:04.626 "nvme": [ 00:18:04.626 { 00:18:04.626 "trid": { 00:18:04.626 "trtype": "TCP", 00:18:04.626 "adrfam": "IPv4", 00:18:04.626 "traddr": "10.0.0.2", 00:18:04.626 "trsvcid": "4420", 00:18:04.626 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:18:04.626 }, 00:18:04.626 "ctrlr_data": { 00:18:04.626 "cntlid": 1, 00:18:04.626 "vendor_id": "0x8086", 00:18:04.626 "model_number": "SPDK bdev Controller", 00:18:04.626 "serial_number": "SPDK0", 00:18:04.626 "firmware_revision": "24.01.1", 00:18:04.626 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:18:04.626 "oacs": { 00:18:04.626 "security": 0, 00:18:04.626 "format": 0, 00:18:04.626 "firmware": 0, 00:18:04.626 "ns_manage": 0 00:18:04.626 }, 00:18:04.626 "multi_ctrlr": true, 00:18:04.626 "ana_reporting": false 00:18:04.626 }, 00:18:04.626 "vs": { 00:18:04.626 "nvme_version": "1.3" 00:18:04.626 }, 00:18:04.626 "ns_data": { 00:18:04.626 "id": 1, 00:18:04.626 "can_share": true 00:18:04.626 } 00:18:04.626 } 00:18:04.626 ], 00:18:04.626 "mp_policy": "active_passive" 00:18:04.626 } 00:18:04.626 } 00:18:04.626 ] 00:18:04.627 19:04:21 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=3092698 00:18:04.627 19:04:21 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:18:04.627 19:04:21 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:18:04.886 Running I/O for 10 seconds... 00:18:05.824 Latency(us) 00:18:05.824 [2024-11-26T18:04:22.751Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:05.824 [2024-11-26T18:04:22.751Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:05.824 Nvme0n1 : 1.00 23399.00 91.40 0.00 0.00 0.00 0.00 0.00 00:18:05.824 [2024-11-26T18:04:22.751Z] =================================================================================================================== 00:18:05.824 [2024-11-26T18:04:22.751Z] Total : 23399.00 91.40 0.00 0.00 0.00 0.00 0.00 00:18:05.824 00:18:06.763 19:04:23 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u c70637fb-e70b-45f9-8a77-16fece1f214d 00:18:06.763 [2024-11-26T18:04:23.690Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:06.763 Nvme0n1 : 2.00 23616.50 92.25 0.00 0.00 0.00 0.00 0.00 00:18:06.763 [2024-11-26T18:04:23.690Z] =================================================================================================================== 00:18:06.763 [2024-11-26T18:04:23.690Z] Total : 23616.50 92.25 0.00 0.00 0.00 0.00 0.00 00:18:06.763 00:18:07.069 true 00:18:07.069 19:04:23 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c70637fb-e70b-45f9-8a77-16fece1f214d 00:18:07.069 19:04:23 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:18:07.069 19:04:23 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:18:07.069 19:04:23 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:18:07.069 19:04:23 -- target/nvmf_lvs_grow.sh@65 -- # wait 3092698 00:18:08.054 [2024-11-26T18:04:24.981Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:08.054 Nvme0n1 : 3.00 23616.00 92.25 0.00 0.00 0.00 0.00 0.00 00:18:08.054 [2024-11-26T18:04:24.981Z] =================================================================================================================== 00:18:08.054 [2024-11-26T18:04:24.981Z] Total : 23616.00 92.25 0.00 0.00 0.00 0.00 0.00 00:18:08.054 00:18:08.992 [2024-11-26T18:04:25.919Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:08.992 Nvme0n1 : 4.00 23685.75 92.52 0.00 0.00 0.00 0.00 0.00 00:18:08.992 [2024-11-26T18:04:25.919Z] =================================================================================================================== 00:18:08.992 [2024-11-26T18:04:25.919Z] Total : 23685.75 92.52 0.00 0.00 0.00 0.00 0.00 00:18:08.992 00:18:10.042 [2024-11-26T18:04:26.969Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:10.042 Nvme0n1 : 5.00 23742.60 92.74 0.00 0.00 0.00 0.00 0.00 00:18:10.042 [2024-11-26T18:04:26.969Z] =================================================================================================================== 00:18:10.042 [2024-11-26T18:04:26.969Z] Total : 23742.60 92.74 0.00 0.00 0.00 0.00 0.00 00:18:10.042 00:18:10.980 [2024-11-26T18:04:27.907Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:10.980 Nvme0n1 : 6.00 23781.33 92.90 0.00 0.00 0.00 0.00 0.00 00:18:10.980 [2024-11-26T18:04:27.907Z] =================================================================================================================== 00:18:10.980 [2024-11-26T18:04:27.907Z] Total : 23781.33 92.90 0.00 0.00 0.00 0.00 0.00 00:18:10.980 00:18:11.915 [2024-11-26T18:04:28.842Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:11.915 Nvme0n1 : 7.00 23808.71 93.00 0.00 0.00 0.00 0.00 0.00 00:18:11.915 [2024-11-26T18:04:28.842Z] =================================================================================================================== 00:18:11.915 [2024-11-26T18:04:28.842Z] Total : 23808.71 93.00 0.00 0.00 0.00 0.00 0.00 00:18:11.915 00:18:12.849 [2024-11-26T18:04:29.776Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:12.849 Nvme0n1 : 8.00 23832.38 93.10 0.00 0.00 0.00 0.00 0.00 00:18:12.849 [2024-11-26T18:04:29.776Z] =================================================================================================================== 00:18:12.849 [2024-11-26T18:04:29.776Z] Total : 23832.38 93.10 0.00 0.00 0.00 0.00 0.00 00:18:12.849 00:18:13.785 [2024-11-26T18:04:30.712Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:13.785 Nvme0n1 : 9.00 23815.11 93.03 0.00 0.00 0.00 0.00 0.00 00:18:13.785 [2024-11-26T18:04:30.712Z] =================================================================================================================== 00:18:13.785 [2024-11-26T18:04:30.712Z] Total : 23815.11 93.03 0.00 0.00 0.00 0.00 0.00 00:18:13.785 00:18:15.162 [2024-11-26T18:04:32.089Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:15.163 Nvme0n1 : 10.00 23832.30 93.09 0.00 0.00 0.00 0.00 0.00 00:18:15.163 [2024-11-26T18:04:32.090Z] =================================================================================================================== 00:18:15.163 [2024-11-26T18:04:32.090Z] Total : 23832.30 93.09 0.00 0.00 0.00 0.00 0.00 00:18:15.163 00:18:15.163 00:18:15.163 Latency(us) 00:18:15.163 [2024-11-26T18:04:32.090Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:15.163 [2024-11-26T18:04:32.090Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:15.163 Nvme0n1 : 10.00 23828.16 93.08 0.00 0.00 5368.55 3105.84 13164.19 00:18:15.163 [2024-11-26T18:04:32.090Z] =================================================================================================================== 00:18:15.163 [2024-11-26T18:04:32.090Z] Total : 23828.16 93.08 0.00 0.00 5368.55 3105.84 13164.19 00:18:15.163 0 00:18:15.163 19:04:31 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 3092451 00:18:15.163 19:04:31 -- common/autotest_common.sh@936 -- # '[' -z 3092451 ']' 00:18:15.163 19:04:31 -- common/autotest_common.sh@940 -- # kill -0 3092451 00:18:15.163 19:04:31 -- common/autotest_common.sh@941 -- # uname 00:18:15.163 19:04:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:15.163 19:04:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3092451 00:18:15.163 19:04:31 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:15.163 19:04:31 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:15.163 19:04:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3092451' 00:18:15.163 killing process with pid 3092451 00:18:15.163 19:04:31 -- common/autotest_common.sh@955 -- # kill 3092451 00:18:15.163 Received shutdown signal, test time was about 10.000000 seconds 00:18:15.163 00:18:15.163 Latency(us) 00:18:15.163 [2024-11-26T18:04:32.090Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:15.163 [2024-11-26T18:04:32.090Z] =================================================================================================================== 00:18:15.163 [2024-11-26T18:04:32.090Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:15.163 19:04:31 -- common/autotest_common.sh@960 -- # wait 3092451 00:18:15.163 19:04:31 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:18:15.422 19:04:32 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c70637fb-e70b-45f9-8a77-16fece1f214d 00:18:15.422 19:04:32 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:18:15.422 19:04:32 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:18:15.422 19:04:32 -- target/nvmf_lvs_grow.sh@71 -- # [[ '' == \d\i\r\t\y ]] 00:18:15.422 19:04:32 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:18:15.680 [2024-11-26 19:04:32.434528] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:18:15.680 19:04:32 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c70637fb-e70b-45f9-8a77-16fece1f214d 00:18:15.680 19:04:32 -- common/autotest_common.sh@650 -- # local es=0 00:18:15.681 19:04:32 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c70637fb-e70b-45f9-8a77-16fece1f214d 00:18:15.681 19:04:32 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:15.681 19:04:32 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:15.681 19:04:32 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:15.681 19:04:32 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:15.681 19:04:32 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:15.681 19:04:32 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:15.681 19:04:32 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:15.681 19:04:32 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:18:15.681 19:04:32 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c70637fb-e70b-45f9-8a77-16fece1f214d 00:18:15.939 request: 00:18:15.939 { 00:18:15.939 "uuid": "c70637fb-e70b-45f9-8a77-16fece1f214d", 00:18:15.939 "method": "bdev_lvol_get_lvstores", 00:18:15.939 "req_id": 1 00:18:15.939 } 00:18:15.939 Got JSON-RPC error response 00:18:15.939 response: 00:18:15.939 { 00:18:15.939 "code": -19, 00:18:15.939 "message": "No such device" 00:18:15.940 } 00:18:15.940 19:04:32 -- common/autotest_common.sh@653 -- # es=1 00:18:15.940 19:04:32 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:18:15.940 19:04:32 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:18:15.940 19:04:32 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:18:15.940 19:04:32 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:18:15.940 aio_bdev 00:18:15.940 19:04:32 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev e0ccac68-fc8e-41a8-aa20-6738c04e96b0 00:18:15.940 19:04:32 -- common/autotest_common.sh@897 -- # local bdev_name=e0ccac68-fc8e-41a8-aa20-6738c04e96b0 00:18:15.940 19:04:32 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:18:15.940 19:04:32 -- common/autotest_common.sh@899 -- # local i 00:18:15.940 19:04:32 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:18:15.940 19:04:32 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:18:15.940 19:04:32 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:18:16.198 19:04:33 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b e0ccac68-fc8e-41a8-aa20-6738c04e96b0 -t 2000 00:18:16.457 [ 00:18:16.457 { 00:18:16.457 "name": "e0ccac68-fc8e-41a8-aa20-6738c04e96b0", 00:18:16.457 "aliases": [ 00:18:16.457 "lvs/lvol" 00:18:16.457 ], 00:18:16.457 "product_name": "Logical Volume", 00:18:16.457 "block_size": 4096, 00:18:16.457 "num_blocks": 38912, 00:18:16.457 "uuid": "e0ccac68-fc8e-41a8-aa20-6738c04e96b0", 00:18:16.457 "assigned_rate_limits": { 00:18:16.457 "rw_ios_per_sec": 0, 00:18:16.457 "rw_mbytes_per_sec": 0, 00:18:16.457 "r_mbytes_per_sec": 0, 00:18:16.457 "w_mbytes_per_sec": 0 00:18:16.457 }, 00:18:16.457 "claimed": false, 00:18:16.457 "zoned": false, 00:18:16.457 "supported_io_types": { 00:18:16.457 "read": true, 00:18:16.457 "write": true, 00:18:16.457 "unmap": true, 00:18:16.457 "write_zeroes": true, 00:18:16.457 "flush": false, 00:18:16.457 "reset": true, 00:18:16.457 "compare": false, 00:18:16.457 "compare_and_write": false, 00:18:16.457 "abort": false, 00:18:16.457 "nvme_admin": false, 00:18:16.457 "nvme_io": false 00:18:16.457 }, 00:18:16.457 "driver_specific": { 00:18:16.457 "lvol": { 00:18:16.457 "lvol_store_uuid": "c70637fb-e70b-45f9-8a77-16fece1f214d", 00:18:16.457 "base_bdev": "aio_bdev", 00:18:16.457 "thin_provision": false, 00:18:16.457 "snapshot": false, 00:18:16.457 "clone": false, 00:18:16.457 "esnap_clone": false 00:18:16.457 } 00:18:16.457 } 00:18:16.457 } 00:18:16.457 ] 00:18:16.457 19:04:33 -- common/autotest_common.sh@905 -- # return 0 00:18:16.457 19:04:33 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c70637fb-e70b-45f9-8a77-16fece1f214d 00:18:16.457 19:04:33 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:18:16.715 19:04:33 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:18:16.716 19:04:33 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c70637fb-e70b-45f9-8a77-16fece1f214d 00:18:16.716 19:04:33 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:18:16.716 19:04:33 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:18:16.716 19:04:33 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete e0ccac68-fc8e-41a8-aa20-6738c04e96b0 00:18:16.974 19:04:33 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u c70637fb-e70b-45f9-8a77-16fece1f214d 00:18:17.233 19:04:33 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:18:17.234 19:04:34 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:18:17.492 00:18:17.492 real 0m15.892s 00:18:17.492 user 0m15.624s 00:18:17.492 sys 0m1.427s 00:18:17.492 19:04:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:17.492 19:04:34 -- common/autotest_common.sh@10 -- # set +x 00:18:17.492 ************************************ 00:18:17.492 END TEST lvs_grow_clean 00:18:17.492 ************************************ 00:18:17.492 19:04:34 -- target/nvmf_lvs_grow.sh@102 -- # run_test lvs_grow_dirty lvs_grow dirty 00:18:17.492 19:04:34 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:17.492 19:04:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:17.492 19:04:34 -- common/autotest_common.sh@10 -- # set +x 00:18:17.492 ************************************ 00:18:17.492 START TEST lvs_grow_dirty 00:18:17.492 ************************************ 00:18:17.492 19:04:34 -- common/autotest_common.sh@1114 -- # lvs_grow dirty 00:18:17.492 19:04:34 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:18:17.492 19:04:34 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:18:17.492 19:04:34 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:18:17.492 19:04:34 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:18:17.492 19:04:34 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:18:17.492 19:04:34 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:18:17.492 19:04:34 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:18:17.492 19:04:34 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:18:17.492 19:04:34 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:18:17.492 19:04:34 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:18:17.493 19:04:34 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:18:17.751 19:04:34 -- target/nvmf_lvs_grow.sh@28 -- # lvs=bf6b95b6-5af9-4d54-9ebd-2227ed754237 00:18:17.751 19:04:34 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u bf6b95b6-5af9-4d54-9ebd-2227ed754237 00:18:17.751 19:04:34 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:18:18.010 19:04:34 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:18:18.010 19:04:34 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:18:18.010 19:04:34 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u bf6b95b6-5af9-4d54-9ebd-2227ed754237 lvol 150 00:18:18.269 19:04:34 -- target/nvmf_lvs_grow.sh@33 -- # lvol=f219085e-8679-4e1c-bc41-dfbb2deea549 00:18:18.269 19:04:34 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:18:18.269 19:04:34 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:18:18.269 [2024-11-26 19:04:35.140838] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:18:18.269 [2024-11-26 19:04:35.140883] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:18:18.269 true 00:18:18.269 19:04:35 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:18:18.269 19:04:35 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u bf6b95b6-5af9-4d54-9ebd-2227ed754237 00:18:18.529 19:04:35 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:18:18.529 19:04:35 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:18:18.788 19:04:35 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 f219085e-8679-4e1c-bc41-dfbb2deea549 00:18:18.788 19:04:35 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:18:19.046 19:04:35 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:18:19.306 19:04:36 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=3095100 00:18:19.306 19:04:36 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:18:19.306 19:04:36 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:19.306 19:04:36 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 3095100 /var/tmp/bdevperf.sock 00:18:19.306 19:04:36 -- common/autotest_common.sh@829 -- # '[' -z 3095100 ']' 00:18:19.306 19:04:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:19.306 19:04:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:19.306 19:04:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:19.306 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:19.306 19:04:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:19.306 19:04:36 -- common/autotest_common.sh@10 -- # set +x 00:18:19.306 [2024-11-26 19:04:36.077814] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:19.306 [2024-11-26 19:04:36.077861] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3095100 ] 00:18:19.306 EAL: No free 2048 kB hugepages reported on node 1 00:18:19.306 [2024-11-26 19:04:36.130870] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:19.306 [2024-11-26 19:04:36.167966] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:20.242 19:04:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:20.242 19:04:36 -- common/autotest_common.sh@862 -- # return 0 00:18:20.242 19:04:36 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:18:20.501 Nvme0n1 00:18:20.501 19:04:37 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:18:20.767 [ 00:18:20.767 { 00:18:20.767 "name": "Nvme0n1", 00:18:20.767 "aliases": [ 00:18:20.767 "f219085e-8679-4e1c-bc41-dfbb2deea549" 00:18:20.767 ], 00:18:20.767 "product_name": "NVMe disk", 00:18:20.767 "block_size": 4096, 00:18:20.767 "num_blocks": 38912, 00:18:20.767 "uuid": "f219085e-8679-4e1c-bc41-dfbb2deea549", 00:18:20.767 "assigned_rate_limits": { 00:18:20.767 "rw_ios_per_sec": 0, 00:18:20.767 "rw_mbytes_per_sec": 0, 00:18:20.767 "r_mbytes_per_sec": 0, 00:18:20.767 "w_mbytes_per_sec": 0 00:18:20.767 }, 00:18:20.767 "claimed": false, 00:18:20.767 "zoned": false, 00:18:20.767 "supported_io_types": { 00:18:20.767 "read": true, 00:18:20.767 "write": true, 00:18:20.767 "unmap": true, 00:18:20.767 "write_zeroes": true, 00:18:20.767 "flush": true, 00:18:20.767 "reset": true, 00:18:20.767 "compare": true, 00:18:20.767 "compare_and_write": true, 00:18:20.767 "abort": true, 00:18:20.767 "nvme_admin": true, 00:18:20.767 "nvme_io": true 00:18:20.767 }, 00:18:20.767 "driver_specific": { 00:18:20.767 "nvme": [ 00:18:20.767 { 00:18:20.767 "trid": { 00:18:20.767 "trtype": "TCP", 00:18:20.767 "adrfam": "IPv4", 00:18:20.767 "traddr": "10.0.0.2", 00:18:20.767 "trsvcid": "4420", 00:18:20.767 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:18:20.767 }, 00:18:20.767 "ctrlr_data": { 00:18:20.767 "cntlid": 1, 00:18:20.767 "vendor_id": "0x8086", 00:18:20.767 "model_number": "SPDK bdev Controller", 00:18:20.767 "serial_number": "SPDK0", 00:18:20.767 "firmware_revision": "24.01.1", 00:18:20.767 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:18:20.767 "oacs": { 00:18:20.767 "security": 0, 00:18:20.767 "format": 0, 00:18:20.767 "firmware": 0, 00:18:20.767 "ns_manage": 0 00:18:20.767 }, 00:18:20.767 "multi_ctrlr": true, 00:18:20.767 "ana_reporting": false 00:18:20.767 }, 00:18:20.767 "vs": { 00:18:20.767 "nvme_version": "1.3" 00:18:20.767 }, 00:18:20.767 "ns_data": { 00:18:20.767 "id": 1, 00:18:20.767 "can_share": true 00:18:20.767 } 00:18:20.767 } 00:18:20.767 ], 00:18:20.767 "mp_policy": "active_passive" 00:18:20.767 } 00:18:20.767 } 00:18:20.767 ] 00:18:20.767 19:04:37 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=3095336 00:18:20.767 19:04:37 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:18:20.767 19:04:37 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:18:20.767 Running I/O for 10 seconds... 00:18:21.705 Latency(us) 00:18:21.705 [2024-11-26T18:04:38.632Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:21.705 [2024-11-26T18:04:38.632Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:21.705 Nvme0n1 : 1.00 23523.00 91.89 0.00 0.00 0.00 0.00 0.00 00:18:21.705 [2024-11-26T18:04:38.632Z] =================================================================================================================== 00:18:21.705 [2024-11-26T18:04:38.632Z] Total : 23523.00 91.89 0.00 0.00 0.00 0.00 0.00 00:18:21.705 00:18:22.642 19:04:39 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u bf6b95b6-5af9-4d54-9ebd-2227ed754237 00:18:22.642 [2024-11-26T18:04:39.569Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:22.642 Nvme0n1 : 2.00 23605.50 92.21 0.00 0.00 0.00 0.00 0.00 00:18:22.642 [2024-11-26T18:04:39.569Z] =================================================================================================================== 00:18:22.642 [2024-11-26T18:04:39.569Z] Total : 23605.50 92.21 0.00 0.00 0.00 0.00 0.00 00:18:22.642 00:18:22.901 true 00:18:22.901 19:04:39 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u bf6b95b6-5af9-4d54-9ebd-2227ed754237 00:18:22.901 19:04:39 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:18:23.160 19:04:39 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:18:23.160 19:04:39 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:18:23.160 19:04:39 -- target/nvmf_lvs_grow.sh@65 -- # wait 3095336 00:18:23.728 [2024-11-26T18:04:40.655Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:23.728 Nvme0n1 : 3.00 23512.00 91.84 0.00 0.00 0.00 0.00 0.00 00:18:23.728 [2024-11-26T18:04:40.655Z] =================================================================================================================== 00:18:23.728 [2024-11-26T18:04:40.655Z] Total : 23512.00 91.84 0.00 0.00 0.00 0.00 0.00 00:18:23.728 00:18:24.662 [2024-11-26T18:04:41.589Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:24.663 Nvme0n1 : 4.00 23599.75 92.19 0.00 0.00 0.00 0.00 0.00 00:18:24.663 [2024-11-26T18:04:41.590Z] =================================================================================================================== 00:18:24.663 [2024-11-26T18:04:41.590Z] Total : 23599.75 92.19 0.00 0.00 0.00 0.00 0.00 00:18:24.663 00:18:26.053 [2024-11-26T18:04:42.980Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:26.053 Nvme0n1 : 5.00 23659.80 92.42 0.00 0.00 0.00 0.00 0.00 00:18:26.053 [2024-11-26T18:04:42.980Z] =================================================================================================================== 00:18:26.053 [2024-11-26T18:04:42.980Z] Total : 23659.80 92.42 0.00 0.00 0.00 0.00 0.00 00:18:26.053 00:18:26.989 [2024-11-26T18:04:43.916Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:26.989 Nvme0n1 : 6.00 23693.50 92.55 0.00 0.00 0.00 0.00 0.00 00:18:26.989 [2024-11-26T18:04:43.916Z] =================================================================================================================== 00:18:26.989 [2024-11-26T18:04:43.916Z] Total : 23693.50 92.55 0.00 0.00 0.00 0.00 0.00 00:18:26.989 00:18:27.924 [2024-11-26T18:04:44.851Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:27.924 Nvme0n1 : 7.00 23720.57 92.66 0.00 0.00 0.00 0.00 0.00 00:18:27.924 [2024-11-26T18:04:44.851Z] =================================================================================================================== 00:18:27.924 [2024-11-26T18:04:44.851Z] Total : 23720.57 92.66 0.00 0.00 0.00 0.00 0.00 00:18:27.924 00:18:28.861 [2024-11-26T18:04:45.788Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:28.861 Nvme0n1 : 8.00 23746.38 92.76 0.00 0.00 0.00 0.00 0.00 00:18:28.861 [2024-11-26T18:04:45.788Z] =================================================================================================================== 00:18:28.861 [2024-11-26T18:04:45.788Z] Total : 23746.38 92.76 0.00 0.00 0.00 0.00 0.00 00:18:28.861 00:18:29.797 [2024-11-26T18:04:46.724Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:29.797 Nvme0n1 : 9.00 23783.44 92.90 0.00 0.00 0.00 0.00 0.00 00:18:29.797 [2024-11-26T18:04:46.724Z] =================================================================================================================== 00:18:29.797 [2024-11-26T18:04:46.724Z] Total : 23783.44 92.90 0.00 0.00 0.00 0.00 0.00 00:18:29.797 00:18:30.734 [2024-11-26T18:04:47.661Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:30.734 Nvme0n1 : 10.00 23788.30 92.92 0.00 0.00 0.00 0.00 0.00 00:18:30.734 [2024-11-26T18:04:47.661Z] =================================================================================================================== 00:18:30.734 [2024-11-26T18:04:47.661Z] Total : 23788.30 92.92 0.00 0.00 0.00 0.00 0.00 00:18:30.734 00:18:30.734 00:18:30.734 Latency(us) 00:18:30.734 [2024-11-26T18:04:47.661Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:30.734 [2024-11-26T18:04:47.661Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:30.734 Nvme0n1 : 10.00 23791.58 92.94 0.00 0.00 5377.28 1438.94 10770.70 00:18:30.734 [2024-11-26T18:04:47.661Z] =================================================================================================================== 00:18:30.734 [2024-11-26T18:04:47.661Z] Total : 23791.58 92.94 0.00 0.00 5377.28 1438.94 10770.70 00:18:30.734 0 00:18:30.734 19:04:47 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 3095100 00:18:30.734 19:04:47 -- common/autotest_common.sh@936 -- # '[' -z 3095100 ']' 00:18:30.734 19:04:47 -- common/autotest_common.sh@940 -- # kill -0 3095100 00:18:30.734 19:04:47 -- common/autotest_common.sh@941 -- # uname 00:18:30.734 19:04:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:30.734 19:04:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3095100 00:18:30.993 19:04:47 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:30.993 19:04:47 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:30.993 19:04:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3095100' 00:18:30.993 killing process with pid 3095100 00:18:30.993 19:04:47 -- common/autotest_common.sh@955 -- # kill 3095100 00:18:30.993 Received shutdown signal, test time was about 10.000000 seconds 00:18:30.993 00:18:30.993 Latency(us) 00:18:30.993 [2024-11-26T18:04:47.920Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:30.993 [2024-11-26T18:04:47.920Z] =================================================================================================================== 00:18:30.993 [2024-11-26T18:04:47.920Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:30.993 19:04:47 -- common/autotest_common.sh@960 -- # wait 3095100 00:18:30.993 19:04:47 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:18:31.253 19:04:48 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u bf6b95b6-5af9-4d54-9ebd-2227ed754237 00:18:31.253 19:04:48 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:18:31.512 19:04:48 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:18:31.512 19:04:48 -- target/nvmf_lvs_grow.sh@71 -- # [[ dirty == \d\i\r\t\y ]] 00:18:31.512 19:04:48 -- target/nvmf_lvs_grow.sh@73 -- # kill -9 3091911 00:18:31.512 19:04:48 -- target/nvmf_lvs_grow.sh@74 -- # wait 3091911 00:18:31.512 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh: line 74: 3091911 Killed "${NVMF_APP[@]}" "$@" 00:18:31.512 19:04:48 -- target/nvmf_lvs_grow.sh@74 -- # true 00:18:31.512 19:04:48 -- target/nvmf_lvs_grow.sh@75 -- # nvmfappstart -m 0x1 00:18:31.512 19:04:48 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:31.512 19:04:48 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:31.513 19:04:48 -- common/autotest_common.sh@10 -- # set +x 00:18:31.513 19:04:48 -- nvmf/common.sh@469 -- # nvmfpid=3097203 00:18:31.513 19:04:48 -- nvmf/common.sh@470 -- # waitforlisten 3097203 00:18:31.513 19:04:48 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:18:31.513 19:04:48 -- common/autotest_common.sh@829 -- # '[' -z 3097203 ']' 00:18:31.513 19:04:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:31.513 19:04:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:31.513 19:04:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:31.513 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:31.513 19:04:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:31.513 19:04:48 -- common/autotest_common.sh@10 -- # set +x 00:18:31.513 [2024-11-26 19:04:48.316812] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:31.513 [2024-11-26 19:04:48.316859] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:31.513 EAL: No free 2048 kB hugepages reported on node 1 00:18:31.513 [2024-11-26 19:04:48.375841] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:31.513 [2024-11-26 19:04:48.415192] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:31.513 [2024-11-26 19:04:48.415326] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:31.513 [2024-11-26 19:04:48.415334] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:31.513 [2024-11-26 19:04:48.415341] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:31.513 [2024-11-26 19:04:48.415356] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:32.449 19:04:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:32.449 19:04:49 -- common/autotest_common.sh@862 -- # return 0 00:18:32.449 19:04:49 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:32.449 19:04:49 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:32.449 19:04:49 -- common/autotest_common.sh@10 -- # set +x 00:18:32.449 19:04:49 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:32.449 19:04:49 -- target/nvmf_lvs_grow.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:18:32.449 [2024-11-26 19:04:49.332618] blobstore.c:4642:bs_recover: *NOTICE*: Performing recovery on blobstore 00:18:32.449 [2024-11-26 19:04:49.332725] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x0 00:18:32.449 [2024-11-26 19:04:49.332750] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x1 00:18:32.449 19:04:49 -- target/nvmf_lvs_grow.sh@76 -- # aio_bdev=aio_bdev 00:18:32.449 19:04:49 -- target/nvmf_lvs_grow.sh@77 -- # waitforbdev f219085e-8679-4e1c-bc41-dfbb2deea549 00:18:32.449 19:04:49 -- common/autotest_common.sh@897 -- # local bdev_name=f219085e-8679-4e1c-bc41-dfbb2deea549 00:18:32.449 19:04:49 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:18:32.449 19:04:49 -- common/autotest_common.sh@899 -- # local i 00:18:32.449 19:04:49 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:18:32.449 19:04:49 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:18:32.449 19:04:49 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:18:32.708 19:04:49 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b f219085e-8679-4e1c-bc41-dfbb2deea549 -t 2000 00:18:32.966 [ 00:18:32.966 { 00:18:32.966 "name": "f219085e-8679-4e1c-bc41-dfbb2deea549", 00:18:32.966 "aliases": [ 00:18:32.966 "lvs/lvol" 00:18:32.966 ], 00:18:32.966 "product_name": "Logical Volume", 00:18:32.966 "block_size": 4096, 00:18:32.966 "num_blocks": 38912, 00:18:32.966 "uuid": "f219085e-8679-4e1c-bc41-dfbb2deea549", 00:18:32.966 "assigned_rate_limits": { 00:18:32.966 "rw_ios_per_sec": 0, 00:18:32.966 "rw_mbytes_per_sec": 0, 00:18:32.966 "r_mbytes_per_sec": 0, 00:18:32.966 "w_mbytes_per_sec": 0 00:18:32.966 }, 00:18:32.966 "claimed": false, 00:18:32.966 "zoned": false, 00:18:32.966 "supported_io_types": { 00:18:32.966 "read": true, 00:18:32.966 "write": true, 00:18:32.966 "unmap": true, 00:18:32.966 "write_zeroes": true, 00:18:32.966 "flush": false, 00:18:32.966 "reset": true, 00:18:32.966 "compare": false, 00:18:32.966 "compare_and_write": false, 00:18:32.966 "abort": false, 00:18:32.966 "nvme_admin": false, 00:18:32.966 "nvme_io": false 00:18:32.966 }, 00:18:32.966 "driver_specific": { 00:18:32.966 "lvol": { 00:18:32.966 "lvol_store_uuid": "bf6b95b6-5af9-4d54-9ebd-2227ed754237", 00:18:32.966 "base_bdev": "aio_bdev", 00:18:32.966 "thin_provision": false, 00:18:32.966 "snapshot": false, 00:18:32.966 "clone": false, 00:18:32.966 "esnap_clone": false 00:18:32.966 } 00:18:32.966 } 00:18:32.966 } 00:18:32.966 ] 00:18:32.966 19:04:49 -- common/autotest_common.sh@905 -- # return 0 00:18:32.966 19:04:49 -- target/nvmf_lvs_grow.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u bf6b95b6-5af9-4d54-9ebd-2227ed754237 00:18:32.966 19:04:49 -- target/nvmf_lvs_grow.sh@78 -- # jq -r '.[0].free_clusters' 00:18:32.966 19:04:49 -- target/nvmf_lvs_grow.sh@78 -- # (( free_clusters == 61 )) 00:18:32.966 19:04:49 -- target/nvmf_lvs_grow.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u bf6b95b6-5af9-4d54-9ebd-2227ed754237 00:18:32.966 19:04:49 -- target/nvmf_lvs_grow.sh@79 -- # jq -r '.[0].total_data_clusters' 00:18:33.224 19:04:50 -- target/nvmf_lvs_grow.sh@79 -- # (( data_clusters == 99 )) 00:18:33.224 19:04:50 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:18:33.485 [2024-11-26 19:04:50.213176] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:18:33.485 19:04:50 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u bf6b95b6-5af9-4d54-9ebd-2227ed754237 00:18:33.485 19:04:50 -- common/autotest_common.sh@650 -- # local es=0 00:18:33.485 19:04:50 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u bf6b95b6-5af9-4d54-9ebd-2227ed754237 00:18:33.485 19:04:50 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:33.485 19:04:50 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:33.485 19:04:50 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:33.485 19:04:50 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:33.485 19:04:50 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:33.485 19:04:50 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:33.485 19:04:50 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:33.485 19:04:50 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:18:33.485 19:04:50 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u bf6b95b6-5af9-4d54-9ebd-2227ed754237 00:18:33.747 request: 00:18:33.747 { 00:18:33.747 "uuid": "bf6b95b6-5af9-4d54-9ebd-2227ed754237", 00:18:33.747 "method": "bdev_lvol_get_lvstores", 00:18:33.747 "req_id": 1 00:18:33.747 } 00:18:33.747 Got JSON-RPC error response 00:18:33.747 response: 00:18:33.747 { 00:18:33.747 "code": -19, 00:18:33.747 "message": "No such device" 00:18:33.747 } 00:18:33.747 19:04:50 -- common/autotest_common.sh@653 -- # es=1 00:18:33.747 19:04:50 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:18:33.747 19:04:50 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:18:33.747 19:04:50 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:18:33.747 19:04:50 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:18:33.747 aio_bdev 00:18:33.747 19:04:50 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev f219085e-8679-4e1c-bc41-dfbb2deea549 00:18:33.747 19:04:50 -- common/autotest_common.sh@897 -- # local bdev_name=f219085e-8679-4e1c-bc41-dfbb2deea549 00:18:33.747 19:04:50 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:18:33.747 19:04:50 -- common/autotest_common.sh@899 -- # local i 00:18:33.747 19:04:50 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:18:33.747 19:04:50 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:18:33.747 19:04:50 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:18:34.006 19:04:50 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b f219085e-8679-4e1c-bc41-dfbb2deea549 -t 2000 00:18:34.265 [ 00:18:34.265 { 00:18:34.265 "name": "f219085e-8679-4e1c-bc41-dfbb2deea549", 00:18:34.265 "aliases": [ 00:18:34.265 "lvs/lvol" 00:18:34.265 ], 00:18:34.265 "product_name": "Logical Volume", 00:18:34.265 "block_size": 4096, 00:18:34.265 "num_blocks": 38912, 00:18:34.265 "uuid": "f219085e-8679-4e1c-bc41-dfbb2deea549", 00:18:34.265 "assigned_rate_limits": { 00:18:34.265 "rw_ios_per_sec": 0, 00:18:34.265 "rw_mbytes_per_sec": 0, 00:18:34.265 "r_mbytes_per_sec": 0, 00:18:34.265 "w_mbytes_per_sec": 0 00:18:34.265 }, 00:18:34.265 "claimed": false, 00:18:34.265 "zoned": false, 00:18:34.265 "supported_io_types": { 00:18:34.265 "read": true, 00:18:34.265 "write": true, 00:18:34.265 "unmap": true, 00:18:34.265 "write_zeroes": true, 00:18:34.265 "flush": false, 00:18:34.265 "reset": true, 00:18:34.265 "compare": false, 00:18:34.265 "compare_and_write": false, 00:18:34.265 "abort": false, 00:18:34.265 "nvme_admin": false, 00:18:34.265 "nvme_io": false 00:18:34.265 }, 00:18:34.265 "driver_specific": { 00:18:34.265 "lvol": { 00:18:34.265 "lvol_store_uuid": "bf6b95b6-5af9-4d54-9ebd-2227ed754237", 00:18:34.265 "base_bdev": "aio_bdev", 00:18:34.265 "thin_provision": false, 00:18:34.265 "snapshot": false, 00:18:34.265 "clone": false, 00:18:34.265 "esnap_clone": false 00:18:34.265 } 00:18:34.265 } 00:18:34.265 } 00:18:34.265 ] 00:18:34.265 19:04:50 -- common/autotest_common.sh@905 -- # return 0 00:18:34.266 19:04:50 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u bf6b95b6-5af9-4d54-9ebd-2227ed754237 00:18:34.266 19:04:50 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:18:34.266 19:04:51 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:18:34.266 19:04:51 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u bf6b95b6-5af9-4d54-9ebd-2227ed754237 00:18:34.266 19:04:51 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:18:34.525 19:04:51 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:18:34.525 19:04:51 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete f219085e-8679-4e1c-bc41-dfbb2deea549 00:18:34.784 19:04:51 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u bf6b95b6-5af9-4d54-9ebd-2227ed754237 00:18:34.784 19:04:51 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:18:35.043 19:04:51 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:18:35.043 00:18:35.043 real 0m17.652s 00:18:35.043 user 0m45.058s 00:18:35.043 sys 0m3.985s 00:18:35.043 19:04:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:35.043 19:04:51 -- common/autotest_common.sh@10 -- # set +x 00:18:35.043 ************************************ 00:18:35.043 END TEST lvs_grow_dirty 00:18:35.043 ************************************ 00:18:35.043 19:04:51 -- target/nvmf_lvs_grow.sh@1 -- # process_shm --id 0 00:18:35.043 19:04:51 -- common/autotest_common.sh@806 -- # type=--id 00:18:35.043 19:04:51 -- common/autotest_common.sh@807 -- # id=0 00:18:35.043 19:04:51 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:18:35.043 19:04:51 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:18:35.043 19:04:51 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:18:35.043 19:04:51 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:18:35.043 19:04:51 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:18:35.043 19:04:51 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:18:35.043 nvmf_trace.0 00:18:35.043 19:04:51 -- common/autotest_common.sh@821 -- # return 0 00:18:35.043 19:04:51 -- target/nvmf_lvs_grow.sh@1 -- # nvmftestfini 00:18:35.043 19:04:51 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:35.043 19:04:51 -- nvmf/common.sh@116 -- # sync 00:18:35.043 19:04:51 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:35.043 19:04:51 -- nvmf/common.sh@119 -- # set +e 00:18:35.043 19:04:51 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:35.043 19:04:51 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:35.043 rmmod nvme_tcp 00:18:35.043 rmmod nvme_fabrics 00:18:35.303 rmmod nvme_keyring 00:18:35.303 19:04:51 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:35.303 19:04:51 -- nvmf/common.sh@123 -- # set -e 00:18:35.303 19:04:51 -- nvmf/common.sh@124 -- # return 0 00:18:35.303 19:04:51 -- nvmf/common.sh@477 -- # '[' -n 3097203 ']' 00:18:35.303 19:04:51 -- nvmf/common.sh@478 -- # killprocess 3097203 00:18:35.303 19:04:51 -- common/autotest_common.sh@936 -- # '[' -z 3097203 ']' 00:18:35.303 19:04:51 -- common/autotest_common.sh@940 -- # kill -0 3097203 00:18:35.303 19:04:51 -- common/autotest_common.sh@941 -- # uname 00:18:35.303 19:04:51 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:35.303 19:04:51 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3097203 00:18:35.303 19:04:52 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:18:35.303 19:04:52 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:18:35.303 19:04:52 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3097203' 00:18:35.303 killing process with pid 3097203 00:18:35.303 19:04:52 -- common/autotest_common.sh@955 -- # kill 3097203 00:18:35.303 19:04:52 -- common/autotest_common.sh@960 -- # wait 3097203 00:18:35.303 19:04:52 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:35.303 19:04:52 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:35.303 19:04:52 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:35.303 19:04:52 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:35.303 19:04:52 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:35.303 19:04:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:35.303 19:04:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:35.303 19:04:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:37.836 19:04:54 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:37.836 00:18:37.836 real 0m42.296s 00:18:37.836 user 1m6.340s 00:18:37.836 sys 0m9.650s 00:18:37.836 19:04:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:37.836 19:04:54 -- common/autotest_common.sh@10 -- # set +x 00:18:37.836 ************************************ 00:18:37.836 END TEST nvmf_lvs_grow 00:18:37.836 ************************************ 00:18:37.836 19:04:54 -- nvmf/nvmf.sh@49 -- # run_test nvmf_bdev_io_wait /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:18:37.836 19:04:54 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:37.836 19:04:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:37.836 19:04:54 -- common/autotest_common.sh@10 -- # set +x 00:18:37.836 ************************************ 00:18:37.836 START TEST nvmf_bdev_io_wait 00:18:37.836 ************************************ 00:18:37.836 19:04:54 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:18:37.836 * Looking for test storage... 00:18:37.836 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:37.836 19:04:54 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:37.836 19:04:54 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:37.836 19:04:54 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:37.836 19:04:54 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:37.836 19:04:54 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:37.836 19:04:54 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:37.836 19:04:54 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:37.836 19:04:54 -- scripts/common.sh@335 -- # IFS=.-: 00:18:37.836 19:04:54 -- scripts/common.sh@335 -- # read -ra ver1 00:18:37.836 19:04:54 -- scripts/common.sh@336 -- # IFS=.-: 00:18:37.836 19:04:54 -- scripts/common.sh@336 -- # read -ra ver2 00:18:37.836 19:04:54 -- scripts/common.sh@337 -- # local 'op=<' 00:18:37.836 19:04:54 -- scripts/common.sh@339 -- # ver1_l=2 00:18:37.836 19:04:54 -- scripts/common.sh@340 -- # ver2_l=1 00:18:37.836 19:04:54 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:37.837 19:04:54 -- scripts/common.sh@343 -- # case "$op" in 00:18:37.837 19:04:54 -- scripts/common.sh@344 -- # : 1 00:18:37.837 19:04:54 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:37.837 19:04:54 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:37.837 19:04:54 -- scripts/common.sh@364 -- # decimal 1 00:18:37.837 19:04:54 -- scripts/common.sh@352 -- # local d=1 00:18:37.837 19:04:54 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:37.837 19:04:54 -- scripts/common.sh@354 -- # echo 1 00:18:37.837 19:04:54 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:37.837 19:04:54 -- scripts/common.sh@365 -- # decimal 2 00:18:37.837 19:04:54 -- scripts/common.sh@352 -- # local d=2 00:18:37.837 19:04:54 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:37.837 19:04:54 -- scripts/common.sh@354 -- # echo 2 00:18:37.837 19:04:54 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:37.837 19:04:54 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:37.837 19:04:54 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:37.837 19:04:54 -- scripts/common.sh@367 -- # return 0 00:18:37.837 19:04:54 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:37.837 19:04:54 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:37.837 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:37.837 --rc genhtml_branch_coverage=1 00:18:37.837 --rc genhtml_function_coverage=1 00:18:37.837 --rc genhtml_legend=1 00:18:37.837 --rc geninfo_all_blocks=1 00:18:37.837 --rc geninfo_unexecuted_blocks=1 00:18:37.837 00:18:37.837 ' 00:18:37.837 19:04:54 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:37.837 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:37.837 --rc genhtml_branch_coverage=1 00:18:37.837 --rc genhtml_function_coverage=1 00:18:37.837 --rc genhtml_legend=1 00:18:37.837 --rc geninfo_all_blocks=1 00:18:37.837 --rc geninfo_unexecuted_blocks=1 00:18:37.837 00:18:37.837 ' 00:18:37.837 19:04:54 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:37.837 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:37.837 --rc genhtml_branch_coverage=1 00:18:37.837 --rc genhtml_function_coverage=1 00:18:37.837 --rc genhtml_legend=1 00:18:37.837 --rc geninfo_all_blocks=1 00:18:37.837 --rc geninfo_unexecuted_blocks=1 00:18:37.837 00:18:37.837 ' 00:18:37.837 19:04:54 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:37.837 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:37.837 --rc genhtml_branch_coverage=1 00:18:37.837 --rc genhtml_function_coverage=1 00:18:37.837 --rc genhtml_legend=1 00:18:37.837 --rc geninfo_all_blocks=1 00:18:37.837 --rc geninfo_unexecuted_blocks=1 00:18:37.837 00:18:37.837 ' 00:18:37.837 19:04:54 -- target/bdev_io_wait.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:37.837 19:04:54 -- nvmf/common.sh@7 -- # uname -s 00:18:37.837 19:04:54 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:37.837 19:04:54 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:37.837 19:04:54 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:37.837 19:04:54 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:37.837 19:04:54 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:37.837 19:04:54 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:37.837 19:04:54 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:37.837 19:04:54 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:37.837 19:04:54 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:37.837 19:04:54 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:37.837 19:04:54 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:18:37.837 19:04:54 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:18:37.837 19:04:54 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:37.837 19:04:54 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:37.837 19:04:54 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:37.837 19:04:54 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:37.837 19:04:54 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:37.837 19:04:54 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:37.837 19:04:54 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:37.837 19:04:54 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:37.837 19:04:54 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:37.837 19:04:54 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:37.837 19:04:54 -- paths/export.sh@5 -- # export PATH 00:18:37.837 19:04:54 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:37.837 19:04:54 -- nvmf/common.sh@46 -- # : 0 00:18:37.837 19:04:54 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:37.837 19:04:54 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:37.837 19:04:54 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:37.837 19:04:54 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:37.837 19:04:54 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:37.837 19:04:54 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:37.837 19:04:54 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:37.837 19:04:54 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:37.837 19:04:54 -- target/bdev_io_wait.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:37.837 19:04:54 -- target/bdev_io_wait.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:37.837 19:04:54 -- target/bdev_io_wait.sh@14 -- # nvmftestinit 00:18:37.837 19:04:54 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:37.837 19:04:54 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:37.837 19:04:54 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:37.837 19:04:54 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:37.837 19:04:54 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:37.837 19:04:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:37.837 19:04:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:37.837 19:04:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:37.837 19:04:54 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:37.837 19:04:54 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:37.837 19:04:54 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:37.837 19:04:54 -- common/autotest_common.sh@10 -- # set +x 00:18:43.102 19:04:59 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:43.102 19:04:59 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:43.102 19:04:59 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:43.102 19:04:59 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:43.102 19:04:59 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:43.102 19:04:59 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:43.102 19:04:59 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:43.102 19:04:59 -- nvmf/common.sh@294 -- # net_devs=() 00:18:43.102 19:04:59 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:43.102 19:04:59 -- nvmf/common.sh@295 -- # e810=() 00:18:43.102 19:04:59 -- nvmf/common.sh@295 -- # local -ga e810 00:18:43.102 19:04:59 -- nvmf/common.sh@296 -- # x722=() 00:18:43.102 19:04:59 -- nvmf/common.sh@296 -- # local -ga x722 00:18:43.102 19:04:59 -- nvmf/common.sh@297 -- # mlx=() 00:18:43.102 19:04:59 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:43.102 19:04:59 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:43.102 19:04:59 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:43.102 19:04:59 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:43.102 19:04:59 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:43.102 19:04:59 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:43.102 19:04:59 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:43.102 19:04:59 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:43.102 19:04:59 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:43.102 19:04:59 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:43.102 19:04:59 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:43.102 19:04:59 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:43.102 19:04:59 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:43.102 19:04:59 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:43.102 19:04:59 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:43.102 19:04:59 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:43.102 19:04:59 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:43.102 19:04:59 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:43.102 19:04:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:43.102 19:04:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:18:43.102 Found 0000:86:00.0 (0x8086 - 0x159b) 00:18:43.102 19:04:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:43.102 19:04:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:43.102 19:04:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:43.103 19:04:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:43.103 19:04:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:43.103 19:04:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:43.103 19:04:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:18:43.103 Found 0000:86:00.1 (0x8086 - 0x159b) 00:18:43.103 19:04:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:43.103 19:04:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:43.103 19:04:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:43.103 19:04:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:43.103 19:04:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:43.103 19:04:59 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:43.103 19:04:59 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:43.103 19:04:59 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:43.103 19:04:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:43.103 19:04:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:43.103 19:04:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:43.103 19:04:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:43.103 19:04:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:18:43.103 Found net devices under 0000:86:00.0: cvl_0_0 00:18:43.103 19:04:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:43.103 19:04:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:43.103 19:04:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:43.103 19:04:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:43.103 19:04:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:43.103 19:04:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:18:43.103 Found net devices under 0000:86:00.1: cvl_0_1 00:18:43.103 19:04:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:43.103 19:04:59 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:43.103 19:04:59 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:43.103 19:04:59 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:43.103 19:04:59 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:43.103 19:04:59 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:43.103 19:04:59 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:43.103 19:04:59 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:43.103 19:04:59 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:43.103 19:04:59 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:43.103 19:04:59 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:43.103 19:04:59 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:43.103 19:04:59 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:43.103 19:04:59 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:43.103 19:04:59 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:43.103 19:04:59 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:43.103 19:04:59 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:43.103 19:04:59 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:43.103 19:04:59 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:43.362 19:05:00 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:43.362 19:05:00 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:43.362 19:05:00 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:43.362 19:05:00 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:43.362 19:05:00 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:43.362 19:05:00 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:43.362 19:05:00 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:43.362 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:43.362 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.445 ms 00:18:43.362 00:18:43.362 --- 10.0.0.2 ping statistics --- 00:18:43.362 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:43.362 rtt min/avg/max/mdev = 0.445/0.445/0.445/0.000 ms 00:18:43.362 19:05:00 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:43.362 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:43.362 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.216 ms 00:18:43.362 00:18:43.362 --- 10.0.0.1 ping statistics --- 00:18:43.362 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:43.362 rtt min/avg/max/mdev = 0.216/0.216/0.216/0.000 ms 00:18:43.362 19:05:00 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:43.362 19:05:00 -- nvmf/common.sh@410 -- # return 0 00:18:43.362 19:05:00 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:43.362 19:05:00 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:43.362 19:05:00 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:43.362 19:05:00 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:43.362 19:05:00 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:43.362 19:05:00 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:43.362 19:05:00 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:43.362 19:05:00 -- target/bdev_io_wait.sh@15 -- # nvmfappstart -m 0xF --wait-for-rpc 00:18:43.362 19:05:00 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:43.362 19:05:00 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:43.362 19:05:00 -- common/autotest_common.sh@10 -- # set +x 00:18:43.362 19:05:00 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:18:43.362 19:05:00 -- nvmf/common.sh@469 -- # nvmfpid=3101302 00:18:43.362 19:05:00 -- nvmf/common.sh@470 -- # waitforlisten 3101302 00:18:43.362 19:05:00 -- common/autotest_common.sh@829 -- # '[' -z 3101302 ']' 00:18:43.362 19:05:00 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:43.362 19:05:00 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:43.362 19:05:00 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:43.362 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:43.362 19:05:00 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:43.362 19:05:00 -- common/autotest_common.sh@10 -- # set +x 00:18:43.362 [2024-11-26 19:05:00.262783] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:43.362 [2024-11-26 19:05:00.262826] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:43.621 EAL: No free 2048 kB hugepages reported on node 1 00:18:43.621 [2024-11-26 19:05:00.321238] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:18:43.621 [2024-11-26 19:05:00.362594] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:43.622 [2024-11-26 19:05:00.362722] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:43.622 [2024-11-26 19:05:00.362730] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:43.622 [2024-11-26 19:05:00.362736] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:43.622 [2024-11-26 19:05:00.362781] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:43.622 [2024-11-26 19:05:00.362932] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:43.622 [2024-11-26 19:05:00.363028] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:18:43.622 [2024-11-26 19:05:00.363029] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:43.622 19:05:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:43.622 19:05:00 -- common/autotest_common.sh@862 -- # return 0 00:18:43.622 19:05:00 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:43.622 19:05:00 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:43.622 19:05:00 -- common/autotest_common.sh@10 -- # set +x 00:18:43.622 19:05:00 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:43.622 19:05:00 -- target/bdev_io_wait.sh@18 -- # rpc_cmd bdev_set_options -p 5 -c 1 00:18:43.622 19:05:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:43.622 19:05:00 -- common/autotest_common.sh@10 -- # set +x 00:18:43.622 19:05:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:43.622 19:05:00 -- target/bdev_io_wait.sh@19 -- # rpc_cmd framework_start_init 00:18:43.622 19:05:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:43.622 19:05:00 -- common/autotest_common.sh@10 -- # set +x 00:18:43.622 19:05:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:43.622 19:05:00 -- target/bdev_io_wait.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:43.622 19:05:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:43.622 19:05:00 -- common/autotest_common.sh@10 -- # set +x 00:18:43.622 [2024-11-26 19:05:00.526946] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:43.622 19:05:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:43.622 19:05:00 -- target/bdev_io_wait.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:18:43.622 19:05:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:43.622 19:05:00 -- common/autotest_common.sh@10 -- # set +x 00:18:43.881 Malloc0 00:18:43.881 19:05:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:43.881 19:05:00 -- target/bdev_io_wait.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:18:43.881 19:05:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:43.881 19:05:00 -- common/autotest_common.sh@10 -- # set +x 00:18:43.881 19:05:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:43.881 19:05:00 -- target/bdev_io_wait.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:43.881 19:05:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:43.881 19:05:00 -- common/autotest_common.sh@10 -- # set +x 00:18:43.881 19:05:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:43.881 19:05:00 -- target/bdev_io_wait.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:43.881 19:05:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:43.881 19:05:00 -- common/autotest_common.sh@10 -- # set +x 00:18:43.881 [2024-11-26 19:05:00.585808] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:43.881 19:05:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:43.881 19:05:00 -- target/bdev_io_wait.sh@28 -- # WRITE_PID=3101338 00:18:43.881 19:05:00 -- target/bdev_io_wait.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x10 -i 1 --json /dev/fd/63 -q 128 -o 4096 -w write -t 1 -s 256 00:18:43.881 19:05:00 -- target/bdev_io_wait.sh@27 -- # gen_nvmf_target_json 00:18:43.881 19:05:00 -- target/bdev_io_wait.sh@30 -- # READ_PID=3101340 00:18:43.881 19:05:00 -- nvmf/common.sh@520 -- # config=() 00:18:43.881 19:05:00 -- nvmf/common.sh@520 -- # local subsystem config 00:18:43.881 19:05:00 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:43.881 19:05:00 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:43.881 { 00:18:43.881 "params": { 00:18:43.881 "name": "Nvme$subsystem", 00:18:43.881 "trtype": "$TEST_TRANSPORT", 00:18:43.881 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:43.881 "adrfam": "ipv4", 00:18:43.881 "trsvcid": "$NVMF_PORT", 00:18:43.881 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:43.881 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:43.881 "hdgst": ${hdgst:-false}, 00:18:43.881 "ddgst": ${ddgst:-false} 00:18:43.881 }, 00:18:43.881 "method": "bdev_nvme_attach_controller" 00:18:43.881 } 00:18:43.881 EOF 00:18:43.881 )") 00:18:43.881 19:05:00 -- target/bdev_io_wait.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x20 -i 2 --json /dev/fd/63 -q 128 -o 4096 -w read -t 1 -s 256 00:18:43.881 19:05:00 -- target/bdev_io_wait.sh@29 -- # gen_nvmf_target_json 00:18:43.881 19:05:00 -- target/bdev_io_wait.sh@32 -- # FLUSH_PID=3101342 00:18:43.881 19:05:00 -- nvmf/common.sh@520 -- # config=() 00:18:43.881 19:05:00 -- nvmf/common.sh@520 -- # local subsystem config 00:18:43.881 19:05:00 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:43.881 19:05:00 -- target/bdev_io_wait.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x40 -i 3 --json /dev/fd/63 -q 128 -o 4096 -w flush -t 1 -s 256 00:18:43.881 19:05:00 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:43.881 { 00:18:43.881 "params": { 00:18:43.881 "name": "Nvme$subsystem", 00:18:43.881 "trtype": "$TEST_TRANSPORT", 00:18:43.881 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:43.881 "adrfam": "ipv4", 00:18:43.881 "trsvcid": "$NVMF_PORT", 00:18:43.881 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:43.881 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:43.881 "hdgst": ${hdgst:-false}, 00:18:43.881 "ddgst": ${ddgst:-false} 00:18:43.881 }, 00:18:43.881 "method": "bdev_nvme_attach_controller" 00:18:43.881 } 00:18:43.881 EOF 00:18:43.881 )") 00:18:43.881 19:05:00 -- target/bdev_io_wait.sh@31 -- # gen_nvmf_target_json 00:18:43.881 19:05:00 -- target/bdev_io_wait.sh@34 -- # UNMAP_PID=3101345 00:18:43.881 19:05:00 -- target/bdev_io_wait.sh@35 -- # sync 00:18:43.881 19:05:00 -- nvmf/common.sh@520 -- # config=() 00:18:43.881 19:05:00 -- nvmf/common.sh@542 -- # cat 00:18:43.881 19:05:00 -- nvmf/common.sh@520 -- # local subsystem config 00:18:43.881 19:05:00 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:43.881 19:05:00 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:43.881 { 00:18:43.881 "params": { 00:18:43.881 "name": "Nvme$subsystem", 00:18:43.881 "trtype": "$TEST_TRANSPORT", 00:18:43.881 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:43.881 "adrfam": "ipv4", 00:18:43.881 "trsvcid": "$NVMF_PORT", 00:18:43.881 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:43.881 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:43.881 "hdgst": ${hdgst:-false}, 00:18:43.881 "ddgst": ${ddgst:-false} 00:18:43.881 }, 00:18:43.881 "method": "bdev_nvme_attach_controller" 00:18:43.881 } 00:18:43.881 EOF 00:18:43.881 )") 00:18:43.881 19:05:00 -- target/bdev_io_wait.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x80 -i 4 --json /dev/fd/63 -q 128 -o 4096 -w unmap -t 1 -s 256 00:18:43.881 19:05:00 -- target/bdev_io_wait.sh@33 -- # gen_nvmf_target_json 00:18:43.881 19:05:00 -- nvmf/common.sh@520 -- # config=() 00:18:43.881 19:05:00 -- nvmf/common.sh@542 -- # cat 00:18:43.881 19:05:00 -- nvmf/common.sh@520 -- # local subsystem config 00:18:43.881 19:05:00 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:43.881 19:05:00 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:43.881 { 00:18:43.881 "params": { 00:18:43.881 "name": "Nvme$subsystem", 00:18:43.881 "trtype": "$TEST_TRANSPORT", 00:18:43.881 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:43.881 "adrfam": "ipv4", 00:18:43.881 "trsvcid": "$NVMF_PORT", 00:18:43.881 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:43.881 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:43.881 "hdgst": ${hdgst:-false}, 00:18:43.881 "ddgst": ${ddgst:-false} 00:18:43.881 }, 00:18:43.881 "method": "bdev_nvme_attach_controller" 00:18:43.881 } 00:18:43.881 EOF 00:18:43.881 )") 00:18:43.881 19:05:00 -- nvmf/common.sh@542 -- # cat 00:18:43.881 19:05:00 -- target/bdev_io_wait.sh@37 -- # wait 3101338 00:18:43.881 19:05:00 -- nvmf/common.sh@542 -- # cat 00:18:43.881 19:05:00 -- nvmf/common.sh@544 -- # jq . 00:18:43.881 19:05:00 -- nvmf/common.sh@544 -- # jq . 00:18:43.881 19:05:00 -- nvmf/common.sh@544 -- # jq . 00:18:43.881 19:05:00 -- nvmf/common.sh@545 -- # IFS=, 00:18:43.881 19:05:00 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:43.881 "params": { 00:18:43.881 "name": "Nvme1", 00:18:43.881 "trtype": "tcp", 00:18:43.881 "traddr": "10.0.0.2", 00:18:43.881 "adrfam": "ipv4", 00:18:43.881 "trsvcid": "4420", 00:18:43.881 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:43.881 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:43.881 "hdgst": false, 00:18:43.881 "ddgst": false 00:18:43.881 }, 00:18:43.881 "method": "bdev_nvme_attach_controller" 00:18:43.881 }' 00:18:43.881 19:05:00 -- nvmf/common.sh@544 -- # jq . 00:18:43.881 19:05:00 -- nvmf/common.sh@545 -- # IFS=, 00:18:43.881 19:05:00 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:43.881 "params": { 00:18:43.881 "name": "Nvme1", 00:18:43.881 "trtype": "tcp", 00:18:43.881 "traddr": "10.0.0.2", 00:18:43.881 "adrfam": "ipv4", 00:18:43.881 "trsvcid": "4420", 00:18:43.881 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:43.881 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:43.881 "hdgst": false, 00:18:43.881 "ddgst": false 00:18:43.881 }, 00:18:43.881 "method": "bdev_nvme_attach_controller" 00:18:43.881 }' 00:18:43.881 19:05:00 -- nvmf/common.sh@545 -- # IFS=, 00:18:43.881 19:05:00 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:43.881 "params": { 00:18:43.881 "name": "Nvme1", 00:18:43.881 "trtype": "tcp", 00:18:43.881 "traddr": "10.0.0.2", 00:18:43.881 "adrfam": "ipv4", 00:18:43.881 "trsvcid": "4420", 00:18:43.881 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:43.881 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:43.881 "hdgst": false, 00:18:43.881 "ddgst": false 00:18:43.881 }, 00:18:43.881 "method": "bdev_nvme_attach_controller" 00:18:43.881 }' 00:18:43.881 19:05:00 -- nvmf/common.sh@545 -- # IFS=, 00:18:43.882 19:05:00 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:43.882 "params": { 00:18:43.882 "name": "Nvme1", 00:18:43.882 "trtype": "tcp", 00:18:43.882 "traddr": "10.0.0.2", 00:18:43.882 "adrfam": "ipv4", 00:18:43.882 "trsvcid": "4420", 00:18:43.882 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:43.882 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:43.882 "hdgst": false, 00:18:43.882 "ddgst": false 00:18:43.882 }, 00:18:43.882 "method": "bdev_nvme_attach_controller" 00:18:43.882 }' 00:18:43.882 [2024-11-26 19:05:00.634717] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:43.882 [2024-11-26 19:05:00.634720] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:43.882 [2024-11-26 19:05:00.634721] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:43.882 [2024-11-26 19:05:00.634769] [ DPDK EAL parameters: bdevperf -c 0x40 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk3 --proc-type=auto ] 00:18:43.882 [2024-11-26 19:05:00.634770] [ DPDK EAL parameters: bdevperf -c 0x10 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-11-26 19:05:00.634770] [ DPDK EAL parameters: bdevperf -c 0x20 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:18:43.882 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk2 --proc-type=auto ] 00:18:43.882 [2024-11-26 19:05:00.636522] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:43.882 [2024-11-26 19:05:00.636565] [ DPDK EAL parameters: bdevperf -c 0x80 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk4 --proc-type=auto ] 00:18:43.882 EAL: No free 2048 kB hugepages reported on node 1 00:18:43.882 EAL: No free 2048 kB hugepages reported on node 1 00:18:44.141 [2024-11-26 19:05:00.819564] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:44.141 [2024-11-26 19:05:00.845386] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:18:44.141 EAL: No free 2048 kB hugepages reported on node 1 00:18:44.141 [2024-11-26 19:05:00.915769] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:44.141 [2024-11-26 19:05:00.941575] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:18:44.141 EAL: No free 2048 kB hugepages reported on node 1 00:18:44.141 [2024-11-26 19:05:01.011925] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:44.141 [2024-11-26 19:05:01.042739] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:18:44.399 [2024-11-26 19:05:01.071408] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:44.399 [2024-11-26 19:05:01.096875] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:18:44.399 Running I/O for 1 seconds... 00:18:44.399 Running I/O for 1 seconds... 00:18:44.399 Running I/O for 1 seconds... 00:18:44.658 Running I/O for 1 seconds... 00:18:45.593 00:18:45.593 Latency(us) 00:18:45.593 [2024-11-26T18:05:02.520Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:45.593 [2024-11-26T18:05:02.520Z] Job: Nvme1n1 (Core Mask 0x20, workload: read, depth: 128, IO size: 4096) 00:18:45.593 Nvme1n1 : 1.02 8261.54 32.27 0.00 0.00 15345.48 6097.70 24162.84 00:18:45.593 [2024-11-26T18:05:02.520Z] =================================================================================================================== 00:18:45.593 [2024-11-26T18:05:02.520Z] Total : 8261.54 32.27 0.00 0.00 15345.48 6097.70 24162.84 00:18:45.593 00:18:45.593 Latency(us) 00:18:45.594 [2024-11-26T18:05:02.521Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:45.594 [2024-11-26T18:05:02.521Z] Job: Nvme1n1 (Core Mask 0x40, workload: flush, depth: 128, IO size: 4096) 00:18:45.594 Nvme1n1 : 1.00 250857.79 979.91 0.00 0.00 509.10 203.02 637.55 00:18:45.594 [2024-11-26T18:05:02.521Z] =================================================================================================================== 00:18:45.594 [2024-11-26T18:05:02.521Z] Total : 250857.79 979.91 0.00 0.00 509.10 203.02 637.55 00:18:45.594 00:18:45.594 Latency(us) 00:18:45.594 [2024-11-26T18:05:02.521Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:45.594 [2024-11-26T18:05:02.521Z] Job: Nvme1n1 (Core Mask 0x10, workload: write, depth: 128, IO size: 4096) 00:18:45.594 Nvme1n1 : 1.00 7839.96 30.62 0.00 0.00 16285.42 4673.00 30545.47 00:18:45.594 [2024-11-26T18:05:02.521Z] =================================================================================================================== 00:18:45.594 [2024-11-26T18:05:02.521Z] Total : 7839.96 30.62 0.00 0.00 16285.42 4673.00 30545.47 00:18:45.594 00:18:45.594 Latency(us) 00:18:45.594 [2024-11-26T18:05:02.521Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:45.594 [2024-11-26T18:05:02.521Z] Job: Nvme1n1 (Core Mask 0x80, workload: unmap, depth: 128, IO size: 4096) 00:18:45.594 Nvme1n1 : 1.00 12465.44 48.69 0.00 0.00 10242.95 4302.58 21427.42 00:18:45.594 [2024-11-26T18:05:02.521Z] =================================================================================================================== 00:18:45.594 [2024-11-26T18:05:02.521Z] Total : 12465.44 48.69 0.00 0.00 10242.95 4302.58 21427.42 00:18:45.852 19:05:02 -- target/bdev_io_wait.sh@38 -- # wait 3101340 00:18:45.852 19:05:02 -- target/bdev_io_wait.sh@39 -- # wait 3101342 00:18:45.852 19:05:02 -- target/bdev_io_wait.sh@40 -- # wait 3101345 00:18:45.852 19:05:02 -- target/bdev_io_wait.sh@42 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:18:45.852 19:05:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:45.852 19:05:02 -- common/autotest_common.sh@10 -- # set +x 00:18:45.852 19:05:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:45.852 19:05:02 -- target/bdev_io_wait.sh@44 -- # trap - SIGINT SIGTERM EXIT 00:18:45.852 19:05:02 -- target/bdev_io_wait.sh@46 -- # nvmftestfini 00:18:45.852 19:05:02 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:45.852 19:05:02 -- nvmf/common.sh@116 -- # sync 00:18:45.852 19:05:02 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:45.852 19:05:02 -- nvmf/common.sh@119 -- # set +e 00:18:45.852 19:05:02 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:45.852 19:05:02 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:45.852 rmmod nvme_tcp 00:18:45.852 rmmod nvme_fabrics 00:18:45.852 rmmod nvme_keyring 00:18:45.852 19:05:02 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:45.852 19:05:02 -- nvmf/common.sh@123 -- # set -e 00:18:45.852 19:05:02 -- nvmf/common.sh@124 -- # return 0 00:18:45.852 19:05:02 -- nvmf/common.sh@477 -- # '[' -n 3101302 ']' 00:18:45.852 19:05:02 -- nvmf/common.sh@478 -- # killprocess 3101302 00:18:45.852 19:05:02 -- common/autotest_common.sh@936 -- # '[' -z 3101302 ']' 00:18:45.852 19:05:02 -- common/autotest_common.sh@940 -- # kill -0 3101302 00:18:45.852 19:05:02 -- common/autotest_common.sh@941 -- # uname 00:18:45.852 19:05:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:45.852 19:05:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3101302 00:18:45.852 19:05:02 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:18:45.852 19:05:02 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:18:45.852 19:05:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3101302' 00:18:45.852 killing process with pid 3101302 00:18:45.852 19:05:02 -- common/autotest_common.sh@955 -- # kill 3101302 00:18:45.852 19:05:02 -- common/autotest_common.sh@960 -- # wait 3101302 00:18:46.111 19:05:02 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:46.111 19:05:02 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:46.111 19:05:02 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:46.111 19:05:02 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:46.111 19:05:02 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:46.111 19:05:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:46.111 19:05:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:46.111 19:05:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:48.646 19:05:04 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:48.646 00:18:48.646 real 0m10.625s 00:18:48.646 user 0m16.848s 00:18:48.646 sys 0m5.828s 00:18:48.646 19:05:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:48.646 19:05:04 -- common/autotest_common.sh@10 -- # set +x 00:18:48.646 ************************************ 00:18:48.646 END TEST nvmf_bdev_io_wait 00:18:48.646 ************************************ 00:18:48.646 19:05:04 -- nvmf/nvmf.sh@50 -- # run_test nvmf_queue_depth /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:18:48.646 19:05:04 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:48.646 19:05:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:48.646 19:05:04 -- common/autotest_common.sh@10 -- # set +x 00:18:48.646 ************************************ 00:18:48.646 START TEST nvmf_queue_depth 00:18:48.646 ************************************ 00:18:48.646 19:05:04 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:18:48.646 * Looking for test storage... 00:18:48.646 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:48.646 19:05:05 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:48.646 19:05:05 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:48.646 19:05:05 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:48.646 19:05:05 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:48.646 19:05:05 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:48.646 19:05:05 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:48.646 19:05:05 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:48.646 19:05:05 -- scripts/common.sh@335 -- # IFS=.-: 00:18:48.646 19:05:05 -- scripts/common.sh@335 -- # read -ra ver1 00:18:48.646 19:05:05 -- scripts/common.sh@336 -- # IFS=.-: 00:18:48.646 19:05:05 -- scripts/common.sh@336 -- # read -ra ver2 00:18:48.646 19:05:05 -- scripts/common.sh@337 -- # local 'op=<' 00:18:48.646 19:05:05 -- scripts/common.sh@339 -- # ver1_l=2 00:18:48.646 19:05:05 -- scripts/common.sh@340 -- # ver2_l=1 00:18:48.646 19:05:05 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:48.646 19:05:05 -- scripts/common.sh@343 -- # case "$op" in 00:18:48.646 19:05:05 -- scripts/common.sh@344 -- # : 1 00:18:48.646 19:05:05 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:48.646 19:05:05 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:48.646 19:05:05 -- scripts/common.sh@364 -- # decimal 1 00:18:48.646 19:05:05 -- scripts/common.sh@352 -- # local d=1 00:18:48.646 19:05:05 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:48.646 19:05:05 -- scripts/common.sh@354 -- # echo 1 00:18:48.646 19:05:05 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:48.646 19:05:05 -- scripts/common.sh@365 -- # decimal 2 00:18:48.646 19:05:05 -- scripts/common.sh@352 -- # local d=2 00:18:48.646 19:05:05 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:48.646 19:05:05 -- scripts/common.sh@354 -- # echo 2 00:18:48.646 19:05:05 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:48.646 19:05:05 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:48.646 19:05:05 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:48.646 19:05:05 -- scripts/common.sh@367 -- # return 0 00:18:48.646 19:05:05 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:48.646 19:05:05 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:48.646 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:48.646 --rc genhtml_branch_coverage=1 00:18:48.646 --rc genhtml_function_coverage=1 00:18:48.646 --rc genhtml_legend=1 00:18:48.646 --rc geninfo_all_blocks=1 00:18:48.646 --rc geninfo_unexecuted_blocks=1 00:18:48.646 00:18:48.646 ' 00:18:48.646 19:05:05 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:48.646 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:48.646 --rc genhtml_branch_coverage=1 00:18:48.646 --rc genhtml_function_coverage=1 00:18:48.646 --rc genhtml_legend=1 00:18:48.646 --rc geninfo_all_blocks=1 00:18:48.646 --rc geninfo_unexecuted_blocks=1 00:18:48.646 00:18:48.646 ' 00:18:48.646 19:05:05 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:48.646 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:48.646 --rc genhtml_branch_coverage=1 00:18:48.646 --rc genhtml_function_coverage=1 00:18:48.646 --rc genhtml_legend=1 00:18:48.646 --rc geninfo_all_blocks=1 00:18:48.647 --rc geninfo_unexecuted_blocks=1 00:18:48.647 00:18:48.647 ' 00:18:48.647 19:05:05 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:48.647 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:48.647 --rc genhtml_branch_coverage=1 00:18:48.647 --rc genhtml_function_coverage=1 00:18:48.647 --rc genhtml_legend=1 00:18:48.647 --rc geninfo_all_blocks=1 00:18:48.647 --rc geninfo_unexecuted_blocks=1 00:18:48.647 00:18:48.647 ' 00:18:48.647 19:05:05 -- target/queue_depth.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:48.647 19:05:05 -- nvmf/common.sh@7 -- # uname -s 00:18:48.647 19:05:05 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:48.647 19:05:05 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:48.647 19:05:05 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:48.647 19:05:05 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:48.647 19:05:05 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:48.647 19:05:05 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:48.647 19:05:05 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:48.647 19:05:05 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:48.647 19:05:05 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:48.647 19:05:05 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:48.647 19:05:05 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:18:48.647 19:05:05 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:18:48.647 19:05:05 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:48.647 19:05:05 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:48.647 19:05:05 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:48.647 19:05:05 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:48.647 19:05:05 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:48.647 19:05:05 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:48.647 19:05:05 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:48.647 19:05:05 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:48.647 19:05:05 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:48.647 19:05:05 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:48.647 19:05:05 -- paths/export.sh@5 -- # export PATH 00:18:48.647 19:05:05 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:48.647 19:05:05 -- nvmf/common.sh@46 -- # : 0 00:18:48.647 19:05:05 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:48.647 19:05:05 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:48.647 19:05:05 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:48.647 19:05:05 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:48.647 19:05:05 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:48.647 19:05:05 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:48.647 19:05:05 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:48.647 19:05:05 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:48.647 19:05:05 -- target/queue_depth.sh@14 -- # MALLOC_BDEV_SIZE=64 00:18:48.647 19:05:05 -- target/queue_depth.sh@15 -- # MALLOC_BLOCK_SIZE=512 00:18:48.647 19:05:05 -- target/queue_depth.sh@17 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:18:48.647 19:05:05 -- target/queue_depth.sh@19 -- # nvmftestinit 00:18:48.647 19:05:05 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:48.647 19:05:05 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:48.647 19:05:05 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:48.647 19:05:05 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:48.647 19:05:05 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:48.647 19:05:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:48.647 19:05:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:48.647 19:05:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:48.647 19:05:05 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:48.647 19:05:05 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:48.647 19:05:05 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:48.647 19:05:05 -- common/autotest_common.sh@10 -- # set +x 00:18:53.914 19:05:10 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:53.914 19:05:10 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:53.914 19:05:10 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:53.914 19:05:10 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:53.914 19:05:10 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:53.914 19:05:10 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:53.914 19:05:10 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:53.914 19:05:10 -- nvmf/common.sh@294 -- # net_devs=() 00:18:53.914 19:05:10 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:53.914 19:05:10 -- nvmf/common.sh@295 -- # e810=() 00:18:53.914 19:05:10 -- nvmf/common.sh@295 -- # local -ga e810 00:18:53.914 19:05:10 -- nvmf/common.sh@296 -- # x722=() 00:18:53.914 19:05:10 -- nvmf/common.sh@296 -- # local -ga x722 00:18:53.914 19:05:10 -- nvmf/common.sh@297 -- # mlx=() 00:18:53.914 19:05:10 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:53.914 19:05:10 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:53.914 19:05:10 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:53.914 19:05:10 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:53.914 19:05:10 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:53.914 19:05:10 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:53.914 19:05:10 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:53.914 19:05:10 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:53.914 19:05:10 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:53.914 19:05:10 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:53.914 19:05:10 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:53.914 19:05:10 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:53.914 19:05:10 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:53.914 19:05:10 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:53.914 19:05:10 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:53.914 19:05:10 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:53.914 19:05:10 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:53.914 19:05:10 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:53.914 19:05:10 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:53.914 19:05:10 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:18:53.914 Found 0000:86:00.0 (0x8086 - 0x159b) 00:18:53.914 19:05:10 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:53.914 19:05:10 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:53.914 19:05:10 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:53.914 19:05:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:53.914 19:05:10 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:53.914 19:05:10 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:53.914 19:05:10 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:18:53.914 Found 0000:86:00.1 (0x8086 - 0x159b) 00:18:53.914 19:05:10 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:53.914 19:05:10 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:53.914 19:05:10 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:53.914 19:05:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:53.914 19:05:10 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:53.914 19:05:10 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:53.914 19:05:10 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:53.914 19:05:10 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:53.914 19:05:10 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:53.914 19:05:10 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:53.914 19:05:10 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:53.914 19:05:10 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:53.914 19:05:10 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:18:53.914 Found net devices under 0000:86:00.0: cvl_0_0 00:18:53.914 19:05:10 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:53.914 19:05:10 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:53.914 19:05:10 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:53.914 19:05:10 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:53.914 19:05:10 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:53.914 19:05:10 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:18:53.914 Found net devices under 0000:86:00.1: cvl_0_1 00:18:53.914 19:05:10 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:53.914 19:05:10 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:53.914 19:05:10 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:53.915 19:05:10 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:53.915 19:05:10 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:53.915 19:05:10 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:53.915 19:05:10 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:53.915 19:05:10 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:53.915 19:05:10 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:53.915 19:05:10 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:53.915 19:05:10 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:53.915 19:05:10 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:53.915 19:05:10 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:53.915 19:05:10 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:53.915 19:05:10 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:53.915 19:05:10 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:53.915 19:05:10 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:53.915 19:05:10 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:53.915 19:05:10 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:53.915 19:05:10 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:53.915 19:05:10 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:53.915 19:05:10 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:53.915 19:05:10 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:53.915 19:05:10 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:53.915 19:05:10 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:53.915 19:05:10 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:53.915 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:53.915 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.355 ms 00:18:53.915 00:18:53.915 --- 10.0.0.2 ping statistics --- 00:18:53.915 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:53.915 rtt min/avg/max/mdev = 0.355/0.355/0.355/0.000 ms 00:18:53.915 19:05:10 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:53.915 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:53.915 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.237 ms 00:18:53.915 00:18:53.915 --- 10.0.0.1 ping statistics --- 00:18:53.915 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:53.915 rtt min/avg/max/mdev = 0.237/0.237/0.237/0.000 ms 00:18:53.915 19:05:10 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:53.915 19:05:10 -- nvmf/common.sh@410 -- # return 0 00:18:53.915 19:05:10 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:53.915 19:05:10 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:53.915 19:05:10 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:53.915 19:05:10 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:53.915 19:05:10 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:53.915 19:05:10 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:53.915 19:05:10 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:53.915 19:05:10 -- target/queue_depth.sh@21 -- # nvmfappstart -m 0x2 00:18:53.915 19:05:10 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:53.915 19:05:10 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:53.915 19:05:10 -- common/autotest_common.sh@10 -- # set +x 00:18:53.915 19:05:10 -- nvmf/common.sh@469 -- # nvmfpid=3105351 00:18:53.915 19:05:10 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:53.915 19:05:10 -- nvmf/common.sh@470 -- # waitforlisten 3105351 00:18:53.915 19:05:10 -- common/autotest_common.sh@829 -- # '[' -z 3105351 ']' 00:18:53.915 19:05:10 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:53.915 19:05:10 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:53.915 19:05:10 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:53.915 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:53.915 19:05:10 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:53.915 19:05:10 -- common/autotest_common.sh@10 -- # set +x 00:18:53.915 [2024-11-26 19:05:10.784533] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:53.915 [2024-11-26 19:05:10.784580] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:53.915 EAL: No free 2048 kB hugepages reported on node 1 00:18:54.173 [2024-11-26 19:05:10.843409] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:54.173 [2024-11-26 19:05:10.884088] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:54.173 [2024-11-26 19:05:10.884202] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:54.173 [2024-11-26 19:05:10.884211] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:54.173 [2024-11-26 19:05:10.884218] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:54.173 [2024-11-26 19:05:10.884238] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:54.740 19:05:11 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:54.740 19:05:11 -- common/autotest_common.sh@862 -- # return 0 00:18:54.740 19:05:11 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:54.740 19:05:11 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:54.740 19:05:11 -- common/autotest_common.sh@10 -- # set +x 00:18:54.740 19:05:11 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:54.740 19:05:11 -- target/queue_depth.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:54.740 19:05:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:54.740 19:05:11 -- common/autotest_common.sh@10 -- # set +x 00:18:54.740 [2024-11-26 19:05:11.647291] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:54.740 19:05:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:54.740 19:05:11 -- target/queue_depth.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:18:54.740 19:05:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:54.740 19:05:11 -- common/autotest_common.sh@10 -- # set +x 00:18:55.013 Malloc0 00:18:55.013 19:05:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:55.013 19:05:11 -- target/queue_depth.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:18:55.013 19:05:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:55.013 19:05:11 -- common/autotest_common.sh@10 -- # set +x 00:18:55.013 19:05:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:55.013 19:05:11 -- target/queue_depth.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:55.013 19:05:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:55.013 19:05:11 -- common/autotest_common.sh@10 -- # set +x 00:18:55.014 19:05:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:55.014 19:05:11 -- target/queue_depth.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:55.014 19:05:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:55.014 19:05:11 -- common/autotest_common.sh@10 -- # set +x 00:18:55.014 [2024-11-26 19:05:11.702305] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:55.014 19:05:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:55.014 19:05:11 -- target/queue_depth.sh@30 -- # bdevperf_pid=3105393 00:18:55.014 19:05:11 -- target/queue_depth.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 1024 -o 4096 -w verify -t 10 00:18:55.014 19:05:11 -- target/queue_depth.sh@32 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:55.014 19:05:11 -- target/queue_depth.sh@33 -- # waitforlisten 3105393 /var/tmp/bdevperf.sock 00:18:55.014 19:05:11 -- common/autotest_common.sh@829 -- # '[' -z 3105393 ']' 00:18:55.014 19:05:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:55.014 19:05:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:55.014 19:05:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:55.014 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:55.014 19:05:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:55.014 19:05:11 -- common/autotest_common.sh@10 -- # set +x 00:18:55.014 [2024-11-26 19:05:11.749455] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:55.014 [2024-11-26 19:05:11.749495] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3105393 ] 00:18:55.014 EAL: No free 2048 kB hugepages reported on node 1 00:18:55.014 [2024-11-26 19:05:11.804452] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:55.014 [2024-11-26 19:05:11.842216] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:55.714 19:05:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:55.714 19:05:12 -- common/autotest_common.sh@862 -- # return 0 00:18:55.714 19:05:12 -- target/queue_depth.sh@34 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:18:55.714 19:05:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:55.714 19:05:12 -- common/autotest_common.sh@10 -- # set +x 00:18:55.972 NVMe0n1 00:18:55.972 19:05:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:55.972 19:05:12 -- target/queue_depth.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:18:55.972 Running I/O for 10 seconds... 00:19:08.171 00:19:08.171 Latency(us) 00:19:08.171 [2024-11-26T18:05:25.098Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:19:08.171 [2024-11-26T18:05:25.098Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 1024, IO size: 4096) 00:19:08.171 Verification LBA range: start 0x0 length 0x4000 00:19:08.171 NVMe0n1 : 10.05 17909.23 69.96 0.00 0.00 57008.91 11910.46 42170.99 00:19:08.171 [2024-11-26T18:05:25.098Z] =================================================================================================================== 00:19:08.171 [2024-11-26T18:05:25.098Z] Total : 17909.23 69.96 0.00 0.00 57008.91 11910.46 42170.99 00:19:08.171 0 00:19:08.171 19:05:22 -- target/queue_depth.sh@39 -- # killprocess 3105393 00:19:08.171 19:05:22 -- common/autotest_common.sh@936 -- # '[' -z 3105393 ']' 00:19:08.171 19:05:22 -- common/autotest_common.sh@940 -- # kill -0 3105393 00:19:08.171 19:05:22 -- common/autotest_common.sh@941 -- # uname 00:19:08.171 19:05:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:08.171 19:05:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3105393 00:19:08.171 19:05:23 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:19:08.171 19:05:23 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:19:08.171 19:05:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3105393' 00:19:08.171 killing process with pid 3105393 00:19:08.171 19:05:23 -- common/autotest_common.sh@955 -- # kill 3105393 00:19:08.171 Received shutdown signal, test time was about 10.000000 seconds 00:19:08.171 00:19:08.171 Latency(us) 00:19:08.171 [2024-11-26T18:05:25.098Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:19:08.171 [2024-11-26T18:05:25.098Z] =================================================================================================================== 00:19:08.171 [2024-11-26T18:05:25.098Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:19:08.171 19:05:23 -- common/autotest_common.sh@960 -- # wait 3105393 00:19:08.171 19:05:23 -- target/queue_depth.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:19:08.171 19:05:23 -- target/queue_depth.sh@43 -- # nvmftestfini 00:19:08.171 19:05:23 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:08.171 19:05:23 -- nvmf/common.sh@116 -- # sync 00:19:08.171 19:05:23 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:08.171 19:05:23 -- nvmf/common.sh@119 -- # set +e 00:19:08.171 19:05:23 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:08.171 19:05:23 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:08.171 rmmod nvme_tcp 00:19:08.172 rmmod nvme_fabrics 00:19:08.172 rmmod nvme_keyring 00:19:08.172 19:05:23 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:08.172 19:05:23 -- nvmf/common.sh@123 -- # set -e 00:19:08.172 19:05:23 -- nvmf/common.sh@124 -- # return 0 00:19:08.172 19:05:23 -- nvmf/common.sh@477 -- # '[' -n 3105351 ']' 00:19:08.172 19:05:23 -- nvmf/common.sh@478 -- # killprocess 3105351 00:19:08.172 19:05:23 -- common/autotest_common.sh@936 -- # '[' -z 3105351 ']' 00:19:08.172 19:05:23 -- common/autotest_common.sh@940 -- # kill -0 3105351 00:19:08.172 19:05:23 -- common/autotest_common.sh@941 -- # uname 00:19:08.172 19:05:23 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:08.172 19:05:23 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3105351 00:19:08.172 19:05:23 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:19:08.172 19:05:23 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:19:08.172 19:05:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3105351' 00:19:08.172 killing process with pid 3105351 00:19:08.172 19:05:23 -- common/autotest_common.sh@955 -- # kill 3105351 00:19:08.172 19:05:23 -- common/autotest_common.sh@960 -- # wait 3105351 00:19:08.172 19:05:23 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:08.172 19:05:23 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:08.172 19:05:23 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:08.172 19:05:23 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:08.172 19:05:23 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:08.172 19:05:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:08.172 19:05:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:08.172 19:05:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:08.740 19:05:25 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:08.740 00:19:08.740 real 0m20.583s 00:19:08.740 user 0m25.168s 00:19:08.740 sys 0m5.823s 00:19:08.740 19:05:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:08.740 19:05:25 -- common/autotest_common.sh@10 -- # set +x 00:19:08.740 ************************************ 00:19:08.740 END TEST nvmf_queue_depth 00:19:08.740 ************************************ 00:19:08.740 19:05:25 -- nvmf/nvmf.sh@51 -- # run_test nvmf_multipath /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:19:08.740 19:05:25 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:08.740 19:05:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:08.740 19:05:25 -- common/autotest_common.sh@10 -- # set +x 00:19:08.740 ************************************ 00:19:08.740 START TEST nvmf_multipath 00:19:08.740 ************************************ 00:19:08.740 19:05:25 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:19:08.999 * Looking for test storage... 00:19:08.999 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:08.999 19:05:25 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:08.999 19:05:25 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:08.999 19:05:25 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:08.999 19:05:25 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:08.999 19:05:25 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:08.999 19:05:25 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:08.999 19:05:25 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:08.999 19:05:25 -- scripts/common.sh@335 -- # IFS=.-: 00:19:08.999 19:05:25 -- scripts/common.sh@335 -- # read -ra ver1 00:19:08.999 19:05:25 -- scripts/common.sh@336 -- # IFS=.-: 00:19:08.999 19:05:25 -- scripts/common.sh@336 -- # read -ra ver2 00:19:08.999 19:05:25 -- scripts/common.sh@337 -- # local 'op=<' 00:19:08.999 19:05:25 -- scripts/common.sh@339 -- # ver1_l=2 00:19:08.999 19:05:25 -- scripts/common.sh@340 -- # ver2_l=1 00:19:08.999 19:05:25 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:08.999 19:05:25 -- scripts/common.sh@343 -- # case "$op" in 00:19:08.999 19:05:25 -- scripts/common.sh@344 -- # : 1 00:19:08.999 19:05:25 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:08.999 19:05:25 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:08.999 19:05:25 -- scripts/common.sh@364 -- # decimal 1 00:19:08.999 19:05:25 -- scripts/common.sh@352 -- # local d=1 00:19:08.999 19:05:25 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:08.999 19:05:25 -- scripts/common.sh@354 -- # echo 1 00:19:08.999 19:05:25 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:08.999 19:05:25 -- scripts/common.sh@365 -- # decimal 2 00:19:08.999 19:05:25 -- scripts/common.sh@352 -- # local d=2 00:19:08.999 19:05:25 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:08.999 19:05:25 -- scripts/common.sh@354 -- # echo 2 00:19:08.999 19:05:25 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:08.999 19:05:25 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:08.999 19:05:25 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:08.999 19:05:25 -- scripts/common.sh@367 -- # return 0 00:19:08.999 19:05:25 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:08.999 19:05:25 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:08.999 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:08.999 --rc genhtml_branch_coverage=1 00:19:08.999 --rc genhtml_function_coverage=1 00:19:08.999 --rc genhtml_legend=1 00:19:08.999 --rc geninfo_all_blocks=1 00:19:08.999 --rc geninfo_unexecuted_blocks=1 00:19:08.999 00:19:08.999 ' 00:19:08.999 19:05:25 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:08.999 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:08.999 --rc genhtml_branch_coverage=1 00:19:08.999 --rc genhtml_function_coverage=1 00:19:08.999 --rc genhtml_legend=1 00:19:08.999 --rc geninfo_all_blocks=1 00:19:08.999 --rc geninfo_unexecuted_blocks=1 00:19:08.999 00:19:08.999 ' 00:19:08.999 19:05:25 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:08.999 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:08.999 --rc genhtml_branch_coverage=1 00:19:08.999 --rc genhtml_function_coverage=1 00:19:08.999 --rc genhtml_legend=1 00:19:08.999 --rc geninfo_all_blocks=1 00:19:08.999 --rc geninfo_unexecuted_blocks=1 00:19:08.999 00:19:08.999 ' 00:19:08.999 19:05:25 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:08.999 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:08.999 --rc genhtml_branch_coverage=1 00:19:08.999 --rc genhtml_function_coverage=1 00:19:08.999 --rc genhtml_legend=1 00:19:08.999 --rc geninfo_all_blocks=1 00:19:08.999 --rc geninfo_unexecuted_blocks=1 00:19:08.999 00:19:08.999 ' 00:19:08.999 19:05:25 -- target/multipath.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:08.999 19:05:25 -- nvmf/common.sh@7 -- # uname -s 00:19:08.999 19:05:25 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:08.999 19:05:25 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:08.999 19:05:25 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:08.999 19:05:25 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:08.999 19:05:25 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:08.999 19:05:25 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:08.999 19:05:25 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:08.999 19:05:25 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:08.999 19:05:25 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:08.999 19:05:25 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:08.999 19:05:25 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:19:08.999 19:05:25 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:19:08.999 19:05:25 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:08.999 19:05:25 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:08.999 19:05:25 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:08.999 19:05:25 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:08.999 19:05:25 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:08.999 19:05:25 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:08.999 19:05:25 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:08.999 19:05:25 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:08.999 19:05:25 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:08.999 19:05:25 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:08.999 19:05:25 -- paths/export.sh@5 -- # export PATH 00:19:08.999 19:05:25 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:08.999 19:05:25 -- nvmf/common.sh@46 -- # : 0 00:19:09.000 19:05:25 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:09.000 19:05:25 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:09.000 19:05:25 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:09.000 19:05:25 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:09.000 19:05:25 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:09.000 19:05:25 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:09.000 19:05:25 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:09.000 19:05:25 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:09.000 19:05:25 -- target/multipath.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:09.000 19:05:25 -- target/multipath.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:09.000 19:05:25 -- target/multipath.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:19:09.000 19:05:25 -- target/multipath.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:19:09.000 19:05:25 -- target/multipath.sh@43 -- # nvmftestinit 00:19:09.000 19:05:25 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:09.000 19:05:25 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:09.000 19:05:25 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:09.000 19:05:25 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:09.000 19:05:25 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:09.000 19:05:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:09.000 19:05:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:09.000 19:05:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:09.000 19:05:25 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:09.000 19:05:25 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:09.000 19:05:25 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:09.000 19:05:25 -- common/autotest_common.sh@10 -- # set +x 00:19:14.270 19:05:30 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:14.270 19:05:30 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:14.270 19:05:30 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:14.270 19:05:30 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:14.270 19:05:30 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:14.270 19:05:30 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:14.270 19:05:30 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:14.270 19:05:30 -- nvmf/common.sh@294 -- # net_devs=() 00:19:14.270 19:05:30 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:14.270 19:05:30 -- nvmf/common.sh@295 -- # e810=() 00:19:14.270 19:05:30 -- nvmf/common.sh@295 -- # local -ga e810 00:19:14.270 19:05:30 -- nvmf/common.sh@296 -- # x722=() 00:19:14.270 19:05:30 -- nvmf/common.sh@296 -- # local -ga x722 00:19:14.270 19:05:30 -- nvmf/common.sh@297 -- # mlx=() 00:19:14.270 19:05:30 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:14.270 19:05:30 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:14.270 19:05:30 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:14.270 19:05:30 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:14.270 19:05:30 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:14.270 19:05:30 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:14.270 19:05:30 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:14.270 19:05:30 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:14.270 19:05:30 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:14.270 19:05:30 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:14.270 19:05:30 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:14.270 19:05:30 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:14.270 19:05:30 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:14.270 19:05:30 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:14.270 19:05:30 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:14.270 19:05:30 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:14.270 19:05:31 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:14.270 19:05:31 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:14.270 19:05:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:14.270 19:05:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:19:14.270 Found 0000:86:00.0 (0x8086 - 0x159b) 00:19:14.270 19:05:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:14.270 19:05:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:14.270 19:05:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:14.270 19:05:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:14.270 19:05:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:14.270 19:05:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:14.270 19:05:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:19:14.270 Found 0000:86:00.1 (0x8086 - 0x159b) 00:19:14.270 19:05:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:14.270 19:05:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:14.270 19:05:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:14.270 19:05:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:14.270 19:05:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:14.270 19:05:31 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:14.270 19:05:31 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:14.270 19:05:31 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:14.270 19:05:31 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:14.270 19:05:31 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:14.270 19:05:31 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:14.270 19:05:31 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:14.270 19:05:31 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:19:14.270 Found net devices under 0000:86:00.0: cvl_0_0 00:19:14.270 19:05:31 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:14.270 19:05:31 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:14.270 19:05:31 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:14.270 19:05:31 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:14.270 19:05:31 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:14.270 19:05:31 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:19:14.270 Found net devices under 0000:86:00.1: cvl_0_1 00:19:14.270 19:05:31 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:14.270 19:05:31 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:14.270 19:05:31 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:14.270 19:05:31 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:14.270 19:05:31 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:14.270 19:05:31 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:14.270 19:05:31 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:14.270 19:05:31 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:14.270 19:05:31 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:14.270 19:05:31 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:14.270 19:05:31 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:14.270 19:05:31 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:14.270 19:05:31 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:14.270 19:05:31 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:14.270 19:05:31 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:14.270 19:05:31 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:14.270 19:05:31 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:14.270 19:05:31 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:14.270 19:05:31 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:14.270 19:05:31 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:14.270 19:05:31 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:14.270 19:05:31 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:14.270 19:05:31 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:14.530 19:05:31 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:14.530 19:05:31 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:14.530 19:05:31 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:14.530 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:14.530 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.414 ms 00:19:14.530 00:19:14.530 --- 10.0.0.2 ping statistics --- 00:19:14.530 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:14.530 rtt min/avg/max/mdev = 0.414/0.414/0.414/0.000 ms 00:19:14.530 19:05:31 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:14.530 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:14.530 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.143 ms 00:19:14.530 00:19:14.530 --- 10.0.0.1 ping statistics --- 00:19:14.530 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:14.530 rtt min/avg/max/mdev = 0.143/0.143/0.143/0.000 ms 00:19:14.530 19:05:31 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:14.530 19:05:31 -- nvmf/common.sh@410 -- # return 0 00:19:14.530 19:05:31 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:14.530 19:05:31 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:14.530 19:05:31 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:14.530 19:05:31 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:14.530 19:05:31 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:14.530 19:05:31 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:14.530 19:05:31 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:14.530 19:05:31 -- target/multipath.sh@45 -- # '[' -z ']' 00:19:14.530 19:05:31 -- target/multipath.sh@46 -- # echo 'only one NIC for nvmf test' 00:19:14.530 only one NIC for nvmf test 00:19:14.530 19:05:31 -- target/multipath.sh@47 -- # nvmftestfini 00:19:14.530 19:05:31 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:14.530 19:05:31 -- nvmf/common.sh@116 -- # sync 00:19:14.530 19:05:31 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:14.530 19:05:31 -- nvmf/common.sh@119 -- # set +e 00:19:14.530 19:05:31 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:14.530 19:05:31 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:14.530 rmmod nvme_tcp 00:19:14.530 rmmod nvme_fabrics 00:19:14.530 rmmod nvme_keyring 00:19:14.530 19:05:31 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:14.530 19:05:31 -- nvmf/common.sh@123 -- # set -e 00:19:14.530 19:05:31 -- nvmf/common.sh@124 -- # return 0 00:19:14.530 19:05:31 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:19:14.530 19:05:31 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:14.530 19:05:31 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:14.530 19:05:31 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:14.530 19:05:31 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:14.530 19:05:31 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:14.530 19:05:31 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:14.530 19:05:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:14.530 19:05:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:17.068 19:05:33 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:17.068 19:05:33 -- target/multipath.sh@48 -- # exit 0 00:19:17.068 19:05:33 -- target/multipath.sh@1 -- # nvmftestfini 00:19:17.068 19:05:33 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:17.068 19:05:33 -- nvmf/common.sh@116 -- # sync 00:19:17.068 19:05:33 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:17.068 19:05:33 -- nvmf/common.sh@119 -- # set +e 00:19:17.068 19:05:33 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:17.068 19:05:33 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:17.068 19:05:33 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:17.068 19:05:33 -- nvmf/common.sh@123 -- # set -e 00:19:17.068 19:05:33 -- nvmf/common.sh@124 -- # return 0 00:19:17.068 19:05:33 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:19:17.068 19:05:33 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:17.068 19:05:33 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:17.068 19:05:33 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:17.068 19:05:33 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:17.068 19:05:33 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:17.068 19:05:33 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:17.068 19:05:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:17.068 19:05:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:17.068 19:05:33 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:17.068 00:19:17.068 real 0m7.793s 00:19:17.068 user 0m1.712s 00:19:17.068 sys 0m4.086s 00:19:17.068 19:05:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:17.068 19:05:33 -- common/autotest_common.sh@10 -- # set +x 00:19:17.068 ************************************ 00:19:17.068 END TEST nvmf_multipath 00:19:17.068 ************************************ 00:19:17.068 19:05:33 -- nvmf/nvmf.sh@52 -- # run_test nvmf_zcopy /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:19:17.068 19:05:33 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:17.068 19:05:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:17.068 19:05:33 -- common/autotest_common.sh@10 -- # set +x 00:19:17.068 ************************************ 00:19:17.068 START TEST nvmf_zcopy 00:19:17.068 ************************************ 00:19:17.068 19:05:33 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:19:17.068 * Looking for test storage... 00:19:17.068 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:17.068 19:05:33 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:17.068 19:05:33 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:17.068 19:05:33 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:17.068 19:05:33 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:17.068 19:05:33 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:17.068 19:05:33 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:17.068 19:05:33 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:17.068 19:05:33 -- scripts/common.sh@335 -- # IFS=.-: 00:19:17.068 19:05:33 -- scripts/common.sh@335 -- # read -ra ver1 00:19:17.068 19:05:33 -- scripts/common.sh@336 -- # IFS=.-: 00:19:17.068 19:05:33 -- scripts/common.sh@336 -- # read -ra ver2 00:19:17.068 19:05:33 -- scripts/common.sh@337 -- # local 'op=<' 00:19:17.068 19:05:33 -- scripts/common.sh@339 -- # ver1_l=2 00:19:17.068 19:05:33 -- scripts/common.sh@340 -- # ver2_l=1 00:19:17.068 19:05:33 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:17.068 19:05:33 -- scripts/common.sh@343 -- # case "$op" in 00:19:17.068 19:05:33 -- scripts/common.sh@344 -- # : 1 00:19:17.068 19:05:33 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:17.068 19:05:33 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:17.068 19:05:33 -- scripts/common.sh@364 -- # decimal 1 00:19:17.068 19:05:33 -- scripts/common.sh@352 -- # local d=1 00:19:17.068 19:05:33 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:17.068 19:05:33 -- scripts/common.sh@354 -- # echo 1 00:19:17.069 19:05:33 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:17.069 19:05:33 -- scripts/common.sh@365 -- # decimal 2 00:19:17.069 19:05:33 -- scripts/common.sh@352 -- # local d=2 00:19:17.069 19:05:33 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:17.069 19:05:33 -- scripts/common.sh@354 -- # echo 2 00:19:17.069 19:05:33 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:17.069 19:05:33 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:17.069 19:05:33 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:17.069 19:05:33 -- scripts/common.sh@367 -- # return 0 00:19:17.069 19:05:33 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:17.069 19:05:33 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:17.069 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:17.069 --rc genhtml_branch_coverage=1 00:19:17.069 --rc genhtml_function_coverage=1 00:19:17.069 --rc genhtml_legend=1 00:19:17.069 --rc geninfo_all_blocks=1 00:19:17.069 --rc geninfo_unexecuted_blocks=1 00:19:17.069 00:19:17.069 ' 00:19:17.069 19:05:33 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:17.069 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:17.069 --rc genhtml_branch_coverage=1 00:19:17.069 --rc genhtml_function_coverage=1 00:19:17.069 --rc genhtml_legend=1 00:19:17.069 --rc geninfo_all_blocks=1 00:19:17.069 --rc geninfo_unexecuted_blocks=1 00:19:17.069 00:19:17.069 ' 00:19:17.069 19:05:33 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:17.069 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:17.069 --rc genhtml_branch_coverage=1 00:19:17.069 --rc genhtml_function_coverage=1 00:19:17.069 --rc genhtml_legend=1 00:19:17.069 --rc geninfo_all_blocks=1 00:19:17.069 --rc geninfo_unexecuted_blocks=1 00:19:17.069 00:19:17.069 ' 00:19:17.069 19:05:33 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:17.069 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:17.069 --rc genhtml_branch_coverage=1 00:19:17.069 --rc genhtml_function_coverage=1 00:19:17.069 --rc genhtml_legend=1 00:19:17.069 --rc geninfo_all_blocks=1 00:19:17.069 --rc geninfo_unexecuted_blocks=1 00:19:17.069 00:19:17.069 ' 00:19:17.069 19:05:33 -- target/zcopy.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:17.069 19:05:33 -- nvmf/common.sh@7 -- # uname -s 00:19:17.069 19:05:33 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:17.069 19:05:33 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:17.069 19:05:33 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:17.069 19:05:33 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:17.069 19:05:33 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:17.069 19:05:33 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:17.069 19:05:33 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:17.069 19:05:33 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:17.069 19:05:33 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:17.069 19:05:33 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:17.069 19:05:33 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:19:17.069 19:05:33 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:19:17.069 19:05:33 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:17.069 19:05:33 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:17.069 19:05:33 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:17.069 19:05:33 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:17.069 19:05:33 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:17.069 19:05:33 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:17.069 19:05:33 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:17.069 19:05:33 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:17.069 19:05:33 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:17.069 19:05:33 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:17.069 19:05:33 -- paths/export.sh@5 -- # export PATH 00:19:17.069 19:05:33 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:17.069 19:05:33 -- nvmf/common.sh@46 -- # : 0 00:19:17.069 19:05:33 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:17.069 19:05:33 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:17.069 19:05:33 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:17.069 19:05:33 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:17.069 19:05:33 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:17.069 19:05:33 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:17.069 19:05:33 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:17.069 19:05:33 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:17.069 19:05:33 -- target/zcopy.sh@12 -- # nvmftestinit 00:19:17.069 19:05:33 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:17.069 19:05:33 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:17.069 19:05:33 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:17.069 19:05:33 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:17.069 19:05:33 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:17.069 19:05:33 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:17.069 19:05:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:17.069 19:05:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:17.069 19:05:33 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:17.069 19:05:33 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:17.069 19:05:33 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:17.069 19:05:33 -- common/autotest_common.sh@10 -- # set +x 00:19:22.339 19:05:39 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:22.339 19:05:39 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:22.339 19:05:39 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:22.339 19:05:39 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:22.339 19:05:39 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:22.339 19:05:39 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:22.339 19:05:39 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:22.339 19:05:39 -- nvmf/common.sh@294 -- # net_devs=() 00:19:22.339 19:05:39 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:22.339 19:05:39 -- nvmf/common.sh@295 -- # e810=() 00:19:22.339 19:05:39 -- nvmf/common.sh@295 -- # local -ga e810 00:19:22.339 19:05:39 -- nvmf/common.sh@296 -- # x722=() 00:19:22.339 19:05:39 -- nvmf/common.sh@296 -- # local -ga x722 00:19:22.339 19:05:39 -- nvmf/common.sh@297 -- # mlx=() 00:19:22.339 19:05:39 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:22.339 19:05:39 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:22.339 19:05:39 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:22.339 19:05:39 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:22.339 19:05:39 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:22.339 19:05:39 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:22.339 19:05:39 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:22.339 19:05:39 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:22.339 19:05:39 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:22.339 19:05:39 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:22.339 19:05:39 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:22.339 19:05:39 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:22.339 19:05:39 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:22.339 19:05:39 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:22.339 19:05:39 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:22.339 19:05:39 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:22.339 19:05:39 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:22.339 19:05:39 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:22.339 19:05:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:22.339 19:05:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:19:22.339 Found 0000:86:00.0 (0x8086 - 0x159b) 00:19:22.339 19:05:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:22.339 19:05:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:22.339 19:05:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:22.339 19:05:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:22.339 19:05:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:22.339 19:05:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:22.339 19:05:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:19:22.339 Found 0000:86:00.1 (0x8086 - 0x159b) 00:19:22.339 19:05:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:22.339 19:05:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:22.339 19:05:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:22.339 19:05:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:22.339 19:05:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:22.339 19:05:39 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:22.339 19:05:39 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:22.339 19:05:39 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:22.339 19:05:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:22.339 19:05:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:22.339 19:05:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:22.339 19:05:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:22.339 19:05:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:19:22.339 Found net devices under 0000:86:00.0: cvl_0_0 00:19:22.339 19:05:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:22.339 19:05:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:22.339 19:05:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:22.339 19:05:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:22.339 19:05:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:22.339 19:05:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:19:22.339 Found net devices under 0000:86:00.1: cvl_0_1 00:19:22.339 19:05:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:22.339 19:05:39 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:22.339 19:05:39 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:22.339 19:05:39 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:22.339 19:05:39 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:22.339 19:05:39 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:22.339 19:05:39 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:22.339 19:05:39 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:22.339 19:05:39 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:22.339 19:05:39 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:22.339 19:05:39 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:22.339 19:05:39 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:22.340 19:05:39 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:22.340 19:05:39 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:22.340 19:05:39 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:22.340 19:05:39 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:22.340 19:05:39 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:22.340 19:05:39 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:22.340 19:05:39 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:22.599 19:05:39 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:22.599 19:05:39 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:22.599 19:05:39 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:22.599 19:05:39 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:22.599 19:05:39 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:22.599 19:05:39 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:22.599 19:05:39 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:22.599 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:22.599 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.339 ms 00:19:22.599 00:19:22.600 --- 10.0.0.2 ping statistics --- 00:19:22.600 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:22.600 rtt min/avg/max/mdev = 0.339/0.339/0.339/0.000 ms 00:19:22.600 19:05:39 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:22.600 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:22.600 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.201 ms 00:19:22.600 00:19:22.600 --- 10.0.0.1 ping statistics --- 00:19:22.600 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:22.600 rtt min/avg/max/mdev = 0.201/0.201/0.201/0.000 ms 00:19:22.600 19:05:39 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:22.600 19:05:39 -- nvmf/common.sh@410 -- # return 0 00:19:22.600 19:05:39 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:22.600 19:05:39 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:22.600 19:05:39 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:22.600 19:05:39 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:22.600 19:05:39 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:22.600 19:05:39 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:22.600 19:05:39 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:22.600 19:05:39 -- target/zcopy.sh@13 -- # nvmfappstart -m 0x2 00:19:22.600 19:05:39 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:22.600 19:05:39 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:22.600 19:05:39 -- common/autotest_common.sh@10 -- # set +x 00:19:22.600 19:05:39 -- nvmf/common.sh@469 -- # nvmfpid=3114346 00:19:22.600 19:05:39 -- nvmf/common.sh@470 -- # waitforlisten 3114346 00:19:22.600 19:05:39 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:19:22.600 19:05:39 -- common/autotest_common.sh@829 -- # '[' -z 3114346 ']' 00:19:22.600 19:05:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:22.600 19:05:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:22.600 19:05:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:22.600 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:22.600 19:05:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:22.600 19:05:39 -- common/autotest_common.sh@10 -- # set +x 00:19:22.600 [2024-11-26 19:05:39.500041] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:19:22.600 [2024-11-26 19:05:39.500084] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:22.860 EAL: No free 2048 kB hugepages reported on node 1 00:19:22.860 [2024-11-26 19:05:39.560571] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:22.860 [2024-11-26 19:05:39.598627] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:22.860 [2024-11-26 19:05:39.598735] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:22.860 [2024-11-26 19:05:39.598744] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:22.860 [2024-11-26 19:05:39.598751] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:22.860 [2024-11-26 19:05:39.598768] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:23.427 19:05:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:23.427 19:05:40 -- common/autotest_common.sh@862 -- # return 0 00:19:23.427 19:05:40 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:23.427 19:05:40 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:23.427 19:05:40 -- common/autotest_common.sh@10 -- # set +x 00:19:23.686 19:05:40 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:23.686 19:05:40 -- target/zcopy.sh@15 -- # '[' tcp '!=' tcp ']' 00:19:23.686 19:05:40 -- target/zcopy.sh@22 -- # rpc_cmd nvmf_create_transport -t tcp -o -c 0 --zcopy 00:19:23.686 19:05:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.686 19:05:40 -- common/autotest_common.sh@10 -- # set +x 00:19:23.686 [2024-11-26 19:05:40.356334] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:23.686 19:05:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.686 19:05:40 -- target/zcopy.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:19:23.686 19:05:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.686 19:05:40 -- common/autotest_common.sh@10 -- # set +x 00:19:23.686 19:05:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.686 19:05:40 -- target/zcopy.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:23.686 19:05:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.686 19:05:40 -- common/autotest_common.sh@10 -- # set +x 00:19:23.686 [2024-11-26 19:05:40.372501] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:23.686 19:05:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.686 19:05:40 -- target/zcopy.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:19:23.686 19:05:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.686 19:05:40 -- common/autotest_common.sh@10 -- # set +x 00:19:23.686 19:05:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.686 19:05:40 -- target/zcopy.sh@29 -- # rpc_cmd bdev_malloc_create 32 4096 -b malloc0 00:19:23.686 19:05:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.686 19:05:40 -- common/autotest_common.sh@10 -- # set +x 00:19:23.686 malloc0 00:19:23.686 19:05:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.686 19:05:40 -- target/zcopy.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:19:23.686 19:05:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.686 19:05:40 -- common/autotest_common.sh@10 -- # set +x 00:19:23.686 19:05:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.686 19:05:40 -- target/zcopy.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -t 10 -q 128 -w verify -o 8192 00:19:23.686 19:05:40 -- target/zcopy.sh@33 -- # gen_nvmf_target_json 00:19:23.686 19:05:40 -- nvmf/common.sh@520 -- # config=() 00:19:23.686 19:05:40 -- nvmf/common.sh@520 -- # local subsystem config 00:19:23.686 19:05:40 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:19:23.686 19:05:40 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:19:23.686 { 00:19:23.686 "params": { 00:19:23.686 "name": "Nvme$subsystem", 00:19:23.686 "trtype": "$TEST_TRANSPORT", 00:19:23.686 "traddr": "$NVMF_FIRST_TARGET_IP", 00:19:23.686 "adrfam": "ipv4", 00:19:23.686 "trsvcid": "$NVMF_PORT", 00:19:23.686 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:19:23.687 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:19:23.687 "hdgst": ${hdgst:-false}, 00:19:23.687 "ddgst": ${ddgst:-false} 00:19:23.687 }, 00:19:23.687 "method": "bdev_nvme_attach_controller" 00:19:23.687 } 00:19:23.687 EOF 00:19:23.687 )") 00:19:23.687 19:05:40 -- nvmf/common.sh@542 -- # cat 00:19:23.687 19:05:40 -- nvmf/common.sh@544 -- # jq . 00:19:23.687 19:05:40 -- nvmf/common.sh@545 -- # IFS=, 00:19:23.687 19:05:40 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:19:23.687 "params": { 00:19:23.687 "name": "Nvme1", 00:19:23.687 "trtype": "tcp", 00:19:23.687 "traddr": "10.0.0.2", 00:19:23.687 "adrfam": "ipv4", 00:19:23.687 "trsvcid": "4420", 00:19:23.687 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:19:23.687 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:19:23.687 "hdgst": false, 00:19:23.687 "ddgst": false 00:19:23.687 }, 00:19:23.687 "method": "bdev_nvme_attach_controller" 00:19:23.687 }' 00:19:23.687 [2024-11-26 19:05:40.437166] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:19:23.687 [2024-11-26 19:05:40.437210] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3114579 ] 00:19:23.687 EAL: No free 2048 kB hugepages reported on node 1 00:19:23.687 [2024-11-26 19:05:40.492414] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:23.687 [2024-11-26 19:05:40.531048] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:23.945 Running I/O for 10 seconds... 00:19:33.933 00:19:33.933 Latency(us) 00:19:33.933 [2024-11-26T18:05:50.860Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:19:33.933 [2024-11-26T18:05:50.860Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 8192) 00:19:33.933 Verification LBA range: start 0x0 length 0x1000 00:19:33.933 Nvme1n1 : 10.01 12903.39 100.81 0.00 0.00 9896.32 1068.52 19375.86 00:19:33.933 [2024-11-26T18:05:50.860Z] =================================================================================================================== 00:19:33.933 [2024-11-26T18:05:50.860Z] Total : 12903.39 100.81 0.00 0.00 9896.32 1068.52 19375.86 00:19:34.191 19:05:50 -- target/zcopy.sh@39 -- # perfpid=3116231 00:19:34.191 19:05:50 -- target/zcopy.sh@41 -- # xtrace_disable 00:19:34.191 19:05:50 -- common/autotest_common.sh@10 -- # set +x 00:19:34.191 19:05:50 -- target/zcopy.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -t 5 -q 128 -w randrw -M 50 -o 8192 00:19:34.191 [2024-11-26 19:05:50.927847] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.191 [2024-11-26 19:05:50.927881] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.191 19:05:50 -- target/zcopy.sh@37 -- # gen_nvmf_target_json 00:19:34.191 19:05:50 -- nvmf/common.sh@520 -- # config=() 00:19:34.191 19:05:50 -- nvmf/common.sh@520 -- # local subsystem config 00:19:34.191 19:05:50 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:19:34.191 19:05:50 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:19:34.191 { 00:19:34.191 "params": { 00:19:34.191 "name": "Nvme$subsystem", 00:19:34.191 "trtype": "$TEST_TRANSPORT", 00:19:34.191 "traddr": "$NVMF_FIRST_TARGET_IP", 00:19:34.191 "adrfam": "ipv4", 00:19:34.191 "trsvcid": "$NVMF_PORT", 00:19:34.191 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:19:34.191 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:19:34.191 "hdgst": ${hdgst:-false}, 00:19:34.191 "ddgst": ${ddgst:-false} 00:19:34.191 }, 00:19:34.191 "method": "bdev_nvme_attach_controller" 00:19:34.191 } 00:19:34.191 EOF 00:19:34.191 )") 00:19:34.191 19:05:50 -- nvmf/common.sh@542 -- # cat 00:19:34.191 [2024-11-26 19:05:50.935830] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.191 [2024-11-26 19:05:50.935845] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.191 19:05:50 -- nvmf/common.sh@544 -- # jq . 00:19:34.191 19:05:50 -- nvmf/common.sh@545 -- # IFS=, 00:19:34.191 19:05:50 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:19:34.191 "params": { 00:19:34.191 "name": "Nvme1", 00:19:34.191 "trtype": "tcp", 00:19:34.191 "traddr": "10.0.0.2", 00:19:34.191 "adrfam": "ipv4", 00:19:34.191 "trsvcid": "4420", 00:19:34.191 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:19:34.191 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:19:34.191 "hdgst": false, 00:19:34.191 "ddgst": false 00:19:34.191 }, 00:19:34.191 "method": "bdev_nvme_attach_controller" 00:19:34.191 }' 00:19:34.191 [2024-11-26 19:05:50.943844] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.191 [2024-11-26 19:05:50.943856] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.191 [2024-11-26 19:05:50.951864] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.191 [2024-11-26 19:05:50.951873] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.191 [2024-11-26 19:05:50.959886] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.191 [2024-11-26 19:05:50.959896] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.191 [2024-11-26 19:05:50.965549] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:19:34.192 [2024-11-26 19:05:50.965592] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3116231 ] 00:19:34.192 [2024-11-26 19:05:50.967908] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.192 [2024-11-26 19:05:50.967919] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.192 [2024-11-26 19:05:50.975933] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.192 [2024-11-26 19:05:50.975943] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.192 [2024-11-26 19:05:50.983958] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.192 [2024-11-26 19:05:50.983968] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.192 EAL: No free 2048 kB hugepages reported on node 1 00:19:34.192 [2024-11-26 19:05:50.991979] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.192 [2024-11-26 19:05:50.991990] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.192 [2024-11-26 19:05:50.999998] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.192 [2024-11-26 19:05:51.000008] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.192 [2024-11-26 19:05:51.008016] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.192 [2024-11-26 19:05:51.008026] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.192 [2024-11-26 19:05:51.016037] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.192 [2024-11-26 19:05:51.016051] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.192 [2024-11-26 19:05:51.020533] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:34.192 [2024-11-26 19:05:51.024058] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.192 [2024-11-26 19:05:51.024069] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.192 [2024-11-26 19:05:51.032080] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.192 [2024-11-26 19:05:51.032092] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.192 [2024-11-26 19:05:51.040102] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.192 [2024-11-26 19:05:51.040118] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.192 [2024-11-26 19:05:51.048130] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.192 [2024-11-26 19:05:51.048149] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.192 [2024-11-26 19:05:51.056144] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.192 [2024-11-26 19:05:51.056154] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.192 [2024-11-26 19:05:51.058652] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:34.192 [2024-11-26 19:05:51.064167] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.192 [2024-11-26 19:05:51.064180] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.192 [2024-11-26 19:05:51.072197] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.192 [2024-11-26 19:05:51.072215] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.192 [2024-11-26 19:05:51.080215] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.192 [2024-11-26 19:05:51.080227] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.192 [2024-11-26 19:05:51.088236] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.192 [2024-11-26 19:05:51.088247] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.192 [2024-11-26 19:05:51.096254] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.192 [2024-11-26 19:05:51.096265] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.192 [2024-11-26 19:05:51.104276] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.192 [2024-11-26 19:05:51.104286] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.192 [2024-11-26 19:05:51.112306] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.192 [2024-11-26 19:05:51.112321] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.452 [2024-11-26 19:05:51.120326] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.452 [2024-11-26 19:05:51.120339] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.452 [2024-11-26 19:05:51.128341] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.452 [2024-11-26 19:05:51.128352] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.452 [2024-11-26 19:05:51.136390] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.452 [2024-11-26 19:05:51.136410] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.452 [2024-11-26 19:05:51.144407] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.452 [2024-11-26 19:05:51.144421] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.452 [2024-11-26 19:05:51.152425] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.452 [2024-11-26 19:05:51.152438] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.452 [2024-11-26 19:05:51.160447] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.452 [2024-11-26 19:05:51.160465] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.452 [2024-11-26 19:05:51.168473] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.452 [2024-11-26 19:05:51.168487] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.452 [2024-11-26 19:05:51.176491] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.452 [2024-11-26 19:05:51.176506] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.452 [2024-11-26 19:05:51.184510] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.452 [2024-11-26 19:05:51.184520] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.452 [2024-11-26 19:05:51.192539] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.452 [2024-11-26 19:05:51.192556] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.452 [2024-11-26 19:05:51.200556] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.452 [2024-11-26 19:05:51.200568] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.452 Running I/O for 5 seconds... 00:19:34.452 [2024-11-26 19:05:51.208579] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.452 [2024-11-26 19:05:51.208589] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.452 [2024-11-26 19:05:51.219832] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.452 [2024-11-26 19:05:51.219852] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.452 [2024-11-26 19:05:51.228300] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.452 [2024-11-26 19:05:51.228318] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.452 [2024-11-26 19:05:51.234928] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.452 [2024-11-26 19:05:51.234954] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.452 [2024-11-26 19:05:51.245728] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.452 [2024-11-26 19:05:51.245749] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.452 [2024-11-26 19:05:51.254412] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.452 [2024-11-26 19:05:51.254431] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.452 [2024-11-26 19:05:51.263376] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.452 [2024-11-26 19:05:51.263395] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.452 [2024-11-26 19:05:51.272258] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.452 [2024-11-26 19:05:51.272277] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.452 [2024-11-26 19:05:51.280946] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.452 [2024-11-26 19:05:51.280969] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.452 [2024-11-26 19:05:51.289887] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.452 [2024-11-26 19:05:51.289905] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.452 [2024-11-26 19:05:51.298763] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.452 [2024-11-26 19:05:51.298781] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.452 [2024-11-26 19:05:51.307853] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.452 [2024-11-26 19:05:51.307873] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.452 [2024-11-26 19:05:51.317190] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.452 [2024-11-26 19:05:51.317211] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.452 [2024-11-26 19:05:51.325573] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.452 [2024-11-26 19:05:51.325597] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.452 [2024-11-26 19:05:51.335126] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.452 [2024-11-26 19:05:51.335146] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.452 [2024-11-26 19:05:51.343446] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.452 [2024-11-26 19:05:51.343466] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.452 [2024-11-26 19:05:51.352818] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.452 [2024-11-26 19:05:51.352837] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.452 [2024-11-26 19:05:51.361735] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.452 [2024-11-26 19:05:51.361754] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.452 [2024-11-26 19:05:51.370646] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.452 [2024-11-26 19:05:51.370668] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.712 [2024-11-26 19:05:51.379060] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.712 [2024-11-26 19:05:51.379079] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.712 [2024-11-26 19:05:51.388691] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.712 [2024-11-26 19:05:51.388710] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.712 [2024-11-26 19:05:51.397833] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.712 [2024-11-26 19:05:51.397853] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.712 [2024-11-26 19:05:51.407379] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.712 [2024-11-26 19:05:51.407399] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.712 [2024-11-26 19:05:51.415850] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.712 [2024-11-26 19:05:51.415870] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.712 [2024-11-26 19:05:51.424943] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.712 [2024-11-26 19:05:51.424972] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.712 [2024-11-26 19:05:51.434306] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.712 [2024-11-26 19:05:51.434326] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.712 [2024-11-26 19:05:51.443311] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.712 [2024-11-26 19:05:51.443332] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.712 [2024-11-26 19:05:51.452044] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.712 [2024-11-26 19:05:51.452064] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.712 [2024-11-26 19:05:51.461493] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.712 [2024-11-26 19:05:51.461512] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.712 [2024-11-26 19:05:51.470370] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.712 [2024-11-26 19:05:51.470389] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.712 [2024-11-26 19:05:51.479252] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.712 [2024-11-26 19:05:51.479271] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.712 [2024-11-26 19:05:51.488671] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.712 [2024-11-26 19:05:51.488693] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.712 [2024-11-26 19:05:51.496874] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.712 [2024-11-26 19:05:51.496893] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.712 [2024-11-26 19:05:51.505888] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.712 [2024-11-26 19:05:51.505908] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.712 [2024-11-26 19:05:51.514987] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.712 [2024-11-26 19:05:51.515006] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.712 [2024-11-26 19:05:51.524320] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.712 [2024-11-26 19:05:51.524339] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.712 [2024-11-26 19:05:51.532592] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.712 [2024-11-26 19:05:51.532611] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.712 [2024-11-26 19:05:51.541406] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.712 [2024-11-26 19:05:51.541426] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.712 [2024-11-26 19:05:51.550223] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.712 [2024-11-26 19:05:51.550244] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.712 [2024-11-26 19:05:51.559185] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.712 [2024-11-26 19:05:51.559204] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.712 [2024-11-26 19:05:51.568105] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.712 [2024-11-26 19:05:51.568140] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.712 [2024-11-26 19:05:51.576915] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.712 [2024-11-26 19:05:51.576934] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.712 [2024-11-26 19:05:51.585696] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.712 [2024-11-26 19:05:51.585715] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.712 [2024-11-26 19:05:51.594578] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.712 [2024-11-26 19:05:51.594598] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.712 [2024-11-26 19:05:51.603481] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.712 [2024-11-26 19:05:51.603501] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.712 [2024-11-26 19:05:51.611712] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.712 [2024-11-26 19:05:51.611731] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.712 [2024-11-26 19:05:51.620538] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.712 [2024-11-26 19:05:51.620557] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.712 [2024-11-26 19:05:51.630030] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.712 [2024-11-26 19:05:51.630049] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.971 [2024-11-26 19:05:51.638637] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.971 [2024-11-26 19:05:51.638657] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.971 [2024-11-26 19:05:51.647545] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.971 [2024-11-26 19:05:51.647564] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.971 [2024-11-26 19:05:51.655917] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.971 [2024-11-26 19:05:51.655936] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.971 [2024-11-26 19:05:51.664604] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.971 [2024-11-26 19:05:51.664633] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.971 [2024-11-26 19:05:51.673701] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.971 [2024-11-26 19:05:51.673721] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.971 [2024-11-26 19:05:51.682815] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.971 [2024-11-26 19:05:51.682835] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.971 [2024-11-26 19:05:51.691265] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.971 [2024-11-26 19:05:51.691284] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.971 [2024-11-26 19:05:51.700021] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.971 [2024-11-26 19:05:51.700041] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.971 [2024-11-26 19:05:51.708395] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.972 [2024-11-26 19:05:51.708414] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.972 [2024-11-26 19:05:51.716797] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.972 [2024-11-26 19:05:51.716816] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.972 [2024-11-26 19:05:51.725651] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.972 [2024-11-26 19:05:51.725669] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.972 [2024-11-26 19:05:51.734718] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.972 [2024-11-26 19:05:51.734738] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.972 [2024-11-26 19:05:51.743543] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.972 [2024-11-26 19:05:51.743563] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.972 [2024-11-26 19:05:51.753144] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.972 [2024-11-26 19:05:51.753163] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.972 [2024-11-26 19:05:51.761982] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.972 [2024-11-26 19:05:51.762001] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.972 [2024-11-26 19:05:51.771054] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.972 [2024-11-26 19:05:51.771074] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.972 [2024-11-26 19:05:51.780581] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.972 [2024-11-26 19:05:51.780600] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.972 [2024-11-26 19:05:51.788954] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.972 [2024-11-26 19:05:51.788972] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.972 [2024-11-26 19:05:51.797796] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.972 [2024-11-26 19:05:51.797815] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.972 [2024-11-26 19:05:51.806684] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.972 [2024-11-26 19:05:51.806703] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.972 [2024-11-26 19:05:51.815583] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.972 [2024-11-26 19:05:51.815601] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.972 [2024-11-26 19:05:51.824479] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.972 [2024-11-26 19:05:51.824499] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.972 [2024-11-26 19:05:51.833353] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.972 [2024-11-26 19:05:51.833371] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.972 [2024-11-26 19:05:51.842778] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.972 [2024-11-26 19:05:51.842796] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.972 [2024-11-26 19:05:51.851158] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.972 [2024-11-26 19:05:51.851177] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.972 [2024-11-26 19:05:51.860124] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.972 [2024-11-26 19:05:51.860143] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.972 [2024-11-26 19:05:51.868877] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.972 [2024-11-26 19:05:51.868896] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.972 [2024-11-26 19:05:51.877721] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.972 [2024-11-26 19:05:51.877740] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:34.972 [2024-11-26 19:05:51.886576] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:34.972 [2024-11-26 19:05:51.886595] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.231 [2024-11-26 19:05:51.896158] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.231 [2024-11-26 19:05:51.896178] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.231 [2024-11-26 19:05:51.905275] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.231 [2024-11-26 19:05:51.905295] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.231 [2024-11-26 19:05:51.914402] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.231 [2024-11-26 19:05:51.914421] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.231 [2024-11-26 19:05:51.923430] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.231 [2024-11-26 19:05:51.923448] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.231 [2024-11-26 19:05:51.932213] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.231 [2024-11-26 19:05:51.932231] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.231 [2024-11-26 19:05:51.941655] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.231 [2024-11-26 19:05:51.941674] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.231 [2024-11-26 19:05:51.951189] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.231 [2024-11-26 19:05:51.951209] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.231 [2024-11-26 19:05:51.959576] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.231 [2024-11-26 19:05:51.959594] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.231 [2024-11-26 19:05:51.968004] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.231 [2024-11-26 19:05:51.968023] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.231 [2024-11-26 19:05:51.976899] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.231 [2024-11-26 19:05:51.976917] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.231 [2024-11-26 19:05:51.986015] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.231 [2024-11-26 19:05:51.986034] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.231 [2024-11-26 19:05:51.994804] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.231 [2024-11-26 19:05:51.994822] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.231 [2024-11-26 19:05:52.003560] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.231 [2024-11-26 19:05:52.003580] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.231 [2024-11-26 19:05:52.012562] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.231 [2024-11-26 19:05:52.012581] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.231 [2024-11-26 19:05:52.021911] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.231 [2024-11-26 19:05:52.021929] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.231 [2024-11-26 19:05:52.030791] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.231 [2024-11-26 19:05:52.030811] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.231 [2024-11-26 19:05:52.040031] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.231 [2024-11-26 19:05:52.040050] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.231 [2024-11-26 19:05:52.049045] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.231 [2024-11-26 19:05:52.049064] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.231 [2024-11-26 19:05:52.057552] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.231 [2024-11-26 19:05:52.057571] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.231 [2024-11-26 19:05:52.066958] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.231 [2024-11-26 19:05:52.066977] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.231 [2024-11-26 19:05:52.076013] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.231 [2024-11-26 19:05:52.076033] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.231 [2024-11-26 19:05:52.084921] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.231 [2024-11-26 19:05:52.084940] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.231 [2024-11-26 19:05:52.093897] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.231 [2024-11-26 19:05:52.093916] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.231 [2024-11-26 19:05:52.102775] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.231 [2024-11-26 19:05:52.102794] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.231 [2024-11-26 19:05:52.112277] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.231 [2024-11-26 19:05:52.112298] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.231 [2024-11-26 19:05:52.121250] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.231 [2024-11-26 19:05:52.121269] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.231 [2024-11-26 19:05:52.130064] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.231 [2024-11-26 19:05:52.130082] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.231 [2024-11-26 19:05:52.139012] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.231 [2024-11-26 19:05:52.139031] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.231 [2024-11-26 19:05:52.148001] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.231 [2024-11-26 19:05:52.148020] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.491 [2024-11-26 19:05:52.156419] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.491 [2024-11-26 19:05:52.156439] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.491 [2024-11-26 19:05:52.165508] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.491 [2024-11-26 19:05:52.165531] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.491 [2024-11-26 19:05:52.175030] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.491 [2024-11-26 19:05:52.175049] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.491 [2024-11-26 19:05:52.183358] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.491 [2024-11-26 19:05:52.183377] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.491 [2024-11-26 19:05:52.192286] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.491 [2024-11-26 19:05:52.192305] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.491 [2024-11-26 19:05:52.201735] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.491 [2024-11-26 19:05:52.201754] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.491 [2024-11-26 19:05:52.210292] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.491 [2024-11-26 19:05:52.210311] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.491 [2024-11-26 19:05:52.219420] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.491 [2024-11-26 19:05:52.219439] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.491 [2024-11-26 19:05:52.228626] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.491 [2024-11-26 19:05:52.228646] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.491 [2024-11-26 19:05:52.237360] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.491 [2024-11-26 19:05:52.237379] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.491 [2024-11-26 19:05:52.246181] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.491 [2024-11-26 19:05:52.246199] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.491 [2024-11-26 19:05:52.255187] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.491 [2024-11-26 19:05:52.255206] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.491 [2024-11-26 19:05:52.264086] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.491 [2024-11-26 19:05:52.264105] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.491 [2024-11-26 19:05:52.273027] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.491 [2024-11-26 19:05:52.273046] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.491 [2024-11-26 19:05:52.281978] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.491 [2024-11-26 19:05:52.281996] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.491 [2024-11-26 19:05:52.290834] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.491 [2024-11-26 19:05:52.290853] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.491 [2024-11-26 19:05:52.299700] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.491 [2024-11-26 19:05:52.299720] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.491 [2024-11-26 19:05:52.308493] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.491 [2024-11-26 19:05:52.308511] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.491 [2024-11-26 19:05:52.317446] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.491 [2024-11-26 19:05:52.317464] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.491 [2024-11-26 19:05:52.326369] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.491 [2024-11-26 19:05:52.326388] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.491 [2024-11-26 19:05:52.334768] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.491 [2024-11-26 19:05:52.334790] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.491 [2024-11-26 19:05:52.344481] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.491 [2024-11-26 19:05:52.344500] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.491 [2024-11-26 19:05:52.353418] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.491 [2024-11-26 19:05:52.353436] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.491 [2024-11-26 19:05:52.362355] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.491 [2024-11-26 19:05:52.362374] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.491 [2024-11-26 19:05:52.371403] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.491 [2024-11-26 19:05:52.371422] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.491 [2024-11-26 19:05:52.379918] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.491 [2024-11-26 19:05:52.379937] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.491 [2024-11-26 19:05:52.389040] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.491 [2024-11-26 19:05:52.389060] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.491 [2024-11-26 19:05:52.398141] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.491 [2024-11-26 19:05:52.398160] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.491 [2024-11-26 19:05:52.407117] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.491 [2024-11-26 19:05:52.407136] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.751 [2024-11-26 19:05:52.416228] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.751 [2024-11-26 19:05:52.416248] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.751 [2024-11-26 19:05:52.425362] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.751 [2024-11-26 19:05:52.425382] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.751 [2024-11-26 19:05:52.434755] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.751 [2024-11-26 19:05:52.434774] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.751 [2024-11-26 19:05:52.443721] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.751 [2024-11-26 19:05:52.443740] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.751 [2024-11-26 19:05:52.453105] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.751 [2024-11-26 19:05:52.453124] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.751 [2024-11-26 19:05:52.462158] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.751 [2024-11-26 19:05:52.462177] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.751 [2024-11-26 19:05:52.470954] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.751 [2024-11-26 19:05:52.470974] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.751 [2024-11-26 19:05:52.480089] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.751 [2024-11-26 19:05:52.480108] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.751 [2024-11-26 19:05:52.489287] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.751 [2024-11-26 19:05:52.489307] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.751 [2024-11-26 19:05:52.498163] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.751 [2024-11-26 19:05:52.498182] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.751 [2024-11-26 19:05:52.507184] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.751 [2024-11-26 19:05:52.507206] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.751 [2024-11-26 19:05:52.516217] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.751 [2024-11-26 19:05:52.516236] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.751 [2024-11-26 19:05:52.524557] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.751 [2024-11-26 19:05:52.524575] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.751 [2024-11-26 19:05:52.533634] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.751 [2024-11-26 19:05:52.533653] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.751 [2024-11-26 19:05:52.540295] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.751 [2024-11-26 19:05:52.540314] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.751 [2024-11-26 19:05:52.551243] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.751 [2024-11-26 19:05:52.551262] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.751 [2024-11-26 19:05:52.560345] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.751 [2024-11-26 19:05:52.560365] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.751 [2024-11-26 19:05:52.568827] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.751 [2024-11-26 19:05:52.568846] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.751 [2024-11-26 19:05:52.577928] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.751 [2024-11-26 19:05:52.577956] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.751 [2024-11-26 19:05:52.586936] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.751 [2024-11-26 19:05:52.586963] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.751 [2024-11-26 19:05:52.596218] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.751 [2024-11-26 19:05:52.596236] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.751 [2024-11-26 19:05:52.605111] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.751 [2024-11-26 19:05:52.605129] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.751 [2024-11-26 19:05:52.613456] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.751 [2024-11-26 19:05:52.613475] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.751 [2024-11-26 19:05:52.622406] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.752 [2024-11-26 19:05:52.622425] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.752 [2024-11-26 19:05:52.630781] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.752 [2024-11-26 19:05:52.630801] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.752 [2024-11-26 19:05:52.639968] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.752 [2024-11-26 19:05:52.640002] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.752 [2024-11-26 19:05:52.649072] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.752 [2024-11-26 19:05:52.649090] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.752 [2024-11-26 19:05:52.657914] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.752 [2024-11-26 19:05:52.657933] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:35.752 [2024-11-26 19:05:52.667039] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:35.752 [2024-11-26 19:05:52.667057] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.011 [2024-11-26 19:05:52.675485] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.012 [2024-11-26 19:05:52.675512] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.012 [2024-11-26 19:05:52.684985] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.012 [2024-11-26 19:05:52.685004] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.012 [2024-11-26 19:05:52.693731] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.012 [2024-11-26 19:05:52.693750] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.012 [2024-11-26 19:05:52.702724] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.012 [2024-11-26 19:05:52.702742] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.012 [2024-11-26 19:05:52.709372] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.012 [2024-11-26 19:05:52.709391] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.012 [2024-11-26 19:05:52.720023] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.012 [2024-11-26 19:05:52.720042] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.012 [2024-11-26 19:05:52.728379] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.012 [2024-11-26 19:05:52.728397] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.012 [2024-11-26 19:05:52.737291] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.012 [2024-11-26 19:05:52.737311] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.012 [2024-11-26 19:05:52.746735] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.012 [2024-11-26 19:05:52.746753] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.012 [2024-11-26 19:05:52.755210] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.012 [2024-11-26 19:05:52.755229] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.012 [2024-11-26 19:05:52.764174] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.012 [2024-11-26 19:05:52.764192] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.012 [2024-11-26 19:05:52.773321] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.012 [2024-11-26 19:05:52.773340] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.012 [2024-11-26 19:05:52.782193] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.012 [2024-11-26 19:05:52.782213] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.012 [2024-11-26 19:05:52.791183] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.012 [2024-11-26 19:05:52.791203] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.012 [2024-11-26 19:05:52.800065] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.012 [2024-11-26 19:05:52.800085] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.012 [2024-11-26 19:05:52.809341] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.012 [2024-11-26 19:05:52.809361] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.012 [2024-11-26 19:05:52.818209] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.012 [2024-11-26 19:05:52.818229] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.012 [2024-11-26 19:05:52.827222] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.012 [2024-11-26 19:05:52.827257] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.012 [2024-11-26 19:05:52.835778] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.012 [2024-11-26 19:05:52.835799] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.012 [2024-11-26 19:05:52.844972] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.012 [2024-11-26 19:05:52.844992] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.012 [2024-11-26 19:05:52.853397] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.012 [2024-11-26 19:05:52.853416] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.012 [2024-11-26 19:05:52.862185] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.012 [2024-11-26 19:05:52.862205] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.012 [2024-11-26 19:05:52.871660] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.012 [2024-11-26 19:05:52.871680] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.012 [2024-11-26 19:05:52.880276] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.012 [2024-11-26 19:05:52.880296] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.012 [2024-11-26 19:05:52.889128] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.012 [2024-11-26 19:05:52.889147] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.012 [2024-11-26 19:05:52.898101] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.012 [2024-11-26 19:05:52.898120] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.012 [2024-11-26 19:05:52.906965] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.012 [2024-11-26 19:05:52.906984] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.012 [2024-11-26 19:05:52.915499] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.012 [2024-11-26 19:05:52.915517] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.012 [2024-11-26 19:05:52.924355] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.012 [2024-11-26 19:05:52.924374] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.012 [2024-11-26 19:05:52.933393] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.012 [2024-11-26 19:05:52.933414] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.271 [2024-11-26 19:05:52.942751] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.271 [2024-11-26 19:05:52.942770] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.271 [2024-11-26 19:05:52.952282] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.271 [2024-11-26 19:05:52.952301] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.271 [2024-11-26 19:05:52.961567] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.271 [2024-11-26 19:05:52.961587] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.271 [2024-11-26 19:05:52.969966] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.271 [2024-11-26 19:05:52.969985] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.271 [2024-11-26 19:05:52.979340] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.271 [2024-11-26 19:05:52.979359] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.271 [2024-11-26 19:05:52.988411] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.271 [2024-11-26 19:05:52.988430] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.271 [2024-11-26 19:05:52.997434] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.271 [2024-11-26 19:05:52.997453] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.271 [2024-11-26 19:05:53.006122] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.271 [2024-11-26 19:05:53.006141] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.271 [2024-11-26 19:05:53.015755] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.271 [2024-11-26 19:05:53.015786] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.271 [2024-11-26 19:05:53.024309] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.271 [2024-11-26 19:05:53.024328] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.271 [2024-11-26 19:05:53.033255] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.271 [2024-11-26 19:05:53.033273] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.271 [2024-11-26 19:05:53.042287] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.271 [2024-11-26 19:05:53.042307] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.271 [2024-11-26 19:05:53.050723] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.271 [2024-11-26 19:05:53.050743] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.271 [2024-11-26 19:05:53.059525] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.271 [2024-11-26 19:05:53.059544] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.271 [2024-11-26 19:05:53.068817] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.271 [2024-11-26 19:05:53.068836] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.271 [2024-11-26 19:05:53.077236] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.271 [2024-11-26 19:05:53.077255] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.272 [2024-11-26 19:05:53.086377] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.272 [2024-11-26 19:05:53.086396] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.272 [2024-11-26 19:05:53.095491] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.272 [2024-11-26 19:05:53.095510] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.272 [2024-11-26 19:05:53.104913] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.272 [2024-11-26 19:05:53.104933] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.272 [2024-11-26 19:05:53.114109] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.272 [2024-11-26 19:05:53.114129] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.272 [2024-11-26 19:05:53.122912] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.272 [2024-11-26 19:05:53.122931] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.272 [2024-11-26 19:05:53.131827] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.272 [2024-11-26 19:05:53.131846] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.272 [2024-11-26 19:05:53.140754] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.272 [2024-11-26 19:05:53.140773] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.272 [2024-11-26 19:05:53.149868] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.272 [2024-11-26 19:05:53.149888] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.272 [2024-11-26 19:05:53.158389] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.272 [2024-11-26 19:05:53.158408] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.272 [2024-11-26 19:05:53.167364] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.272 [2024-11-26 19:05:53.167384] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.272 [2024-11-26 19:05:53.175843] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.272 [2024-11-26 19:05:53.175863] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.272 [2024-11-26 19:05:53.184315] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.272 [2024-11-26 19:05:53.184335] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.272 [2024-11-26 19:05:53.193463] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.272 [2024-11-26 19:05:53.193483] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.531 [2024-11-26 19:05:53.202661] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.531 [2024-11-26 19:05:53.202680] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.531 [2024-11-26 19:05:53.211756] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.531 [2024-11-26 19:05:53.211774] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.531 [2024-11-26 19:05:53.220660] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.531 [2024-11-26 19:05:53.220679] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.531 [2024-11-26 19:05:53.229729] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.531 [2024-11-26 19:05:53.229748] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.531 [2024-11-26 19:05:53.238151] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.531 [2024-11-26 19:05:53.238169] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.531 [2024-11-26 19:05:53.247606] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.531 [2024-11-26 19:05:53.247624] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.531 [2024-11-26 19:05:53.256605] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.531 [2024-11-26 19:05:53.256623] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.531 [2024-11-26 19:05:53.265096] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.531 [2024-11-26 19:05:53.265115] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.531 [2024-11-26 19:05:53.274169] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.531 [2024-11-26 19:05:53.274188] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.531 [2024-11-26 19:05:53.283137] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.531 [2024-11-26 19:05:53.283155] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.531 [2024-11-26 19:05:53.292655] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.532 [2024-11-26 19:05:53.292674] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.532 [2024-11-26 19:05:53.301339] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.532 [2024-11-26 19:05:53.301357] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.532 [2024-11-26 19:05:53.310104] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.532 [2024-11-26 19:05:53.310123] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.532 [2024-11-26 19:05:53.318955] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.532 [2024-11-26 19:05:53.318974] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.532 [2024-11-26 19:05:53.327723] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.532 [2024-11-26 19:05:53.327741] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.532 [2024-11-26 19:05:53.336713] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.532 [2024-11-26 19:05:53.336732] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.532 [2024-11-26 19:05:53.345571] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.532 [2024-11-26 19:05:53.345589] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.532 [2024-11-26 19:05:53.354271] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.532 [2024-11-26 19:05:53.354290] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.532 [2024-11-26 19:05:53.363071] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.532 [2024-11-26 19:05:53.363090] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.532 [2024-11-26 19:05:53.372107] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.532 [2024-11-26 19:05:53.372126] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.532 [2024-11-26 19:05:53.381069] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.532 [2024-11-26 19:05:53.381087] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.532 [2024-11-26 19:05:53.390024] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.532 [2024-11-26 19:05:53.390043] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.532 [2024-11-26 19:05:53.398570] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.532 [2024-11-26 19:05:53.398588] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.532 [2024-11-26 19:05:53.407045] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.532 [2024-11-26 19:05:53.407064] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.532 [2024-11-26 19:05:53.416087] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.532 [2024-11-26 19:05:53.416106] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.532 [2024-11-26 19:05:53.424740] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.532 [2024-11-26 19:05:53.424759] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.532 [2024-11-26 19:05:53.433484] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.532 [2024-11-26 19:05:53.433502] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.532 [2024-11-26 19:05:53.442434] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.532 [2024-11-26 19:05:53.442453] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.532 [2024-11-26 19:05:53.451434] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.532 [2024-11-26 19:05:53.451453] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.792 [2024-11-26 19:05:53.460594] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.792 [2024-11-26 19:05:53.460613] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.792 [2024-11-26 19:05:53.468909] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.792 [2024-11-26 19:05:53.468927] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.792 [2024-11-26 19:05:53.477940] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.792 [2024-11-26 19:05:53.477966] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.792 [2024-11-26 19:05:53.486489] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.792 [2024-11-26 19:05:53.486508] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.792 [2024-11-26 19:05:53.494873] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.792 [2024-11-26 19:05:53.494891] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.792 [2024-11-26 19:05:53.503933] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.792 [2024-11-26 19:05:53.503962] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.792 [2024-11-26 19:05:53.512999] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.792 [2024-11-26 19:05:53.513021] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.792 [2024-11-26 19:05:53.521246] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.792 [2024-11-26 19:05:53.521264] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.792 [2024-11-26 19:05:53.529823] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.792 [2024-11-26 19:05:53.529841] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.792 [2024-11-26 19:05:53.538702] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.792 [2024-11-26 19:05:53.538720] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.792 [2024-11-26 19:05:53.547352] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.792 [2024-11-26 19:05:53.547371] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.792 [2024-11-26 19:05:53.556187] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.792 [2024-11-26 19:05:53.556205] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.792 [2024-11-26 19:05:53.565085] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.792 [2024-11-26 19:05:53.565104] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.792 [2024-11-26 19:05:53.573903] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.792 [2024-11-26 19:05:53.573923] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.792 [2024-11-26 19:05:53.582190] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.792 [2024-11-26 19:05:53.582208] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.792 [2024-11-26 19:05:53.590919] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.792 [2024-11-26 19:05:53.590938] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.792 [2024-11-26 19:05:53.599885] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.792 [2024-11-26 19:05:53.599905] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.792 [2024-11-26 19:05:53.608774] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.792 [2024-11-26 19:05:53.608794] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.792 [2024-11-26 19:05:53.617416] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.792 [2024-11-26 19:05:53.617435] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.792 [2024-11-26 19:05:53.626226] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.792 [2024-11-26 19:05:53.626244] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.792 [2024-11-26 19:05:53.635564] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.792 [2024-11-26 19:05:53.635583] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.792 [2024-11-26 19:05:53.643863] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.792 [2024-11-26 19:05:53.643881] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.792 [2024-11-26 19:05:53.652701] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.792 [2024-11-26 19:05:53.652720] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.792 [2024-11-26 19:05:53.662213] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.792 [2024-11-26 19:05:53.662231] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.792 [2024-11-26 19:05:53.671576] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.792 [2024-11-26 19:05:53.671595] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.792 [2024-11-26 19:05:53.680114] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.792 [2024-11-26 19:05:53.680136] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.792 [2024-11-26 19:05:53.688430] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.792 [2024-11-26 19:05:53.688448] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.792 [2024-11-26 19:05:53.697311] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.792 [2024-11-26 19:05:53.697329] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.792 [2024-11-26 19:05:53.706188] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.792 [2024-11-26 19:05:53.706207] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:36.792 [2024-11-26 19:05:53.714991] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:36.792 [2024-11-26 19:05:53.715009] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.053 [2024-11-26 19:05:53.723922] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.053 [2024-11-26 19:05:53.723941] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.053 [2024-11-26 19:05:53.733019] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.053 [2024-11-26 19:05:53.733038] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.053 [2024-11-26 19:05:53.741797] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.053 [2024-11-26 19:05:53.741816] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.053 [2024-11-26 19:05:53.750627] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.053 [2024-11-26 19:05:53.750645] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.053 [2024-11-26 19:05:53.759683] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.053 [2024-11-26 19:05:53.759701] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.053 [2024-11-26 19:05:53.769196] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.053 [2024-11-26 19:05:53.769214] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.053 [2024-11-26 19:05:53.777510] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.053 [2024-11-26 19:05:53.777528] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.053 [2024-11-26 19:05:53.786405] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.053 [2024-11-26 19:05:53.786423] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.053 [2024-11-26 19:05:53.794763] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.053 [2024-11-26 19:05:53.794781] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.053 [2024-11-26 19:05:53.804242] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.053 [2024-11-26 19:05:53.804261] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.053 [2024-11-26 19:05:53.811374] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.053 [2024-11-26 19:05:53.811392] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.053 [2024-11-26 19:05:53.821341] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.053 [2024-11-26 19:05:53.821361] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.053 [2024-11-26 19:05:53.829979] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.053 [2024-11-26 19:05:53.829998] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.053 [2024-11-26 19:05:53.838926] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.053 [2024-11-26 19:05:53.838945] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.053 [2024-11-26 19:05:53.847719] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.053 [2024-11-26 19:05:53.847742] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.053 [2024-11-26 19:05:53.856793] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.053 [2024-11-26 19:05:53.856812] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.053 [2024-11-26 19:05:53.865909] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.053 [2024-11-26 19:05:53.865927] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.053 [2024-11-26 19:05:53.874745] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.053 [2024-11-26 19:05:53.874764] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.053 [2024-11-26 19:05:53.883677] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.053 [2024-11-26 19:05:53.883697] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.053 [2024-11-26 19:05:53.893166] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.053 [2024-11-26 19:05:53.893185] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.053 [2024-11-26 19:05:53.901484] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.053 [2024-11-26 19:05:53.901503] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.053 [2024-11-26 19:05:53.910229] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.053 [2024-11-26 19:05:53.910248] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.053 [2024-11-26 19:05:53.919155] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.053 [2024-11-26 19:05:53.919173] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.053 [2024-11-26 19:05:53.928014] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.053 [2024-11-26 19:05:53.928033] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.053 [2024-11-26 19:05:53.936983] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.053 [2024-11-26 19:05:53.937002] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.053 [2024-11-26 19:05:53.945923] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.053 [2024-11-26 19:05:53.945942] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.053 [2024-11-26 19:05:53.954657] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.053 [2024-11-26 19:05:53.954675] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.053 [2024-11-26 19:05:53.964080] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.053 [2024-11-26 19:05:53.964099] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.053 [2024-11-26 19:05:53.973219] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.053 [2024-11-26 19:05:53.973238] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.312 [2024-11-26 19:05:53.981593] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.312 [2024-11-26 19:05:53.981612] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.312 [2024-11-26 19:05:53.990644] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.312 [2024-11-26 19:05:53.990664] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.312 [2024-11-26 19:05:53.999840] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.312 [2024-11-26 19:05:53.999859] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.312 [2024-11-26 19:05:54.009251] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.312 [2024-11-26 19:05:54.009270] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.312 [2024-11-26 19:05:54.018405] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.312 [2024-11-26 19:05:54.018427] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.312 [2024-11-26 19:05:54.027059] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.312 [2024-11-26 19:05:54.027078] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.312 [2024-11-26 19:05:54.036563] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.312 [2024-11-26 19:05:54.036582] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.312 [2024-11-26 19:05:54.045548] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.312 [2024-11-26 19:05:54.045567] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.312 [2024-11-26 19:05:54.054372] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.313 [2024-11-26 19:05:54.054391] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.313 [2024-11-26 19:05:54.063357] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.313 [2024-11-26 19:05:54.063375] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.313 [2024-11-26 19:05:54.072217] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.313 [2024-11-26 19:05:54.072236] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.313 [2024-11-26 19:05:54.080938] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.313 [2024-11-26 19:05:54.080962] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.313 [2024-11-26 19:05:54.089324] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.313 [2024-11-26 19:05:54.089344] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.313 [2024-11-26 19:05:54.098748] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.313 [2024-11-26 19:05:54.098767] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.313 [2024-11-26 19:05:54.108118] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.313 [2024-11-26 19:05:54.108138] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.313 [2024-11-26 19:05:54.116511] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.313 [2024-11-26 19:05:54.116529] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.313 [2024-11-26 19:05:54.124930] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.313 [2024-11-26 19:05:54.124955] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.313 [2024-11-26 19:05:54.134352] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.313 [2024-11-26 19:05:54.134371] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.313 [2024-11-26 19:05:54.143309] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.313 [2024-11-26 19:05:54.143328] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.313 [2024-11-26 19:05:54.152674] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.313 [2024-11-26 19:05:54.152692] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.313 [2024-11-26 19:05:54.161756] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.313 [2024-11-26 19:05:54.161775] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.313 [2024-11-26 19:05:54.170178] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.313 [2024-11-26 19:05:54.170196] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.313 [2024-11-26 19:05:54.178526] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.313 [2024-11-26 19:05:54.178545] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.313 [2024-11-26 19:05:54.187298] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.313 [2024-11-26 19:05:54.187319] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.313 [2024-11-26 19:05:54.196137] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.313 [2024-11-26 19:05:54.196157] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.313 [2024-11-26 19:05:54.205202] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.313 [2024-11-26 19:05:54.205223] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.313 [2024-11-26 19:05:54.211866] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.313 [2024-11-26 19:05:54.211885] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.313 [2024-11-26 19:05:54.222816] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.313 [2024-11-26 19:05:54.222836] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.313 [2024-11-26 19:05:54.231621] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.313 [2024-11-26 19:05:54.231642] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.573 [2024-11-26 19:05:54.240691] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.573 [2024-11-26 19:05:54.240712] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.573 [2024-11-26 19:05:54.250185] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.573 [2024-11-26 19:05:54.250205] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.573 [2024-11-26 19:05:54.258659] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.573 [2024-11-26 19:05:54.258679] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.573 [2024-11-26 19:05:54.267780] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.573 [2024-11-26 19:05:54.267799] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.573 [2024-11-26 19:05:54.276764] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.573 [2024-11-26 19:05:54.276785] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.573 [2024-11-26 19:05:54.285173] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.573 [2024-11-26 19:05:54.285193] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.573 [2024-11-26 19:05:54.293545] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.573 [2024-11-26 19:05:54.293564] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.573 [2024-11-26 19:05:54.302015] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.573 [2024-11-26 19:05:54.302033] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.573 [2024-11-26 19:05:54.311053] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.573 [2024-11-26 19:05:54.311072] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.573 [2024-11-26 19:05:54.319850] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.573 [2024-11-26 19:05:54.319869] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.573 [2024-11-26 19:05:54.328818] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.573 [2024-11-26 19:05:54.328837] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.573 [2024-11-26 19:05:54.337903] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.573 [2024-11-26 19:05:54.337922] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.573 [2024-11-26 19:05:54.347498] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.573 [2024-11-26 19:05:54.347516] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.573 [2024-11-26 19:05:54.356534] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.573 [2024-11-26 19:05:54.356552] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.573 [2024-11-26 19:05:54.363730] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.573 [2024-11-26 19:05:54.363749] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.573 [2024-11-26 19:05:54.373319] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.573 [2024-11-26 19:05:54.373339] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.573 [2024-11-26 19:05:54.381977] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.573 [2024-11-26 19:05:54.381996] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.573 [2024-11-26 19:05:54.390990] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.573 [2024-11-26 19:05:54.391008] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.573 [2024-11-26 19:05:54.399932] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.573 [2024-11-26 19:05:54.399960] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.573 [2024-11-26 19:05:54.408966] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.573 [2024-11-26 19:05:54.408986] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.573 [2024-11-26 19:05:54.417355] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.573 [2024-11-26 19:05:54.417375] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.573 [2024-11-26 19:05:54.426570] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.573 [2024-11-26 19:05:54.426589] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.573 [2024-11-26 19:05:54.435024] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.573 [2024-11-26 19:05:54.435042] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.573 [2024-11-26 19:05:54.444166] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.573 [2024-11-26 19:05:54.444186] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.573 [2024-11-26 19:05:54.453161] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.573 [2024-11-26 19:05:54.453179] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.573 [2024-11-26 19:05:54.462034] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.573 [2024-11-26 19:05:54.462052] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.573 [2024-11-26 19:05:54.471528] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.573 [2024-11-26 19:05:54.471548] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.573 [2024-11-26 19:05:54.480057] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.573 [2024-11-26 19:05:54.480077] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.573 [2024-11-26 19:05:54.488891] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.573 [2024-11-26 19:05:54.488910] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.833 [2024-11-26 19:05:54.498003] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.833 [2024-11-26 19:05:54.498023] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.833 [2024-11-26 19:05:54.507013] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.833 [2024-11-26 19:05:54.507034] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.833 [2024-11-26 19:05:54.515351] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.833 [2024-11-26 19:05:54.515371] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.833 [2024-11-26 19:05:54.524616] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.833 [2024-11-26 19:05:54.524635] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.833 [2024-11-26 19:05:54.533660] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.833 [2024-11-26 19:05:54.533679] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.833 [2024-11-26 19:05:54.542413] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.833 [2024-11-26 19:05:54.542432] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.833 [2024-11-26 19:05:54.551344] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.833 [2024-11-26 19:05:54.551362] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.833 [2024-11-26 19:05:54.560376] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.833 [2024-11-26 19:05:54.560396] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.833 [2024-11-26 19:05:54.569284] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.833 [2024-11-26 19:05:54.569303] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.833 [2024-11-26 19:05:54.578270] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.833 [2024-11-26 19:05:54.578290] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.833 [2024-11-26 19:05:54.587391] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.833 [2024-11-26 19:05:54.587410] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.833 [2024-11-26 19:05:54.596741] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.833 [2024-11-26 19:05:54.596760] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.833 [2024-11-26 19:05:54.606511] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.833 [2024-11-26 19:05:54.606531] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.833 [2024-11-26 19:05:54.614927] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.833 [2024-11-26 19:05:54.614953] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.833 [2024-11-26 19:05:54.624258] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.833 [2024-11-26 19:05:54.624279] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.833 [2024-11-26 19:05:54.632870] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.833 [2024-11-26 19:05:54.632890] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.833 [2024-11-26 19:05:54.641900] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.833 [2024-11-26 19:05:54.641919] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.833 [2024-11-26 19:05:54.650843] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.833 [2024-11-26 19:05:54.650861] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.833 [2024-11-26 19:05:54.659584] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.833 [2024-11-26 19:05:54.659602] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.833 [2024-11-26 19:05:54.669218] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.833 [2024-11-26 19:05:54.669237] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.833 [2024-11-26 19:05:54.678317] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.833 [2024-11-26 19:05:54.678336] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.833 [2024-11-26 19:05:54.687045] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.833 [2024-11-26 19:05:54.687065] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.833 [2024-11-26 19:05:54.695803] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.833 [2024-11-26 19:05:54.695821] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.833 [2024-11-26 19:05:54.704750] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.833 [2024-11-26 19:05:54.704769] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.833 [2024-11-26 19:05:54.713056] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.833 [2024-11-26 19:05:54.713075] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.833 [2024-11-26 19:05:54.722506] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.833 [2024-11-26 19:05:54.722524] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.833 [2024-11-26 19:05:54.731048] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.833 [2024-11-26 19:05:54.731067] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.833 [2024-11-26 19:05:54.739578] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.833 [2024-11-26 19:05:54.739597] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:37.833 [2024-11-26 19:05:54.748643] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:37.834 [2024-11-26 19:05:54.748662] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.093 [2024-11-26 19:05:54.757839] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.093 [2024-11-26 19:05:54.757859] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.093 [2024-11-26 19:05:54.766694] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.093 [2024-11-26 19:05:54.766712] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.093 [2024-11-26 19:05:54.775704] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.093 [2024-11-26 19:05:54.775722] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.093 [2024-11-26 19:05:54.784594] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.093 [2024-11-26 19:05:54.784612] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.093 [2024-11-26 19:05:54.793496] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.093 [2024-11-26 19:05:54.793515] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.093 [2024-11-26 19:05:54.802285] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.093 [2024-11-26 19:05:54.802303] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.093 [2024-11-26 19:05:54.810992] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.093 [2024-11-26 19:05:54.811010] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.093 [2024-11-26 19:05:54.819794] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.093 [2024-11-26 19:05:54.819814] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.093 [2024-11-26 19:05:54.829376] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.093 [2024-11-26 19:05:54.829395] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.093 [2024-11-26 19:05:54.837942] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.093 [2024-11-26 19:05:54.837968] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.093 [2024-11-26 19:05:54.846984] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.093 [2024-11-26 19:05:54.847003] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.093 [2024-11-26 19:05:54.855891] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.093 [2024-11-26 19:05:54.855913] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.093 [2024-11-26 19:05:54.864870] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.093 [2024-11-26 19:05:54.864889] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.093 [2024-11-26 19:05:54.873766] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.093 [2024-11-26 19:05:54.873785] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.093 [2024-11-26 19:05:54.882067] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.093 [2024-11-26 19:05:54.882085] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.093 [2024-11-26 19:05:54.890921] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.093 [2024-11-26 19:05:54.890939] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.093 [2024-11-26 19:05:54.900290] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.093 [2024-11-26 19:05:54.900308] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.093 [2024-11-26 19:05:54.909198] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.093 [2024-11-26 19:05:54.909217] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.093 [2024-11-26 19:05:54.918121] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.093 [2024-11-26 19:05:54.918140] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.093 [2024-11-26 19:05:54.927543] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.093 [2024-11-26 19:05:54.927562] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.094 [2024-11-26 19:05:54.936679] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.094 [2024-11-26 19:05:54.936698] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.094 [2024-11-26 19:05:54.945014] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.094 [2024-11-26 19:05:54.945033] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.094 [2024-11-26 19:05:54.953445] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.094 [2024-11-26 19:05:54.953464] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.094 [2024-11-26 19:05:54.962925] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.094 [2024-11-26 19:05:54.962944] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.094 [2024-11-26 19:05:54.971978] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.094 [2024-11-26 19:05:54.971997] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.094 [2024-11-26 19:05:54.981491] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.094 [2024-11-26 19:05:54.981510] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.094 [2024-11-26 19:05:54.990090] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.094 [2024-11-26 19:05:54.990109] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.094 [2024-11-26 19:05:54.999038] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.094 [2024-11-26 19:05:54.999056] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.094 [2024-11-26 19:05:55.007692] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.094 [2024-11-26 19:05:55.007709] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.094 [2024-11-26 19:05:55.016776] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.353 [2024-11-26 19:05:55.016795] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.353 [2024-11-26 19:05:55.025883] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.353 [2024-11-26 19:05:55.025907] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.353 [2024-11-26 19:05:55.034969] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.353 [2024-11-26 19:05:55.034988] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.354 [2024-11-26 19:05:55.044130] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.354 [2024-11-26 19:05:55.044148] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.354 [2024-11-26 19:05:55.052435] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.354 [2024-11-26 19:05:55.052455] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.354 [2024-11-26 19:05:55.061191] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.354 [2024-11-26 19:05:55.061210] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.354 [2024-11-26 19:05:55.070040] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.354 [2024-11-26 19:05:55.070059] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.354 [2024-11-26 19:05:55.079009] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.354 [2024-11-26 19:05:55.079028] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.354 [2024-11-26 19:05:55.087884] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.354 [2024-11-26 19:05:55.087902] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.354 [2024-11-26 19:05:55.096661] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.354 [2024-11-26 19:05:55.096680] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.354 [2024-11-26 19:05:55.105981] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.354 [2024-11-26 19:05:55.106000] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.354 [2024-11-26 19:05:55.114913] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.354 [2024-11-26 19:05:55.114932] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.354 [2024-11-26 19:05:55.123799] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.354 [2024-11-26 19:05:55.123817] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.354 [2024-11-26 19:05:55.132628] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.354 [2024-11-26 19:05:55.132647] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.354 [2024-11-26 19:05:55.141398] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.354 [2024-11-26 19:05:55.141417] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.354 [2024-11-26 19:05:55.150287] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.354 [2024-11-26 19:05:55.150306] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.354 [2024-11-26 19:05:55.159126] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.354 [2024-11-26 19:05:55.159144] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.354 [2024-11-26 19:05:55.167434] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.354 [2024-11-26 19:05:55.167452] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.354 [2024-11-26 19:05:55.176422] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.354 [2024-11-26 19:05:55.176440] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.354 [2024-11-26 19:05:55.184710] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.354 [2024-11-26 19:05:55.184728] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.354 [2024-11-26 19:05:55.193761] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.354 [2024-11-26 19:05:55.193786] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.354 [2024-11-26 19:05:55.202623] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.354 [2024-11-26 19:05:55.202642] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.354 [2024-11-26 19:05:55.211491] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.354 [2024-11-26 19:05:55.211510] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.354 [2024-11-26 19:05:55.220868] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.354 [2024-11-26 19:05:55.220888] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.354 [2024-11-26 19:05:55.229820] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.354 [2024-11-26 19:05:55.229839] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.354 [2024-11-26 19:05:55.238639] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.354 [2024-11-26 19:05:55.238657] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.354 [2024-11-26 19:05:55.247630] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.354 [2024-11-26 19:05:55.247649] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.354 [2024-11-26 19:05:55.256471] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.354 [2024-11-26 19:05:55.256490] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.354 [2024-11-26 19:05:55.265319] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.354 [2024-11-26 19:05:55.265337] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.354 [2024-11-26 19:05:55.274124] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.354 [2024-11-26 19:05:55.274154] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.614 [2024-11-26 19:05:55.283711] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.614 [2024-11-26 19:05:55.283730] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.614 [2024-11-26 19:05:55.292755] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.614 [2024-11-26 19:05:55.292774] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.614 [2024-11-26 19:05:55.301817] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.614 [2024-11-26 19:05:55.301836] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.614 [2024-11-26 19:05:55.311004] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.614 [2024-11-26 19:05:55.311024] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.614 [2024-11-26 19:05:55.320145] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.614 [2024-11-26 19:05:55.320163] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.614 [2024-11-26 19:05:55.329195] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.614 [2024-11-26 19:05:55.329213] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.614 [2024-11-26 19:05:55.338342] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.614 [2024-11-26 19:05:55.338362] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.614 [2024-11-26 19:05:55.352617] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.614 [2024-11-26 19:05:55.352636] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.614 [2024-11-26 19:05:55.361231] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.614 [2024-11-26 19:05:55.361250] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.614 [2024-11-26 19:05:55.370460] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.614 [2024-11-26 19:05:55.370490] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.614 [2024-11-26 19:05:55.379484] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.614 [2024-11-26 19:05:55.379503] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.614 [2024-11-26 19:05:55.387847] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.614 [2024-11-26 19:05:55.387866] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.614 [2024-11-26 19:05:55.397193] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.614 [2024-11-26 19:05:55.397212] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.614 [2024-11-26 19:05:55.405470] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.614 [2024-11-26 19:05:55.405489] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.614 [2024-11-26 19:05:55.414004] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.614 [2024-11-26 19:05:55.414022] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.614 [2024-11-26 19:05:55.422972] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.614 [2024-11-26 19:05:55.422990] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.614 [2024-11-26 19:05:55.431911] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.614 [2024-11-26 19:05:55.431930] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.614 [2024-11-26 19:05:55.440896] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.614 [2024-11-26 19:05:55.440915] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.614 [2024-11-26 19:05:55.449216] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.614 [2024-11-26 19:05:55.449234] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.614 [2024-11-26 19:05:55.457856] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.614 [2024-11-26 19:05:55.457885] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.614 [2024-11-26 19:05:55.466718] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.614 [2024-11-26 19:05:55.466736] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.614 [2024-11-26 19:05:55.475958] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.614 [2024-11-26 19:05:55.475977] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.614 [2024-11-26 19:05:55.484351] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.614 [2024-11-26 19:05:55.484370] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.614 [2024-11-26 19:05:55.493327] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.614 [2024-11-26 19:05:55.493346] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.614 [2024-11-26 19:05:55.502658] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.614 [2024-11-26 19:05:55.502676] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.614 [2024-11-26 19:05:55.510977] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.614 [2024-11-26 19:05:55.510995] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.614 [2024-11-26 19:05:55.520108] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.614 [2024-11-26 19:05:55.520127] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.614 [2024-11-26 19:05:55.528460] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.614 [2024-11-26 19:05:55.528479] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.614 [2024-11-26 19:05:55.537361] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.614 [2024-11-26 19:05:55.537385] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.875 [2024-11-26 19:05:55.546391] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.875 [2024-11-26 19:05:55.546410] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.875 [2024-11-26 19:05:55.555358] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.875 [2024-11-26 19:05:55.555377] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.875 [2024-11-26 19:05:55.564003] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.875 [2024-11-26 19:05:55.564021] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.875 [2024-11-26 19:05:55.573029] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.875 [2024-11-26 19:05:55.573048] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.875 [2024-11-26 19:05:55.581516] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.875 [2024-11-26 19:05:55.581535] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.875 [2024-11-26 19:05:55.589903] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.875 [2024-11-26 19:05:55.589921] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.875 [2024-11-26 19:05:55.599412] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.875 [2024-11-26 19:05:55.599431] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.875 [2024-11-26 19:05:55.607598] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.875 [2024-11-26 19:05:55.607617] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.875 [2024-11-26 19:05:55.616553] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.875 [2024-11-26 19:05:55.616572] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.875 [2024-11-26 19:05:55.625406] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.875 [2024-11-26 19:05:55.625426] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.875 [2024-11-26 19:05:55.634703] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.875 [2024-11-26 19:05:55.634723] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.875 [2024-11-26 19:05:55.643687] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.875 [2024-11-26 19:05:55.643707] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.875 [2024-11-26 19:05:55.652742] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.875 [2024-11-26 19:05:55.652762] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.875 [2024-11-26 19:05:55.661885] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.875 [2024-11-26 19:05:55.661905] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.875 [2024-11-26 19:05:55.670850] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.875 [2024-11-26 19:05:55.670870] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.875 [2024-11-26 19:05:55.679265] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.875 [2024-11-26 19:05:55.679284] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.875 [2024-11-26 19:05:55.688250] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.875 [2024-11-26 19:05:55.688270] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.875 [2024-11-26 19:05:55.697864] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.875 [2024-11-26 19:05:55.697883] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.875 [2024-11-26 19:05:55.706844] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.875 [2024-11-26 19:05:55.706863] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.875 [2024-11-26 19:05:55.715202] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.875 [2024-11-26 19:05:55.715222] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.875 [2024-11-26 19:05:55.724689] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.875 [2024-11-26 19:05:55.724709] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.875 [2024-11-26 19:05:55.733613] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.875 [2024-11-26 19:05:55.733633] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.875 [2024-11-26 19:05:55.742673] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.875 [2024-11-26 19:05:55.742691] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.875 [2024-11-26 19:05:55.751729] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.875 [2024-11-26 19:05:55.751749] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.875 [2024-11-26 19:05:55.760662] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.875 [2024-11-26 19:05:55.760681] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.875 [2024-11-26 19:05:55.769135] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.875 [2024-11-26 19:05:55.769154] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.875 [2024-11-26 19:05:55.777416] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.875 [2024-11-26 19:05:55.777435] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.875 [2024-11-26 19:05:55.786934] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.875 [2024-11-26 19:05:55.786960] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:38.875 [2024-11-26 19:05:55.795417] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:38.875 [2024-11-26 19:05:55.795439] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.134 [2024-11-26 19:05:55.803963] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.134 [2024-11-26 19:05:55.803983] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.134 [2024-11-26 19:05:55.813023] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.134 [2024-11-26 19:05:55.813043] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.134 [2024-11-26 19:05:55.822052] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.134 [2024-11-26 19:05:55.822072] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.134 [2024-11-26 19:05:55.830496] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.134 [2024-11-26 19:05:55.830515] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.134 [2024-11-26 19:05:55.839407] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.134 [2024-11-26 19:05:55.839428] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.134 [2024-11-26 19:05:55.848281] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.134 [2024-11-26 19:05:55.848300] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.134 [2024-11-26 19:05:55.857220] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.134 [2024-11-26 19:05:55.857240] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.134 [2024-11-26 19:05:55.865933] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.134 [2024-11-26 19:05:55.865960] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.134 [2024-11-26 19:05:55.875349] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.134 [2024-11-26 19:05:55.875368] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.134 [2024-11-26 19:05:55.884875] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.135 [2024-11-26 19:05:55.884894] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.135 [2024-11-26 19:05:55.893974] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.135 [2024-11-26 19:05:55.893993] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.135 [2024-11-26 19:05:55.902925] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.135 [2024-11-26 19:05:55.902945] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.135 [2024-11-26 19:05:55.911869] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.135 [2024-11-26 19:05:55.911888] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.135 [2024-11-26 19:05:55.920619] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.135 [2024-11-26 19:05:55.920639] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.135 [2024-11-26 19:05:55.929624] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.135 [2024-11-26 19:05:55.929644] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.135 [2024-11-26 19:05:55.938337] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.135 [2024-11-26 19:05:55.938357] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.135 [2024-11-26 19:05:55.947349] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.135 [2024-11-26 19:05:55.947368] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.135 [2024-11-26 19:05:55.955629] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.135 [2024-11-26 19:05:55.955647] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.135 [2024-11-26 19:05:55.964574] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.135 [2024-11-26 19:05:55.964594] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.135 [2024-11-26 19:05:55.973981] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.135 [2024-11-26 19:05:55.974000] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.135 [2024-11-26 19:05:55.983017] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.135 [2024-11-26 19:05:55.983037] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.135 [2024-11-26 19:05:55.991335] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.135 [2024-11-26 19:05:55.991354] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.135 [2024-11-26 19:05:56.000121] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.135 [2024-11-26 19:05:56.000141] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.135 [2024-11-26 19:05:56.008953] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.135 [2024-11-26 19:05:56.008973] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.135 [2024-11-26 19:05:56.017867] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.135 [2024-11-26 19:05:56.017886] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.135 [2024-11-26 19:05:56.026873] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.135 [2024-11-26 19:05:56.026892] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.135 [2024-11-26 19:05:56.035866] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.135 [2024-11-26 19:05:56.035885] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.135 [2024-11-26 19:05:56.044183] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.135 [2024-11-26 19:05:56.044202] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.135 [2024-11-26 19:05:56.053068] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.135 [2024-11-26 19:05:56.053087] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.394 [2024-11-26 19:05:56.061650] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.394 [2024-11-26 19:05:56.061670] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.394 [2024-11-26 19:05:56.070616] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.394 [2024-11-26 19:05:56.070635] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.394 [2024-11-26 19:05:56.078975] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.394 [2024-11-26 19:05:56.078993] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.394 [2024-11-26 19:05:56.087700] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.394 [2024-11-26 19:05:56.087718] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.394 [2024-11-26 19:05:56.096795] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.394 [2024-11-26 19:05:56.096814] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.394 [2024-11-26 19:05:56.106183] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.394 [2024-11-26 19:05:56.106202] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.394 [2024-11-26 19:05:56.114586] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.394 [2024-11-26 19:05:56.114604] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.394 [2024-11-26 19:05:56.123736] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.394 [2024-11-26 19:05:56.123754] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.394 [2024-11-26 19:05:56.132749] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.394 [2024-11-26 19:05:56.132768] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.394 [2024-11-26 19:05:56.141455] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.394 [2024-11-26 19:05:56.141473] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.394 [2024-11-26 19:05:56.150603] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.394 [2024-11-26 19:05:56.150622] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.394 [2024-11-26 19:05:56.159106] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.394 [2024-11-26 19:05:56.159126] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.394 [2024-11-26 19:05:56.168321] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.394 [2024-11-26 19:05:56.168340] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.394 [2024-11-26 19:05:56.177544] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.394 [2024-11-26 19:05:56.177563] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.394 [2024-11-26 19:05:56.184278] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.394 [2024-11-26 19:05:56.184296] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.394 [2024-11-26 19:05:56.195089] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.394 [2024-11-26 19:05:56.195108] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.394 [2024-11-26 19:05:56.203641] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.394 [2024-11-26 19:05:56.203664] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.394 [2024-11-26 19:05:56.213260] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.394 [2024-11-26 19:05:56.213278] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.394 [2024-11-26 19:05:56.219599] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.394 [2024-11-26 19:05:56.219617] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.394 00:19:39.394 Latency(us) 00:19:39.394 [2024-11-26T18:05:56.321Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:19:39.394 [2024-11-26T18:05:56.321Z] Job: Nvme1n1 (Core Mask 0x1, workload: randrw, percentage: 50, depth: 128, IO size: 8192) 00:19:39.394 Nvme1n1 : 5.01 17340.83 135.48 0.00 0.00 7375.30 3148.58 16412.49 00:19:39.394 [2024-11-26T18:05:56.321Z] =================================================================================================================== 00:19:39.394 [2024-11-26T18:05:56.321Z] Total : 17340.83 135.48 0.00 0.00 7375.30 3148.58 16412.49 00:19:39.394 [2024-11-26 19:05:56.227615] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.394 [2024-11-26 19:05:56.227630] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.394 [2024-11-26 19:05:56.235635] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.394 [2024-11-26 19:05:56.235648] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.394 [2024-11-26 19:05:56.243663] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.394 [2024-11-26 19:05:56.243676] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.394 [2024-11-26 19:05:56.251687] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.394 [2024-11-26 19:05:56.251702] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.394 [2024-11-26 19:05:56.259701] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.394 [2024-11-26 19:05:56.259714] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.394 [2024-11-26 19:05:56.267723] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.394 [2024-11-26 19:05:56.267734] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.394 [2024-11-26 19:05:56.275739] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.394 [2024-11-26 19:05:56.275750] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.394 [2024-11-26 19:05:56.283761] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.394 [2024-11-26 19:05:56.283773] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.394 [2024-11-26 19:05:56.291782] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.394 [2024-11-26 19:05:56.291792] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.394 [2024-11-26 19:05:56.299804] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.394 [2024-11-26 19:05:56.299814] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.394 [2024-11-26 19:05:56.307826] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.394 [2024-11-26 19:05:56.307837] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.394 [2024-11-26 19:05:56.315852] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.394 [2024-11-26 19:05:56.315865] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.654 [2024-11-26 19:05:56.323870] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.654 [2024-11-26 19:05:56.323882] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.654 [2024-11-26 19:05:56.331889] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.654 [2024-11-26 19:05:56.331905] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.654 [2024-11-26 19:05:56.339931] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.654 [2024-11-26 19:05:56.339942] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.654 [2024-11-26 19:05:56.347934] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.654 [2024-11-26 19:05:56.347945] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.654 [2024-11-26 19:05:56.355957] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.654 [2024-11-26 19:05:56.355967] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.654 [2024-11-26 19:05:56.363976] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.654 [2024-11-26 19:05:56.363986] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.654 [2024-11-26 19:05:56.372003] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.654 [2024-11-26 19:05:56.372014] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.654 [2024-11-26 19:05:56.380023] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.654 [2024-11-26 19:05:56.380033] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.654 [2024-11-26 19:05:56.388043] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:39.654 [2024-11-26 19:05:56.388053] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.654 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh: line 42: kill: (3116231) - No such process 00:19:39.654 19:05:56 -- target/zcopy.sh@49 -- # wait 3116231 00:19:39.654 19:05:56 -- target/zcopy.sh@52 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:19:39.654 19:05:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:39.654 19:05:56 -- common/autotest_common.sh@10 -- # set +x 00:19:39.654 19:05:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:39.654 19:05:56 -- target/zcopy.sh@53 -- # rpc_cmd bdev_delay_create -b malloc0 -d delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:19:39.654 19:05:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:39.654 19:05:56 -- common/autotest_common.sh@10 -- # set +x 00:19:39.654 delay0 00:19:39.654 19:05:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:39.654 19:05:56 -- target/zcopy.sh@54 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 delay0 -n 1 00:19:39.654 19:05:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:39.654 19:05:56 -- common/autotest_common.sh@10 -- # set +x 00:19:39.654 19:05:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:39.654 19:05:56 -- target/zcopy.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -c 0x1 -t 5 -q 64 -w randrw -M 50 -l warning -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 ns:1' 00:19:39.654 EAL: No free 2048 kB hugepages reported on node 1 00:19:39.654 [2024-11-26 19:05:56.478807] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:19:46.221 [2024-11-26 19:06:02.535654] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2516360 is same with the state(5) to be set 00:19:46.221 Initializing NVMe Controllers 00:19:46.221 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:19:46.221 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:19:46.221 Initialization complete. Launching workers. 00:19:46.221 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 I/O completed: 320, failed: 135 00:19:46.221 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) abort submitted 422, failed to submit 33 00:19:46.221 success 241, unsuccess 181, failed 0 00:19:46.221 19:06:02 -- target/zcopy.sh@59 -- # trap - SIGINT SIGTERM EXIT 00:19:46.221 19:06:02 -- target/zcopy.sh@60 -- # nvmftestfini 00:19:46.221 19:06:02 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:46.221 19:06:02 -- nvmf/common.sh@116 -- # sync 00:19:46.221 19:06:02 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:46.221 19:06:02 -- nvmf/common.sh@119 -- # set +e 00:19:46.221 19:06:02 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:46.221 19:06:02 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:46.221 rmmod nvme_tcp 00:19:46.221 rmmod nvme_fabrics 00:19:46.221 rmmod nvme_keyring 00:19:46.221 19:06:02 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:46.221 19:06:02 -- nvmf/common.sh@123 -- # set -e 00:19:46.221 19:06:02 -- nvmf/common.sh@124 -- # return 0 00:19:46.221 19:06:02 -- nvmf/common.sh@477 -- # '[' -n 3114346 ']' 00:19:46.221 19:06:02 -- nvmf/common.sh@478 -- # killprocess 3114346 00:19:46.221 19:06:02 -- common/autotest_common.sh@936 -- # '[' -z 3114346 ']' 00:19:46.221 19:06:02 -- common/autotest_common.sh@940 -- # kill -0 3114346 00:19:46.221 19:06:02 -- common/autotest_common.sh@941 -- # uname 00:19:46.221 19:06:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:46.221 19:06:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3114346 00:19:46.221 19:06:02 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:19:46.221 19:06:02 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:19:46.221 19:06:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3114346' 00:19:46.221 killing process with pid 3114346 00:19:46.221 19:06:02 -- common/autotest_common.sh@955 -- # kill 3114346 00:19:46.221 19:06:02 -- common/autotest_common.sh@960 -- # wait 3114346 00:19:46.221 19:06:02 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:46.221 19:06:02 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:46.221 19:06:02 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:46.221 19:06:02 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:46.221 19:06:02 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:46.221 19:06:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:46.221 19:06:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:46.221 19:06:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:48.127 19:06:04 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:48.127 00:19:48.127 real 0m31.439s 00:19:48.127 user 0m42.223s 00:19:48.127 sys 0m10.775s 00:19:48.127 19:06:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:48.127 19:06:04 -- common/autotest_common.sh@10 -- # set +x 00:19:48.127 ************************************ 00:19:48.127 END TEST nvmf_zcopy 00:19:48.127 ************************************ 00:19:48.127 19:06:04 -- nvmf/nvmf.sh@53 -- # run_test nvmf_nmic /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:19:48.127 19:06:04 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:48.127 19:06:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:48.127 19:06:04 -- common/autotest_common.sh@10 -- # set +x 00:19:48.127 ************************************ 00:19:48.127 START TEST nvmf_nmic 00:19:48.127 ************************************ 00:19:48.127 19:06:04 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:19:48.127 * Looking for test storage... 00:19:48.127 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:48.127 19:06:05 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:48.127 19:06:05 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:48.127 19:06:05 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:48.387 19:06:05 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:48.387 19:06:05 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:48.387 19:06:05 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:48.387 19:06:05 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:48.387 19:06:05 -- scripts/common.sh@335 -- # IFS=.-: 00:19:48.387 19:06:05 -- scripts/common.sh@335 -- # read -ra ver1 00:19:48.387 19:06:05 -- scripts/common.sh@336 -- # IFS=.-: 00:19:48.387 19:06:05 -- scripts/common.sh@336 -- # read -ra ver2 00:19:48.387 19:06:05 -- scripts/common.sh@337 -- # local 'op=<' 00:19:48.387 19:06:05 -- scripts/common.sh@339 -- # ver1_l=2 00:19:48.387 19:06:05 -- scripts/common.sh@340 -- # ver2_l=1 00:19:48.387 19:06:05 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:48.387 19:06:05 -- scripts/common.sh@343 -- # case "$op" in 00:19:48.387 19:06:05 -- scripts/common.sh@344 -- # : 1 00:19:48.387 19:06:05 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:48.387 19:06:05 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:48.387 19:06:05 -- scripts/common.sh@364 -- # decimal 1 00:19:48.387 19:06:05 -- scripts/common.sh@352 -- # local d=1 00:19:48.387 19:06:05 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:48.387 19:06:05 -- scripts/common.sh@354 -- # echo 1 00:19:48.387 19:06:05 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:48.387 19:06:05 -- scripts/common.sh@365 -- # decimal 2 00:19:48.387 19:06:05 -- scripts/common.sh@352 -- # local d=2 00:19:48.387 19:06:05 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:48.387 19:06:05 -- scripts/common.sh@354 -- # echo 2 00:19:48.387 19:06:05 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:48.387 19:06:05 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:48.387 19:06:05 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:48.387 19:06:05 -- scripts/common.sh@367 -- # return 0 00:19:48.387 19:06:05 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:48.387 19:06:05 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:48.387 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:48.387 --rc genhtml_branch_coverage=1 00:19:48.387 --rc genhtml_function_coverage=1 00:19:48.387 --rc genhtml_legend=1 00:19:48.387 --rc geninfo_all_blocks=1 00:19:48.387 --rc geninfo_unexecuted_blocks=1 00:19:48.387 00:19:48.387 ' 00:19:48.387 19:06:05 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:48.387 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:48.387 --rc genhtml_branch_coverage=1 00:19:48.387 --rc genhtml_function_coverage=1 00:19:48.387 --rc genhtml_legend=1 00:19:48.387 --rc geninfo_all_blocks=1 00:19:48.387 --rc geninfo_unexecuted_blocks=1 00:19:48.387 00:19:48.387 ' 00:19:48.387 19:06:05 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:48.387 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:48.387 --rc genhtml_branch_coverage=1 00:19:48.387 --rc genhtml_function_coverage=1 00:19:48.387 --rc genhtml_legend=1 00:19:48.387 --rc geninfo_all_blocks=1 00:19:48.387 --rc geninfo_unexecuted_blocks=1 00:19:48.387 00:19:48.387 ' 00:19:48.387 19:06:05 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:48.387 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:48.387 --rc genhtml_branch_coverage=1 00:19:48.387 --rc genhtml_function_coverage=1 00:19:48.387 --rc genhtml_legend=1 00:19:48.387 --rc geninfo_all_blocks=1 00:19:48.387 --rc geninfo_unexecuted_blocks=1 00:19:48.387 00:19:48.387 ' 00:19:48.387 19:06:05 -- target/nmic.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:48.387 19:06:05 -- nvmf/common.sh@7 -- # uname -s 00:19:48.387 19:06:05 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:48.387 19:06:05 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:48.387 19:06:05 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:48.387 19:06:05 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:48.387 19:06:05 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:48.387 19:06:05 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:48.387 19:06:05 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:48.387 19:06:05 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:48.387 19:06:05 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:48.387 19:06:05 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:48.387 19:06:05 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:19:48.387 19:06:05 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:19:48.387 19:06:05 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:48.387 19:06:05 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:48.387 19:06:05 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:48.387 19:06:05 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:48.387 19:06:05 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:48.387 19:06:05 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:48.387 19:06:05 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:48.387 19:06:05 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:48.387 19:06:05 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:48.387 19:06:05 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:48.387 19:06:05 -- paths/export.sh@5 -- # export PATH 00:19:48.387 19:06:05 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:48.387 19:06:05 -- nvmf/common.sh@46 -- # : 0 00:19:48.387 19:06:05 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:48.387 19:06:05 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:48.387 19:06:05 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:48.387 19:06:05 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:48.387 19:06:05 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:48.387 19:06:05 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:48.387 19:06:05 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:48.387 19:06:05 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:48.387 19:06:05 -- target/nmic.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:48.387 19:06:05 -- target/nmic.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:48.387 19:06:05 -- target/nmic.sh@14 -- # nvmftestinit 00:19:48.387 19:06:05 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:48.387 19:06:05 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:48.387 19:06:05 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:48.387 19:06:05 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:48.388 19:06:05 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:48.388 19:06:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:48.388 19:06:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:48.388 19:06:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:48.388 19:06:05 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:48.388 19:06:05 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:48.388 19:06:05 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:48.388 19:06:05 -- common/autotest_common.sh@10 -- # set +x 00:19:53.658 19:06:10 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:53.658 19:06:10 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:53.658 19:06:10 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:53.658 19:06:10 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:53.658 19:06:10 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:53.658 19:06:10 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:53.658 19:06:10 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:53.658 19:06:10 -- nvmf/common.sh@294 -- # net_devs=() 00:19:53.658 19:06:10 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:53.658 19:06:10 -- nvmf/common.sh@295 -- # e810=() 00:19:53.658 19:06:10 -- nvmf/common.sh@295 -- # local -ga e810 00:19:53.658 19:06:10 -- nvmf/common.sh@296 -- # x722=() 00:19:53.658 19:06:10 -- nvmf/common.sh@296 -- # local -ga x722 00:19:53.658 19:06:10 -- nvmf/common.sh@297 -- # mlx=() 00:19:53.658 19:06:10 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:53.658 19:06:10 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:53.658 19:06:10 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:53.658 19:06:10 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:53.658 19:06:10 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:53.658 19:06:10 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:53.658 19:06:10 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:53.659 19:06:10 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:53.659 19:06:10 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:53.659 19:06:10 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:53.659 19:06:10 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:53.659 19:06:10 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:53.659 19:06:10 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:53.659 19:06:10 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:53.659 19:06:10 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:53.659 19:06:10 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:53.659 19:06:10 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:53.659 19:06:10 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:53.659 19:06:10 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:53.659 19:06:10 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:19:53.659 Found 0000:86:00.0 (0x8086 - 0x159b) 00:19:53.659 19:06:10 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:53.659 19:06:10 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:53.659 19:06:10 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:53.659 19:06:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:53.659 19:06:10 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:53.659 19:06:10 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:53.659 19:06:10 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:19:53.659 Found 0000:86:00.1 (0x8086 - 0x159b) 00:19:53.659 19:06:10 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:53.659 19:06:10 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:53.659 19:06:10 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:53.659 19:06:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:53.659 19:06:10 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:53.659 19:06:10 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:53.659 19:06:10 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:53.659 19:06:10 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:53.659 19:06:10 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:53.659 19:06:10 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:53.659 19:06:10 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:53.659 19:06:10 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:53.659 19:06:10 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:19:53.659 Found net devices under 0000:86:00.0: cvl_0_0 00:19:53.659 19:06:10 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:53.659 19:06:10 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:53.659 19:06:10 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:53.659 19:06:10 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:53.659 19:06:10 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:53.659 19:06:10 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:19:53.659 Found net devices under 0000:86:00.1: cvl_0_1 00:19:53.659 19:06:10 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:53.659 19:06:10 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:53.659 19:06:10 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:53.659 19:06:10 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:53.659 19:06:10 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:53.659 19:06:10 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:53.659 19:06:10 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:53.659 19:06:10 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:53.659 19:06:10 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:53.659 19:06:10 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:53.659 19:06:10 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:53.659 19:06:10 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:53.659 19:06:10 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:53.659 19:06:10 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:53.659 19:06:10 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:53.659 19:06:10 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:53.659 19:06:10 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:53.659 19:06:10 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:53.659 19:06:10 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:53.659 19:06:10 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:53.659 19:06:10 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:53.659 19:06:10 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:53.659 19:06:10 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:53.659 19:06:10 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:53.659 19:06:10 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:53.659 19:06:10 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:53.659 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:53.659 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.431 ms 00:19:53.659 00:19:53.659 --- 10.0.0.2 ping statistics --- 00:19:53.659 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:53.659 rtt min/avg/max/mdev = 0.431/0.431/0.431/0.000 ms 00:19:53.659 19:06:10 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:53.659 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:53.659 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.213 ms 00:19:53.659 00:19:53.659 --- 10.0.0.1 ping statistics --- 00:19:53.659 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:53.659 rtt min/avg/max/mdev = 0.213/0.213/0.213/0.000 ms 00:19:53.659 19:06:10 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:53.659 19:06:10 -- nvmf/common.sh@410 -- # return 0 00:19:53.659 19:06:10 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:53.659 19:06:10 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:53.659 19:06:10 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:53.659 19:06:10 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:53.659 19:06:10 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:53.659 19:06:10 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:53.659 19:06:10 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:53.659 19:06:10 -- target/nmic.sh@15 -- # nvmfappstart -m 0xF 00:19:53.659 19:06:10 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:53.659 19:06:10 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:53.659 19:06:10 -- common/autotest_common.sh@10 -- # set +x 00:19:53.659 19:06:10 -- nvmf/common.sh@469 -- # nvmfpid=3122151 00:19:53.659 19:06:10 -- nvmf/common.sh@470 -- # waitforlisten 3122151 00:19:53.659 19:06:10 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:19:53.659 19:06:10 -- common/autotest_common.sh@829 -- # '[' -z 3122151 ']' 00:19:53.659 19:06:10 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:53.659 19:06:10 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:53.659 19:06:10 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:53.659 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:53.659 19:06:10 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:53.659 19:06:10 -- common/autotest_common.sh@10 -- # set +x 00:19:53.659 [2024-11-26 19:06:10.485839] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:19:53.659 [2024-11-26 19:06:10.485884] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:53.659 EAL: No free 2048 kB hugepages reported on node 1 00:19:53.659 [2024-11-26 19:06:10.548736] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:53.917 [2024-11-26 19:06:10.590824] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:53.917 [2024-11-26 19:06:10.590936] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:53.917 [2024-11-26 19:06:10.590946] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:53.917 [2024-11-26 19:06:10.590957] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:53.917 [2024-11-26 19:06:10.590999] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:53.917 [2024-11-26 19:06:10.591095] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:53.917 [2024-11-26 19:06:10.591111] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:53.917 [2024-11-26 19:06:10.591113] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:54.487 19:06:11 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:54.488 19:06:11 -- common/autotest_common.sh@862 -- # return 0 00:19:54.488 19:06:11 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:54.488 19:06:11 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:54.488 19:06:11 -- common/autotest_common.sh@10 -- # set +x 00:19:54.488 19:06:11 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:54.488 19:06:11 -- target/nmic.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:54.488 19:06:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:54.488 19:06:11 -- common/autotest_common.sh@10 -- # set +x 00:19:54.488 [2024-11-26 19:06:11.367499] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:54.488 19:06:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:54.488 19:06:11 -- target/nmic.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:19:54.488 19:06:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:54.488 19:06:11 -- common/autotest_common.sh@10 -- # set +x 00:19:54.488 Malloc0 00:19:54.488 19:06:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:54.488 19:06:11 -- target/nmic.sh@21 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:19:54.488 19:06:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:54.488 19:06:11 -- common/autotest_common.sh@10 -- # set +x 00:19:54.488 19:06:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:54.488 19:06:11 -- target/nmic.sh@22 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:54.488 19:06:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:54.488 19:06:11 -- common/autotest_common.sh@10 -- # set +x 00:19:54.752 19:06:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:54.752 19:06:11 -- target/nmic.sh@23 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:54.752 19:06:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:54.752 19:06:11 -- common/autotest_common.sh@10 -- # set +x 00:19:54.752 [2024-11-26 19:06:11.423605] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:54.752 19:06:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:54.752 19:06:11 -- target/nmic.sh@25 -- # echo 'test case1: single bdev can'\''t be used in multiple subsystems' 00:19:54.752 test case1: single bdev can't be used in multiple subsystems 00:19:54.752 19:06:11 -- target/nmic.sh@26 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:19:54.752 19:06:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:54.752 19:06:11 -- common/autotest_common.sh@10 -- # set +x 00:19:54.752 19:06:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:54.752 19:06:11 -- target/nmic.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:19:54.752 19:06:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:54.752 19:06:11 -- common/autotest_common.sh@10 -- # set +x 00:19:54.752 19:06:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:54.752 19:06:11 -- target/nmic.sh@28 -- # nmic_status=0 00:19:54.752 19:06:11 -- target/nmic.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc0 00:19:54.752 19:06:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:54.752 19:06:11 -- common/autotest_common.sh@10 -- # set +x 00:19:54.752 [2024-11-26 19:06:11.447495] bdev.c:7940:bdev_open: *ERROR*: bdev Malloc0 already claimed: type exclusive_write by module NVMe-oF Target 00:19:54.752 [2024-11-26 19:06:11.447516] subsystem.c:1819:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2: bdev Malloc0 cannot be opened, error=-1 00:19:54.752 [2024-11-26 19:06:11.447523] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:54.752 request: 00:19:54.752 { 00:19:54.752 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:19:54.752 "namespace": { 00:19:54.752 "bdev_name": "Malloc0" 00:19:54.752 }, 00:19:54.752 "method": "nvmf_subsystem_add_ns", 00:19:54.752 "req_id": 1 00:19:54.752 } 00:19:54.752 Got JSON-RPC error response 00:19:54.752 response: 00:19:54.752 { 00:19:54.752 "code": -32602, 00:19:54.752 "message": "Invalid parameters" 00:19:54.752 } 00:19:54.752 19:06:11 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:19:54.752 19:06:11 -- target/nmic.sh@29 -- # nmic_status=1 00:19:54.752 19:06:11 -- target/nmic.sh@31 -- # '[' 1 -eq 0 ']' 00:19:54.752 19:06:11 -- target/nmic.sh@36 -- # echo ' Adding namespace failed - expected result.' 00:19:54.752 Adding namespace failed - expected result. 00:19:54.752 19:06:11 -- target/nmic.sh@39 -- # echo 'test case2: host connect to nvmf target in multiple paths' 00:19:54.752 test case2: host connect to nvmf target in multiple paths 00:19:54.752 19:06:11 -- target/nmic.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:19:54.752 19:06:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:54.752 19:06:11 -- common/autotest_common.sh@10 -- # set +x 00:19:54.752 [2024-11-26 19:06:11.459626] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:19:54.752 19:06:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:54.753 19:06:11 -- target/nmic.sh@41 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:19:56.126 19:06:12 -- target/nmic.sh@42 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4421 00:19:57.060 19:06:13 -- target/nmic.sh@44 -- # waitforserial SPDKISFASTANDAWESOME 00:19:57.060 19:06:13 -- common/autotest_common.sh@1187 -- # local i=0 00:19:57.060 19:06:13 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:57.060 19:06:13 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:57.060 19:06:13 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:58.982 19:06:15 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:58.982 19:06:15 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:58.982 19:06:15 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:19:58.982 19:06:15 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:58.982 19:06:15 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:58.982 19:06:15 -- common/autotest_common.sh@1197 -- # return 0 00:19:58.982 19:06:15 -- target/nmic.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:19:58.982 [global] 00:19:58.982 thread=1 00:19:58.982 invalidate=1 00:19:58.982 rw=write 00:19:58.982 time_based=1 00:19:58.982 runtime=1 00:19:58.982 ioengine=libaio 00:19:58.982 direct=1 00:19:58.982 bs=4096 00:19:58.982 iodepth=1 00:19:58.982 norandommap=0 00:19:58.982 numjobs=1 00:19:58.982 00:19:58.982 verify_dump=1 00:19:58.982 verify_backlog=512 00:19:58.982 verify_state_save=0 00:19:58.982 do_verify=1 00:19:58.982 verify=crc32c-intel 00:19:58.982 [job0] 00:19:58.982 filename=/dev/nvme0n1 00:19:58.982 Could not set queue depth (nvme0n1) 00:19:59.241 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:59.241 fio-3.35 00:19:59.241 Starting 1 thread 00:20:00.613 00:20:00.613 job0: (groupid=0, jobs=1): err= 0: pid=3123239: Tue Nov 26 19:06:17 2024 00:20:00.613 read: IOPS=21, BW=87.2KiB/s (89.3kB/s)(88.0KiB/1009msec) 00:20:00.613 slat (nsec): min=9004, max=26855, avg=23236.95, stdev=3294.29 00:20:00.613 clat (usec): min=40859, max=42028, avg=41210.20, stdev=448.83 00:20:00.613 lat (usec): min=40881, max=42052, avg=41233.44, stdev=448.69 00:20:00.614 clat percentiles (usec): 00:20:00.614 | 1.00th=[40633], 5.00th=[40633], 10.00th=[40633], 20.00th=[41157], 00:20:00.614 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:20:00.614 | 70.00th=[41157], 80.00th=[41681], 90.00th=[42206], 95.00th=[42206], 00:20:00.614 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:20:00.614 | 99.99th=[42206] 00:20:00.614 write: IOPS=507, BW=2030KiB/s (2078kB/s)(2048KiB/1009msec); 0 zone resets 00:20:00.614 slat (usec): min=9, max=23785, avg=56.83, stdev=1050.74 00:20:00.614 clat (usec): min=108, max=229, avg=138.46, stdev=11.95 00:20:00.614 lat (usec): min=118, max=23989, avg=195.29, stdev=1053.68 00:20:00.614 clat percentiles (usec): 00:20:00.614 | 1.00th=[ 113], 5.00th=[ 115], 10.00th=[ 119], 20.00th=[ 133], 00:20:00.614 | 30.00th=[ 137], 40.00th=[ 139], 50.00th=[ 141], 60.00th=[ 143], 00:20:00.614 | 70.00th=[ 145], 80.00th=[ 145], 90.00th=[ 149], 95.00th=[ 153], 00:20:00.614 | 99.00th=[ 161], 99.50th=[ 186], 99.90th=[ 231], 99.95th=[ 231], 00:20:00.614 | 99.99th=[ 231] 00:20:00.614 bw ( KiB/s): min= 4096, max= 4096, per=100.00%, avg=4096.00, stdev= 0.00, samples=1 00:20:00.614 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:20:00.614 lat (usec) : 250=95.88% 00:20:00.614 lat (msec) : 50=4.12% 00:20:00.614 cpu : usr=0.40%, sys=0.40%, ctx=538, majf=0, minf=1 00:20:00.614 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:20:00.614 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:00.614 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:00.614 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:00.614 latency : target=0, window=0, percentile=100.00%, depth=1 00:20:00.614 00:20:00.614 Run status group 0 (all jobs): 00:20:00.614 READ: bw=87.2KiB/s (89.3kB/s), 87.2KiB/s-87.2KiB/s (89.3kB/s-89.3kB/s), io=88.0KiB (90.1kB), run=1009-1009msec 00:20:00.614 WRITE: bw=2030KiB/s (2078kB/s), 2030KiB/s-2030KiB/s (2078kB/s-2078kB/s), io=2048KiB (2097kB), run=1009-1009msec 00:20:00.614 00:20:00.614 Disk stats (read/write): 00:20:00.614 nvme0n1: ios=70/512, merge=0/0, ticks=1082/65, in_queue=1147, util=98.50% 00:20:00.614 19:06:17 -- target/nmic.sh@48 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:20:00.614 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 2 controller(s) 00:20:00.614 19:06:17 -- target/nmic.sh@49 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:20:00.614 19:06:17 -- common/autotest_common.sh@1208 -- # local i=0 00:20:00.614 19:06:17 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:00.614 19:06:17 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:20:00.614 19:06:17 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:00.614 19:06:17 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:20:00.614 19:06:17 -- common/autotest_common.sh@1220 -- # return 0 00:20:00.614 19:06:17 -- target/nmic.sh@51 -- # trap - SIGINT SIGTERM EXIT 00:20:00.614 19:06:17 -- target/nmic.sh@53 -- # nvmftestfini 00:20:00.614 19:06:17 -- nvmf/common.sh@476 -- # nvmfcleanup 00:20:00.614 19:06:17 -- nvmf/common.sh@116 -- # sync 00:20:00.614 19:06:17 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:20:00.614 19:06:17 -- nvmf/common.sh@119 -- # set +e 00:20:00.614 19:06:17 -- nvmf/common.sh@120 -- # for i in {1..20} 00:20:00.614 19:06:17 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:20:00.614 rmmod nvme_tcp 00:20:00.614 rmmod nvme_fabrics 00:20:00.614 rmmod nvme_keyring 00:20:00.614 19:06:17 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:20:00.614 19:06:17 -- nvmf/common.sh@123 -- # set -e 00:20:00.614 19:06:17 -- nvmf/common.sh@124 -- # return 0 00:20:00.614 19:06:17 -- nvmf/common.sh@477 -- # '[' -n 3122151 ']' 00:20:00.614 19:06:17 -- nvmf/common.sh@478 -- # killprocess 3122151 00:20:00.614 19:06:17 -- common/autotest_common.sh@936 -- # '[' -z 3122151 ']' 00:20:00.614 19:06:17 -- common/autotest_common.sh@940 -- # kill -0 3122151 00:20:00.614 19:06:17 -- common/autotest_common.sh@941 -- # uname 00:20:00.614 19:06:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:00.614 19:06:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3122151 00:20:00.872 19:06:17 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:20:00.872 19:06:17 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:20:00.872 19:06:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3122151' 00:20:00.872 killing process with pid 3122151 00:20:00.873 19:06:17 -- common/autotest_common.sh@955 -- # kill 3122151 00:20:00.873 19:06:17 -- common/autotest_common.sh@960 -- # wait 3122151 00:20:00.873 19:06:17 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:20:00.873 19:06:17 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:20:00.873 19:06:17 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:20:00.873 19:06:17 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:20:00.873 19:06:17 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:20:00.873 19:06:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:00.873 19:06:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:00.873 19:06:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:03.415 19:06:19 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:20:03.415 00:20:03.415 real 0m14.863s 00:20:03.415 user 0m35.623s 00:20:03.415 sys 0m4.766s 00:20:03.415 19:06:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:20:03.415 19:06:19 -- common/autotest_common.sh@10 -- # set +x 00:20:03.415 ************************************ 00:20:03.415 END TEST nvmf_nmic 00:20:03.415 ************************************ 00:20:03.415 19:06:19 -- nvmf/nvmf.sh@54 -- # run_test nvmf_fio_target /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:20:03.415 19:06:19 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:20:03.415 19:06:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:20:03.415 19:06:19 -- common/autotest_common.sh@10 -- # set +x 00:20:03.415 ************************************ 00:20:03.415 START TEST nvmf_fio_target 00:20:03.415 ************************************ 00:20:03.415 19:06:19 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:20:03.415 * Looking for test storage... 00:20:03.415 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:20:03.415 19:06:19 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:20:03.415 19:06:19 -- common/autotest_common.sh@1690 -- # lcov --version 00:20:03.415 19:06:19 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:20:03.415 19:06:19 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:20:03.415 19:06:19 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:20:03.415 19:06:19 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:20:03.415 19:06:19 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:20:03.415 19:06:19 -- scripts/common.sh@335 -- # IFS=.-: 00:20:03.415 19:06:19 -- scripts/common.sh@335 -- # read -ra ver1 00:20:03.415 19:06:19 -- scripts/common.sh@336 -- # IFS=.-: 00:20:03.415 19:06:19 -- scripts/common.sh@336 -- # read -ra ver2 00:20:03.415 19:06:19 -- scripts/common.sh@337 -- # local 'op=<' 00:20:03.415 19:06:19 -- scripts/common.sh@339 -- # ver1_l=2 00:20:03.415 19:06:19 -- scripts/common.sh@340 -- # ver2_l=1 00:20:03.415 19:06:19 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:20:03.415 19:06:19 -- scripts/common.sh@343 -- # case "$op" in 00:20:03.415 19:06:19 -- scripts/common.sh@344 -- # : 1 00:20:03.415 19:06:19 -- scripts/common.sh@363 -- # (( v = 0 )) 00:20:03.415 19:06:19 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:20:03.415 19:06:19 -- scripts/common.sh@364 -- # decimal 1 00:20:03.415 19:06:19 -- scripts/common.sh@352 -- # local d=1 00:20:03.415 19:06:19 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:20:03.415 19:06:19 -- scripts/common.sh@354 -- # echo 1 00:20:03.415 19:06:19 -- scripts/common.sh@364 -- # ver1[v]=1 00:20:03.415 19:06:19 -- scripts/common.sh@365 -- # decimal 2 00:20:03.415 19:06:19 -- scripts/common.sh@352 -- # local d=2 00:20:03.415 19:06:19 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:20:03.415 19:06:19 -- scripts/common.sh@354 -- # echo 2 00:20:03.415 19:06:19 -- scripts/common.sh@365 -- # ver2[v]=2 00:20:03.415 19:06:19 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:20:03.415 19:06:19 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:20:03.415 19:06:19 -- scripts/common.sh@367 -- # return 0 00:20:03.415 19:06:19 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:20:03.415 19:06:19 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:20:03.415 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:03.415 --rc genhtml_branch_coverage=1 00:20:03.415 --rc genhtml_function_coverage=1 00:20:03.415 --rc genhtml_legend=1 00:20:03.415 --rc geninfo_all_blocks=1 00:20:03.415 --rc geninfo_unexecuted_blocks=1 00:20:03.415 00:20:03.415 ' 00:20:03.415 19:06:19 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:20:03.415 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:03.415 --rc genhtml_branch_coverage=1 00:20:03.415 --rc genhtml_function_coverage=1 00:20:03.415 --rc genhtml_legend=1 00:20:03.415 --rc geninfo_all_blocks=1 00:20:03.415 --rc geninfo_unexecuted_blocks=1 00:20:03.415 00:20:03.415 ' 00:20:03.415 19:06:19 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:20:03.415 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:03.415 --rc genhtml_branch_coverage=1 00:20:03.415 --rc genhtml_function_coverage=1 00:20:03.415 --rc genhtml_legend=1 00:20:03.415 --rc geninfo_all_blocks=1 00:20:03.415 --rc geninfo_unexecuted_blocks=1 00:20:03.415 00:20:03.415 ' 00:20:03.415 19:06:19 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:20:03.415 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:03.415 --rc genhtml_branch_coverage=1 00:20:03.415 --rc genhtml_function_coverage=1 00:20:03.415 --rc genhtml_legend=1 00:20:03.415 --rc geninfo_all_blocks=1 00:20:03.415 --rc geninfo_unexecuted_blocks=1 00:20:03.415 00:20:03.416 ' 00:20:03.416 19:06:19 -- target/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:20:03.416 19:06:19 -- nvmf/common.sh@7 -- # uname -s 00:20:03.416 19:06:19 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:03.416 19:06:19 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:03.416 19:06:19 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:03.416 19:06:19 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:03.416 19:06:19 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:03.416 19:06:19 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:03.416 19:06:19 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:03.416 19:06:19 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:03.416 19:06:19 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:03.416 19:06:20 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:03.416 19:06:20 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:20:03.416 19:06:20 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:20:03.416 19:06:20 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:03.416 19:06:20 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:03.416 19:06:20 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:03.416 19:06:20 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:20:03.416 19:06:20 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:03.416 19:06:20 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:03.416 19:06:20 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:03.416 19:06:20 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:03.416 19:06:20 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:03.416 19:06:20 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:03.416 19:06:20 -- paths/export.sh@5 -- # export PATH 00:20:03.416 19:06:20 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:03.416 19:06:20 -- nvmf/common.sh@46 -- # : 0 00:20:03.416 19:06:20 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:20:03.416 19:06:20 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:20:03.416 19:06:20 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:20:03.416 19:06:20 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:03.416 19:06:20 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:03.416 19:06:20 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:20:03.416 19:06:20 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:20:03.416 19:06:20 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:20:03.416 19:06:20 -- target/fio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:20:03.416 19:06:20 -- target/fio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:20:03.416 19:06:20 -- target/fio.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:20:03.416 19:06:20 -- target/fio.sh@16 -- # nvmftestinit 00:20:03.416 19:06:20 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:20:03.416 19:06:20 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:03.416 19:06:20 -- nvmf/common.sh@436 -- # prepare_net_devs 00:20:03.416 19:06:20 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:20:03.416 19:06:20 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:20:03.416 19:06:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:03.416 19:06:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:03.416 19:06:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:03.416 19:06:20 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:20:03.416 19:06:20 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:20:03.416 19:06:20 -- nvmf/common.sh@284 -- # xtrace_disable 00:20:03.416 19:06:20 -- common/autotest_common.sh@10 -- # set +x 00:20:08.832 19:06:25 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:08.832 19:06:25 -- nvmf/common.sh@290 -- # pci_devs=() 00:20:08.832 19:06:25 -- nvmf/common.sh@290 -- # local -a pci_devs 00:20:08.832 19:06:25 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:20:08.832 19:06:25 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:20:08.832 19:06:25 -- nvmf/common.sh@292 -- # pci_drivers=() 00:20:08.832 19:06:25 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:20:08.832 19:06:25 -- nvmf/common.sh@294 -- # net_devs=() 00:20:08.832 19:06:25 -- nvmf/common.sh@294 -- # local -ga net_devs 00:20:08.832 19:06:25 -- nvmf/common.sh@295 -- # e810=() 00:20:08.832 19:06:25 -- nvmf/common.sh@295 -- # local -ga e810 00:20:08.832 19:06:25 -- nvmf/common.sh@296 -- # x722=() 00:20:08.832 19:06:25 -- nvmf/common.sh@296 -- # local -ga x722 00:20:08.832 19:06:25 -- nvmf/common.sh@297 -- # mlx=() 00:20:08.832 19:06:25 -- nvmf/common.sh@297 -- # local -ga mlx 00:20:08.832 19:06:25 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:08.832 19:06:25 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:08.832 19:06:25 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:08.832 19:06:25 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:08.832 19:06:25 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:08.832 19:06:25 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:08.832 19:06:25 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:08.832 19:06:25 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:08.832 19:06:25 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:08.832 19:06:25 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:08.832 19:06:25 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:08.832 19:06:25 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:20:08.832 19:06:25 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:20:08.832 19:06:25 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:20:08.832 19:06:25 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:20:08.832 19:06:25 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:20:08.832 19:06:25 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:20:08.832 19:06:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:08.832 19:06:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:20:08.832 Found 0000:86:00.0 (0x8086 - 0x159b) 00:20:08.832 19:06:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:08.832 19:06:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:08.832 19:06:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:08.832 19:06:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:08.832 19:06:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:08.832 19:06:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:08.832 19:06:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:20:08.832 Found 0000:86:00.1 (0x8086 - 0x159b) 00:20:08.832 19:06:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:08.832 19:06:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:08.832 19:06:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:08.832 19:06:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:08.832 19:06:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:08.832 19:06:25 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:20:08.832 19:06:25 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:20:08.832 19:06:25 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:20:08.832 19:06:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:08.832 19:06:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:08.832 19:06:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:08.832 19:06:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:08.832 19:06:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:20:08.832 Found net devices under 0000:86:00.0: cvl_0_0 00:20:08.832 19:06:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:08.832 19:06:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:08.832 19:06:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:08.833 19:06:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:08.833 19:06:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:08.833 19:06:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:20:08.833 Found net devices under 0000:86:00.1: cvl_0_1 00:20:08.833 19:06:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:08.833 19:06:25 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:20:08.833 19:06:25 -- nvmf/common.sh@402 -- # is_hw=yes 00:20:08.833 19:06:25 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:20:08.833 19:06:25 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:20:08.833 19:06:25 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:20:08.833 19:06:25 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:20:08.833 19:06:25 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:20:08.833 19:06:25 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:20:08.833 19:06:25 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:20:08.833 19:06:25 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:20:08.833 19:06:25 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:20:08.833 19:06:25 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:20:08.833 19:06:25 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:20:08.833 19:06:25 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:20:08.833 19:06:25 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:20:08.833 19:06:25 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:20:08.833 19:06:25 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:20:08.833 19:06:25 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:20:08.833 19:06:25 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:20:08.833 19:06:25 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:20:08.833 19:06:25 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:20:08.833 19:06:25 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:20:08.833 19:06:25 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:20:08.833 19:06:25 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:20:08.833 19:06:25 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:20:08.833 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:20:08.833 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.286 ms 00:20:08.833 00:20:08.833 --- 10.0.0.2 ping statistics --- 00:20:08.833 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:08.833 rtt min/avg/max/mdev = 0.286/0.286/0.286/0.000 ms 00:20:08.833 19:06:25 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:20:08.833 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:20:08.833 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.227 ms 00:20:08.833 00:20:08.833 --- 10.0.0.1 ping statistics --- 00:20:08.833 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:08.833 rtt min/avg/max/mdev = 0.227/0.227/0.227/0.000 ms 00:20:08.833 19:06:25 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:20:08.833 19:06:25 -- nvmf/common.sh@410 -- # return 0 00:20:08.833 19:06:25 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:20:08.833 19:06:25 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:20:08.833 19:06:25 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:20:08.833 19:06:25 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:20:08.833 19:06:25 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:20:08.833 19:06:25 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:20:08.833 19:06:25 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:20:08.833 19:06:25 -- target/fio.sh@17 -- # nvmfappstart -m 0xF 00:20:08.833 19:06:25 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:08.833 19:06:25 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:08.833 19:06:25 -- common/autotest_common.sh@10 -- # set +x 00:20:08.833 19:06:25 -- nvmf/common.sh@469 -- # nvmfpid=3126898 00:20:08.833 19:06:25 -- nvmf/common.sh@470 -- # waitforlisten 3126898 00:20:08.833 19:06:25 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:20:08.833 19:06:25 -- common/autotest_common.sh@829 -- # '[' -z 3126898 ']' 00:20:08.833 19:06:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:08.833 19:06:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:08.833 19:06:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:08.833 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:08.833 19:06:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:08.833 19:06:25 -- common/autotest_common.sh@10 -- # set +x 00:20:08.833 [2024-11-26 19:06:25.594718] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:08.833 [2024-11-26 19:06:25.594769] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:08.833 EAL: No free 2048 kB hugepages reported on node 1 00:20:08.833 [2024-11-26 19:06:25.656710] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:20:08.833 [2024-11-26 19:06:25.698900] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:08.833 [2024-11-26 19:06:25.699026] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:08.833 [2024-11-26 19:06:25.699036] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:08.833 [2024-11-26 19:06:25.699042] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:08.833 [2024-11-26 19:06:25.699086] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:08.833 [2024-11-26 19:06:25.699182] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:08.833 [2024-11-26 19:06:25.699250] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:20:08.833 [2024-11-26 19:06:25.699251] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:20:09.774 19:06:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:09.774 19:06:26 -- common/autotest_common.sh@862 -- # return 0 00:20:09.774 19:06:26 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:09.774 19:06:26 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:09.774 19:06:26 -- common/autotest_common.sh@10 -- # set +x 00:20:09.774 19:06:26 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:09.774 19:06:26 -- target/fio.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:20:09.774 [2024-11-26 19:06:26.633038] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:09.774 19:06:26 -- target/fio.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:20:10.031 19:06:26 -- target/fio.sh@21 -- # malloc_bdevs='Malloc0 ' 00:20:10.031 19:06:26 -- target/fio.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:20:10.289 19:06:27 -- target/fio.sh@22 -- # malloc_bdevs+=Malloc1 00:20:10.289 19:06:27 -- target/fio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:20:10.547 19:06:27 -- target/fio.sh@24 -- # raid_malloc_bdevs='Malloc2 ' 00:20:10.547 19:06:27 -- target/fio.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:20:10.805 19:06:27 -- target/fio.sh@25 -- # raid_malloc_bdevs+=Malloc3 00:20:10.805 19:06:27 -- target/fio.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc2 Malloc3' 00:20:10.805 19:06:27 -- target/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:20:11.062 19:06:27 -- target/fio.sh@29 -- # concat_malloc_bdevs='Malloc4 ' 00:20:11.062 19:06:27 -- target/fio.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:20:11.319 19:06:28 -- target/fio.sh@30 -- # concat_malloc_bdevs+='Malloc5 ' 00:20:11.320 19:06:28 -- target/fio.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:20:11.577 19:06:28 -- target/fio.sh@31 -- # concat_malloc_bdevs+=Malloc6 00:20:11.577 19:06:28 -- target/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n concat0 -r concat -z 64 -b 'Malloc4 Malloc5 Malloc6' 00:20:11.577 19:06:28 -- target/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:20:11.834 19:06:28 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:20:11.834 19:06:28 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:20:12.092 19:06:28 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:20:12.092 19:06:28 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:20:12.349 19:06:29 -- target/fio.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:20:12.349 [2024-11-26 19:06:29.195309] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:12.349 19:06:29 -- target/fio.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 raid0 00:20:12.606 19:06:29 -- target/fio.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 concat0 00:20:12.863 19:06:29 -- target/fio.sh@46 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:20:13.796 19:06:30 -- target/fio.sh@48 -- # waitforserial SPDKISFASTANDAWESOME 4 00:20:13.796 19:06:30 -- common/autotest_common.sh@1187 -- # local i=0 00:20:13.796 19:06:30 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:20:13.796 19:06:30 -- common/autotest_common.sh@1189 -- # [[ -n 4 ]] 00:20:13.796 19:06:30 -- common/autotest_common.sh@1190 -- # nvme_device_counter=4 00:20:13.796 19:06:30 -- common/autotest_common.sh@1194 -- # sleep 2 00:20:16.324 19:06:32 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:20:16.324 19:06:32 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:20:16.324 19:06:32 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:20:16.324 19:06:32 -- common/autotest_common.sh@1196 -- # nvme_devices=4 00:20:16.324 19:06:32 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:20:16.324 19:06:32 -- common/autotest_common.sh@1197 -- # return 0 00:20:16.324 19:06:32 -- target/fio.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:20:16.324 [global] 00:20:16.324 thread=1 00:20:16.324 invalidate=1 00:20:16.324 rw=write 00:20:16.324 time_based=1 00:20:16.324 runtime=1 00:20:16.324 ioengine=libaio 00:20:16.324 direct=1 00:20:16.324 bs=4096 00:20:16.324 iodepth=1 00:20:16.324 norandommap=0 00:20:16.324 numjobs=1 00:20:16.324 00:20:16.324 verify_dump=1 00:20:16.324 verify_backlog=512 00:20:16.324 verify_state_save=0 00:20:16.324 do_verify=1 00:20:16.324 verify=crc32c-intel 00:20:16.324 [job0] 00:20:16.324 filename=/dev/nvme0n1 00:20:16.324 [job1] 00:20:16.324 filename=/dev/nvme0n2 00:20:16.324 [job2] 00:20:16.324 filename=/dev/nvme0n3 00:20:16.324 [job3] 00:20:16.324 filename=/dev/nvme0n4 00:20:16.324 Could not set queue depth (nvme0n1) 00:20:16.324 Could not set queue depth (nvme0n2) 00:20:16.324 Could not set queue depth (nvme0n3) 00:20:16.324 Could not set queue depth (nvme0n4) 00:20:16.324 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:20:16.324 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:20:16.324 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:20:16.324 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:20:16.324 fio-3.35 00:20:16.324 Starting 4 threads 00:20:17.693 00:20:17.693 job0: (groupid=0, jobs=1): err= 0: pid=3128397: Tue Nov 26 19:06:34 2024 00:20:17.693 read: IOPS=1960, BW=7840KiB/s (8028kB/s)(7848KiB/1001msec) 00:20:17.693 slat (nsec): min=6576, max=23817, avg=7477.04, stdev=702.69 00:20:17.693 clat (usec): min=202, max=41522, avg=305.09, stdev=932.50 00:20:17.693 lat (usec): min=208, max=41529, avg=312.56, stdev=932.50 00:20:17.693 clat percentiles (usec): 00:20:17.693 | 1.00th=[ 219], 5.00th=[ 233], 10.00th=[ 239], 20.00th=[ 247], 00:20:17.693 | 30.00th=[ 253], 40.00th=[ 262], 50.00th=[ 269], 60.00th=[ 277], 00:20:17.693 | 70.00th=[ 289], 80.00th=[ 314], 90.00th=[ 343], 95.00th=[ 396], 00:20:17.693 | 99.00th=[ 498], 99.50th=[ 510], 99.90th=[ 553], 99.95th=[41681], 00:20:17.693 | 99.99th=[41681] 00:20:17.693 write: IOPS=2045, BW=8184KiB/s (8380kB/s)(8192KiB/1001msec); 0 zone resets 00:20:17.693 slat (usec): min=9, max=41594, avg=30.95, stdev=918.88 00:20:17.693 clat (usec): min=112, max=450, avg=153.56, stdev=25.04 00:20:17.693 lat (usec): min=122, max=41885, avg=184.52, stdev=922.27 00:20:17.693 clat percentiles (usec): 00:20:17.693 | 1.00th=[ 119], 5.00th=[ 125], 10.00th=[ 130], 20.00th=[ 137], 00:20:17.693 | 30.00th=[ 141], 40.00th=[ 145], 50.00th=[ 149], 60.00th=[ 153], 00:20:17.693 | 70.00th=[ 159], 80.00th=[ 165], 90.00th=[ 184], 95.00th=[ 206], 00:20:17.693 | 99.00th=[ 241], 99.50th=[ 243], 99.90th=[ 293], 99.95th=[ 343], 00:20:17.693 | 99.99th=[ 449] 00:20:17.693 bw ( KiB/s): min= 8192, max= 8192, per=28.48%, avg=8192.00, stdev= 0.00, samples=1 00:20:17.693 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:20:17.693 lat (usec) : 250=62.97%, 500=36.63%, 750=0.37% 00:20:17.693 lat (msec) : 50=0.02% 00:20:17.693 cpu : usr=2.50%, sys=3.30%, ctx=4014, majf=0, minf=1 00:20:17.693 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:20:17.693 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:17.693 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:17.693 issued rwts: total=1962,2048,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:17.693 latency : target=0, window=0, percentile=100.00%, depth=1 00:20:17.693 job1: (groupid=0, jobs=1): err= 0: pid=3128398: Tue Nov 26 19:06:34 2024 00:20:17.693 read: IOPS=2045, BW=8184KiB/s (8380kB/s)(8192KiB/1001msec) 00:20:17.693 slat (nsec): min=7514, max=24958, avg=8595.61, stdev=1069.29 00:20:17.693 clat (usec): min=183, max=557, avg=272.64, stdev=43.13 00:20:17.693 lat (usec): min=192, max=565, avg=281.24, stdev=43.12 00:20:17.694 clat percentiles (usec): 00:20:17.694 | 1.00th=[ 204], 5.00th=[ 221], 10.00th=[ 231], 20.00th=[ 241], 00:20:17.694 | 30.00th=[ 247], 40.00th=[ 255], 50.00th=[ 265], 60.00th=[ 277], 00:20:17.694 | 70.00th=[ 289], 80.00th=[ 302], 90.00th=[ 318], 95.00th=[ 338], 00:20:17.694 | 99.00th=[ 453], 99.50th=[ 506], 99.90th=[ 545], 99.95th=[ 553], 00:20:17.694 | 99.99th=[ 562] 00:20:17.694 write: IOPS=2266, BW=9067KiB/s (9285kB/s)(9076KiB/1001msec); 0 zone resets 00:20:17.694 slat (nsec): min=10402, max=39400, avg=12047.69, stdev=1298.58 00:20:17.694 clat (usec): min=129, max=379, avg=169.54, stdev=28.81 00:20:17.694 lat (usec): min=141, max=419, avg=181.59, stdev=29.01 00:20:17.694 clat percentiles (usec): 00:20:17.694 | 1.00th=[ 135], 5.00th=[ 141], 10.00th=[ 145], 20.00th=[ 149], 00:20:17.694 | 30.00th=[ 153], 40.00th=[ 157], 50.00th=[ 159], 60.00th=[ 165], 00:20:17.694 | 70.00th=[ 174], 80.00th=[ 188], 90.00th=[ 219], 95.00th=[ 233], 00:20:17.694 | 99.00th=[ 251], 99.50th=[ 258], 99.90th=[ 310], 99.95th=[ 334], 00:20:17.694 | 99.99th=[ 379] 00:20:17.694 bw ( KiB/s): min= 8880, max= 8880, per=30.87%, avg=8880.00, stdev= 0.00, samples=1 00:20:17.694 iops : min= 2220, max= 2220, avg=2220.00, stdev= 0.00, samples=1 00:20:17.694 lat (usec) : 250=67.85%, 500=31.90%, 750=0.25% 00:20:17.694 cpu : usr=3.20%, sys=4.10%, ctx=4317, majf=0, minf=1 00:20:17.694 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:20:17.694 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:17.694 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:17.694 issued rwts: total=2048,2269,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:17.694 latency : target=0, window=0, percentile=100.00%, depth=1 00:20:17.694 job2: (groupid=0, jobs=1): err= 0: pid=3128399: Tue Nov 26 19:06:34 2024 00:20:17.694 read: IOPS=21, BW=87.0KiB/s (89.0kB/s)(88.0KiB/1012msec) 00:20:17.694 slat (nsec): min=9804, max=32159, avg=19647.50, stdev=7072.02 00:20:17.694 clat (usec): min=40774, max=41956, avg=41008.11, stdev=229.18 00:20:17.694 lat (usec): min=40801, max=41978, avg=41027.75, stdev=229.86 00:20:17.694 clat percentiles (usec): 00:20:17.694 | 1.00th=[40633], 5.00th=[40633], 10.00th=[40633], 20.00th=[41157], 00:20:17.694 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:20:17.694 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:20:17.694 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:20:17.694 | 99.99th=[42206] 00:20:17.694 write: IOPS=505, BW=2024KiB/s (2072kB/s)(2048KiB/1012msec); 0 zone resets 00:20:17.694 slat (nsec): min=10629, max=37723, avg=12226.73, stdev=2496.91 00:20:17.694 clat (usec): min=139, max=368, avg=197.49, stdev=29.93 00:20:17.694 lat (usec): min=151, max=406, avg=209.72, stdev=30.59 00:20:17.694 clat percentiles (usec): 00:20:17.694 | 1.00th=[ 147], 5.00th=[ 159], 10.00th=[ 161], 20.00th=[ 169], 00:20:17.694 | 30.00th=[ 176], 40.00th=[ 186], 50.00th=[ 198], 60.00th=[ 208], 00:20:17.694 | 70.00th=[ 217], 80.00th=[ 223], 90.00th=[ 237], 95.00th=[ 241], 00:20:17.694 | 99.00th=[ 269], 99.50th=[ 306], 99.90th=[ 367], 99.95th=[ 367], 00:20:17.694 | 99.99th=[ 367] 00:20:17.694 bw ( KiB/s): min= 4096, max= 4096, per=14.24%, avg=4096.00, stdev= 0.00, samples=1 00:20:17.694 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:20:17.694 lat (usec) : 250=93.07%, 500=2.81% 00:20:17.694 lat (msec) : 50=4.12% 00:20:17.694 cpu : usr=0.20%, sys=1.19%, ctx=534, majf=0, minf=1 00:20:17.694 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:20:17.694 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:17.694 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:17.694 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:17.694 latency : target=0, window=0, percentile=100.00%, depth=1 00:20:17.694 job3: (groupid=0, jobs=1): err= 0: pid=3128400: Tue Nov 26 19:06:34 2024 00:20:17.694 read: IOPS=2045, BW=8184KiB/s (8380kB/s)(8192KiB/1001msec) 00:20:17.694 slat (nsec): min=7876, max=29272, avg=8719.34, stdev=1108.57 00:20:17.694 clat (usec): min=202, max=564, avg=244.16, stdev=23.23 00:20:17.694 lat (usec): min=211, max=573, avg=252.88, stdev=23.24 00:20:17.694 clat percentiles (usec): 00:20:17.694 | 1.00th=[ 210], 5.00th=[ 221], 10.00th=[ 225], 20.00th=[ 231], 00:20:17.694 | 30.00th=[ 237], 40.00th=[ 239], 50.00th=[ 243], 60.00th=[ 247], 00:20:17.694 | 70.00th=[ 249], 80.00th=[ 253], 90.00th=[ 262], 95.00th=[ 269], 00:20:17.694 | 99.00th=[ 310], 99.50th=[ 420], 99.90th=[ 482], 99.95th=[ 482], 00:20:17.694 | 99.99th=[ 562] 00:20:17.694 write: IOPS=2445, BW=9782KiB/s (10.0MB/s)(9792KiB/1001msec); 0 zone resets 00:20:17.694 slat (nsec): min=10987, max=82530, avg=12394.36, stdev=2011.69 00:20:17.694 clat (usec): min=109, max=339, avg=179.32, stdev=20.02 00:20:17.694 lat (usec): min=150, max=375, avg=191.72, stdev=20.11 00:20:17.694 clat percentiles (usec): 00:20:17.694 | 1.00th=[ 149], 5.00th=[ 155], 10.00th=[ 159], 20.00th=[ 165], 00:20:17.694 | 30.00th=[ 169], 40.00th=[ 172], 50.00th=[ 176], 60.00th=[ 180], 00:20:17.694 | 70.00th=[ 186], 80.00th=[ 192], 90.00th=[ 206], 95.00th=[ 221], 00:20:17.694 | 99.00th=[ 243], 99.50th=[ 260], 99.90th=[ 293], 99.95th=[ 318], 00:20:17.694 | 99.99th=[ 338] 00:20:17.694 bw ( KiB/s): min= 9768, max= 9768, per=33.96%, avg=9768.00, stdev= 0.00, samples=1 00:20:17.694 iops : min= 2442, max= 2442, avg=2442.00, stdev= 0.00, samples=1 00:20:17.694 lat (usec) : 250=86.32%, 500=13.66%, 750=0.02% 00:20:17.694 cpu : usr=3.20%, sys=4.40%, ctx=4497, majf=0, minf=1 00:20:17.694 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:20:17.694 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:17.694 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:17.694 issued rwts: total=2048,2448,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:17.694 latency : target=0, window=0, percentile=100.00%, depth=1 00:20:17.694 00:20:17.694 Run status group 0 (all jobs): 00:20:17.694 READ: bw=23.5MiB/s (24.6MB/s), 87.0KiB/s-8184KiB/s (89.0kB/s-8380kB/s), io=23.8MiB (24.9MB), run=1001-1012msec 00:20:17.694 WRITE: bw=28.1MiB/s (29.5MB/s), 2024KiB/s-9782KiB/s (2072kB/s-10.0MB/s), io=28.4MiB (29.8MB), run=1001-1012msec 00:20:17.694 00:20:17.694 Disk stats (read/write): 00:20:17.694 nvme0n1: ios=1588/1840, merge=0/0, ticks=775/280, in_queue=1055, util=98.00% 00:20:17.694 nvme0n2: ios=1675/2048, merge=0/0, ticks=464/340, in_queue=804, util=87.09% 00:20:17.694 nvme0n3: ios=18/512, merge=0/0, ticks=738/93, in_queue=831, util=89.04% 00:20:17.694 nvme0n4: ios=1774/2048, merge=0/0, ticks=418/360, in_queue=778, util=89.70% 00:20:17.694 19:06:34 -- target/fio.sh@51 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t randwrite -r 1 -v 00:20:17.694 [global] 00:20:17.694 thread=1 00:20:17.694 invalidate=1 00:20:17.694 rw=randwrite 00:20:17.694 time_based=1 00:20:17.694 runtime=1 00:20:17.694 ioengine=libaio 00:20:17.694 direct=1 00:20:17.694 bs=4096 00:20:17.694 iodepth=1 00:20:17.694 norandommap=0 00:20:17.694 numjobs=1 00:20:17.694 00:20:17.694 verify_dump=1 00:20:17.694 verify_backlog=512 00:20:17.694 verify_state_save=0 00:20:17.694 do_verify=1 00:20:17.694 verify=crc32c-intel 00:20:17.694 [job0] 00:20:17.694 filename=/dev/nvme0n1 00:20:17.694 [job1] 00:20:17.694 filename=/dev/nvme0n2 00:20:17.694 [job2] 00:20:17.694 filename=/dev/nvme0n3 00:20:17.694 [job3] 00:20:17.694 filename=/dev/nvme0n4 00:20:17.694 Could not set queue depth (nvme0n1) 00:20:17.694 Could not set queue depth (nvme0n2) 00:20:17.694 Could not set queue depth (nvme0n3) 00:20:17.694 Could not set queue depth (nvme0n4) 00:20:17.951 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:20:17.951 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:20:17.951 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:20:17.951 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:20:17.951 fio-3.35 00:20:17.951 Starting 4 threads 00:20:19.324 00:20:19.324 job0: (groupid=0, jobs=1): err= 0: pid=3128776: Tue Nov 26 19:06:35 2024 00:20:19.324 read: IOPS=21, BW=87.0KiB/s (89.1kB/s)(88.0KiB/1011msec) 00:20:19.324 slat (nsec): min=11945, max=24426, avg=22520.59, stdev=2560.97 00:20:19.324 clat (usec): min=40847, max=41261, avg=40981.28, stdev=80.37 00:20:19.324 lat (usec): min=40871, max=41273, avg=41003.80, stdev=78.22 00:20:19.324 clat percentiles (usec): 00:20:19.324 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:20:19.324 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:20:19.324 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:20:19.324 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:20:19.324 | 99.99th=[41157] 00:20:19.324 write: IOPS=506, BW=2026KiB/s (2074kB/s)(2048KiB/1011msec); 0 zone resets 00:20:19.324 slat (nsec): min=11191, max=40220, avg=12598.60, stdev=2254.75 00:20:19.324 clat (usec): min=133, max=321, avg=196.85, stdev=23.96 00:20:19.324 lat (usec): min=147, max=361, avg=209.44, stdev=24.42 00:20:19.324 clat percentiles (usec): 00:20:19.324 | 1.00th=[ 147], 5.00th=[ 159], 10.00th=[ 169], 20.00th=[ 180], 00:20:19.324 | 30.00th=[ 184], 40.00th=[ 190], 50.00th=[ 196], 60.00th=[ 204], 00:20:19.324 | 70.00th=[ 208], 80.00th=[ 217], 90.00th=[ 227], 95.00th=[ 237], 00:20:19.324 | 99.00th=[ 265], 99.50th=[ 281], 99.90th=[ 322], 99.95th=[ 322], 00:20:19.324 | 99.99th=[ 322] 00:20:19.324 bw ( KiB/s): min= 4096, max= 4096, per=18.58%, avg=4096.00, stdev= 0.00, samples=1 00:20:19.324 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:20:19.324 lat (usec) : 250=94.19%, 500=1.69% 00:20:19.325 lat (msec) : 50=4.12% 00:20:19.325 cpu : usr=0.50%, sys=0.89%, ctx=534, majf=0, minf=1 00:20:19.325 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:20:19.325 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:19.325 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:19.325 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:19.325 latency : target=0, window=0, percentile=100.00%, depth=1 00:20:19.325 job1: (groupid=0, jobs=1): err= 0: pid=3128778: Tue Nov 26 19:06:35 2024 00:20:19.325 read: IOPS=2370, BW=9483KiB/s (9710kB/s)(9492KiB/1001msec) 00:20:19.325 slat (nsec): min=7205, max=36836, avg=8389.47, stdev=1436.68 00:20:19.325 clat (usec): min=164, max=963, avg=214.25, stdev=36.27 00:20:19.325 lat (usec): min=173, max=979, avg=222.64, stdev=36.39 00:20:19.325 clat percentiles (usec): 00:20:19.325 | 1.00th=[ 176], 5.00th=[ 182], 10.00th=[ 186], 20.00th=[ 192], 00:20:19.325 | 30.00th=[ 196], 40.00th=[ 200], 50.00th=[ 204], 60.00th=[ 210], 00:20:19.325 | 70.00th=[ 217], 80.00th=[ 247], 90.00th=[ 258], 95.00th=[ 265], 00:20:19.325 | 99.00th=[ 281], 99.50th=[ 343], 99.90th=[ 594], 99.95th=[ 799], 00:20:19.325 | 99.99th=[ 963] 00:20:19.325 write: IOPS=2557, BW=9.99MiB/s (10.5MB/s)(10.0MiB/1001msec); 0 zone resets 00:20:19.325 slat (nsec): min=10537, max=45567, avg=12120.85, stdev=2007.55 00:20:19.325 clat (usec): min=119, max=338, avg=164.93, stdev=34.39 00:20:19.325 lat (usec): min=130, max=351, avg=177.05, stdev=34.72 00:20:19.325 clat percentiles (usec): 00:20:19.325 | 1.00th=[ 127], 5.00th=[ 131], 10.00th=[ 135], 20.00th=[ 139], 00:20:19.325 | 30.00th=[ 143], 40.00th=[ 147], 50.00th=[ 155], 60.00th=[ 163], 00:20:19.325 | 70.00th=[ 176], 80.00th=[ 188], 90.00th=[ 212], 95.00th=[ 249], 00:20:19.325 | 99.00th=[ 260], 99.50th=[ 265], 99.90th=[ 306], 99.95th=[ 318], 00:20:19.325 | 99.99th=[ 338] 00:20:19.325 bw ( KiB/s): min=10496, max=10496, per=47.62%, avg=10496.00, stdev= 0.00, samples=1 00:20:19.325 iops : min= 2624, max= 2624, avg=2624.00, stdev= 0.00, samples=1 00:20:19.325 lat (usec) : 250=89.13%, 500=10.78%, 750=0.04%, 1000=0.04% 00:20:19.325 cpu : usr=3.60%, sys=8.40%, ctx=4935, majf=0, minf=1 00:20:19.325 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:20:19.325 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:19.325 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:19.325 issued rwts: total=2373,2560,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:19.325 latency : target=0, window=0, percentile=100.00%, depth=1 00:20:19.325 job2: (groupid=0, jobs=1): err= 0: pid=3128780: Tue Nov 26 19:06:35 2024 00:20:19.325 read: IOPS=1728, BW=6913KiB/s (7079kB/s)(6920KiB/1001msec) 00:20:19.325 slat (nsec): min=6937, max=26201, avg=7806.72, stdev=1262.09 00:20:19.325 clat (usec): min=181, max=41954, avg=359.92, stdev=2412.53 00:20:19.325 lat (usec): min=188, max=41978, avg=367.73, stdev=2413.33 00:20:19.325 clat percentiles (usec): 00:20:19.325 | 1.00th=[ 190], 5.00th=[ 194], 10.00th=[ 200], 20.00th=[ 204], 00:20:19.325 | 30.00th=[ 208], 40.00th=[ 210], 50.00th=[ 215], 60.00th=[ 219], 00:20:19.325 | 70.00th=[ 225], 80.00th=[ 231], 90.00th=[ 241], 95.00th=[ 251], 00:20:19.325 | 99.00th=[ 265], 99.50th=[ 351], 99.90th=[41681], 99.95th=[42206], 00:20:19.325 | 99.99th=[42206] 00:20:19.325 write: IOPS=2045, BW=8184KiB/s (8380kB/s)(8192KiB/1001msec); 0 zone resets 00:20:19.325 slat (nsec): min=9593, max=44380, avg=10790.14, stdev=1401.28 00:20:19.325 clat (usec): min=129, max=323, avg=161.38, stdev=13.98 00:20:19.325 lat (usec): min=139, max=367, avg=172.17, stdev=14.27 00:20:19.325 clat percentiles (usec): 00:20:19.325 | 1.00th=[ 137], 5.00th=[ 143], 10.00th=[ 147], 20.00th=[ 151], 00:20:19.325 | 30.00th=[ 153], 40.00th=[ 157], 50.00th=[ 161], 60.00th=[ 163], 00:20:19.325 | 70.00th=[ 167], 80.00th=[ 172], 90.00th=[ 180], 95.00th=[ 186], 00:20:19.325 | 99.00th=[ 196], 99.50th=[ 210], 99.90th=[ 239], 99.95th=[ 277], 00:20:19.325 | 99.99th=[ 322] 00:20:19.325 bw ( KiB/s): min= 5952, max= 5952, per=27.00%, avg=5952.00, stdev= 0.00, samples=1 00:20:19.325 iops : min= 1488, max= 1488, avg=1488.00, stdev= 0.00, samples=1 00:20:19.325 lat (usec) : 250=97.38%, 500=2.44%, 750=0.03% 00:20:19.325 lat (msec) : 50=0.16% 00:20:19.325 cpu : usr=2.10%, sys=3.40%, ctx=3780, majf=0, minf=1 00:20:19.325 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:20:19.325 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:19.325 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:19.325 issued rwts: total=1730,2048,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:19.325 latency : target=0, window=0, percentile=100.00%, depth=1 00:20:19.325 job3: (groupid=0, jobs=1): err= 0: pid=3128781: Tue Nov 26 19:06:35 2024 00:20:19.325 read: IOPS=22, BW=90.0KiB/s (92.2kB/s)(92.0KiB/1022msec) 00:20:19.325 slat (nsec): min=9231, max=25338, avg=19714.17, stdev=5852.85 00:20:19.325 clat (usec): min=402, max=42056, avg=39482.09, stdev=8532.65 00:20:19.325 lat (usec): min=427, max=42066, avg=39501.81, stdev=8531.39 00:20:19.325 clat percentiles (usec): 00:20:19.325 | 1.00th=[ 404], 5.00th=[40633], 10.00th=[40633], 20.00th=[41157], 00:20:19.325 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:20:19.325 | 70.00th=[41681], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:20:19.325 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:20:19.325 | 99.99th=[42206] 00:20:19.325 write: IOPS=500, BW=2004KiB/s (2052kB/s)(2048KiB/1022msec); 0 zone resets 00:20:19.325 slat (nsec): min=9609, max=41603, avg=10706.10, stdev=1715.97 00:20:19.325 clat (usec): min=129, max=379, avg=200.08, stdev=30.18 00:20:19.325 lat (usec): min=139, max=405, avg=210.78, stdev=30.66 00:20:19.325 clat percentiles (usec): 00:20:19.325 | 1.00th=[ 141], 5.00th=[ 153], 10.00th=[ 163], 20.00th=[ 178], 00:20:19.325 | 30.00th=[ 190], 40.00th=[ 196], 50.00th=[ 200], 60.00th=[ 206], 00:20:19.325 | 70.00th=[ 212], 80.00th=[ 219], 90.00th=[ 227], 95.00th=[ 239], 00:20:19.325 | 99.00th=[ 326], 99.50th=[ 347], 99.90th=[ 379], 99.95th=[ 379], 00:20:19.325 | 99.99th=[ 379] 00:20:19.325 bw ( KiB/s): min= 4096, max= 4096, per=18.58%, avg=4096.00, stdev= 0.00, samples=1 00:20:19.325 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:20:19.325 lat (usec) : 250=92.52%, 500=3.36% 00:20:19.325 lat (msec) : 50=4.11% 00:20:19.325 cpu : usr=0.29%, sys=0.49%, ctx=536, majf=0, minf=1 00:20:19.325 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:20:19.325 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:19.325 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:19.325 issued rwts: total=23,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:19.325 latency : target=0, window=0, percentile=100.00%, depth=1 00:20:19.325 00:20:19.325 Run status group 0 (all jobs): 00:20:19.325 READ: bw=15.9MiB/s (16.6MB/s), 87.0KiB/s-9483KiB/s (89.1kB/s-9710kB/s), io=16.2MiB (17.0MB), run=1001-1022msec 00:20:19.325 WRITE: bw=21.5MiB/s (22.6MB/s), 2004KiB/s-9.99MiB/s (2052kB/s-10.5MB/s), io=22.0MiB (23.1MB), run=1001-1022msec 00:20:19.325 00:20:19.325 Disk stats (read/write): 00:20:19.325 nvme0n1: ios=68/512, merge=0/0, ticks=758/95, in_queue=853, util=86.87% 00:20:19.325 nvme0n2: ios=2073/2084, merge=0/0, ticks=1411/327, in_queue=1738, util=98.17% 00:20:19.325 nvme0n3: ios=1518/1536, merge=0/0, ticks=1550/248, in_queue=1798, util=98.02% 00:20:19.325 nvme0n4: ios=42/512, merge=0/0, ticks=1692/98, in_queue=1790, util=98.22% 00:20:19.325 19:06:35 -- target/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t write -r 1 -v 00:20:19.325 [global] 00:20:19.325 thread=1 00:20:19.325 invalidate=1 00:20:19.325 rw=write 00:20:19.325 time_based=1 00:20:19.325 runtime=1 00:20:19.325 ioengine=libaio 00:20:19.325 direct=1 00:20:19.325 bs=4096 00:20:19.325 iodepth=128 00:20:19.325 norandommap=0 00:20:19.325 numjobs=1 00:20:19.325 00:20:19.325 verify_dump=1 00:20:19.325 verify_backlog=512 00:20:19.325 verify_state_save=0 00:20:19.325 do_verify=1 00:20:19.325 verify=crc32c-intel 00:20:19.325 [job0] 00:20:19.325 filename=/dev/nvme0n1 00:20:19.325 [job1] 00:20:19.325 filename=/dev/nvme0n2 00:20:19.325 [job2] 00:20:19.325 filename=/dev/nvme0n3 00:20:19.325 [job3] 00:20:19.325 filename=/dev/nvme0n4 00:20:19.325 Could not set queue depth (nvme0n1) 00:20:19.325 Could not set queue depth (nvme0n2) 00:20:19.325 Could not set queue depth (nvme0n3) 00:20:19.325 Could not set queue depth (nvme0n4) 00:20:19.325 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:20:19.325 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:20:19.325 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:20:19.325 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:20:19.325 fio-3.35 00:20:19.325 Starting 4 threads 00:20:20.698 00:20:20.698 job0: (groupid=0, jobs=1): err= 0: pid=3129154: Tue Nov 26 19:06:37 2024 00:20:20.698 read: IOPS=3552, BW=13.9MiB/s (14.5MB/s)(14.0MiB/1009msec) 00:20:20.698 slat (nsec): min=1326, max=14729k, avg=111160.11, stdev=758405.45 00:20:20.698 clat (usec): min=5075, max=48243, avg=15189.50, stdev=8659.62 00:20:20.698 lat (usec): min=5081, max=48248, avg=15300.66, stdev=8693.33 00:20:20.698 clat percentiles (usec): 00:20:20.698 | 1.00th=[ 6587], 5.00th=[ 8094], 10.00th=[ 8848], 20.00th=[10421], 00:20:20.698 | 30.00th=[10814], 40.00th=[11076], 50.00th=[11994], 60.00th=[12911], 00:20:20.698 | 70.00th=[13960], 80.00th=[17433], 90.00th=[25297], 95.00th=[40633], 00:20:20.698 | 99.00th=[45876], 99.50th=[45876], 99.90th=[48497], 99.95th=[48497], 00:20:20.698 | 99.99th=[48497] 00:20:20.698 write: IOPS=3716, BW=14.5MiB/s (15.2MB/s)(14.6MiB/1009msec); 0 zone resets 00:20:20.698 slat (usec): min=2, max=36015, avg=150.34, stdev=926.00 00:20:20.698 clat (usec): min=3312, max=54892, avg=19559.08, stdev=11156.47 00:20:20.698 lat (usec): min=3339, max=54903, avg=19709.42, stdev=11238.04 00:20:20.698 clat percentiles (usec): 00:20:20.698 | 1.00th=[ 4686], 5.00th=[ 7898], 10.00th=[ 8979], 20.00th=[ 9634], 00:20:20.698 | 30.00th=[10552], 40.00th=[12518], 50.00th=[16581], 60.00th=[21890], 00:20:20.698 | 70.00th=[22676], 80.00th=[28705], 90.00th=[36439], 95.00th=[41157], 00:20:20.698 | 99.00th=[51643], 99.50th=[54264], 99.90th=[54789], 99.95th=[54789], 00:20:20.698 | 99.99th=[54789] 00:20:20.698 bw ( KiB/s): min=11984, max=17000, per=19.69%, avg=14492.00, stdev=3546.85, samples=2 00:20:20.698 iops : min= 2996, max= 4250, avg=3623.00, stdev=886.71, samples=2 00:20:20.698 lat (msec) : 4=0.19%, 10=21.73%, 20=46.90%, 50=30.46%, 100=0.71% 00:20:20.698 cpu : usr=2.38%, sys=6.94%, ctx=342, majf=0, minf=1 00:20:20.698 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.1% 00:20:20.698 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:20.698 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:20:20.698 issued rwts: total=3584,3750,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:20.698 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:20.698 job1: (groupid=0, jobs=1): err= 0: pid=3129155: Tue Nov 26 19:06:37 2024 00:20:20.698 read: IOPS=6125, BW=23.9MiB/s (25.1MB/s)(24.0MiB/1003msec) 00:20:20.698 slat (nsec): min=1380, max=8589.4k, avg=75062.42, stdev=477395.93 00:20:20.698 clat (usec): min=1603, max=18051, avg=9680.53, stdev=1903.07 00:20:20.698 lat (usec): min=1625, max=18054, avg=9755.60, stdev=1927.23 00:20:20.698 clat percentiles (usec): 00:20:20.698 | 1.00th=[ 6063], 5.00th=[ 6587], 10.00th=[ 7439], 20.00th=[ 8586], 00:20:20.698 | 30.00th=[ 8979], 40.00th=[ 9372], 50.00th=[ 9503], 60.00th=[ 9765], 00:20:20.698 | 70.00th=[10159], 80.00th=[10945], 90.00th=[11600], 95.00th=[13173], 00:20:20.698 | 99.00th=[15401], 99.50th=[16909], 99.90th=[17695], 99.95th=[17957], 00:20:20.698 | 99.99th=[17957] 00:20:20.698 write: IOPS=6346, BW=24.8MiB/s (26.0MB/s)(24.9MiB/1003msec); 0 zone resets 00:20:20.698 slat (usec): min=2, max=15533, avg=78.03, stdev=547.49 00:20:20.698 clat (usec): min=477, max=38771, avg=10500.04, stdev=3539.54 00:20:20.698 lat (usec): min=2884, max=38779, avg=10578.07, stdev=3565.46 00:20:20.698 clat percentiles (usec): 00:20:20.698 | 1.00th=[ 4293], 5.00th=[ 6063], 10.00th=[ 7439], 20.00th=[ 9372], 00:20:20.698 | 30.00th=[ 9896], 40.00th=[10028], 50.00th=[10159], 60.00th=[10290], 00:20:20.698 | 70.00th=[10421], 80.00th=[10552], 90.00th=[13435], 95.00th=[15664], 00:20:20.698 | 99.00th=[25822], 99.50th=[30016], 99.90th=[38536], 99.95th=[38536], 00:20:20.698 | 99.99th=[38536] 00:20:20.698 bw ( KiB/s): min=24576, max=25328, per=33.90%, avg=24952.00, stdev=531.74, samples=2 00:20:20.698 iops : min= 6144, max= 6332, avg=6238.00, stdev=132.94, samples=2 00:20:20.698 lat (usec) : 500=0.01% 00:20:20.698 lat (msec) : 2=0.18%, 4=0.48%, 10=49.30%, 20=48.86%, 50=1.17% 00:20:20.698 cpu : usr=5.89%, sys=6.39%, ctx=498, majf=0, minf=1 00:20:20.698 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.5% 00:20:20.698 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:20.698 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:20:20.698 issued rwts: total=6144,6366,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:20.698 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:20.698 job2: (groupid=0, jobs=1): err= 0: pid=3129156: Tue Nov 26 19:06:37 2024 00:20:20.698 read: IOPS=3566, BW=13.9MiB/s (14.6MB/s)(14.0MiB/1005msec) 00:20:20.698 slat (nsec): min=1771, max=28114k, avg=122343.90, stdev=888744.05 00:20:20.698 clat (usec): min=7278, max=66315, avg=17576.90, stdev=9277.71 00:20:20.698 lat (usec): min=7283, max=66339, avg=17699.24, stdev=9340.34 00:20:20.698 clat percentiles (usec): 00:20:20.698 | 1.00th=[ 9241], 5.00th=[10028], 10.00th=[10945], 20.00th=[11600], 00:20:20.698 | 30.00th=[12387], 40.00th=[13829], 50.00th=[14484], 60.00th=[16188], 00:20:20.698 | 70.00th=[17171], 80.00th=[18482], 90.00th=[31327], 95.00th=[42206], 00:20:20.698 | 99.00th=[51119], 99.50th=[51119], 99.90th=[51119], 99.95th=[55837], 00:20:20.698 | 99.99th=[66323] 00:20:20.698 write: IOPS=3743, BW=14.6MiB/s (15.3MB/s)(14.7MiB/1005msec); 0 zone resets 00:20:20.698 slat (usec): min=2, max=15375, avg=139.83, stdev=866.02 00:20:20.698 clat (usec): min=3638, max=56338, avg=17149.18, stdev=9470.93 00:20:20.698 lat (usec): min=5301, max=56346, avg=17289.01, stdev=9539.92 00:20:20.698 clat percentiles (usec): 00:20:20.698 | 1.00th=[ 6652], 5.00th=[ 9765], 10.00th=[11338], 20.00th=[12125], 00:20:20.698 | 30.00th=[12518], 40.00th=[13304], 50.00th=[13829], 60.00th=[15401], 00:20:20.698 | 70.00th=[16581], 80.00th=[20317], 90.00th=[23725], 95.00th=[43779], 00:20:20.698 | 99.00th=[54789], 99.50th=[55313], 99.90th=[56361], 99.95th=[56361], 00:20:20.698 | 99.99th=[56361] 00:20:20.698 bw ( KiB/s): min=11976, max=17096, per=19.75%, avg=14536.00, stdev=3620.39, samples=2 00:20:20.698 iops : min= 2994, max= 4274, avg=3634.00, stdev=905.10, samples=2 00:20:20.698 lat (msec) : 4=0.01%, 10=5.06%, 20=73.97%, 50=18.25%, 100=2.70% 00:20:20.698 cpu : usr=3.09%, sys=4.88%, ctx=294, majf=0, minf=1 00:20:20.698 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.1% 00:20:20.698 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:20.698 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:20:20.698 issued rwts: total=3584,3762,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:20.698 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:20.698 job3: (groupid=0, jobs=1): err= 0: pid=3129157: Tue Nov 26 19:06:37 2024 00:20:20.698 read: IOPS=4598, BW=18.0MiB/s (18.8MB/s)(18.0MiB/1002msec) 00:20:20.698 slat (nsec): min=1210, max=39181k, avg=100420.55, stdev=815622.28 00:20:20.698 clat (usec): min=3019, max=64954, avg=12849.00, stdev=6627.12 00:20:20.698 lat (usec): min=3028, max=64986, avg=12949.42, stdev=6676.41 00:20:20.698 clat percentiles (usec): 00:20:20.698 | 1.00th=[ 6521], 5.00th=[ 8455], 10.00th=[ 9241], 20.00th=[10290], 00:20:20.698 | 30.00th=[10814], 40.00th=[11076], 50.00th=[11207], 60.00th=[11469], 00:20:20.698 | 70.00th=[11731], 80.00th=[12518], 90.00th=[16057], 95.00th=[26346], 00:20:20.698 | 99.00th=[45876], 99.50th=[47973], 99.90th=[47973], 99.95th=[47973], 00:20:20.698 | 99.99th=[64750] 00:20:20.698 write: IOPS=4677, BW=18.3MiB/s (19.2MB/s)(18.3MiB/1002msec); 0 zone resets 00:20:20.698 slat (usec): min=2, max=19737, avg=108.63, stdev=631.18 00:20:20.698 clat (usec): min=187, max=48812, avg=14401.57, stdev=6516.73 00:20:20.698 lat (usec): min=3695, max=48827, avg=14510.20, stdev=6562.15 00:20:20.698 clat percentiles (usec): 00:20:20.698 | 1.00th=[ 6849], 5.00th=[10552], 10.00th=[10945], 20.00th=[11207], 00:20:20.698 | 30.00th=[11469], 40.00th=[11600], 50.00th=[11731], 60.00th=[11994], 00:20:20.698 | 70.00th=[12518], 80.00th=[15926], 90.00th=[22152], 95.00th=[26870], 00:20:20.698 | 99.00th=[40109], 99.50th=[42730], 99.90th=[49021], 99.95th=[49021], 00:20:20.698 | 99.99th=[49021] 00:20:20.698 bw ( KiB/s): min=15704, max=21160, per=25.04%, avg=18432.00, stdev=3857.97, samples=2 00:20:20.698 iops : min= 3926, max= 5290, avg=4608.00, stdev=964.49, samples=2 00:20:20.698 lat (usec) : 250=0.01% 00:20:20.698 lat (msec) : 4=0.82%, 10=10.24%, 20=75.78%, 50=13.14%, 100=0.01% 00:20:20.698 cpu : usr=2.50%, sys=5.19%, ctx=557, majf=0, minf=1 00:20:20.698 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.3% 00:20:20.698 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:20.698 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:20:20.698 issued rwts: total=4608,4687,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:20.698 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:20.698 00:20:20.698 Run status group 0 (all jobs): 00:20:20.698 READ: bw=69.4MiB/s (72.7MB/s), 13.9MiB/s-23.9MiB/s (14.5MB/s-25.1MB/s), io=70.0MiB (73.4MB), run=1002-1009msec 00:20:20.698 WRITE: bw=71.9MiB/s (75.4MB/s), 14.5MiB/s-24.8MiB/s (15.2MB/s-26.0MB/s), io=72.5MiB (76.0MB), run=1002-1009msec 00:20:20.698 00:20:20.698 Disk stats (read/write): 00:20:20.698 nvme0n1: ios=3128/3183, merge=0/0, ticks=41130/56400, in_queue=97530, util=86.87% 00:20:20.698 nvme0n2: ios=5169/5471, merge=0/0, ticks=33779/37247, in_queue=71026, util=87.41% 00:20:20.698 nvme0n3: ios=3129/3418, merge=0/0, ticks=24280/26133, in_queue=50413, util=93.14% 00:20:20.698 nvme0n4: ios=3641/4047, merge=0/0, ticks=25056/28494, in_queue=53550, util=95.18% 00:20:20.698 19:06:37 -- target/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t randwrite -r 1 -v 00:20:20.698 [global] 00:20:20.698 thread=1 00:20:20.698 invalidate=1 00:20:20.698 rw=randwrite 00:20:20.698 time_based=1 00:20:20.698 runtime=1 00:20:20.698 ioengine=libaio 00:20:20.698 direct=1 00:20:20.698 bs=4096 00:20:20.698 iodepth=128 00:20:20.698 norandommap=0 00:20:20.698 numjobs=1 00:20:20.698 00:20:20.698 verify_dump=1 00:20:20.698 verify_backlog=512 00:20:20.698 verify_state_save=0 00:20:20.698 do_verify=1 00:20:20.698 verify=crc32c-intel 00:20:20.698 [job0] 00:20:20.698 filename=/dev/nvme0n1 00:20:20.698 [job1] 00:20:20.698 filename=/dev/nvme0n2 00:20:20.698 [job2] 00:20:20.698 filename=/dev/nvme0n3 00:20:20.698 [job3] 00:20:20.698 filename=/dev/nvme0n4 00:20:20.698 Could not set queue depth (nvme0n1) 00:20:20.698 Could not set queue depth (nvme0n2) 00:20:20.698 Could not set queue depth (nvme0n3) 00:20:20.698 Could not set queue depth (nvme0n4) 00:20:20.956 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:20:20.956 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:20:20.956 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:20:20.956 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:20:20.956 fio-3.35 00:20:20.956 Starting 4 threads 00:20:22.334 00:20:22.334 job0: (groupid=0, jobs=1): err= 0: pid=3129532: Tue Nov 26 19:06:39 2024 00:20:22.334 read: IOPS=3569, BW=13.9MiB/s (14.6MB/s)(14.0MiB/1004msec) 00:20:22.334 slat (nsec): min=1406, max=17532k, avg=156876.29, stdev=1029555.91 00:20:22.334 clat (usec): min=1817, max=84486, avg=20280.88, stdev=14993.86 00:20:22.334 lat (usec): min=1825, max=84496, avg=20437.75, stdev=15091.43 00:20:22.334 clat percentiles (usec): 00:20:22.334 | 1.00th=[ 6194], 5.00th=[ 8291], 10.00th=[ 8979], 20.00th=[10290], 00:20:22.334 | 30.00th=[11994], 40.00th=[14222], 50.00th=[15270], 60.00th=[16581], 00:20:22.334 | 70.00th=[19530], 80.00th=[25035], 90.00th=[43779], 95.00th=[58459], 00:20:22.334 | 99.00th=[71828], 99.50th=[71828], 99.90th=[84411], 99.95th=[84411], 00:20:22.334 | 99.99th=[84411] 00:20:22.334 write: IOPS=3628, BW=14.2MiB/s (14.9MB/s)(14.2MiB/1004msec); 0 zone resets 00:20:22.334 slat (usec): min=2, max=13248, avg=109.46, stdev=663.64 00:20:22.334 clat (usec): min=358, max=51723, avg=14770.88, stdev=6808.71 00:20:22.334 lat (usec): min=725, max=51726, avg=14880.34, stdev=6835.43 00:20:22.334 clat percentiles (usec): 00:20:22.334 | 1.00th=[ 3556], 5.00th=[ 6521], 10.00th=[ 6915], 20.00th=[ 8848], 00:20:22.335 | 30.00th=[ 9896], 40.00th=[12125], 50.00th=[13698], 60.00th=[15270], 00:20:22.335 | 70.00th=[18744], 80.00th=[21365], 90.00th=[23987], 95.00th=[25297], 00:20:22.335 | 99.00th=[35390], 99.50th=[36963], 99.90th=[38011], 99.95th=[51643], 00:20:22.335 | 99.99th=[51643] 00:20:22.335 bw ( KiB/s): min=13200, max=15472, per=21.35%, avg=14336.00, stdev=1606.55, samples=2 00:20:22.335 iops : min= 3300, max= 3868, avg=3584.00, stdev=401.64, samples=2 00:20:22.335 lat (usec) : 500=0.01%, 750=0.04% 00:20:22.335 lat (msec) : 2=0.51%, 4=0.43%, 10=24.33%, 20=47.60%, 50=23.16% 00:20:22.335 lat (msec) : 100=3.92% 00:20:22.335 cpu : usr=2.79%, sys=5.68%, ctx=348, majf=0, minf=1 00:20:22.335 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.1% 00:20:22.335 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:22.335 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:20:22.335 issued rwts: total=3584,3643,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:22.335 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:22.335 job1: (groupid=0, jobs=1): err= 0: pid=3129533: Tue Nov 26 19:06:39 2024 00:20:22.335 read: IOPS=5104, BW=19.9MiB/s (20.9MB/s)(20.0MiB/1003msec) 00:20:22.335 slat (nsec): min=1169, max=15785k, avg=92419.61, stdev=679112.60 00:20:22.335 clat (usec): min=1361, max=58135, avg=11934.46, stdev=5895.26 00:20:22.335 lat (usec): min=1367, max=59491, avg=12026.88, stdev=5934.24 00:20:22.335 clat percentiles (usec): 00:20:22.335 | 1.00th=[ 3097], 5.00th=[ 6325], 10.00th=[ 7177], 20.00th=[ 7898], 00:20:22.335 | 30.00th=[ 8225], 40.00th=[ 9241], 50.00th=[10421], 60.00th=[12256], 00:20:22.335 | 70.00th=[13960], 80.00th=[15270], 90.00th=[18220], 95.00th=[20841], 00:20:22.335 | 99.00th=[29230], 99.50th=[55837], 99.90th=[57934], 99.95th=[57934], 00:20:22.335 | 99.99th=[57934] 00:20:22.335 write: IOPS=5160, BW=20.2MiB/s (21.1MB/s)(20.2MiB/1003msec); 0 zone resets 00:20:22.335 slat (usec): min=2, max=9031, avg=86.88, stdev=518.30 00:20:22.335 clat (usec): min=346, max=54228, avg=12783.77, stdev=6521.76 00:20:22.335 lat (usec): min=561, max=54231, avg=12870.65, stdev=6556.84 00:20:22.335 clat percentiles (usec): 00:20:22.335 | 1.00th=[ 3982], 5.00th=[ 5932], 10.00th=[ 6390], 20.00th=[ 7635], 00:20:22.335 | 30.00th=[ 7898], 40.00th=[ 8455], 50.00th=[10290], 60.00th=[12911], 00:20:22.335 | 70.00th=[16712], 80.00th=[19530], 90.00th=[21890], 95.00th=[22152], 00:20:22.335 | 99.00th=[29230], 99.50th=[43254], 99.90th=[50594], 99.95th=[50594], 00:20:22.335 | 99.99th=[54264] 00:20:22.335 bw ( KiB/s): min=16464, max=24496, per=30.50%, avg=20480.00, stdev=5679.48, samples=2 00:20:22.335 iops : min= 4116, max= 6124, avg=5120.00, stdev=1419.87, samples=2 00:20:22.335 lat (usec) : 500=0.02%, 1000=0.06% 00:20:22.335 lat (msec) : 2=0.10%, 4=1.12%, 10=44.83%, 20=41.22%, 50=12.31% 00:20:22.335 lat (msec) : 100=0.35% 00:20:22.335 cpu : usr=2.89%, sys=5.79%, ctx=369, majf=0, minf=1 00:20:22.335 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:20:22.335 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:22.335 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:20:22.335 issued rwts: total=5120,5176,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:22.335 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:22.335 job2: (groupid=0, jobs=1): err= 0: pid=3129534: Tue Nov 26 19:06:39 2024 00:20:22.335 read: IOPS=3859, BW=15.1MiB/s (15.8MB/s)(15.7MiB/1043msec) 00:20:22.335 slat (nsec): min=1118, max=13639k, avg=104161.18, stdev=704144.55 00:20:22.335 clat (usec): min=4761, max=53990, avg=15150.20, stdev=7943.04 00:20:22.335 lat (usec): min=4767, max=55754, avg=15254.36, stdev=7971.89 00:20:22.335 clat percentiles (usec): 00:20:22.335 | 1.00th=[ 7046], 5.00th=[ 8094], 10.00th=[ 9110], 20.00th=[10552], 00:20:22.335 | 30.00th=[11338], 40.00th=[12125], 50.00th=[13042], 60.00th=[14484], 00:20:22.335 | 70.00th=[15270], 80.00th=[17695], 90.00th=[21890], 95.00th=[27657], 00:20:22.335 | 99.00th=[53216], 99.50th=[53740], 99.90th=[53740], 99.95th=[53740], 00:20:22.335 | 99.99th=[53740] 00:20:22.335 write: IOPS=3927, BW=15.3MiB/s (16.1MB/s)(16.0MiB/1043msec); 0 zone resets 00:20:22.335 slat (usec): min=2, max=14466, avg=122.58, stdev=776.54 00:20:22.335 clat (usec): min=1221, max=50331, avg=17432.06, stdev=7330.90 00:20:22.335 lat (usec): min=1232, max=50335, avg=17554.64, stdev=7385.78 00:20:22.335 clat percentiles (usec): 00:20:22.335 | 1.00th=[ 5866], 5.00th=[ 8586], 10.00th=[ 9765], 20.00th=[11863], 00:20:22.335 | 30.00th=[12911], 40.00th=[13698], 50.00th=[16057], 60.00th=[17957], 00:20:22.335 | 70.00th=[21103], 80.00th=[21890], 90.00th=[27132], 95.00th=[32113], 00:20:22.335 | 99.00th=[40633], 99.50th=[42206], 99.90th=[48497], 99.95th=[48497], 00:20:22.335 | 99.99th=[50070] 00:20:22.335 bw ( KiB/s): min=16384, max=16384, per=24.40%, avg=16384.00, stdev= 0.00, samples=2 00:20:22.335 iops : min= 4096, max= 4096, avg=4096.00, stdev= 0.00, samples=2 00:20:22.335 lat (msec) : 2=0.11%, 4=0.09%, 10=13.37%, 20=61.48%, 50=24.26% 00:20:22.335 lat (msec) : 100=0.69% 00:20:22.335 cpu : usr=2.69%, sys=4.03%, ctx=387, majf=0, minf=2 00:20:22.335 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:20:22.335 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:22.335 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:20:22.335 issued rwts: total=4025,4096,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:22.335 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:22.335 job3: (groupid=0, jobs=1): err= 0: pid=3129535: Tue Nov 26 19:06:39 2024 00:20:22.335 read: IOPS=4079, BW=15.9MiB/s (16.7MB/s)(16.0MiB/1004msec) 00:20:22.335 slat (nsec): min=1205, max=13979k, avg=99352.22, stdev=742091.08 00:20:22.335 clat (usec): min=1928, max=36809, avg=13289.21, stdev=5101.88 00:20:22.335 lat (usec): min=1935, max=36834, avg=13388.57, stdev=5151.59 00:20:22.335 clat percentiles (usec): 00:20:22.335 | 1.00th=[ 2704], 5.00th=[ 7570], 10.00th=[ 8455], 20.00th=[10683], 00:20:22.335 | 30.00th=[11207], 40.00th=[11469], 50.00th=[12125], 60.00th=[12911], 00:20:22.335 | 70.00th=[13829], 80.00th=[15926], 90.00th=[19268], 95.00th=[22676], 00:20:22.335 | 99.00th=[36439], 99.50th=[36439], 99.90th=[36439], 99.95th=[36439], 00:20:22.335 | 99.99th=[36963] 00:20:22.335 write: IOPS=4572, BW=17.9MiB/s (18.7MB/s)(17.9MiB/1004msec); 0 zone resets 00:20:22.335 slat (nsec): min=1933, max=18409k, avg=118625.03, stdev=816234.93 00:20:22.335 clat (usec): min=1186, max=73420, avg=15823.40, stdev=10449.54 00:20:22.335 lat (usec): min=1194, max=74522, avg=15942.02, stdev=10515.73 00:20:22.335 clat percentiles (usec): 00:20:22.335 | 1.00th=[ 3130], 5.00th=[ 5800], 10.00th=[ 7635], 20.00th=[11076], 00:20:22.335 | 30.00th=[11600], 40.00th=[12387], 50.00th=[13042], 60.00th=[14353], 00:20:22.335 | 70.00th=[16057], 80.00th=[17433], 90.00th=[25297], 95.00th=[33817], 00:20:22.335 | 99.00th=[68682], 99.50th=[69731], 99.90th=[72877], 99.95th=[73925], 00:20:22.335 | 99.99th=[73925] 00:20:22.335 bw ( KiB/s): min=16384, max=19328, per=26.60%, avg=17856.00, stdev=2081.72, samples=2 00:20:22.335 iops : min= 4096, max= 4832, avg=4464.00, stdev=520.43, samples=2 00:20:22.335 lat (msec) : 2=0.17%, 4=1.65%, 10=14.04%, 20=72.23%, 50=10.57% 00:20:22.335 lat (msec) : 100=1.34% 00:20:22.335 cpu : usr=2.89%, sys=4.39%, ctx=354, majf=0, minf=1 00:20:22.335 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:20:22.335 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:22.335 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:20:22.335 issued rwts: total=4096,4591,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:22.335 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:22.335 00:20:22.335 Run status group 0 (all jobs): 00:20:22.335 READ: bw=63.0MiB/s (66.1MB/s), 13.9MiB/s-19.9MiB/s (14.6MB/s-20.9MB/s), io=65.7MiB (68.9MB), run=1003-1043msec 00:20:22.335 WRITE: bw=65.6MiB/s (68.7MB/s), 14.2MiB/s-20.2MiB/s (14.9MB/s-21.1MB/s), io=68.4MiB (71.7MB), run=1003-1043msec 00:20:22.335 00:20:22.335 Disk stats (read/write): 00:20:22.335 nvme0n1: ios=2603/2935, merge=0/0, ticks=34892/25419, in_queue=60311, util=96.09% 00:20:22.335 nvme0n2: ios=4145/4487, merge=0/0, ticks=31159/37166, in_queue=68325, util=83.74% 00:20:22.335 nvme0n3: ios=3114/3584, merge=0/0, ticks=31239/42847, in_queue=74086, util=89.94% 00:20:22.335 nvme0n4: ios=3537/3584, merge=0/0, ticks=31130/41375, in_queue=72505, util=87.54% 00:20:22.335 19:06:39 -- target/fio.sh@55 -- # sync 00:20:22.335 19:06:39 -- target/fio.sh@59 -- # fio_pid=3129774 00:20:22.335 19:06:39 -- target/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t read -r 10 00:20:22.335 19:06:39 -- target/fio.sh@61 -- # sleep 3 00:20:22.335 [global] 00:20:22.335 thread=1 00:20:22.335 invalidate=1 00:20:22.335 rw=read 00:20:22.335 time_based=1 00:20:22.335 runtime=10 00:20:22.335 ioengine=libaio 00:20:22.335 direct=1 00:20:22.335 bs=4096 00:20:22.335 iodepth=1 00:20:22.335 norandommap=1 00:20:22.335 numjobs=1 00:20:22.335 00:20:22.335 [job0] 00:20:22.335 filename=/dev/nvme0n1 00:20:22.335 [job1] 00:20:22.335 filename=/dev/nvme0n2 00:20:22.335 [job2] 00:20:22.335 filename=/dev/nvme0n3 00:20:22.335 [job3] 00:20:22.335 filename=/dev/nvme0n4 00:20:22.335 Could not set queue depth (nvme0n1) 00:20:22.335 Could not set queue depth (nvme0n2) 00:20:22.335 Could not set queue depth (nvme0n3) 00:20:22.335 Could not set queue depth (nvme0n4) 00:20:22.594 job0: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:20:22.594 job1: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:20:22.594 job2: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:20:22.594 job3: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:20:22.594 fio-3.35 00:20:22.594 Starting 4 threads 00:20:25.877 19:06:42 -- target/fio.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete concat0 00:20:25.877 fio: io_u error on file /dev/nvme0n4: Operation not supported: read offset=40980480, buflen=4096 00:20:25.877 fio: pid=3129913, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:20:25.877 19:06:42 -- target/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete raid0 00:20:25.877 19:06:42 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:20:25.877 19:06:42 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc0 00:20:25.877 fio: io_u error on file /dev/nvme0n3: Operation not supported: read offset=44666880, buflen=4096 00:20:25.877 fio: pid=3129912, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:20:25.877 fio: io_u error on file /dev/nvme0n1: Operation not supported: read offset=3911680, buflen=4096 00:20:25.877 fio: pid=3129910, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:20:25.877 19:06:42 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:20:25.877 19:06:42 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc1 00:20:26.137 fio: io_u error on file /dev/nvme0n2: Operation not supported: read offset=52383744, buflen=4096 00:20:26.137 fio: pid=3129911, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:20:26.137 19:06:42 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:20:26.137 19:06:42 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc2 00:20:26.137 00:20:26.137 job0: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=3129910: Tue Nov 26 19:06:42 2024 00:20:26.137 read: IOPS=309, BW=1238KiB/s (1268kB/s)(3820KiB/3086msec) 00:20:26.137 slat (nsec): min=3542, max=65987, avg=8628.05, stdev=4374.09 00:20:26.137 clat (usec): min=203, max=42046, avg=3193.39, stdev=10540.79 00:20:26.137 lat (usec): min=207, max=42056, avg=3202.01, stdev=10543.31 00:20:26.137 clat percentiles (usec): 00:20:26.137 | 1.00th=[ 208], 5.00th=[ 221], 10.00th=[ 227], 20.00th=[ 241], 00:20:26.137 | 30.00th=[ 253], 40.00th=[ 260], 50.00th=[ 269], 60.00th=[ 277], 00:20:26.137 | 70.00th=[ 285], 80.00th=[ 293], 90.00th=[ 371], 95.00th=[41157], 00:20:26.137 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:20:26.137 | 99.99th=[42206] 00:20:26.137 bw ( KiB/s): min= 94, max= 3960, per=3.01%, avg=1270.33, stdev=1832.70, samples=6 00:20:26.137 iops : min= 23, max= 990, avg=317.50, stdev=458.24, samples=6 00:20:26.137 lat (usec) : 250=26.88%, 500=65.06%, 750=0.52% 00:20:26.137 lat (msec) : 2=0.10%, 4=0.21%, 50=7.11% 00:20:26.137 cpu : usr=0.13%, sys=0.29%, ctx=958, majf=0, minf=1 00:20:26.137 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:20:26.137 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:26.137 complete : 0=0.1%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:26.137 issued rwts: total=956,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:26.137 latency : target=0, window=0, percentile=100.00%, depth=1 00:20:26.137 job1: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=3129911: Tue Nov 26 19:06:42 2024 00:20:26.137 read: IOPS=3897, BW=15.2MiB/s (16.0MB/s)(50.0MiB/3282msec) 00:20:26.137 slat (usec): min=6, max=12715, avg= 9.90, stdev=141.96 00:20:26.137 clat (usec): min=156, max=41962, avg=243.63, stdev=657.36 00:20:26.137 lat (usec): min=165, max=41970, avg=253.53, stdev=672.76 00:20:26.137 clat percentiles (usec): 00:20:26.137 | 1.00th=[ 174], 5.00th=[ 184], 10.00th=[ 192], 20.00th=[ 206], 00:20:26.137 | 30.00th=[ 215], 40.00th=[ 221], 50.00th=[ 227], 60.00th=[ 233], 00:20:26.137 | 70.00th=[ 241], 80.00th=[ 251], 90.00th=[ 269], 95.00th=[ 302], 00:20:26.137 | 99.00th=[ 379], 99.50th=[ 404], 99.90th=[ 486], 99.95th=[ 523], 00:20:26.137 | 99.99th=[40633] 00:20:26.137 bw ( KiB/s): min=12072, max=17318, per=36.86%, avg=15570.33, stdev=1877.73, samples=6 00:20:26.137 iops : min= 3018, max= 4329, avg=3892.50, stdev=469.34, samples=6 00:20:26.137 lat (usec) : 250=80.06%, 500=19.87%, 750=0.03% 00:20:26.137 lat (msec) : 50=0.03% 00:20:26.137 cpu : usr=1.13%, sys=3.99%, ctx=12793, majf=0, minf=2 00:20:26.137 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:20:26.137 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:26.137 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:26.137 issued rwts: total=12790,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:26.137 latency : target=0, window=0, percentile=100.00%, depth=1 00:20:26.137 job2: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=3129912: Tue Nov 26 19:06:42 2024 00:20:26.137 read: IOPS=3754, BW=14.7MiB/s (15.4MB/s)(42.6MiB/2905msec) 00:20:26.137 slat (nsec): min=7364, max=43091, avg=8734.47, stdev=1719.83 00:20:26.137 clat (usec): min=176, max=41901, avg=253.63, stdev=903.24 00:20:26.137 lat (usec): min=184, max=41926, avg=262.36, stdev=903.60 00:20:26.137 clat percentiles (usec): 00:20:26.137 | 1.00th=[ 194], 5.00th=[ 202], 10.00th=[ 208], 20.00th=[ 215], 00:20:26.137 | 30.00th=[ 219], 40.00th=[ 225], 50.00th=[ 229], 60.00th=[ 235], 00:20:26.137 | 70.00th=[ 243], 80.00th=[ 249], 90.00th=[ 260], 95.00th=[ 269], 00:20:26.137 | 99.00th=[ 293], 99.50th=[ 306], 99.90th=[ 510], 99.95th=[22152], 00:20:26.137 | 99.99th=[41157] 00:20:26.137 bw ( KiB/s): min=15232, max=17272, per=38.89%, avg=16425.60, stdev=866.73, samples=5 00:20:26.137 iops : min= 3808, max= 4318, avg=4106.40, stdev=216.68, samples=5 00:20:26.137 lat (usec) : 250=81.27%, 500=18.62%, 750=0.02% 00:20:26.137 lat (msec) : 4=0.03%, 50=0.06% 00:20:26.137 cpu : usr=2.44%, sys=5.89%, ctx=10908, majf=0, minf=2 00:20:26.137 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:20:26.138 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:26.138 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:26.138 issued rwts: total=10906,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:26.138 latency : target=0, window=0, percentile=100.00%, depth=1 00:20:26.138 job3: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=3129913: Tue Nov 26 19:06:42 2024 00:20:26.138 read: IOPS=3739, BW=14.6MiB/s (15.3MB/s)(39.1MiB/2676msec) 00:20:26.138 slat (nsec): min=6416, max=42894, avg=7683.40, stdev=1630.30 00:20:26.138 clat (usec): min=170, max=41440, avg=256.54, stdev=709.51 00:20:26.138 lat (usec): min=189, max=41450, avg=264.22, stdev=709.54 00:20:26.138 clat percentiles (usec): 00:20:26.138 | 1.00th=[ 194], 5.00th=[ 202], 10.00th=[ 206], 20.00th=[ 212], 00:20:26.138 | 30.00th=[ 219], 40.00th=[ 225], 50.00th=[ 233], 60.00th=[ 245], 00:20:26.138 | 70.00th=[ 265], 80.00th=[ 277], 90.00th=[ 285], 95.00th=[ 302], 00:20:26.138 | 99.00th=[ 379], 99.50th=[ 396], 99.90th=[ 449], 99.95th=[ 529], 00:20:26.138 | 99.99th=[41157] 00:20:26.138 bw ( KiB/s): min=11848, max=17232, per=35.70%, avg=15076.80, stdev=2369.68, samples=5 00:20:26.138 iops : min= 2962, max= 4308, avg=3769.20, stdev=592.42, samples=5 00:20:26.138 lat (usec) : 250=62.57%, 500=37.36%, 750=0.02% 00:20:26.138 lat (msec) : 2=0.01%, 50=0.03% 00:20:26.138 cpu : usr=0.79%, sys=3.66%, ctx=10007, majf=0, minf=2 00:20:26.138 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:20:26.138 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:26.138 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:26.138 issued rwts: total=10006,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:26.138 latency : target=0, window=0, percentile=100.00%, depth=1 00:20:26.138 00:20:26.138 Run status group 0 (all jobs): 00:20:26.138 READ: bw=41.2MiB/s (43.2MB/s), 1238KiB/s-15.2MiB/s (1268kB/s-16.0MB/s), io=135MiB (142MB), run=2676-3282msec 00:20:26.138 00:20:26.138 Disk stats (read/write): 00:20:26.138 nvme0n1: ios=995/0, merge=0/0, ticks=4079/0, in_queue=4079, util=98.95% 00:20:26.138 nvme0n2: ios=11903/0, merge=0/0, ticks=2845/0, in_queue=2845, util=94.25% 00:20:26.138 nvme0n3: ios=10948/0, merge=0/0, ticks=2743/0, in_queue=2743, util=100.00% 00:20:26.138 nvme0n4: ios=9612/0, merge=0/0, ticks=2431/0, in_queue=2431, util=96.38% 00:20:26.397 19:06:43 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:20:26.397 19:06:43 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc3 00:20:26.397 19:06:43 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:20:26.397 19:06:43 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc4 00:20:26.656 19:06:43 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:20:26.656 19:06:43 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc5 00:20:26.916 19:06:43 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:20:26.916 19:06:43 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc6 00:20:27.175 19:06:43 -- target/fio.sh@69 -- # fio_status=0 00:20:27.175 19:06:43 -- target/fio.sh@70 -- # wait 3129774 00:20:27.175 19:06:43 -- target/fio.sh@70 -- # fio_status=4 00:20:27.176 19:06:43 -- target/fio.sh@72 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:20:27.176 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:20:27.176 19:06:43 -- target/fio.sh@73 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:20:27.176 19:06:43 -- common/autotest_common.sh@1208 -- # local i=0 00:20:27.176 19:06:43 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:27.176 19:06:43 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:20:27.176 19:06:43 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:27.176 19:06:43 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:20:27.176 19:06:44 -- common/autotest_common.sh@1220 -- # return 0 00:20:27.176 19:06:44 -- target/fio.sh@75 -- # '[' 4 -eq 0 ']' 00:20:27.176 19:06:44 -- target/fio.sh@80 -- # echo 'nvmf hotplug test: fio failed as expected' 00:20:27.176 nvmf hotplug test: fio failed as expected 00:20:27.176 19:06:44 -- target/fio.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:20:27.434 19:06:44 -- target/fio.sh@85 -- # rm -f ./local-job0-0-verify.state 00:20:27.434 19:06:44 -- target/fio.sh@86 -- # rm -f ./local-job1-1-verify.state 00:20:27.434 19:06:44 -- target/fio.sh@87 -- # rm -f ./local-job2-2-verify.state 00:20:27.434 19:06:44 -- target/fio.sh@89 -- # trap - SIGINT SIGTERM EXIT 00:20:27.434 19:06:44 -- target/fio.sh@91 -- # nvmftestfini 00:20:27.434 19:06:44 -- nvmf/common.sh@476 -- # nvmfcleanup 00:20:27.434 19:06:44 -- nvmf/common.sh@116 -- # sync 00:20:27.434 19:06:44 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:20:27.434 19:06:44 -- nvmf/common.sh@119 -- # set +e 00:20:27.434 19:06:44 -- nvmf/common.sh@120 -- # for i in {1..20} 00:20:27.434 19:06:44 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:20:27.434 rmmod nvme_tcp 00:20:27.434 rmmod nvme_fabrics 00:20:27.434 rmmod nvme_keyring 00:20:27.434 19:06:44 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:20:27.434 19:06:44 -- nvmf/common.sh@123 -- # set -e 00:20:27.434 19:06:44 -- nvmf/common.sh@124 -- # return 0 00:20:27.434 19:06:44 -- nvmf/common.sh@477 -- # '[' -n 3126898 ']' 00:20:27.434 19:06:44 -- nvmf/common.sh@478 -- # killprocess 3126898 00:20:27.434 19:06:44 -- common/autotest_common.sh@936 -- # '[' -z 3126898 ']' 00:20:27.434 19:06:44 -- common/autotest_common.sh@940 -- # kill -0 3126898 00:20:27.434 19:06:44 -- common/autotest_common.sh@941 -- # uname 00:20:27.434 19:06:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:27.434 19:06:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3126898 00:20:27.434 19:06:44 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:20:27.434 19:06:44 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:20:27.434 19:06:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3126898' 00:20:27.434 killing process with pid 3126898 00:20:27.434 19:06:44 -- common/autotest_common.sh@955 -- # kill 3126898 00:20:27.434 19:06:44 -- common/autotest_common.sh@960 -- # wait 3126898 00:20:27.693 19:06:44 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:20:27.693 19:06:44 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:20:27.693 19:06:44 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:20:27.693 19:06:44 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:20:27.693 19:06:44 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:20:27.693 19:06:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:27.693 19:06:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:27.693 19:06:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:30.224 19:06:46 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:20:30.224 00:20:30.224 real 0m26.727s 00:20:30.224 user 1m47.904s 00:20:30.224 sys 0m8.806s 00:20:30.224 19:06:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:20:30.224 19:06:46 -- common/autotest_common.sh@10 -- # set +x 00:20:30.224 ************************************ 00:20:30.224 END TEST nvmf_fio_target 00:20:30.224 ************************************ 00:20:30.224 19:06:46 -- nvmf/nvmf.sh@55 -- # run_test nvmf_bdevio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:20:30.224 19:06:46 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:20:30.224 19:06:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:20:30.224 19:06:46 -- common/autotest_common.sh@10 -- # set +x 00:20:30.224 ************************************ 00:20:30.224 START TEST nvmf_bdevio 00:20:30.224 ************************************ 00:20:30.224 19:06:46 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:20:30.224 * Looking for test storage... 00:20:30.224 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:20:30.224 19:06:46 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:20:30.224 19:06:46 -- common/autotest_common.sh@1690 -- # lcov --version 00:20:30.224 19:06:46 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:20:30.224 19:06:46 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:20:30.224 19:06:46 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:20:30.224 19:06:46 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:20:30.224 19:06:46 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:20:30.224 19:06:46 -- scripts/common.sh@335 -- # IFS=.-: 00:20:30.224 19:06:46 -- scripts/common.sh@335 -- # read -ra ver1 00:20:30.224 19:06:46 -- scripts/common.sh@336 -- # IFS=.-: 00:20:30.224 19:06:46 -- scripts/common.sh@336 -- # read -ra ver2 00:20:30.224 19:06:46 -- scripts/common.sh@337 -- # local 'op=<' 00:20:30.224 19:06:46 -- scripts/common.sh@339 -- # ver1_l=2 00:20:30.224 19:06:46 -- scripts/common.sh@340 -- # ver2_l=1 00:20:30.224 19:06:46 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:20:30.224 19:06:46 -- scripts/common.sh@343 -- # case "$op" in 00:20:30.224 19:06:46 -- scripts/common.sh@344 -- # : 1 00:20:30.224 19:06:46 -- scripts/common.sh@363 -- # (( v = 0 )) 00:20:30.224 19:06:46 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:20:30.224 19:06:46 -- scripts/common.sh@364 -- # decimal 1 00:20:30.224 19:06:46 -- scripts/common.sh@352 -- # local d=1 00:20:30.224 19:06:46 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:20:30.224 19:06:46 -- scripts/common.sh@354 -- # echo 1 00:20:30.224 19:06:46 -- scripts/common.sh@364 -- # ver1[v]=1 00:20:30.224 19:06:46 -- scripts/common.sh@365 -- # decimal 2 00:20:30.224 19:06:46 -- scripts/common.sh@352 -- # local d=2 00:20:30.224 19:06:46 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:20:30.224 19:06:46 -- scripts/common.sh@354 -- # echo 2 00:20:30.224 19:06:46 -- scripts/common.sh@365 -- # ver2[v]=2 00:20:30.224 19:06:46 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:20:30.224 19:06:46 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:20:30.224 19:06:46 -- scripts/common.sh@367 -- # return 0 00:20:30.224 19:06:46 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:20:30.224 19:06:46 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:20:30.224 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:30.224 --rc genhtml_branch_coverage=1 00:20:30.224 --rc genhtml_function_coverage=1 00:20:30.224 --rc genhtml_legend=1 00:20:30.224 --rc geninfo_all_blocks=1 00:20:30.224 --rc geninfo_unexecuted_blocks=1 00:20:30.224 00:20:30.224 ' 00:20:30.224 19:06:46 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:20:30.224 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:30.224 --rc genhtml_branch_coverage=1 00:20:30.224 --rc genhtml_function_coverage=1 00:20:30.224 --rc genhtml_legend=1 00:20:30.224 --rc geninfo_all_blocks=1 00:20:30.224 --rc geninfo_unexecuted_blocks=1 00:20:30.224 00:20:30.224 ' 00:20:30.224 19:06:46 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:20:30.224 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:30.224 --rc genhtml_branch_coverage=1 00:20:30.224 --rc genhtml_function_coverage=1 00:20:30.224 --rc genhtml_legend=1 00:20:30.224 --rc geninfo_all_blocks=1 00:20:30.224 --rc geninfo_unexecuted_blocks=1 00:20:30.224 00:20:30.224 ' 00:20:30.224 19:06:46 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:20:30.225 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:30.225 --rc genhtml_branch_coverage=1 00:20:30.225 --rc genhtml_function_coverage=1 00:20:30.225 --rc genhtml_legend=1 00:20:30.225 --rc geninfo_all_blocks=1 00:20:30.225 --rc geninfo_unexecuted_blocks=1 00:20:30.225 00:20:30.225 ' 00:20:30.225 19:06:46 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:20:30.225 19:06:46 -- nvmf/common.sh@7 -- # uname -s 00:20:30.225 19:06:46 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:30.225 19:06:46 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:30.225 19:06:46 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:30.225 19:06:46 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:30.225 19:06:46 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:30.225 19:06:46 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:30.225 19:06:46 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:30.225 19:06:46 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:30.225 19:06:46 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:30.225 19:06:46 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:30.225 19:06:46 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:20:30.225 19:06:46 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:20:30.225 19:06:46 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:30.225 19:06:46 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:30.225 19:06:46 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:30.225 19:06:46 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:20:30.225 19:06:46 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:30.225 19:06:46 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:30.225 19:06:46 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:30.225 19:06:46 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:30.225 19:06:46 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:30.225 19:06:46 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:30.225 19:06:46 -- paths/export.sh@5 -- # export PATH 00:20:30.225 19:06:46 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:30.225 19:06:46 -- nvmf/common.sh@46 -- # : 0 00:20:30.225 19:06:46 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:20:30.225 19:06:46 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:20:30.225 19:06:46 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:20:30.225 19:06:46 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:30.225 19:06:46 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:30.225 19:06:46 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:20:30.225 19:06:46 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:20:30.225 19:06:46 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:20:30.225 19:06:46 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:20:30.225 19:06:46 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:20:30.225 19:06:46 -- target/bdevio.sh@14 -- # nvmftestinit 00:20:30.225 19:06:46 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:20:30.225 19:06:46 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:30.225 19:06:46 -- nvmf/common.sh@436 -- # prepare_net_devs 00:20:30.225 19:06:46 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:20:30.225 19:06:46 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:20:30.225 19:06:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:30.225 19:06:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:30.225 19:06:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:30.225 19:06:46 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:20:30.225 19:06:46 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:20:30.225 19:06:46 -- nvmf/common.sh@284 -- # xtrace_disable 00:20:30.225 19:06:46 -- common/autotest_common.sh@10 -- # set +x 00:20:35.500 19:06:52 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:35.500 19:06:52 -- nvmf/common.sh@290 -- # pci_devs=() 00:20:35.500 19:06:52 -- nvmf/common.sh@290 -- # local -a pci_devs 00:20:35.500 19:06:52 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:20:35.500 19:06:52 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:20:35.500 19:06:52 -- nvmf/common.sh@292 -- # pci_drivers=() 00:20:35.500 19:06:52 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:20:35.500 19:06:52 -- nvmf/common.sh@294 -- # net_devs=() 00:20:35.500 19:06:52 -- nvmf/common.sh@294 -- # local -ga net_devs 00:20:35.500 19:06:52 -- nvmf/common.sh@295 -- # e810=() 00:20:35.500 19:06:52 -- nvmf/common.sh@295 -- # local -ga e810 00:20:35.500 19:06:52 -- nvmf/common.sh@296 -- # x722=() 00:20:35.500 19:06:52 -- nvmf/common.sh@296 -- # local -ga x722 00:20:35.500 19:06:52 -- nvmf/common.sh@297 -- # mlx=() 00:20:35.500 19:06:52 -- nvmf/common.sh@297 -- # local -ga mlx 00:20:35.501 19:06:52 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:35.501 19:06:52 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:35.501 19:06:52 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:35.501 19:06:52 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:35.501 19:06:52 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:35.501 19:06:52 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:35.501 19:06:52 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:35.501 19:06:52 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:35.501 19:06:52 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:35.501 19:06:52 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:35.501 19:06:52 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:35.501 19:06:52 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:20:35.501 19:06:52 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:20:35.501 19:06:52 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:20:35.501 19:06:52 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:20:35.501 19:06:52 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:20:35.501 19:06:52 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:20:35.501 19:06:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:35.501 19:06:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:20:35.501 Found 0000:86:00.0 (0x8086 - 0x159b) 00:20:35.501 19:06:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:35.501 19:06:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:35.501 19:06:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:35.501 19:06:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:35.501 19:06:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:35.501 19:06:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:35.501 19:06:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:20:35.501 Found 0000:86:00.1 (0x8086 - 0x159b) 00:20:35.501 19:06:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:35.501 19:06:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:35.501 19:06:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:35.501 19:06:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:35.501 19:06:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:35.501 19:06:52 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:20:35.501 19:06:52 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:20:35.501 19:06:52 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:20:35.501 19:06:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:35.501 19:06:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:35.501 19:06:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:35.501 19:06:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:35.501 19:06:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:20:35.501 Found net devices under 0000:86:00.0: cvl_0_0 00:20:35.501 19:06:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:35.501 19:06:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:35.501 19:06:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:35.501 19:06:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:35.501 19:06:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:35.501 19:06:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:20:35.501 Found net devices under 0000:86:00.1: cvl_0_1 00:20:35.501 19:06:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:35.501 19:06:52 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:20:35.501 19:06:52 -- nvmf/common.sh@402 -- # is_hw=yes 00:20:35.501 19:06:52 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:20:35.501 19:06:52 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:20:35.501 19:06:52 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:20:35.501 19:06:52 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:20:35.501 19:06:52 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:20:35.501 19:06:52 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:20:35.501 19:06:52 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:20:35.501 19:06:52 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:20:35.501 19:06:52 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:20:35.501 19:06:52 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:20:35.501 19:06:52 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:20:35.501 19:06:52 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:20:35.501 19:06:52 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:20:35.501 19:06:52 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:20:35.501 19:06:52 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:20:35.501 19:06:52 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:20:35.501 19:06:52 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:20:35.501 19:06:52 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:20:35.501 19:06:52 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:20:35.501 19:06:52 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:20:35.501 19:06:52 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:20:35.501 19:06:52 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:20:35.501 19:06:52 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:20:35.501 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:20:35.501 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.421 ms 00:20:35.501 00:20:35.501 --- 10.0.0.2 ping statistics --- 00:20:35.501 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:35.501 rtt min/avg/max/mdev = 0.421/0.421/0.421/0.000 ms 00:20:35.501 19:06:52 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:20:35.501 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:20:35.501 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.109 ms 00:20:35.501 00:20:35.501 --- 10.0.0.1 ping statistics --- 00:20:35.501 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:35.501 rtt min/avg/max/mdev = 0.109/0.109/0.109/0.000 ms 00:20:35.501 19:06:52 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:20:35.501 19:06:52 -- nvmf/common.sh@410 -- # return 0 00:20:35.501 19:06:52 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:20:35.501 19:06:52 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:20:35.501 19:06:52 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:20:35.501 19:06:52 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:20:35.501 19:06:52 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:20:35.501 19:06:52 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:20:35.501 19:06:52 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:20:35.501 19:06:52 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:20:35.501 19:06:52 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:35.501 19:06:52 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:35.501 19:06:52 -- common/autotest_common.sh@10 -- # set +x 00:20:35.501 19:06:52 -- nvmf/common.sh@469 -- # nvmfpid=3134185 00:20:35.501 19:06:52 -- nvmf/common.sh@470 -- # waitforlisten 3134185 00:20:35.501 19:06:52 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x78 00:20:35.501 19:06:52 -- common/autotest_common.sh@829 -- # '[' -z 3134185 ']' 00:20:35.501 19:06:52 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:35.501 19:06:52 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:35.501 19:06:52 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:35.501 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:35.501 19:06:52 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:35.501 19:06:52 -- common/autotest_common.sh@10 -- # set +x 00:20:35.501 [2024-11-26 19:06:52.374636] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:35.501 [2024-11-26 19:06:52.374677] [ DPDK EAL parameters: nvmf -c 0x78 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:35.501 EAL: No free 2048 kB hugepages reported on node 1 00:20:35.759 [2024-11-26 19:06:52.436966] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:20:35.760 [2024-11-26 19:06:52.475796] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:35.760 [2024-11-26 19:06:52.475915] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:35.760 [2024-11-26 19:06:52.475925] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:35.760 [2024-11-26 19:06:52.475933] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:35.760 [2024-11-26 19:06:52.475984] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:20:35.760 [2024-11-26 19:06:52.476077] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:20:35.760 [2024-11-26 19:06:52.476187] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:20:35.760 [2024-11-26 19:06:52.476188] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:20:36.423 19:06:53 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:36.423 19:06:53 -- common/autotest_common.sh@862 -- # return 0 00:20:36.423 19:06:53 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:36.423 19:06:53 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:36.423 19:06:53 -- common/autotest_common.sh@10 -- # set +x 00:20:36.423 19:06:53 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:36.423 19:06:53 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:20:36.423 19:06:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:36.423 19:06:53 -- common/autotest_common.sh@10 -- # set +x 00:20:36.423 [2024-11-26 19:06:53.239479] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:36.423 19:06:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:36.423 19:06:53 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:20:36.423 19:06:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:36.423 19:06:53 -- common/autotest_common.sh@10 -- # set +x 00:20:36.423 Malloc0 00:20:36.423 19:06:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:36.423 19:06:53 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:20:36.423 19:06:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:36.423 19:06:53 -- common/autotest_common.sh@10 -- # set +x 00:20:36.423 19:06:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:36.423 19:06:53 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:20:36.423 19:06:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:36.423 19:06:53 -- common/autotest_common.sh@10 -- # set +x 00:20:36.423 19:06:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:36.423 19:06:53 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:20:36.423 19:06:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:36.423 19:06:53 -- common/autotest_common.sh@10 -- # set +x 00:20:36.423 [2024-11-26 19:06:53.283327] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:36.423 19:06:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:36.423 19:06:53 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 00:20:36.423 19:06:53 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:20:36.423 19:06:53 -- nvmf/common.sh@520 -- # config=() 00:20:36.423 19:06:53 -- nvmf/common.sh@520 -- # local subsystem config 00:20:36.423 19:06:53 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:20:36.423 19:06:53 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:20:36.423 { 00:20:36.423 "params": { 00:20:36.423 "name": "Nvme$subsystem", 00:20:36.423 "trtype": "$TEST_TRANSPORT", 00:20:36.423 "traddr": "$NVMF_FIRST_TARGET_IP", 00:20:36.423 "adrfam": "ipv4", 00:20:36.423 "trsvcid": "$NVMF_PORT", 00:20:36.423 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:20:36.423 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:20:36.423 "hdgst": ${hdgst:-false}, 00:20:36.423 "ddgst": ${ddgst:-false} 00:20:36.423 }, 00:20:36.423 "method": "bdev_nvme_attach_controller" 00:20:36.423 } 00:20:36.423 EOF 00:20:36.423 )") 00:20:36.423 19:06:53 -- nvmf/common.sh@542 -- # cat 00:20:36.423 19:06:53 -- nvmf/common.sh@544 -- # jq . 00:20:36.423 19:06:53 -- nvmf/common.sh@545 -- # IFS=, 00:20:36.423 19:06:53 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:20:36.423 "params": { 00:20:36.423 "name": "Nvme1", 00:20:36.423 "trtype": "tcp", 00:20:36.423 "traddr": "10.0.0.2", 00:20:36.423 "adrfam": "ipv4", 00:20:36.423 "trsvcid": "4420", 00:20:36.423 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:36.423 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:36.423 "hdgst": false, 00:20:36.423 "ddgst": false 00:20:36.423 }, 00:20:36.423 "method": "bdev_nvme_attach_controller" 00:20:36.423 }' 00:20:36.423 [2024-11-26 19:06:53.330418] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:36.423 [2024-11-26 19:06:53.330459] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3134437 ] 00:20:36.683 EAL: No free 2048 kB hugepages reported on node 1 00:20:36.683 [2024-11-26 19:06:53.385872] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:20:36.683 [2024-11-26 19:06:53.426054] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:36.683 [2024-11-26 19:06:53.426150] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:36.683 [2024-11-26 19:06:53.426152] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:20:36.942 [2024-11-26 19:06:53.614859] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:20:36.942 [2024-11-26 19:06:53.614892] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:20:36.942 I/O targets: 00:20:36.942 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:20:36.942 00:20:36.942 00:20:36.942 CUnit - A unit testing framework for C - Version 2.1-3 00:20:36.942 http://cunit.sourceforge.net/ 00:20:36.942 00:20:36.942 00:20:36.942 Suite: bdevio tests on: Nvme1n1 00:20:36.942 Test: blockdev write read block ...passed 00:20:36.942 Test: blockdev write zeroes read block ...passed 00:20:36.942 Test: blockdev write zeroes read no split ...passed 00:20:36.942 Test: blockdev write zeroes read split ...passed 00:20:36.942 Test: blockdev write zeroes read split partial ...passed 00:20:36.942 Test: blockdev reset ...[2024-11-26 19:06:53.769904] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:20:36.942 [2024-11-26 19:06:53.769963] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x25244f0 (9): Bad file descriptor 00:20:37.201 [2024-11-26 19:06:53.905173] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:20:37.201 passed 00:20:37.201 Test: blockdev write read 8 blocks ...passed 00:20:37.201 Test: blockdev write read size > 128k ...passed 00:20:37.201 Test: blockdev write read invalid size ...passed 00:20:37.201 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:20:37.201 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:20:37.201 Test: blockdev write read max offset ...passed 00:20:37.201 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:20:37.201 Test: blockdev writev readv 8 blocks ...passed 00:20:37.201 Test: blockdev writev readv 30 x 1block ...passed 00:20:37.201 Test: blockdev writev readv block ...passed 00:20:37.460 Test: blockdev writev readv size > 128k ...passed 00:20:37.460 Test: blockdev writev readv size > 128k in two iovs ...passed 00:20:37.460 Test: blockdev comparev and writev ...[2024-11-26 19:06:54.158811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:37.460 [2024-11-26 19:06:54.158846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:37.460 [2024-11-26 19:06:54.158861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:37.460 [2024-11-26 19:06:54.158869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:20:37.460 [2024-11-26 19:06:54.159112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:37.460 [2024-11-26 19:06:54.159124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:20:37.460 [2024-11-26 19:06:54.159135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:37.460 [2024-11-26 19:06:54.159142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:20:37.460 [2024-11-26 19:06:54.159371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:37.460 [2024-11-26 19:06:54.159383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:20:37.460 [2024-11-26 19:06:54.159396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:37.460 [2024-11-26 19:06:54.159404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:20:37.461 [2024-11-26 19:06:54.159641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:37.461 [2024-11-26 19:06:54.159652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:20:37.461 [2024-11-26 19:06:54.159664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:37.461 [2024-11-26 19:06:54.159672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:20:37.461 passed 00:20:37.461 Test: blockdev nvme passthru rw ...passed 00:20:37.461 Test: blockdev nvme passthru vendor specific ...[2024-11-26 19:06:54.241229] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:20:37.461 [2024-11-26 19:06:54.241248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:20:37.461 [2024-11-26 19:06:54.241361] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:20:37.461 [2024-11-26 19:06:54.241371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:20:37.461 [2024-11-26 19:06:54.241480] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:20:37.461 [2024-11-26 19:06:54.241490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:20:37.461 [2024-11-26 19:06:54.241600] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:20:37.461 [2024-11-26 19:06:54.241611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:20:37.461 passed 00:20:37.461 Test: blockdev nvme admin passthru ...passed 00:20:37.461 Test: blockdev copy ...passed 00:20:37.461 00:20:37.461 Run Summary: Type Total Ran Passed Failed Inactive 00:20:37.461 suites 1 1 n/a 0 0 00:20:37.461 tests 23 23 23 0 0 00:20:37.461 asserts 152 152 152 0 n/a 00:20:37.461 00:20:37.461 Elapsed time = 1.371 seconds 00:20:37.720 19:06:54 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:20:37.720 19:06:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:37.720 19:06:54 -- common/autotest_common.sh@10 -- # set +x 00:20:37.720 19:06:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:37.720 19:06:54 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:20:37.720 19:06:54 -- target/bdevio.sh@30 -- # nvmftestfini 00:20:37.720 19:06:54 -- nvmf/common.sh@476 -- # nvmfcleanup 00:20:37.720 19:06:54 -- nvmf/common.sh@116 -- # sync 00:20:37.720 19:06:54 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:20:37.720 19:06:54 -- nvmf/common.sh@119 -- # set +e 00:20:37.720 19:06:54 -- nvmf/common.sh@120 -- # for i in {1..20} 00:20:37.720 19:06:54 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:20:37.720 rmmod nvme_tcp 00:20:37.720 rmmod nvme_fabrics 00:20:37.720 rmmod nvme_keyring 00:20:37.720 19:06:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:20:37.720 19:06:54 -- nvmf/common.sh@123 -- # set -e 00:20:37.720 19:06:54 -- nvmf/common.sh@124 -- # return 0 00:20:37.720 19:06:54 -- nvmf/common.sh@477 -- # '[' -n 3134185 ']' 00:20:37.720 19:06:54 -- nvmf/common.sh@478 -- # killprocess 3134185 00:20:37.720 19:06:54 -- common/autotest_common.sh@936 -- # '[' -z 3134185 ']' 00:20:37.720 19:06:54 -- common/autotest_common.sh@940 -- # kill -0 3134185 00:20:37.720 19:06:54 -- common/autotest_common.sh@941 -- # uname 00:20:37.720 19:06:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:37.720 19:06:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3134185 00:20:37.720 19:06:54 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:20:37.720 19:06:54 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:20:37.720 19:06:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3134185' 00:20:37.720 killing process with pid 3134185 00:20:37.720 19:06:54 -- common/autotest_common.sh@955 -- # kill 3134185 00:20:37.721 19:06:54 -- common/autotest_common.sh@960 -- # wait 3134185 00:20:37.980 19:06:54 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:20:37.980 19:06:54 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:20:37.980 19:06:54 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:20:37.980 19:06:54 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:20:37.980 19:06:54 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:20:37.980 19:06:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:37.980 19:06:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:37.980 19:06:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:39.888 19:06:56 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:20:40.148 00:20:40.148 real 0m10.204s 00:20:40.148 user 0m12.887s 00:20:40.148 sys 0m4.723s 00:20:40.148 19:06:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:20:40.148 19:06:56 -- common/autotest_common.sh@10 -- # set +x 00:20:40.148 ************************************ 00:20:40.148 END TEST nvmf_bdevio 00:20:40.148 ************************************ 00:20:40.148 19:06:56 -- nvmf/nvmf.sh@57 -- # '[' tcp = tcp ']' 00:20:40.148 19:06:56 -- nvmf/nvmf.sh@58 -- # run_test nvmf_bdevio_no_huge /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:20:40.148 19:06:56 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:20:40.148 19:06:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:20:40.148 19:06:56 -- common/autotest_common.sh@10 -- # set +x 00:20:40.148 ************************************ 00:20:40.148 START TEST nvmf_bdevio_no_huge 00:20:40.148 ************************************ 00:20:40.148 19:06:56 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:20:40.148 * Looking for test storage... 00:20:40.148 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:20:40.148 19:06:56 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:20:40.148 19:06:56 -- common/autotest_common.sh@1690 -- # lcov --version 00:20:40.148 19:06:56 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:20:40.148 19:06:56 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:20:40.148 19:06:56 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:20:40.148 19:06:57 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:20:40.148 19:06:57 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:20:40.148 19:06:57 -- scripts/common.sh@335 -- # IFS=.-: 00:20:40.148 19:06:57 -- scripts/common.sh@335 -- # read -ra ver1 00:20:40.148 19:06:57 -- scripts/common.sh@336 -- # IFS=.-: 00:20:40.148 19:06:57 -- scripts/common.sh@336 -- # read -ra ver2 00:20:40.148 19:06:57 -- scripts/common.sh@337 -- # local 'op=<' 00:20:40.148 19:06:57 -- scripts/common.sh@339 -- # ver1_l=2 00:20:40.148 19:06:57 -- scripts/common.sh@340 -- # ver2_l=1 00:20:40.148 19:06:57 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:20:40.148 19:06:57 -- scripts/common.sh@343 -- # case "$op" in 00:20:40.148 19:06:57 -- scripts/common.sh@344 -- # : 1 00:20:40.148 19:06:57 -- scripts/common.sh@363 -- # (( v = 0 )) 00:20:40.148 19:06:57 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:20:40.148 19:06:57 -- scripts/common.sh@364 -- # decimal 1 00:20:40.148 19:06:57 -- scripts/common.sh@352 -- # local d=1 00:20:40.148 19:06:57 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:20:40.148 19:06:57 -- scripts/common.sh@354 -- # echo 1 00:20:40.148 19:06:57 -- scripts/common.sh@364 -- # ver1[v]=1 00:20:40.148 19:06:57 -- scripts/common.sh@365 -- # decimal 2 00:20:40.148 19:06:57 -- scripts/common.sh@352 -- # local d=2 00:20:40.148 19:06:57 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:20:40.148 19:06:57 -- scripts/common.sh@354 -- # echo 2 00:20:40.148 19:06:57 -- scripts/common.sh@365 -- # ver2[v]=2 00:20:40.148 19:06:57 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:20:40.148 19:06:57 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:20:40.148 19:06:57 -- scripts/common.sh@367 -- # return 0 00:20:40.148 19:06:57 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:20:40.148 19:06:57 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:20:40.148 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:40.148 --rc genhtml_branch_coverage=1 00:20:40.148 --rc genhtml_function_coverage=1 00:20:40.148 --rc genhtml_legend=1 00:20:40.148 --rc geninfo_all_blocks=1 00:20:40.148 --rc geninfo_unexecuted_blocks=1 00:20:40.148 00:20:40.148 ' 00:20:40.148 19:06:57 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:20:40.148 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:40.148 --rc genhtml_branch_coverage=1 00:20:40.148 --rc genhtml_function_coverage=1 00:20:40.148 --rc genhtml_legend=1 00:20:40.148 --rc geninfo_all_blocks=1 00:20:40.148 --rc geninfo_unexecuted_blocks=1 00:20:40.148 00:20:40.148 ' 00:20:40.148 19:06:57 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:20:40.148 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:40.148 --rc genhtml_branch_coverage=1 00:20:40.148 --rc genhtml_function_coverage=1 00:20:40.148 --rc genhtml_legend=1 00:20:40.148 --rc geninfo_all_blocks=1 00:20:40.148 --rc geninfo_unexecuted_blocks=1 00:20:40.148 00:20:40.148 ' 00:20:40.148 19:06:57 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:20:40.148 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:40.148 --rc genhtml_branch_coverage=1 00:20:40.148 --rc genhtml_function_coverage=1 00:20:40.148 --rc genhtml_legend=1 00:20:40.148 --rc geninfo_all_blocks=1 00:20:40.148 --rc geninfo_unexecuted_blocks=1 00:20:40.148 00:20:40.148 ' 00:20:40.148 19:06:57 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:20:40.148 19:06:57 -- nvmf/common.sh@7 -- # uname -s 00:20:40.148 19:06:57 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:40.148 19:06:57 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:40.148 19:06:57 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:40.148 19:06:57 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:40.148 19:06:57 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:40.148 19:06:57 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:40.148 19:06:57 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:40.148 19:06:57 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:40.148 19:06:57 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:40.148 19:06:57 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:40.148 19:06:57 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:20:40.148 19:06:57 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:20:40.148 19:06:57 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:40.148 19:06:57 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:40.148 19:06:57 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:40.148 19:06:57 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:20:40.148 19:06:57 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:40.148 19:06:57 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:40.148 19:06:57 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:40.148 19:06:57 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:40.149 19:06:57 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:40.149 19:06:57 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:40.149 19:06:57 -- paths/export.sh@5 -- # export PATH 00:20:40.149 19:06:57 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:40.149 19:06:57 -- nvmf/common.sh@46 -- # : 0 00:20:40.149 19:06:57 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:20:40.149 19:06:57 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:20:40.149 19:06:57 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:20:40.149 19:06:57 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:40.149 19:06:57 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:40.149 19:06:57 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:20:40.149 19:06:57 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:20:40.149 19:06:57 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:20:40.149 19:06:57 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:20:40.149 19:06:57 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:20:40.149 19:06:57 -- target/bdevio.sh@14 -- # nvmftestinit 00:20:40.149 19:06:57 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:20:40.149 19:06:57 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:40.149 19:06:57 -- nvmf/common.sh@436 -- # prepare_net_devs 00:20:40.149 19:06:57 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:20:40.149 19:06:57 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:20:40.149 19:06:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:40.149 19:06:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:40.149 19:06:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:40.149 19:06:57 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:20:40.149 19:06:57 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:20:40.149 19:06:57 -- nvmf/common.sh@284 -- # xtrace_disable 00:20:40.149 19:06:57 -- common/autotest_common.sh@10 -- # set +x 00:20:45.426 19:07:02 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:45.426 19:07:02 -- nvmf/common.sh@290 -- # pci_devs=() 00:20:45.426 19:07:02 -- nvmf/common.sh@290 -- # local -a pci_devs 00:20:45.426 19:07:02 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:20:45.426 19:07:02 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:20:45.426 19:07:02 -- nvmf/common.sh@292 -- # pci_drivers=() 00:20:45.426 19:07:02 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:20:45.426 19:07:02 -- nvmf/common.sh@294 -- # net_devs=() 00:20:45.426 19:07:02 -- nvmf/common.sh@294 -- # local -ga net_devs 00:20:45.426 19:07:02 -- nvmf/common.sh@295 -- # e810=() 00:20:45.426 19:07:02 -- nvmf/common.sh@295 -- # local -ga e810 00:20:45.426 19:07:02 -- nvmf/common.sh@296 -- # x722=() 00:20:45.426 19:07:02 -- nvmf/common.sh@296 -- # local -ga x722 00:20:45.426 19:07:02 -- nvmf/common.sh@297 -- # mlx=() 00:20:45.426 19:07:02 -- nvmf/common.sh@297 -- # local -ga mlx 00:20:45.426 19:07:02 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:45.426 19:07:02 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:45.426 19:07:02 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:45.426 19:07:02 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:45.426 19:07:02 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:45.426 19:07:02 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:45.426 19:07:02 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:45.426 19:07:02 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:45.426 19:07:02 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:45.426 19:07:02 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:45.426 19:07:02 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:45.426 19:07:02 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:20:45.426 19:07:02 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:20:45.426 19:07:02 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:20:45.426 19:07:02 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:20:45.426 19:07:02 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:20:45.426 19:07:02 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:20:45.426 19:07:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:45.426 19:07:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:20:45.426 Found 0000:86:00.0 (0x8086 - 0x159b) 00:20:45.426 19:07:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:45.426 19:07:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:45.426 19:07:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:45.426 19:07:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:45.426 19:07:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:45.426 19:07:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:45.426 19:07:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:20:45.426 Found 0000:86:00.1 (0x8086 - 0x159b) 00:20:45.426 19:07:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:45.426 19:07:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:45.426 19:07:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:45.426 19:07:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:45.426 19:07:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:45.426 19:07:02 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:20:45.426 19:07:02 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:20:45.426 19:07:02 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:20:45.426 19:07:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:45.426 19:07:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:45.426 19:07:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:45.426 19:07:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:45.426 19:07:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:20:45.427 Found net devices under 0000:86:00.0: cvl_0_0 00:20:45.427 19:07:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:45.427 19:07:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:45.427 19:07:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:45.427 19:07:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:45.427 19:07:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:45.427 19:07:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:20:45.427 Found net devices under 0000:86:00.1: cvl_0_1 00:20:45.427 19:07:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:45.427 19:07:02 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:20:45.427 19:07:02 -- nvmf/common.sh@402 -- # is_hw=yes 00:20:45.427 19:07:02 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:20:45.427 19:07:02 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:20:45.427 19:07:02 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:20:45.427 19:07:02 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:20:45.427 19:07:02 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:20:45.427 19:07:02 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:20:45.427 19:07:02 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:20:45.427 19:07:02 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:20:45.427 19:07:02 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:20:45.427 19:07:02 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:20:45.427 19:07:02 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:20:45.427 19:07:02 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:20:45.427 19:07:02 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:20:45.427 19:07:02 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:20:45.427 19:07:02 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:20:45.427 19:07:02 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:20:45.427 19:07:02 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:20:45.427 19:07:02 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:20:45.427 19:07:02 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:20:45.427 19:07:02 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:20:45.427 19:07:02 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:20:45.427 19:07:02 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:20:45.687 19:07:02 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:20:45.687 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:20:45.687 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.477 ms 00:20:45.687 00:20:45.687 --- 10.0.0.2 ping statistics --- 00:20:45.687 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:45.687 rtt min/avg/max/mdev = 0.477/0.477/0.477/0.000 ms 00:20:45.687 19:07:02 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:20:45.687 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:20:45.687 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.203 ms 00:20:45.687 00:20:45.687 --- 10.0.0.1 ping statistics --- 00:20:45.687 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:45.687 rtt min/avg/max/mdev = 0.203/0.203/0.203/0.000 ms 00:20:45.687 19:07:02 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:20:45.687 19:07:02 -- nvmf/common.sh@410 -- # return 0 00:20:45.687 19:07:02 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:20:45.687 19:07:02 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:20:45.687 19:07:02 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:20:45.687 19:07:02 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:20:45.687 19:07:02 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:20:45.687 19:07:02 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:20:45.687 19:07:02 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:20:45.687 19:07:02 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:20:45.687 19:07:02 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:45.687 19:07:02 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:45.687 19:07:02 -- common/autotest_common.sh@10 -- # set +x 00:20:45.687 19:07:02 -- nvmf/common.sh@469 -- # nvmfpid=3137991 00:20:45.687 19:07:02 -- nvmf/common.sh@470 -- # waitforlisten 3137991 00:20:45.687 19:07:02 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --no-huge -s 1024 -m 0x78 00:20:45.687 19:07:02 -- common/autotest_common.sh@829 -- # '[' -z 3137991 ']' 00:20:45.687 19:07:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:45.687 19:07:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:45.687 19:07:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:45.687 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:45.687 19:07:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:45.687 19:07:02 -- common/autotest_common.sh@10 -- # set +x 00:20:45.687 [2024-11-26 19:07:02.448522] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:45.687 [2024-11-26 19:07:02.448571] [ DPDK EAL parameters: nvmf -c 0x78 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk0 --proc-type=auto ] 00:20:45.687 [2024-11-26 19:07:02.510604] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:20:45.687 [2024-11-26 19:07:02.574665] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:45.687 [2024-11-26 19:07:02.574775] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:45.687 [2024-11-26 19:07:02.574782] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:45.687 [2024-11-26 19:07:02.574789] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:45.687 [2024-11-26 19:07:02.574894] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:20:45.687 [2024-11-26 19:07:02.575005] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:20:45.687 [2024-11-26 19:07:02.575114] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:20:45.687 [2024-11-26 19:07:02.575115] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:20:46.626 19:07:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:46.626 19:07:03 -- common/autotest_common.sh@862 -- # return 0 00:20:46.626 19:07:03 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:46.626 19:07:03 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:46.626 19:07:03 -- common/autotest_common.sh@10 -- # set +x 00:20:46.626 19:07:03 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:46.626 19:07:03 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:20:46.626 19:07:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:46.626 19:07:03 -- common/autotest_common.sh@10 -- # set +x 00:20:46.626 [2024-11-26 19:07:03.317395] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:46.626 19:07:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:46.626 19:07:03 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:20:46.626 19:07:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:46.626 19:07:03 -- common/autotest_common.sh@10 -- # set +x 00:20:46.626 Malloc0 00:20:46.626 19:07:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:46.626 19:07:03 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:20:46.626 19:07:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:46.626 19:07:03 -- common/autotest_common.sh@10 -- # set +x 00:20:46.626 19:07:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:46.626 19:07:03 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:20:46.626 19:07:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:46.626 19:07:03 -- common/autotest_common.sh@10 -- # set +x 00:20:46.626 19:07:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:46.626 19:07:03 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:20:46.626 19:07:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:46.626 19:07:03 -- common/autotest_common.sh@10 -- # set +x 00:20:46.626 [2024-11-26 19:07:03.353659] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:46.626 19:07:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:46.626 19:07:03 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 --no-huge -s 1024 00:20:46.626 19:07:03 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:20:46.626 19:07:03 -- nvmf/common.sh@520 -- # config=() 00:20:46.626 19:07:03 -- nvmf/common.sh@520 -- # local subsystem config 00:20:46.626 19:07:03 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:20:46.626 19:07:03 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:20:46.626 { 00:20:46.626 "params": { 00:20:46.626 "name": "Nvme$subsystem", 00:20:46.626 "trtype": "$TEST_TRANSPORT", 00:20:46.626 "traddr": "$NVMF_FIRST_TARGET_IP", 00:20:46.626 "adrfam": "ipv4", 00:20:46.626 "trsvcid": "$NVMF_PORT", 00:20:46.626 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:20:46.626 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:20:46.626 "hdgst": ${hdgst:-false}, 00:20:46.626 "ddgst": ${ddgst:-false} 00:20:46.626 }, 00:20:46.626 "method": "bdev_nvme_attach_controller" 00:20:46.626 } 00:20:46.626 EOF 00:20:46.626 )") 00:20:46.626 19:07:03 -- nvmf/common.sh@542 -- # cat 00:20:46.626 19:07:03 -- nvmf/common.sh@544 -- # jq . 00:20:46.626 19:07:03 -- nvmf/common.sh@545 -- # IFS=, 00:20:46.626 19:07:03 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:20:46.626 "params": { 00:20:46.626 "name": "Nvme1", 00:20:46.626 "trtype": "tcp", 00:20:46.626 "traddr": "10.0.0.2", 00:20:46.626 "adrfam": "ipv4", 00:20:46.626 "trsvcid": "4420", 00:20:46.626 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:46.626 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:46.626 "hdgst": false, 00:20:46.626 "ddgst": false 00:20:46.626 }, 00:20:46.626 "method": "bdev_nvme_attach_controller" 00:20:46.626 }' 00:20:46.626 [2024-11-26 19:07:03.401639] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:46.626 [2024-11-26 19:07:03.401684] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk_pid3138244 ] 00:20:46.626 [2024-11-26 19:07:03.458325] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:20:46.626 [2024-11-26 19:07:03.523066] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:46.626 [2024-11-26 19:07:03.523160] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:46.626 [2024-11-26 19:07:03.523162] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:20:46.886 [2024-11-26 19:07:03.658922] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:20:46.886 [2024-11-26 19:07:03.658959] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:20:46.886 I/O targets: 00:20:46.886 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:20:46.886 00:20:46.886 00:20:46.886 CUnit - A unit testing framework for C - Version 2.1-3 00:20:46.886 http://cunit.sourceforge.net/ 00:20:46.886 00:20:46.886 00:20:46.886 Suite: bdevio tests on: Nvme1n1 00:20:46.886 Test: blockdev write read block ...passed 00:20:46.886 Test: blockdev write zeroes read block ...passed 00:20:46.886 Test: blockdev write zeroes read no split ...passed 00:20:46.886 Test: blockdev write zeroes read split ...passed 00:20:46.886 Test: blockdev write zeroes read split partial ...passed 00:20:46.886 Test: blockdev reset ...[2024-11-26 19:07:03.780676] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:20:46.886 [2024-11-26 19:07:03.780729] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x926a70 (9): Bad file descriptor 00:20:46.886 [2024-11-26 19:07:03.799306] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:20:46.886 passed 00:20:47.146 Test: blockdev write read 8 blocks ...passed 00:20:47.146 Test: blockdev write read size > 128k ...passed 00:20:47.146 Test: blockdev write read invalid size ...passed 00:20:47.146 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:20:47.146 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:20:47.146 Test: blockdev write read max offset ...passed 00:20:47.146 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:20:47.146 Test: blockdev writev readv 8 blocks ...passed 00:20:47.146 Test: blockdev writev readv 30 x 1block ...passed 00:20:47.146 Test: blockdev writev readv block ...passed 00:20:47.146 Test: blockdev writev readv size > 128k ...passed 00:20:47.146 Test: blockdev writev readv size > 128k in two iovs ...passed 00:20:47.146 Test: blockdev comparev and writev ...[2024-11-26 19:07:04.052729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:47.146 [2024-11-26 19:07:04.052764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:47.146 [2024-11-26 19:07:04.052779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:47.146 [2024-11-26 19:07:04.052787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:20:47.146 [2024-11-26 19:07:04.053050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:47.146 [2024-11-26 19:07:04.053062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:20:47.146 [2024-11-26 19:07:04.053078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:47.146 [2024-11-26 19:07:04.053086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:20:47.146 [2024-11-26 19:07:04.053330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:47.146 [2024-11-26 19:07:04.053341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:20:47.146 [2024-11-26 19:07:04.053353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:47.146 [2024-11-26 19:07:04.053359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:20:47.146 [2024-11-26 19:07:04.053581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:47.146 [2024-11-26 19:07:04.053592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:20:47.146 [2024-11-26 19:07:04.053603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:47.146 [2024-11-26 19:07:04.053610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:20:47.406 passed 00:20:47.406 Test: blockdev nvme passthru rw ...passed 00:20:47.406 Test: blockdev nvme passthru vendor specific ...[2024-11-26 19:07:04.135412] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:20:47.406 [2024-11-26 19:07:04.135430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:20:47.406 [2024-11-26 19:07:04.135537] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:20:47.406 [2024-11-26 19:07:04.135548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:20:47.406 [2024-11-26 19:07:04.135653] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:20:47.406 [2024-11-26 19:07:04.135663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:20:47.406 [2024-11-26 19:07:04.135775] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:20:47.406 [2024-11-26 19:07:04.135785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:20:47.406 passed 00:20:47.406 Test: blockdev nvme admin passthru ...passed 00:20:47.406 Test: blockdev copy ...passed 00:20:47.406 00:20:47.406 Run Summary: Type Total Ran Passed Failed Inactive 00:20:47.406 suites 1 1 n/a 0 0 00:20:47.406 tests 23 23 23 0 0 00:20:47.406 asserts 152 152 152 0 n/a 00:20:47.406 00:20:47.406 Elapsed time = 1.067 seconds 00:20:47.666 19:07:04 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:20:47.666 19:07:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:47.666 19:07:04 -- common/autotest_common.sh@10 -- # set +x 00:20:47.666 19:07:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:47.666 19:07:04 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:20:47.666 19:07:04 -- target/bdevio.sh@30 -- # nvmftestfini 00:20:47.666 19:07:04 -- nvmf/common.sh@476 -- # nvmfcleanup 00:20:47.666 19:07:04 -- nvmf/common.sh@116 -- # sync 00:20:47.666 19:07:04 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:20:47.666 19:07:04 -- nvmf/common.sh@119 -- # set +e 00:20:47.666 19:07:04 -- nvmf/common.sh@120 -- # for i in {1..20} 00:20:47.666 19:07:04 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:20:47.666 rmmod nvme_tcp 00:20:47.666 rmmod nvme_fabrics 00:20:47.666 rmmod nvme_keyring 00:20:47.666 19:07:04 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:20:47.666 19:07:04 -- nvmf/common.sh@123 -- # set -e 00:20:47.666 19:07:04 -- nvmf/common.sh@124 -- # return 0 00:20:47.666 19:07:04 -- nvmf/common.sh@477 -- # '[' -n 3137991 ']' 00:20:47.666 19:07:04 -- nvmf/common.sh@478 -- # killprocess 3137991 00:20:47.666 19:07:04 -- common/autotest_common.sh@936 -- # '[' -z 3137991 ']' 00:20:47.666 19:07:04 -- common/autotest_common.sh@940 -- # kill -0 3137991 00:20:47.666 19:07:04 -- common/autotest_common.sh@941 -- # uname 00:20:47.666 19:07:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:47.666 19:07:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3137991 00:20:47.666 19:07:04 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:20:47.666 19:07:04 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:20:47.666 19:07:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3137991' 00:20:47.666 killing process with pid 3137991 00:20:47.666 19:07:04 -- common/autotest_common.sh@955 -- # kill 3137991 00:20:47.666 19:07:04 -- common/autotest_common.sh@960 -- # wait 3137991 00:20:48.235 19:07:04 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:20:48.235 19:07:04 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:20:48.235 19:07:04 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:20:48.235 19:07:04 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:20:48.235 19:07:04 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:20:48.235 19:07:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:48.235 19:07:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:48.235 19:07:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:50.141 19:07:06 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:20:50.141 00:20:50.141 real 0m10.089s 00:20:50.141 user 0m12.431s 00:20:50.141 sys 0m4.919s 00:20:50.141 19:07:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:20:50.141 19:07:06 -- common/autotest_common.sh@10 -- # set +x 00:20:50.141 ************************************ 00:20:50.141 END TEST nvmf_bdevio_no_huge 00:20:50.141 ************************************ 00:20:50.141 19:07:06 -- nvmf/nvmf.sh@59 -- # run_test nvmf_tls /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:20:50.141 19:07:06 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:20:50.141 19:07:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:20:50.141 19:07:06 -- common/autotest_common.sh@10 -- # set +x 00:20:50.141 ************************************ 00:20:50.141 START TEST nvmf_tls 00:20:50.141 ************************************ 00:20:50.141 19:07:06 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:20:50.141 * Looking for test storage... 00:20:50.141 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:20:50.401 19:07:07 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:20:50.401 19:07:07 -- common/autotest_common.sh@1690 -- # lcov --version 00:20:50.401 19:07:07 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:20:50.401 19:07:07 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:20:50.401 19:07:07 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:20:50.401 19:07:07 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:20:50.401 19:07:07 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:20:50.401 19:07:07 -- scripts/common.sh@335 -- # IFS=.-: 00:20:50.401 19:07:07 -- scripts/common.sh@335 -- # read -ra ver1 00:20:50.401 19:07:07 -- scripts/common.sh@336 -- # IFS=.-: 00:20:50.401 19:07:07 -- scripts/common.sh@336 -- # read -ra ver2 00:20:50.401 19:07:07 -- scripts/common.sh@337 -- # local 'op=<' 00:20:50.401 19:07:07 -- scripts/common.sh@339 -- # ver1_l=2 00:20:50.401 19:07:07 -- scripts/common.sh@340 -- # ver2_l=1 00:20:50.401 19:07:07 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:20:50.401 19:07:07 -- scripts/common.sh@343 -- # case "$op" in 00:20:50.401 19:07:07 -- scripts/common.sh@344 -- # : 1 00:20:50.401 19:07:07 -- scripts/common.sh@363 -- # (( v = 0 )) 00:20:50.401 19:07:07 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:20:50.401 19:07:07 -- scripts/common.sh@364 -- # decimal 1 00:20:50.401 19:07:07 -- scripts/common.sh@352 -- # local d=1 00:20:50.401 19:07:07 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:20:50.401 19:07:07 -- scripts/common.sh@354 -- # echo 1 00:20:50.402 19:07:07 -- scripts/common.sh@364 -- # ver1[v]=1 00:20:50.402 19:07:07 -- scripts/common.sh@365 -- # decimal 2 00:20:50.402 19:07:07 -- scripts/common.sh@352 -- # local d=2 00:20:50.402 19:07:07 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:20:50.402 19:07:07 -- scripts/common.sh@354 -- # echo 2 00:20:50.402 19:07:07 -- scripts/common.sh@365 -- # ver2[v]=2 00:20:50.402 19:07:07 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:20:50.402 19:07:07 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:20:50.402 19:07:07 -- scripts/common.sh@367 -- # return 0 00:20:50.402 19:07:07 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:20:50.402 19:07:07 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:20:50.402 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:50.402 --rc genhtml_branch_coverage=1 00:20:50.402 --rc genhtml_function_coverage=1 00:20:50.402 --rc genhtml_legend=1 00:20:50.402 --rc geninfo_all_blocks=1 00:20:50.402 --rc geninfo_unexecuted_blocks=1 00:20:50.402 00:20:50.402 ' 00:20:50.402 19:07:07 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:20:50.402 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:50.402 --rc genhtml_branch_coverage=1 00:20:50.402 --rc genhtml_function_coverage=1 00:20:50.402 --rc genhtml_legend=1 00:20:50.402 --rc geninfo_all_blocks=1 00:20:50.402 --rc geninfo_unexecuted_blocks=1 00:20:50.402 00:20:50.402 ' 00:20:50.402 19:07:07 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:20:50.402 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:50.402 --rc genhtml_branch_coverage=1 00:20:50.402 --rc genhtml_function_coverage=1 00:20:50.402 --rc genhtml_legend=1 00:20:50.402 --rc geninfo_all_blocks=1 00:20:50.402 --rc geninfo_unexecuted_blocks=1 00:20:50.402 00:20:50.402 ' 00:20:50.402 19:07:07 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:20:50.402 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:50.402 --rc genhtml_branch_coverage=1 00:20:50.402 --rc genhtml_function_coverage=1 00:20:50.402 --rc genhtml_legend=1 00:20:50.402 --rc geninfo_all_blocks=1 00:20:50.402 --rc geninfo_unexecuted_blocks=1 00:20:50.402 00:20:50.402 ' 00:20:50.402 19:07:07 -- target/tls.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:20:50.402 19:07:07 -- nvmf/common.sh@7 -- # uname -s 00:20:50.402 19:07:07 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:50.402 19:07:07 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:50.402 19:07:07 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:50.402 19:07:07 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:50.402 19:07:07 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:50.402 19:07:07 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:50.402 19:07:07 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:50.402 19:07:07 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:50.402 19:07:07 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:50.402 19:07:07 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:50.402 19:07:07 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:20:50.402 19:07:07 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:20:50.402 19:07:07 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:50.402 19:07:07 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:50.402 19:07:07 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:50.402 19:07:07 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:20:50.402 19:07:07 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:50.402 19:07:07 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:50.402 19:07:07 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:50.402 19:07:07 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:50.402 19:07:07 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:50.402 19:07:07 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:50.402 19:07:07 -- paths/export.sh@5 -- # export PATH 00:20:50.402 19:07:07 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:50.402 19:07:07 -- nvmf/common.sh@46 -- # : 0 00:20:50.402 19:07:07 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:20:50.402 19:07:07 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:20:50.402 19:07:07 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:20:50.402 19:07:07 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:50.402 19:07:07 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:50.402 19:07:07 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:20:50.402 19:07:07 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:20:50.402 19:07:07 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:20:50.402 19:07:07 -- target/tls.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:20:50.402 19:07:07 -- target/tls.sh@71 -- # nvmftestinit 00:20:50.402 19:07:07 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:20:50.402 19:07:07 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:50.402 19:07:07 -- nvmf/common.sh@436 -- # prepare_net_devs 00:20:50.402 19:07:07 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:20:50.402 19:07:07 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:20:50.402 19:07:07 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:50.402 19:07:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:50.402 19:07:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:50.402 19:07:07 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:20:50.402 19:07:07 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:20:50.402 19:07:07 -- nvmf/common.sh@284 -- # xtrace_disable 00:20:50.402 19:07:07 -- common/autotest_common.sh@10 -- # set +x 00:20:55.681 19:07:12 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:55.681 19:07:12 -- nvmf/common.sh@290 -- # pci_devs=() 00:20:55.681 19:07:12 -- nvmf/common.sh@290 -- # local -a pci_devs 00:20:55.681 19:07:12 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:20:55.681 19:07:12 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:20:55.681 19:07:12 -- nvmf/common.sh@292 -- # pci_drivers=() 00:20:55.681 19:07:12 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:20:55.681 19:07:12 -- nvmf/common.sh@294 -- # net_devs=() 00:20:55.681 19:07:12 -- nvmf/common.sh@294 -- # local -ga net_devs 00:20:55.681 19:07:12 -- nvmf/common.sh@295 -- # e810=() 00:20:55.681 19:07:12 -- nvmf/common.sh@295 -- # local -ga e810 00:20:55.681 19:07:12 -- nvmf/common.sh@296 -- # x722=() 00:20:55.681 19:07:12 -- nvmf/common.sh@296 -- # local -ga x722 00:20:55.681 19:07:12 -- nvmf/common.sh@297 -- # mlx=() 00:20:55.681 19:07:12 -- nvmf/common.sh@297 -- # local -ga mlx 00:20:55.681 19:07:12 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:55.681 19:07:12 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:55.681 19:07:12 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:55.681 19:07:12 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:55.681 19:07:12 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:55.681 19:07:12 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:55.681 19:07:12 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:55.681 19:07:12 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:55.681 19:07:12 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:55.681 19:07:12 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:55.681 19:07:12 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:55.681 19:07:12 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:20:55.681 19:07:12 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:20:55.681 19:07:12 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:20:55.681 19:07:12 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:20:55.681 19:07:12 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:20:55.681 19:07:12 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:20:55.681 19:07:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:55.681 19:07:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:20:55.682 Found 0000:86:00.0 (0x8086 - 0x159b) 00:20:55.682 19:07:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:55.682 19:07:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:55.682 19:07:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:55.682 19:07:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:55.682 19:07:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:55.682 19:07:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:55.682 19:07:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:20:55.682 Found 0000:86:00.1 (0x8086 - 0x159b) 00:20:55.682 19:07:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:55.682 19:07:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:55.682 19:07:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:55.682 19:07:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:55.682 19:07:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:55.682 19:07:12 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:20:55.682 19:07:12 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:20:55.682 19:07:12 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:20:55.682 19:07:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:55.682 19:07:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:55.682 19:07:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:55.682 19:07:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:55.682 19:07:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:20:55.682 Found net devices under 0000:86:00.0: cvl_0_0 00:20:55.682 19:07:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:55.682 19:07:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:55.682 19:07:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:55.682 19:07:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:55.682 19:07:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:55.682 19:07:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:20:55.682 Found net devices under 0000:86:00.1: cvl_0_1 00:20:55.682 19:07:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:55.682 19:07:12 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:20:55.682 19:07:12 -- nvmf/common.sh@402 -- # is_hw=yes 00:20:55.682 19:07:12 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:20:55.682 19:07:12 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:20:55.682 19:07:12 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:20:55.682 19:07:12 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:20:55.682 19:07:12 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:20:55.682 19:07:12 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:20:55.682 19:07:12 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:20:55.682 19:07:12 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:20:55.682 19:07:12 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:20:55.682 19:07:12 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:20:55.682 19:07:12 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:20:55.682 19:07:12 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:20:55.682 19:07:12 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:20:55.682 19:07:12 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:20:55.682 19:07:12 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:20:55.682 19:07:12 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:20:55.940 19:07:12 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:20:55.940 19:07:12 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:20:55.940 19:07:12 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:20:55.940 19:07:12 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:20:55.940 19:07:12 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:20:55.940 19:07:12 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:20:55.940 19:07:12 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:20:55.940 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:20:55.940 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.475 ms 00:20:55.940 00:20:55.940 --- 10.0.0.2 ping statistics --- 00:20:55.940 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:55.940 rtt min/avg/max/mdev = 0.475/0.475/0.475/0.000 ms 00:20:55.940 19:07:12 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:20:55.940 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:20:55.940 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.198 ms 00:20:55.940 00:20:55.940 --- 10.0.0.1 ping statistics --- 00:20:55.940 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:55.940 rtt min/avg/max/mdev = 0.198/0.198/0.198/0.000 ms 00:20:55.940 19:07:12 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:20:55.940 19:07:12 -- nvmf/common.sh@410 -- # return 0 00:20:55.940 19:07:12 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:20:55.940 19:07:12 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:20:55.940 19:07:12 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:20:55.940 19:07:12 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:20:55.940 19:07:12 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:20:55.940 19:07:12 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:20:55.940 19:07:12 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:20:55.940 19:07:12 -- target/tls.sh@72 -- # nvmfappstart -m 0x2 --wait-for-rpc 00:20:55.940 19:07:12 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:55.940 19:07:12 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:55.940 19:07:12 -- common/autotest_common.sh@10 -- # set +x 00:20:55.940 19:07:12 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 --wait-for-rpc 00:20:55.940 19:07:12 -- nvmf/common.sh@469 -- # nvmfpid=3142018 00:20:55.940 19:07:12 -- nvmf/common.sh@470 -- # waitforlisten 3142018 00:20:55.940 19:07:12 -- common/autotest_common.sh@829 -- # '[' -z 3142018 ']' 00:20:55.940 19:07:12 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:55.940 19:07:12 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:55.940 19:07:12 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:55.940 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:55.940 19:07:12 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:55.940 19:07:12 -- common/autotest_common.sh@10 -- # set +x 00:20:55.940 [2024-11-26 19:07:12.846473] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:55.940 [2024-11-26 19:07:12.846517] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:56.199 EAL: No free 2048 kB hugepages reported on node 1 00:20:56.199 [2024-11-26 19:07:12.902053] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:56.199 [2024-11-26 19:07:12.941781] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:56.199 [2024-11-26 19:07:12.941888] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:56.199 [2024-11-26 19:07:12.941896] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:56.199 [2024-11-26 19:07:12.941902] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:56.199 [2024-11-26 19:07:12.941918] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:56.199 19:07:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:56.199 19:07:12 -- common/autotest_common.sh@862 -- # return 0 00:20:56.199 19:07:12 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:56.199 19:07:12 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:56.199 19:07:12 -- common/autotest_common.sh@10 -- # set +x 00:20:56.199 19:07:13 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:56.199 19:07:13 -- target/tls.sh@74 -- # '[' tcp '!=' tcp ']' 00:20:56.199 19:07:13 -- target/tls.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_set_default_impl -i ssl 00:20:56.456 true 00:20:56.456 19:07:13 -- target/tls.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:56.456 19:07:13 -- target/tls.sh@82 -- # jq -r .tls_version 00:20:56.715 19:07:13 -- target/tls.sh@82 -- # version=0 00:20:56.715 19:07:13 -- target/tls.sh@83 -- # [[ 0 != \0 ]] 00:20:56.715 19:07:13 -- target/tls.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:20:56.715 19:07:13 -- target/tls.sh@90 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:56.715 19:07:13 -- target/tls.sh@90 -- # jq -r .tls_version 00:20:56.973 19:07:13 -- target/tls.sh@90 -- # version=13 00:20:56.973 19:07:13 -- target/tls.sh@91 -- # [[ 13 != \1\3 ]] 00:20:56.973 19:07:13 -- target/tls.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 7 00:20:57.232 19:07:13 -- target/tls.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:57.232 19:07:13 -- target/tls.sh@98 -- # jq -r .tls_version 00:20:57.232 19:07:14 -- target/tls.sh@98 -- # version=7 00:20:57.232 19:07:14 -- target/tls.sh@99 -- # [[ 7 != \7 ]] 00:20:57.232 19:07:14 -- target/tls.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:57.232 19:07:14 -- target/tls.sh@105 -- # jq -r .enable_ktls 00:20:57.490 19:07:14 -- target/tls.sh@105 -- # ktls=false 00:20:57.490 19:07:14 -- target/tls.sh@106 -- # [[ false != \f\a\l\s\e ]] 00:20:57.490 19:07:14 -- target/tls.sh@112 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --enable-ktls 00:20:57.748 19:07:14 -- target/tls.sh@113 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:57.748 19:07:14 -- target/tls.sh@113 -- # jq -r .enable_ktls 00:20:57.748 19:07:14 -- target/tls.sh@113 -- # ktls=true 00:20:57.748 19:07:14 -- target/tls.sh@114 -- # [[ true != \t\r\u\e ]] 00:20:57.748 19:07:14 -- target/tls.sh@120 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --disable-ktls 00:20:58.007 19:07:14 -- target/tls.sh@121 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:58.007 19:07:14 -- target/tls.sh@121 -- # jq -r .enable_ktls 00:20:58.284 19:07:14 -- target/tls.sh@121 -- # ktls=false 00:20:58.284 19:07:14 -- target/tls.sh@122 -- # [[ false != \f\a\l\s\e ]] 00:20:58.284 19:07:14 -- target/tls.sh@127 -- # format_interchange_psk 00112233445566778899aabbccddeeff 00:20:58.284 19:07:14 -- target/tls.sh@49 -- # local key hash crc 00:20:58.284 19:07:14 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff 00:20:58.284 19:07:14 -- target/tls.sh@51 -- # hash=01 00:20:58.284 19:07:14 -- target/tls.sh@52 -- # gzip -1 -c 00:20:58.284 19:07:14 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff 00:20:58.284 19:07:14 -- target/tls.sh@52 -- # tail -c8 00:20:58.284 19:07:14 -- target/tls.sh@52 -- # head -c 4 00:20:58.284 19:07:15 -- target/tls.sh@52 -- # crc='p$H�' 00:20:58.284 19:07:15 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:20:58.284 19:07:15 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeffp$H�' 00:20:58.284 19:07:15 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:20:58.284 19:07:15 -- target/tls.sh@127 -- # key=NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:20:58.284 19:07:15 -- target/tls.sh@128 -- # format_interchange_psk ffeeddccbbaa99887766554433221100 00:20:58.284 19:07:15 -- target/tls.sh@49 -- # local key hash crc 00:20:58.284 19:07:15 -- target/tls.sh@51 -- # key=ffeeddccbbaa99887766554433221100 00:20:58.284 19:07:15 -- target/tls.sh@51 -- # hash=01 00:20:58.284 19:07:15 -- target/tls.sh@52 -- # echo -n ffeeddccbbaa99887766554433221100 00:20:58.284 19:07:15 -- target/tls.sh@52 -- # head -c 4 00:20:58.284 19:07:15 -- target/tls.sh@52 -- # gzip -1 -c 00:20:58.284 19:07:15 -- target/tls.sh@52 -- # tail -c8 00:20:58.284 19:07:15 -- target/tls.sh@52 -- # crc=$'_\006o\330' 00:20:58.284 19:07:15 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:20:58.284 19:07:15 -- target/tls.sh@54 -- # echo -n $'ffeeddccbbaa99887766554433221100_\006o\330' 00:20:58.284 19:07:15 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:20:58.284 19:07:15 -- target/tls.sh@128 -- # key_2=NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:20:58.284 19:07:15 -- target/tls.sh@130 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:58.284 19:07:15 -- target/tls.sh@131 -- # key_2_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:58.284 19:07:15 -- target/tls.sh@133 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:20:58.284 19:07:15 -- target/tls.sh@134 -- # echo -n NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:20:58.284 19:07:15 -- target/tls.sh@136 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:58.284 19:07:15 -- target/tls.sh@137 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:58.284 19:07:15 -- target/tls.sh@139 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:20:58.567 19:07:15 -- target/tls.sh@140 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_start_init 00:20:58.567 19:07:15 -- target/tls.sh@142 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:58.567 19:07:15 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:58.567 19:07:15 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:20:58.843 [2024-11-26 19:07:15.629648] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:58.843 19:07:15 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:20:59.101 19:07:15 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:20:59.101 [2024-11-26 19:07:15.978553] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:59.101 [2024-11-26 19:07:15.978737] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:59.101 19:07:15 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:20:59.360 malloc0 00:20:59.360 19:07:16 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:20:59.619 19:07:16 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:59.619 19:07:16 -- target/tls.sh@146 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -S ssl -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 hostnqn:nqn.2016-06.io.spdk:host1' --psk-path /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:59.619 EAL: No free 2048 kB hugepages reported on node 1 00:21:11.828 Initializing NVMe Controllers 00:21:11.828 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:21:11.828 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:21:11.828 Initialization complete. Launching workers. 00:21:11.828 ======================================================== 00:21:11.828 Latency(us) 00:21:11.828 Device Information : IOPS MiB/s Average min max 00:21:11.828 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 16979.80 66.33 3769.53 829.76 5746.71 00:21:11.828 ======================================================== 00:21:11.828 Total : 16979.80 66.33 3769.53 829.76 5746.71 00:21:11.828 00:21:11.828 19:07:26 -- target/tls.sh@152 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:21:11.828 19:07:26 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:21:11.828 19:07:26 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:21:11.828 19:07:26 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:21:11.828 19:07:26 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:21:11.828 19:07:26 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:21:11.828 19:07:26 -- target/tls.sh@28 -- # bdevperf_pid=3144290 00:21:11.828 19:07:26 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:21:11.828 19:07:26 -- target/tls.sh@31 -- # waitforlisten 3144290 /var/tmp/bdevperf.sock 00:21:11.828 19:07:26 -- common/autotest_common.sh@829 -- # '[' -z 3144290 ']' 00:21:11.828 19:07:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:11.828 19:07:26 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:21:11.828 19:07:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:11.828 19:07:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:11.828 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:11.828 19:07:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:11.828 19:07:26 -- common/autotest_common.sh@10 -- # set +x 00:21:11.828 [2024-11-26 19:07:26.647424] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:21:11.828 [2024-11-26 19:07:26.647479] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3144290 ] 00:21:11.828 EAL: No free 2048 kB hugepages reported on node 1 00:21:11.828 [2024-11-26 19:07:26.700725] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:11.828 [2024-11-26 19:07:26.737608] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:11.828 19:07:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:11.828 19:07:27 -- common/autotest_common.sh@862 -- # return 0 00:21:11.828 19:07:27 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:21:11.828 [2024-11-26 19:07:27.618523] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:21:11.828 TLSTESTn1 00:21:11.828 19:07:27 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:21:11.828 Running I/O for 10 seconds... 00:21:21.809 00:21:21.809 Latency(us) 00:21:21.809 [2024-11-26T18:07:38.736Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:21.809 [2024-11-26T18:07:38.736Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:21:21.809 Verification LBA range: start 0x0 length 0x2000 00:21:21.809 TLSTESTn1 : 10.01 6768.63 26.44 0.00 0.00 18888.86 3219.81 38979.67 00:21:21.809 [2024-11-26T18:07:38.736Z] =================================================================================================================== 00:21:21.809 [2024-11-26T18:07:38.736Z] Total : 6768.63 26.44 0.00 0.00 18888.86 3219.81 38979.67 00:21:21.809 0 00:21:21.809 19:07:37 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:21:21.809 19:07:37 -- target/tls.sh@45 -- # killprocess 3144290 00:21:21.809 19:07:37 -- common/autotest_common.sh@936 -- # '[' -z 3144290 ']' 00:21:21.809 19:07:37 -- common/autotest_common.sh@940 -- # kill -0 3144290 00:21:21.809 19:07:37 -- common/autotest_common.sh@941 -- # uname 00:21:21.809 19:07:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:21.809 19:07:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3144290 00:21:21.809 19:07:37 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:21:21.809 19:07:37 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:21:21.809 19:07:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3144290' 00:21:21.809 killing process with pid 3144290 00:21:21.809 19:07:37 -- common/autotest_common.sh@955 -- # kill 3144290 00:21:21.809 Received shutdown signal, test time was about 10.000000 seconds 00:21:21.809 00:21:21.809 Latency(us) 00:21:21.809 [2024-11-26T18:07:38.736Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:21.809 [2024-11-26T18:07:38.736Z] =================================================================================================================== 00:21:21.809 [2024-11-26T18:07:38.736Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:21:21.809 19:07:37 -- common/autotest_common.sh@960 -- # wait 3144290 00:21:21.809 19:07:38 -- target/tls.sh@155 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:21:21.809 19:07:38 -- common/autotest_common.sh@650 -- # local es=0 00:21:21.809 19:07:38 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:21:21.809 19:07:38 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:21:21.809 19:07:38 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:21.809 19:07:38 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:21:21.809 19:07:38 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:21.809 19:07:38 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:21:21.809 19:07:38 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:21:21.809 19:07:38 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:21:21.809 19:07:38 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:21:21.809 19:07:38 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt' 00:21:21.809 19:07:38 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:21:21.809 19:07:38 -- target/tls.sh@28 -- # bdevperf_pid=3146185 00:21:21.809 19:07:38 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:21:21.809 19:07:38 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:21:21.809 19:07:38 -- target/tls.sh@31 -- # waitforlisten 3146185 /var/tmp/bdevperf.sock 00:21:21.809 19:07:38 -- common/autotest_common.sh@829 -- # '[' -z 3146185 ']' 00:21:21.809 19:07:38 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:21.809 19:07:38 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:21.809 19:07:38 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:21.809 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:21.809 19:07:38 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:21.809 19:07:38 -- common/autotest_common.sh@10 -- # set +x 00:21:21.809 [2024-11-26 19:07:38.110781] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:21:21.809 [2024-11-26 19:07:38.110833] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3146185 ] 00:21:21.809 EAL: No free 2048 kB hugepages reported on node 1 00:21:21.809 [2024-11-26 19:07:38.165214] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:21.809 [2024-11-26 19:07:38.201470] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:22.068 19:07:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:22.068 19:07:38 -- common/autotest_common.sh@862 -- # return 0 00:21:22.068 19:07:38 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:21:22.327 [2024-11-26 19:07:39.082006] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:21:22.327 [2024-11-26 19:07:39.092081] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:21:22.327 [2024-11-26 19:07:39.092188] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19f5de0 (107): Transport endpoint is not connected 00:21:22.327 [2024-11-26 19:07:39.093171] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19f5de0 (9): Bad file descriptor 00:21:22.327 [2024-11-26 19:07:39.094172] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:22.328 [2024-11-26 19:07:39.094183] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:21:22.328 [2024-11-26 19:07:39.094190] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:22.328 request: 00:21:22.328 { 00:21:22.328 "name": "TLSTEST", 00:21:22.328 "trtype": "tcp", 00:21:22.328 "traddr": "10.0.0.2", 00:21:22.328 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:21:22.328 "adrfam": "ipv4", 00:21:22.328 "trsvcid": "4420", 00:21:22.328 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:21:22.328 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt", 00:21:22.328 "method": "bdev_nvme_attach_controller", 00:21:22.328 "req_id": 1 00:21:22.328 } 00:21:22.328 Got JSON-RPC error response 00:21:22.328 response: 00:21:22.328 { 00:21:22.328 "code": -32602, 00:21:22.328 "message": "Invalid parameters" 00:21:22.328 } 00:21:22.328 19:07:39 -- target/tls.sh@36 -- # killprocess 3146185 00:21:22.328 19:07:39 -- common/autotest_common.sh@936 -- # '[' -z 3146185 ']' 00:21:22.328 19:07:39 -- common/autotest_common.sh@940 -- # kill -0 3146185 00:21:22.328 19:07:39 -- common/autotest_common.sh@941 -- # uname 00:21:22.328 19:07:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:22.328 19:07:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3146185 00:21:22.328 19:07:39 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:21:22.328 19:07:39 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:21:22.328 19:07:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3146185' 00:21:22.328 killing process with pid 3146185 00:21:22.328 19:07:39 -- common/autotest_common.sh@955 -- # kill 3146185 00:21:22.328 Received shutdown signal, test time was about 10.000000 seconds 00:21:22.328 00:21:22.328 Latency(us) 00:21:22.328 [2024-11-26T18:07:39.255Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:22.328 [2024-11-26T18:07:39.255Z] =================================================================================================================== 00:21:22.328 [2024-11-26T18:07:39.255Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:21:22.328 19:07:39 -- common/autotest_common.sh@960 -- # wait 3146185 00:21:22.587 19:07:39 -- target/tls.sh@37 -- # return 1 00:21:22.587 19:07:39 -- common/autotest_common.sh@653 -- # es=1 00:21:22.587 19:07:39 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:21:22.587 19:07:39 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:21:22.587 19:07:39 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:21:22.587 19:07:39 -- target/tls.sh@158 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:21:22.587 19:07:39 -- common/autotest_common.sh@650 -- # local es=0 00:21:22.587 19:07:39 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:21:22.587 19:07:39 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:21:22.587 19:07:39 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:22.587 19:07:39 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:21:22.587 19:07:39 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:22.587 19:07:39 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:21:22.587 19:07:39 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:21:22.587 19:07:39 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:21:22.587 19:07:39 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host2 00:21:22.587 19:07:39 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:21:22.587 19:07:39 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:21:22.587 19:07:39 -- target/tls.sh@28 -- # bdevperf_pid=3146352 00:21:22.587 19:07:39 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:21:22.587 19:07:39 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:21:22.587 19:07:39 -- target/tls.sh@31 -- # waitforlisten 3146352 /var/tmp/bdevperf.sock 00:21:22.587 19:07:39 -- common/autotest_common.sh@829 -- # '[' -z 3146352 ']' 00:21:22.587 19:07:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:22.587 19:07:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:22.587 19:07:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:22.587 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:22.587 19:07:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:22.587 19:07:39 -- common/autotest_common.sh@10 -- # set +x 00:21:22.587 [2024-11-26 19:07:39.377793] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:21:22.587 [2024-11-26 19:07:39.377844] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3146352 ] 00:21:22.587 EAL: No free 2048 kB hugepages reported on node 1 00:21:22.587 [2024-11-26 19:07:39.433251] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:22.587 [2024-11-26 19:07:39.470693] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:23.522 19:07:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:23.522 19:07:40 -- common/autotest_common.sh@862 -- # return 0 00:21:23.522 19:07:40 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host2 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:21:23.522 [2024-11-26 19:07:40.355945] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:21:23.522 [2024-11-26 19:07:40.365248] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:21:23.522 [2024-11-26 19:07:40.365270] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:21:23.522 [2024-11-26 19:07:40.365293] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:21:23.522 [2024-11-26 19:07:40.366170] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1689de0 (107): Transport endpoint is not connected 00:21:23.522 [2024-11-26 19:07:40.367164] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1689de0 (9): Bad file descriptor 00:21:23.522 [2024-11-26 19:07:40.368165] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:23.522 [2024-11-26 19:07:40.368176] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:21:23.522 [2024-11-26 19:07:40.368183] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:23.522 request: 00:21:23.522 { 00:21:23.522 "name": "TLSTEST", 00:21:23.522 "trtype": "tcp", 00:21:23.522 "traddr": "10.0.0.2", 00:21:23.522 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:21:23.522 "adrfam": "ipv4", 00:21:23.522 "trsvcid": "4420", 00:21:23.522 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:21:23.522 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:21:23.522 "method": "bdev_nvme_attach_controller", 00:21:23.522 "req_id": 1 00:21:23.522 } 00:21:23.523 Got JSON-RPC error response 00:21:23.523 response: 00:21:23.523 { 00:21:23.523 "code": -32602, 00:21:23.523 "message": "Invalid parameters" 00:21:23.523 } 00:21:23.523 19:07:40 -- target/tls.sh@36 -- # killprocess 3146352 00:21:23.523 19:07:40 -- common/autotest_common.sh@936 -- # '[' -z 3146352 ']' 00:21:23.523 19:07:40 -- common/autotest_common.sh@940 -- # kill -0 3146352 00:21:23.523 19:07:40 -- common/autotest_common.sh@941 -- # uname 00:21:23.523 19:07:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:23.523 19:07:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3146352 00:21:23.523 19:07:40 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:21:23.523 19:07:40 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:21:23.523 19:07:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3146352' 00:21:23.523 killing process with pid 3146352 00:21:23.523 19:07:40 -- common/autotest_common.sh@955 -- # kill 3146352 00:21:23.523 Received shutdown signal, test time was about 10.000000 seconds 00:21:23.523 00:21:23.523 Latency(us) 00:21:23.523 [2024-11-26T18:07:40.450Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:23.523 [2024-11-26T18:07:40.450Z] =================================================================================================================== 00:21:23.523 [2024-11-26T18:07:40.450Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:21:23.523 19:07:40 -- common/autotest_common.sh@960 -- # wait 3146352 00:21:23.781 19:07:40 -- target/tls.sh@37 -- # return 1 00:21:23.782 19:07:40 -- common/autotest_common.sh@653 -- # es=1 00:21:23.782 19:07:40 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:21:23.782 19:07:40 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:21:23.782 19:07:40 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:21:23.782 19:07:40 -- target/tls.sh@161 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:21:23.782 19:07:40 -- common/autotest_common.sh@650 -- # local es=0 00:21:23.782 19:07:40 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:21:23.782 19:07:40 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:21:23.782 19:07:40 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:23.782 19:07:40 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:21:23.782 19:07:40 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:23.782 19:07:40 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:21:23.782 19:07:40 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:21:23.782 19:07:40 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode2 00:21:23.782 19:07:40 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:21:23.782 19:07:40 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:21:23.782 19:07:40 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:21:23.782 19:07:40 -- target/tls.sh@28 -- # bdevperf_pid=3146553 00:21:23.782 19:07:40 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:21:23.782 19:07:40 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:21:23.782 19:07:40 -- target/tls.sh@31 -- # waitforlisten 3146553 /var/tmp/bdevperf.sock 00:21:23.782 19:07:40 -- common/autotest_common.sh@829 -- # '[' -z 3146553 ']' 00:21:23.782 19:07:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:23.782 19:07:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:23.782 19:07:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:23.782 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:23.782 19:07:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:23.782 19:07:40 -- common/autotest_common.sh@10 -- # set +x 00:21:23.782 [2024-11-26 19:07:40.655827] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:21:23.782 [2024-11-26 19:07:40.655880] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3146553 ] 00:21:23.782 EAL: No free 2048 kB hugepages reported on node 1 00:21:24.042 [2024-11-26 19:07:40.709272] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:24.042 [2024-11-26 19:07:40.746677] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:24.610 19:07:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:24.610 19:07:41 -- common/autotest_common.sh@862 -- # return 0 00:21:24.610 19:07:41 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:21:24.869 [2024-11-26 19:07:41.619705] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:21:24.870 [2024-11-26 19:07:41.628458] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:21:24.870 [2024-11-26 19:07:41.628480] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:21:24.870 [2024-11-26 19:07:41.628503] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:21:24.870 [2024-11-26 19:07:41.628830] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x577de0 (107): Transport endpoint is not connected 00:21:24.870 [2024-11-26 19:07:41.629824] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x577de0 (9): Bad file descriptor 00:21:24.870 [2024-11-26 19:07:41.630824] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:21:24.870 [2024-11-26 19:07:41.630834] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:21:24.870 [2024-11-26 19:07:41.630841] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:21:24.870 request: 00:21:24.870 { 00:21:24.870 "name": "TLSTEST", 00:21:24.870 "trtype": "tcp", 00:21:24.870 "traddr": "10.0.0.2", 00:21:24.870 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:21:24.870 "adrfam": "ipv4", 00:21:24.870 "trsvcid": "4420", 00:21:24.870 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:21:24.870 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:21:24.870 "method": "bdev_nvme_attach_controller", 00:21:24.870 "req_id": 1 00:21:24.870 } 00:21:24.870 Got JSON-RPC error response 00:21:24.870 response: 00:21:24.870 { 00:21:24.870 "code": -32602, 00:21:24.870 "message": "Invalid parameters" 00:21:24.870 } 00:21:24.870 19:07:41 -- target/tls.sh@36 -- # killprocess 3146553 00:21:24.870 19:07:41 -- common/autotest_common.sh@936 -- # '[' -z 3146553 ']' 00:21:24.870 19:07:41 -- common/autotest_common.sh@940 -- # kill -0 3146553 00:21:24.870 19:07:41 -- common/autotest_common.sh@941 -- # uname 00:21:24.870 19:07:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:24.870 19:07:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3146553 00:21:24.870 19:07:41 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:21:24.870 19:07:41 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:21:24.870 19:07:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3146553' 00:21:24.870 killing process with pid 3146553 00:21:24.870 19:07:41 -- common/autotest_common.sh@955 -- # kill 3146553 00:21:24.870 Received shutdown signal, test time was about 10.000000 seconds 00:21:24.870 00:21:24.870 Latency(us) 00:21:24.870 [2024-11-26T18:07:41.797Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:24.870 [2024-11-26T18:07:41.797Z] =================================================================================================================== 00:21:24.870 [2024-11-26T18:07:41.797Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:21:24.870 19:07:41 -- common/autotest_common.sh@960 -- # wait 3146553 00:21:25.129 19:07:41 -- target/tls.sh@37 -- # return 1 00:21:25.129 19:07:41 -- common/autotest_common.sh@653 -- # es=1 00:21:25.129 19:07:41 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:21:25.129 19:07:41 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:21:25.129 19:07:41 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:21:25.129 19:07:41 -- target/tls.sh@164 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:21:25.129 19:07:41 -- common/autotest_common.sh@650 -- # local es=0 00:21:25.129 19:07:41 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:21:25.129 19:07:41 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:21:25.129 19:07:41 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:25.129 19:07:41 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:21:25.129 19:07:41 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:25.129 19:07:41 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:21:25.129 19:07:41 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:21:25.129 19:07:41 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:21:25.129 19:07:41 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:21:25.129 19:07:41 -- target/tls.sh@23 -- # psk= 00:21:25.129 19:07:41 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:21:25.129 19:07:41 -- target/tls.sh@28 -- # bdevperf_pid=3146795 00:21:25.129 19:07:41 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:21:25.129 19:07:41 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:21:25.129 19:07:41 -- target/tls.sh@31 -- # waitforlisten 3146795 /var/tmp/bdevperf.sock 00:21:25.129 19:07:41 -- common/autotest_common.sh@829 -- # '[' -z 3146795 ']' 00:21:25.129 19:07:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:25.129 19:07:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:25.129 19:07:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:25.130 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:25.130 19:07:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:25.130 19:07:41 -- common/autotest_common.sh@10 -- # set +x 00:21:25.130 [2024-11-26 19:07:41.914563] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:21:25.130 [2024-11-26 19:07:41.914612] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3146795 ] 00:21:25.130 EAL: No free 2048 kB hugepages reported on node 1 00:21:25.130 [2024-11-26 19:07:41.966549] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:25.130 [2024-11-26 19:07:42.000156] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:26.069 19:07:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:26.069 19:07:42 -- common/autotest_common.sh@862 -- # return 0 00:21:26.069 19:07:42 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 00:21:26.069 [2024-11-26 19:07:42.881692] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:21:26.069 [2024-11-26 19:07:42.883118] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x5523d0 (9): Bad file descriptor 00:21:26.069 [2024-11-26 19:07:42.884116] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:26.069 [2024-11-26 19:07:42.884128] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:21:26.069 [2024-11-26 19:07:42.884134] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:26.069 request: 00:21:26.069 { 00:21:26.069 "name": "TLSTEST", 00:21:26.069 "trtype": "tcp", 00:21:26.069 "traddr": "10.0.0.2", 00:21:26.069 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:21:26.069 "adrfam": "ipv4", 00:21:26.069 "trsvcid": "4420", 00:21:26.069 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:21:26.069 "method": "bdev_nvme_attach_controller", 00:21:26.069 "req_id": 1 00:21:26.069 } 00:21:26.069 Got JSON-RPC error response 00:21:26.069 response: 00:21:26.069 { 00:21:26.069 "code": -32602, 00:21:26.069 "message": "Invalid parameters" 00:21:26.069 } 00:21:26.069 19:07:42 -- target/tls.sh@36 -- # killprocess 3146795 00:21:26.069 19:07:42 -- common/autotest_common.sh@936 -- # '[' -z 3146795 ']' 00:21:26.069 19:07:42 -- common/autotest_common.sh@940 -- # kill -0 3146795 00:21:26.069 19:07:42 -- common/autotest_common.sh@941 -- # uname 00:21:26.069 19:07:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:26.069 19:07:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3146795 00:21:26.069 19:07:42 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:21:26.069 19:07:42 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:21:26.069 19:07:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3146795' 00:21:26.069 killing process with pid 3146795 00:21:26.069 19:07:42 -- common/autotest_common.sh@955 -- # kill 3146795 00:21:26.069 Received shutdown signal, test time was about 10.000000 seconds 00:21:26.069 00:21:26.069 Latency(us) 00:21:26.069 [2024-11-26T18:07:42.996Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:26.069 [2024-11-26T18:07:42.996Z] =================================================================================================================== 00:21:26.069 [2024-11-26T18:07:42.996Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:21:26.069 19:07:42 -- common/autotest_common.sh@960 -- # wait 3146795 00:21:26.328 19:07:43 -- target/tls.sh@37 -- # return 1 00:21:26.328 19:07:43 -- common/autotest_common.sh@653 -- # es=1 00:21:26.328 19:07:43 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:21:26.328 19:07:43 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:21:26.328 19:07:43 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:21:26.328 19:07:43 -- target/tls.sh@167 -- # killprocess 3142018 00:21:26.328 19:07:43 -- common/autotest_common.sh@936 -- # '[' -z 3142018 ']' 00:21:26.328 19:07:43 -- common/autotest_common.sh@940 -- # kill -0 3142018 00:21:26.328 19:07:43 -- common/autotest_common.sh@941 -- # uname 00:21:26.328 19:07:43 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:26.328 19:07:43 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3142018 00:21:26.328 19:07:43 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:21:26.328 19:07:43 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:21:26.328 19:07:43 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3142018' 00:21:26.328 killing process with pid 3142018 00:21:26.328 19:07:43 -- common/autotest_common.sh@955 -- # kill 3142018 00:21:26.328 19:07:43 -- common/autotest_common.sh@960 -- # wait 3142018 00:21:26.587 19:07:43 -- target/tls.sh@168 -- # format_interchange_psk 00112233445566778899aabbccddeeff0011223344556677 02 00:21:26.587 19:07:43 -- target/tls.sh@49 -- # local key hash crc 00:21:26.587 19:07:43 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff0011223344556677 00:21:26.587 19:07:43 -- target/tls.sh@51 -- # hash=02 00:21:26.587 19:07:43 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff0011223344556677 00:21:26.587 19:07:43 -- target/tls.sh@52 -- # gzip -1 -c 00:21:26.587 19:07:43 -- target/tls.sh@52 -- # head -c 4 00:21:26.587 19:07:43 -- target/tls.sh@52 -- # tail -c8 00:21:26.587 19:07:43 -- target/tls.sh@52 -- # crc='�e�'\''' 00:21:26.587 19:07:43 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:21:26.587 19:07:43 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeff0011223344556677�e�'\''' 00:21:26.587 19:07:43 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:21:26.587 19:07:43 -- target/tls.sh@168 -- # key_long=NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:21:26.587 19:07:43 -- target/tls.sh@169 -- # key_long_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:26.587 19:07:43 -- target/tls.sh@170 -- # echo -n NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:21:26.587 19:07:43 -- target/tls.sh@171 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:26.587 19:07:43 -- target/tls.sh@172 -- # nvmfappstart -m 0x2 00:21:26.587 19:07:43 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:26.587 19:07:43 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:26.587 19:07:43 -- common/autotest_common.sh@10 -- # set +x 00:21:26.587 19:07:43 -- nvmf/common.sh@469 -- # nvmfpid=3147056 00:21:26.587 19:07:43 -- nvmf/common.sh@470 -- # waitforlisten 3147056 00:21:26.587 19:07:43 -- common/autotest_common.sh@829 -- # '[' -z 3147056 ']' 00:21:26.587 19:07:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:26.587 19:07:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:26.587 19:07:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:26.587 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:26.587 19:07:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:26.587 19:07:43 -- common/autotest_common.sh@10 -- # set +x 00:21:26.587 19:07:43 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:21:26.587 [2024-11-26 19:07:43.423254] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:21:26.587 [2024-11-26 19:07:43.423301] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:26.587 EAL: No free 2048 kB hugepages reported on node 1 00:21:26.587 [2024-11-26 19:07:43.480526] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:26.845 [2024-11-26 19:07:43.518609] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:26.845 [2024-11-26 19:07:43.518718] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:26.845 [2024-11-26 19:07:43.518729] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:26.845 [2024-11-26 19:07:43.518735] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:26.845 [2024-11-26 19:07:43.518757] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:27.412 19:07:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:27.412 19:07:44 -- common/autotest_common.sh@862 -- # return 0 00:21:27.412 19:07:44 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:27.412 19:07:44 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:27.412 19:07:44 -- common/autotest_common.sh@10 -- # set +x 00:21:27.412 19:07:44 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:27.412 19:07:44 -- target/tls.sh@174 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:27.412 19:07:44 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:27.413 19:07:44 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:21:27.671 [2024-11-26 19:07:44.420838] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:27.671 19:07:44 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:21:27.930 19:07:44 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:21:27.930 [2024-11-26 19:07:44.757709] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:21:27.930 [2024-11-26 19:07:44.757903] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:27.930 19:07:44 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:21:28.190 malloc0 00:21:28.190 19:07:44 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:21:28.450 19:07:45 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:28.450 19:07:45 -- target/tls.sh@176 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:28.450 19:07:45 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:21:28.450 19:07:45 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:21:28.450 19:07:45 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:21:28.450 19:07:45 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:21:28.450 19:07:45 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:21:28.450 19:07:45 -- target/tls.sh@28 -- # bdevperf_pid=3147539 00:21:28.450 19:07:45 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:21:28.450 19:07:45 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:21:28.450 19:07:45 -- target/tls.sh@31 -- # waitforlisten 3147539 /var/tmp/bdevperf.sock 00:21:28.450 19:07:45 -- common/autotest_common.sh@829 -- # '[' -z 3147539 ']' 00:21:28.450 19:07:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:28.450 19:07:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:28.450 19:07:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:28.450 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:28.450 19:07:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:28.450 19:07:45 -- common/autotest_common.sh@10 -- # set +x 00:21:28.450 [2024-11-26 19:07:45.367078] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:21:28.450 [2024-11-26 19:07:45.367127] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3147539 ] 00:21:28.709 EAL: No free 2048 kB hugepages reported on node 1 00:21:28.709 [2024-11-26 19:07:45.419213] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:28.709 [2024-11-26 19:07:45.456066] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:29.276 19:07:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:29.276 19:07:46 -- common/autotest_common.sh@862 -- # return 0 00:21:29.276 19:07:46 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:29.535 [2024-11-26 19:07:46.344719] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:21:29.535 TLSTESTn1 00:21:29.535 19:07:46 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:21:29.793 Running I/O for 10 seconds... 00:21:39.776 00:21:39.776 Latency(us) 00:21:39.776 [2024-11-26T18:07:56.703Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:39.776 [2024-11-26T18:07:56.703Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:21:39.776 Verification LBA range: start 0x0 length 0x2000 00:21:39.776 TLSTESTn1 : 10.01 6636.89 25.93 0.00 0.00 19267.22 2664.18 39435.58 00:21:39.776 [2024-11-26T18:07:56.703Z] =================================================================================================================== 00:21:39.776 [2024-11-26T18:07:56.703Z] Total : 6636.89 25.93 0.00 0.00 19267.22 2664.18 39435.58 00:21:39.776 0 00:21:39.776 19:07:56 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:21:39.776 19:07:56 -- target/tls.sh@45 -- # killprocess 3147539 00:21:39.776 19:07:56 -- common/autotest_common.sh@936 -- # '[' -z 3147539 ']' 00:21:39.776 19:07:56 -- common/autotest_common.sh@940 -- # kill -0 3147539 00:21:39.776 19:07:56 -- common/autotest_common.sh@941 -- # uname 00:21:39.776 19:07:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:39.776 19:07:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3147539 00:21:39.776 19:07:56 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:21:39.776 19:07:56 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:21:39.776 19:07:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3147539' 00:21:39.776 killing process with pid 3147539 00:21:39.776 19:07:56 -- common/autotest_common.sh@955 -- # kill 3147539 00:21:39.776 Received shutdown signal, test time was about 10.000000 seconds 00:21:39.776 00:21:39.777 Latency(us) 00:21:39.777 [2024-11-26T18:07:56.704Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:39.777 [2024-11-26T18:07:56.704Z] =================================================================================================================== 00:21:39.777 [2024-11-26T18:07:56.704Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:21:39.777 19:07:56 -- common/autotest_common.sh@960 -- # wait 3147539 00:21:40.036 19:07:56 -- target/tls.sh@179 -- # chmod 0666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:40.036 19:07:56 -- target/tls.sh@180 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:40.036 19:07:56 -- common/autotest_common.sh@650 -- # local es=0 00:21:40.036 19:07:56 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:40.036 19:07:56 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:21:40.036 19:07:56 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:40.036 19:07:56 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:21:40.036 19:07:56 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:40.036 19:07:56 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:40.036 19:07:56 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:21:40.036 19:07:56 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:21:40.036 19:07:56 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:21:40.036 19:07:56 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:21:40.036 19:07:56 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:21:40.036 19:07:56 -- target/tls.sh@28 -- # bdevperf_pid=3149409 00:21:40.036 19:07:56 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:21:40.036 19:07:56 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:21:40.036 19:07:56 -- target/tls.sh@31 -- # waitforlisten 3149409 /var/tmp/bdevperf.sock 00:21:40.036 19:07:56 -- common/autotest_common.sh@829 -- # '[' -z 3149409 ']' 00:21:40.036 19:07:56 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:40.036 19:07:56 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:40.036 19:07:56 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:40.036 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:40.036 19:07:56 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:40.036 19:07:56 -- common/autotest_common.sh@10 -- # set +x 00:21:40.036 [2024-11-26 19:07:56.844901] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:21:40.036 [2024-11-26 19:07:56.844963] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3149409 ] 00:21:40.036 EAL: No free 2048 kB hugepages reported on node 1 00:21:40.036 [2024-11-26 19:07:56.896570] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:40.036 [2024-11-26 19:07:56.930403] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:40.974 19:07:57 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:40.974 19:07:57 -- common/autotest_common.sh@862 -- # return 0 00:21:40.974 19:07:57 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:40.974 [2024-11-26 19:07:57.807181] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:21:40.974 [2024-11-26 19:07:57.807225] bdev_nvme_rpc.c: 336:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:21:40.974 request: 00:21:40.974 { 00:21:40.974 "name": "TLSTEST", 00:21:40.974 "trtype": "tcp", 00:21:40.974 "traddr": "10.0.0.2", 00:21:40.974 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:21:40.974 "adrfam": "ipv4", 00:21:40.974 "trsvcid": "4420", 00:21:40.974 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:21:40.974 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:21:40.974 "method": "bdev_nvme_attach_controller", 00:21:40.974 "req_id": 1 00:21:40.974 } 00:21:40.974 Got JSON-RPC error response 00:21:40.974 response: 00:21:40.974 { 00:21:40.974 "code": -22, 00:21:40.974 "message": "Could not retrieve PSK from file: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:21:40.974 } 00:21:40.974 19:07:57 -- target/tls.sh@36 -- # killprocess 3149409 00:21:40.974 19:07:57 -- common/autotest_common.sh@936 -- # '[' -z 3149409 ']' 00:21:40.974 19:07:57 -- common/autotest_common.sh@940 -- # kill -0 3149409 00:21:40.974 19:07:57 -- common/autotest_common.sh@941 -- # uname 00:21:40.974 19:07:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:40.974 19:07:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3149409 00:21:40.974 19:07:57 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:21:40.974 19:07:57 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:21:40.974 19:07:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3149409' 00:21:40.974 killing process with pid 3149409 00:21:40.974 19:07:57 -- common/autotest_common.sh@955 -- # kill 3149409 00:21:40.974 Received shutdown signal, test time was about 10.000000 seconds 00:21:40.974 00:21:40.974 Latency(us) 00:21:40.974 [2024-11-26T18:07:57.901Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:40.974 [2024-11-26T18:07:57.901Z] =================================================================================================================== 00:21:40.974 [2024-11-26T18:07:57.901Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:21:40.974 19:07:57 -- common/autotest_common.sh@960 -- # wait 3149409 00:21:41.233 19:07:58 -- target/tls.sh@37 -- # return 1 00:21:41.233 19:07:58 -- common/autotest_common.sh@653 -- # es=1 00:21:41.233 19:07:58 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:21:41.233 19:07:58 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:21:41.233 19:07:58 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:21:41.233 19:07:58 -- target/tls.sh@183 -- # killprocess 3147056 00:21:41.233 19:07:58 -- common/autotest_common.sh@936 -- # '[' -z 3147056 ']' 00:21:41.233 19:07:58 -- common/autotest_common.sh@940 -- # kill -0 3147056 00:21:41.233 19:07:58 -- common/autotest_common.sh@941 -- # uname 00:21:41.233 19:07:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:41.233 19:07:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3147056 00:21:41.233 19:07:58 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:21:41.233 19:07:58 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:21:41.233 19:07:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3147056' 00:21:41.233 killing process with pid 3147056 00:21:41.233 19:07:58 -- common/autotest_common.sh@955 -- # kill 3147056 00:21:41.233 19:07:58 -- common/autotest_common.sh@960 -- # wait 3147056 00:21:41.493 19:07:58 -- target/tls.sh@184 -- # nvmfappstart -m 0x2 00:21:41.493 19:07:58 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:41.493 19:07:58 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:41.493 19:07:58 -- common/autotest_common.sh@10 -- # set +x 00:21:41.493 19:07:58 -- nvmf/common.sh@469 -- # nvmfpid=3149656 00:21:41.493 19:07:58 -- nvmf/common.sh@470 -- # waitforlisten 3149656 00:21:41.493 19:07:58 -- common/autotest_common.sh@829 -- # '[' -z 3149656 ']' 00:21:41.493 19:07:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:41.493 19:07:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:41.493 19:07:58 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:21:41.493 19:07:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:41.493 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:41.493 19:07:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:41.493 19:07:58 -- common/autotest_common.sh@10 -- # set +x 00:21:41.493 [2024-11-26 19:07:58.318614] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:21:41.493 [2024-11-26 19:07:58.318660] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:41.493 EAL: No free 2048 kB hugepages reported on node 1 00:21:41.493 [2024-11-26 19:07:58.375838] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:41.493 [2024-11-26 19:07:58.413609] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:41.493 [2024-11-26 19:07:58.413718] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:41.493 [2024-11-26 19:07:58.413725] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:41.493 [2024-11-26 19:07:58.413732] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:41.493 [2024-11-26 19:07:58.413748] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:42.435 19:07:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:42.435 19:07:59 -- common/autotest_common.sh@862 -- # return 0 00:21:42.435 19:07:59 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:42.435 19:07:59 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:42.435 19:07:59 -- common/autotest_common.sh@10 -- # set +x 00:21:42.435 19:07:59 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:42.435 19:07:59 -- target/tls.sh@186 -- # NOT setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:42.435 19:07:59 -- common/autotest_common.sh@650 -- # local es=0 00:21:42.435 19:07:59 -- common/autotest_common.sh@652 -- # valid_exec_arg setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:42.435 19:07:59 -- common/autotest_common.sh@638 -- # local arg=setup_nvmf_tgt 00:21:42.435 19:07:59 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:42.435 19:07:59 -- common/autotest_common.sh@642 -- # type -t setup_nvmf_tgt 00:21:42.435 19:07:59 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:42.435 19:07:59 -- common/autotest_common.sh@653 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:42.435 19:07:59 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:42.435 19:07:59 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:21:42.435 [2024-11-26 19:07:59.327773] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:42.435 19:07:59 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:21:42.698 19:07:59 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:21:42.957 [2024-11-26 19:07:59.692701] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:21:42.957 [2024-11-26 19:07:59.692892] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:42.957 19:07:59 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:21:42.957 malloc0 00:21:43.216 19:07:59 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:21:43.216 19:08:00 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:43.475 [2024-11-26 19:08:00.242191] tcp.c:3551:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:21:43.475 [2024-11-26 19:08:00.242219] tcp.c:3620:nvmf_tcp_subsystem_add_host: *ERROR*: Could not retrieve PSK from file 00:21:43.475 [2024-11-26 19:08:00.242233] subsystem.c: 880:spdk_nvmf_subsystem_add_host: *ERROR*: Unable to add host to TCP transport 00:21:43.475 request: 00:21:43.475 { 00:21:43.475 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:43.475 "host": "nqn.2016-06.io.spdk:host1", 00:21:43.475 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:21:43.475 "method": "nvmf_subsystem_add_host", 00:21:43.475 "req_id": 1 00:21:43.475 } 00:21:43.475 Got JSON-RPC error response 00:21:43.475 response: 00:21:43.475 { 00:21:43.475 "code": -32603, 00:21:43.475 "message": "Internal error" 00:21:43.475 } 00:21:43.475 19:08:00 -- common/autotest_common.sh@653 -- # es=1 00:21:43.475 19:08:00 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:21:43.475 19:08:00 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:21:43.476 19:08:00 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:21:43.476 19:08:00 -- target/tls.sh@189 -- # killprocess 3149656 00:21:43.476 19:08:00 -- common/autotest_common.sh@936 -- # '[' -z 3149656 ']' 00:21:43.476 19:08:00 -- common/autotest_common.sh@940 -- # kill -0 3149656 00:21:43.476 19:08:00 -- common/autotest_common.sh@941 -- # uname 00:21:43.476 19:08:00 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:43.476 19:08:00 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3149656 00:21:43.476 19:08:00 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:21:43.476 19:08:00 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:21:43.476 19:08:00 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3149656' 00:21:43.476 killing process with pid 3149656 00:21:43.476 19:08:00 -- common/autotest_common.sh@955 -- # kill 3149656 00:21:43.476 19:08:00 -- common/autotest_common.sh@960 -- # wait 3149656 00:21:43.735 19:08:00 -- target/tls.sh@190 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:43.735 19:08:00 -- target/tls.sh@193 -- # nvmfappstart -m 0x2 00:21:43.735 19:08:00 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:43.735 19:08:00 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:43.735 19:08:00 -- common/autotest_common.sh@10 -- # set +x 00:21:43.735 19:08:00 -- nvmf/common.sh@469 -- # nvmfpid=3149931 00:21:43.735 19:08:00 -- nvmf/common.sh@470 -- # waitforlisten 3149931 00:21:43.735 19:08:00 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:21:43.735 19:08:00 -- common/autotest_common.sh@829 -- # '[' -z 3149931 ']' 00:21:43.735 19:08:00 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:43.735 19:08:00 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:43.735 19:08:00 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:43.735 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:43.735 19:08:00 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:43.735 19:08:00 -- common/autotest_common.sh@10 -- # set +x 00:21:43.735 [2024-11-26 19:08:00.533560] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:21:43.735 [2024-11-26 19:08:00.533607] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:43.735 EAL: No free 2048 kB hugepages reported on node 1 00:21:43.735 [2024-11-26 19:08:00.589144] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:43.735 [2024-11-26 19:08:00.627219] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:43.735 [2024-11-26 19:08:00.627325] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:43.735 [2024-11-26 19:08:00.627335] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:43.735 [2024-11-26 19:08:00.627342] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:43.735 [2024-11-26 19:08:00.627362] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:44.673 19:08:01 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:44.673 19:08:01 -- common/autotest_common.sh@862 -- # return 0 00:21:44.673 19:08:01 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:44.673 19:08:01 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:44.673 19:08:01 -- common/autotest_common.sh@10 -- # set +x 00:21:44.673 19:08:01 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:44.674 19:08:01 -- target/tls.sh@194 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:44.674 19:08:01 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:44.674 19:08:01 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:21:44.674 [2024-11-26 19:08:01.545642] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:44.674 19:08:01 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:21:44.933 19:08:01 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:21:45.191 [2024-11-26 19:08:01.890533] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:21:45.191 [2024-11-26 19:08:01.890720] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:45.191 19:08:01 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:21:45.191 malloc0 00:21:45.191 19:08:02 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:21:45.450 19:08:02 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:45.709 19:08:02 -- target/tls.sh@196 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:21:45.709 19:08:02 -- target/tls.sh@197 -- # bdevperf_pid=3150414 00:21:45.709 19:08:02 -- target/tls.sh@199 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:21:45.709 19:08:02 -- target/tls.sh@200 -- # waitforlisten 3150414 /var/tmp/bdevperf.sock 00:21:45.709 19:08:02 -- common/autotest_common.sh@829 -- # '[' -z 3150414 ']' 00:21:45.709 19:08:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:45.709 19:08:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:45.709 19:08:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:45.709 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:45.709 19:08:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:45.709 19:08:02 -- common/autotest_common.sh@10 -- # set +x 00:21:45.709 [2024-11-26 19:08:02.499163] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:21:45.709 [2024-11-26 19:08:02.499211] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3150414 ] 00:21:45.709 EAL: No free 2048 kB hugepages reported on node 1 00:21:45.710 [2024-11-26 19:08:02.550450] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:45.710 [2024-11-26 19:08:02.587618] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:46.647 19:08:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:46.647 19:08:03 -- common/autotest_common.sh@862 -- # return 0 00:21:46.647 19:08:03 -- target/tls.sh@201 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:46.647 [2024-11-26 19:08:03.472572] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:21:46.647 TLSTESTn1 00:21:46.647 19:08:03 -- target/tls.sh@205 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py save_config 00:21:46.907 19:08:03 -- target/tls.sh@205 -- # tgtconf='{ 00:21:46.907 "subsystems": [ 00:21:46.907 { 00:21:46.907 "subsystem": "iobuf", 00:21:46.907 "config": [ 00:21:46.907 { 00:21:46.907 "method": "iobuf_set_options", 00:21:46.907 "params": { 00:21:46.907 "small_pool_count": 8192, 00:21:46.907 "large_pool_count": 1024, 00:21:46.907 "small_bufsize": 8192, 00:21:46.907 "large_bufsize": 135168 00:21:46.907 } 00:21:46.907 } 00:21:46.907 ] 00:21:46.907 }, 00:21:46.907 { 00:21:46.907 "subsystem": "sock", 00:21:46.907 "config": [ 00:21:46.907 { 00:21:46.907 "method": "sock_impl_set_options", 00:21:46.907 "params": { 00:21:46.907 "impl_name": "posix", 00:21:46.907 "recv_buf_size": 2097152, 00:21:46.907 "send_buf_size": 2097152, 00:21:46.907 "enable_recv_pipe": true, 00:21:46.907 "enable_quickack": false, 00:21:46.907 "enable_placement_id": 0, 00:21:46.907 "enable_zerocopy_send_server": true, 00:21:46.907 "enable_zerocopy_send_client": false, 00:21:46.907 "zerocopy_threshold": 0, 00:21:46.907 "tls_version": 0, 00:21:46.907 "enable_ktls": false 00:21:46.907 } 00:21:46.907 }, 00:21:46.907 { 00:21:46.907 "method": "sock_impl_set_options", 00:21:46.907 "params": { 00:21:46.907 "impl_name": "ssl", 00:21:46.907 "recv_buf_size": 4096, 00:21:46.907 "send_buf_size": 4096, 00:21:46.907 "enable_recv_pipe": true, 00:21:46.907 "enable_quickack": false, 00:21:46.907 "enable_placement_id": 0, 00:21:46.907 "enable_zerocopy_send_server": true, 00:21:46.907 "enable_zerocopy_send_client": false, 00:21:46.907 "zerocopy_threshold": 0, 00:21:46.907 "tls_version": 0, 00:21:46.907 "enable_ktls": false 00:21:46.907 } 00:21:46.907 } 00:21:46.907 ] 00:21:46.907 }, 00:21:46.907 { 00:21:46.907 "subsystem": "vmd", 00:21:46.907 "config": [] 00:21:46.908 }, 00:21:46.908 { 00:21:46.908 "subsystem": "accel", 00:21:46.908 "config": [ 00:21:46.908 { 00:21:46.908 "method": "accel_set_options", 00:21:46.908 "params": { 00:21:46.908 "small_cache_size": 128, 00:21:46.908 "large_cache_size": 16, 00:21:46.908 "task_count": 2048, 00:21:46.908 "sequence_count": 2048, 00:21:46.908 "buf_count": 2048 00:21:46.908 } 00:21:46.908 } 00:21:46.908 ] 00:21:46.908 }, 00:21:46.908 { 00:21:46.908 "subsystem": "bdev", 00:21:46.908 "config": [ 00:21:46.908 { 00:21:46.908 "method": "bdev_set_options", 00:21:46.908 "params": { 00:21:46.908 "bdev_io_pool_size": 65535, 00:21:46.908 "bdev_io_cache_size": 256, 00:21:46.908 "bdev_auto_examine": true, 00:21:46.908 "iobuf_small_cache_size": 128, 00:21:46.908 "iobuf_large_cache_size": 16 00:21:46.908 } 00:21:46.908 }, 00:21:46.908 { 00:21:46.908 "method": "bdev_raid_set_options", 00:21:46.908 "params": { 00:21:46.908 "process_window_size_kb": 1024 00:21:46.908 } 00:21:46.908 }, 00:21:46.908 { 00:21:46.908 "method": "bdev_iscsi_set_options", 00:21:46.908 "params": { 00:21:46.908 "timeout_sec": 30 00:21:46.908 } 00:21:46.908 }, 00:21:46.908 { 00:21:46.908 "method": "bdev_nvme_set_options", 00:21:46.908 "params": { 00:21:46.908 "action_on_timeout": "none", 00:21:46.908 "timeout_us": 0, 00:21:46.908 "timeout_admin_us": 0, 00:21:46.908 "keep_alive_timeout_ms": 10000, 00:21:46.908 "transport_retry_count": 4, 00:21:46.908 "arbitration_burst": 0, 00:21:46.908 "low_priority_weight": 0, 00:21:46.908 "medium_priority_weight": 0, 00:21:46.908 "high_priority_weight": 0, 00:21:46.908 "nvme_adminq_poll_period_us": 10000, 00:21:46.908 "nvme_ioq_poll_period_us": 0, 00:21:46.908 "io_queue_requests": 0, 00:21:46.908 "delay_cmd_submit": true, 00:21:46.908 "bdev_retry_count": 3, 00:21:46.908 "transport_ack_timeout": 0, 00:21:46.908 "ctrlr_loss_timeout_sec": 0, 00:21:46.908 "reconnect_delay_sec": 0, 00:21:46.908 "fast_io_fail_timeout_sec": 0, 00:21:46.908 "generate_uuids": false, 00:21:46.908 "transport_tos": 0, 00:21:46.908 "io_path_stat": false, 00:21:46.908 "allow_accel_sequence": false 00:21:46.908 } 00:21:46.908 }, 00:21:46.908 { 00:21:46.908 "method": "bdev_nvme_set_hotplug", 00:21:46.908 "params": { 00:21:46.908 "period_us": 100000, 00:21:46.908 "enable": false 00:21:46.908 } 00:21:46.908 }, 00:21:46.908 { 00:21:46.908 "method": "bdev_malloc_create", 00:21:46.908 "params": { 00:21:46.908 "name": "malloc0", 00:21:46.908 "num_blocks": 8192, 00:21:46.908 "block_size": 4096, 00:21:46.908 "physical_block_size": 4096, 00:21:46.908 "uuid": "9f6ff026-76fa-457f-8977-4e53e1eb223d", 00:21:46.908 "optimal_io_boundary": 0 00:21:46.908 } 00:21:46.908 }, 00:21:46.908 { 00:21:46.908 "method": "bdev_wait_for_examine" 00:21:46.908 } 00:21:46.908 ] 00:21:46.908 }, 00:21:46.908 { 00:21:46.908 "subsystem": "nbd", 00:21:46.908 "config": [] 00:21:46.908 }, 00:21:46.908 { 00:21:46.908 "subsystem": "scheduler", 00:21:46.908 "config": [ 00:21:46.908 { 00:21:46.908 "method": "framework_set_scheduler", 00:21:46.908 "params": { 00:21:46.908 "name": "static" 00:21:46.908 } 00:21:46.908 } 00:21:46.908 ] 00:21:46.908 }, 00:21:46.908 { 00:21:46.908 "subsystem": "nvmf", 00:21:46.908 "config": [ 00:21:46.908 { 00:21:46.908 "method": "nvmf_set_config", 00:21:46.908 "params": { 00:21:46.908 "discovery_filter": "match_any", 00:21:46.908 "admin_cmd_passthru": { 00:21:46.908 "identify_ctrlr": false 00:21:46.908 } 00:21:46.908 } 00:21:46.908 }, 00:21:46.908 { 00:21:46.908 "method": "nvmf_set_max_subsystems", 00:21:46.908 "params": { 00:21:46.908 "max_subsystems": 1024 00:21:46.908 } 00:21:46.908 }, 00:21:46.908 { 00:21:46.908 "method": "nvmf_set_crdt", 00:21:46.908 "params": { 00:21:46.908 "crdt1": 0, 00:21:46.908 "crdt2": 0, 00:21:46.908 "crdt3": 0 00:21:46.908 } 00:21:46.908 }, 00:21:46.908 { 00:21:46.908 "method": "nvmf_create_transport", 00:21:46.908 "params": { 00:21:46.908 "trtype": "TCP", 00:21:46.908 "max_queue_depth": 128, 00:21:46.908 "max_io_qpairs_per_ctrlr": 127, 00:21:46.908 "in_capsule_data_size": 4096, 00:21:46.908 "max_io_size": 131072, 00:21:46.908 "io_unit_size": 131072, 00:21:46.908 "max_aq_depth": 128, 00:21:46.908 "num_shared_buffers": 511, 00:21:46.908 "buf_cache_size": 4294967295, 00:21:46.908 "dif_insert_or_strip": false, 00:21:46.908 "zcopy": false, 00:21:46.908 "c2h_success": false, 00:21:46.908 "sock_priority": 0, 00:21:46.908 "abort_timeout_sec": 1 00:21:46.908 } 00:21:46.908 }, 00:21:46.908 { 00:21:46.908 "method": "nvmf_create_subsystem", 00:21:46.908 "params": { 00:21:46.908 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:46.908 "allow_any_host": false, 00:21:46.908 "serial_number": "SPDK00000000000001", 00:21:46.908 "model_number": "SPDK bdev Controller", 00:21:46.908 "max_namespaces": 10, 00:21:46.908 "min_cntlid": 1, 00:21:46.908 "max_cntlid": 65519, 00:21:46.908 "ana_reporting": false 00:21:46.908 } 00:21:46.908 }, 00:21:46.908 { 00:21:46.908 "method": "nvmf_subsystem_add_host", 00:21:46.908 "params": { 00:21:46.908 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:46.908 "host": "nqn.2016-06.io.spdk:host1", 00:21:46.908 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:21:46.908 } 00:21:46.908 }, 00:21:46.908 { 00:21:46.908 "method": "nvmf_subsystem_add_ns", 00:21:46.908 "params": { 00:21:46.908 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:46.908 "namespace": { 00:21:46.908 "nsid": 1, 00:21:46.908 "bdev_name": "malloc0", 00:21:46.908 "nguid": "9F6FF02676FA457F89774E53E1EB223D", 00:21:46.908 "uuid": "9f6ff026-76fa-457f-8977-4e53e1eb223d" 00:21:46.908 } 00:21:46.908 } 00:21:46.908 }, 00:21:46.908 { 00:21:46.908 "method": "nvmf_subsystem_add_listener", 00:21:46.908 "params": { 00:21:46.908 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:46.908 "listen_address": { 00:21:46.908 "trtype": "TCP", 00:21:46.908 "adrfam": "IPv4", 00:21:46.908 "traddr": "10.0.0.2", 00:21:46.908 "trsvcid": "4420" 00:21:46.908 }, 00:21:46.908 "secure_channel": true 00:21:46.908 } 00:21:46.908 } 00:21:46.908 ] 00:21:46.908 } 00:21:46.908 ] 00:21:46.908 }' 00:21:46.908 19:08:03 -- target/tls.sh@206 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock save_config 00:21:47.169 19:08:04 -- target/tls.sh@206 -- # bdevperfconf='{ 00:21:47.169 "subsystems": [ 00:21:47.169 { 00:21:47.169 "subsystem": "iobuf", 00:21:47.169 "config": [ 00:21:47.169 { 00:21:47.169 "method": "iobuf_set_options", 00:21:47.169 "params": { 00:21:47.169 "small_pool_count": 8192, 00:21:47.169 "large_pool_count": 1024, 00:21:47.169 "small_bufsize": 8192, 00:21:47.169 "large_bufsize": 135168 00:21:47.169 } 00:21:47.169 } 00:21:47.169 ] 00:21:47.169 }, 00:21:47.169 { 00:21:47.169 "subsystem": "sock", 00:21:47.169 "config": [ 00:21:47.169 { 00:21:47.169 "method": "sock_impl_set_options", 00:21:47.169 "params": { 00:21:47.169 "impl_name": "posix", 00:21:47.169 "recv_buf_size": 2097152, 00:21:47.169 "send_buf_size": 2097152, 00:21:47.169 "enable_recv_pipe": true, 00:21:47.169 "enable_quickack": false, 00:21:47.169 "enable_placement_id": 0, 00:21:47.169 "enable_zerocopy_send_server": true, 00:21:47.169 "enable_zerocopy_send_client": false, 00:21:47.169 "zerocopy_threshold": 0, 00:21:47.169 "tls_version": 0, 00:21:47.169 "enable_ktls": false 00:21:47.169 } 00:21:47.169 }, 00:21:47.169 { 00:21:47.169 "method": "sock_impl_set_options", 00:21:47.169 "params": { 00:21:47.169 "impl_name": "ssl", 00:21:47.169 "recv_buf_size": 4096, 00:21:47.169 "send_buf_size": 4096, 00:21:47.169 "enable_recv_pipe": true, 00:21:47.169 "enable_quickack": false, 00:21:47.169 "enable_placement_id": 0, 00:21:47.169 "enable_zerocopy_send_server": true, 00:21:47.169 "enable_zerocopy_send_client": false, 00:21:47.169 "zerocopy_threshold": 0, 00:21:47.169 "tls_version": 0, 00:21:47.169 "enable_ktls": false 00:21:47.169 } 00:21:47.169 } 00:21:47.169 ] 00:21:47.169 }, 00:21:47.169 { 00:21:47.169 "subsystem": "vmd", 00:21:47.169 "config": [] 00:21:47.169 }, 00:21:47.169 { 00:21:47.169 "subsystem": "accel", 00:21:47.169 "config": [ 00:21:47.169 { 00:21:47.169 "method": "accel_set_options", 00:21:47.169 "params": { 00:21:47.169 "small_cache_size": 128, 00:21:47.169 "large_cache_size": 16, 00:21:47.169 "task_count": 2048, 00:21:47.169 "sequence_count": 2048, 00:21:47.169 "buf_count": 2048 00:21:47.169 } 00:21:47.169 } 00:21:47.169 ] 00:21:47.169 }, 00:21:47.169 { 00:21:47.169 "subsystem": "bdev", 00:21:47.169 "config": [ 00:21:47.169 { 00:21:47.169 "method": "bdev_set_options", 00:21:47.169 "params": { 00:21:47.169 "bdev_io_pool_size": 65535, 00:21:47.169 "bdev_io_cache_size": 256, 00:21:47.169 "bdev_auto_examine": true, 00:21:47.169 "iobuf_small_cache_size": 128, 00:21:47.169 "iobuf_large_cache_size": 16 00:21:47.169 } 00:21:47.169 }, 00:21:47.169 { 00:21:47.169 "method": "bdev_raid_set_options", 00:21:47.169 "params": { 00:21:47.169 "process_window_size_kb": 1024 00:21:47.169 } 00:21:47.169 }, 00:21:47.169 { 00:21:47.169 "method": "bdev_iscsi_set_options", 00:21:47.169 "params": { 00:21:47.169 "timeout_sec": 30 00:21:47.169 } 00:21:47.169 }, 00:21:47.169 { 00:21:47.169 "method": "bdev_nvme_set_options", 00:21:47.169 "params": { 00:21:47.169 "action_on_timeout": "none", 00:21:47.169 "timeout_us": 0, 00:21:47.169 "timeout_admin_us": 0, 00:21:47.169 "keep_alive_timeout_ms": 10000, 00:21:47.169 "transport_retry_count": 4, 00:21:47.169 "arbitration_burst": 0, 00:21:47.169 "low_priority_weight": 0, 00:21:47.169 "medium_priority_weight": 0, 00:21:47.169 "high_priority_weight": 0, 00:21:47.169 "nvme_adminq_poll_period_us": 10000, 00:21:47.169 "nvme_ioq_poll_period_us": 0, 00:21:47.169 "io_queue_requests": 512, 00:21:47.169 "delay_cmd_submit": true, 00:21:47.169 "bdev_retry_count": 3, 00:21:47.169 "transport_ack_timeout": 0, 00:21:47.169 "ctrlr_loss_timeout_sec": 0, 00:21:47.169 "reconnect_delay_sec": 0, 00:21:47.169 "fast_io_fail_timeout_sec": 0, 00:21:47.169 "generate_uuids": false, 00:21:47.169 "transport_tos": 0, 00:21:47.169 "io_path_stat": false, 00:21:47.169 "allow_accel_sequence": false 00:21:47.169 } 00:21:47.169 }, 00:21:47.169 { 00:21:47.169 "method": "bdev_nvme_attach_controller", 00:21:47.169 "params": { 00:21:47.169 "name": "TLSTEST", 00:21:47.169 "trtype": "TCP", 00:21:47.169 "adrfam": "IPv4", 00:21:47.169 "traddr": "10.0.0.2", 00:21:47.169 "trsvcid": "4420", 00:21:47.169 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:21:47.169 "prchk_reftag": false, 00:21:47.169 "prchk_guard": false, 00:21:47.169 "ctrlr_loss_timeout_sec": 0, 00:21:47.169 "reconnect_delay_sec": 0, 00:21:47.169 "fast_io_fail_timeout_sec": 0, 00:21:47.169 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:21:47.169 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:21:47.169 "hdgst": false, 00:21:47.169 "ddgst": false 00:21:47.169 } 00:21:47.169 }, 00:21:47.169 { 00:21:47.169 "method": "bdev_nvme_set_hotplug", 00:21:47.169 "params": { 00:21:47.169 "period_us": 100000, 00:21:47.169 "enable": false 00:21:47.169 } 00:21:47.169 }, 00:21:47.169 { 00:21:47.169 "method": "bdev_wait_for_examine" 00:21:47.169 } 00:21:47.169 ] 00:21:47.169 }, 00:21:47.169 { 00:21:47.169 "subsystem": "nbd", 00:21:47.169 "config": [] 00:21:47.169 } 00:21:47.169 ] 00:21:47.169 }' 00:21:47.169 19:08:04 -- target/tls.sh@208 -- # killprocess 3150414 00:21:47.169 19:08:04 -- common/autotest_common.sh@936 -- # '[' -z 3150414 ']' 00:21:47.169 19:08:04 -- common/autotest_common.sh@940 -- # kill -0 3150414 00:21:47.169 19:08:04 -- common/autotest_common.sh@941 -- # uname 00:21:47.169 19:08:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:47.169 19:08:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3150414 00:21:47.429 19:08:04 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:21:47.429 19:08:04 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:21:47.429 19:08:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3150414' 00:21:47.429 killing process with pid 3150414 00:21:47.429 19:08:04 -- common/autotest_common.sh@955 -- # kill 3150414 00:21:47.429 Received shutdown signal, test time was about 10.000000 seconds 00:21:47.429 00:21:47.429 Latency(us) 00:21:47.429 [2024-11-26T18:08:04.356Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:47.429 [2024-11-26T18:08:04.356Z] =================================================================================================================== 00:21:47.429 [2024-11-26T18:08:04.356Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:21:47.429 19:08:04 -- common/autotest_common.sh@960 -- # wait 3150414 00:21:47.429 19:08:04 -- target/tls.sh@209 -- # killprocess 3149931 00:21:47.429 19:08:04 -- common/autotest_common.sh@936 -- # '[' -z 3149931 ']' 00:21:47.429 19:08:04 -- common/autotest_common.sh@940 -- # kill -0 3149931 00:21:47.429 19:08:04 -- common/autotest_common.sh@941 -- # uname 00:21:47.429 19:08:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:47.429 19:08:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3149931 00:21:47.429 19:08:04 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:21:47.429 19:08:04 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:21:47.429 19:08:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3149931' 00:21:47.429 killing process with pid 3149931 00:21:47.429 19:08:04 -- common/autotest_common.sh@955 -- # kill 3149931 00:21:47.429 19:08:04 -- common/autotest_common.sh@960 -- # wait 3149931 00:21:47.688 19:08:04 -- target/tls.sh@212 -- # nvmfappstart -m 0x2 -c /dev/fd/62 00:21:47.688 19:08:04 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:47.688 19:08:04 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:47.688 19:08:04 -- target/tls.sh@212 -- # echo '{ 00:21:47.688 "subsystems": [ 00:21:47.688 { 00:21:47.688 "subsystem": "iobuf", 00:21:47.688 "config": [ 00:21:47.688 { 00:21:47.688 "method": "iobuf_set_options", 00:21:47.688 "params": { 00:21:47.688 "small_pool_count": 8192, 00:21:47.688 "large_pool_count": 1024, 00:21:47.688 "small_bufsize": 8192, 00:21:47.688 "large_bufsize": 135168 00:21:47.688 } 00:21:47.688 } 00:21:47.688 ] 00:21:47.688 }, 00:21:47.688 { 00:21:47.688 "subsystem": "sock", 00:21:47.688 "config": [ 00:21:47.688 { 00:21:47.688 "method": "sock_impl_set_options", 00:21:47.688 "params": { 00:21:47.688 "impl_name": "posix", 00:21:47.688 "recv_buf_size": 2097152, 00:21:47.688 "send_buf_size": 2097152, 00:21:47.688 "enable_recv_pipe": true, 00:21:47.688 "enable_quickack": false, 00:21:47.688 "enable_placement_id": 0, 00:21:47.688 "enable_zerocopy_send_server": true, 00:21:47.688 "enable_zerocopy_send_client": false, 00:21:47.688 "zerocopy_threshold": 0, 00:21:47.688 "tls_version": 0, 00:21:47.688 "enable_ktls": false 00:21:47.688 } 00:21:47.688 }, 00:21:47.688 { 00:21:47.688 "method": "sock_impl_set_options", 00:21:47.688 "params": { 00:21:47.688 "impl_name": "ssl", 00:21:47.688 "recv_buf_size": 4096, 00:21:47.688 "send_buf_size": 4096, 00:21:47.688 "enable_recv_pipe": true, 00:21:47.688 "enable_quickack": false, 00:21:47.689 "enable_placement_id": 0, 00:21:47.689 "enable_zerocopy_send_server": true, 00:21:47.689 "enable_zerocopy_send_client": false, 00:21:47.689 "zerocopy_threshold": 0, 00:21:47.689 "tls_version": 0, 00:21:47.689 "enable_ktls": false 00:21:47.689 } 00:21:47.689 } 00:21:47.689 ] 00:21:47.689 }, 00:21:47.689 { 00:21:47.689 "subsystem": "vmd", 00:21:47.689 "config": [] 00:21:47.689 }, 00:21:47.689 { 00:21:47.689 "subsystem": "accel", 00:21:47.689 "config": [ 00:21:47.689 { 00:21:47.689 "method": "accel_set_options", 00:21:47.689 "params": { 00:21:47.689 "small_cache_size": 128, 00:21:47.689 "large_cache_size": 16, 00:21:47.689 "task_count": 2048, 00:21:47.689 "sequence_count": 2048, 00:21:47.689 "buf_count": 2048 00:21:47.689 } 00:21:47.689 } 00:21:47.689 ] 00:21:47.689 }, 00:21:47.689 { 00:21:47.689 "subsystem": "bdev", 00:21:47.689 "config": [ 00:21:47.689 { 00:21:47.689 "method": "bdev_set_options", 00:21:47.689 "params": { 00:21:47.689 "bdev_io_pool_size": 65535, 00:21:47.689 "bdev_io_cache_size": 256, 00:21:47.689 "bdev_auto_examine": true, 00:21:47.689 "iobuf_small_cache_size": 128, 00:21:47.689 "iobuf_large_cache_size": 16 00:21:47.689 } 00:21:47.689 }, 00:21:47.689 { 00:21:47.689 "method": "bdev_raid_set_options", 00:21:47.689 "params": { 00:21:47.689 "process_window_size_kb": 1024 00:21:47.689 } 00:21:47.689 }, 00:21:47.689 { 00:21:47.689 "method": "bdev_iscsi_set_options", 00:21:47.689 "params": { 00:21:47.689 "timeout_sec": 30 00:21:47.689 } 00:21:47.689 }, 00:21:47.689 { 00:21:47.689 "method": "bdev_nvme_set_options", 00:21:47.689 "params": { 00:21:47.689 "action_on_timeout": "none", 00:21:47.689 "timeout_us": 0, 00:21:47.689 "timeout_admin_us": 0, 00:21:47.689 "keep_alive_timeout_ms": 10000, 00:21:47.689 "transport_retry_count": 4, 00:21:47.689 "arbitration_burst": 0, 00:21:47.689 "low_priority_weight": 0, 00:21:47.689 "medium_priority_weight": 0, 00:21:47.689 "high_priority_weight": 0, 00:21:47.689 "nvme_adminq_poll_period_us": 10000, 00:21:47.689 "nvme_ioq_poll_period_us": 0, 00:21:47.689 "io_queue_requests": 0, 00:21:47.689 "delay_cmd_submit": true, 00:21:47.689 "bdev_retry_count": 3, 00:21:47.689 "transport_ack_timeout": 0, 00:21:47.689 "ctrlr_loss_timeout_sec": 0, 00:21:47.689 "reconnect_delay_sec": 0, 00:21:47.689 "fast_io_fail_timeout_sec": 0, 00:21:47.689 "generate_uuids": false, 00:21:47.689 "transport_tos": 0, 00:21:47.689 "io_path_stat": false, 00:21:47.689 "allow_accel_sequence": false 00:21:47.689 } 00:21:47.689 }, 00:21:47.689 { 00:21:47.689 "method": "bdev_nvme_set_hotplug", 00:21:47.689 "params": { 00:21:47.689 "period_us": 100000, 00:21:47.689 "enable": false 00:21:47.689 } 00:21:47.689 }, 00:21:47.689 { 00:21:47.689 "method": "bdev_malloc_create", 00:21:47.689 "params": { 00:21:47.689 "name": "malloc0", 00:21:47.689 "num_blocks": 8192, 00:21:47.689 "block_size": 4096, 00:21:47.689 "physical_block_size": 4096, 00:21:47.689 "uuid": "9f6ff026-76fa-457f-8977-4e53e1eb223d", 00:21:47.689 "optimal_io_boundary": 0 00:21:47.689 } 00:21:47.689 }, 00:21:47.689 { 00:21:47.689 "method": "bdev_wait_for_examine" 00:21:47.689 } 00:21:47.689 ] 00:21:47.689 }, 00:21:47.689 { 00:21:47.689 "subsystem": "nbd", 00:21:47.689 "config": [] 00:21:47.689 }, 00:21:47.689 { 00:21:47.689 "subsystem": "scheduler", 00:21:47.689 "config": [ 00:21:47.689 { 00:21:47.689 "method": "framework_set_scheduler", 00:21:47.689 "params": { 00:21:47.689 "name": "static" 00:21:47.689 } 00:21:47.689 } 00:21:47.689 ] 00:21:47.689 }, 00:21:47.689 { 00:21:47.689 "subsystem": "nvmf", 00:21:47.689 "config": [ 00:21:47.689 { 00:21:47.689 "method": "nvmf_set_config", 00:21:47.689 "params": { 00:21:47.689 "discovery_filter": "match_any", 00:21:47.689 "admin_cmd_passthru": { 00:21:47.689 "identify_ctrlr": false 00:21:47.689 } 00:21:47.689 } 00:21:47.689 }, 00:21:47.689 { 00:21:47.689 "method": "nvmf_set_max_subsystems", 00:21:47.689 "params": { 00:21:47.689 "max_subsystems": 1024 00:21:47.689 } 00:21:47.689 }, 00:21:47.689 { 00:21:47.689 "method": "nvmf_set_crdt", 00:21:47.689 "params": { 00:21:47.689 "crdt1": 0, 00:21:47.689 "crdt2": 0, 00:21:47.689 "crdt3": 0 00:21:47.689 } 00:21:47.689 }, 00:21:47.689 { 00:21:47.689 "method": "nvmf_create_transport", 00:21:47.689 "params": { 00:21:47.689 "trtype": "TCP", 00:21:47.689 "max_queue_depth": 128, 00:21:47.689 "max_io_qpairs_per_ctrlr": 127, 00:21:47.689 "in_capsule_data_size": 4096, 00:21:47.689 "max_io_size": 131072, 00:21:47.689 "io_unit_size": 131072, 00:21:47.689 "max_aq_depth": 128, 00:21:47.689 "num_shared_buffers": 511, 00:21:47.689 "buf_cache_size": 4294967295, 00:21:47.689 "dif_insert_or_strip": false, 00:21:47.689 "zcopy": false, 00:21:47.689 "c2h_success": false, 00:21:47.689 "sock_priority": 0, 00:21:47.689 "abort_timeout_sec": 1 00:21:47.689 } 00:21:47.689 }, 00:21:47.689 { 00:21:47.689 "method": "nvmf_create_subsystem", 00:21:47.689 "params": { 00:21:47.689 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:47.689 "allow_any_host": false, 00:21:47.689 "serial_number": "SPDK00000000000001", 00:21:47.689 "model_number": "SPDK bdev Controller", 00:21:47.689 "max_namespaces": 10, 00:21:47.689 "min_cntlid": 1, 00:21:47.689 "max_cntlid": 65519, 00:21:47.689 "ana_reporting": false 00:21:47.689 } 00:21:47.689 }, 00:21:47.689 { 00:21:47.689 "method": "nvmf_subsystem_add_host", 00:21:47.689 "params": { 00:21:47.689 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:47.689 "host": "nqn.2016-06.io.spdk:host1", 00:21:47.689 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:21:47.689 } 00:21:47.689 }, 00:21:47.689 { 00:21:47.689 "method": "nvmf_subsystem_add_ns", 00:21:47.689 "params": { 00:21:47.689 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:47.689 "namespace": { 00:21:47.689 "nsid": 1, 00:21:47.689 "bdev_name": "malloc0", 00:21:47.689 "nguid": "9F6FF02676FA457F89774E53E1EB223D", 00:21:47.689 "uuid": "9f6ff026-76fa-457f-8977-4e53e1eb223d" 00:21:47.689 } 00:21:47.689 } 00:21:47.689 }, 00:21:47.689 { 00:21:47.689 "method": "nvmf_subsystem_add_listener", 00:21:47.689 "params": { 00:21:47.689 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:47.689 "listen_address": { 00:21:47.689 "trtype": "TCP", 00:21:47.689 "adrfam": "IPv4", 00:21:47.689 "traddr": "10.0.0.2", 00:21:47.689 "trsvcid": "4420" 00:21:47.689 }, 00:21:47.689 "secure_channel": true 00:21:47.689 } 00:21:47.689 } 00:21:47.689 ] 00:21:47.689 } 00:21:47.689 ] 00:21:47.689 }' 00:21:47.689 19:08:04 -- common/autotest_common.sh@10 -- # set +x 00:21:47.689 19:08:04 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 -c /dev/fd/62 00:21:47.689 19:08:04 -- nvmf/common.sh@469 -- # nvmfpid=3150673 00:21:47.690 19:08:04 -- nvmf/common.sh@470 -- # waitforlisten 3150673 00:21:47.690 19:08:04 -- common/autotest_common.sh@829 -- # '[' -z 3150673 ']' 00:21:47.690 19:08:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:47.690 19:08:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:47.690 19:08:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:47.690 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:47.690 19:08:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:47.690 19:08:04 -- common/autotest_common.sh@10 -- # set +x 00:21:47.690 [2024-11-26 19:08:04.565078] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:21:47.690 [2024-11-26 19:08:04.565124] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:47.690 EAL: No free 2048 kB hugepages reported on node 1 00:21:47.952 [2024-11-26 19:08:04.622175] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:47.952 [2024-11-26 19:08:04.660998] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:47.952 [2024-11-26 19:08:04.661106] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:47.952 [2024-11-26 19:08:04.661115] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:47.952 [2024-11-26 19:08:04.661121] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:47.952 [2024-11-26 19:08:04.661142] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:47.952 [2024-11-26 19:08:04.851542] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:48.211 [2024-11-26 19:08:04.883577] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:21:48.211 [2024-11-26 19:08:04.883784] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:48.470 19:08:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:48.470 19:08:05 -- common/autotest_common.sh@862 -- # return 0 00:21:48.470 19:08:05 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:48.729 19:08:05 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:48.729 19:08:05 -- common/autotest_common.sh@10 -- # set +x 00:21:48.729 19:08:05 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:48.729 19:08:05 -- target/tls.sh@216 -- # bdevperf_pid=3150923 00:21:48.729 19:08:05 -- target/tls.sh@217 -- # waitforlisten 3150923 /var/tmp/bdevperf.sock 00:21:48.729 19:08:05 -- common/autotest_common.sh@829 -- # '[' -z 3150923 ']' 00:21:48.729 19:08:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:48.729 19:08:05 -- target/tls.sh@213 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 -c /dev/fd/63 00:21:48.729 19:08:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:48.729 19:08:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:48.729 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:48.729 19:08:05 -- target/tls.sh@213 -- # echo '{ 00:21:48.729 "subsystems": [ 00:21:48.729 { 00:21:48.729 "subsystem": "iobuf", 00:21:48.729 "config": [ 00:21:48.729 { 00:21:48.729 "method": "iobuf_set_options", 00:21:48.729 "params": { 00:21:48.729 "small_pool_count": 8192, 00:21:48.729 "large_pool_count": 1024, 00:21:48.729 "small_bufsize": 8192, 00:21:48.729 "large_bufsize": 135168 00:21:48.729 } 00:21:48.729 } 00:21:48.729 ] 00:21:48.729 }, 00:21:48.729 { 00:21:48.729 "subsystem": "sock", 00:21:48.729 "config": [ 00:21:48.729 { 00:21:48.729 "method": "sock_impl_set_options", 00:21:48.729 "params": { 00:21:48.729 "impl_name": "posix", 00:21:48.729 "recv_buf_size": 2097152, 00:21:48.729 "send_buf_size": 2097152, 00:21:48.729 "enable_recv_pipe": true, 00:21:48.729 "enable_quickack": false, 00:21:48.729 "enable_placement_id": 0, 00:21:48.729 "enable_zerocopy_send_server": true, 00:21:48.730 "enable_zerocopy_send_client": false, 00:21:48.730 "zerocopy_threshold": 0, 00:21:48.730 "tls_version": 0, 00:21:48.730 "enable_ktls": false 00:21:48.730 } 00:21:48.730 }, 00:21:48.730 { 00:21:48.730 "method": "sock_impl_set_options", 00:21:48.730 "params": { 00:21:48.730 "impl_name": "ssl", 00:21:48.730 "recv_buf_size": 4096, 00:21:48.730 "send_buf_size": 4096, 00:21:48.730 "enable_recv_pipe": true, 00:21:48.730 "enable_quickack": false, 00:21:48.730 "enable_placement_id": 0, 00:21:48.730 "enable_zerocopy_send_server": true, 00:21:48.730 "enable_zerocopy_send_client": false, 00:21:48.730 "zerocopy_threshold": 0, 00:21:48.730 "tls_version": 0, 00:21:48.730 "enable_ktls": false 00:21:48.730 } 00:21:48.730 } 00:21:48.730 ] 00:21:48.730 }, 00:21:48.730 { 00:21:48.730 "subsystem": "vmd", 00:21:48.730 "config": [] 00:21:48.730 }, 00:21:48.730 { 00:21:48.730 "subsystem": "accel", 00:21:48.730 "config": [ 00:21:48.730 { 00:21:48.730 "method": "accel_set_options", 00:21:48.730 "params": { 00:21:48.730 "small_cache_size": 128, 00:21:48.730 "large_cache_size": 16, 00:21:48.730 "task_count": 2048, 00:21:48.730 "sequence_count": 2048, 00:21:48.730 "buf_count": 2048 00:21:48.730 } 00:21:48.730 } 00:21:48.730 ] 00:21:48.730 }, 00:21:48.730 { 00:21:48.730 "subsystem": "bdev", 00:21:48.730 "config": [ 00:21:48.730 { 00:21:48.730 "method": "bdev_set_options", 00:21:48.730 "params": { 00:21:48.730 "bdev_io_pool_size": 65535, 00:21:48.730 "bdev_io_cache_size": 256, 00:21:48.730 "bdev_auto_examine": true, 00:21:48.730 "iobuf_small_cache_size": 128, 00:21:48.730 "iobuf_large_cache_size": 16 00:21:48.730 } 00:21:48.730 }, 00:21:48.730 { 00:21:48.730 "method": "bdev_raid_set_options", 00:21:48.730 "params": { 00:21:48.730 "process_window_size_kb": 1024 00:21:48.730 } 00:21:48.730 }, 00:21:48.730 { 00:21:48.730 "method": "bdev_iscsi_set_options", 00:21:48.730 "params": { 00:21:48.730 "timeout_sec": 30 00:21:48.730 } 00:21:48.730 }, 00:21:48.730 { 00:21:48.730 "method": "bdev_nvme_set_options", 00:21:48.730 "params": { 00:21:48.730 "action_on_timeout": "none", 00:21:48.730 "timeout_us": 0, 00:21:48.730 "timeout_admin_us": 0, 00:21:48.730 "keep_alive_timeout_ms": 10000, 00:21:48.730 "transport_retry_count": 4, 00:21:48.730 "arbitration_burst": 0, 00:21:48.730 "low_priority_weight": 0, 00:21:48.730 "medium_priority_weight": 0, 00:21:48.730 "high_priority_weight": 0, 00:21:48.730 "nvme_adminq_poll_period_us": 10000, 00:21:48.730 "nvme_ioq_poll_period_us": 0, 00:21:48.730 "io_queue_requests": 512, 00:21:48.730 "delay_cmd_submit": true, 00:21:48.730 "bdev_retry_count": 3, 00:21:48.730 "transport_ack_timeout": 0, 00:21:48.730 "ctrlr_loss_timeout_sec": 0, 00:21:48.730 "reconnect_delay_sec": 0, 00:21:48.730 "fast_io_fail_timeout_sec": 0, 00:21:48.730 "generate_uuids": false, 00:21:48.730 "transport_tos": 0, 00:21:48.730 "io_path_stat": false, 00:21:48.730 "allow_accel_sequence": false 00:21:48.730 } 00:21:48.730 }, 00:21:48.730 { 00:21:48.730 "method": "bdev_nvme_attach_controller", 00:21:48.730 "params": { 00:21:48.730 "name": "TLSTEST", 00:21:48.730 "trtype": "TCP", 00:21:48.730 "adrfam": "IPv4", 00:21:48.730 "traddr": "10.0.0.2", 00:21:48.730 "trsvcid": "4420", 00:21:48.730 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:21:48.730 "prchk_reftag": false, 00:21:48.730 "prchk_guard": false, 00:21:48.730 "ctrlr_loss_timeout_sec": 0, 00:21:48.730 "reconnect_delay_sec": 0, 00:21:48.730 "fast_io_fail_timeout_sec": 0, 00:21:48.730 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:21:48.730 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:21:48.730 "hdgst": false, 00:21:48.730 "ddgst": false 00:21:48.730 } 00:21:48.730 }, 00:21:48.730 { 00:21:48.730 "method": "bdev_nvme_set_hotplug", 00:21:48.730 "params": { 00:21:48.730 "period_us": 100000, 00:21:48.730 "enable": false 00:21:48.730 } 00:21:48.730 }, 00:21:48.730 { 00:21:48.730 "method": "bdev_wait_for_examine" 00:21:48.730 } 00:21:48.730 ] 00:21:48.730 }, 00:21:48.730 { 00:21:48.730 "subsystem": "nbd", 00:21:48.730 "config": [] 00:21:48.730 } 00:21:48.730 ] 00:21:48.730 }' 00:21:48.730 19:08:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:48.730 19:08:05 -- common/autotest_common.sh@10 -- # set +x 00:21:48.730 [2024-11-26 19:08:05.469287] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:21:48.730 [2024-11-26 19:08:05.469333] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3150923 ] 00:21:48.730 EAL: No free 2048 kB hugepages reported on node 1 00:21:48.730 [2024-11-26 19:08:05.519511] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:48.730 [2024-11-26 19:08:05.557604] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:48.989 [2024-11-26 19:08:05.685061] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:21:49.558 19:08:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:49.558 19:08:06 -- common/autotest_common.sh@862 -- # return 0 00:21:49.558 19:08:06 -- target/tls.sh@220 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:21:49.558 Running I/O for 10 seconds... 00:21:59.554 00:21:59.554 Latency(us) 00:21:59.554 [2024-11-26T18:08:16.481Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:59.554 [2024-11-26T18:08:16.481Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:21:59.554 Verification LBA range: start 0x0 length 0x2000 00:21:59.554 TLSTESTn1 : 10.01 6561.33 25.63 0.00 0.00 19488.61 3148.58 38523.77 00:21:59.554 [2024-11-26T18:08:16.481Z] =================================================================================================================== 00:21:59.554 [2024-11-26T18:08:16.481Z] Total : 6561.33 25.63 0.00 0.00 19488.61 3148.58 38523.77 00:21:59.554 0 00:21:59.554 19:08:16 -- target/tls.sh@222 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:21:59.554 19:08:16 -- target/tls.sh@223 -- # killprocess 3150923 00:21:59.554 19:08:16 -- common/autotest_common.sh@936 -- # '[' -z 3150923 ']' 00:21:59.554 19:08:16 -- common/autotest_common.sh@940 -- # kill -0 3150923 00:21:59.554 19:08:16 -- common/autotest_common.sh@941 -- # uname 00:21:59.554 19:08:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:59.554 19:08:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3150923 00:21:59.814 19:08:16 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:21:59.814 19:08:16 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:21:59.814 19:08:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3150923' 00:21:59.814 killing process with pid 3150923 00:21:59.814 19:08:16 -- common/autotest_common.sh@955 -- # kill 3150923 00:21:59.814 Received shutdown signal, test time was about 10.000000 seconds 00:21:59.814 00:21:59.814 Latency(us) 00:21:59.814 [2024-11-26T18:08:16.741Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:59.814 [2024-11-26T18:08:16.741Z] =================================================================================================================== 00:21:59.814 [2024-11-26T18:08:16.741Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:21:59.814 19:08:16 -- common/autotest_common.sh@960 -- # wait 3150923 00:21:59.814 19:08:16 -- target/tls.sh@224 -- # killprocess 3150673 00:21:59.814 19:08:16 -- common/autotest_common.sh@936 -- # '[' -z 3150673 ']' 00:21:59.814 19:08:16 -- common/autotest_common.sh@940 -- # kill -0 3150673 00:21:59.814 19:08:16 -- common/autotest_common.sh@941 -- # uname 00:21:59.814 19:08:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:59.814 19:08:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3150673 00:21:59.814 19:08:16 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:21:59.814 19:08:16 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:21:59.814 19:08:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3150673' 00:21:59.814 killing process with pid 3150673 00:21:59.814 19:08:16 -- common/autotest_common.sh@955 -- # kill 3150673 00:21:59.814 19:08:16 -- common/autotest_common.sh@960 -- # wait 3150673 00:22:00.074 19:08:16 -- target/tls.sh@226 -- # trap - SIGINT SIGTERM EXIT 00:22:00.074 19:08:16 -- target/tls.sh@227 -- # cleanup 00:22:00.074 19:08:16 -- target/tls.sh@15 -- # process_shm --id 0 00:22:00.074 19:08:16 -- common/autotest_common.sh@806 -- # type=--id 00:22:00.074 19:08:16 -- common/autotest_common.sh@807 -- # id=0 00:22:00.074 19:08:16 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:22:00.074 19:08:16 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:22:00.074 19:08:16 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:22:00.074 19:08:16 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:22:00.074 19:08:16 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:22:00.074 19:08:16 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:22:00.074 nvmf_trace.0 00:22:00.074 19:08:16 -- common/autotest_common.sh@821 -- # return 0 00:22:00.074 19:08:16 -- target/tls.sh@16 -- # killprocess 3150923 00:22:00.074 19:08:16 -- common/autotest_common.sh@936 -- # '[' -z 3150923 ']' 00:22:00.074 19:08:16 -- common/autotest_common.sh@940 -- # kill -0 3150923 00:22:00.074 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3150923) - No such process 00:22:00.074 19:08:16 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3150923 is not found' 00:22:00.074 Process with pid 3150923 is not found 00:22:00.074 19:08:16 -- target/tls.sh@17 -- # nvmftestfini 00:22:00.074 19:08:16 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:00.074 19:08:16 -- nvmf/common.sh@116 -- # sync 00:22:00.074 19:08:16 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:00.074 19:08:16 -- nvmf/common.sh@119 -- # set +e 00:22:00.074 19:08:16 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:00.074 19:08:16 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:00.074 rmmod nvme_tcp 00:22:00.074 rmmod nvme_fabrics 00:22:00.333 rmmod nvme_keyring 00:22:00.334 19:08:17 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:00.334 19:08:17 -- nvmf/common.sh@123 -- # set -e 00:22:00.334 19:08:17 -- nvmf/common.sh@124 -- # return 0 00:22:00.334 19:08:17 -- nvmf/common.sh@477 -- # '[' -n 3150673 ']' 00:22:00.334 19:08:17 -- nvmf/common.sh@478 -- # killprocess 3150673 00:22:00.334 19:08:17 -- common/autotest_common.sh@936 -- # '[' -z 3150673 ']' 00:22:00.334 19:08:17 -- common/autotest_common.sh@940 -- # kill -0 3150673 00:22:00.334 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3150673) - No such process 00:22:00.334 19:08:17 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3150673 is not found' 00:22:00.334 Process with pid 3150673 is not found 00:22:00.334 19:08:17 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:00.334 19:08:17 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:00.334 19:08:17 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:00.334 19:08:17 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:00.334 19:08:17 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:00.334 19:08:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:00.334 19:08:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:00.334 19:08:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:02.241 19:08:19 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:02.241 19:08:19 -- target/tls.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:22:02.241 00:22:02.241 real 1m12.112s 00:22:02.241 user 1m46.637s 00:22:02.241 sys 0m27.982s 00:22:02.241 19:08:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:02.241 19:08:19 -- common/autotest_common.sh@10 -- # set +x 00:22:02.241 ************************************ 00:22:02.241 END TEST nvmf_tls 00:22:02.241 ************************************ 00:22:02.241 19:08:19 -- nvmf/nvmf.sh@60 -- # run_test nvmf_fips /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:22:02.241 19:08:19 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:02.241 19:08:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:02.241 19:08:19 -- common/autotest_common.sh@10 -- # set +x 00:22:02.241 ************************************ 00:22:02.241 START TEST nvmf_fips 00:22:02.241 ************************************ 00:22:02.241 19:08:19 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:22:02.501 * Looking for test storage... 00:22:02.501 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips 00:22:02.501 19:08:19 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:02.501 19:08:19 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:02.501 19:08:19 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:02.501 19:08:19 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:02.501 19:08:19 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:02.501 19:08:19 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:02.501 19:08:19 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:02.501 19:08:19 -- scripts/common.sh@335 -- # IFS=.-: 00:22:02.501 19:08:19 -- scripts/common.sh@335 -- # read -ra ver1 00:22:02.501 19:08:19 -- scripts/common.sh@336 -- # IFS=.-: 00:22:02.501 19:08:19 -- scripts/common.sh@336 -- # read -ra ver2 00:22:02.501 19:08:19 -- scripts/common.sh@337 -- # local 'op=<' 00:22:02.501 19:08:19 -- scripts/common.sh@339 -- # ver1_l=2 00:22:02.501 19:08:19 -- scripts/common.sh@340 -- # ver2_l=1 00:22:02.501 19:08:19 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:02.501 19:08:19 -- scripts/common.sh@343 -- # case "$op" in 00:22:02.501 19:08:19 -- scripts/common.sh@344 -- # : 1 00:22:02.501 19:08:19 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:02.501 19:08:19 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:02.501 19:08:19 -- scripts/common.sh@364 -- # decimal 1 00:22:02.501 19:08:19 -- scripts/common.sh@352 -- # local d=1 00:22:02.501 19:08:19 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:02.501 19:08:19 -- scripts/common.sh@354 -- # echo 1 00:22:02.501 19:08:19 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:02.501 19:08:19 -- scripts/common.sh@365 -- # decimal 2 00:22:02.501 19:08:19 -- scripts/common.sh@352 -- # local d=2 00:22:02.501 19:08:19 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:02.501 19:08:19 -- scripts/common.sh@354 -- # echo 2 00:22:02.501 19:08:19 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:02.501 19:08:19 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:02.501 19:08:19 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:02.501 19:08:19 -- scripts/common.sh@367 -- # return 0 00:22:02.501 19:08:19 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:02.501 19:08:19 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:02.501 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:02.501 --rc genhtml_branch_coverage=1 00:22:02.501 --rc genhtml_function_coverage=1 00:22:02.501 --rc genhtml_legend=1 00:22:02.501 --rc geninfo_all_blocks=1 00:22:02.501 --rc geninfo_unexecuted_blocks=1 00:22:02.501 00:22:02.501 ' 00:22:02.501 19:08:19 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:02.501 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:02.501 --rc genhtml_branch_coverage=1 00:22:02.501 --rc genhtml_function_coverage=1 00:22:02.501 --rc genhtml_legend=1 00:22:02.501 --rc geninfo_all_blocks=1 00:22:02.501 --rc geninfo_unexecuted_blocks=1 00:22:02.501 00:22:02.501 ' 00:22:02.501 19:08:19 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:02.501 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:02.501 --rc genhtml_branch_coverage=1 00:22:02.501 --rc genhtml_function_coverage=1 00:22:02.501 --rc genhtml_legend=1 00:22:02.501 --rc geninfo_all_blocks=1 00:22:02.501 --rc geninfo_unexecuted_blocks=1 00:22:02.501 00:22:02.501 ' 00:22:02.501 19:08:19 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:02.501 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:02.501 --rc genhtml_branch_coverage=1 00:22:02.501 --rc genhtml_function_coverage=1 00:22:02.501 --rc genhtml_legend=1 00:22:02.501 --rc geninfo_all_blocks=1 00:22:02.501 --rc geninfo_unexecuted_blocks=1 00:22:02.501 00:22:02.501 ' 00:22:02.501 19:08:19 -- fips/fips.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:02.501 19:08:19 -- nvmf/common.sh@7 -- # uname -s 00:22:02.501 19:08:19 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:02.501 19:08:19 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:02.501 19:08:19 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:02.501 19:08:19 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:02.501 19:08:19 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:02.501 19:08:19 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:02.501 19:08:19 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:02.501 19:08:19 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:02.501 19:08:19 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:02.501 19:08:19 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:02.501 19:08:19 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:22:02.501 19:08:19 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:22:02.501 19:08:19 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:02.501 19:08:19 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:02.501 19:08:19 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:02.501 19:08:19 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:02.501 19:08:19 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:02.501 19:08:19 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:02.501 19:08:19 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:02.501 19:08:19 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:02.501 19:08:19 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:02.501 19:08:19 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:02.501 19:08:19 -- paths/export.sh@5 -- # export PATH 00:22:02.501 19:08:19 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:02.501 19:08:19 -- nvmf/common.sh@46 -- # : 0 00:22:02.501 19:08:19 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:02.502 19:08:19 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:02.502 19:08:19 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:02.502 19:08:19 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:02.502 19:08:19 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:02.502 19:08:19 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:02.502 19:08:19 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:02.502 19:08:19 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:02.502 19:08:19 -- fips/fips.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:22:02.502 19:08:19 -- fips/fips.sh@89 -- # check_openssl_version 00:22:02.502 19:08:19 -- fips/fips.sh@83 -- # local target=3.0.0 00:22:02.502 19:08:19 -- fips/fips.sh@85 -- # openssl version 00:22:02.502 19:08:19 -- fips/fips.sh@85 -- # awk '{print $2}' 00:22:02.502 19:08:19 -- fips/fips.sh@85 -- # ge 3.1.1 3.0.0 00:22:02.502 19:08:19 -- scripts/common.sh@375 -- # cmp_versions 3.1.1 '>=' 3.0.0 00:22:02.502 19:08:19 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:02.502 19:08:19 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:02.502 19:08:19 -- scripts/common.sh@335 -- # IFS=.-: 00:22:02.502 19:08:19 -- scripts/common.sh@335 -- # read -ra ver1 00:22:02.502 19:08:19 -- scripts/common.sh@336 -- # IFS=.-: 00:22:02.502 19:08:19 -- scripts/common.sh@336 -- # read -ra ver2 00:22:02.502 19:08:19 -- scripts/common.sh@337 -- # local 'op=>=' 00:22:02.502 19:08:19 -- scripts/common.sh@339 -- # ver1_l=3 00:22:02.502 19:08:19 -- scripts/common.sh@340 -- # ver2_l=3 00:22:02.502 19:08:19 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:02.502 19:08:19 -- scripts/common.sh@343 -- # case "$op" in 00:22:02.502 19:08:19 -- scripts/common.sh@347 -- # : 1 00:22:02.502 19:08:19 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:02.502 19:08:19 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:02.502 19:08:19 -- scripts/common.sh@364 -- # decimal 3 00:22:02.502 19:08:19 -- scripts/common.sh@352 -- # local d=3 00:22:02.502 19:08:19 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:22:02.502 19:08:19 -- scripts/common.sh@354 -- # echo 3 00:22:02.502 19:08:19 -- scripts/common.sh@364 -- # ver1[v]=3 00:22:02.502 19:08:19 -- scripts/common.sh@365 -- # decimal 3 00:22:02.502 19:08:19 -- scripts/common.sh@352 -- # local d=3 00:22:02.502 19:08:19 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:22:02.502 19:08:19 -- scripts/common.sh@354 -- # echo 3 00:22:02.502 19:08:19 -- scripts/common.sh@365 -- # ver2[v]=3 00:22:02.502 19:08:19 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:02.502 19:08:19 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:02.502 19:08:19 -- scripts/common.sh@363 -- # (( v++ )) 00:22:02.502 19:08:19 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:02.502 19:08:19 -- scripts/common.sh@364 -- # decimal 1 00:22:02.502 19:08:19 -- scripts/common.sh@352 -- # local d=1 00:22:02.502 19:08:19 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:02.502 19:08:19 -- scripts/common.sh@354 -- # echo 1 00:22:02.502 19:08:19 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:02.502 19:08:19 -- scripts/common.sh@365 -- # decimal 0 00:22:02.502 19:08:19 -- scripts/common.sh@352 -- # local d=0 00:22:02.502 19:08:19 -- scripts/common.sh@353 -- # [[ 0 =~ ^[0-9]+$ ]] 00:22:02.502 19:08:19 -- scripts/common.sh@354 -- # echo 0 00:22:02.502 19:08:19 -- scripts/common.sh@365 -- # ver2[v]=0 00:22:02.502 19:08:19 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:02.502 19:08:19 -- scripts/common.sh@366 -- # return 0 00:22:02.502 19:08:19 -- fips/fips.sh@95 -- # openssl info -modulesdir 00:22:02.502 19:08:19 -- fips/fips.sh@95 -- # [[ ! -f /usr/lib64/ossl-modules/fips.so ]] 00:22:02.502 19:08:19 -- fips/fips.sh@100 -- # openssl fipsinstall -help 00:22:02.502 19:08:19 -- fips/fips.sh@100 -- # warn='This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode' 00:22:02.502 19:08:19 -- fips/fips.sh@101 -- # [[ This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode == \T\h\i\s\ \c\o\m\m\a\n\d\ \i\s\ \n\o\t\ \e\n\a\b\l\e\d* ]] 00:22:02.502 19:08:19 -- fips/fips.sh@104 -- # export callback=build_openssl_config 00:22:02.502 19:08:19 -- fips/fips.sh@104 -- # callback=build_openssl_config 00:22:02.502 19:08:19 -- fips/fips.sh@113 -- # build_openssl_config 00:22:02.502 19:08:19 -- fips/fips.sh@37 -- # cat 00:22:02.502 19:08:19 -- fips/fips.sh@57 -- # [[ ! -t 0 ]] 00:22:02.502 19:08:19 -- fips/fips.sh@58 -- # cat - 00:22:02.502 19:08:19 -- fips/fips.sh@114 -- # export OPENSSL_CONF=spdk_fips.conf 00:22:02.502 19:08:19 -- fips/fips.sh@114 -- # OPENSSL_CONF=spdk_fips.conf 00:22:02.502 19:08:19 -- fips/fips.sh@116 -- # mapfile -t providers 00:22:02.502 19:08:19 -- fips/fips.sh@116 -- # openssl list -providers 00:22:02.502 19:08:19 -- fips/fips.sh@116 -- # grep name 00:22:02.502 19:08:19 -- fips/fips.sh@120 -- # (( 2 != 2 )) 00:22:02.502 19:08:19 -- fips/fips.sh@120 -- # [[ name: openssl base provider != *base* ]] 00:22:02.502 19:08:19 -- fips/fips.sh@120 -- # [[ name: red hat enterprise linux 9 - openssl fips provider != *fips* ]] 00:22:02.502 19:08:19 -- fips/fips.sh@127 -- # NOT openssl md5 /dev/fd/62 00:22:02.502 19:08:19 -- fips/fips.sh@127 -- # : 00:22:02.502 19:08:19 -- common/autotest_common.sh@650 -- # local es=0 00:22:02.502 19:08:19 -- common/autotest_common.sh@652 -- # valid_exec_arg openssl md5 /dev/fd/62 00:22:02.502 19:08:19 -- common/autotest_common.sh@638 -- # local arg=openssl 00:22:02.761 19:08:19 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:02.761 19:08:19 -- common/autotest_common.sh@642 -- # type -t openssl 00:22:02.761 19:08:19 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:02.761 19:08:19 -- common/autotest_common.sh@644 -- # type -P openssl 00:22:02.761 19:08:19 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:02.761 19:08:19 -- common/autotest_common.sh@644 -- # arg=/usr/bin/openssl 00:22:02.761 19:08:19 -- common/autotest_common.sh@644 -- # [[ -x /usr/bin/openssl ]] 00:22:02.761 19:08:19 -- common/autotest_common.sh@653 -- # openssl md5 /dev/fd/62 00:22:02.761 Error setting digest 00:22:02.761 40726952E37F0000:error:0308010C:digital envelope routines:inner_evp_generic_fetch:unsupported:crypto/evp/evp_fetch.c:341:Global default library context, Algorithm (MD5 : 95), Properties () 00:22:02.761 40726952E37F0000:error:03000086:digital envelope routines:evp_md_init_internal:initialization error:crypto/evp/digest.c:272: 00:22:02.761 19:08:19 -- common/autotest_common.sh@653 -- # es=1 00:22:02.761 19:08:19 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:22:02.761 19:08:19 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:22:02.761 19:08:19 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:22:02.761 19:08:19 -- fips/fips.sh@130 -- # nvmftestinit 00:22:02.761 19:08:19 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:02.761 19:08:19 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:02.761 19:08:19 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:02.761 19:08:19 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:02.761 19:08:19 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:02.761 19:08:19 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:02.761 19:08:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:02.761 19:08:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:02.761 19:08:19 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:02.761 19:08:19 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:02.761 19:08:19 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:02.761 19:08:19 -- common/autotest_common.sh@10 -- # set +x 00:22:08.041 19:08:24 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:08.041 19:08:24 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:08.041 19:08:24 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:08.041 19:08:24 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:08.041 19:08:24 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:08.041 19:08:24 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:08.041 19:08:24 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:08.041 19:08:24 -- nvmf/common.sh@294 -- # net_devs=() 00:22:08.041 19:08:24 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:08.041 19:08:24 -- nvmf/common.sh@295 -- # e810=() 00:22:08.041 19:08:24 -- nvmf/common.sh@295 -- # local -ga e810 00:22:08.041 19:08:24 -- nvmf/common.sh@296 -- # x722=() 00:22:08.041 19:08:24 -- nvmf/common.sh@296 -- # local -ga x722 00:22:08.041 19:08:24 -- nvmf/common.sh@297 -- # mlx=() 00:22:08.041 19:08:24 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:08.041 19:08:24 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:08.042 19:08:24 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:08.042 19:08:24 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:08.042 19:08:24 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:08.042 19:08:24 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:08.042 19:08:24 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:08.042 19:08:24 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:08.042 19:08:24 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:08.042 19:08:24 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:08.042 19:08:24 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:08.042 19:08:24 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:08.042 19:08:24 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:08.042 19:08:24 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:08.042 19:08:24 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:08.042 19:08:24 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:08.042 19:08:24 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:08.042 19:08:24 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:08.042 19:08:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:08.042 19:08:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:22:08.042 Found 0000:86:00.0 (0x8086 - 0x159b) 00:22:08.042 19:08:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:08.042 19:08:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:08.042 19:08:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:08.042 19:08:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:08.042 19:08:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:08.042 19:08:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:08.042 19:08:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:22:08.042 Found 0000:86:00.1 (0x8086 - 0x159b) 00:22:08.042 19:08:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:08.042 19:08:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:08.042 19:08:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:08.042 19:08:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:08.042 19:08:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:08.042 19:08:24 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:08.042 19:08:24 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:08.042 19:08:24 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:08.042 19:08:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:08.042 19:08:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:08.042 19:08:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:08.042 19:08:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:08.042 19:08:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:22:08.042 Found net devices under 0000:86:00.0: cvl_0_0 00:22:08.042 19:08:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:08.042 19:08:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:08.042 19:08:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:08.042 19:08:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:08.042 19:08:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:08.042 19:08:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:22:08.042 Found net devices under 0000:86:00.1: cvl_0_1 00:22:08.042 19:08:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:08.042 19:08:24 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:08.042 19:08:24 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:08.042 19:08:24 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:08.042 19:08:24 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:08.042 19:08:24 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:08.042 19:08:24 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:08.042 19:08:24 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:08.042 19:08:24 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:08.042 19:08:24 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:08.042 19:08:24 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:08.042 19:08:24 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:08.042 19:08:24 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:08.042 19:08:24 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:08.042 19:08:24 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:08.042 19:08:24 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:08.042 19:08:24 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:08.042 19:08:24 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:08.042 19:08:24 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:08.042 19:08:24 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:08.042 19:08:24 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:08.042 19:08:24 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:08.042 19:08:24 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:08.042 19:08:24 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:08.042 19:08:24 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:08.042 19:08:24 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:08.042 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:08.042 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.394 ms 00:22:08.042 00:22:08.042 --- 10.0.0.2 ping statistics --- 00:22:08.042 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:08.042 rtt min/avg/max/mdev = 0.394/0.394/0.394/0.000 ms 00:22:08.042 19:08:24 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:08.042 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:08.042 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.146 ms 00:22:08.042 00:22:08.042 --- 10.0.0.1 ping statistics --- 00:22:08.042 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:08.042 rtt min/avg/max/mdev = 0.146/0.146/0.146/0.000 ms 00:22:08.042 19:08:24 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:08.042 19:08:24 -- nvmf/common.sh@410 -- # return 0 00:22:08.042 19:08:24 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:08.042 19:08:24 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:08.042 19:08:24 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:08.042 19:08:24 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:08.042 19:08:24 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:08.042 19:08:24 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:08.042 19:08:24 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:08.042 19:08:24 -- fips/fips.sh@131 -- # nvmfappstart -m 0x2 00:22:08.042 19:08:24 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:08.042 19:08:24 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:08.042 19:08:24 -- common/autotest_common.sh@10 -- # set +x 00:22:08.042 19:08:24 -- nvmf/common.sh@469 -- # nvmfpid=3156286 00:22:08.042 19:08:24 -- nvmf/common.sh@470 -- # waitforlisten 3156286 00:22:08.042 19:08:24 -- common/autotest_common.sh@829 -- # '[' -z 3156286 ']' 00:22:08.042 19:08:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:08.042 19:08:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:08.042 19:08:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:08.042 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:08.042 19:08:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:08.042 19:08:24 -- common/autotest_common.sh@10 -- # set +x 00:22:08.042 19:08:24 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:22:08.042 [2024-11-26 19:08:24.949975] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:22:08.043 [2024-11-26 19:08:24.950027] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:08.301 EAL: No free 2048 kB hugepages reported on node 1 00:22:08.301 [2024-11-26 19:08:25.009859] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:08.301 [2024-11-26 19:08:25.048936] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:08.301 [2024-11-26 19:08:25.049073] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:08.301 [2024-11-26 19:08:25.049082] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:08.302 [2024-11-26 19:08:25.049089] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:08.302 [2024-11-26 19:08:25.049111] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:08.938 19:08:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:08.938 19:08:25 -- common/autotest_common.sh@862 -- # return 0 00:22:08.938 19:08:25 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:08.938 19:08:25 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:08.938 19:08:25 -- common/autotest_common.sh@10 -- # set +x 00:22:08.938 19:08:25 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:08.938 19:08:25 -- fips/fips.sh@133 -- # trap cleanup EXIT 00:22:08.938 19:08:25 -- fips/fips.sh@136 -- # key=NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:22:08.938 19:08:25 -- fips/fips.sh@137 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:22:08.938 19:08:25 -- fips/fips.sh@138 -- # echo -n NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:22:08.938 19:08:25 -- fips/fips.sh@139 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:22:08.938 19:08:25 -- fips/fips.sh@141 -- # setup_nvmf_tgt_conf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:22:08.938 19:08:25 -- fips/fips.sh@22 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:22:08.938 19:08:25 -- fips/fips.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:22:09.227 [2024-11-26 19:08:25.935897] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:09.227 [2024-11-26 19:08:25.951903] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:22:09.227 [2024-11-26 19:08:25.952090] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:09.227 malloc0 00:22:09.227 19:08:25 -- fips/fips.sh@144 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:22:09.227 19:08:25 -- fips/fips.sh@147 -- # bdevperf_pid=3156385 00:22:09.227 19:08:25 -- fips/fips.sh@145 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:22:09.227 19:08:25 -- fips/fips.sh@148 -- # waitforlisten 3156385 /var/tmp/bdevperf.sock 00:22:09.227 19:08:25 -- common/autotest_common.sh@829 -- # '[' -z 3156385 ']' 00:22:09.227 19:08:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:09.227 19:08:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:09.227 19:08:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:09.227 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:09.227 19:08:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:09.227 19:08:26 -- common/autotest_common.sh@10 -- # set +x 00:22:09.227 [2024-11-26 19:08:26.060301] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:22:09.227 [2024-11-26 19:08:26.060351] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3156385 ] 00:22:09.227 EAL: No free 2048 kB hugepages reported on node 1 00:22:09.227 [2024-11-26 19:08:26.113578] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:09.487 [2024-11-26 19:08:26.151940] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:10.057 19:08:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:10.057 19:08:26 -- common/autotest_common.sh@862 -- # return 0 00:22:10.057 19:08:26 -- fips/fips.sh@150 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:22:10.317 [2024-11-26 19:08:27.009008] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:22:10.317 TLSTESTn1 00:22:10.317 19:08:27 -- fips/fips.sh@154 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:22:10.317 Running I/O for 10 seconds... 00:22:22.526 00:22:22.526 Latency(us) 00:22:22.526 [2024-11-26T18:08:39.453Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:22.526 [2024-11-26T18:08:39.453Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:22:22.526 Verification LBA range: start 0x0 length 0x2000 00:22:22.526 TLSTESTn1 : 10.02 6482.51 25.32 0.00 0.00 19719.08 4929.45 37611.97 00:22:22.526 [2024-11-26T18:08:39.453Z] =================================================================================================================== 00:22:22.526 [2024-11-26T18:08:39.453Z] Total : 6482.51 25.32 0.00 0.00 19719.08 4929.45 37611.97 00:22:22.526 0 00:22:22.526 19:08:37 -- fips/fips.sh@1 -- # cleanup 00:22:22.526 19:08:37 -- fips/fips.sh@15 -- # process_shm --id 0 00:22:22.526 19:08:37 -- common/autotest_common.sh@806 -- # type=--id 00:22:22.526 19:08:37 -- common/autotest_common.sh@807 -- # id=0 00:22:22.526 19:08:37 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:22:22.526 19:08:37 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:22:22.526 19:08:37 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:22:22.526 19:08:37 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:22:22.526 19:08:37 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:22:22.526 19:08:37 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:22:22.526 nvmf_trace.0 00:22:22.526 19:08:37 -- common/autotest_common.sh@821 -- # return 0 00:22:22.526 19:08:37 -- fips/fips.sh@16 -- # killprocess 3156385 00:22:22.526 19:08:37 -- common/autotest_common.sh@936 -- # '[' -z 3156385 ']' 00:22:22.526 19:08:37 -- common/autotest_common.sh@940 -- # kill -0 3156385 00:22:22.526 19:08:37 -- common/autotest_common.sh@941 -- # uname 00:22:22.526 19:08:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:22.526 19:08:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3156385 00:22:22.526 19:08:37 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:22:22.526 19:08:37 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:22:22.526 19:08:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3156385' 00:22:22.526 killing process with pid 3156385 00:22:22.526 19:08:37 -- common/autotest_common.sh@955 -- # kill 3156385 00:22:22.526 Received shutdown signal, test time was about 10.000000 seconds 00:22:22.526 00:22:22.526 Latency(us) 00:22:22.526 [2024-11-26T18:08:39.453Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:22.526 [2024-11-26T18:08:39.453Z] =================================================================================================================== 00:22:22.526 [2024-11-26T18:08:39.453Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:22:22.526 19:08:37 -- common/autotest_common.sh@960 -- # wait 3156385 00:22:22.526 19:08:37 -- fips/fips.sh@17 -- # nvmftestfini 00:22:22.526 19:08:37 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:22.526 19:08:37 -- nvmf/common.sh@116 -- # sync 00:22:22.526 19:08:37 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:22.526 19:08:37 -- nvmf/common.sh@119 -- # set +e 00:22:22.526 19:08:37 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:22.526 19:08:37 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:22.526 rmmod nvme_tcp 00:22:22.526 rmmod nvme_fabrics 00:22:22.526 rmmod nvme_keyring 00:22:22.526 19:08:37 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:22.526 19:08:37 -- nvmf/common.sh@123 -- # set -e 00:22:22.526 19:08:37 -- nvmf/common.sh@124 -- # return 0 00:22:22.526 19:08:37 -- nvmf/common.sh@477 -- # '[' -n 3156286 ']' 00:22:22.526 19:08:37 -- nvmf/common.sh@478 -- # killprocess 3156286 00:22:22.526 19:08:37 -- common/autotest_common.sh@936 -- # '[' -z 3156286 ']' 00:22:22.526 19:08:37 -- common/autotest_common.sh@940 -- # kill -0 3156286 00:22:22.526 19:08:37 -- common/autotest_common.sh@941 -- # uname 00:22:22.526 19:08:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:22.527 19:08:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3156286 00:22:22.527 19:08:37 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:22:22.527 19:08:37 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:22:22.527 19:08:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3156286' 00:22:22.527 killing process with pid 3156286 00:22:22.527 19:08:37 -- common/autotest_common.sh@955 -- # kill 3156286 00:22:22.527 19:08:37 -- common/autotest_common.sh@960 -- # wait 3156286 00:22:22.527 19:08:37 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:22.527 19:08:37 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:22.527 19:08:37 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:22.527 19:08:37 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:22.527 19:08:37 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:22.527 19:08:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:22.527 19:08:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:22.527 19:08:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:23.096 19:08:39 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:23.096 19:08:39 -- fips/fips.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:22:23.096 00:22:23.096 real 0m20.747s 00:22:23.096 user 0m21.915s 00:22:23.096 sys 0m9.568s 00:22:23.096 19:08:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:23.096 19:08:39 -- common/autotest_common.sh@10 -- # set +x 00:22:23.096 ************************************ 00:22:23.096 END TEST nvmf_fips 00:22:23.096 ************************************ 00:22:23.096 19:08:39 -- nvmf/nvmf.sh@63 -- # '[' 1 -eq 1 ']' 00:22:23.096 19:08:39 -- nvmf/nvmf.sh@64 -- # run_test nvmf_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:22:23.096 19:08:39 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:23.096 19:08:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:23.096 19:08:39 -- common/autotest_common.sh@10 -- # set +x 00:22:23.096 ************************************ 00:22:23.096 START TEST nvmf_fuzz 00:22:23.096 ************************************ 00:22:23.096 19:08:39 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:22:23.096 * Looking for test storage... 00:22:23.096 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:22:23.096 19:08:39 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:23.096 19:08:39 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:23.096 19:08:39 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:23.355 19:08:40 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:23.355 19:08:40 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:23.355 19:08:40 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:23.355 19:08:40 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:23.355 19:08:40 -- scripts/common.sh@335 -- # IFS=.-: 00:22:23.355 19:08:40 -- scripts/common.sh@335 -- # read -ra ver1 00:22:23.355 19:08:40 -- scripts/common.sh@336 -- # IFS=.-: 00:22:23.355 19:08:40 -- scripts/common.sh@336 -- # read -ra ver2 00:22:23.355 19:08:40 -- scripts/common.sh@337 -- # local 'op=<' 00:22:23.355 19:08:40 -- scripts/common.sh@339 -- # ver1_l=2 00:22:23.355 19:08:40 -- scripts/common.sh@340 -- # ver2_l=1 00:22:23.355 19:08:40 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:23.355 19:08:40 -- scripts/common.sh@343 -- # case "$op" in 00:22:23.355 19:08:40 -- scripts/common.sh@344 -- # : 1 00:22:23.355 19:08:40 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:23.355 19:08:40 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:23.355 19:08:40 -- scripts/common.sh@364 -- # decimal 1 00:22:23.355 19:08:40 -- scripts/common.sh@352 -- # local d=1 00:22:23.355 19:08:40 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:23.355 19:08:40 -- scripts/common.sh@354 -- # echo 1 00:22:23.355 19:08:40 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:23.355 19:08:40 -- scripts/common.sh@365 -- # decimal 2 00:22:23.355 19:08:40 -- scripts/common.sh@352 -- # local d=2 00:22:23.355 19:08:40 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:23.355 19:08:40 -- scripts/common.sh@354 -- # echo 2 00:22:23.355 19:08:40 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:23.355 19:08:40 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:23.355 19:08:40 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:23.355 19:08:40 -- scripts/common.sh@367 -- # return 0 00:22:23.355 19:08:40 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:23.355 19:08:40 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:23.355 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:23.355 --rc genhtml_branch_coverage=1 00:22:23.355 --rc genhtml_function_coverage=1 00:22:23.355 --rc genhtml_legend=1 00:22:23.355 --rc geninfo_all_blocks=1 00:22:23.355 --rc geninfo_unexecuted_blocks=1 00:22:23.355 00:22:23.355 ' 00:22:23.356 19:08:40 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:23.356 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:23.356 --rc genhtml_branch_coverage=1 00:22:23.356 --rc genhtml_function_coverage=1 00:22:23.356 --rc genhtml_legend=1 00:22:23.356 --rc geninfo_all_blocks=1 00:22:23.356 --rc geninfo_unexecuted_blocks=1 00:22:23.356 00:22:23.356 ' 00:22:23.356 19:08:40 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:23.356 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:23.356 --rc genhtml_branch_coverage=1 00:22:23.356 --rc genhtml_function_coverage=1 00:22:23.356 --rc genhtml_legend=1 00:22:23.356 --rc geninfo_all_blocks=1 00:22:23.356 --rc geninfo_unexecuted_blocks=1 00:22:23.356 00:22:23.356 ' 00:22:23.356 19:08:40 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:23.356 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:23.356 --rc genhtml_branch_coverage=1 00:22:23.356 --rc genhtml_function_coverage=1 00:22:23.356 --rc genhtml_legend=1 00:22:23.356 --rc geninfo_all_blocks=1 00:22:23.356 --rc geninfo_unexecuted_blocks=1 00:22:23.356 00:22:23.356 ' 00:22:23.356 19:08:40 -- target/fabrics_fuzz.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:23.356 19:08:40 -- nvmf/common.sh@7 -- # uname -s 00:22:23.356 19:08:40 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:23.356 19:08:40 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:23.356 19:08:40 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:23.356 19:08:40 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:23.356 19:08:40 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:23.356 19:08:40 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:23.356 19:08:40 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:23.356 19:08:40 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:23.356 19:08:40 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:23.356 19:08:40 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:23.356 19:08:40 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:22:23.356 19:08:40 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:22:23.356 19:08:40 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:23.356 19:08:40 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:23.356 19:08:40 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:23.356 19:08:40 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:23.356 19:08:40 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:23.356 19:08:40 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:23.356 19:08:40 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:23.356 19:08:40 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:23.356 19:08:40 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:23.356 19:08:40 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:23.356 19:08:40 -- paths/export.sh@5 -- # export PATH 00:22:23.356 19:08:40 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:23.356 19:08:40 -- nvmf/common.sh@46 -- # : 0 00:22:23.356 19:08:40 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:23.356 19:08:40 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:23.356 19:08:40 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:23.356 19:08:40 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:23.356 19:08:40 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:23.356 19:08:40 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:23.356 19:08:40 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:23.356 19:08:40 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:23.356 19:08:40 -- target/fabrics_fuzz.sh@11 -- # nvmftestinit 00:22:23.356 19:08:40 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:23.356 19:08:40 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:23.356 19:08:40 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:23.356 19:08:40 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:23.356 19:08:40 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:23.356 19:08:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:23.356 19:08:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:23.356 19:08:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:23.356 19:08:40 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:23.356 19:08:40 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:23.356 19:08:40 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:23.356 19:08:40 -- common/autotest_common.sh@10 -- # set +x 00:22:28.633 19:08:45 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:28.633 19:08:45 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:28.633 19:08:45 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:28.633 19:08:45 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:28.633 19:08:45 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:28.633 19:08:45 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:28.633 19:08:45 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:28.633 19:08:45 -- nvmf/common.sh@294 -- # net_devs=() 00:22:28.633 19:08:45 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:28.633 19:08:45 -- nvmf/common.sh@295 -- # e810=() 00:22:28.633 19:08:45 -- nvmf/common.sh@295 -- # local -ga e810 00:22:28.633 19:08:45 -- nvmf/common.sh@296 -- # x722=() 00:22:28.633 19:08:45 -- nvmf/common.sh@296 -- # local -ga x722 00:22:28.633 19:08:45 -- nvmf/common.sh@297 -- # mlx=() 00:22:28.633 19:08:45 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:28.633 19:08:45 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:28.633 19:08:45 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:28.633 19:08:45 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:28.633 19:08:45 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:28.633 19:08:45 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:28.633 19:08:45 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:28.633 19:08:45 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:28.633 19:08:45 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:28.633 19:08:45 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:28.633 19:08:45 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:28.633 19:08:45 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:28.633 19:08:45 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:28.633 19:08:45 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:28.633 19:08:45 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:28.633 19:08:45 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:28.633 19:08:45 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:28.633 19:08:45 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:28.633 19:08:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:28.633 19:08:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:22:28.633 Found 0000:86:00.0 (0x8086 - 0x159b) 00:22:28.633 19:08:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:28.633 19:08:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:28.633 19:08:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:28.633 19:08:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:28.633 19:08:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:28.633 19:08:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:28.633 19:08:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:22:28.633 Found 0000:86:00.1 (0x8086 - 0x159b) 00:22:28.633 19:08:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:28.633 19:08:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:28.633 19:08:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:28.633 19:08:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:28.633 19:08:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:28.633 19:08:45 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:28.633 19:08:45 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:28.633 19:08:45 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:28.633 19:08:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:28.633 19:08:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:28.633 19:08:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:28.633 19:08:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:28.633 19:08:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:22:28.633 Found net devices under 0000:86:00.0: cvl_0_0 00:22:28.633 19:08:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:28.633 19:08:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:28.633 19:08:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:28.633 19:08:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:28.633 19:08:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:28.633 19:08:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:22:28.633 Found net devices under 0000:86:00.1: cvl_0_1 00:22:28.633 19:08:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:28.633 19:08:45 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:28.633 19:08:45 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:28.633 19:08:45 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:28.633 19:08:45 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:28.633 19:08:45 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:28.633 19:08:45 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:28.634 19:08:45 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:28.634 19:08:45 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:28.634 19:08:45 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:28.634 19:08:45 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:28.634 19:08:45 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:28.634 19:08:45 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:28.634 19:08:45 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:28.634 19:08:45 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:28.634 19:08:45 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:28.634 19:08:45 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:28.634 19:08:45 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:28.634 19:08:45 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:28.634 19:08:45 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:28.634 19:08:45 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:28.634 19:08:45 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:28.634 19:08:45 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:28.634 19:08:45 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:28.634 19:08:45 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:28.634 19:08:45 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:28.634 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:28.634 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.442 ms 00:22:28.634 00:22:28.634 --- 10.0.0.2 ping statistics --- 00:22:28.634 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:28.634 rtt min/avg/max/mdev = 0.442/0.442/0.442/0.000 ms 00:22:28.634 19:08:45 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:28.634 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:28.634 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.220 ms 00:22:28.634 00:22:28.634 --- 10.0.0.1 ping statistics --- 00:22:28.634 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:28.634 rtt min/avg/max/mdev = 0.220/0.220/0.220/0.000 ms 00:22:28.634 19:08:45 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:28.634 19:08:45 -- nvmf/common.sh@410 -- # return 0 00:22:28.634 19:08:45 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:28.634 19:08:45 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:28.634 19:08:45 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:28.634 19:08:45 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:28.634 19:08:45 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:28.634 19:08:45 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:28.634 19:08:45 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:28.634 19:08:45 -- target/fabrics_fuzz.sh@13 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:22:28.634 19:08:45 -- target/fabrics_fuzz.sh@14 -- # nvmfpid=3161797 00:22:28.634 19:08:45 -- target/fabrics_fuzz.sh@16 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:22:28.634 19:08:45 -- target/fabrics_fuzz.sh@18 -- # waitforlisten 3161797 00:22:28.634 19:08:45 -- common/autotest_common.sh@829 -- # '[' -z 3161797 ']' 00:22:28.634 19:08:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:28.634 19:08:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:28.634 19:08:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:28.634 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:28.634 19:08:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:28.634 19:08:45 -- common/autotest_common.sh@10 -- # set +x 00:22:29.571 19:08:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:29.571 19:08:46 -- common/autotest_common.sh@862 -- # return 0 00:22:29.571 19:08:46 -- target/fabrics_fuzz.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:29.571 19:08:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:29.571 19:08:46 -- common/autotest_common.sh@10 -- # set +x 00:22:29.571 19:08:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:29.571 19:08:46 -- target/fabrics_fuzz.sh@21 -- # rpc_cmd bdev_malloc_create -b Malloc0 64 512 00:22:29.571 19:08:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:29.571 19:08:46 -- common/autotest_common.sh@10 -- # set +x 00:22:29.571 Malloc0 00:22:29.571 19:08:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:29.571 19:08:46 -- target/fabrics_fuzz.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:22:29.571 19:08:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:29.571 19:08:46 -- common/autotest_common.sh@10 -- # set +x 00:22:29.571 19:08:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:29.571 19:08:46 -- target/fabrics_fuzz.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:22:29.571 19:08:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:29.571 19:08:46 -- common/autotest_common.sh@10 -- # set +x 00:22:29.571 19:08:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:29.571 19:08:46 -- target/fabrics_fuzz.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:29.571 19:08:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:29.571 19:08:46 -- common/autotest_common.sh@10 -- # set +x 00:22:29.571 19:08:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:29.571 19:08:46 -- target/fabrics_fuzz.sh@27 -- # trid='trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' 00:22:29.571 19:08:46 -- target/fabrics_fuzz.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -t 30 -S 123456 -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -N -a 00:23:01.650 Fuzzing completed. Shutting down the fuzz application 00:23:01.650 00:23:01.650 Dumping successful admin opcodes: 00:23:01.650 8, 9, 10, 24, 00:23:01.650 Dumping successful io opcodes: 00:23:01.650 0, 9, 00:23:01.650 NS: 0x200003aeff00 I/O qp, Total commands completed: 907189, total successful commands: 5284, random_seed: 2630716800 00:23:01.650 NS: 0x200003aeff00 admin qp, Total commands completed: 93387, total successful commands: 756, random_seed: 3435511872 00:23:01.650 19:09:16 -- target/fabrics_fuzz.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -j /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/example.json -a 00:23:01.650 Fuzzing completed. Shutting down the fuzz application 00:23:01.650 00:23:01.651 Dumping successful admin opcodes: 00:23:01.651 24, 00:23:01.651 Dumping successful io opcodes: 00:23:01.651 00:23:01.651 NS: 0x200003aeff00 I/O qp, Total commands completed: 0, total successful commands: 0, random_seed: 3503935834 00:23:01.651 NS: 0x200003aeff00 admin qp, Total commands completed: 16, total successful commands: 4, random_seed: 3504006296 00:23:01.651 19:09:18 -- target/fabrics_fuzz.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:01.651 19:09:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:01.651 19:09:18 -- common/autotest_common.sh@10 -- # set +x 00:23:01.651 19:09:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:01.651 19:09:18 -- target/fabrics_fuzz.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:23:01.651 19:09:18 -- target/fabrics_fuzz.sh@38 -- # nvmftestfini 00:23:01.651 19:09:18 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:01.651 19:09:18 -- nvmf/common.sh@116 -- # sync 00:23:01.651 19:09:18 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:01.651 19:09:18 -- nvmf/common.sh@119 -- # set +e 00:23:01.651 19:09:18 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:01.651 19:09:18 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:01.651 rmmod nvme_tcp 00:23:01.651 rmmod nvme_fabrics 00:23:01.651 rmmod nvme_keyring 00:23:01.651 19:09:18 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:01.651 19:09:18 -- nvmf/common.sh@123 -- # set -e 00:23:01.651 19:09:18 -- nvmf/common.sh@124 -- # return 0 00:23:01.651 19:09:18 -- nvmf/common.sh@477 -- # '[' -n 3161797 ']' 00:23:01.651 19:09:18 -- nvmf/common.sh@478 -- # killprocess 3161797 00:23:01.651 19:09:18 -- common/autotest_common.sh@936 -- # '[' -z 3161797 ']' 00:23:01.651 19:09:18 -- common/autotest_common.sh@940 -- # kill -0 3161797 00:23:01.651 19:09:18 -- common/autotest_common.sh@941 -- # uname 00:23:01.651 19:09:18 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:01.651 19:09:18 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3161797 00:23:01.651 19:09:18 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:01.651 19:09:18 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:01.651 19:09:18 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3161797' 00:23:01.651 killing process with pid 3161797 00:23:01.651 19:09:18 -- common/autotest_common.sh@955 -- # kill 3161797 00:23:01.651 19:09:18 -- common/autotest_common.sh@960 -- # wait 3161797 00:23:01.651 19:09:18 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:01.651 19:09:18 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:01.651 19:09:18 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:01.651 19:09:18 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:01.651 19:09:18 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:01.651 19:09:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:01.651 19:09:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:01.651 19:09:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:03.554 19:09:20 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:03.554 19:09:20 -- target/fabrics_fuzz.sh@39 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs2.txt 00:23:03.554 00:23:03.554 real 0m40.499s 00:23:03.554 user 0m53.053s 00:23:03.554 sys 0m16.630s 00:23:03.554 19:09:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:03.554 19:09:20 -- common/autotest_common.sh@10 -- # set +x 00:23:03.554 ************************************ 00:23:03.554 END TEST nvmf_fuzz 00:23:03.554 ************************************ 00:23:03.554 19:09:20 -- nvmf/nvmf.sh@65 -- # run_test nvmf_multiconnection /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:23:03.554 19:09:20 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:03.554 19:09:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:03.554 19:09:20 -- common/autotest_common.sh@10 -- # set +x 00:23:03.554 ************************************ 00:23:03.554 START TEST nvmf_multiconnection 00:23:03.554 ************************************ 00:23:03.554 19:09:20 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:23:03.815 * Looking for test storage... 00:23:03.815 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:23:03.815 19:09:20 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:03.815 19:09:20 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:03.815 19:09:20 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:03.815 19:09:20 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:03.815 19:09:20 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:03.815 19:09:20 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:03.815 19:09:20 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:03.815 19:09:20 -- scripts/common.sh@335 -- # IFS=.-: 00:23:03.815 19:09:20 -- scripts/common.sh@335 -- # read -ra ver1 00:23:03.815 19:09:20 -- scripts/common.sh@336 -- # IFS=.-: 00:23:03.815 19:09:20 -- scripts/common.sh@336 -- # read -ra ver2 00:23:03.815 19:09:20 -- scripts/common.sh@337 -- # local 'op=<' 00:23:03.815 19:09:20 -- scripts/common.sh@339 -- # ver1_l=2 00:23:03.815 19:09:20 -- scripts/common.sh@340 -- # ver2_l=1 00:23:03.815 19:09:20 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:03.815 19:09:20 -- scripts/common.sh@343 -- # case "$op" in 00:23:03.815 19:09:20 -- scripts/common.sh@344 -- # : 1 00:23:03.815 19:09:20 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:03.815 19:09:20 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:03.815 19:09:20 -- scripts/common.sh@364 -- # decimal 1 00:23:03.815 19:09:20 -- scripts/common.sh@352 -- # local d=1 00:23:03.815 19:09:20 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:03.815 19:09:20 -- scripts/common.sh@354 -- # echo 1 00:23:03.815 19:09:20 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:03.815 19:09:20 -- scripts/common.sh@365 -- # decimal 2 00:23:03.815 19:09:20 -- scripts/common.sh@352 -- # local d=2 00:23:03.815 19:09:20 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:03.815 19:09:20 -- scripts/common.sh@354 -- # echo 2 00:23:03.815 19:09:20 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:03.815 19:09:20 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:03.815 19:09:20 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:03.815 19:09:20 -- scripts/common.sh@367 -- # return 0 00:23:03.815 19:09:20 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:03.815 19:09:20 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:03.815 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:03.815 --rc genhtml_branch_coverage=1 00:23:03.815 --rc genhtml_function_coverage=1 00:23:03.815 --rc genhtml_legend=1 00:23:03.815 --rc geninfo_all_blocks=1 00:23:03.815 --rc geninfo_unexecuted_blocks=1 00:23:03.815 00:23:03.815 ' 00:23:03.815 19:09:20 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:03.815 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:03.815 --rc genhtml_branch_coverage=1 00:23:03.815 --rc genhtml_function_coverage=1 00:23:03.815 --rc genhtml_legend=1 00:23:03.815 --rc geninfo_all_blocks=1 00:23:03.815 --rc geninfo_unexecuted_blocks=1 00:23:03.815 00:23:03.815 ' 00:23:03.815 19:09:20 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:03.815 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:03.815 --rc genhtml_branch_coverage=1 00:23:03.815 --rc genhtml_function_coverage=1 00:23:03.815 --rc genhtml_legend=1 00:23:03.815 --rc geninfo_all_blocks=1 00:23:03.815 --rc geninfo_unexecuted_blocks=1 00:23:03.815 00:23:03.815 ' 00:23:03.815 19:09:20 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:03.815 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:03.815 --rc genhtml_branch_coverage=1 00:23:03.815 --rc genhtml_function_coverage=1 00:23:03.815 --rc genhtml_legend=1 00:23:03.815 --rc geninfo_all_blocks=1 00:23:03.815 --rc geninfo_unexecuted_blocks=1 00:23:03.815 00:23:03.815 ' 00:23:03.815 19:09:20 -- target/multiconnection.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:03.815 19:09:20 -- nvmf/common.sh@7 -- # uname -s 00:23:03.815 19:09:20 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:03.815 19:09:20 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:03.815 19:09:20 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:03.815 19:09:20 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:03.815 19:09:20 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:03.815 19:09:20 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:03.815 19:09:20 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:03.815 19:09:20 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:03.815 19:09:20 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:03.815 19:09:20 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:03.815 19:09:20 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:23:03.815 19:09:20 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:23:03.815 19:09:20 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:03.815 19:09:20 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:03.815 19:09:20 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:03.815 19:09:20 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:03.815 19:09:20 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:03.815 19:09:20 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:03.815 19:09:20 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:03.815 19:09:20 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:03.815 19:09:20 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:03.815 19:09:20 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:03.815 19:09:20 -- paths/export.sh@5 -- # export PATH 00:23:03.815 19:09:20 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:03.815 19:09:20 -- nvmf/common.sh@46 -- # : 0 00:23:03.815 19:09:20 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:03.815 19:09:20 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:03.815 19:09:20 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:03.815 19:09:20 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:03.815 19:09:20 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:03.815 19:09:20 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:03.815 19:09:20 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:03.815 19:09:20 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:03.815 19:09:20 -- target/multiconnection.sh@11 -- # MALLOC_BDEV_SIZE=64 00:23:03.815 19:09:20 -- target/multiconnection.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:23:03.815 19:09:20 -- target/multiconnection.sh@14 -- # NVMF_SUBSYS=11 00:23:03.815 19:09:20 -- target/multiconnection.sh@16 -- # nvmftestinit 00:23:03.815 19:09:20 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:03.815 19:09:20 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:03.815 19:09:20 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:03.815 19:09:20 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:03.815 19:09:20 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:03.815 19:09:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:03.815 19:09:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:03.815 19:09:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:03.815 19:09:20 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:03.815 19:09:20 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:03.815 19:09:20 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:03.815 19:09:20 -- common/autotest_common.sh@10 -- # set +x 00:23:09.114 19:09:25 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:09.114 19:09:25 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:09.114 19:09:25 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:09.114 19:09:25 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:09.114 19:09:25 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:09.114 19:09:25 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:09.114 19:09:25 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:09.114 19:09:25 -- nvmf/common.sh@294 -- # net_devs=() 00:23:09.114 19:09:25 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:09.114 19:09:25 -- nvmf/common.sh@295 -- # e810=() 00:23:09.114 19:09:25 -- nvmf/common.sh@295 -- # local -ga e810 00:23:09.114 19:09:25 -- nvmf/common.sh@296 -- # x722=() 00:23:09.114 19:09:25 -- nvmf/common.sh@296 -- # local -ga x722 00:23:09.114 19:09:25 -- nvmf/common.sh@297 -- # mlx=() 00:23:09.114 19:09:25 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:09.114 19:09:25 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:09.114 19:09:25 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:09.114 19:09:25 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:09.114 19:09:25 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:09.114 19:09:25 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:09.114 19:09:25 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:09.114 19:09:25 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:09.114 19:09:25 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:09.114 19:09:25 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:09.114 19:09:25 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:09.114 19:09:25 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:09.114 19:09:25 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:09.114 19:09:25 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:09.114 19:09:25 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:09.114 19:09:25 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:09.114 19:09:25 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:09.114 19:09:25 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:09.114 19:09:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:09.114 19:09:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:23:09.114 Found 0000:86:00.0 (0x8086 - 0x159b) 00:23:09.114 19:09:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:09.114 19:09:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:09.114 19:09:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:09.114 19:09:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:09.114 19:09:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:09.114 19:09:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:09.114 19:09:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:23:09.114 Found 0000:86:00.1 (0x8086 - 0x159b) 00:23:09.114 19:09:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:09.114 19:09:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:09.114 19:09:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:09.114 19:09:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:09.114 19:09:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:09.114 19:09:25 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:09.114 19:09:25 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:09.114 19:09:25 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:09.114 19:09:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:09.114 19:09:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:09.114 19:09:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:09.114 19:09:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:09.114 19:09:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:23:09.114 Found net devices under 0000:86:00.0: cvl_0_0 00:23:09.114 19:09:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:09.114 19:09:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:09.114 19:09:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:09.114 19:09:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:09.114 19:09:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:09.114 19:09:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:23:09.114 Found net devices under 0000:86:00.1: cvl_0_1 00:23:09.114 19:09:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:09.114 19:09:25 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:09.114 19:09:25 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:09.114 19:09:25 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:09.114 19:09:25 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:09.115 19:09:25 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:09.115 19:09:25 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:09.115 19:09:25 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:09.115 19:09:25 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:09.115 19:09:25 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:09.115 19:09:25 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:09.115 19:09:25 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:09.115 19:09:25 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:09.115 19:09:25 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:09.115 19:09:25 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:09.115 19:09:25 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:09.115 19:09:25 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:09.115 19:09:25 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:09.115 19:09:25 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:09.115 19:09:25 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:09.115 19:09:25 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:09.115 19:09:25 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:09.115 19:09:25 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:09.373 19:09:26 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:09.373 19:09:26 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:09.373 19:09:26 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:09.373 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:09.373 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.371 ms 00:23:09.373 00:23:09.373 --- 10.0.0.2 ping statistics --- 00:23:09.373 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:09.373 rtt min/avg/max/mdev = 0.371/0.371/0.371/0.000 ms 00:23:09.373 19:09:26 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:09.373 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:09.373 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.222 ms 00:23:09.373 00:23:09.373 --- 10.0.0.1 ping statistics --- 00:23:09.373 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:09.373 rtt min/avg/max/mdev = 0.222/0.222/0.222/0.000 ms 00:23:09.373 19:09:26 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:09.373 19:09:26 -- nvmf/common.sh@410 -- # return 0 00:23:09.373 19:09:26 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:09.373 19:09:26 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:09.373 19:09:26 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:09.373 19:09:26 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:09.373 19:09:26 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:09.373 19:09:26 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:09.373 19:09:26 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:09.373 19:09:26 -- target/multiconnection.sh@17 -- # nvmfappstart -m 0xF 00:23:09.373 19:09:26 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:09.373 19:09:26 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:09.373 19:09:26 -- common/autotest_common.sh@10 -- # set +x 00:23:09.374 19:09:26 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:23:09.374 19:09:26 -- nvmf/common.sh@469 -- # nvmfpid=3171198 00:23:09.374 19:09:26 -- nvmf/common.sh@470 -- # waitforlisten 3171198 00:23:09.374 19:09:26 -- common/autotest_common.sh@829 -- # '[' -z 3171198 ']' 00:23:09.374 19:09:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:09.374 19:09:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:09.374 19:09:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:09.374 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:09.374 19:09:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:09.374 19:09:26 -- common/autotest_common.sh@10 -- # set +x 00:23:09.374 [2024-11-26 19:09:26.148585] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:23:09.374 [2024-11-26 19:09:26.148633] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:09.374 EAL: No free 2048 kB hugepages reported on node 1 00:23:09.374 [2024-11-26 19:09:26.209835] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:09.374 [2024-11-26 19:09:26.251691] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:09.374 [2024-11-26 19:09:26.251807] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:09.374 [2024-11-26 19:09:26.251815] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:09.374 [2024-11-26 19:09:26.251821] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:09.374 [2024-11-26 19:09:26.251867] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:09.374 [2024-11-26 19:09:26.251980] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:09.374 [2024-11-26 19:09:26.253962] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:09.374 [2024-11-26 19:09:26.253964] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:10.310 19:09:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:10.310 19:09:26 -- common/autotest_common.sh@862 -- # return 0 00:23:10.310 19:09:26 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:10.310 19:09:27 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:10.310 19:09:27 -- common/autotest_common.sh@10 -- # set +x 00:23:10.310 19:09:27 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:10.310 19:09:27 -- target/multiconnection.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:23:10.310 19:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.310 19:09:27 -- common/autotest_common.sh@10 -- # set +x 00:23:10.310 [2024-11-26 19:09:27.043551] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:10.310 19:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.310 19:09:27 -- target/multiconnection.sh@21 -- # seq 1 11 00:23:10.310 19:09:27 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:10.310 19:09:27 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:23:10.310 19:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.310 19:09:27 -- common/autotest_common.sh@10 -- # set +x 00:23:10.310 Malloc1 00:23:10.310 19:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.310 19:09:27 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK1 00:23:10.310 19:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.310 19:09:27 -- common/autotest_common.sh@10 -- # set +x 00:23:10.310 19:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.310 19:09:27 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:23:10.310 19:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.310 19:09:27 -- common/autotest_common.sh@10 -- # set +x 00:23:10.310 19:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.310 19:09:27 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:10.310 19:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.310 19:09:27 -- common/autotest_common.sh@10 -- # set +x 00:23:10.310 [2024-11-26 19:09:27.103344] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:10.310 19:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.310 19:09:27 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:10.310 19:09:27 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc2 00:23:10.310 19:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.310 19:09:27 -- common/autotest_common.sh@10 -- # set +x 00:23:10.310 Malloc2 00:23:10.310 19:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.311 19:09:27 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:23:10.311 19:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.311 19:09:27 -- common/autotest_common.sh@10 -- # set +x 00:23:10.311 19:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.311 19:09:27 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc2 00:23:10.311 19:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.311 19:09:27 -- common/autotest_common.sh@10 -- # set +x 00:23:10.311 19:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.311 19:09:27 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:23:10.311 19:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.311 19:09:27 -- common/autotest_common.sh@10 -- # set +x 00:23:10.311 19:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.311 19:09:27 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:10.311 19:09:27 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc3 00:23:10.311 19:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.311 19:09:27 -- common/autotest_common.sh@10 -- # set +x 00:23:10.311 Malloc3 00:23:10.311 19:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.311 19:09:27 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK3 00:23:10.311 19:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.311 19:09:27 -- common/autotest_common.sh@10 -- # set +x 00:23:10.311 19:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.311 19:09:27 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Malloc3 00:23:10.311 19:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.311 19:09:27 -- common/autotest_common.sh@10 -- # set +x 00:23:10.311 19:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.311 19:09:27 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:23:10.311 19:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.311 19:09:27 -- common/autotest_common.sh@10 -- # set +x 00:23:10.311 19:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.311 19:09:27 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:10.311 19:09:27 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc4 00:23:10.311 19:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.311 19:09:27 -- common/autotest_common.sh@10 -- # set +x 00:23:10.311 Malloc4 00:23:10.311 19:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.311 19:09:27 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK4 00:23:10.311 19:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.311 19:09:27 -- common/autotest_common.sh@10 -- # set +x 00:23:10.311 19:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.311 19:09:27 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Malloc4 00:23:10.311 19:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.311 19:09:27 -- common/autotest_common.sh@10 -- # set +x 00:23:10.570 19:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.570 19:09:27 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:23:10.570 19:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.570 19:09:27 -- common/autotest_common.sh@10 -- # set +x 00:23:10.570 19:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.570 19:09:27 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:10.570 19:09:27 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc5 00:23:10.570 19:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.570 19:09:27 -- common/autotest_common.sh@10 -- # set +x 00:23:10.570 Malloc5 00:23:10.570 19:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.570 19:09:27 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode5 -a -s SPDK5 00:23:10.570 19:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.570 19:09:27 -- common/autotest_common.sh@10 -- # set +x 00:23:10.570 19:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.570 19:09:27 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode5 Malloc5 00:23:10.570 19:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.570 19:09:27 -- common/autotest_common.sh@10 -- # set +x 00:23:10.570 19:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.570 19:09:27 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode5 -t tcp -a 10.0.0.2 -s 4420 00:23:10.570 19:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.570 19:09:27 -- common/autotest_common.sh@10 -- # set +x 00:23:10.570 19:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.570 19:09:27 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:10.570 19:09:27 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc6 00:23:10.570 19:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.570 19:09:27 -- common/autotest_common.sh@10 -- # set +x 00:23:10.570 Malloc6 00:23:10.570 19:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.570 19:09:27 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode6 -a -s SPDK6 00:23:10.570 19:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.570 19:09:27 -- common/autotest_common.sh@10 -- # set +x 00:23:10.570 19:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.570 19:09:27 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode6 Malloc6 00:23:10.570 19:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.570 19:09:27 -- common/autotest_common.sh@10 -- # set +x 00:23:10.570 19:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.570 19:09:27 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode6 -t tcp -a 10.0.0.2 -s 4420 00:23:10.570 19:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.570 19:09:27 -- common/autotest_common.sh@10 -- # set +x 00:23:10.570 19:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.570 19:09:27 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:10.570 19:09:27 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc7 00:23:10.570 19:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.570 19:09:27 -- common/autotest_common.sh@10 -- # set +x 00:23:10.570 Malloc7 00:23:10.570 19:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.570 19:09:27 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode7 -a -s SPDK7 00:23:10.570 19:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.570 19:09:27 -- common/autotest_common.sh@10 -- # set +x 00:23:10.570 19:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.570 19:09:27 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode7 Malloc7 00:23:10.570 19:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.570 19:09:27 -- common/autotest_common.sh@10 -- # set +x 00:23:10.570 19:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.570 19:09:27 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode7 -t tcp -a 10.0.0.2 -s 4420 00:23:10.570 19:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.570 19:09:27 -- common/autotest_common.sh@10 -- # set +x 00:23:10.570 19:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.570 19:09:27 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:10.570 19:09:27 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc8 00:23:10.570 19:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.570 19:09:27 -- common/autotest_common.sh@10 -- # set +x 00:23:10.570 Malloc8 00:23:10.570 19:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.570 19:09:27 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode8 -a -s SPDK8 00:23:10.570 19:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.570 19:09:27 -- common/autotest_common.sh@10 -- # set +x 00:23:10.570 19:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.570 19:09:27 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode8 Malloc8 00:23:10.570 19:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.570 19:09:27 -- common/autotest_common.sh@10 -- # set +x 00:23:10.570 19:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.570 19:09:27 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode8 -t tcp -a 10.0.0.2 -s 4420 00:23:10.570 19:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.570 19:09:27 -- common/autotest_common.sh@10 -- # set +x 00:23:10.570 19:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.570 19:09:27 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:10.570 19:09:27 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc9 00:23:10.570 19:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.570 19:09:27 -- common/autotest_common.sh@10 -- # set +x 00:23:10.570 Malloc9 00:23:10.570 19:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.570 19:09:27 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode9 -a -s SPDK9 00:23:10.570 19:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.570 19:09:27 -- common/autotest_common.sh@10 -- # set +x 00:23:10.570 19:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.570 19:09:27 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode9 Malloc9 00:23:10.570 19:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.570 19:09:27 -- common/autotest_common.sh@10 -- # set +x 00:23:10.570 19:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.570 19:09:27 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode9 -t tcp -a 10.0.0.2 -s 4420 00:23:10.570 19:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.570 19:09:27 -- common/autotest_common.sh@10 -- # set +x 00:23:10.570 19:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.570 19:09:27 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:10.570 19:09:27 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc10 00:23:10.570 19:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.570 19:09:27 -- common/autotest_common.sh@10 -- # set +x 00:23:10.829 Malloc10 00:23:10.829 19:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.829 19:09:27 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode10 -a -s SPDK10 00:23:10.829 19:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.829 19:09:27 -- common/autotest_common.sh@10 -- # set +x 00:23:10.829 19:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.829 19:09:27 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode10 Malloc10 00:23:10.829 19:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.829 19:09:27 -- common/autotest_common.sh@10 -- # set +x 00:23:10.829 19:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.829 19:09:27 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode10 -t tcp -a 10.0.0.2 -s 4420 00:23:10.829 19:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.829 19:09:27 -- common/autotest_common.sh@10 -- # set +x 00:23:10.829 19:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.829 19:09:27 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:10.829 19:09:27 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc11 00:23:10.829 19:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.829 19:09:27 -- common/autotest_common.sh@10 -- # set +x 00:23:10.829 Malloc11 00:23:10.829 19:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.829 19:09:27 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode11 -a -s SPDK11 00:23:10.829 19:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.829 19:09:27 -- common/autotest_common.sh@10 -- # set +x 00:23:10.829 19:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.829 19:09:27 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode11 Malloc11 00:23:10.829 19:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.829 19:09:27 -- common/autotest_common.sh@10 -- # set +x 00:23:10.829 19:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.829 19:09:27 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode11 -t tcp -a 10.0.0.2 -s 4420 00:23:10.829 19:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.829 19:09:27 -- common/autotest_common.sh@10 -- # set +x 00:23:10.829 19:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.829 19:09:27 -- target/multiconnection.sh@28 -- # seq 1 11 00:23:10.829 19:09:27 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:10.829 19:09:27 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:23:12.206 19:09:28 -- target/multiconnection.sh@30 -- # waitforserial SPDK1 00:23:12.206 19:09:28 -- common/autotest_common.sh@1187 -- # local i=0 00:23:12.206 19:09:28 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:23:12.206 19:09:28 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:23:12.206 19:09:28 -- common/autotest_common.sh@1194 -- # sleep 2 00:23:14.108 19:09:30 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:23:14.108 19:09:30 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:23:14.108 19:09:30 -- common/autotest_common.sh@1196 -- # grep -c SPDK1 00:23:14.108 19:09:30 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:23:14.108 19:09:30 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:23:14.108 19:09:30 -- common/autotest_common.sh@1197 -- # return 0 00:23:14.108 19:09:30 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:14.108 19:09:30 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode2 -a 10.0.0.2 -s 4420 00:23:15.044 19:09:31 -- target/multiconnection.sh@30 -- # waitforserial SPDK2 00:23:15.044 19:09:31 -- common/autotest_common.sh@1187 -- # local i=0 00:23:15.044 19:09:31 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:23:15.044 19:09:31 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:23:15.044 19:09:31 -- common/autotest_common.sh@1194 -- # sleep 2 00:23:17.574 19:09:33 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:23:17.574 19:09:33 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:23:17.574 19:09:33 -- common/autotest_common.sh@1196 -- # grep -c SPDK2 00:23:17.574 19:09:33 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:23:17.574 19:09:33 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:23:17.574 19:09:33 -- common/autotest_common.sh@1197 -- # return 0 00:23:17.574 19:09:33 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:17.574 19:09:33 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode3 -a 10.0.0.2 -s 4420 00:23:18.507 19:09:35 -- target/multiconnection.sh@30 -- # waitforserial SPDK3 00:23:18.507 19:09:35 -- common/autotest_common.sh@1187 -- # local i=0 00:23:18.507 19:09:35 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:23:18.507 19:09:35 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:23:18.507 19:09:35 -- common/autotest_common.sh@1194 -- # sleep 2 00:23:20.411 19:09:37 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:23:20.411 19:09:37 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:23:20.411 19:09:37 -- common/autotest_common.sh@1196 -- # grep -c SPDK3 00:23:20.411 19:09:37 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:23:20.411 19:09:37 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:23:20.411 19:09:37 -- common/autotest_common.sh@1197 -- # return 0 00:23:20.411 19:09:37 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:20.411 19:09:37 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode4 -a 10.0.0.2 -s 4420 00:23:21.787 19:09:38 -- target/multiconnection.sh@30 -- # waitforserial SPDK4 00:23:21.787 19:09:38 -- common/autotest_common.sh@1187 -- # local i=0 00:23:21.787 19:09:38 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:23:21.787 19:09:38 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:23:21.787 19:09:38 -- common/autotest_common.sh@1194 -- # sleep 2 00:23:23.692 19:09:40 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:23:23.692 19:09:40 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:23:23.692 19:09:40 -- common/autotest_common.sh@1196 -- # grep -c SPDK4 00:23:23.692 19:09:40 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:23:23.692 19:09:40 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:23:23.692 19:09:40 -- common/autotest_common.sh@1197 -- # return 0 00:23:23.692 19:09:40 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:23.692 19:09:40 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode5 -a 10.0.0.2 -s 4420 00:23:25.070 19:09:41 -- target/multiconnection.sh@30 -- # waitforserial SPDK5 00:23:25.070 19:09:41 -- common/autotest_common.sh@1187 -- # local i=0 00:23:25.070 19:09:41 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:23:25.070 19:09:41 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:23:25.070 19:09:41 -- common/autotest_common.sh@1194 -- # sleep 2 00:23:26.975 19:09:43 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:23:26.975 19:09:43 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:23:26.975 19:09:43 -- common/autotest_common.sh@1196 -- # grep -c SPDK5 00:23:26.975 19:09:43 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:23:26.975 19:09:43 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:23:26.975 19:09:43 -- common/autotest_common.sh@1197 -- # return 0 00:23:26.975 19:09:43 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:26.975 19:09:43 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode6 -a 10.0.0.2 -s 4420 00:23:28.353 19:09:44 -- target/multiconnection.sh@30 -- # waitforserial SPDK6 00:23:28.353 19:09:44 -- common/autotest_common.sh@1187 -- # local i=0 00:23:28.353 19:09:44 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:23:28.353 19:09:44 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:23:28.353 19:09:44 -- common/autotest_common.sh@1194 -- # sleep 2 00:23:30.261 19:09:46 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:23:30.261 19:09:46 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:23:30.261 19:09:46 -- common/autotest_common.sh@1196 -- # grep -c SPDK6 00:23:30.261 19:09:46 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:23:30.261 19:09:46 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:23:30.261 19:09:46 -- common/autotest_common.sh@1197 -- # return 0 00:23:30.261 19:09:46 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:30.261 19:09:46 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode7 -a 10.0.0.2 -s 4420 00:23:31.639 19:09:48 -- target/multiconnection.sh@30 -- # waitforserial SPDK7 00:23:31.639 19:09:48 -- common/autotest_common.sh@1187 -- # local i=0 00:23:31.639 19:09:48 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:23:31.639 19:09:48 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:23:31.639 19:09:48 -- common/autotest_common.sh@1194 -- # sleep 2 00:23:33.543 19:09:50 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:23:33.543 19:09:50 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:23:33.543 19:09:50 -- common/autotest_common.sh@1196 -- # grep -c SPDK7 00:23:33.543 19:09:50 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:23:33.543 19:09:50 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:23:33.543 19:09:50 -- common/autotest_common.sh@1197 -- # return 0 00:23:33.543 19:09:50 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:33.543 19:09:50 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode8 -a 10.0.0.2 -s 4420 00:23:34.921 19:09:51 -- target/multiconnection.sh@30 -- # waitforserial SPDK8 00:23:34.921 19:09:51 -- common/autotest_common.sh@1187 -- # local i=0 00:23:34.921 19:09:51 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:23:34.921 19:09:51 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:23:34.921 19:09:51 -- common/autotest_common.sh@1194 -- # sleep 2 00:23:36.845 19:09:53 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:23:36.845 19:09:53 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:23:36.845 19:09:53 -- common/autotest_common.sh@1196 -- # grep -c SPDK8 00:23:36.845 19:09:53 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:23:36.845 19:09:53 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:23:36.845 19:09:53 -- common/autotest_common.sh@1197 -- # return 0 00:23:36.845 19:09:53 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:36.845 19:09:53 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode9 -a 10.0.0.2 -s 4420 00:23:38.302 19:09:54 -- target/multiconnection.sh@30 -- # waitforserial SPDK9 00:23:38.302 19:09:54 -- common/autotest_common.sh@1187 -- # local i=0 00:23:38.302 19:09:54 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:23:38.302 19:09:54 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:23:38.302 19:09:54 -- common/autotest_common.sh@1194 -- # sleep 2 00:23:40.208 19:09:56 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:23:40.208 19:09:56 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:23:40.208 19:09:56 -- common/autotest_common.sh@1196 -- # grep -c SPDK9 00:23:40.208 19:09:56 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:23:40.208 19:09:56 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:23:40.208 19:09:56 -- common/autotest_common.sh@1197 -- # return 0 00:23:40.208 19:09:56 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:40.208 19:09:56 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode10 -a 10.0.0.2 -s 4420 00:23:41.585 19:09:58 -- target/multiconnection.sh@30 -- # waitforserial SPDK10 00:23:41.585 19:09:58 -- common/autotest_common.sh@1187 -- # local i=0 00:23:41.585 19:09:58 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:23:41.585 19:09:58 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:23:41.585 19:09:58 -- common/autotest_common.sh@1194 -- # sleep 2 00:23:44.120 19:10:00 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:23:44.120 19:10:00 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:23:44.120 19:10:00 -- common/autotest_common.sh@1196 -- # grep -c SPDK10 00:23:44.120 19:10:00 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:23:44.120 19:10:00 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:23:44.120 19:10:00 -- common/autotest_common.sh@1197 -- # return 0 00:23:44.120 19:10:00 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:44.120 19:10:00 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode11 -a 10.0.0.2 -s 4420 00:23:45.056 19:10:01 -- target/multiconnection.sh@30 -- # waitforserial SPDK11 00:23:45.056 19:10:01 -- common/autotest_common.sh@1187 -- # local i=0 00:23:45.056 19:10:01 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:23:45.056 19:10:01 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:23:45.056 19:10:01 -- common/autotest_common.sh@1194 -- # sleep 2 00:23:46.960 19:10:03 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:23:46.960 19:10:03 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:23:46.960 19:10:03 -- common/autotest_common.sh@1196 -- # grep -c SPDK11 00:23:46.960 19:10:03 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:23:46.960 19:10:03 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:23:46.960 19:10:03 -- common/autotest_common.sh@1197 -- # return 0 00:23:46.960 19:10:03 -- target/multiconnection.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t read -r 10 00:23:46.960 [global] 00:23:46.960 thread=1 00:23:46.960 invalidate=1 00:23:46.960 rw=read 00:23:46.960 time_based=1 00:23:46.960 runtime=10 00:23:46.960 ioengine=libaio 00:23:46.960 direct=1 00:23:46.960 bs=262144 00:23:46.960 iodepth=64 00:23:46.960 norandommap=1 00:23:46.960 numjobs=1 00:23:46.960 00:23:46.960 [job0] 00:23:46.960 filename=/dev/nvme0n1 00:23:46.960 [job1] 00:23:46.961 filename=/dev/nvme10n1 00:23:46.961 [job2] 00:23:46.961 filename=/dev/nvme1n1 00:23:46.961 [job3] 00:23:46.961 filename=/dev/nvme2n1 00:23:46.961 [job4] 00:23:46.961 filename=/dev/nvme3n1 00:23:46.961 [job5] 00:23:46.961 filename=/dev/nvme4n1 00:23:46.961 [job6] 00:23:46.961 filename=/dev/nvme5n1 00:23:46.961 [job7] 00:23:46.961 filename=/dev/nvme6n1 00:23:46.961 [job8] 00:23:46.961 filename=/dev/nvme7n1 00:23:46.961 [job9] 00:23:46.961 filename=/dev/nvme8n1 00:23:46.961 [job10] 00:23:46.961 filename=/dev/nvme9n1 00:23:47.220 Could not set queue depth (nvme0n1) 00:23:47.220 Could not set queue depth (nvme10n1) 00:23:47.220 Could not set queue depth (nvme1n1) 00:23:47.220 Could not set queue depth (nvme2n1) 00:23:47.220 Could not set queue depth (nvme3n1) 00:23:47.220 Could not set queue depth (nvme4n1) 00:23:47.220 Could not set queue depth (nvme5n1) 00:23:47.220 Could not set queue depth (nvme6n1) 00:23:47.220 Could not set queue depth (nvme7n1) 00:23:47.220 Could not set queue depth (nvme8n1) 00:23:47.220 Could not set queue depth (nvme9n1) 00:23:47.479 job0: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:47.479 job1: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:47.479 job2: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:47.479 job3: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:47.479 job4: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:47.479 job5: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:47.479 job6: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:47.479 job7: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:47.479 job8: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:47.479 job9: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:47.479 job10: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:47.479 fio-3.35 00:23:47.479 Starting 11 threads 00:23:59.717 00:23:59.717 job0: (groupid=0, jobs=1): err= 0: pid=3177767: Tue Nov 26 19:10:15 2024 00:23:59.717 read: IOPS=703, BW=176MiB/s (184MB/s)(1773MiB/10084msec) 00:23:59.717 slat (usec): min=11, max=134094, avg=1042.04, stdev=4354.77 00:23:59.717 clat (usec): min=787, max=320283, avg=89853.60, stdev=44980.02 00:23:59.717 lat (usec): min=825, max=320334, avg=90895.63, stdev=45532.37 00:23:59.717 clat percentiles (msec): 00:23:59.717 | 1.00th=[ 4], 5.00th=[ 11], 10.00th=[ 21], 20.00th=[ 49], 00:23:59.717 | 30.00th=[ 70], 40.00th=[ 84], 50.00th=[ 93], 60.00th=[ 104], 00:23:59.717 | 70.00th=[ 114], 80.00th=[ 128], 90.00th=[ 148], 95.00th=[ 161], 00:23:59.717 | 99.00th=[ 190], 99.50th=[ 197], 99.90th=[ 207], 99.95th=[ 279], 00:23:59.717 | 99.99th=[ 321] 00:23:59.717 bw ( KiB/s): min=117760, max=357376, per=7.94%, avg=179922.60, stdev=59595.51, samples=20 00:23:59.717 iops : min= 460, max= 1396, avg=702.75, stdev=232.77, samples=20 00:23:59.717 lat (usec) : 1000=0.08% 00:23:59.717 lat (msec) : 2=0.38%, 4=0.69%, 10=3.53%, 20=5.36%, 50=11.06% 00:23:59.717 lat (msec) : 100=34.82%, 250=44.00%, 500=0.08% 00:23:59.717 cpu : usr=0.28%, sys=2.68%, ctx=1553, majf=0, minf=4097 00:23:59.717 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:23:59.717 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:59.717 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:59.717 issued rwts: total=7091,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:59.717 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:59.717 job1: (groupid=0, jobs=1): err= 0: pid=3177768: Tue Nov 26 19:10:15 2024 00:23:59.717 read: IOPS=786, BW=197MiB/s (206MB/s)(1982MiB/10077msec) 00:23:59.717 slat (usec): min=10, max=75043, avg=773.89, stdev=3284.42 00:23:59.717 clat (usec): min=954, max=214618, avg=80486.46, stdev=41081.61 00:23:59.717 lat (usec): min=993, max=257629, avg=81260.35, stdev=41544.72 00:23:59.717 clat percentiles (msec): 00:23:59.717 | 1.00th=[ 6], 5.00th=[ 13], 10.00th=[ 21], 20.00th=[ 46], 00:23:59.717 | 30.00th=[ 62], 40.00th=[ 71], 50.00th=[ 81], 60.00th=[ 89], 00:23:59.717 | 70.00th=[ 101], 80.00th=[ 112], 90.00th=[ 132], 95.00th=[ 157], 00:23:59.717 | 99.00th=[ 184], 99.50th=[ 194], 99.90th=[ 203], 99.95th=[ 209], 00:23:59.717 | 99.99th=[ 215] 00:23:59.717 bw ( KiB/s): min=99840, max=311808, per=8.89%, avg=201278.05, stdev=55613.47, samples=20 00:23:59.717 iops : min= 390, max= 1218, avg=786.20, stdev=217.28, samples=20 00:23:59.717 lat (usec) : 1000=0.03% 00:23:59.717 lat (msec) : 2=0.01%, 4=0.24%, 10=3.19%, 20=5.99%, 50=12.86% 00:23:59.717 lat (msec) : 100=47.62%, 250=30.07% 00:23:59.717 cpu : usr=0.26%, sys=3.07%, ctx=1806, majf=0, minf=4097 00:23:59.717 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:23:59.717 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:59.717 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:59.717 issued rwts: total=7926,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:59.717 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:59.717 job2: (groupid=0, jobs=1): err= 0: pid=3177770: Tue Nov 26 19:10:15 2024 00:23:59.717 read: IOPS=775, BW=194MiB/s (203MB/s)(1954MiB/10080msec) 00:23:59.717 slat (usec): min=9, max=141570, avg=851.50, stdev=4195.99 00:23:59.717 clat (usec): min=1503, max=235975, avg=81617.07, stdev=46713.39 00:23:59.717 lat (usec): min=1538, max=331013, avg=82468.57, stdev=47276.42 00:23:59.717 clat percentiles (msec): 00:23:59.717 | 1.00th=[ 5], 5.00th=[ 13], 10.00th=[ 22], 20.00th=[ 33], 00:23:59.717 | 30.00th=[ 46], 40.00th=[ 66], 50.00th=[ 86], 60.00th=[ 97], 00:23:59.717 | 70.00th=[ 109], 80.00th=[ 126], 90.00th=[ 144], 95.00th=[ 159], 00:23:59.717 | 99.00th=[ 192], 99.50th=[ 203], 99.90th=[ 207], 99.95th=[ 209], 00:23:59.717 | 99.99th=[ 236] 00:23:59.717 bw ( KiB/s): min=120832, max=436224, per=8.76%, avg=198384.75, stdev=77558.32, samples=20 00:23:59.717 iops : min= 472, max= 1704, avg=774.90, stdev=302.99, samples=20 00:23:59.717 lat (msec) : 2=0.05%, 4=0.68%, 10=2.56%, 20=6.17%, 50=22.95% 00:23:59.717 lat (msec) : 100=31.26%, 250=36.33% 00:23:59.717 cpu : usr=0.25%, sys=2.80%, ctx=1690, majf=0, minf=3722 00:23:59.717 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:23:59.717 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:59.717 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:59.717 issued rwts: total=7814,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:59.717 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:59.717 job3: (groupid=0, jobs=1): err= 0: pid=3177771: Tue Nov 26 19:10:15 2024 00:23:59.717 read: IOPS=853, BW=213MiB/s (224MB/s)(2150MiB/10076msec) 00:23:59.717 slat (usec): min=8, max=89188, avg=673.98, stdev=3463.65 00:23:59.717 clat (usec): min=933, max=229194, avg=74241.03, stdev=48043.45 00:23:59.717 lat (usec): min=962, max=229229, avg=74915.01, stdev=48500.93 00:23:59.717 clat percentiles (msec): 00:23:59.717 | 1.00th=[ 4], 5.00th=[ 7], 10.00th=[ 12], 20.00th=[ 24], 00:23:59.717 | 30.00th=[ 44], 40.00th=[ 55], 50.00th=[ 69], 60.00th=[ 90], 00:23:59.717 | 70.00th=[ 101], 80.00th=[ 120], 90.00th=[ 140], 95.00th=[ 157], 00:23:59.717 | 99.00th=[ 186], 99.50th=[ 207], 99.90th=[ 226], 99.95th=[ 228], 00:23:59.717 | 99.99th=[ 230] 00:23:59.717 bw ( KiB/s): min=118784, max=360960, per=9.65%, avg=218495.75, stdev=80759.56, samples=20 00:23:59.717 iops : min= 464, max= 1410, avg=853.45, stdev=315.50, samples=20 00:23:59.717 lat (usec) : 1000=0.03% 00:23:59.717 lat (msec) : 2=0.24%, 4=1.37%, 10=6.93%, 20=7.68%, 50=19.49% 00:23:59.717 lat (msec) : 100=34.03%, 250=30.22% 00:23:59.717 cpu : usr=0.28%, sys=3.22%, ctx=2017, majf=0, minf=4097 00:23:59.717 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:23:59.717 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:59.717 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:59.717 issued rwts: total=8598,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:59.717 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:59.717 job4: (groupid=0, jobs=1): err= 0: pid=3177777: Tue Nov 26 19:10:15 2024 00:23:59.717 read: IOPS=957, BW=239MiB/s (251MB/s)(2413MiB/10083msec) 00:23:59.717 slat (usec): min=9, max=125131, avg=677.92, stdev=3432.89 00:23:59.717 clat (usec): min=992, max=274054, avg=66098.73, stdev=44421.85 00:23:59.717 lat (usec): min=1020, max=274088, avg=66776.66, stdev=44832.98 00:23:59.717 clat percentiles (msec): 00:23:59.717 | 1.00th=[ 4], 5.00th=[ 10], 10.00th=[ 17], 20.00th=[ 26], 00:23:59.717 | 30.00th=[ 31], 40.00th=[ 44], 50.00th=[ 58], 60.00th=[ 73], 00:23:59.717 | 70.00th=[ 90], 80.00th=[ 107], 90.00th=[ 130], 95.00th=[ 150], 00:23:59.717 | 99.00th=[ 180], 99.50th=[ 194], 99.90th=[ 203], 99.95th=[ 209], 00:23:59.717 | 99.99th=[ 275] 00:23:59.717 bw ( KiB/s): min=112640, max=546304, per=10.84%, avg=245416.70, stdev=112901.79, samples=20 00:23:59.717 iops : min= 440, max= 2134, avg=958.60, stdev=441.06, samples=20 00:23:59.717 lat (usec) : 1000=0.01% 00:23:59.717 lat (msec) : 2=0.18%, 4=1.13%, 10=3.84%, 20=6.97%, 50=32.75% 00:23:59.717 lat (msec) : 100=31.04%, 250=24.04%, 500=0.03% 00:23:59.717 cpu : usr=0.32%, sys=3.44%, ctx=2040, majf=0, minf=4097 00:23:59.717 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.3% 00:23:59.717 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:59.717 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:59.717 issued rwts: total=9651,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:59.717 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:59.717 job5: (groupid=0, jobs=1): err= 0: pid=3177812: Tue Nov 26 19:10:15 2024 00:23:59.717 read: IOPS=790, BW=198MiB/s (207MB/s)(1991MiB/10075msec) 00:23:59.717 slat (usec): min=7, max=86806, avg=898.57, stdev=3676.51 00:23:59.717 clat (usec): min=873, max=244193, avg=80006.80, stdev=42854.91 00:23:59.717 lat (usec): min=912, max=244226, avg=80905.37, stdev=43372.24 00:23:59.717 clat percentiles (msec): 00:23:59.717 | 1.00th=[ 3], 5.00th=[ 18], 10.00th=[ 26], 20.00th=[ 42], 00:23:59.717 | 30.00th=[ 55], 40.00th=[ 66], 50.00th=[ 78], 60.00th=[ 88], 00:23:59.717 | 70.00th=[ 99], 80.00th=[ 115], 90.00th=[ 142], 95.00th=[ 159], 00:23:59.717 | 99.00th=[ 190], 99.50th=[ 194], 99.90th=[ 205], 99.95th=[ 234], 00:23:59.718 | 99.99th=[ 245] 00:23:59.718 bw ( KiB/s): min=104960, max=445952, per=8.93%, avg=202198.70, stdev=78233.62, samples=20 00:23:59.718 iops : min= 410, max= 1742, avg=789.80, stdev=305.62, samples=20 00:23:59.718 lat (usec) : 1000=0.03% 00:23:59.718 lat (msec) : 2=0.68%, 4=0.83%, 10=1.18%, 20=3.11%, 50=19.60% 00:23:59.718 lat (msec) : 100=46.11%, 250=28.46% 00:23:59.718 cpu : usr=0.35%, sys=2.76%, ctx=1740, majf=0, minf=4097 00:23:59.718 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:23:59.718 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:59.718 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:59.718 issued rwts: total=7963,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:59.718 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:59.718 job6: (groupid=0, jobs=1): err= 0: pid=3177825: Tue Nov 26 19:10:15 2024 00:23:59.718 read: IOPS=1034, BW=259MiB/s (271MB/s)(2608MiB/10080msec) 00:23:59.718 slat (usec): min=10, max=121559, avg=562.96, stdev=2975.57 00:23:59.718 clat (usec): min=752, max=205425, avg=61215.93, stdev=44796.28 00:23:59.718 lat (usec): min=770, max=281139, avg=61778.89, stdev=45163.57 00:23:59.718 clat percentiles (msec): 00:23:59.718 | 1.00th=[ 3], 5.00th=[ 8], 10.00th=[ 14], 20.00th=[ 24], 00:23:59.718 | 30.00th=[ 30], 40.00th=[ 36], 50.00th=[ 48], 60.00th=[ 61], 00:23:59.718 | 70.00th=[ 82], 80.00th=[ 104], 90.00th=[ 130], 95.00th=[ 150], 00:23:59.718 | 99.00th=[ 180], 99.50th=[ 186], 99.90th=[ 194], 99.95th=[ 199], 00:23:59.718 | 99.99th=[ 201] 00:23:59.718 bw ( KiB/s): min=142051, max=525824, per=11.72%, avg=265431.75, stdev=104604.27, samples=20 00:23:59.718 iops : min= 554, max= 2054, avg=1036.75, stdev=408.67, samples=20 00:23:59.718 lat (usec) : 1000=0.08% 00:23:59.718 lat (msec) : 2=0.49%, 4=1.31%, 10=4.87%, 20=9.08%, 50=36.21% 00:23:59.718 lat (msec) : 100=26.71%, 250=21.26% 00:23:59.718 cpu : usr=0.32%, sys=3.82%, ctx=2242, majf=0, minf=4097 00:23:59.718 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:23:59.718 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:59.718 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:59.718 issued rwts: total=10432,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:59.718 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:59.718 job7: (groupid=0, jobs=1): err= 0: pid=3177848: Tue Nov 26 19:10:15 2024 00:23:59.718 read: IOPS=593, BW=148MiB/s (156MB/s)(1497MiB/10086msec) 00:23:59.718 slat (usec): min=11, max=49603, avg=1232.34, stdev=4292.68 00:23:59.718 clat (usec): min=1680, max=222434, avg=106468.76, stdev=42056.73 00:23:59.718 lat (usec): min=1716, max=222494, avg=107701.09, stdev=42770.12 00:23:59.718 clat percentiles (msec): 00:23:59.718 | 1.00th=[ 8], 5.00th=[ 22], 10.00th=[ 46], 20.00th=[ 78], 00:23:59.718 | 30.00th=[ 89], 40.00th=[ 96], 50.00th=[ 107], 60.00th=[ 121], 00:23:59.718 | 70.00th=[ 132], 80.00th=[ 146], 90.00th=[ 159], 95.00th=[ 171], 00:23:59.718 | 99.00th=[ 188], 99.50th=[ 192], 99.90th=[ 203], 99.95th=[ 213], 00:23:59.718 | 99.99th=[ 224] 00:23:59.718 bw ( KiB/s): min=95232, max=307712, per=6.69%, avg=151612.80, stdev=52405.96, samples=20 00:23:59.718 iops : min= 372, max= 1202, avg=592.20, stdev=204.70, samples=20 00:23:59.718 lat (msec) : 2=0.03%, 4=0.30%, 10=1.92%, 20=2.31%, 50=6.26% 00:23:59.718 lat (msec) : 100=32.91%, 250=56.26% 00:23:59.718 cpu : usr=0.25%, sys=2.30%, ctx=1417, majf=0, minf=4097 00:23:59.718 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=98.9% 00:23:59.718 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:59.718 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:59.718 issued rwts: total=5986,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:59.718 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:59.718 job8: (groupid=0, jobs=1): err= 0: pid=3177912: Tue Nov 26 19:10:15 2024 00:23:59.718 read: IOPS=870, BW=218MiB/s (228MB/s)(2180MiB/10020msec) 00:23:59.718 slat (usec): min=10, max=113849, avg=616.07, stdev=3417.72 00:23:59.718 clat (usec): min=933, max=219352, avg=72841.07, stdev=48230.94 00:23:59.718 lat (usec): min=979, max=219457, avg=73457.14, stdev=48606.04 00:23:59.718 clat percentiles (msec): 00:23:59.718 | 1.00th=[ 3], 5.00th=[ 7], 10.00th=[ 14], 20.00th=[ 26], 00:23:59.718 | 30.00th=[ 38], 40.00th=[ 50], 50.00th=[ 70], 60.00th=[ 87], 00:23:59.718 | 70.00th=[ 99], 80.00th=[ 114], 90.00th=[ 146], 95.00th=[ 159], 00:23:59.718 | 99.00th=[ 188], 99.50th=[ 194], 99.90th=[ 213], 99.95th=[ 218], 00:23:59.718 | 99.99th=[ 220] 00:23:59.718 bw ( KiB/s): min=132608, max=375568, per=9.78%, avg=221581.60, stdev=81216.94, samples=20 00:23:59.718 iops : min= 518, max= 1467, avg=865.55, stdev=317.25, samples=20 00:23:59.718 lat (usec) : 1000=0.03% 00:23:59.718 lat (msec) : 2=0.29%, 4=1.95%, 10=5.38%, 20=7.39%, 50=25.84% 00:23:59.718 lat (msec) : 100=30.38%, 250=28.75% 00:23:59.718 cpu : usr=0.31%, sys=3.04%, ctx=2146, majf=0, minf=4097 00:23:59.718 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:23:59.718 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:59.718 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:59.718 issued rwts: total=8720,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:59.718 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:59.718 job9: (groupid=0, jobs=1): err= 0: pid=3177934: Tue Nov 26 19:10:15 2024 00:23:59.718 read: IOPS=805, BW=201MiB/s (211MB/s)(2016MiB/10013msec) 00:23:59.718 slat (usec): min=10, max=95986, avg=913.89, stdev=3780.19 00:23:59.718 clat (usec): min=1056, max=236885, avg=78479.36, stdev=45177.01 00:23:59.718 lat (usec): min=1086, max=236944, avg=79393.25, stdev=45794.24 00:23:59.718 clat percentiles (msec): 00:23:59.718 | 1.00th=[ 4], 5.00th=[ 11], 10.00th=[ 21], 20.00th=[ 39], 00:23:59.718 | 30.00th=[ 50], 40.00th=[ 63], 50.00th=[ 74], 60.00th=[ 87], 00:23:59.718 | 70.00th=[ 101], 80.00th=[ 121], 90.00th=[ 144], 95.00th=[ 161], 00:23:59.718 | 99.00th=[ 186], 99.50th=[ 192], 99.90th=[ 203], 99.95th=[ 211], 00:23:59.718 | 99.99th=[ 236] 00:23:59.718 bw ( KiB/s): min=103424, max=462336, per=9.04%, avg=204766.10, stdev=93907.37, samples=20 00:23:59.718 iops : min= 404, max= 1806, avg=799.85, stdev=366.80, samples=20 00:23:59.718 lat (msec) : 2=0.27%, 4=0.86%, 10=3.21%, 20=5.51%, 50=21.01% 00:23:59.718 lat (msec) : 100=38.77%, 250=30.37% 00:23:59.718 cpu : usr=0.27%, sys=3.16%, ctx=1789, majf=0, minf=4097 00:23:59.718 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:23:59.718 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:59.718 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:59.718 issued rwts: total=8063,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:59.718 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:59.718 job10: (groupid=0, jobs=1): err= 0: pid=3177956: Tue Nov 26 19:10:15 2024 00:23:59.718 read: IOPS=693, BW=173MiB/s (182MB/s)(1748MiB/10083msec) 00:23:59.718 slat (usec): min=11, max=135917, avg=872.49, stdev=4169.89 00:23:59.718 clat (usec): min=782, max=284741, avg=91311.82, stdev=47126.39 00:23:59.718 lat (usec): min=826, max=284763, avg=92184.31, stdev=47533.31 00:23:59.718 clat percentiles (msec): 00:23:59.718 | 1.00th=[ 6], 5.00th=[ 18], 10.00th=[ 27], 20.00th=[ 44], 00:23:59.718 | 30.00th=[ 66], 40.00th=[ 80], 50.00th=[ 90], 60.00th=[ 102], 00:23:59.718 | 70.00th=[ 120], 80.00th=[ 138], 90.00th=[ 157], 95.00th=[ 165], 00:23:59.718 | 99.00th=[ 201], 99.50th=[ 203], 99.90th=[ 215], 99.95th=[ 222], 00:23:59.718 | 99.99th=[ 284] 00:23:59.718 bw ( KiB/s): min=108544, max=310272, per=7.83%, avg=177328.00, stdev=50006.13, samples=20 00:23:59.718 iops : min= 424, max= 1212, avg=692.65, stdev=195.35, samples=20 00:23:59.718 lat (usec) : 1000=0.01% 00:23:59.718 lat (msec) : 2=0.03%, 4=0.60%, 10=1.83%, 20=3.28%, 50=17.54% 00:23:59.718 lat (msec) : 100=35.32%, 250=41.35%, 500=0.04% 00:23:59.718 cpu : usr=0.25%, sys=2.53%, ctx=1695, majf=0, minf=4097 00:23:59.718 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:23:59.718 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:59.718 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:59.718 issued rwts: total=6991,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:59.718 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:59.718 00:23:59.718 Run status group 0 (all jobs): 00:23:59.718 READ: bw=2212MiB/s (2319MB/s), 148MiB/s-259MiB/s (156MB/s-271MB/s), io=21.8GiB (23.4GB), run=10013-10086msec 00:23:59.718 00:23:59.718 Disk stats (read/write): 00:23:59.718 nvme0n1: ios=14119/0, merge=0/0, ticks=1250945/0, in_queue=1250945, util=93.98% 00:23:59.718 nvme10n1: ios=15831/0, merge=0/0, ticks=1256168/0, in_queue=1256168, util=94.45% 00:23:59.718 nvme1n1: ios=15578/0, merge=0/0, ticks=1253566/0, in_queue=1253566, util=95.14% 00:23:59.718 nvme2n1: ios=17174/0, merge=0/0, ticks=1258817/0, in_queue=1258817, util=95.48% 00:23:59.718 nvme3n1: ios=19250/0, merge=0/0, ticks=1252995/0, in_queue=1252995, util=95.69% 00:23:59.718 nvme4n1: ios=15879/0, merge=0/0, ticks=1254662/0, in_queue=1254662, util=96.58% 00:23:59.718 nvme5n1: ios=20831/0, merge=0/0, ticks=1257453/0, in_queue=1257453, util=96.99% 00:23:59.718 nvme6n1: ios=11906/0, merge=0/0, ticks=1248263/0, in_queue=1248263, util=97.34% 00:23:59.718 nvme7n1: ios=16863/0, merge=0/0, ticks=1230870/0, in_queue=1230870, util=98.33% 00:23:59.718 nvme8n1: ios=15464/0, merge=0/0, ticks=1223080/0, in_queue=1223080, util=98.85% 00:23:59.718 nvme9n1: ios=13938/0, merge=0/0, ticks=1256880/0, in_queue=1256880, util=99.23% 00:23:59.718 19:10:15 -- target/multiconnection.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t randwrite -r 10 00:23:59.718 [global] 00:23:59.718 thread=1 00:23:59.718 invalidate=1 00:23:59.718 rw=randwrite 00:23:59.718 time_based=1 00:23:59.718 runtime=10 00:23:59.718 ioengine=libaio 00:23:59.718 direct=1 00:23:59.718 bs=262144 00:23:59.718 iodepth=64 00:23:59.718 norandommap=1 00:23:59.718 numjobs=1 00:23:59.718 00:23:59.718 [job0] 00:23:59.718 filename=/dev/nvme0n1 00:23:59.718 [job1] 00:23:59.718 filename=/dev/nvme10n1 00:23:59.718 [job2] 00:23:59.718 filename=/dev/nvme1n1 00:23:59.718 [job3] 00:23:59.718 filename=/dev/nvme2n1 00:23:59.718 [job4] 00:23:59.718 filename=/dev/nvme3n1 00:23:59.718 [job5] 00:23:59.718 filename=/dev/nvme4n1 00:23:59.718 [job6] 00:23:59.719 filename=/dev/nvme5n1 00:23:59.719 [job7] 00:23:59.719 filename=/dev/nvme6n1 00:23:59.719 [job8] 00:23:59.719 filename=/dev/nvme7n1 00:23:59.719 [job9] 00:23:59.719 filename=/dev/nvme8n1 00:23:59.719 [job10] 00:23:59.719 filename=/dev/nvme9n1 00:23:59.719 Could not set queue depth (nvme0n1) 00:23:59.719 Could not set queue depth (nvme10n1) 00:23:59.719 Could not set queue depth (nvme1n1) 00:23:59.719 Could not set queue depth (nvme2n1) 00:23:59.719 Could not set queue depth (nvme3n1) 00:23:59.719 Could not set queue depth (nvme4n1) 00:23:59.719 Could not set queue depth (nvme5n1) 00:23:59.719 Could not set queue depth (nvme6n1) 00:23:59.719 Could not set queue depth (nvme7n1) 00:23:59.719 Could not set queue depth (nvme8n1) 00:23:59.719 Could not set queue depth (nvme9n1) 00:23:59.719 job0: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:59.719 job1: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:59.719 job2: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:59.719 job3: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:59.719 job4: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:59.719 job5: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:59.719 job6: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:59.719 job7: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:59.719 job8: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:59.719 job9: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:59.719 job10: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:59.719 fio-3.35 00:23:59.719 Starting 11 threads 00:24:09.700 00:24:09.700 job0: (groupid=0, jobs=1): err= 0: pid=3179535: Tue Nov 26 19:10:26 2024 00:24:09.700 write: IOPS=574, BW=144MiB/s (151MB/s)(1461MiB/10162msec); 0 zone resets 00:24:09.700 slat (usec): min=18, max=49690, avg=1396.77, stdev=3186.90 00:24:09.700 clat (usec): min=1956, max=293313, avg=109828.41, stdev=49619.58 00:24:09.700 lat (msec): min=2, max=293, avg=111.23, stdev=50.31 00:24:09.700 clat percentiles (msec): 00:24:09.700 | 1.00th=[ 10], 5.00th=[ 26], 10.00th=[ 39], 20.00th=[ 61], 00:24:09.700 | 30.00th=[ 78], 40.00th=[ 103], 50.00th=[ 120], 60.00th=[ 133], 00:24:09.700 | 70.00th=[ 144], 80.00th=[ 155], 90.00th=[ 165], 95.00th=[ 176], 00:24:09.700 | 99.00th=[ 218], 99.50th=[ 253], 99.90th=[ 288], 99.95th=[ 292], 00:24:09.700 | 99.99th=[ 292] 00:24:09.700 bw ( KiB/s): min=98304, max=283648, per=8.25%, avg=147929.65, stdev=52710.48, samples=20 00:24:09.700 iops : min= 384, max= 1108, avg=577.85, stdev=205.90, samples=20 00:24:09.700 lat (msec) : 2=0.02%, 4=0.19%, 10=1.04%, 20=2.24%, 50=12.79% 00:24:09.700 lat (msec) : 100=22.24%, 250=60.96%, 500=0.53% 00:24:09.700 cpu : usr=1.33%, sys=1.72%, ctx=2617, majf=0, minf=1 00:24:09.700 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=98.9% 00:24:09.700 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:09.700 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:24:09.700 issued rwts: total=0,5842,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:09.700 latency : target=0, window=0, percentile=100.00%, depth=64 00:24:09.700 job1: (groupid=0, jobs=1): err= 0: pid=3179553: Tue Nov 26 19:10:26 2024 00:24:09.700 write: IOPS=573, BW=143MiB/s (150MB/s)(1457MiB/10156msec); 0 zone resets 00:24:09.700 slat (usec): min=28, max=85310, avg=1423.65, stdev=4245.54 00:24:09.700 clat (msec): min=2, max=306, avg=110.01, stdev=52.45 00:24:09.700 lat (msec): min=2, max=306, avg=111.43, stdev=52.99 00:24:09.700 clat percentiles (msec): 00:24:09.700 | 1.00th=[ 9], 5.00th=[ 27], 10.00th=[ 39], 20.00th=[ 64], 00:24:09.700 | 30.00th=[ 72], 40.00th=[ 99], 50.00th=[ 116], 60.00th=[ 130], 00:24:09.700 | 70.00th=[ 140], 80.00th=[ 155], 90.00th=[ 167], 95.00th=[ 192], 00:24:09.700 | 99.00th=[ 247], 99.50th=[ 262], 99.90th=[ 300], 99.95th=[ 305], 00:24:09.700 | 99.99th=[ 309] 00:24:09.700 bw ( KiB/s): min=85504, max=237531, per=8.23%, avg=147607.75, stdev=45643.60, samples=20 00:24:09.700 iops : min= 334, max= 927, avg=576.55, stdev=178.21, samples=20 00:24:09.700 lat (msec) : 4=0.24%, 10=0.96%, 20=2.40%, 50=11.48%, 100=25.88% 00:24:09.700 lat (msec) : 250=58.22%, 500=0.82% 00:24:09.700 cpu : usr=1.19%, sys=1.72%, ctx=2402, majf=0, minf=1 00:24:09.700 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=98.9% 00:24:09.700 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:09.700 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:24:09.700 issued rwts: total=0,5828,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:09.700 latency : target=0, window=0, percentile=100.00%, depth=64 00:24:09.700 job2: (groupid=0, jobs=1): err= 0: pid=3179569: Tue Nov 26 19:10:26 2024 00:24:09.700 write: IOPS=1008, BW=252MiB/s (264MB/s)(2564MiB/10166msec); 0 zone resets 00:24:09.700 slat (usec): min=22, max=30936, avg=932.43, stdev=2013.29 00:24:09.700 clat (usec): min=1441, max=327431, avg=62477.95, stdev=40176.41 00:24:09.700 lat (usec): min=1503, max=327473, avg=63410.37, stdev=40702.03 00:24:09.700 clat percentiles (msec): 00:24:09.700 | 1.00th=[ 16], 5.00th=[ 38], 10.00th=[ 39], 20.00th=[ 40], 00:24:09.700 | 30.00th=[ 40], 40.00th=[ 41], 50.00th=[ 41], 60.00th=[ 42], 00:24:09.700 | 70.00th=[ 66], 80.00th=[ 94], 90.00th=[ 130], 95.00th=[ 148], 00:24:09.700 | 99.00th=[ 176], 99.50th=[ 192], 99.90th=[ 296], 99.95th=[ 317], 00:24:09.700 | 99.99th=[ 330] 00:24:09.700 bw ( KiB/s): min=102400, max=409600, per=14.56%, avg=260927.50, stdev=125234.97, samples=20 00:24:09.700 iops : min= 400, max= 1600, avg=1019.20, stdev=489.25, samples=20 00:24:09.700 lat (msec) : 2=0.02%, 4=0.10%, 10=0.44%, 20=0.85%, 50=65.92% 00:24:09.700 lat (msec) : 100=14.28%, 250=18.10%, 500=0.29% 00:24:09.700 cpu : usr=2.36%, sys=3.06%, ctx=2932, majf=0, minf=1 00:24:09.700 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:24:09.700 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:09.700 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:24:09.700 issued rwts: total=0,10256,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:09.700 latency : target=0, window=0, percentile=100.00%, depth=64 00:24:09.700 job3: (groupid=0, jobs=1): err= 0: pid=3179589: Tue Nov 26 19:10:26 2024 00:24:09.700 write: IOPS=665, BW=166MiB/s (175MB/s)(1692MiB/10162msec); 0 zone resets 00:24:09.700 slat (usec): min=18, max=86405, avg=1253.23, stdev=2973.39 00:24:09.700 clat (usec): min=1139, max=337279, avg=94811.34, stdev=47048.44 00:24:09.700 lat (usec): min=1726, max=337316, avg=96064.57, stdev=47676.73 00:24:09.700 clat percentiles (msec): 00:24:09.700 | 1.00th=[ 6], 5.00th=[ 20], 10.00th=[ 40], 20.00th=[ 62], 00:24:09.701 | 30.00th=[ 71], 40.00th=[ 74], 50.00th=[ 95], 60.00th=[ 103], 00:24:09.701 | 70.00th=[ 110], 80.00th=[ 132], 90.00th=[ 159], 95.00th=[ 169], 00:24:09.701 | 99.00th=[ 253], 99.50th=[ 266], 99.90th=[ 317], 99.95th=[ 330], 00:24:09.701 | 99.99th=[ 338] 00:24:09.701 bw ( KiB/s): min=87040, max=307200, per=9.57%, avg=171596.80, stdev=56187.13, samples=20 00:24:09.701 iops : min= 340, max= 1200, avg=670.30, stdev=219.48, samples=20 00:24:09.701 lat (msec) : 2=0.06%, 4=0.34%, 10=2.08%, 20=2.54%, 50=9.35% 00:24:09.701 lat (msec) : 100=41.69%, 250=42.86%, 500=1.08% 00:24:09.701 cpu : usr=1.60%, sys=1.98%, ctx=2872, majf=0, minf=1 00:24:09.701 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:24:09.701 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:09.701 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:24:09.701 issued rwts: total=0,6767,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:09.701 latency : target=0, window=0, percentile=100.00%, depth=64 00:24:09.701 job4: (groupid=0, jobs=1): err= 0: pid=3179593: Tue Nov 26 19:10:26 2024 00:24:09.701 write: IOPS=667, BW=167MiB/s (175MB/s)(1681MiB/10071msec); 0 zone resets 00:24:09.701 slat (usec): min=24, max=37865, avg=1161.81, stdev=2666.75 00:24:09.701 clat (msec): min=2, max=205, avg=94.69, stdev=37.54 00:24:09.701 lat (msec): min=2, max=205, avg=95.85, stdev=38.03 00:24:09.701 clat percentiles (msec): 00:24:09.701 | 1.00th=[ 11], 5.00th=[ 42], 10.00th=[ 59], 20.00th=[ 70], 00:24:09.701 | 30.00th=[ 73], 40.00th=[ 77], 50.00th=[ 85], 60.00th=[ 101], 00:24:09.701 | 70.00th=[ 109], 80.00th=[ 125], 90.00th=[ 148], 95.00th=[ 174], 00:24:09.701 | 99.00th=[ 192], 99.50th=[ 197], 99.90th=[ 203], 99.95th=[ 205], 00:24:09.701 | 99.99th=[ 205] 00:24:09.701 bw ( KiB/s): min=92160, max=250880, per=9.51%, avg=170470.40, stdev=47105.90, samples=20 00:24:09.701 iops : min= 360, max= 980, avg=665.90, stdev=184.01, samples=20 00:24:09.701 lat (msec) : 4=0.16%, 10=0.83%, 20=1.23%, 50=5.58%, 100=51.86% 00:24:09.701 lat (msec) : 250=40.33% 00:24:09.701 cpu : usr=1.66%, sys=2.06%, ctx=3037, majf=0, minf=1 00:24:09.701 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:24:09.701 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:09.701 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:24:09.701 issued rwts: total=0,6722,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:09.701 latency : target=0, window=0, percentile=100.00%, depth=64 00:24:09.701 job5: (groupid=0, jobs=1): err= 0: pid=3179597: Tue Nov 26 19:10:26 2024 00:24:09.701 write: IOPS=542, BW=136MiB/s (142MB/s)(1379MiB/10158msec); 0 zone resets 00:24:09.701 slat (usec): min=24, max=66410, avg=1644.86, stdev=3582.31 00:24:09.701 clat (msec): min=2, max=330, avg=116.02, stdev=48.24 00:24:09.701 lat (msec): min=2, max=330, avg=117.66, stdev=48.85 00:24:09.701 clat percentiles (msec): 00:24:09.701 | 1.00th=[ 13], 5.00th=[ 41], 10.00th=[ 59], 20.00th=[ 73], 00:24:09.701 | 30.00th=[ 87], 40.00th=[ 103], 50.00th=[ 105], 60.00th=[ 129], 00:24:09.701 | 70.00th=[ 144], 80.00th=[ 163], 90.00th=[ 176], 95.00th=[ 192], 00:24:09.701 | 99.00th=[ 228], 99.50th=[ 255], 99.90th=[ 321], 99.95th=[ 321], 00:24:09.701 | 99.99th=[ 330] 00:24:09.701 bw ( KiB/s): min=86016, max=291328, per=7.79%, avg=139571.20, stdev=51448.50, samples=20 00:24:09.701 iops : min= 336, max= 1138, avg=545.20, stdev=200.97, samples=20 00:24:09.701 lat (msec) : 4=0.05%, 10=0.83%, 20=0.56%, 50=6.53%, 100=30.39% 00:24:09.701 lat (msec) : 250=61.09%, 500=0.54% 00:24:09.701 cpu : usr=1.26%, sys=1.75%, ctx=1899, majf=0, minf=1 00:24:09.701 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:24:09.701 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:09.701 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:24:09.701 issued rwts: total=0,5515,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:09.701 latency : target=0, window=0, percentile=100.00%, depth=64 00:24:09.701 job6: (groupid=0, jobs=1): err= 0: pid=3179599: Tue Nov 26 19:10:26 2024 00:24:09.701 write: IOPS=590, BW=148MiB/s (155MB/s)(1490MiB/10099msec); 0 zone resets 00:24:09.701 slat (usec): min=28, max=56719, avg=1434.72, stdev=3360.64 00:24:09.701 clat (usec): min=1668, max=262593, avg=106957.10, stdev=52435.04 00:24:09.701 lat (usec): min=1715, max=262642, avg=108391.82, stdev=53163.23 00:24:09.701 clat percentiles (msec): 00:24:09.701 | 1.00th=[ 17], 5.00th=[ 39], 10.00th=[ 40], 20.00th=[ 47], 00:24:09.701 | 30.00th=[ 73], 40.00th=[ 82], 50.00th=[ 105], 60.00th=[ 126], 00:24:09.701 | 70.00th=[ 150], 80.00th=[ 161], 90.00th=[ 174], 95.00th=[ 184], 00:24:09.701 | 99.00th=[ 220], 99.50th=[ 228], 99.90th=[ 253], 99.95th=[ 259], 00:24:09.701 | 99.99th=[ 264] 00:24:09.701 bw ( KiB/s): min=88064, max=396800, per=8.42%, avg=150956.00, stdev=72023.52, samples=20 00:24:09.701 iops : min= 344, max= 1550, avg=589.65, stdev=281.33, samples=20 00:24:09.701 lat (msec) : 2=0.02%, 4=0.07%, 10=0.18%, 20=1.14%, 50=19.35% 00:24:09.701 lat (msec) : 100=26.18%, 250=52.95%, 500=0.12% 00:24:09.701 cpu : usr=1.60%, sys=1.61%, ctx=2323, majf=0, minf=1 00:24:09.701 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=98.9% 00:24:09.701 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:09.701 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:24:09.701 issued rwts: total=0,5959,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:09.701 latency : target=0, window=0, percentile=100.00%, depth=64 00:24:09.701 job7: (groupid=0, jobs=1): err= 0: pid=3179602: Tue Nov 26 19:10:26 2024 00:24:09.701 write: IOPS=604, BW=151MiB/s (159MB/s)(1522MiB/10070msec); 0 zone resets 00:24:09.701 slat (usec): min=23, max=149677, avg=1235.38, stdev=3913.71 00:24:09.701 clat (usec): min=1472, max=292339, avg=104578.08, stdev=52320.57 00:24:09.701 lat (msec): min=2, max=292, avg=105.81, stdev=52.88 00:24:09.701 clat percentiles (msec): 00:24:09.701 | 1.00th=[ 7], 5.00th=[ 19], 10.00th=[ 35], 20.00th=[ 68], 00:24:09.701 | 30.00th=[ 72], 40.00th=[ 79], 50.00th=[ 99], 60.00th=[ 121], 00:24:09.701 | 70.00th=[ 138], 80.00th=[ 155], 90.00th=[ 169], 95.00th=[ 194], 00:24:09.701 | 99.00th=[ 226], 99.50th=[ 241], 99.90th=[ 262], 99.95th=[ 271], 00:24:09.701 | 99.99th=[ 292] 00:24:09.701 bw ( KiB/s): min=88064, max=273920, per=8.61%, avg=154265.60, stdev=49902.23, samples=20 00:24:09.701 iops : min= 344, max= 1070, avg=602.60, stdev=194.93, samples=20 00:24:09.701 lat (msec) : 2=0.02%, 4=0.21%, 10=1.97%, 20=3.30%, 50=8.82% 00:24:09.701 lat (msec) : 100=36.49%, 250=48.94%, 500=0.25% 00:24:09.701 cpu : usr=1.39%, sys=1.87%, ctx=2980, majf=0, minf=1 00:24:09.701 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:24:09.701 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:09.701 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:24:09.701 issued rwts: total=0,6089,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:09.701 latency : target=0, window=0, percentile=100.00%, depth=64 00:24:09.701 job8: (groupid=0, jobs=1): err= 0: pid=3179603: Tue Nov 26 19:10:26 2024 00:24:09.701 write: IOPS=457, BW=114MiB/s (120MB/s)(1155MiB/10098msec); 0 zone resets 00:24:09.701 slat (usec): min=26, max=56873, avg=1899.12, stdev=4102.66 00:24:09.701 clat (msec): min=3, max=246, avg=138.00, stdev=41.88 00:24:09.701 lat (msec): min=3, max=246, avg=139.90, stdev=42.47 00:24:09.701 clat percentiles (msec): 00:24:09.701 | 1.00th=[ 12], 5.00th=[ 54], 10.00th=[ 75], 20.00th=[ 110], 00:24:09.701 | 30.00th=[ 128], 40.00th=[ 134], 50.00th=[ 142], 60.00th=[ 153], 00:24:09.701 | 70.00th=[ 165], 80.00th=[ 171], 90.00th=[ 182], 95.00th=[ 192], 00:24:09.701 | 99.00th=[ 224], 99.50th=[ 234], 99.90th=[ 245], 99.95th=[ 247], 00:24:09.701 | 99.99th=[ 247] 00:24:09.701 bw ( KiB/s): min=81920, max=175616, per=6.50%, avg=116608.00, stdev=26219.24, samples=20 00:24:09.701 iops : min= 320, max= 686, avg=455.50, stdev=102.42, samples=20 00:24:09.701 lat (msec) : 4=0.04%, 10=0.82%, 20=1.04%, 50=2.82%, 100=9.94% 00:24:09.701 lat (msec) : 250=85.34% 00:24:09.701 cpu : usr=1.14%, sys=1.53%, ctx=1706, majf=0, minf=1 00:24:09.701 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.6% 00:24:09.701 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:09.701 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:24:09.701 issued rwts: total=0,4618,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:09.701 latency : target=0, window=0, percentile=100.00%, depth=64 00:24:09.701 job9: (groupid=0, jobs=1): err= 0: pid=3179604: Tue Nov 26 19:10:26 2024 00:24:09.701 write: IOPS=710, BW=178MiB/s (186MB/s)(1806MiB/10164msec); 0 zone resets 00:24:09.701 slat (usec): min=20, max=102854, avg=1144.01, stdev=3031.11 00:24:09.701 clat (usec): min=877, max=340278, avg=88877.12, stdev=52447.94 00:24:09.701 lat (usec): min=922, max=340324, avg=90021.14, stdev=53080.23 00:24:09.701 clat percentiles (msec): 00:24:09.701 | 1.00th=[ 10], 5.00th=[ 29], 10.00th=[ 39], 20.00th=[ 41], 00:24:09.701 | 30.00th=[ 42], 40.00th=[ 64], 50.00th=[ 83], 60.00th=[ 103], 00:24:09.701 | 70.00th=[ 111], 80.00th=[ 132], 90.00th=[ 167], 95.00th=[ 186], 00:24:09.701 | 99.00th=[ 224], 99.50th=[ 232], 99.90th=[ 321], 99.95th=[ 330], 00:24:09.701 | 99.99th=[ 342] 00:24:09.701 bw ( KiB/s): min=88064, max=404992, per=10.22%, avg=183280.65, stdev=98089.07, samples=20 00:24:09.701 iops : min= 344, max= 1582, avg=715.90, stdev=383.20, samples=20 00:24:09.701 lat (usec) : 1000=0.04% 00:24:09.701 lat (msec) : 2=0.10%, 4=0.21%, 10=0.71%, 20=1.97%, 50=32.45% 00:24:09.701 lat (msec) : 100=23.27%, 250=40.88%, 500=0.37% 00:24:09.701 cpu : usr=1.59%, sys=1.87%, ctx=2852, majf=0, minf=1 00:24:09.701 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.1% 00:24:09.701 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:09.701 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:24:09.701 issued rwts: total=0,7223,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:09.701 latency : target=0, window=0, percentile=100.00%, depth=64 00:24:09.701 job10: (groupid=0, jobs=1): err= 0: pid=3179605: Tue Nov 26 19:10:26 2024 00:24:09.701 write: IOPS=630, BW=158MiB/s (165MB/s)(1592MiB/10099msec); 0 zone resets 00:24:09.701 slat (usec): min=25, max=49993, avg=1381.23, stdev=3158.27 00:24:09.701 clat (msec): min=2, max=207, avg=100.10, stdev=49.51 00:24:09.701 lat (msec): min=3, max=207, avg=101.48, stdev=50.21 00:24:09.702 clat percentiles (msec): 00:24:09.702 | 1.00th=[ 17], 5.00th=[ 37], 10.00th=[ 40], 20.00th=[ 43], 00:24:09.702 | 30.00th=[ 64], 40.00th=[ 77], 50.00th=[ 97], 60.00th=[ 125], 00:24:09.702 | 70.00th=[ 138], 80.00th=[ 153], 90.00th=[ 165], 95.00th=[ 176], 00:24:09.702 | 99.00th=[ 190], 99.50th=[ 201], 99.90th=[ 207], 99.95th=[ 207], 00:24:09.702 | 99.99th=[ 209] 00:24:09.702 bw ( KiB/s): min=89600, max=365568, per=9.00%, avg=161392.85, stdev=81160.32, samples=20 00:24:09.702 iops : min= 350, max= 1428, avg=630.40, stdev=317.06, samples=20 00:24:09.702 lat (msec) : 4=0.05%, 10=0.19%, 20=1.84%, 50=21.88%, 100=27.49% 00:24:09.702 lat (msec) : 250=48.56% 00:24:09.702 cpu : usr=1.53%, sys=2.09%, ctx=2372, majf=0, minf=1 00:24:09.702 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:24:09.702 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:09.702 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:24:09.702 issued rwts: total=0,6367,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:09.702 latency : target=0, window=0, percentile=100.00%, depth=64 00:24:09.702 00:24:09.702 Run status group 0 (all jobs): 00:24:09.702 WRITE: bw=1751MiB/s (1836MB/s), 114MiB/s-252MiB/s (120MB/s-264MB/s), io=17.4GiB (18.7GB), run=10070-10166msec 00:24:09.702 00:24:09.702 Disk stats (read/write): 00:24:09.702 nvme0n1: ios=55/11501, merge=0/0, ticks=1140/1214373, in_queue=1215513, util=99.44% 00:24:09.702 nvme10n1: ios=52/11471, merge=0/0, ticks=2924/1162510, in_queue=1165434, util=99.67% 00:24:09.702 nvme1n1: ios=49/20510, merge=0/0, ticks=41/1235776, in_queue=1235817, util=97.74% 00:24:09.702 nvme2n1: ios=46/13354, merge=0/0, ticks=24/1209858, in_queue=1209882, util=97.80% 00:24:09.702 nvme3n1: ios=24/13194, merge=0/0, ticks=30/1218314, in_queue=1218344, util=97.83% 00:24:09.702 nvme4n1: ios=52/10845, merge=0/0, ticks=1092/1203985, in_queue=1205077, util=100.00% 00:24:09.702 nvme5n1: ios=47/11693, merge=0/0, ticks=785/1210542, in_queue=1211327, util=100.00% 00:24:09.702 nvme6n1: ios=49/11918, merge=0/0, ticks=4743/1207743, in_queue=1212486, util=100.00% 00:24:09.702 nvme7n1: ios=0/9016, merge=0/0, ticks=0/1209339, in_queue=1209339, util=98.78% 00:24:09.702 nvme8n1: ios=0/14231, merge=0/0, ticks=0/1211084, in_queue=1211084, util=98.94% 00:24:09.702 nvme9n1: ios=0/12509, merge=0/0, ticks=0/1209294, in_queue=1209294, util=99.07% 00:24:09.702 19:10:26 -- target/multiconnection.sh@36 -- # sync 00:24:09.702 19:10:26 -- target/multiconnection.sh@37 -- # seq 1 11 00:24:09.702 19:10:26 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:24:09.702 19:10:26 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:24:09.702 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:24:09.702 19:10:26 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK1 00:24:09.702 19:10:26 -- common/autotest_common.sh@1208 -- # local i=0 00:24:09.702 19:10:26 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:24:09.702 19:10:26 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK1 00:24:09.702 19:10:26 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:24:09.702 19:10:26 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK1 00:24:09.702 19:10:26 -- common/autotest_common.sh@1220 -- # return 0 00:24:09.702 19:10:26 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:24:09.702 19:10:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:09.702 19:10:26 -- common/autotest_common.sh@10 -- # set +x 00:24:09.702 19:10:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:09.702 19:10:26 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:24:09.702 19:10:26 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode2 00:24:09.961 NQN:nqn.2016-06.io.spdk:cnode2 disconnected 1 controller(s) 00:24:09.961 19:10:26 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK2 00:24:09.961 19:10:26 -- common/autotest_common.sh@1208 -- # local i=0 00:24:09.961 19:10:26 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:24:09.961 19:10:26 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK2 00:24:10.221 19:10:26 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:24:10.221 19:10:26 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK2 00:24:10.221 19:10:26 -- common/autotest_common.sh@1220 -- # return 0 00:24:10.221 19:10:26 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:24:10.221 19:10:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:10.221 19:10:26 -- common/autotest_common.sh@10 -- # set +x 00:24:10.221 19:10:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:10.221 19:10:26 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:24:10.221 19:10:26 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode3 00:24:10.480 NQN:nqn.2016-06.io.spdk:cnode3 disconnected 1 controller(s) 00:24:10.480 19:10:27 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK3 00:24:10.480 19:10:27 -- common/autotest_common.sh@1208 -- # local i=0 00:24:10.480 19:10:27 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:24:10.480 19:10:27 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK3 00:24:10.480 19:10:27 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:24:10.480 19:10:27 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK3 00:24:10.480 19:10:27 -- common/autotest_common.sh@1220 -- # return 0 00:24:10.480 19:10:27 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:24:10.480 19:10:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:10.480 19:10:27 -- common/autotest_common.sh@10 -- # set +x 00:24:10.480 19:10:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:10.480 19:10:27 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:24:10.480 19:10:27 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode4 00:24:10.739 NQN:nqn.2016-06.io.spdk:cnode4 disconnected 1 controller(s) 00:24:10.739 19:10:27 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK4 00:24:10.739 19:10:27 -- common/autotest_common.sh@1208 -- # local i=0 00:24:10.739 19:10:27 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:24:10.739 19:10:27 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK4 00:24:10.739 19:10:27 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:24:10.739 19:10:27 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK4 00:24:10.739 19:10:27 -- common/autotest_common.sh@1220 -- # return 0 00:24:10.739 19:10:27 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:24:10.739 19:10:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:10.739 19:10:27 -- common/autotest_common.sh@10 -- # set +x 00:24:10.739 19:10:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:10.739 19:10:27 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:24:10.739 19:10:27 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode5 00:24:10.997 NQN:nqn.2016-06.io.spdk:cnode5 disconnected 1 controller(s) 00:24:10.997 19:10:27 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK5 00:24:10.997 19:10:27 -- common/autotest_common.sh@1208 -- # local i=0 00:24:10.997 19:10:27 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:24:10.997 19:10:27 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK5 00:24:11.256 19:10:27 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:24:11.256 19:10:27 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK5 00:24:11.256 19:10:27 -- common/autotest_common.sh@1220 -- # return 0 00:24:11.256 19:10:27 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode5 00:24:11.256 19:10:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:11.256 19:10:27 -- common/autotest_common.sh@10 -- # set +x 00:24:11.256 19:10:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:11.256 19:10:27 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:24:11.256 19:10:27 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode6 00:24:11.256 NQN:nqn.2016-06.io.spdk:cnode6 disconnected 1 controller(s) 00:24:11.256 19:10:28 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK6 00:24:11.256 19:10:28 -- common/autotest_common.sh@1208 -- # local i=0 00:24:11.256 19:10:28 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:24:11.256 19:10:28 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK6 00:24:11.256 19:10:28 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:24:11.257 19:10:28 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK6 00:24:11.257 19:10:28 -- common/autotest_common.sh@1220 -- # return 0 00:24:11.257 19:10:28 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode6 00:24:11.257 19:10:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:11.257 19:10:28 -- common/autotest_common.sh@10 -- # set +x 00:24:11.516 19:10:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:11.516 19:10:28 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:24:11.516 19:10:28 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode7 00:24:11.516 NQN:nqn.2016-06.io.spdk:cnode7 disconnected 1 controller(s) 00:24:11.516 19:10:28 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK7 00:24:11.516 19:10:28 -- common/autotest_common.sh@1208 -- # local i=0 00:24:11.516 19:10:28 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:24:11.516 19:10:28 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK7 00:24:11.774 19:10:28 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:24:11.774 19:10:28 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK7 00:24:11.774 19:10:28 -- common/autotest_common.sh@1220 -- # return 0 00:24:11.774 19:10:28 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode7 00:24:11.774 19:10:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:11.774 19:10:28 -- common/autotest_common.sh@10 -- # set +x 00:24:11.774 19:10:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:11.774 19:10:28 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:24:11.774 19:10:28 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode8 00:24:12.033 NQN:nqn.2016-06.io.spdk:cnode8 disconnected 1 controller(s) 00:24:12.033 19:10:28 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK8 00:24:12.033 19:10:28 -- common/autotest_common.sh@1208 -- # local i=0 00:24:12.033 19:10:28 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:24:12.033 19:10:28 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK8 00:24:12.033 19:10:28 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:24:12.033 19:10:28 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK8 00:24:12.033 19:10:28 -- common/autotest_common.sh@1220 -- # return 0 00:24:12.033 19:10:28 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode8 00:24:12.033 19:10:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:12.033 19:10:28 -- common/autotest_common.sh@10 -- # set +x 00:24:12.033 19:10:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:12.033 19:10:28 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:24:12.033 19:10:28 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode9 00:24:12.033 NQN:nqn.2016-06.io.spdk:cnode9 disconnected 1 controller(s) 00:24:12.033 19:10:28 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK9 00:24:12.033 19:10:28 -- common/autotest_common.sh@1208 -- # local i=0 00:24:12.033 19:10:28 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:24:12.033 19:10:28 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK9 00:24:12.033 19:10:28 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:24:12.033 19:10:28 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK9 00:24:12.293 19:10:28 -- common/autotest_common.sh@1220 -- # return 0 00:24:12.293 19:10:28 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode9 00:24:12.293 19:10:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:12.293 19:10:28 -- common/autotest_common.sh@10 -- # set +x 00:24:12.293 19:10:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:12.293 19:10:28 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:24:12.293 19:10:28 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode10 00:24:12.293 NQN:nqn.2016-06.io.spdk:cnode10 disconnected 1 controller(s) 00:24:12.293 19:10:29 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK10 00:24:12.293 19:10:29 -- common/autotest_common.sh@1208 -- # local i=0 00:24:12.293 19:10:29 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:24:12.293 19:10:29 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK10 00:24:12.293 19:10:29 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:24:12.293 19:10:29 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK10 00:24:12.293 19:10:29 -- common/autotest_common.sh@1220 -- # return 0 00:24:12.293 19:10:29 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode10 00:24:12.293 19:10:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:12.293 19:10:29 -- common/autotest_common.sh@10 -- # set +x 00:24:12.293 19:10:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:12.293 19:10:29 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:24:12.293 19:10:29 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode11 00:24:12.551 NQN:nqn.2016-06.io.spdk:cnode11 disconnected 1 controller(s) 00:24:12.551 19:10:29 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK11 00:24:12.551 19:10:29 -- common/autotest_common.sh@1208 -- # local i=0 00:24:12.551 19:10:29 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:24:12.551 19:10:29 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK11 00:24:12.551 19:10:29 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:24:12.551 19:10:29 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK11 00:24:12.551 19:10:29 -- common/autotest_common.sh@1220 -- # return 0 00:24:12.552 19:10:29 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode11 00:24:12.552 19:10:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:12.552 19:10:29 -- common/autotest_common.sh@10 -- # set +x 00:24:12.552 19:10:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:12.552 19:10:29 -- target/multiconnection.sh@43 -- # rm -f ./local-job0-0-verify.state 00:24:12.552 19:10:29 -- target/multiconnection.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:24:12.552 19:10:29 -- target/multiconnection.sh@47 -- # nvmftestfini 00:24:12.552 19:10:29 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:12.552 19:10:29 -- nvmf/common.sh@116 -- # sync 00:24:12.552 19:10:29 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:12.552 19:10:29 -- nvmf/common.sh@119 -- # set +e 00:24:12.552 19:10:29 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:12.552 19:10:29 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:12.552 rmmod nvme_tcp 00:24:12.552 rmmod nvme_fabrics 00:24:12.552 rmmod nvme_keyring 00:24:12.552 19:10:29 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:12.552 19:10:29 -- nvmf/common.sh@123 -- # set -e 00:24:12.552 19:10:29 -- nvmf/common.sh@124 -- # return 0 00:24:12.552 19:10:29 -- nvmf/common.sh@477 -- # '[' -n 3171198 ']' 00:24:12.552 19:10:29 -- nvmf/common.sh@478 -- # killprocess 3171198 00:24:12.552 19:10:29 -- common/autotest_common.sh@936 -- # '[' -z 3171198 ']' 00:24:12.552 19:10:29 -- common/autotest_common.sh@940 -- # kill -0 3171198 00:24:12.552 19:10:29 -- common/autotest_common.sh@941 -- # uname 00:24:12.552 19:10:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:12.552 19:10:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3171198 00:24:12.552 19:10:29 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:12.552 19:10:29 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:12.552 19:10:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3171198' 00:24:12.552 killing process with pid 3171198 00:24:12.552 19:10:29 -- common/autotest_common.sh@955 -- # kill 3171198 00:24:12.552 19:10:29 -- common/autotest_common.sh@960 -- # wait 3171198 00:24:13.119 19:10:29 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:13.119 19:10:29 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:13.119 19:10:29 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:13.119 19:10:29 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:13.119 19:10:29 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:13.119 19:10:29 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:13.119 19:10:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:13.119 19:10:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:15.023 19:10:31 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:15.023 00:24:15.023 real 1m11.438s 00:24:15.023 user 4m12.803s 00:24:15.023 sys 0m26.156s 00:24:15.023 19:10:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:24:15.023 19:10:31 -- common/autotest_common.sh@10 -- # set +x 00:24:15.023 ************************************ 00:24:15.023 END TEST nvmf_multiconnection 00:24:15.023 ************************************ 00:24:15.023 19:10:31 -- nvmf/nvmf.sh@66 -- # run_test nvmf_initiator_timeout /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:24:15.023 19:10:31 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:24:15.023 19:10:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:24:15.023 19:10:31 -- common/autotest_common.sh@10 -- # set +x 00:24:15.023 ************************************ 00:24:15.023 START TEST nvmf_initiator_timeout 00:24:15.023 ************************************ 00:24:15.023 19:10:31 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:24:15.283 * Looking for test storage... 00:24:15.283 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:24:15.283 19:10:32 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:24:15.283 19:10:32 -- common/autotest_common.sh@1690 -- # lcov --version 00:24:15.283 19:10:32 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:24:15.283 19:10:32 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:24:15.283 19:10:32 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:24:15.283 19:10:32 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:24:15.283 19:10:32 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:24:15.283 19:10:32 -- scripts/common.sh@335 -- # IFS=.-: 00:24:15.283 19:10:32 -- scripts/common.sh@335 -- # read -ra ver1 00:24:15.283 19:10:32 -- scripts/common.sh@336 -- # IFS=.-: 00:24:15.283 19:10:32 -- scripts/common.sh@336 -- # read -ra ver2 00:24:15.283 19:10:32 -- scripts/common.sh@337 -- # local 'op=<' 00:24:15.283 19:10:32 -- scripts/common.sh@339 -- # ver1_l=2 00:24:15.283 19:10:32 -- scripts/common.sh@340 -- # ver2_l=1 00:24:15.283 19:10:32 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:24:15.283 19:10:32 -- scripts/common.sh@343 -- # case "$op" in 00:24:15.283 19:10:32 -- scripts/common.sh@344 -- # : 1 00:24:15.283 19:10:32 -- scripts/common.sh@363 -- # (( v = 0 )) 00:24:15.283 19:10:32 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:24:15.283 19:10:32 -- scripts/common.sh@364 -- # decimal 1 00:24:15.283 19:10:32 -- scripts/common.sh@352 -- # local d=1 00:24:15.283 19:10:32 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:24:15.283 19:10:32 -- scripts/common.sh@354 -- # echo 1 00:24:15.283 19:10:32 -- scripts/common.sh@364 -- # ver1[v]=1 00:24:15.283 19:10:32 -- scripts/common.sh@365 -- # decimal 2 00:24:15.283 19:10:32 -- scripts/common.sh@352 -- # local d=2 00:24:15.283 19:10:32 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:24:15.283 19:10:32 -- scripts/common.sh@354 -- # echo 2 00:24:15.283 19:10:32 -- scripts/common.sh@365 -- # ver2[v]=2 00:24:15.283 19:10:32 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:24:15.283 19:10:32 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:24:15.283 19:10:32 -- scripts/common.sh@367 -- # return 0 00:24:15.283 19:10:32 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:24:15.283 19:10:32 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:24:15.283 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:15.283 --rc genhtml_branch_coverage=1 00:24:15.283 --rc genhtml_function_coverage=1 00:24:15.283 --rc genhtml_legend=1 00:24:15.283 --rc geninfo_all_blocks=1 00:24:15.283 --rc geninfo_unexecuted_blocks=1 00:24:15.283 00:24:15.283 ' 00:24:15.283 19:10:32 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:24:15.283 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:15.283 --rc genhtml_branch_coverage=1 00:24:15.283 --rc genhtml_function_coverage=1 00:24:15.283 --rc genhtml_legend=1 00:24:15.283 --rc geninfo_all_blocks=1 00:24:15.283 --rc geninfo_unexecuted_blocks=1 00:24:15.283 00:24:15.283 ' 00:24:15.283 19:10:32 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:24:15.283 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:15.283 --rc genhtml_branch_coverage=1 00:24:15.283 --rc genhtml_function_coverage=1 00:24:15.283 --rc genhtml_legend=1 00:24:15.283 --rc geninfo_all_blocks=1 00:24:15.283 --rc geninfo_unexecuted_blocks=1 00:24:15.283 00:24:15.283 ' 00:24:15.283 19:10:32 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:24:15.283 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:15.283 --rc genhtml_branch_coverage=1 00:24:15.283 --rc genhtml_function_coverage=1 00:24:15.283 --rc genhtml_legend=1 00:24:15.283 --rc geninfo_all_blocks=1 00:24:15.283 --rc geninfo_unexecuted_blocks=1 00:24:15.283 00:24:15.283 ' 00:24:15.283 19:10:32 -- target/initiator_timeout.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:24:15.283 19:10:32 -- nvmf/common.sh@7 -- # uname -s 00:24:15.283 19:10:32 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:24:15.283 19:10:32 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:24:15.283 19:10:32 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:24:15.283 19:10:32 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:24:15.283 19:10:32 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:24:15.283 19:10:32 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:24:15.283 19:10:32 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:24:15.283 19:10:32 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:24:15.283 19:10:32 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:24:15.283 19:10:32 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:24:15.283 19:10:32 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:24:15.283 19:10:32 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:24:15.283 19:10:32 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:24:15.283 19:10:32 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:24:15.283 19:10:32 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:24:15.283 19:10:32 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:15.283 19:10:32 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:15.283 19:10:32 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:15.283 19:10:32 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:15.283 19:10:32 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:15.284 19:10:32 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:15.284 19:10:32 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:15.284 19:10:32 -- paths/export.sh@5 -- # export PATH 00:24:15.284 19:10:32 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:15.284 19:10:32 -- nvmf/common.sh@46 -- # : 0 00:24:15.284 19:10:32 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:24:15.284 19:10:32 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:24:15.284 19:10:32 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:24:15.284 19:10:32 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:24:15.284 19:10:32 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:24:15.284 19:10:32 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:24:15.284 19:10:32 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:24:15.284 19:10:32 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:24:15.284 19:10:32 -- target/initiator_timeout.sh@11 -- # MALLOC_BDEV_SIZE=64 00:24:15.284 19:10:32 -- target/initiator_timeout.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:24:15.284 19:10:32 -- target/initiator_timeout.sh@14 -- # nvmftestinit 00:24:15.284 19:10:32 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:15.284 19:10:32 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:15.284 19:10:32 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:15.284 19:10:32 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:15.284 19:10:32 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:15.284 19:10:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:15.284 19:10:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:15.284 19:10:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:15.284 19:10:32 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:15.284 19:10:32 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:15.284 19:10:32 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:15.284 19:10:32 -- common/autotest_common.sh@10 -- # set +x 00:24:20.558 19:10:37 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:20.558 19:10:37 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:20.558 19:10:37 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:20.558 19:10:37 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:20.559 19:10:37 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:20.559 19:10:37 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:20.559 19:10:37 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:20.559 19:10:37 -- nvmf/common.sh@294 -- # net_devs=() 00:24:20.559 19:10:37 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:20.559 19:10:37 -- nvmf/common.sh@295 -- # e810=() 00:24:20.559 19:10:37 -- nvmf/common.sh@295 -- # local -ga e810 00:24:20.559 19:10:37 -- nvmf/common.sh@296 -- # x722=() 00:24:20.559 19:10:37 -- nvmf/common.sh@296 -- # local -ga x722 00:24:20.559 19:10:37 -- nvmf/common.sh@297 -- # mlx=() 00:24:20.559 19:10:37 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:20.559 19:10:37 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:20.559 19:10:37 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:20.559 19:10:37 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:20.559 19:10:37 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:20.559 19:10:37 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:20.559 19:10:37 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:20.559 19:10:37 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:20.559 19:10:37 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:20.559 19:10:37 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:20.559 19:10:37 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:20.559 19:10:37 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:20.559 19:10:37 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:20.559 19:10:37 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:20.559 19:10:37 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:20.559 19:10:37 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:20.559 19:10:37 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:20.559 19:10:37 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:20.559 19:10:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:20.559 19:10:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:24:20.559 Found 0000:86:00.0 (0x8086 - 0x159b) 00:24:20.559 19:10:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:20.559 19:10:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:20.559 19:10:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:20.559 19:10:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:20.559 19:10:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:20.559 19:10:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:20.559 19:10:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:24:20.559 Found 0000:86:00.1 (0x8086 - 0x159b) 00:24:20.559 19:10:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:20.559 19:10:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:20.559 19:10:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:20.559 19:10:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:20.559 19:10:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:20.559 19:10:37 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:20.559 19:10:37 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:20.559 19:10:37 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:20.559 19:10:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:20.559 19:10:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:20.559 19:10:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:20.559 19:10:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:20.559 19:10:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:24:20.559 Found net devices under 0000:86:00.0: cvl_0_0 00:24:20.559 19:10:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:20.559 19:10:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:20.559 19:10:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:20.559 19:10:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:20.559 19:10:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:20.559 19:10:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:24:20.559 Found net devices under 0000:86:00.1: cvl_0_1 00:24:20.559 19:10:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:20.559 19:10:37 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:20.559 19:10:37 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:20.559 19:10:37 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:20.559 19:10:37 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:20.559 19:10:37 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:20.559 19:10:37 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:20.559 19:10:37 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:20.559 19:10:37 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:20.559 19:10:37 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:20.559 19:10:37 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:20.559 19:10:37 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:20.559 19:10:37 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:20.559 19:10:37 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:20.559 19:10:37 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:20.559 19:10:37 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:20.559 19:10:37 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:20.559 19:10:37 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:20.817 19:10:37 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:20.817 19:10:37 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:20.817 19:10:37 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:20.817 19:10:37 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:20.817 19:10:37 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:20.817 19:10:37 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:20.817 19:10:37 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:20.817 19:10:37 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:20.817 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:20.817 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.446 ms 00:24:20.817 00:24:20.817 --- 10.0.0.2 ping statistics --- 00:24:20.817 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:20.817 rtt min/avg/max/mdev = 0.446/0.446/0.446/0.000 ms 00:24:20.817 19:10:37 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:20.817 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:20.818 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.163 ms 00:24:20.818 00:24:20.818 --- 10.0.0.1 ping statistics --- 00:24:20.818 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:20.818 rtt min/avg/max/mdev = 0.163/0.163/0.163/0.000 ms 00:24:20.818 19:10:37 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:20.818 19:10:37 -- nvmf/common.sh@410 -- # return 0 00:24:20.818 19:10:37 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:20.818 19:10:37 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:20.818 19:10:37 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:20.818 19:10:37 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:20.818 19:10:37 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:20.818 19:10:37 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:20.818 19:10:37 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:20.818 19:10:37 -- target/initiator_timeout.sh@15 -- # nvmfappstart -m 0xF 00:24:20.818 19:10:37 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:24:20.818 19:10:37 -- common/autotest_common.sh@722 -- # xtrace_disable 00:24:20.818 19:10:37 -- common/autotest_common.sh@10 -- # set +x 00:24:20.818 19:10:37 -- nvmf/common.sh@469 -- # nvmfpid=3185080 00:24:20.818 19:10:37 -- nvmf/common.sh@470 -- # waitforlisten 3185080 00:24:20.818 19:10:37 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:24:20.818 19:10:37 -- common/autotest_common.sh@829 -- # '[' -z 3185080 ']' 00:24:20.818 19:10:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:20.818 19:10:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:24:20.818 19:10:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:20.818 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:20.818 19:10:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:24:20.818 19:10:37 -- common/autotest_common.sh@10 -- # set +x 00:24:21.078 [2024-11-26 19:10:37.785067] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:24:21.078 [2024-11-26 19:10:37.785110] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:21.078 EAL: No free 2048 kB hugepages reported on node 1 00:24:21.078 [2024-11-26 19:10:37.844062] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:21.078 [2024-11-26 19:10:37.884380] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:21.078 [2024-11-26 19:10:37.884495] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:21.078 [2024-11-26 19:10:37.884504] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:21.078 [2024-11-26 19:10:37.884512] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:21.078 [2024-11-26 19:10:37.885965] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:21.078 [2024-11-26 19:10:37.885982] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:21.078 [2024-11-26 19:10:37.886071] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:21.078 [2024-11-26 19:10:37.886073] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:22.014 19:10:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:24:22.014 19:10:38 -- common/autotest_common.sh@862 -- # return 0 00:24:22.014 19:10:38 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:24:22.014 19:10:38 -- common/autotest_common.sh@728 -- # xtrace_disable 00:24:22.014 19:10:38 -- common/autotest_common.sh@10 -- # set +x 00:24:22.014 19:10:38 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:22.014 19:10:38 -- target/initiator_timeout.sh@17 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:24:22.014 19:10:38 -- target/initiator_timeout.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:24:22.014 19:10:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:22.014 19:10:38 -- common/autotest_common.sh@10 -- # set +x 00:24:22.014 Malloc0 00:24:22.015 19:10:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:22.015 19:10:38 -- target/initiator_timeout.sh@22 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 30 -t 30 -w 30 -n 30 00:24:22.015 19:10:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:22.015 19:10:38 -- common/autotest_common.sh@10 -- # set +x 00:24:22.015 Delay0 00:24:22.015 19:10:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:22.015 19:10:38 -- target/initiator_timeout.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:24:22.015 19:10:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:22.015 19:10:38 -- common/autotest_common.sh@10 -- # set +x 00:24:22.015 [2024-11-26 19:10:38.682036] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:22.015 19:10:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:22.015 19:10:38 -- target/initiator_timeout.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:24:22.015 19:10:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:22.015 19:10:38 -- common/autotest_common.sh@10 -- # set +x 00:24:22.015 19:10:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:22.015 19:10:38 -- target/initiator_timeout.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:24:22.015 19:10:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:22.015 19:10:38 -- common/autotest_common.sh@10 -- # set +x 00:24:22.015 19:10:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:22.015 19:10:38 -- target/initiator_timeout.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:24:22.015 19:10:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:22.015 19:10:38 -- common/autotest_common.sh@10 -- # set +x 00:24:22.015 [2024-11-26 19:10:38.706996] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:22.015 19:10:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:22.015 19:10:38 -- target/initiator_timeout.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:24:22.949 19:10:39 -- target/initiator_timeout.sh@31 -- # waitforserial SPDKISFASTANDAWESOME 00:24:22.949 19:10:39 -- common/autotest_common.sh@1187 -- # local i=0 00:24:22.949 19:10:39 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:24:22.949 19:10:39 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:24:22.949 19:10:39 -- common/autotest_common.sh@1194 -- # sleep 2 00:24:25.480 19:10:41 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:24:25.480 19:10:41 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:24:25.480 19:10:41 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:24:25.480 19:10:41 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:24:25.480 19:10:41 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:24:25.480 19:10:41 -- common/autotest_common.sh@1197 -- # return 0 00:24:25.480 19:10:41 -- target/initiator_timeout.sh@35 -- # fio_pid=3185812 00:24:25.480 19:10:41 -- target/initiator_timeout.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 60 -v 00:24:25.480 19:10:41 -- target/initiator_timeout.sh@37 -- # sleep 3 00:24:25.480 [global] 00:24:25.480 thread=1 00:24:25.480 invalidate=1 00:24:25.480 rw=write 00:24:25.480 time_based=1 00:24:25.480 runtime=60 00:24:25.480 ioengine=libaio 00:24:25.480 direct=1 00:24:25.480 bs=4096 00:24:25.480 iodepth=1 00:24:25.480 norandommap=0 00:24:25.480 numjobs=1 00:24:25.480 00:24:25.480 verify_dump=1 00:24:25.480 verify_backlog=512 00:24:25.480 verify_state_save=0 00:24:25.480 do_verify=1 00:24:25.480 verify=crc32c-intel 00:24:25.480 [job0] 00:24:25.480 filename=/dev/nvme0n1 00:24:25.480 Could not set queue depth (nvme0n1) 00:24:25.480 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:24:25.480 fio-3.35 00:24:25.480 Starting 1 thread 00:24:28.015 19:10:44 -- target/initiator_timeout.sh@40 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 31000000 00:24:28.015 19:10:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:28.015 19:10:44 -- common/autotest_common.sh@10 -- # set +x 00:24:28.015 true 00:24:28.015 19:10:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:28.015 19:10:44 -- target/initiator_timeout.sh@41 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 31000000 00:24:28.015 19:10:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:28.015 19:10:44 -- common/autotest_common.sh@10 -- # set +x 00:24:28.015 true 00:24:28.015 19:10:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:28.015 19:10:44 -- target/initiator_timeout.sh@42 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 31000000 00:24:28.015 19:10:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:28.015 19:10:44 -- common/autotest_common.sh@10 -- # set +x 00:24:28.015 true 00:24:28.015 19:10:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:28.015 19:10:44 -- target/initiator_timeout.sh@43 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 310000000 00:24:28.015 19:10:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:28.015 19:10:44 -- common/autotest_common.sh@10 -- # set +x 00:24:28.015 true 00:24:28.015 19:10:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:28.015 19:10:44 -- target/initiator_timeout.sh@45 -- # sleep 3 00:24:31.303 19:10:47 -- target/initiator_timeout.sh@48 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 30 00:24:31.303 19:10:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:31.303 19:10:47 -- common/autotest_common.sh@10 -- # set +x 00:24:31.303 true 00:24:31.303 19:10:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:31.303 19:10:47 -- target/initiator_timeout.sh@49 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 30 00:24:31.303 19:10:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:31.303 19:10:47 -- common/autotest_common.sh@10 -- # set +x 00:24:31.303 true 00:24:31.303 19:10:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:31.303 19:10:47 -- target/initiator_timeout.sh@50 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 30 00:24:31.303 19:10:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:31.303 19:10:47 -- common/autotest_common.sh@10 -- # set +x 00:24:31.303 true 00:24:31.303 19:10:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:31.303 19:10:47 -- target/initiator_timeout.sh@51 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 30 00:24:31.303 19:10:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:31.303 19:10:47 -- common/autotest_common.sh@10 -- # set +x 00:24:31.303 true 00:24:31.303 19:10:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:31.303 19:10:47 -- target/initiator_timeout.sh@53 -- # fio_status=0 00:24:31.303 19:10:47 -- target/initiator_timeout.sh@54 -- # wait 3185812 00:25:27.544 00:25:27.544 job0: (groupid=0, jobs=1): err= 0: pid=3185929: Tue Nov 26 19:11:42 2024 00:25:27.544 read: IOPS=202, BW=809KiB/s (829kB/s)(47.4MiB/60010msec) 00:25:27.544 slat (usec): min=6, max=11651, avg= 8.85, stdev=105.71 00:25:27.544 clat (usec): min=203, max=41724k, avg=4735.18, stdev=378727.44 00:25:27.544 lat (usec): min=212, max=41724k, avg=4744.03, stdev=378727.62 00:25:27.544 clat percentiles (usec): 00:25:27.544 | 1.00th=[ 221], 5.00th=[ 229], 10.00th=[ 235], 20.00th=[ 239], 00:25:27.544 | 30.00th=[ 241], 40.00th=[ 243], 50.00th=[ 247], 60.00th=[ 249], 00:25:27.544 | 70.00th=[ 253], 80.00th=[ 258], 90.00th=[ 265], 95.00th=[ 269], 00:25:27.544 | 99.00th=[41157], 99.50th=[41157], 99.90th=[42206], 99.95th=[42206], 00:25:27.544 | 99.99th=[42206] 00:25:27.544 write: IOPS=204, BW=819KiB/s (839kB/s)(48.0MiB/60010msec); 0 zone resets 00:25:27.544 slat (usec): min=9, max=27112, avg=12.85, stdev=244.49 00:25:27.544 clat (usec): min=147, max=484, avg=179.51, stdev=12.05 00:25:27.544 lat (usec): min=157, max=27423, avg=192.36, stdev=245.97 00:25:27.544 clat percentiles (usec): 00:25:27.544 | 1.00th=[ 157], 5.00th=[ 163], 10.00th=[ 167], 20.00th=[ 172], 00:25:27.544 | 30.00th=[ 174], 40.00th=[ 176], 50.00th=[ 178], 60.00th=[ 182], 00:25:27.544 | 70.00th=[ 186], 80.00th=[ 190], 90.00th=[ 196], 95.00th=[ 200], 00:25:27.544 | 99.00th=[ 210], 99.50th=[ 215], 99.90th=[ 235], 99.95th=[ 265], 00:25:27.544 | 99.99th=[ 437] 00:25:27.544 bw ( KiB/s): min= 4096, max= 9992, per=100.00%, avg=7561.85, stdev=1749.59, samples=13 00:25:27.544 iops : min= 1024, max= 2498, avg=1890.46, stdev=437.40, samples=13 00:25:27.544 lat (usec) : 250=81.52%, 500=17.19%, 750=0.01%, 1000=0.01% 00:25:27.544 lat (msec) : 50=1.28%, >=2000=0.01% 00:25:27.544 cpu : usr=0.23%, sys=0.37%, ctx=24433, majf=0, minf=1 00:25:27.544 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:25:27.544 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:25:27.544 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:25:27.544 issued rwts: total=12140,12288,0,0 short=0,0,0,0 dropped=0,0,0,0 00:25:27.544 latency : target=0, window=0, percentile=100.00%, depth=1 00:25:27.544 00:25:27.544 Run status group 0 (all jobs): 00:25:27.544 READ: bw=809KiB/s (829kB/s), 809KiB/s-809KiB/s (829kB/s-829kB/s), io=47.4MiB (49.7MB), run=60010-60010msec 00:25:27.544 WRITE: bw=819KiB/s (839kB/s), 819KiB/s-819KiB/s (839kB/s-839kB/s), io=48.0MiB (50.3MB), run=60010-60010msec 00:25:27.544 00:25:27.544 Disk stats (read/write): 00:25:27.544 nvme0n1: ios=12189/12288, merge=0/0, ticks=16890/2160, in_queue=19050, util=99.70% 00:25:27.544 19:11:42 -- target/initiator_timeout.sh@56 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:25:27.544 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:25:27.544 19:11:42 -- target/initiator_timeout.sh@57 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:25:27.544 19:11:42 -- common/autotest_common.sh@1208 -- # local i=0 00:25:27.544 19:11:42 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:25:27.544 19:11:42 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:25:27.544 19:11:42 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:25:27.544 19:11:42 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:25:27.544 19:11:42 -- common/autotest_common.sh@1220 -- # return 0 00:25:27.544 19:11:42 -- target/initiator_timeout.sh@59 -- # '[' 0 -eq 0 ']' 00:25:27.544 19:11:42 -- target/initiator_timeout.sh@60 -- # echo 'nvmf hotplug test: fio successful as expected' 00:25:27.544 nvmf hotplug test: fio successful as expected 00:25:27.544 19:11:42 -- target/initiator_timeout.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:27.544 19:11:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:27.544 19:11:42 -- common/autotest_common.sh@10 -- # set +x 00:25:27.544 19:11:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:27.544 19:11:42 -- target/initiator_timeout.sh@69 -- # rm -f ./local-job0-0-verify.state 00:25:27.544 19:11:42 -- target/initiator_timeout.sh@71 -- # trap - SIGINT SIGTERM EXIT 00:25:27.544 19:11:42 -- target/initiator_timeout.sh@73 -- # nvmftestfini 00:25:27.544 19:11:42 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:27.544 19:11:42 -- nvmf/common.sh@116 -- # sync 00:25:27.544 19:11:42 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:27.544 19:11:42 -- nvmf/common.sh@119 -- # set +e 00:25:27.544 19:11:42 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:27.544 19:11:42 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:27.544 rmmod nvme_tcp 00:25:27.544 rmmod nvme_fabrics 00:25:27.544 rmmod nvme_keyring 00:25:27.544 19:11:42 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:27.544 19:11:42 -- nvmf/common.sh@123 -- # set -e 00:25:27.544 19:11:42 -- nvmf/common.sh@124 -- # return 0 00:25:27.544 19:11:42 -- nvmf/common.sh@477 -- # '[' -n 3185080 ']' 00:25:27.544 19:11:42 -- nvmf/common.sh@478 -- # killprocess 3185080 00:25:27.544 19:11:42 -- common/autotest_common.sh@936 -- # '[' -z 3185080 ']' 00:25:27.544 19:11:42 -- common/autotest_common.sh@940 -- # kill -0 3185080 00:25:27.544 19:11:42 -- common/autotest_common.sh@941 -- # uname 00:25:27.544 19:11:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:27.544 19:11:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3185080 00:25:27.544 19:11:42 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:27.544 19:11:42 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:27.544 19:11:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3185080' 00:25:27.544 killing process with pid 3185080 00:25:27.544 19:11:42 -- common/autotest_common.sh@955 -- # kill 3185080 00:25:27.544 19:11:42 -- common/autotest_common.sh@960 -- # wait 3185080 00:25:27.544 19:11:42 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:27.544 19:11:42 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:27.544 19:11:42 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:27.544 19:11:42 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:27.544 19:11:42 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:27.544 19:11:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:27.544 19:11:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:27.544 19:11:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:28.113 19:11:44 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:28.113 00:25:28.113 real 1m12.888s 00:25:28.113 user 4m24.547s 00:25:28.113 sys 0m6.831s 00:25:28.113 19:11:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:28.113 19:11:44 -- common/autotest_common.sh@10 -- # set +x 00:25:28.113 ************************************ 00:25:28.113 END TEST nvmf_initiator_timeout 00:25:28.113 ************************************ 00:25:28.113 19:11:44 -- nvmf/nvmf.sh@69 -- # [[ phy == phy ]] 00:25:28.113 19:11:44 -- nvmf/nvmf.sh@70 -- # '[' tcp = tcp ']' 00:25:28.113 19:11:44 -- nvmf/nvmf.sh@71 -- # gather_supported_nvmf_pci_devs 00:25:28.113 19:11:44 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:28.113 19:11:44 -- common/autotest_common.sh@10 -- # set +x 00:25:33.386 19:11:50 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:33.386 19:11:50 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:33.386 19:11:50 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:33.386 19:11:50 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:33.386 19:11:50 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:33.386 19:11:50 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:33.386 19:11:50 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:33.386 19:11:50 -- nvmf/common.sh@294 -- # net_devs=() 00:25:33.386 19:11:50 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:33.386 19:11:50 -- nvmf/common.sh@295 -- # e810=() 00:25:33.386 19:11:50 -- nvmf/common.sh@295 -- # local -ga e810 00:25:33.386 19:11:50 -- nvmf/common.sh@296 -- # x722=() 00:25:33.386 19:11:50 -- nvmf/common.sh@296 -- # local -ga x722 00:25:33.386 19:11:50 -- nvmf/common.sh@297 -- # mlx=() 00:25:33.386 19:11:50 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:33.386 19:11:50 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:33.386 19:11:50 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:33.386 19:11:50 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:33.386 19:11:50 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:33.386 19:11:50 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:33.386 19:11:50 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:33.386 19:11:50 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:33.386 19:11:50 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:33.386 19:11:50 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:33.386 19:11:50 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:33.386 19:11:50 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:33.386 19:11:50 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:33.386 19:11:50 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:33.386 19:11:50 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:33.386 19:11:50 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:33.386 19:11:50 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:33.386 19:11:50 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:33.386 19:11:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:33.386 19:11:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:25:33.386 Found 0000:86:00.0 (0x8086 - 0x159b) 00:25:33.386 19:11:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:33.386 19:11:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:33.386 19:11:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:33.386 19:11:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:33.386 19:11:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:33.386 19:11:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:33.386 19:11:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:25:33.386 Found 0000:86:00.1 (0x8086 - 0x159b) 00:25:33.386 19:11:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:33.386 19:11:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:33.386 19:11:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:33.386 19:11:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:33.386 19:11:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:33.386 19:11:50 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:33.386 19:11:50 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:33.386 19:11:50 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:33.386 19:11:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:33.387 19:11:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:33.387 19:11:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:33.387 19:11:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:33.387 19:11:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:25:33.387 Found net devices under 0000:86:00.0: cvl_0_0 00:25:33.387 19:11:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:33.387 19:11:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:33.387 19:11:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:33.387 19:11:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:33.387 19:11:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:33.387 19:11:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:25:33.387 Found net devices under 0000:86:00.1: cvl_0_1 00:25:33.387 19:11:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:33.387 19:11:50 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:33.387 19:11:50 -- nvmf/nvmf.sh@72 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:33.387 19:11:50 -- nvmf/nvmf.sh@73 -- # (( 2 > 0 )) 00:25:33.387 19:11:50 -- nvmf/nvmf.sh@74 -- # run_test nvmf_perf_adq /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:25:33.387 19:11:50 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:33.387 19:11:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:33.387 19:11:50 -- common/autotest_common.sh@10 -- # set +x 00:25:33.387 ************************************ 00:25:33.387 START TEST nvmf_perf_adq 00:25:33.387 ************************************ 00:25:33.387 19:11:50 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:25:33.387 * Looking for test storage... 00:25:33.387 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:25:33.387 19:11:50 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:33.387 19:11:50 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:33.387 19:11:50 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:33.387 19:11:50 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:33.387 19:11:50 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:33.387 19:11:50 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:33.387 19:11:50 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:33.387 19:11:50 -- scripts/common.sh@335 -- # IFS=.-: 00:25:33.387 19:11:50 -- scripts/common.sh@335 -- # read -ra ver1 00:25:33.387 19:11:50 -- scripts/common.sh@336 -- # IFS=.-: 00:25:33.387 19:11:50 -- scripts/common.sh@336 -- # read -ra ver2 00:25:33.387 19:11:50 -- scripts/common.sh@337 -- # local 'op=<' 00:25:33.387 19:11:50 -- scripts/common.sh@339 -- # ver1_l=2 00:25:33.387 19:11:50 -- scripts/common.sh@340 -- # ver2_l=1 00:25:33.387 19:11:50 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:33.387 19:11:50 -- scripts/common.sh@343 -- # case "$op" in 00:25:33.387 19:11:50 -- scripts/common.sh@344 -- # : 1 00:25:33.387 19:11:50 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:33.387 19:11:50 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:33.387 19:11:50 -- scripts/common.sh@364 -- # decimal 1 00:25:33.387 19:11:50 -- scripts/common.sh@352 -- # local d=1 00:25:33.387 19:11:50 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:33.387 19:11:50 -- scripts/common.sh@354 -- # echo 1 00:25:33.387 19:11:50 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:33.387 19:11:50 -- scripts/common.sh@365 -- # decimal 2 00:25:33.387 19:11:50 -- scripts/common.sh@352 -- # local d=2 00:25:33.387 19:11:50 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:33.387 19:11:50 -- scripts/common.sh@354 -- # echo 2 00:25:33.387 19:11:50 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:33.387 19:11:50 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:33.387 19:11:50 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:33.387 19:11:50 -- scripts/common.sh@367 -- # return 0 00:25:33.387 19:11:50 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:33.387 19:11:50 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:33.387 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:33.387 --rc genhtml_branch_coverage=1 00:25:33.387 --rc genhtml_function_coverage=1 00:25:33.387 --rc genhtml_legend=1 00:25:33.387 --rc geninfo_all_blocks=1 00:25:33.387 --rc geninfo_unexecuted_blocks=1 00:25:33.387 00:25:33.387 ' 00:25:33.387 19:11:50 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:33.387 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:33.387 --rc genhtml_branch_coverage=1 00:25:33.387 --rc genhtml_function_coverage=1 00:25:33.387 --rc genhtml_legend=1 00:25:33.387 --rc geninfo_all_blocks=1 00:25:33.387 --rc geninfo_unexecuted_blocks=1 00:25:33.387 00:25:33.387 ' 00:25:33.387 19:11:50 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:33.387 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:33.387 --rc genhtml_branch_coverage=1 00:25:33.387 --rc genhtml_function_coverage=1 00:25:33.387 --rc genhtml_legend=1 00:25:33.387 --rc geninfo_all_blocks=1 00:25:33.387 --rc geninfo_unexecuted_blocks=1 00:25:33.387 00:25:33.387 ' 00:25:33.387 19:11:50 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:33.387 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:33.387 --rc genhtml_branch_coverage=1 00:25:33.387 --rc genhtml_function_coverage=1 00:25:33.387 --rc genhtml_legend=1 00:25:33.387 --rc geninfo_all_blocks=1 00:25:33.387 --rc geninfo_unexecuted_blocks=1 00:25:33.387 00:25:33.387 ' 00:25:33.387 19:11:50 -- target/perf_adq.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:33.387 19:11:50 -- nvmf/common.sh@7 -- # uname -s 00:25:33.387 19:11:50 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:33.387 19:11:50 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:33.387 19:11:50 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:33.387 19:11:50 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:33.387 19:11:50 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:33.387 19:11:50 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:33.387 19:11:50 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:33.387 19:11:50 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:33.387 19:11:50 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:33.387 19:11:50 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:33.668 19:11:50 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:25:33.668 19:11:50 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:25:33.668 19:11:50 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:33.668 19:11:50 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:33.668 19:11:50 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:33.668 19:11:50 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:33.668 19:11:50 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:33.668 19:11:50 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:33.668 19:11:50 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:33.669 19:11:50 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:33.669 19:11:50 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:33.669 19:11:50 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:33.669 19:11:50 -- paths/export.sh@5 -- # export PATH 00:25:33.669 19:11:50 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:33.669 19:11:50 -- nvmf/common.sh@46 -- # : 0 00:25:33.669 19:11:50 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:33.669 19:11:50 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:33.669 19:11:50 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:33.669 19:11:50 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:33.669 19:11:50 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:33.669 19:11:50 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:33.669 19:11:50 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:33.669 19:11:50 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:33.669 19:11:50 -- target/perf_adq.sh@11 -- # gather_supported_nvmf_pci_devs 00:25:33.669 19:11:50 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:33.669 19:11:50 -- common/autotest_common.sh@10 -- # set +x 00:25:39.070 19:11:55 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:39.070 19:11:55 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:39.070 19:11:55 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:39.070 19:11:55 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:39.070 19:11:55 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:39.070 19:11:55 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:39.070 19:11:55 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:39.070 19:11:55 -- nvmf/common.sh@294 -- # net_devs=() 00:25:39.070 19:11:55 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:39.070 19:11:55 -- nvmf/common.sh@295 -- # e810=() 00:25:39.070 19:11:55 -- nvmf/common.sh@295 -- # local -ga e810 00:25:39.070 19:11:55 -- nvmf/common.sh@296 -- # x722=() 00:25:39.070 19:11:55 -- nvmf/common.sh@296 -- # local -ga x722 00:25:39.070 19:11:55 -- nvmf/common.sh@297 -- # mlx=() 00:25:39.070 19:11:55 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:39.070 19:11:55 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:39.070 19:11:55 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:39.070 19:11:55 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:39.070 19:11:55 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:39.070 19:11:55 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:39.070 19:11:55 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:39.070 19:11:55 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:39.070 19:11:55 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:39.070 19:11:55 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:39.070 19:11:55 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:39.070 19:11:55 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:39.070 19:11:55 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:39.070 19:11:55 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:39.070 19:11:55 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:39.070 19:11:55 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:39.070 19:11:55 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:39.070 19:11:55 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:39.070 19:11:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:39.070 19:11:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:25:39.070 Found 0000:86:00.0 (0x8086 - 0x159b) 00:25:39.070 19:11:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:39.070 19:11:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:39.070 19:11:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:39.070 19:11:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:39.070 19:11:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:39.070 19:11:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:39.070 19:11:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:25:39.070 Found 0000:86:00.1 (0x8086 - 0x159b) 00:25:39.070 19:11:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:39.070 19:11:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:39.070 19:11:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:39.070 19:11:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:39.070 19:11:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:39.070 19:11:55 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:39.070 19:11:55 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:39.070 19:11:55 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:39.070 19:11:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:39.070 19:11:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:39.070 19:11:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:39.070 19:11:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:39.070 19:11:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:25:39.070 Found net devices under 0000:86:00.0: cvl_0_0 00:25:39.070 19:11:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:39.070 19:11:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:39.070 19:11:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:39.070 19:11:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:39.070 19:11:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:39.070 19:11:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:25:39.070 Found net devices under 0000:86:00.1: cvl_0_1 00:25:39.070 19:11:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:39.070 19:11:55 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:39.070 19:11:55 -- target/perf_adq.sh@12 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:39.070 19:11:55 -- target/perf_adq.sh@13 -- # (( 2 == 0 )) 00:25:39.070 19:11:55 -- target/perf_adq.sh@18 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:25:39.070 19:11:55 -- target/perf_adq.sh@59 -- # adq_reload_driver 00:25:39.070 19:11:55 -- target/perf_adq.sh@52 -- # rmmod ice 00:25:39.329 19:11:56 -- target/perf_adq.sh@53 -- # modprobe ice 00:25:41.233 19:11:58 -- target/perf_adq.sh@54 -- # sleep 5 00:25:46.506 19:12:03 -- target/perf_adq.sh@67 -- # nvmftestinit 00:25:46.506 19:12:03 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:46.506 19:12:03 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:46.506 19:12:03 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:46.506 19:12:03 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:46.506 19:12:03 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:46.506 19:12:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:46.506 19:12:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:46.506 19:12:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:46.506 19:12:03 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:46.506 19:12:03 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:46.506 19:12:03 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:46.506 19:12:03 -- common/autotest_common.sh@10 -- # set +x 00:25:46.506 19:12:03 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:46.506 19:12:03 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:46.506 19:12:03 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:46.506 19:12:03 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:46.506 19:12:03 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:46.506 19:12:03 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:46.506 19:12:03 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:46.506 19:12:03 -- nvmf/common.sh@294 -- # net_devs=() 00:25:46.506 19:12:03 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:46.506 19:12:03 -- nvmf/common.sh@295 -- # e810=() 00:25:46.506 19:12:03 -- nvmf/common.sh@295 -- # local -ga e810 00:25:46.506 19:12:03 -- nvmf/common.sh@296 -- # x722=() 00:25:46.506 19:12:03 -- nvmf/common.sh@296 -- # local -ga x722 00:25:46.506 19:12:03 -- nvmf/common.sh@297 -- # mlx=() 00:25:46.506 19:12:03 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:46.506 19:12:03 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:46.506 19:12:03 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:46.506 19:12:03 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:46.506 19:12:03 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:46.506 19:12:03 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:46.506 19:12:03 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:46.506 19:12:03 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:46.506 19:12:03 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:46.506 19:12:03 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:46.506 19:12:03 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:46.506 19:12:03 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:46.506 19:12:03 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:46.506 19:12:03 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:46.506 19:12:03 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:46.506 19:12:03 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:46.506 19:12:03 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:46.506 19:12:03 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:46.506 19:12:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:46.506 19:12:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:25:46.506 Found 0000:86:00.0 (0x8086 - 0x159b) 00:25:46.506 19:12:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:46.506 19:12:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:46.506 19:12:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:46.506 19:12:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:46.506 19:12:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:46.506 19:12:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:46.506 19:12:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:25:46.506 Found 0000:86:00.1 (0x8086 - 0x159b) 00:25:46.506 19:12:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:46.506 19:12:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:46.506 19:12:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:46.506 19:12:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:46.506 19:12:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:46.506 19:12:03 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:46.506 19:12:03 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:46.506 19:12:03 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:46.506 19:12:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:46.506 19:12:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:46.506 19:12:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:46.506 19:12:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:46.506 19:12:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:25:46.506 Found net devices under 0000:86:00.0: cvl_0_0 00:25:46.506 19:12:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:46.506 19:12:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:46.506 19:12:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:46.506 19:12:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:46.506 19:12:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:46.506 19:12:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:25:46.506 Found net devices under 0000:86:00.1: cvl_0_1 00:25:46.506 19:12:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:46.506 19:12:03 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:46.506 19:12:03 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:46.506 19:12:03 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:46.507 19:12:03 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:46.507 19:12:03 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:46.507 19:12:03 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:46.507 19:12:03 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:46.507 19:12:03 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:46.507 19:12:03 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:46.507 19:12:03 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:46.507 19:12:03 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:46.507 19:12:03 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:46.507 19:12:03 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:46.507 19:12:03 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:46.507 19:12:03 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:46.507 19:12:03 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:46.507 19:12:03 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:46.507 19:12:03 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:46.507 19:12:03 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:46.507 19:12:03 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:46.507 19:12:03 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:46.507 19:12:03 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:46.507 19:12:03 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:46.507 19:12:03 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:46.507 19:12:03 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:46.507 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:46.507 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.491 ms 00:25:46.507 00:25:46.507 --- 10.0.0.2 ping statistics --- 00:25:46.507 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:46.507 rtt min/avg/max/mdev = 0.491/0.491/0.491/0.000 ms 00:25:46.507 19:12:03 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:46.507 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:46.507 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.229 ms 00:25:46.507 00:25:46.507 --- 10.0.0.1 ping statistics --- 00:25:46.507 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:46.507 rtt min/avg/max/mdev = 0.229/0.229/0.229/0.000 ms 00:25:46.507 19:12:03 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:46.507 19:12:03 -- nvmf/common.sh@410 -- # return 0 00:25:46.507 19:12:03 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:46.507 19:12:03 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:46.507 19:12:03 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:46.507 19:12:03 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:46.507 19:12:03 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:46.507 19:12:03 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:46.507 19:12:03 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:46.507 19:12:03 -- target/perf_adq.sh@68 -- # nvmfappstart -m 0xF --wait-for-rpc 00:25:46.507 19:12:03 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:46.507 19:12:03 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:46.507 19:12:03 -- common/autotest_common.sh@10 -- # set +x 00:25:46.507 19:12:03 -- nvmf/common.sh@469 -- # nvmfpid=3203720 00:25:46.507 19:12:03 -- nvmf/common.sh@470 -- # waitforlisten 3203720 00:25:46.507 19:12:03 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:25:46.507 19:12:03 -- common/autotest_common.sh@829 -- # '[' -z 3203720 ']' 00:25:46.507 19:12:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:46.507 19:12:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:46.507 19:12:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:46.507 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:46.507 19:12:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:46.507 19:12:03 -- common/autotest_common.sh@10 -- # set +x 00:25:46.766 [2024-11-26 19:12:03.452745] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:46.766 [2024-11-26 19:12:03.452794] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:46.766 EAL: No free 2048 kB hugepages reported on node 1 00:25:46.766 [2024-11-26 19:12:03.514151] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:46.766 [2024-11-26 19:12:03.555055] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:46.766 [2024-11-26 19:12:03.555171] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:46.766 [2024-11-26 19:12:03.555179] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:46.766 [2024-11-26 19:12:03.555186] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:46.766 [2024-11-26 19:12:03.555227] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:46.766 [2024-11-26 19:12:03.555241] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:46.766 [2024-11-26 19:12:03.555332] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:46.766 [2024-11-26 19:12:03.555333] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:46.766 19:12:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:46.766 19:12:03 -- common/autotest_common.sh@862 -- # return 0 00:25:46.766 19:12:03 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:46.766 19:12:03 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:46.766 19:12:03 -- common/autotest_common.sh@10 -- # set +x 00:25:46.766 19:12:03 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:46.766 19:12:03 -- target/perf_adq.sh@69 -- # adq_configure_nvmf_target 0 00:25:46.766 19:12:03 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 0 --enable-zerocopy-send-server -i posix 00:25:46.766 19:12:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:46.766 19:12:03 -- common/autotest_common.sh@10 -- # set +x 00:25:46.766 19:12:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:46.766 19:12:03 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:25:46.766 19:12:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:46.766 19:12:03 -- common/autotest_common.sh@10 -- # set +x 00:25:47.025 19:12:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:47.025 19:12:03 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 0 00:25:47.025 19:12:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:47.025 19:12:03 -- common/autotest_common.sh@10 -- # set +x 00:25:47.025 [2024-11-26 19:12:03.740264] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:47.025 19:12:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:47.025 19:12:03 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:25:47.025 19:12:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:47.025 19:12:03 -- common/autotest_common.sh@10 -- # set +x 00:25:47.025 Malloc1 00:25:47.025 19:12:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:47.025 19:12:03 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:47.025 19:12:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:47.025 19:12:03 -- common/autotest_common.sh@10 -- # set +x 00:25:47.025 19:12:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:47.025 19:12:03 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:25:47.025 19:12:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:47.025 19:12:03 -- common/autotest_common.sh@10 -- # set +x 00:25:47.025 19:12:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:47.025 19:12:03 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:47.025 19:12:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:47.025 19:12:03 -- common/autotest_common.sh@10 -- # set +x 00:25:47.025 [2024-11-26 19:12:03.790689] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:47.025 19:12:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:47.025 19:12:03 -- target/perf_adq.sh@73 -- # perfpid=3203850 00:25:47.025 19:12:03 -- target/perf_adq.sh@74 -- # sleep 2 00:25:47.026 19:12:03 -- target/perf_adq.sh@70 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:25:47.026 EAL: No free 2048 kB hugepages reported on node 1 00:25:48.931 19:12:05 -- target/perf_adq.sh@76 -- # rpc_cmd nvmf_get_stats 00:25:48.931 19:12:05 -- target/perf_adq.sh@76 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 1) | length' 00:25:48.931 19:12:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:48.931 19:12:05 -- target/perf_adq.sh@76 -- # wc -l 00:25:48.931 19:12:05 -- common/autotest_common.sh@10 -- # set +x 00:25:48.931 19:12:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:48.931 19:12:05 -- target/perf_adq.sh@76 -- # count=4 00:25:48.931 19:12:05 -- target/perf_adq.sh@77 -- # [[ 4 -ne 4 ]] 00:25:48.931 19:12:05 -- target/perf_adq.sh@81 -- # wait 3203850 00:25:57.049 Initializing NVMe Controllers 00:25:57.049 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:57.049 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:25:57.049 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:25:57.049 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:25:57.049 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:25:57.049 Initialization complete. Launching workers. 00:25:57.049 ======================================================== 00:25:57.049 Latency(us) 00:25:57.049 Device Information : IOPS MiB/s Average min max 00:25:57.049 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 11277.70 44.05 5675.45 949.55 9693.30 00:25:57.049 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 11349.40 44.33 5638.57 1121.40 9440.17 00:25:57.049 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 11412.80 44.58 5607.59 935.47 9543.58 00:25:57.049 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 11501.00 44.93 5565.50 1042.08 9122.44 00:25:57.049 ======================================================== 00:25:57.049 Total : 45540.90 177.89 5621.49 935.47 9693.30 00:25:57.049 00:25:57.049 19:12:13 -- target/perf_adq.sh@82 -- # nvmftestfini 00:25:57.049 19:12:13 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:57.049 19:12:13 -- nvmf/common.sh@116 -- # sync 00:25:57.049 19:12:13 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:57.049 19:12:13 -- nvmf/common.sh@119 -- # set +e 00:25:57.049 19:12:13 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:57.049 19:12:13 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:57.049 rmmod nvme_tcp 00:25:57.049 rmmod nvme_fabrics 00:25:57.308 rmmod nvme_keyring 00:25:57.308 19:12:14 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:57.308 19:12:14 -- nvmf/common.sh@123 -- # set -e 00:25:57.308 19:12:14 -- nvmf/common.sh@124 -- # return 0 00:25:57.308 19:12:14 -- nvmf/common.sh@477 -- # '[' -n 3203720 ']' 00:25:57.308 19:12:14 -- nvmf/common.sh@478 -- # killprocess 3203720 00:25:57.308 19:12:14 -- common/autotest_common.sh@936 -- # '[' -z 3203720 ']' 00:25:57.308 19:12:14 -- common/autotest_common.sh@940 -- # kill -0 3203720 00:25:57.308 19:12:14 -- common/autotest_common.sh@941 -- # uname 00:25:57.308 19:12:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:57.308 19:12:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3203720 00:25:57.308 19:12:14 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:57.309 19:12:14 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:57.309 19:12:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3203720' 00:25:57.309 killing process with pid 3203720 00:25:57.309 19:12:14 -- common/autotest_common.sh@955 -- # kill 3203720 00:25:57.309 19:12:14 -- common/autotest_common.sh@960 -- # wait 3203720 00:25:57.567 19:12:14 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:57.567 19:12:14 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:57.567 19:12:14 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:57.567 19:12:14 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:57.567 19:12:14 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:57.567 19:12:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:57.567 19:12:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:57.567 19:12:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:59.471 19:12:16 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:59.471 19:12:16 -- target/perf_adq.sh@84 -- # adq_reload_driver 00:25:59.471 19:12:16 -- target/perf_adq.sh@52 -- # rmmod ice 00:26:00.849 19:12:17 -- target/perf_adq.sh@53 -- # modprobe ice 00:26:02.750 19:12:19 -- target/perf_adq.sh@54 -- # sleep 5 00:26:08.022 19:12:24 -- target/perf_adq.sh@87 -- # nvmftestinit 00:26:08.022 19:12:24 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:08.022 19:12:24 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:08.022 19:12:24 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:08.022 19:12:24 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:08.022 19:12:24 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:08.022 19:12:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:08.022 19:12:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:08.022 19:12:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:08.022 19:12:24 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:08.022 19:12:24 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:08.022 19:12:24 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:08.022 19:12:24 -- common/autotest_common.sh@10 -- # set +x 00:26:08.022 19:12:24 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:08.022 19:12:24 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:08.022 19:12:24 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:08.022 19:12:24 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:08.022 19:12:24 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:08.022 19:12:24 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:08.022 19:12:24 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:08.022 19:12:24 -- nvmf/common.sh@294 -- # net_devs=() 00:26:08.022 19:12:24 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:08.022 19:12:24 -- nvmf/common.sh@295 -- # e810=() 00:26:08.022 19:12:24 -- nvmf/common.sh@295 -- # local -ga e810 00:26:08.022 19:12:24 -- nvmf/common.sh@296 -- # x722=() 00:26:08.022 19:12:24 -- nvmf/common.sh@296 -- # local -ga x722 00:26:08.022 19:12:24 -- nvmf/common.sh@297 -- # mlx=() 00:26:08.022 19:12:24 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:08.022 19:12:24 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:08.022 19:12:24 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:08.022 19:12:24 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:08.022 19:12:24 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:08.022 19:12:24 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:08.022 19:12:24 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:08.022 19:12:24 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:08.022 19:12:24 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:08.022 19:12:24 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:08.023 19:12:24 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:08.023 19:12:24 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:08.023 19:12:24 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:08.023 19:12:24 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:08.023 19:12:24 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:08.023 19:12:24 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:08.023 19:12:24 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:08.023 19:12:24 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:08.023 19:12:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:08.023 19:12:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:26:08.023 Found 0000:86:00.0 (0x8086 - 0x159b) 00:26:08.023 19:12:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:08.023 19:12:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:08.023 19:12:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:08.023 19:12:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:08.023 19:12:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:08.023 19:12:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:08.023 19:12:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:26:08.023 Found 0000:86:00.1 (0x8086 - 0x159b) 00:26:08.023 19:12:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:08.023 19:12:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:08.023 19:12:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:08.023 19:12:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:08.023 19:12:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:08.023 19:12:24 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:08.023 19:12:24 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:08.023 19:12:24 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:08.023 19:12:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:08.023 19:12:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:08.023 19:12:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:08.023 19:12:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:08.023 19:12:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:26:08.023 Found net devices under 0000:86:00.0: cvl_0_0 00:26:08.023 19:12:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:08.023 19:12:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:08.023 19:12:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:08.023 19:12:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:08.023 19:12:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:08.023 19:12:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:26:08.023 Found net devices under 0000:86:00.1: cvl_0_1 00:26:08.023 19:12:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:08.023 19:12:24 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:08.023 19:12:24 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:08.023 19:12:24 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:08.023 19:12:24 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:08.023 19:12:24 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:08.023 19:12:24 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:08.023 19:12:24 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:08.023 19:12:24 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:08.023 19:12:24 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:08.023 19:12:24 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:08.023 19:12:24 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:08.023 19:12:24 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:08.023 19:12:24 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:08.023 19:12:24 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:08.023 19:12:24 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:08.023 19:12:24 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:08.023 19:12:24 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:08.023 19:12:24 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:08.023 19:12:24 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:08.023 19:12:24 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:08.023 19:12:24 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:08.023 19:12:24 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:08.023 19:12:24 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:08.023 19:12:24 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:08.023 19:12:24 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:08.023 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:08.023 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.411 ms 00:26:08.023 00:26:08.023 --- 10.0.0.2 ping statistics --- 00:26:08.023 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:08.023 rtt min/avg/max/mdev = 0.411/0.411/0.411/0.000 ms 00:26:08.023 19:12:24 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:08.023 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:08.023 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.219 ms 00:26:08.023 00:26:08.023 --- 10.0.0.1 ping statistics --- 00:26:08.023 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:08.023 rtt min/avg/max/mdev = 0.219/0.219/0.219/0.000 ms 00:26:08.023 19:12:24 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:08.023 19:12:24 -- nvmf/common.sh@410 -- # return 0 00:26:08.023 19:12:24 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:08.023 19:12:24 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:08.023 19:12:24 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:08.023 19:12:24 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:08.023 19:12:24 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:08.023 19:12:24 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:08.023 19:12:24 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:08.023 19:12:24 -- target/perf_adq.sh@88 -- # adq_configure_driver 00:26:08.023 19:12:24 -- target/perf_adq.sh@22 -- # ip netns exec cvl_0_0_ns_spdk ethtool --offload cvl_0_0 hw-tc-offload on 00:26:08.023 19:12:24 -- target/perf_adq.sh@24 -- # ip netns exec cvl_0_0_ns_spdk ethtool --set-priv-flags cvl_0_0 channel-pkt-inspect-optimize off 00:26:08.023 19:12:24 -- target/perf_adq.sh@26 -- # sysctl -w net.core.busy_poll=1 00:26:08.023 net.core.busy_poll = 1 00:26:08.023 19:12:24 -- target/perf_adq.sh@27 -- # sysctl -w net.core.busy_read=1 00:26:08.023 net.core.busy_read = 1 00:26:08.023 19:12:24 -- target/perf_adq.sh@29 -- # tc=/usr/sbin/tc 00:26:08.023 19:12:24 -- target/perf_adq.sh@31 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 root mqprio num_tc 2 map 0 1 queues 2@0 2@2 hw 1 mode channel 00:26:08.023 19:12:24 -- target/perf_adq.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 ingress 00:26:08.023 19:12:24 -- target/perf_adq.sh@35 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc filter add dev cvl_0_0 protocol ip parent ffff: prio 1 flower dst_ip 10.0.0.2/32 ip_proto tcp dst_port 4420 skip_sw hw_tc 1 00:26:08.023 19:12:24 -- target/perf_adq.sh@38 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/nvmf/set_xps_rxqs cvl_0_0 00:26:08.023 19:12:24 -- target/perf_adq.sh@89 -- # nvmfappstart -m 0xF --wait-for-rpc 00:26:08.023 19:12:24 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:08.023 19:12:24 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:08.023 19:12:24 -- common/autotest_common.sh@10 -- # set +x 00:26:08.023 19:12:24 -- nvmf/common.sh@469 -- # nvmfpid=3207984 00:26:08.023 19:12:24 -- nvmf/common.sh@470 -- # waitforlisten 3207984 00:26:08.023 19:12:24 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:26:08.023 19:12:24 -- common/autotest_common.sh@829 -- # '[' -z 3207984 ']' 00:26:08.023 19:12:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:08.023 19:12:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:08.023 19:12:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:08.023 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:08.023 19:12:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:08.023 19:12:24 -- common/autotest_common.sh@10 -- # set +x 00:26:08.023 [2024-11-26 19:12:24.824634] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:26:08.023 [2024-11-26 19:12:24.824675] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:08.023 EAL: No free 2048 kB hugepages reported on node 1 00:26:08.023 [2024-11-26 19:12:24.884253] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:26:08.023 [2024-11-26 19:12:24.923753] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:08.023 [2024-11-26 19:12:24.923867] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:08.023 [2024-11-26 19:12:24.923875] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:08.023 [2024-11-26 19:12:24.923882] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:08.023 [2024-11-26 19:12:24.923923] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:08.023 [2024-11-26 19:12:24.924042] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:26:08.023 [2024-11-26 19:12:24.924064] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:26:08.023 [2024-11-26 19:12:24.924066] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:08.282 19:12:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:08.282 19:12:24 -- common/autotest_common.sh@862 -- # return 0 00:26:08.282 19:12:24 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:08.282 19:12:24 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:08.282 19:12:24 -- common/autotest_common.sh@10 -- # set +x 00:26:08.282 19:12:24 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:08.282 19:12:25 -- target/perf_adq.sh@90 -- # adq_configure_nvmf_target 1 00:26:08.282 19:12:25 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 1 --enable-zerocopy-send-server -i posix 00:26:08.282 19:12:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:08.282 19:12:25 -- common/autotest_common.sh@10 -- # set +x 00:26:08.282 19:12:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:08.282 19:12:25 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:26:08.282 19:12:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:08.282 19:12:25 -- common/autotest_common.sh@10 -- # set +x 00:26:08.282 19:12:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:08.282 19:12:25 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 1 00:26:08.282 19:12:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:08.282 19:12:25 -- common/autotest_common.sh@10 -- # set +x 00:26:08.282 [2024-11-26 19:12:25.103026] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:08.282 19:12:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:08.282 19:12:25 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:26:08.282 19:12:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:08.282 19:12:25 -- common/autotest_common.sh@10 -- # set +x 00:26:08.282 Malloc1 00:26:08.282 19:12:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:08.282 19:12:25 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:26:08.282 19:12:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:08.282 19:12:25 -- common/autotest_common.sh@10 -- # set +x 00:26:08.282 19:12:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:08.282 19:12:25 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:26:08.282 19:12:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:08.282 19:12:25 -- common/autotest_common.sh@10 -- # set +x 00:26:08.282 19:12:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:08.282 19:12:25 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:08.282 19:12:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:08.282 19:12:25 -- common/autotest_common.sh@10 -- # set +x 00:26:08.283 [2024-11-26 19:12:25.150633] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:08.283 19:12:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:08.283 19:12:25 -- target/perf_adq.sh@94 -- # perfpid=3208013 00:26:08.283 19:12:25 -- target/perf_adq.sh@95 -- # sleep 2 00:26:08.283 19:12:25 -- target/perf_adq.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:26:08.283 EAL: No free 2048 kB hugepages reported on node 1 00:26:10.817 19:12:27 -- target/perf_adq.sh@97 -- # rpc_cmd nvmf_get_stats 00:26:10.817 19:12:27 -- target/perf_adq.sh@97 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 0) | length' 00:26:10.817 19:12:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:10.817 19:12:27 -- target/perf_adq.sh@97 -- # wc -l 00:26:10.817 19:12:27 -- common/autotest_common.sh@10 -- # set +x 00:26:10.817 19:12:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:10.817 19:12:27 -- target/perf_adq.sh@97 -- # count=2 00:26:10.817 19:12:27 -- target/perf_adq.sh@98 -- # [[ 2 -lt 2 ]] 00:26:10.817 19:12:27 -- target/perf_adq.sh@103 -- # wait 3208013 00:26:18.934 Initializing NVMe Controllers 00:26:18.934 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:18.934 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:26:18.934 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:26:18.934 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:26:18.934 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:26:18.934 Initialization complete. Launching workers. 00:26:18.934 ======================================================== 00:26:18.934 Latency(us) 00:26:18.934 Device Information : IOPS MiB/s Average min max 00:26:18.934 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 8924.50 34.86 7182.25 1016.22 52261.84 00:26:18.934 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 8047.50 31.44 7954.07 1256.48 51716.85 00:26:18.934 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 7731.30 30.20 8277.37 989.93 53684.63 00:26:18.934 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 8361.30 32.66 7655.75 947.30 51662.74 00:26:18.934 ======================================================== 00:26:18.934 Total : 33064.60 129.16 7745.90 947.30 53684.63 00:26:18.934 00:26:18.934 19:12:35 -- target/perf_adq.sh@104 -- # nvmftestfini 00:26:18.934 19:12:35 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:18.934 19:12:35 -- nvmf/common.sh@116 -- # sync 00:26:18.934 19:12:35 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:18.934 19:12:35 -- nvmf/common.sh@119 -- # set +e 00:26:18.934 19:12:35 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:18.934 19:12:35 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:18.934 rmmod nvme_tcp 00:26:18.934 rmmod nvme_fabrics 00:26:18.934 rmmod nvme_keyring 00:26:18.934 19:12:35 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:18.934 19:12:35 -- nvmf/common.sh@123 -- # set -e 00:26:18.934 19:12:35 -- nvmf/common.sh@124 -- # return 0 00:26:18.934 19:12:35 -- nvmf/common.sh@477 -- # '[' -n 3207984 ']' 00:26:18.934 19:12:35 -- nvmf/common.sh@478 -- # killprocess 3207984 00:26:18.934 19:12:35 -- common/autotest_common.sh@936 -- # '[' -z 3207984 ']' 00:26:18.934 19:12:35 -- common/autotest_common.sh@940 -- # kill -0 3207984 00:26:18.934 19:12:35 -- common/autotest_common.sh@941 -- # uname 00:26:18.934 19:12:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:18.934 19:12:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3207984 00:26:18.934 19:12:35 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:18.934 19:12:35 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:18.934 19:12:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3207984' 00:26:18.934 killing process with pid 3207984 00:26:18.934 19:12:35 -- common/autotest_common.sh@955 -- # kill 3207984 00:26:18.934 19:12:35 -- common/autotest_common.sh@960 -- # wait 3207984 00:26:18.934 19:12:35 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:18.934 19:12:35 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:18.934 19:12:35 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:18.934 19:12:35 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:18.934 19:12:35 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:18.934 19:12:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:18.934 19:12:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:18.934 19:12:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:22.223 19:12:38 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:22.223 19:12:38 -- target/perf_adq.sh@106 -- # trap - SIGINT SIGTERM EXIT 00:26:22.223 00:26:22.223 real 0m48.583s 00:26:22.223 user 2m42.054s 00:26:22.223 sys 0m10.129s 00:26:22.223 19:12:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:22.223 19:12:38 -- common/autotest_common.sh@10 -- # set +x 00:26:22.223 ************************************ 00:26:22.223 END TEST nvmf_perf_adq 00:26:22.223 ************************************ 00:26:22.223 19:12:38 -- nvmf/nvmf.sh@81 -- # run_test nvmf_shutdown /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:26:22.223 19:12:38 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:22.223 19:12:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:22.223 19:12:38 -- common/autotest_common.sh@10 -- # set +x 00:26:22.223 ************************************ 00:26:22.223 START TEST nvmf_shutdown 00:26:22.223 ************************************ 00:26:22.223 19:12:38 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:26:22.223 * Looking for test storage... 00:26:22.223 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:26:22.223 19:12:38 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:22.223 19:12:38 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:22.223 19:12:38 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:22.223 19:12:38 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:22.223 19:12:38 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:22.223 19:12:38 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:22.223 19:12:38 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:22.223 19:12:38 -- scripts/common.sh@335 -- # IFS=.-: 00:26:22.223 19:12:38 -- scripts/common.sh@335 -- # read -ra ver1 00:26:22.223 19:12:38 -- scripts/common.sh@336 -- # IFS=.-: 00:26:22.223 19:12:38 -- scripts/common.sh@336 -- # read -ra ver2 00:26:22.223 19:12:38 -- scripts/common.sh@337 -- # local 'op=<' 00:26:22.223 19:12:38 -- scripts/common.sh@339 -- # ver1_l=2 00:26:22.223 19:12:38 -- scripts/common.sh@340 -- # ver2_l=1 00:26:22.223 19:12:38 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:22.223 19:12:38 -- scripts/common.sh@343 -- # case "$op" in 00:26:22.223 19:12:38 -- scripts/common.sh@344 -- # : 1 00:26:22.223 19:12:38 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:22.223 19:12:38 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:22.223 19:12:38 -- scripts/common.sh@364 -- # decimal 1 00:26:22.223 19:12:38 -- scripts/common.sh@352 -- # local d=1 00:26:22.223 19:12:38 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:22.223 19:12:38 -- scripts/common.sh@354 -- # echo 1 00:26:22.223 19:12:38 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:22.223 19:12:38 -- scripts/common.sh@365 -- # decimal 2 00:26:22.223 19:12:38 -- scripts/common.sh@352 -- # local d=2 00:26:22.223 19:12:38 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:22.223 19:12:38 -- scripts/common.sh@354 -- # echo 2 00:26:22.223 19:12:38 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:22.223 19:12:38 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:22.223 19:12:38 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:22.223 19:12:38 -- scripts/common.sh@367 -- # return 0 00:26:22.223 19:12:38 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:22.223 19:12:38 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:22.223 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:22.223 --rc genhtml_branch_coverage=1 00:26:22.223 --rc genhtml_function_coverage=1 00:26:22.223 --rc genhtml_legend=1 00:26:22.223 --rc geninfo_all_blocks=1 00:26:22.223 --rc geninfo_unexecuted_blocks=1 00:26:22.223 00:26:22.223 ' 00:26:22.223 19:12:38 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:22.223 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:22.223 --rc genhtml_branch_coverage=1 00:26:22.223 --rc genhtml_function_coverage=1 00:26:22.223 --rc genhtml_legend=1 00:26:22.223 --rc geninfo_all_blocks=1 00:26:22.223 --rc geninfo_unexecuted_blocks=1 00:26:22.223 00:26:22.223 ' 00:26:22.223 19:12:38 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:22.223 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:22.223 --rc genhtml_branch_coverage=1 00:26:22.223 --rc genhtml_function_coverage=1 00:26:22.223 --rc genhtml_legend=1 00:26:22.223 --rc geninfo_all_blocks=1 00:26:22.223 --rc geninfo_unexecuted_blocks=1 00:26:22.223 00:26:22.223 ' 00:26:22.223 19:12:38 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:22.223 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:22.223 --rc genhtml_branch_coverage=1 00:26:22.223 --rc genhtml_function_coverage=1 00:26:22.223 --rc genhtml_legend=1 00:26:22.223 --rc geninfo_all_blocks=1 00:26:22.223 --rc geninfo_unexecuted_blocks=1 00:26:22.223 00:26:22.223 ' 00:26:22.224 19:12:38 -- target/shutdown.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:22.224 19:12:38 -- nvmf/common.sh@7 -- # uname -s 00:26:22.224 19:12:38 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:22.224 19:12:38 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:22.224 19:12:38 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:22.224 19:12:38 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:22.224 19:12:38 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:22.224 19:12:38 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:22.224 19:12:38 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:22.224 19:12:38 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:22.224 19:12:38 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:22.224 19:12:38 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:22.224 19:12:38 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:26:22.224 19:12:38 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:26:22.224 19:12:38 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:22.224 19:12:38 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:22.224 19:12:38 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:22.224 19:12:38 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:22.224 19:12:38 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:22.224 19:12:38 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:22.224 19:12:38 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:22.224 19:12:38 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:22.224 19:12:38 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:22.224 19:12:38 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:22.224 19:12:38 -- paths/export.sh@5 -- # export PATH 00:26:22.224 19:12:38 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:22.224 19:12:38 -- nvmf/common.sh@46 -- # : 0 00:26:22.224 19:12:38 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:22.224 19:12:38 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:22.224 19:12:38 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:22.224 19:12:38 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:22.224 19:12:38 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:22.224 19:12:38 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:22.224 19:12:38 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:22.224 19:12:38 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:22.224 19:12:38 -- target/shutdown.sh@11 -- # MALLOC_BDEV_SIZE=64 00:26:22.224 19:12:38 -- target/shutdown.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:26:22.224 19:12:38 -- target/shutdown.sh@146 -- # run_test nvmf_shutdown_tc1 nvmf_shutdown_tc1 00:26:22.224 19:12:38 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:26:22.224 19:12:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:22.224 19:12:38 -- common/autotest_common.sh@10 -- # set +x 00:26:22.224 ************************************ 00:26:22.224 START TEST nvmf_shutdown_tc1 00:26:22.224 ************************************ 00:26:22.224 19:12:38 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc1 00:26:22.224 19:12:38 -- target/shutdown.sh@74 -- # starttarget 00:26:22.224 19:12:38 -- target/shutdown.sh@15 -- # nvmftestinit 00:26:22.224 19:12:38 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:22.224 19:12:38 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:22.224 19:12:38 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:22.224 19:12:38 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:22.224 19:12:38 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:22.224 19:12:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:22.224 19:12:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:22.224 19:12:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:22.224 19:12:38 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:22.224 19:12:38 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:22.224 19:12:38 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:22.224 19:12:38 -- common/autotest_common.sh@10 -- # set +x 00:26:27.491 19:12:43 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:27.491 19:12:43 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:27.491 19:12:43 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:27.491 19:12:43 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:27.491 19:12:43 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:27.491 19:12:43 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:27.491 19:12:43 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:27.491 19:12:43 -- nvmf/common.sh@294 -- # net_devs=() 00:26:27.491 19:12:43 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:27.491 19:12:43 -- nvmf/common.sh@295 -- # e810=() 00:26:27.491 19:12:43 -- nvmf/common.sh@295 -- # local -ga e810 00:26:27.491 19:12:43 -- nvmf/common.sh@296 -- # x722=() 00:26:27.491 19:12:43 -- nvmf/common.sh@296 -- # local -ga x722 00:26:27.491 19:12:43 -- nvmf/common.sh@297 -- # mlx=() 00:26:27.491 19:12:43 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:27.491 19:12:43 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:27.491 19:12:43 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:27.491 19:12:43 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:27.491 19:12:43 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:27.491 19:12:43 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:27.491 19:12:43 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:27.491 19:12:43 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:27.491 19:12:43 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:27.491 19:12:43 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:27.491 19:12:43 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:27.491 19:12:43 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:27.491 19:12:43 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:27.491 19:12:43 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:27.491 19:12:43 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:27.491 19:12:43 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:27.491 19:12:43 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:27.491 19:12:43 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:27.491 19:12:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:27.491 19:12:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:26:27.491 Found 0000:86:00.0 (0x8086 - 0x159b) 00:26:27.491 19:12:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:27.491 19:12:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:27.491 19:12:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:27.491 19:12:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:27.491 19:12:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:27.491 19:12:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:27.491 19:12:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:26:27.491 Found 0000:86:00.1 (0x8086 - 0x159b) 00:26:27.491 19:12:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:27.491 19:12:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:27.491 19:12:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:27.491 19:12:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:27.491 19:12:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:27.491 19:12:43 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:27.491 19:12:43 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:27.491 19:12:43 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:27.491 19:12:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:27.491 19:12:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:27.491 19:12:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:27.491 19:12:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:27.491 19:12:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:26:27.491 Found net devices under 0000:86:00.0: cvl_0_0 00:26:27.491 19:12:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:27.491 19:12:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:27.491 19:12:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:27.491 19:12:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:27.491 19:12:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:27.491 19:12:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:26:27.491 Found net devices under 0000:86:00.1: cvl_0_1 00:26:27.491 19:12:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:27.491 19:12:43 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:27.491 19:12:43 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:27.491 19:12:43 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:27.491 19:12:43 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:27.491 19:12:43 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:27.491 19:12:43 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:27.491 19:12:43 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:27.491 19:12:43 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:27.491 19:12:43 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:27.491 19:12:43 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:27.491 19:12:43 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:27.491 19:12:43 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:27.491 19:12:43 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:27.491 19:12:43 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:27.491 19:12:43 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:27.491 19:12:43 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:27.491 19:12:43 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:27.491 19:12:43 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:27.491 19:12:43 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:27.491 19:12:43 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:27.491 19:12:43 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:27.491 19:12:44 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:27.491 19:12:44 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:27.491 19:12:44 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:27.491 19:12:44 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:27.491 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:27.491 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.334 ms 00:26:27.491 00:26:27.491 --- 10.0.0.2 ping statistics --- 00:26:27.491 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:27.491 rtt min/avg/max/mdev = 0.334/0.334/0.334/0.000 ms 00:26:27.491 19:12:44 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:27.491 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:27.491 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.221 ms 00:26:27.491 00:26:27.491 --- 10.0.0.1 ping statistics --- 00:26:27.491 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:27.491 rtt min/avg/max/mdev = 0.221/0.221/0.221/0.000 ms 00:26:27.491 19:12:44 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:27.491 19:12:44 -- nvmf/common.sh@410 -- # return 0 00:26:27.492 19:12:44 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:27.492 19:12:44 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:27.492 19:12:44 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:27.492 19:12:44 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:27.492 19:12:44 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:27.492 19:12:44 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:27.492 19:12:44 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:27.492 19:12:44 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:26:27.492 19:12:44 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:27.492 19:12:44 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:27.492 19:12:44 -- common/autotest_common.sh@10 -- # set +x 00:26:27.492 19:12:44 -- nvmf/common.sh@469 -- # nvmfpid=3213401 00:26:27.492 19:12:44 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:26:27.492 19:12:44 -- nvmf/common.sh@470 -- # waitforlisten 3213401 00:26:27.492 19:12:44 -- common/autotest_common.sh@829 -- # '[' -z 3213401 ']' 00:26:27.492 19:12:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:27.492 19:12:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:27.492 19:12:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:27.492 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:27.492 19:12:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:27.492 19:12:44 -- common/autotest_common.sh@10 -- # set +x 00:26:27.492 [2024-11-26 19:12:44.187443] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:26:27.492 [2024-11-26 19:12:44.187494] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:27.492 EAL: No free 2048 kB hugepages reported on node 1 00:26:27.492 [2024-11-26 19:12:44.247278] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:26:27.492 [2024-11-26 19:12:44.287888] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:27.492 [2024-11-26 19:12:44.288009] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:27.492 [2024-11-26 19:12:44.288017] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:27.492 [2024-11-26 19:12:44.288023] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:27.492 [2024-11-26 19:12:44.288121] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:26:27.492 [2024-11-26 19:12:44.288211] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:26:27.492 [2024-11-26 19:12:44.288321] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:27.492 [2024-11-26 19:12:44.288322] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:26:28.429 19:12:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:28.429 19:12:45 -- common/autotest_common.sh@862 -- # return 0 00:26:28.429 19:12:45 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:28.429 19:12:45 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:28.429 19:12:45 -- common/autotest_common.sh@10 -- # set +x 00:26:28.429 19:12:45 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:28.429 19:12:45 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:26:28.429 19:12:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:28.429 19:12:45 -- common/autotest_common.sh@10 -- # set +x 00:26:28.429 [2024-11-26 19:12:45.061520] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:28.429 19:12:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:28.429 19:12:45 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:26:28.429 19:12:45 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:26:28.429 19:12:45 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:28.429 19:12:45 -- common/autotest_common.sh@10 -- # set +x 00:26:28.429 19:12:45 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:26:28.429 19:12:45 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:28.429 19:12:45 -- target/shutdown.sh@28 -- # cat 00:26:28.429 19:12:45 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:28.429 19:12:45 -- target/shutdown.sh@28 -- # cat 00:26:28.429 19:12:45 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:28.429 19:12:45 -- target/shutdown.sh@28 -- # cat 00:26:28.429 19:12:45 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:28.429 19:12:45 -- target/shutdown.sh@28 -- # cat 00:26:28.429 19:12:45 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:28.429 19:12:45 -- target/shutdown.sh@28 -- # cat 00:26:28.429 19:12:45 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:28.429 19:12:45 -- target/shutdown.sh@28 -- # cat 00:26:28.429 19:12:45 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:28.429 19:12:45 -- target/shutdown.sh@28 -- # cat 00:26:28.429 19:12:45 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:28.429 19:12:45 -- target/shutdown.sh@28 -- # cat 00:26:28.429 19:12:45 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:28.429 19:12:45 -- target/shutdown.sh@28 -- # cat 00:26:28.429 19:12:45 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:28.429 19:12:45 -- target/shutdown.sh@28 -- # cat 00:26:28.429 19:12:45 -- target/shutdown.sh@35 -- # rpc_cmd 00:26:28.429 19:12:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:28.429 19:12:45 -- common/autotest_common.sh@10 -- # set +x 00:26:28.429 Malloc1 00:26:28.429 [2024-11-26 19:12:45.157231] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:28.429 Malloc2 00:26:28.429 Malloc3 00:26:28.429 Malloc4 00:26:28.429 Malloc5 00:26:28.429 Malloc6 00:26:28.688 Malloc7 00:26:28.688 Malloc8 00:26:28.688 Malloc9 00:26:28.688 Malloc10 00:26:28.688 19:12:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:28.688 19:12:45 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:26:28.688 19:12:45 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:28.688 19:12:45 -- common/autotest_common.sh@10 -- # set +x 00:26:28.688 19:12:45 -- target/shutdown.sh@78 -- # perfpid=3213689 00:26:28.688 19:12:45 -- target/shutdown.sh@79 -- # waitforlisten 3213689 /var/tmp/bdevperf.sock 00:26:28.688 19:12:45 -- common/autotest_common.sh@829 -- # '[' -z 3213689 ']' 00:26:28.688 19:12:45 -- target/shutdown.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json /dev/fd/63 00:26:28.688 19:12:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:26:28.688 19:12:45 -- target/shutdown.sh@77 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:26:28.688 19:12:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:28.688 19:12:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:26:28.688 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:26:28.688 19:12:45 -- nvmf/common.sh@520 -- # config=() 00:26:28.688 19:12:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:28.688 19:12:45 -- nvmf/common.sh@520 -- # local subsystem config 00:26:28.688 19:12:45 -- common/autotest_common.sh@10 -- # set +x 00:26:28.688 19:12:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:28.688 19:12:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:28.688 { 00:26:28.688 "params": { 00:26:28.688 "name": "Nvme$subsystem", 00:26:28.688 "trtype": "$TEST_TRANSPORT", 00:26:28.688 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:28.688 "adrfam": "ipv4", 00:26:28.688 "trsvcid": "$NVMF_PORT", 00:26:28.688 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:28.688 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:28.688 "hdgst": ${hdgst:-false}, 00:26:28.688 "ddgst": ${ddgst:-false} 00:26:28.688 }, 00:26:28.688 "method": "bdev_nvme_attach_controller" 00:26:28.688 } 00:26:28.688 EOF 00:26:28.688 )") 00:26:28.688 19:12:45 -- nvmf/common.sh@542 -- # cat 00:26:28.688 19:12:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:28.688 19:12:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:28.688 { 00:26:28.688 "params": { 00:26:28.688 "name": "Nvme$subsystem", 00:26:28.688 "trtype": "$TEST_TRANSPORT", 00:26:28.688 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:28.688 "adrfam": "ipv4", 00:26:28.688 "trsvcid": "$NVMF_PORT", 00:26:28.688 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:28.688 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:28.688 "hdgst": ${hdgst:-false}, 00:26:28.688 "ddgst": ${ddgst:-false} 00:26:28.688 }, 00:26:28.688 "method": "bdev_nvme_attach_controller" 00:26:28.688 } 00:26:28.688 EOF 00:26:28.688 )") 00:26:28.688 19:12:45 -- nvmf/common.sh@542 -- # cat 00:26:28.688 19:12:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:28.688 19:12:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:28.688 { 00:26:28.688 "params": { 00:26:28.688 "name": "Nvme$subsystem", 00:26:28.688 "trtype": "$TEST_TRANSPORT", 00:26:28.688 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:28.688 "adrfam": "ipv4", 00:26:28.688 "trsvcid": "$NVMF_PORT", 00:26:28.688 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:28.688 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:28.688 "hdgst": ${hdgst:-false}, 00:26:28.688 "ddgst": ${ddgst:-false} 00:26:28.688 }, 00:26:28.688 "method": "bdev_nvme_attach_controller" 00:26:28.688 } 00:26:28.688 EOF 00:26:28.688 )") 00:26:28.688 19:12:45 -- nvmf/common.sh@542 -- # cat 00:26:28.688 19:12:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:28.688 19:12:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:28.688 { 00:26:28.688 "params": { 00:26:28.688 "name": "Nvme$subsystem", 00:26:28.688 "trtype": "$TEST_TRANSPORT", 00:26:28.688 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:28.688 "adrfam": "ipv4", 00:26:28.688 "trsvcid": "$NVMF_PORT", 00:26:28.688 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:28.688 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:28.688 "hdgst": ${hdgst:-false}, 00:26:28.688 "ddgst": ${ddgst:-false} 00:26:28.688 }, 00:26:28.688 "method": "bdev_nvme_attach_controller" 00:26:28.688 } 00:26:28.688 EOF 00:26:28.688 )") 00:26:28.688 19:12:45 -- nvmf/common.sh@542 -- # cat 00:26:28.688 19:12:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:28.688 19:12:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:28.688 { 00:26:28.688 "params": { 00:26:28.688 "name": "Nvme$subsystem", 00:26:28.688 "trtype": "$TEST_TRANSPORT", 00:26:28.688 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:28.688 "adrfam": "ipv4", 00:26:28.688 "trsvcid": "$NVMF_PORT", 00:26:28.688 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:28.688 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:28.688 "hdgst": ${hdgst:-false}, 00:26:28.688 "ddgst": ${ddgst:-false} 00:26:28.688 }, 00:26:28.688 "method": "bdev_nvme_attach_controller" 00:26:28.688 } 00:26:28.688 EOF 00:26:28.688 )") 00:26:28.947 19:12:45 -- nvmf/common.sh@542 -- # cat 00:26:28.947 19:12:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:28.947 19:12:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:28.947 { 00:26:28.947 "params": { 00:26:28.947 "name": "Nvme$subsystem", 00:26:28.947 "trtype": "$TEST_TRANSPORT", 00:26:28.947 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:28.947 "adrfam": "ipv4", 00:26:28.947 "trsvcid": "$NVMF_PORT", 00:26:28.947 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:28.947 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:28.947 "hdgst": ${hdgst:-false}, 00:26:28.947 "ddgst": ${ddgst:-false} 00:26:28.947 }, 00:26:28.947 "method": "bdev_nvme_attach_controller" 00:26:28.947 } 00:26:28.947 EOF 00:26:28.947 )") 00:26:28.947 19:12:45 -- nvmf/common.sh@542 -- # cat 00:26:28.947 [2024-11-26 19:12:45.619913] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:26:28.947 [2024-11-26 19:12:45.619970] [ DPDK EAL parameters: bdev_svc -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:26:28.947 19:12:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:28.947 19:12:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:28.947 { 00:26:28.947 "params": { 00:26:28.947 "name": "Nvme$subsystem", 00:26:28.947 "trtype": "$TEST_TRANSPORT", 00:26:28.947 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:28.947 "adrfam": "ipv4", 00:26:28.947 "trsvcid": "$NVMF_PORT", 00:26:28.947 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:28.947 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:28.947 "hdgst": ${hdgst:-false}, 00:26:28.947 "ddgst": ${ddgst:-false} 00:26:28.947 }, 00:26:28.947 "method": "bdev_nvme_attach_controller" 00:26:28.947 } 00:26:28.947 EOF 00:26:28.947 )") 00:26:28.947 19:12:45 -- nvmf/common.sh@542 -- # cat 00:26:28.947 19:12:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:28.947 19:12:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:28.947 { 00:26:28.947 "params": { 00:26:28.947 "name": "Nvme$subsystem", 00:26:28.947 "trtype": "$TEST_TRANSPORT", 00:26:28.947 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:28.947 "adrfam": "ipv4", 00:26:28.947 "trsvcid": "$NVMF_PORT", 00:26:28.947 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:28.947 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:28.947 "hdgst": ${hdgst:-false}, 00:26:28.947 "ddgst": ${ddgst:-false} 00:26:28.947 }, 00:26:28.947 "method": "bdev_nvme_attach_controller" 00:26:28.947 } 00:26:28.947 EOF 00:26:28.947 )") 00:26:28.947 19:12:45 -- nvmf/common.sh@542 -- # cat 00:26:28.947 19:12:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:28.947 19:12:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:28.947 { 00:26:28.947 "params": { 00:26:28.947 "name": "Nvme$subsystem", 00:26:28.947 "trtype": "$TEST_TRANSPORT", 00:26:28.947 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:28.947 "adrfam": "ipv4", 00:26:28.947 "trsvcid": "$NVMF_PORT", 00:26:28.947 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:28.947 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:28.947 "hdgst": ${hdgst:-false}, 00:26:28.947 "ddgst": ${ddgst:-false} 00:26:28.947 }, 00:26:28.947 "method": "bdev_nvme_attach_controller" 00:26:28.947 } 00:26:28.947 EOF 00:26:28.947 )") 00:26:28.947 19:12:45 -- nvmf/common.sh@542 -- # cat 00:26:28.947 19:12:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:28.947 19:12:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:28.947 { 00:26:28.947 "params": { 00:26:28.947 "name": "Nvme$subsystem", 00:26:28.947 "trtype": "$TEST_TRANSPORT", 00:26:28.947 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:28.947 "adrfam": "ipv4", 00:26:28.947 "trsvcid": "$NVMF_PORT", 00:26:28.947 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:28.947 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:28.947 "hdgst": ${hdgst:-false}, 00:26:28.948 "ddgst": ${ddgst:-false} 00:26:28.948 }, 00:26:28.948 "method": "bdev_nvme_attach_controller" 00:26:28.948 } 00:26:28.948 EOF 00:26:28.948 )") 00:26:28.948 EAL: No free 2048 kB hugepages reported on node 1 00:26:28.948 19:12:45 -- nvmf/common.sh@542 -- # cat 00:26:28.948 19:12:45 -- nvmf/common.sh@544 -- # jq . 00:26:28.948 19:12:45 -- nvmf/common.sh@545 -- # IFS=, 00:26:28.948 19:12:45 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:26:28.948 "params": { 00:26:28.948 "name": "Nvme1", 00:26:28.948 "trtype": "tcp", 00:26:28.948 "traddr": "10.0.0.2", 00:26:28.948 "adrfam": "ipv4", 00:26:28.948 "trsvcid": "4420", 00:26:28.948 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:26:28.948 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:26:28.948 "hdgst": false, 00:26:28.948 "ddgst": false 00:26:28.948 }, 00:26:28.948 "method": "bdev_nvme_attach_controller" 00:26:28.948 },{ 00:26:28.948 "params": { 00:26:28.948 "name": "Nvme2", 00:26:28.948 "trtype": "tcp", 00:26:28.948 "traddr": "10.0.0.2", 00:26:28.948 "adrfam": "ipv4", 00:26:28.948 "trsvcid": "4420", 00:26:28.948 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:26:28.948 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:26:28.948 "hdgst": false, 00:26:28.948 "ddgst": false 00:26:28.948 }, 00:26:28.948 "method": "bdev_nvme_attach_controller" 00:26:28.948 },{ 00:26:28.948 "params": { 00:26:28.948 "name": "Nvme3", 00:26:28.948 "trtype": "tcp", 00:26:28.948 "traddr": "10.0.0.2", 00:26:28.948 "adrfam": "ipv4", 00:26:28.948 "trsvcid": "4420", 00:26:28.948 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:26:28.948 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:26:28.948 "hdgst": false, 00:26:28.948 "ddgst": false 00:26:28.948 }, 00:26:28.948 "method": "bdev_nvme_attach_controller" 00:26:28.948 },{ 00:26:28.948 "params": { 00:26:28.948 "name": "Nvme4", 00:26:28.948 "trtype": "tcp", 00:26:28.948 "traddr": "10.0.0.2", 00:26:28.948 "adrfam": "ipv4", 00:26:28.948 "trsvcid": "4420", 00:26:28.948 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:26:28.948 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:26:28.948 "hdgst": false, 00:26:28.948 "ddgst": false 00:26:28.948 }, 00:26:28.948 "method": "bdev_nvme_attach_controller" 00:26:28.948 },{ 00:26:28.948 "params": { 00:26:28.948 "name": "Nvme5", 00:26:28.948 "trtype": "tcp", 00:26:28.948 "traddr": "10.0.0.2", 00:26:28.948 "adrfam": "ipv4", 00:26:28.948 "trsvcid": "4420", 00:26:28.948 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:26:28.948 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:26:28.948 "hdgst": false, 00:26:28.948 "ddgst": false 00:26:28.948 }, 00:26:28.948 "method": "bdev_nvme_attach_controller" 00:26:28.948 },{ 00:26:28.948 "params": { 00:26:28.948 "name": "Nvme6", 00:26:28.948 "trtype": "tcp", 00:26:28.948 "traddr": "10.0.0.2", 00:26:28.948 "adrfam": "ipv4", 00:26:28.948 "trsvcid": "4420", 00:26:28.948 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:26:28.948 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:26:28.948 "hdgst": false, 00:26:28.948 "ddgst": false 00:26:28.948 }, 00:26:28.948 "method": "bdev_nvme_attach_controller" 00:26:28.948 },{ 00:26:28.948 "params": { 00:26:28.948 "name": "Nvme7", 00:26:28.948 "trtype": "tcp", 00:26:28.948 "traddr": "10.0.0.2", 00:26:28.948 "adrfam": "ipv4", 00:26:28.948 "trsvcid": "4420", 00:26:28.948 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:26:28.948 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:26:28.948 "hdgst": false, 00:26:28.948 "ddgst": false 00:26:28.948 }, 00:26:28.948 "method": "bdev_nvme_attach_controller" 00:26:28.948 },{ 00:26:28.948 "params": { 00:26:28.948 "name": "Nvme8", 00:26:28.948 "trtype": "tcp", 00:26:28.948 "traddr": "10.0.0.2", 00:26:28.948 "adrfam": "ipv4", 00:26:28.948 "trsvcid": "4420", 00:26:28.948 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:26:28.948 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:26:28.948 "hdgst": false, 00:26:28.948 "ddgst": false 00:26:28.948 }, 00:26:28.948 "method": "bdev_nvme_attach_controller" 00:26:28.948 },{ 00:26:28.948 "params": { 00:26:28.948 "name": "Nvme9", 00:26:28.948 "trtype": "tcp", 00:26:28.948 "traddr": "10.0.0.2", 00:26:28.948 "adrfam": "ipv4", 00:26:28.948 "trsvcid": "4420", 00:26:28.948 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:26:28.948 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:26:28.948 "hdgst": false, 00:26:28.948 "ddgst": false 00:26:28.948 }, 00:26:28.948 "method": "bdev_nvme_attach_controller" 00:26:28.948 },{ 00:26:28.948 "params": { 00:26:28.948 "name": "Nvme10", 00:26:28.948 "trtype": "tcp", 00:26:28.948 "traddr": "10.0.0.2", 00:26:28.948 "adrfam": "ipv4", 00:26:28.948 "trsvcid": "4420", 00:26:28.948 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:26:28.948 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:26:28.948 "hdgst": false, 00:26:28.948 "ddgst": false 00:26:28.948 }, 00:26:28.948 "method": "bdev_nvme_attach_controller" 00:26:28.948 }' 00:26:28.948 [2024-11-26 19:12:45.678619] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:28.948 [2024-11-26 19:12:45.716904] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:30.325 19:12:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:30.325 19:12:47 -- common/autotest_common.sh@862 -- # return 0 00:26:30.325 19:12:47 -- target/shutdown.sh@80 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:26:30.325 19:12:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:30.325 19:12:47 -- common/autotest_common.sh@10 -- # set +x 00:26:30.325 19:12:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:30.325 19:12:47 -- target/shutdown.sh@83 -- # kill -9 3213689 00:26:30.325 19:12:47 -- target/shutdown.sh@84 -- # rm -f /var/run/spdk_bdev1 00:26:30.325 19:12:47 -- target/shutdown.sh@87 -- # sleep 1 00:26:31.261 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 73: 3213689 Killed $rootdir/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "${num_subsystems[@]}") 00:26:31.261 19:12:48 -- target/shutdown.sh@88 -- # kill -0 3213401 00:26:31.261 19:12:48 -- target/shutdown.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:26:31.261 19:12:48 -- target/shutdown.sh@91 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:26:31.261 19:12:48 -- nvmf/common.sh@520 -- # config=() 00:26:31.261 19:12:48 -- nvmf/common.sh@520 -- # local subsystem config 00:26:31.261 19:12:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:31.261 19:12:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:31.261 { 00:26:31.261 "params": { 00:26:31.261 "name": "Nvme$subsystem", 00:26:31.261 "trtype": "$TEST_TRANSPORT", 00:26:31.261 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:31.261 "adrfam": "ipv4", 00:26:31.261 "trsvcid": "$NVMF_PORT", 00:26:31.261 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:31.261 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:31.261 "hdgst": ${hdgst:-false}, 00:26:31.261 "ddgst": ${ddgst:-false} 00:26:31.261 }, 00:26:31.261 "method": "bdev_nvme_attach_controller" 00:26:31.261 } 00:26:31.261 EOF 00:26:31.261 )") 00:26:31.261 19:12:48 -- nvmf/common.sh@542 -- # cat 00:26:31.261 19:12:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:31.261 19:12:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:31.261 { 00:26:31.261 "params": { 00:26:31.261 "name": "Nvme$subsystem", 00:26:31.261 "trtype": "$TEST_TRANSPORT", 00:26:31.261 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:31.261 "adrfam": "ipv4", 00:26:31.261 "trsvcid": "$NVMF_PORT", 00:26:31.261 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:31.261 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:31.261 "hdgst": ${hdgst:-false}, 00:26:31.261 "ddgst": ${ddgst:-false} 00:26:31.261 }, 00:26:31.261 "method": "bdev_nvme_attach_controller" 00:26:31.261 } 00:26:31.261 EOF 00:26:31.261 )") 00:26:31.261 19:12:48 -- nvmf/common.sh@542 -- # cat 00:26:31.261 19:12:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:31.261 19:12:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:31.261 { 00:26:31.261 "params": { 00:26:31.261 "name": "Nvme$subsystem", 00:26:31.261 "trtype": "$TEST_TRANSPORT", 00:26:31.261 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:31.261 "adrfam": "ipv4", 00:26:31.261 "trsvcid": "$NVMF_PORT", 00:26:31.261 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:31.261 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:31.261 "hdgst": ${hdgst:-false}, 00:26:31.261 "ddgst": ${ddgst:-false} 00:26:31.261 }, 00:26:31.261 "method": "bdev_nvme_attach_controller" 00:26:31.261 } 00:26:31.261 EOF 00:26:31.261 )") 00:26:31.261 19:12:48 -- nvmf/common.sh@542 -- # cat 00:26:31.261 19:12:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:31.261 19:12:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:31.261 { 00:26:31.261 "params": { 00:26:31.261 "name": "Nvme$subsystem", 00:26:31.261 "trtype": "$TEST_TRANSPORT", 00:26:31.261 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:31.261 "adrfam": "ipv4", 00:26:31.261 "trsvcid": "$NVMF_PORT", 00:26:31.261 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:31.261 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:31.261 "hdgst": ${hdgst:-false}, 00:26:31.261 "ddgst": ${ddgst:-false} 00:26:31.261 }, 00:26:31.261 "method": "bdev_nvme_attach_controller" 00:26:31.261 } 00:26:31.261 EOF 00:26:31.261 )") 00:26:31.261 19:12:48 -- nvmf/common.sh@542 -- # cat 00:26:31.520 19:12:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:31.520 19:12:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:31.520 { 00:26:31.520 "params": { 00:26:31.520 "name": "Nvme$subsystem", 00:26:31.520 "trtype": "$TEST_TRANSPORT", 00:26:31.520 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:31.520 "adrfam": "ipv4", 00:26:31.520 "trsvcid": "$NVMF_PORT", 00:26:31.520 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:31.520 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:31.520 "hdgst": ${hdgst:-false}, 00:26:31.520 "ddgst": ${ddgst:-false} 00:26:31.520 }, 00:26:31.520 "method": "bdev_nvme_attach_controller" 00:26:31.520 } 00:26:31.520 EOF 00:26:31.520 )") 00:26:31.520 19:12:48 -- nvmf/common.sh@542 -- # cat 00:26:31.520 19:12:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:31.520 19:12:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:31.520 { 00:26:31.520 "params": { 00:26:31.520 "name": "Nvme$subsystem", 00:26:31.520 "trtype": "$TEST_TRANSPORT", 00:26:31.520 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:31.520 "adrfam": "ipv4", 00:26:31.520 "trsvcid": "$NVMF_PORT", 00:26:31.520 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:31.520 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:31.520 "hdgst": ${hdgst:-false}, 00:26:31.520 "ddgst": ${ddgst:-false} 00:26:31.520 }, 00:26:31.520 "method": "bdev_nvme_attach_controller" 00:26:31.520 } 00:26:31.520 EOF 00:26:31.520 )") 00:26:31.520 19:12:48 -- nvmf/common.sh@542 -- # cat 00:26:31.520 [2024-11-26 19:12:48.200289] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:26:31.520 [2024-11-26 19:12:48.200338] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3214062 ] 00:26:31.520 19:12:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:31.520 19:12:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:31.520 { 00:26:31.520 "params": { 00:26:31.520 "name": "Nvme$subsystem", 00:26:31.520 "trtype": "$TEST_TRANSPORT", 00:26:31.520 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:31.520 "adrfam": "ipv4", 00:26:31.520 "trsvcid": "$NVMF_PORT", 00:26:31.520 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:31.520 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:31.520 "hdgst": ${hdgst:-false}, 00:26:31.520 "ddgst": ${ddgst:-false} 00:26:31.520 }, 00:26:31.520 "method": "bdev_nvme_attach_controller" 00:26:31.520 } 00:26:31.520 EOF 00:26:31.520 )") 00:26:31.520 19:12:48 -- nvmf/common.sh@542 -- # cat 00:26:31.520 19:12:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:31.520 19:12:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:31.520 { 00:26:31.520 "params": { 00:26:31.520 "name": "Nvme$subsystem", 00:26:31.520 "trtype": "$TEST_TRANSPORT", 00:26:31.520 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:31.520 "adrfam": "ipv4", 00:26:31.520 "trsvcid": "$NVMF_PORT", 00:26:31.520 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:31.520 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:31.520 "hdgst": ${hdgst:-false}, 00:26:31.520 "ddgst": ${ddgst:-false} 00:26:31.520 }, 00:26:31.520 "method": "bdev_nvme_attach_controller" 00:26:31.520 } 00:26:31.520 EOF 00:26:31.520 )") 00:26:31.520 19:12:48 -- nvmf/common.sh@542 -- # cat 00:26:31.520 19:12:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:31.520 19:12:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:31.520 { 00:26:31.520 "params": { 00:26:31.520 "name": "Nvme$subsystem", 00:26:31.520 "trtype": "$TEST_TRANSPORT", 00:26:31.520 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:31.520 "adrfam": "ipv4", 00:26:31.520 "trsvcid": "$NVMF_PORT", 00:26:31.520 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:31.520 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:31.520 "hdgst": ${hdgst:-false}, 00:26:31.520 "ddgst": ${ddgst:-false} 00:26:31.520 }, 00:26:31.520 "method": "bdev_nvme_attach_controller" 00:26:31.520 } 00:26:31.520 EOF 00:26:31.520 )") 00:26:31.520 19:12:48 -- nvmf/common.sh@542 -- # cat 00:26:31.520 19:12:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:31.520 19:12:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:31.520 { 00:26:31.520 "params": { 00:26:31.520 "name": "Nvme$subsystem", 00:26:31.521 "trtype": "$TEST_TRANSPORT", 00:26:31.521 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:31.521 "adrfam": "ipv4", 00:26:31.521 "trsvcid": "$NVMF_PORT", 00:26:31.521 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:31.521 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:31.521 "hdgst": ${hdgst:-false}, 00:26:31.521 "ddgst": ${ddgst:-false} 00:26:31.521 }, 00:26:31.521 "method": "bdev_nvme_attach_controller" 00:26:31.521 } 00:26:31.521 EOF 00:26:31.521 )") 00:26:31.521 19:12:48 -- nvmf/common.sh@542 -- # cat 00:26:31.521 19:12:48 -- nvmf/common.sh@544 -- # jq . 00:26:31.521 EAL: No free 2048 kB hugepages reported on node 1 00:26:31.521 19:12:48 -- nvmf/common.sh@545 -- # IFS=, 00:26:31.521 19:12:48 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:26:31.521 "params": { 00:26:31.521 "name": "Nvme1", 00:26:31.521 "trtype": "tcp", 00:26:31.521 "traddr": "10.0.0.2", 00:26:31.521 "adrfam": "ipv4", 00:26:31.521 "trsvcid": "4420", 00:26:31.521 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:26:31.521 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:26:31.521 "hdgst": false, 00:26:31.521 "ddgst": false 00:26:31.521 }, 00:26:31.521 "method": "bdev_nvme_attach_controller" 00:26:31.521 },{ 00:26:31.521 "params": { 00:26:31.521 "name": "Nvme2", 00:26:31.521 "trtype": "tcp", 00:26:31.521 "traddr": "10.0.0.2", 00:26:31.521 "adrfam": "ipv4", 00:26:31.521 "trsvcid": "4420", 00:26:31.521 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:26:31.521 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:26:31.521 "hdgst": false, 00:26:31.521 "ddgst": false 00:26:31.521 }, 00:26:31.521 "method": "bdev_nvme_attach_controller" 00:26:31.521 },{ 00:26:31.521 "params": { 00:26:31.521 "name": "Nvme3", 00:26:31.521 "trtype": "tcp", 00:26:31.521 "traddr": "10.0.0.2", 00:26:31.521 "adrfam": "ipv4", 00:26:31.521 "trsvcid": "4420", 00:26:31.521 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:26:31.521 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:26:31.521 "hdgst": false, 00:26:31.521 "ddgst": false 00:26:31.521 }, 00:26:31.521 "method": "bdev_nvme_attach_controller" 00:26:31.521 },{ 00:26:31.521 "params": { 00:26:31.521 "name": "Nvme4", 00:26:31.521 "trtype": "tcp", 00:26:31.521 "traddr": "10.0.0.2", 00:26:31.521 "adrfam": "ipv4", 00:26:31.521 "trsvcid": "4420", 00:26:31.521 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:26:31.521 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:26:31.521 "hdgst": false, 00:26:31.521 "ddgst": false 00:26:31.521 }, 00:26:31.521 "method": "bdev_nvme_attach_controller" 00:26:31.521 },{ 00:26:31.521 "params": { 00:26:31.521 "name": "Nvme5", 00:26:31.521 "trtype": "tcp", 00:26:31.521 "traddr": "10.0.0.2", 00:26:31.521 "adrfam": "ipv4", 00:26:31.521 "trsvcid": "4420", 00:26:31.521 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:26:31.521 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:26:31.521 "hdgst": false, 00:26:31.521 "ddgst": false 00:26:31.521 }, 00:26:31.521 "method": "bdev_nvme_attach_controller" 00:26:31.521 },{ 00:26:31.521 "params": { 00:26:31.521 "name": "Nvme6", 00:26:31.521 "trtype": "tcp", 00:26:31.521 "traddr": "10.0.0.2", 00:26:31.521 "adrfam": "ipv4", 00:26:31.521 "trsvcid": "4420", 00:26:31.521 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:26:31.521 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:26:31.521 "hdgst": false, 00:26:31.521 "ddgst": false 00:26:31.521 }, 00:26:31.521 "method": "bdev_nvme_attach_controller" 00:26:31.521 },{ 00:26:31.521 "params": { 00:26:31.521 "name": "Nvme7", 00:26:31.521 "trtype": "tcp", 00:26:31.521 "traddr": "10.0.0.2", 00:26:31.521 "adrfam": "ipv4", 00:26:31.521 "trsvcid": "4420", 00:26:31.521 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:26:31.521 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:26:31.521 "hdgst": false, 00:26:31.521 "ddgst": false 00:26:31.521 }, 00:26:31.521 "method": "bdev_nvme_attach_controller" 00:26:31.521 },{ 00:26:31.521 "params": { 00:26:31.521 "name": "Nvme8", 00:26:31.521 "trtype": "tcp", 00:26:31.521 "traddr": "10.0.0.2", 00:26:31.521 "adrfam": "ipv4", 00:26:31.521 "trsvcid": "4420", 00:26:31.521 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:26:31.521 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:26:31.521 "hdgst": false, 00:26:31.521 "ddgst": false 00:26:31.521 }, 00:26:31.521 "method": "bdev_nvme_attach_controller" 00:26:31.521 },{ 00:26:31.521 "params": { 00:26:31.521 "name": "Nvme9", 00:26:31.521 "trtype": "tcp", 00:26:31.521 "traddr": "10.0.0.2", 00:26:31.521 "adrfam": "ipv4", 00:26:31.521 "trsvcid": "4420", 00:26:31.521 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:26:31.521 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:26:31.521 "hdgst": false, 00:26:31.521 "ddgst": false 00:26:31.521 }, 00:26:31.521 "method": "bdev_nvme_attach_controller" 00:26:31.521 },{ 00:26:31.521 "params": { 00:26:31.521 "name": "Nvme10", 00:26:31.521 "trtype": "tcp", 00:26:31.521 "traddr": "10.0.0.2", 00:26:31.521 "adrfam": "ipv4", 00:26:31.521 "trsvcid": "4420", 00:26:31.521 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:26:31.521 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:26:31.521 "hdgst": false, 00:26:31.521 "ddgst": false 00:26:31.521 }, 00:26:31.521 "method": "bdev_nvme_attach_controller" 00:26:31.521 }' 00:26:31.521 [2024-11-26 19:12:48.259831] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:31.521 [2024-11-26 19:12:48.298350] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:32.902 Running I/O for 1 seconds... 00:26:34.277 00:26:34.277 Latency(us) 00:26:34.277 [2024-11-26T18:12:51.204Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:34.277 [2024-11-26T18:12:51.204Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:34.277 Verification LBA range: start 0x0 length 0x400 00:26:34.277 Nvme1n1 : 1.08 482.52 30.16 0.00 0.00 130643.28 16526.47 104401.70 00:26:34.277 [2024-11-26T18:12:51.204Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:34.277 Verification LBA range: start 0x0 length 0x400 00:26:34.277 Nvme2n1 : 1.06 455.76 28.49 0.00 0.00 136596.52 28721.86 117622.87 00:26:34.277 [2024-11-26T18:12:51.204Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:34.277 Verification LBA range: start 0x0 length 0x400 00:26:34.277 Nvme3n1 : 1.08 481.92 30.12 0.00 0.00 129245.88 15044.79 101666.28 00:26:34.277 [2024-11-26T18:12:51.204Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:34.277 Verification LBA range: start 0x0 length 0x400 00:26:34.277 Nvme4n1 : 1.08 481.24 30.08 0.00 0.00 128591.06 17438.27 98474.96 00:26:34.277 [2024-11-26T18:12:51.204Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:34.277 Verification LBA range: start 0x0 length 0x400 00:26:34.277 Nvme5n1 : 1.09 480.33 30.02 0.00 0.00 127993.46 18122.13 98019.06 00:26:34.277 [2024-11-26T18:12:51.204Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:34.277 Verification LBA range: start 0x0 length 0x400 00:26:34.277 Nvme6n1 : 1.09 479.48 29.97 0.00 0.00 127460.70 17894.18 99386.77 00:26:34.277 [2024-11-26T18:12:51.204Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:34.277 Verification LBA range: start 0x0 length 0x400 00:26:34.277 Nvme7n1 : 1.09 478.80 29.93 0.00 0.00 126900.86 17324.30 100754.48 00:26:34.277 [2024-11-26T18:12:51.204Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:34.277 Verification LBA range: start 0x0 length 0x400 00:26:34.277 Nvme8n1 : 1.09 477.61 29.85 0.00 0.00 126799.06 12537.32 105313.50 00:26:34.277 [2024-11-26T18:12:51.204Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:34.277 Verification LBA range: start 0x0 length 0x400 00:26:34.277 Nvme9n1 : 1.08 452.68 28.29 0.00 0.00 132171.33 3732.70 114431.55 00:26:34.277 [2024-11-26T18:12:51.204Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:34.277 Verification LBA range: start 0x0 length 0x400 00:26:34.277 Nvme10n1 : 1.13 470.73 29.42 0.00 0.00 122386.22 16754.42 134035.37 00:26:34.277 [2024-11-26T18:12:51.204Z] =================================================================================================================== 00:26:34.277 [2024-11-26T18:12:51.204Z] Total : 4741.08 296.32 0.00 0.00 128784.28 3732.70 134035.37 00:26:34.277 19:12:51 -- target/shutdown.sh@93 -- # stoptarget 00:26:34.277 19:12:51 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:26:34.277 19:12:51 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:26:34.277 19:12:51 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:26:34.277 19:12:51 -- target/shutdown.sh@45 -- # nvmftestfini 00:26:34.277 19:12:51 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:34.277 19:12:51 -- nvmf/common.sh@116 -- # sync 00:26:34.277 19:12:51 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:34.277 19:12:51 -- nvmf/common.sh@119 -- # set +e 00:26:34.277 19:12:51 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:34.277 19:12:51 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:34.277 rmmod nvme_tcp 00:26:34.277 rmmod nvme_fabrics 00:26:34.277 rmmod nvme_keyring 00:26:34.277 19:12:51 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:34.277 19:12:51 -- nvmf/common.sh@123 -- # set -e 00:26:34.277 19:12:51 -- nvmf/common.sh@124 -- # return 0 00:26:34.277 19:12:51 -- nvmf/common.sh@477 -- # '[' -n 3213401 ']' 00:26:34.277 19:12:51 -- nvmf/common.sh@478 -- # killprocess 3213401 00:26:34.277 19:12:51 -- common/autotest_common.sh@936 -- # '[' -z 3213401 ']' 00:26:34.277 19:12:51 -- common/autotest_common.sh@940 -- # kill -0 3213401 00:26:34.277 19:12:51 -- common/autotest_common.sh@941 -- # uname 00:26:34.277 19:12:51 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:34.277 19:12:51 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3213401 00:26:34.277 19:12:51 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:34.277 19:12:51 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:34.277 19:12:51 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3213401' 00:26:34.277 killing process with pid 3213401 00:26:34.277 19:12:51 -- common/autotest_common.sh@955 -- # kill 3213401 00:26:34.277 19:12:51 -- common/autotest_common.sh@960 -- # wait 3213401 00:26:34.845 19:12:51 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:34.845 19:12:51 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:34.845 19:12:51 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:34.845 19:12:51 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:34.845 19:12:51 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:34.845 19:12:51 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:34.845 19:12:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:34.845 19:12:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:36.746 19:12:53 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:36.746 00:26:36.746 real 0m14.658s 00:26:36.746 user 0m34.488s 00:26:36.746 sys 0m5.259s 00:26:36.746 19:12:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:36.746 19:12:53 -- common/autotest_common.sh@10 -- # set +x 00:26:36.746 ************************************ 00:26:36.746 END TEST nvmf_shutdown_tc1 00:26:36.746 ************************************ 00:26:36.746 19:12:53 -- target/shutdown.sh@147 -- # run_test nvmf_shutdown_tc2 nvmf_shutdown_tc2 00:26:36.746 19:12:53 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:26:36.746 19:12:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:36.746 19:12:53 -- common/autotest_common.sh@10 -- # set +x 00:26:36.746 ************************************ 00:26:36.746 START TEST nvmf_shutdown_tc2 00:26:36.746 ************************************ 00:26:36.746 19:12:53 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc2 00:26:36.746 19:12:53 -- target/shutdown.sh@98 -- # starttarget 00:26:36.746 19:12:53 -- target/shutdown.sh@15 -- # nvmftestinit 00:26:36.746 19:12:53 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:36.746 19:12:53 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:36.746 19:12:53 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:36.746 19:12:53 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:36.746 19:12:53 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:37.004 19:12:53 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:37.004 19:12:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:37.004 19:12:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:37.004 19:12:53 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:37.004 19:12:53 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:37.004 19:12:53 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:37.004 19:12:53 -- common/autotest_common.sh@10 -- # set +x 00:26:37.004 19:12:53 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:37.004 19:12:53 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:37.004 19:12:53 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:37.004 19:12:53 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:37.004 19:12:53 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:37.004 19:12:53 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:37.004 19:12:53 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:37.004 19:12:53 -- nvmf/common.sh@294 -- # net_devs=() 00:26:37.004 19:12:53 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:37.004 19:12:53 -- nvmf/common.sh@295 -- # e810=() 00:26:37.004 19:12:53 -- nvmf/common.sh@295 -- # local -ga e810 00:26:37.004 19:12:53 -- nvmf/common.sh@296 -- # x722=() 00:26:37.004 19:12:53 -- nvmf/common.sh@296 -- # local -ga x722 00:26:37.004 19:12:53 -- nvmf/common.sh@297 -- # mlx=() 00:26:37.004 19:12:53 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:37.004 19:12:53 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:37.004 19:12:53 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:37.004 19:12:53 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:37.004 19:12:53 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:37.004 19:12:53 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:37.005 19:12:53 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:37.005 19:12:53 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:37.005 19:12:53 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:37.005 19:12:53 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:37.005 19:12:53 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:37.005 19:12:53 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:37.005 19:12:53 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:37.005 19:12:53 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:37.005 19:12:53 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:37.005 19:12:53 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:37.005 19:12:53 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:37.005 19:12:53 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:37.005 19:12:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:37.005 19:12:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:26:37.005 Found 0000:86:00.0 (0x8086 - 0x159b) 00:26:37.005 19:12:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:37.005 19:12:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:37.005 19:12:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:37.005 19:12:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:37.005 19:12:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:37.005 19:12:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:37.005 19:12:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:26:37.005 Found 0000:86:00.1 (0x8086 - 0x159b) 00:26:37.005 19:12:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:37.005 19:12:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:37.005 19:12:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:37.005 19:12:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:37.005 19:12:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:37.005 19:12:53 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:37.005 19:12:53 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:37.005 19:12:53 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:37.005 19:12:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:37.005 19:12:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:37.005 19:12:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:37.005 19:12:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:37.005 19:12:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:26:37.005 Found net devices under 0000:86:00.0: cvl_0_0 00:26:37.005 19:12:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:37.005 19:12:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:37.005 19:12:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:37.005 19:12:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:37.005 19:12:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:37.005 19:12:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:26:37.005 Found net devices under 0000:86:00.1: cvl_0_1 00:26:37.005 19:12:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:37.005 19:12:53 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:37.005 19:12:53 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:37.005 19:12:53 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:37.005 19:12:53 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:37.005 19:12:53 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:37.005 19:12:53 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:37.005 19:12:53 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:37.005 19:12:53 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:37.005 19:12:53 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:37.005 19:12:53 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:37.005 19:12:53 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:37.005 19:12:53 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:37.005 19:12:53 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:37.005 19:12:53 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:37.005 19:12:53 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:37.005 19:12:53 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:37.005 19:12:53 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:37.005 19:12:53 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:37.005 19:12:53 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:37.005 19:12:53 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:37.005 19:12:53 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:37.005 19:12:53 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:37.005 19:12:53 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:37.005 19:12:53 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:37.005 19:12:53 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:37.005 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:37.005 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.400 ms 00:26:37.005 00:26:37.005 --- 10.0.0.2 ping statistics --- 00:26:37.005 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:37.005 rtt min/avg/max/mdev = 0.400/0.400/0.400/0.000 ms 00:26:37.005 19:12:53 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:37.005 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:37.005 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.219 ms 00:26:37.005 00:26:37.005 --- 10.0.0.1 ping statistics --- 00:26:37.005 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:37.005 rtt min/avg/max/mdev = 0.219/0.219/0.219/0.000 ms 00:26:37.005 19:12:53 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:37.005 19:12:53 -- nvmf/common.sh@410 -- # return 0 00:26:37.005 19:12:53 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:37.005 19:12:53 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:37.005 19:12:53 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:37.005 19:12:53 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:37.005 19:12:53 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:37.005 19:12:53 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:37.005 19:12:53 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:37.264 19:12:53 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:26:37.264 19:12:53 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:37.264 19:12:53 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:37.264 19:12:53 -- common/autotest_common.sh@10 -- # set +x 00:26:37.264 19:12:53 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:26:37.264 19:12:53 -- nvmf/common.sh@469 -- # nvmfpid=3215106 00:26:37.264 19:12:53 -- nvmf/common.sh@470 -- # waitforlisten 3215106 00:26:37.264 19:12:53 -- common/autotest_common.sh@829 -- # '[' -z 3215106 ']' 00:26:37.264 19:12:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:37.264 19:12:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:37.264 19:12:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:37.264 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:37.264 19:12:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:37.264 19:12:53 -- common/autotest_common.sh@10 -- # set +x 00:26:37.264 [2024-11-26 19:12:54.009448] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:26:37.264 [2024-11-26 19:12:54.009493] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:37.264 EAL: No free 2048 kB hugepages reported on node 1 00:26:37.264 [2024-11-26 19:12:54.067262] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:26:37.264 [2024-11-26 19:12:54.105888] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:37.264 [2024-11-26 19:12:54.106014] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:37.264 [2024-11-26 19:12:54.106024] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:37.264 [2024-11-26 19:12:54.106031] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:37.264 [2024-11-26 19:12:54.106134] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:26:37.264 [2024-11-26 19:12:54.106219] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:26:37.264 [2024-11-26 19:12:54.106330] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:37.264 [2024-11-26 19:12:54.106331] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:26:38.198 19:12:54 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:38.198 19:12:54 -- common/autotest_common.sh@862 -- # return 0 00:26:38.198 19:12:54 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:38.198 19:12:54 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:38.198 19:12:54 -- common/autotest_common.sh@10 -- # set +x 00:26:38.198 19:12:54 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:38.198 19:12:54 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:26:38.198 19:12:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:38.198 19:12:54 -- common/autotest_common.sh@10 -- # set +x 00:26:38.198 [2024-11-26 19:12:54.888511] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:38.198 19:12:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:38.198 19:12:54 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:26:38.198 19:12:54 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:26:38.198 19:12:54 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:38.198 19:12:54 -- common/autotest_common.sh@10 -- # set +x 00:26:38.198 19:12:54 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:26:38.198 19:12:54 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:38.198 19:12:54 -- target/shutdown.sh@28 -- # cat 00:26:38.198 19:12:54 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:38.198 19:12:54 -- target/shutdown.sh@28 -- # cat 00:26:38.198 19:12:54 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:38.198 19:12:54 -- target/shutdown.sh@28 -- # cat 00:26:38.198 19:12:54 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:38.198 19:12:54 -- target/shutdown.sh@28 -- # cat 00:26:38.199 19:12:54 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:38.199 19:12:54 -- target/shutdown.sh@28 -- # cat 00:26:38.199 19:12:54 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:38.199 19:12:54 -- target/shutdown.sh@28 -- # cat 00:26:38.199 19:12:54 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:38.199 19:12:54 -- target/shutdown.sh@28 -- # cat 00:26:38.199 19:12:54 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:38.199 19:12:54 -- target/shutdown.sh@28 -- # cat 00:26:38.199 19:12:54 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:38.199 19:12:54 -- target/shutdown.sh@28 -- # cat 00:26:38.199 19:12:54 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:38.199 19:12:54 -- target/shutdown.sh@28 -- # cat 00:26:38.199 19:12:54 -- target/shutdown.sh@35 -- # rpc_cmd 00:26:38.199 19:12:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:38.199 19:12:54 -- common/autotest_common.sh@10 -- # set +x 00:26:38.199 Malloc1 00:26:38.199 [2024-11-26 19:12:54.984246] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:38.199 Malloc2 00:26:38.199 Malloc3 00:26:38.199 Malloc4 00:26:38.457 Malloc5 00:26:38.457 Malloc6 00:26:38.457 Malloc7 00:26:38.457 Malloc8 00:26:38.457 Malloc9 00:26:38.457 Malloc10 00:26:38.457 19:12:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:38.457 19:12:55 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:26:38.457 19:12:55 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:38.457 19:12:55 -- common/autotest_common.sh@10 -- # set +x 00:26:38.716 19:12:55 -- target/shutdown.sh@102 -- # perfpid=3215391 00:26:38.716 19:12:55 -- target/shutdown.sh@103 -- # waitforlisten 3215391 /var/tmp/bdevperf.sock 00:26:38.716 19:12:55 -- common/autotest_common.sh@829 -- # '[' -z 3215391 ']' 00:26:38.716 19:12:55 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:26:38.716 19:12:55 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:38.716 19:12:55 -- target/shutdown.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:26:38.716 19:12:55 -- target/shutdown.sh@101 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:26:38.716 19:12:55 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:26:38.716 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:26:38.716 19:12:55 -- nvmf/common.sh@520 -- # config=() 00:26:38.716 19:12:55 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:38.716 19:12:55 -- nvmf/common.sh@520 -- # local subsystem config 00:26:38.716 19:12:55 -- common/autotest_common.sh@10 -- # set +x 00:26:38.716 19:12:55 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:38.716 19:12:55 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:38.716 { 00:26:38.716 "params": { 00:26:38.716 "name": "Nvme$subsystem", 00:26:38.716 "trtype": "$TEST_TRANSPORT", 00:26:38.716 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:38.716 "adrfam": "ipv4", 00:26:38.716 "trsvcid": "$NVMF_PORT", 00:26:38.716 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:38.716 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:38.716 "hdgst": ${hdgst:-false}, 00:26:38.716 "ddgst": ${ddgst:-false} 00:26:38.716 }, 00:26:38.716 "method": "bdev_nvme_attach_controller" 00:26:38.716 } 00:26:38.716 EOF 00:26:38.716 )") 00:26:38.716 19:12:55 -- nvmf/common.sh@542 -- # cat 00:26:38.716 19:12:55 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:38.716 19:12:55 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:38.716 { 00:26:38.716 "params": { 00:26:38.716 "name": "Nvme$subsystem", 00:26:38.716 "trtype": "$TEST_TRANSPORT", 00:26:38.716 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:38.716 "adrfam": "ipv4", 00:26:38.716 "trsvcid": "$NVMF_PORT", 00:26:38.716 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:38.716 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:38.716 "hdgst": ${hdgst:-false}, 00:26:38.716 "ddgst": ${ddgst:-false} 00:26:38.716 }, 00:26:38.716 "method": "bdev_nvme_attach_controller" 00:26:38.716 } 00:26:38.716 EOF 00:26:38.716 )") 00:26:38.716 19:12:55 -- nvmf/common.sh@542 -- # cat 00:26:38.716 19:12:55 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:38.716 19:12:55 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:38.716 { 00:26:38.716 "params": { 00:26:38.716 "name": "Nvme$subsystem", 00:26:38.716 "trtype": "$TEST_TRANSPORT", 00:26:38.716 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:38.716 "adrfam": "ipv4", 00:26:38.716 "trsvcid": "$NVMF_PORT", 00:26:38.716 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:38.716 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:38.716 "hdgst": ${hdgst:-false}, 00:26:38.716 "ddgst": ${ddgst:-false} 00:26:38.716 }, 00:26:38.716 "method": "bdev_nvme_attach_controller" 00:26:38.716 } 00:26:38.716 EOF 00:26:38.716 )") 00:26:38.716 19:12:55 -- nvmf/common.sh@542 -- # cat 00:26:38.716 19:12:55 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:38.716 19:12:55 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:38.716 { 00:26:38.716 "params": { 00:26:38.716 "name": "Nvme$subsystem", 00:26:38.716 "trtype": "$TEST_TRANSPORT", 00:26:38.716 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:38.716 "adrfam": "ipv4", 00:26:38.716 "trsvcid": "$NVMF_PORT", 00:26:38.716 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:38.716 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:38.716 "hdgst": ${hdgst:-false}, 00:26:38.716 "ddgst": ${ddgst:-false} 00:26:38.716 }, 00:26:38.716 "method": "bdev_nvme_attach_controller" 00:26:38.716 } 00:26:38.716 EOF 00:26:38.716 )") 00:26:38.716 19:12:55 -- nvmf/common.sh@542 -- # cat 00:26:38.716 19:12:55 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:38.716 19:12:55 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:38.716 { 00:26:38.716 "params": { 00:26:38.716 "name": "Nvme$subsystem", 00:26:38.716 "trtype": "$TEST_TRANSPORT", 00:26:38.716 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:38.716 "adrfam": "ipv4", 00:26:38.716 "trsvcid": "$NVMF_PORT", 00:26:38.716 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:38.716 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:38.716 "hdgst": ${hdgst:-false}, 00:26:38.716 "ddgst": ${ddgst:-false} 00:26:38.716 }, 00:26:38.716 "method": "bdev_nvme_attach_controller" 00:26:38.716 } 00:26:38.716 EOF 00:26:38.716 )") 00:26:38.716 19:12:55 -- nvmf/common.sh@542 -- # cat 00:26:38.716 19:12:55 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:38.716 19:12:55 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:38.716 { 00:26:38.716 "params": { 00:26:38.717 "name": "Nvme$subsystem", 00:26:38.717 "trtype": "$TEST_TRANSPORT", 00:26:38.717 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:38.717 "adrfam": "ipv4", 00:26:38.717 "trsvcid": "$NVMF_PORT", 00:26:38.717 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:38.717 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:38.717 "hdgst": ${hdgst:-false}, 00:26:38.717 "ddgst": ${ddgst:-false} 00:26:38.717 }, 00:26:38.717 "method": "bdev_nvme_attach_controller" 00:26:38.717 } 00:26:38.717 EOF 00:26:38.717 )") 00:26:38.717 19:12:55 -- nvmf/common.sh@542 -- # cat 00:26:38.717 [2024-11-26 19:12:55.449853] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:26:38.717 [2024-11-26 19:12:55.449900] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3215391 ] 00:26:38.717 19:12:55 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:38.717 19:12:55 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:38.717 { 00:26:38.717 "params": { 00:26:38.717 "name": "Nvme$subsystem", 00:26:38.717 "trtype": "$TEST_TRANSPORT", 00:26:38.717 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:38.717 "adrfam": "ipv4", 00:26:38.717 "trsvcid": "$NVMF_PORT", 00:26:38.717 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:38.717 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:38.717 "hdgst": ${hdgst:-false}, 00:26:38.717 "ddgst": ${ddgst:-false} 00:26:38.717 }, 00:26:38.717 "method": "bdev_nvme_attach_controller" 00:26:38.717 } 00:26:38.717 EOF 00:26:38.717 )") 00:26:38.717 19:12:55 -- nvmf/common.sh@542 -- # cat 00:26:38.717 19:12:55 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:38.717 19:12:55 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:38.717 { 00:26:38.717 "params": { 00:26:38.717 "name": "Nvme$subsystem", 00:26:38.717 "trtype": "$TEST_TRANSPORT", 00:26:38.717 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:38.717 "adrfam": "ipv4", 00:26:38.717 "trsvcid": "$NVMF_PORT", 00:26:38.717 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:38.717 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:38.717 "hdgst": ${hdgst:-false}, 00:26:38.717 "ddgst": ${ddgst:-false} 00:26:38.717 }, 00:26:38.717 "method": "bdev_nvme_attach_controller" 00:26:38.717 } 00:26:38.717 EOF 00:26:38.717 )") 00:26:38.717 19:12:55 -- nvmf/common.sh@542 -- # cat 00:26:38.717 19:12:55 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:38.717 19:12:55 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:38.717 { 00:26:38.717 "params": { 00:26:38.717 "name": "Nvme$subsystem", 00:26:38.717 "trtype": "$TEST_TRANSPORT", 00:26:38.717 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:38.717 "adrfam": "ipv4", 00:26:38.717 "trsvcid": "$NVMF_PORT", 00:26:38.717 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:38.717 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:38.717 "hdgst": ${hdgst:-false}, 00:26:38.717 "ddgst": ${ddgst:-false} 00:26:38.717 }, 00:26:38.717 "method": "bdev_nvme_attach_controller" 00:26:38.717 } 00:26:38.717 EOF 00:26:38.717 )") 00:26:38.717 19:12:55 -- nvmf/common.sh@542 -- # cat 00:26:38.717 19:12:55 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:38.717 19:12:55 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:38.717 { 00:26:38.717 "params": { 00:26:38.717 "name": "Nvme$subsystem", 00:26:38.717 "trtype": "$TEST_TRANSPORT", 00:26:38.717 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:38.717 "adrfam": "ipv4", 00:26:38.717 "trsvcid": "$NVMF_PORT", 00:26:38.717 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:38.717 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:38.717 "hdgst": ${hdgst:-false}, 00:26:38.717 "ddgst": ${ddgst:-false} 00:26:38.717 }, 00:26:38.717 "method": "bdev_nvme_attach_controller" 00:26:38.717 } 00:26:38.717 EOF 00:26:38.717 )") 00:26:38.717 EAL: No free 2048 kB hugepages reported on node 1 00:26:38.717 19:12:55 -- nvmf/common.sh@542 -- # cat 00:26:38.717 19:12:55 -- nvmf/common.sh@544 -- # jq . 00:26:38.717 19:12:55 -- nvmf/common.sh@545 -- # IFS=, 00:26:38.717 19:12:55 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:26:38.717 "params": { 00:26:38.717 "name": "Nvme1", 00:26:38.717 "trtype": "tcp", 00:26:38.717 "traddr": "10.0.0.2", 00:26:38.717 "adrfam": "ipv4", 00:26:38.717 "trsvcid": "4420", 00:26:38.717 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:26:38.717 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:26:38.717 "hdgst": false, 00:26:38.717 "ddgst": false 00:26:38.717 }, 00:26:38.717 "method": "bdev_nvme_attach_controller" 00:26:38.717 },{ 00:26:38.717 "params": { 00:26:38.717 "name": "Nvme2", 00:26:38.717 "trtype": "tcp", 00:26:38.717 "traddr": "10.0.0.2", 00:26:38.717 "adrfam": "ipv4", 00:26:38.717 "trsvcid": "4420", 00:26:38.717 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:26:38.717 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:26:38.717 "hdgst": false, 00:26:38.717 "ddgst": false 00:26:38.717 }, 00:26:38.717 "method": "bdev_nvme_attach_controller" 00:26:38.717 },{ 00:26:38.717 "params": { 00:26:38.717 "name": "Nvme3", 00:26:38.717 "trtype": "tcp", 00:26:38.717 "traddr": "10.0.0.2", 00:26:38.717 "adrfam": "ipv4", 00:26:38.717 "trsvcid": "4420", 00:26:38.717 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:26:38.717 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:26:38.717 "hdgst": false, 00:26:38.717 "ddgst": false 00:26:38.717 }, 00:26:38.717 "method": "bdev_nvme_attach_controller" 00:26:38.717 },{ 00:26:38.717 "params": { 00:26:38.717 "name": "Nvme4", 00:26:38.717 "trtype": "tcp", 00:26:38.717 "traddr": "10.0.0.2", 00:26:38.717 "adrfam": "ipv4", 00:26:38.717 "trsvcid": "4420", 00:26:38.717 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:26:38.717 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:26:38.717 "hdgst": false, 00:26:38.717 "ddgst": false 00:26:38.717 }, 00:26:38.717 "method": "bdev_nvme_attach_controller" 00:26:38.717 },{ 00:26:38.717 "params": { 00:26:38.717 "name": "Nvme5", 00:26:38.717 "trtype": "tcp", 00:26:38.717 "traddr": "10.0.0.2", 00:26:38.717 "adrfam": "ipv4", 00:26:38.717 "trsvcid": "4420", 00:26:38.717 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:26:38.717 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:26:38.717 "hdgst": false, 00:26:38.717 "ddgst": false 00:26:38.717 }, 00:26:38.717 "method": "bdev_nvme_attach_controller" 00:26:38.717 },{ 00:26:38.717 "params": { 00:26:38.717 "name": "Nvme6", 00:26:38.717 "trtype": "tcp", 00:26:38.717 "traddr": "10.0.0.2", 00:26:38.717 "adrfam": "ipv4", 00:26:38.717 "trsvcid": "4420", 00:26:38.717 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:26:38.717 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:26:38.717 "hdgst": false, 00:26:38.717 "ddgst": false 00:26:38.717 }, 00:26:38.717 "method": "bdev_nvme_attach_controller" 00:26:38.717 },{ 00:26:38.717 "params": { 00:26:38.717 "name": "Nvme7", 00:26:38.717 "trtype": "tcp", 00:26:38.717 "traddr": "10.0.0.2", 00:26:38.717 "adrfam": "ipv4", 00:26:38.717 "trsvcid": "4420", 00:26:38.717 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:26:38.717 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:26:38.717 "hdgst": false, 00:26:38.717 "ddgst": false 00:26:38.717 }, 00:26:38.717 "method": "bdev_nvme_attach_controller" 00:26:38.717 },{ 00:26:38.717 "params": { 00:26:38.717 "name": "Nvme8", 00:26:38.717 "trtype": "tcp", 00:26:38.717 "traddr": "10.0.0.2", 00:26:38.717 "adrfam": "ipv4", 00:26:38.717 "trsvcid": "4420", 00:26:38.717 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:26:38.717 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:26:38.717 "hdgst": false, 00:26:38.717 "ddgst": false 00:26:38.717 }, 00:26:38.717 "method": "bdev_nvme_attach_controller" 00:26:38.717 },{ 00:26:38.717 "params": { 00:26:38.717 "name": "Nvme9", 00:26:38.717 "trtype": "tcp", 00:26:38.717 "traddr": "10.0.0.2", 00:26:38.717 "adrfam": "ipv4", 00:26:38.717 "trsvcid": "4420", 00:26:38.717 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:26:38.717 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:26:38.717 "hdgst": false, 00:26:38.717 "ddgst": false 00:26:38.717 }, 00:26:38.717 "method": "bdev_nvme_attach_controller" 00:26:38.717 },{ 00:26:38.717 "params": { 00:26:38.717 "name": "Nvme10", 00:26:38.717 "trtype": "tcp", 00:26:38.717 "traddr": "10.0.0.2", 00:26:38.717 "adrfam": "ipv4", 00:26:38.717 "trsvcid": "4420", 00:26:38.717 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:26:38.717 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:26:38.717 "hdgst": false, 00:26:38.717 "ddgst": false 00:26:38.717 }, 00:26:38.717 "method": "bdev_nvme_attach_controller" 00:26:38.717 }' 00:26:38.717 [2024-11-26 19:12:55.507669] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:38.717 [2024-11-26 19:12:55.546195] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:40.130 Running I/O for 10 seconds... 00:26:40.130 19:12:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:40.130 19:12:56 -- common/autotest_common.sh@862 -- # return 0 00:26:40.130 19:12:56 -- target/shutdown.sh@104 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:26:40.130 19:12:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:40.130 19:12:56 -- common/autotest_common.sh@10 -- # set +x 00:26:40.130 19:12:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:40.130 19:12:57 -- target/shutdown.sh@106 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:26:40.130 19:12:57 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:26:40.130 19:12:57 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:26:40.130 19:12:57 -- target/shutdown.sh@57 -- # local ret=1 00:26:40.130 19:12:57 -- target/shutdown.sh@58 -- # local i 00:26:40.130 19:12:57 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:26:40.130 19:12:57 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:26:40.130 19:12:57 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:26:40.130 19:12:57 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:26:40.130 19:12:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:40.130 19:12:57 -- common/autotest_common.sh@10 -- # set +x 00:26:40.418 19:12:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:40.418 19:12:57 -- target/shutdown.sh@60 -- # read_io_count=42 00:26:40.418 19:12:57 -- target/shutdown.sh@63 -- # '[' 42 -ge 100 ']' 00:26:40.418 19:12:57 -- target/shutdown.sh@67 -- # sleep 0.25 00:26:40.418 19:12:57 -- target/shutdown.sh@59 -- # (( i-- )) 00:26:40.418 19:12:57 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:26:40.418 19:12:57 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:26:40.419 19:12:57 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:26:40.419 19:12:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:40.419 19:12:57 -- common/autotest_common.sh@10 -- # set +x 00:26:40.715 19:12:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:40.715 19:12:57 -- target/shutdown.sh@60 -- # read_io_count=167 00:26:40.715 19:12:57 -- target/shutdown.sh@63 -- # '[' 167 -ge 100 ']' 00:26:40.715 19:12:57 -- target/shutdown.sh@64 -- # ret=0 00:26:40.715 19:12:57 -- target/shutdown.sh@65 -- # break 00:26:40.715 19:12:57 -- target/shutdown.sh@69 -- # return 0 00:26:40.715 19:12:57 -- target/shutdown.sh@109 -- # killprocess 3215391 00:26:40.715 19:12:57 -- common/autotest_common.sh@936 -- # '[' -z 3215391 ']' 00:26:40.715 19:12:57 -- common/autotest_common.sh@940 -- # kill -0 3215391 00:26:40.715 19:12:57 -- common/autotest_common.sh@941 -- # uname 00:26:40.715 19:12:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:40.715 19:12:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3215391 00:26:40.715 19:12:57 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:40.715 19:12:57 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:40.715 19:12:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3215391' 00:26:40.715 killing process with pid 3215391 00:26:40.715 19:12:57 -- common/autotest_common.sh@955 -- # kill 3215391 00:26:40.715 19:12:57 -- common/autotest_common.sh@960 -- # wait 3215391 00:26:40.715 Received shutdown signal, test time was about 0.615562 seconds 00:26:40.715 00:26:40.715 Latency(us) 00:26:40.715 [2024-11-26T18:12:57.642Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:40.715 [2024-11-26T18:12:57.642Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:40.715 Verification LBA range: start 0x0 length 0x400 00:26:40.715 Nvme1n1 : 0.58 547.08 34.19 0.00 0.00 115249.65 6724.56 98019.06 00:26:40.715 [2024-11-26T18:12:57.642Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:40.715 Verification LBA range: start 0x0 length 0x400 00:26:40.715 Nvme2n1 : 0.57 481.25 30.08 0.00 0.00 127262.41 19717.79 113063.85 00:26:40.715 [2024-11-26T18:12:57.642Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:40.715 Verification LBA range: start 0x0 length 0x400 00:26:40.715 Nvme3n1 : 0.56 489.38 30.59 0.00 0.00 123702.34 18122.13 96651.35 00:26:40.715 [2024-11-26T18:12:57.642Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:40.715 Verification LBA range: start 0x0 length 0x400 00:26:40.715 Nvme4n1 : 0.56 488.05 30.50 0.00 0.00 122680.75 18236.10 95739.55 00:26:40.715 [2024-11-26T18:12:57.642Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:40.715 Verification LBA range: start 0x0 length 0x400 00:26:40.715 Nvme5n1 : 0.56 485.70 30.36 0.00 0.00 121612.65 19033.93 96195.45 00:26:40.715 [2024-11-26T18:12:57.642Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:40.715 Verification LBA range: start 0x0 length 0x400 00:26:40.715 Nvme6n1 : 0.56 484.50 30.28 0.00 0.00 120588.13 18122.13 98474.96 00:26:40.715 [2024-11-26T18:12:57.642Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:40.715 Verification LBA range: start 0x0 length 0x400 00:26:40.715 Nvme7n1 : 0.57 479.36 29.96 0.00 0.00 120354.31 18464.06 97107.26 00:26:40.715 [2024-11-26T18:12:57.642Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:40.715 Verification LBA range: start 0x0 length 0x400 00:26:40.715 Nvme8n1 : 0.57 476.53 29.78 0.00 0.00 119820.89 18122.13 99386.77 00:26:40.715 [2024-11-26T18:12:57.642Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:40.715 Verification LBA range: start 0x0 length 0x400 00:26:40.715 Nvme9n1 : 0.57 475.28 29.70 0.00 0.00 118646.77 16640.45 102578.09 00:26:40.715 [2024-11-26T18:12:57.642Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:40.715 Verification LBA range: start 0x0 length 0x400 00:26:40.715 Nvme10n1 : 0.61 442.34 27.65 0.00 0.00 119158.93 11340.58 102578.09 00:26:40.715 [2024-11-26T18:12:57.642Z] =================================================================================================================== 00:26:40.715 [2024-11-26T18:12:57.642Z] Total : 4849.47 303.09 0.00 0.00 120819.63 6724.56 113063.85 00:26:40.978 19:12:57 -- target/shutdown.sh@112 -- # sleep 1 00:26:41.914 19:12:58 -- target/shutdown.sh@113 -- # kill -0 3215106 00:26:41.914 19:12:58 -- target/shutdown.sh@115 -- # stoptarget 00:26:41.914 19:12:58 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:26:41.914 19:12:58 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:26:41.914 19:12:58 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:26:41.914 19:12:58 -- target/shutdown.sh@45 -- # nvmftestfini 00:26:41.914 19:12:58 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:41.914 19:12:58 -- nvmf/common.sh@116 -- # sync 00:26:41.914 19:12:58 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:41.914 19:12:58 -- nvmf/common.sh@119 -- # set +e 00:26:41.914 19:12:58 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:41.914 19:12:58 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:41.914 rmmod nvme_tcp 00:26:41.914 rmmod nvme_fabrics 00:26:41.914 rmmod nvme_keyring 00:26:41.914 19:12:58 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:41.914 19:12:58 -- nvmf/common.sh@123 -- # set -e 00:26:41.914 19:12:58 -- nvmf/common.sh@124 -- # return 0 00:26:41.914 19:12:58 -- nvmf/common.sh@477 -- # '[' -n 3215106 ']' 00:26:41.914 19:12:58 -- nvmf/common.sh@478 -- # killprocess 3215106 00:26:41.914 19:12:58 -- common/autotest_common.sh@936 -- # '[' -z 3215106 ']' 00:26:41.914 19:12:58 -- common/autotest_common.sh@940 -- # kill -0 3215106 00:26:41.914 19:12:58 -- common/autotest_common.sh@941 -- # uname 00:26:41.914 19:12:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:41.914 19:12:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3215106 00:26:42.173 19:12:58 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:42.173 19:12:58 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:42.173 19:12:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3215106' 00:26:42.173 killing process with pid 3215106 00:26:42.173 19:12:58 -- common/autotest_common.sh@955 -- # kill 3215106 00:26:42.173 19:12:58 -- common/autotest_common.sh@960 -- # wait 3215106 00:26:42.432 19:12:59 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:42.432 19:12:59 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:42.432 19:12:59 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:42.432 19:12:59 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:42.432 19:12:59 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:42.432 19:12:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:42.432 19:12:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:42.432 19:12:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:44.974 19:13:01 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:44.974 00:26:44.974 real 0m7.636s 00:26:44.974 user 0m22.907s 00:26:44.974 sys 0m1.263s 00:26:44.974 19:13:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:44.974 19:13:01 -- common/autotest_common.sh@10 -- # set +x 00:26:44.974 ************************************ 00:26:44.974 END TEST nvmf_shutdown_tc2 00:26:44.974 ************************************ 00:26:44.974 19:13:01 -- target/shutdown.sh@148 -- # run_test nvmf_shutdown_tc3 nvmf_shutdown_tc3 00:26:44.974 19:13:01 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:26:44.974 19:13:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:44.974 19:13:01 -- common/autotest_common.sh@10 -- # set +x 00:26:44.974 ************************************ 00:26:44.974 START TEST nvmf_shutdown_tc3 00:26:44.974 ************************************ 00:26:44.974 19:13:01 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc3 00:26:44.974 19:13:01 -- target/shutdown.sh@120 -- # starttarget 00:26:44.974 19:13:01 -- target/shutdown.sh@15 -- # nvmftestinit 00:26:44.974 19:13:01 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:44.974 19:13:01 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:44.974 19:13:01 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:44.974 19:13:01 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:44.974 19:13:01 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:44.974 19:13:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:44.974 19:13:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:44.974 19:13:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:44.975 19:13:01 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:44.975 19:13:01 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:44.975 19:13:01 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:44.975 19:13:01 -- common/autotest_common.sh@10 -- # set +x 00:26:44.975 19:13:01 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:44.975 19:13:01 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:44.975 19:13:01 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:44.975 19:13:01 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:44.975 19:13:01 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:44.975 19:13:01 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:44.975 19:13:01 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:44.975 19:13:01 -- nvmf/common.sh@294 -- # net_devs=() 00:26:44.975 19:13:01 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:44.975 19:13:01 -- nvmf/common.sh@295 -- # e810=() 00:26:44.975 19:13:01 -- nvmf/common.sh@295 -- # local -ga e810 00:26:44.975 19:13:01 -- nvmf/common.sh@296 -- # x722=() 00:26:44.975 19:13:01 -- nvmf/common.sh@296 -- # local -ga x722 00:26:44.975 19:13:01 -- nvmf/common.sh@297 -- # mlx=() 00:26:44.975 19:13:01 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:44.975 19:13:01 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:44.975 19:13:01 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:44.975 19:13:01 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:44.975 19:13:01 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:44.975 19:13:01 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:44.975 19:13:01 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:44.975 19:13:01 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:44.975 19:13:01 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:44.975 19:13:01 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:44.975 19:13:01 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:44.975 19:13:01 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:44.975 19:13:01 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:44.975 19:13:01 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:44.975 19:13:01 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:44.975 19:13:01 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:44.975 19:13:01 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:44.975 19:13:01 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:44.975 19:13:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:44.975 19:13:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:26:44.975 Found 0000:86:00.0 (0x8086 - 0x159b) 00:26:44.975 19:13:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:44.975 19:13:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:44.975 19:13:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:44.975 19:13:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:44.975 19:13:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:44.975 19:13:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:44.975 19:13:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:26:44.975 Found 0000:86:00.1 (0x8086 - 0x159b) 00:26:44.975 19:13:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:44.975 19:13:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:44.975 19:13:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:44.975 19:13:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:44.975 19:13:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:44.975 19:13:01 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:44.975 19:13:01 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:44.975 19:13:01 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:44.975 19:13:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:44.975 19:13:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:44.975 19:13:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:44.975 19:13:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:44.975 19:13:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:26:44.975 Found net devices under 0000:86:00.0: cvl_0_0 00:26:44.975 19:13:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:44.975 19:13:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:44.975 19:13:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:44.975 19:13:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:44.975 19:13:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:44.975 19:13:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:26:44.975 Found net devices under 0000:86:00.1: cvl_0_1 00:26:44.975 19:13:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:44.975 19:13:01 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:44.975 19:13:01 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:44.975 19:13:01 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:44.975 19:13:01 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:44.975 19:13:01 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:44.975 19:13:01 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:44.975 19:13:01 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:44.975 19:13:01 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:44.975 19:13:01 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:44.975 19:13:01 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:44.975 19:13:01 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:44.975 19:13:01 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:44.975 19:13:01 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:44.975 19:13:01 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:44.975 19:13:01 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:44.975 19:13:01 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:44.975 19:13:01 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:44.975 19:13:01 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:44.975 19:13:01 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:44.975 19:13:01 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:44.975 19:13:01 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:44.975 19:13:01 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:44.975 19:13:01 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:44.975 19:13:01 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:44.975 19:13:01 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:44.975 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:44.975 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.389 ms 00:26:44.975 00:26:44.975 --- 10.0.0.2 ping statistics --- 00:26:44.975 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:44.975 rtt min/avg/max/mdev = 0.389/0.389/0.389/0.000 ms 00:26:44.975 19:13:01 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:44.975 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:44.975 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.193 ms 00:26:44.975 00:26:44.975 --- 10.0.0.1 ping statistics --- 00:26:44.975 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:44.975 rtt min/avg/max/mdev = 0.193/0.193/0.193/0.000 ms 00:26:44.975 19:13:01 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:44.975 19:13:01 -- nvmf/common.sh@410 -- # return 0 00:26:44.975 19:13:01 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:44.975 19:13:01 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:44.975 19:13:01 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:44.975 19:13:01 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:44.975 19:13:01 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:44.975 19:13:01 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:44.975 19:13:01 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:44.975 19:13:01 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:26:44.975 19:13:01 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:44.975 19:13:01 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:44.975 19:13:01 -- common/autotest_common.sh@10 -- # set +x 00:26:44.975 19:13:01 -- nvmf/common.sh@469 -- # nvmfpid=3216664 00:26:44.975 19:13:01 -- nvmf/common.sh@470 -- # waitforlisten 3216664 00:26:44.975 19:13:01 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:26:44.975 19:13:01 -- common/autotest_common.sh@829 -- # '[' -z 3216664 ']' 00:26:44.975 19:13:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:44.975 19:13:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:44.975 19:13:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:44.975 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:44.975 19:13:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:44.975 19:13:01 -- common/autotest_common.sh@10 -- # set +x 00:26:44.975 [2024-11-26 19:13:01.678847] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:26:44.975 [2024-11-26 19:13:01.678888] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:44.975 EAL: No free 2048 kB hugepages reported on node 1 00:26:44.975 [2024-11-26 19:13:01.738115] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:26:44.975 [2024-11-26 19:13:01.777694] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:44.975 [2024-11-26 19:13:01.777809] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:44.975 [2024-11-26 19:13:01.777817] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:44.975 [2024-11-26 19:13:01.777823] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:44.975 [2024-11-26 19:13:01.777925] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:26:44.975 [2024-11-26 19:13:01.778009] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:26:44.975 [2024-11-26 19:13:01.778116] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:44.975 [2024-11-26 19:13:01.778117] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:26:45.910 19:13:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:45.910 19:13:02 -- common/autotest_common.sh@862 -- # return 0 00:26:45.910 19:13:02 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:45.910 19:13:02 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:45.910 19:13:02 -- common/autotest_common.sh@10 -- # set +x 00:26:45.911 19:13:02 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:45.911 19:13:02 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:26:45.911 19:13:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:45.911 19:13:02 -- common/autotest_common.sh@10 -- # set +x 00:26:45.911 [2024-11-26 19:13:02.543445] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:45.911 19:13:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:45.911 19:13:02 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:26:45.911 19:13:02 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:26:45.911 19:13:02 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:45.911 19:13:02 -- common/autotest_common.sh@10 -- # set +x 00:26:45.911 19:13:02 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:26:45.911 19:13:02 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:45.911 19:13:02 -- target/shutdown.sh@28 -- # cat 00:26:45.911 19:13:02 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:45.911 19:13:02 -- target/shutdown.sh@28 -- # cat 00:26:45.911 19:13:02 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:45.911 19:13:02 -- target/shutdown.sh@28 -- # cat 00:26:45.911 19:13:02 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:45.911 19:13:02 -- target/shutdown.sh@28 -- # cat 00:26:45.911 19:13:02 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:45.911 19:13:02 -- target/shutdown.sh@28 -- # cat 00:26:45.911 19:13:02 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:45.911 19:13:02 -- target/shutdown.sh@28 -- # cat 00:26:45.911 19:13:02 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:45.911 19:13:02 -- target/shutdown.sh@28 -- # cat 00:26:45.911 19:13:02 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:45.911 19:13:02 -- target/shutdown.sh@28 -- # cat 00:26:45.911 19:13:02 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:45.911 19:13:02 -- target/shutdown.sh@28 -- # cat 00:26:45.911 19:13:02 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:45.911 19:13:02 -- target/shutdown.sh@28 -- # cat 00:26:45.911 19:13:02 -- target/shutdown.sh@35 -- # rpc_cmd 00:26:45.911 19:13:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:45.911 19:13:02 -- common/autotest_common.sh@10 -- # set +x 00:26:45.911 Malloc1 00:26:45.911 [2024-11-26 19:13:02.639535] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:45.911 Malloc2 00:26:45.911 Malloc3 00:26:45.911 Malloc4 00:26:45.911 Malloc5 00:26:45.911 Malloc6 00:26:46.169 Malloc7 00:26:46.170 Malloc8 00:26:46.170 Malloc9 00:26:46.170 Malloc10 00:26:46.170 19:13:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:46.170 19:13:03 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:26:46.170 19:13:03 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:46.170 19:13:03 -- common/autotest_common.sh@10 -- # set +x 00:26:46.170 19:13:03 -- target/shutdown.sh@124 -- # perfpid=3216953 00:26:46.170 19:13:03 -- target/shutdown.sh@125 -- # waitforlisten 3216953 /var/tmp/bdevperf.sock 00:26:46.170 19:13:03 -- common/autotest_common.sh@829 -- # '[' -z 3216953 ']' 00:26:46.170 19:13:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:26:46.170 19:13:03 -- target/shutdown.sh@123 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:26:46.170 19:13:03 -- target/shutdown.sh@123 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:26:46.170 19:13:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:46.170 19:13:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:26:46.170 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:26:46.170 19:13:03 -- nvmf/common.sh@520 -- # config=() 00:26:46.170 19:13:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:46.170 19:13:03 -- nvmf/common.sh@520 -- # local subsystem config 00:26:46.170 19:13:03 -- common/autotest_common.sh@10 -- # set +x 00:26:46.170 19:13:03 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:46.170 19:13:03 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:46.170 { 00:26:46.170 "params": { 00:26:46.170 "name": "Nvme$subsystem", 00:26:46.170 "trtype": "$TEST_TRANSPORT", 00:26:46.170 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:46.170 "adrfam": "ipv4", 00:26:46.170 "trsvcid": "$NVMF_PORT", 00:26:46.170 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:46.170 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:46.170 "hdgst": ${hdgst:-false}, 00:26:46.170 "ddgst": ${ddgst:-false} 00:26:46.170 }, 00:26:46.170 "method": "bdev_nvme_attach_controller" 00:26:46.170 } 00:26:46.170 EOF 00:26:46.170 )") 00:26:46.170 19:13:03 -- nvmf/common.sh@542 -- # cat 00:26:46.170 19:13:03 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:46.170 19:13:03 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:46.170 { 00:26:46.170 "params": { 00:26:46.170 "name": "Nvme$subsystem", 00:26:46.170 "trtype": "$TEST_TRANSPORT", 00:26:46.170 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:46.170 "adrfam": "ipv4", 00:26:46.170 "trsvcid": "$NVMF_PORT", 00:26:46.170 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:46.170 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:46.170 "hdgst": ${hdgst:-false}, 00:26:46.170 "ddgst": ${ddgst:-false} 00:26:46.170 }, 00:26:46.170 "method": "bdev_nvme_attach_controller" 00:26:46.170 } 00:26:46.170 EOF 00:26:46.170 )") 00:26:46.170 19:13:03 -- nvmf/common.sh@542 -- # cat 00:26:46.170 19:13:03 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:46.170 19:13:03 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:46.170 { 00:26:46.170 "params": { 00:26:46.170 "name": "Nvme$subsystem", 00:26:46.170 "trtype": "$TEST_TRANSPORT", 00:26:46.170 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:46.170 "adrfam": "ipv4", 00:26:46.170 "trsvcid": "$NVMF_PORT", 00:26:46.170 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:46.170 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:46.170 "hdgst": ${hdgst:-false}, 00:26:46.170 "ddgst": ${ddgst:-false} 00:26:46.170 }, 00:26:46.170 "method": "bdev_nvme_attach_controller" 00:26:46.170 } 00:26:46.170 EOF 00:26:46.170 )") 00:26:46.170 19:13:03 -- nvmf/common.sh@542 -- # cat 00:26:46.170 19:13:03 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:46.170 19:13:03 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:46.170 { 00:26:46.170 "params": { 00:26:46.170 "name": "Nvme$subsystem", 00:26:46.170 "trtype": "$TEST_TRANSPORT", 00:26:46.170 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:46.170 "adrfam": "ipv4", 00:26:46.170 "trsvcid": "$NVMF_PORT", 00:26:46.170 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:46.170 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:46.170 "hdgst": ${hdgst:-false}, 00:26:46.170 "ddgst": ${ddgst:-false} 00:26:46.170 }, 00:26:46.170 "method": "bdev_nvme_attach_controller" 00:26:46.170 } 00:26:46.170 EOF 00:26:46.170 )") 00:26:46.429 19:13:03 -- nvmf/common.sh@542 -- # cat 00:26:46.429 19:13:03 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:46.429 19:13:03 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:46.429 { 00:26:46.429 "params": { 00:26:46.429 "name": "Nvme$subsystem", 00:26:46.429 "trtype": "$TEST_TRANSPORT", 00:26:46.429 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:46.429 "adrfam": "ipv4", 00:26:46.429 "trsvcid": "$NVMF_PORT", 00:26:46.429 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:46.429 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:46.429 "hdgst": ${hdgst:-false}, 00:26:46.429 "ddgst": ${ddgst:-false} 00:26:46.429 }, 00:26:46.429 "method": "bdev_nvme_attach_controller" 00:26:46.429 } 00:26:46.429 EOF 00:26:46.429 )") 00:26:46.429 19:13:03 -- nvmf/common.sh@542 -- # cat 00:26:46.429 19:13:03 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:46.429 19:13:03 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:46.429 { 00:26:46.429 "params": { 00:26:46.429 "name": "Nvme$subsystem", 00:26:46.429 "trtype": "$TEST_TRANSPORT", 00:26:46.429 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:46.429 "adrfam": "ipv4", 00:26:46.429 "trsvcid": "$NVMF_PORT", 00:26:46.429 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:46.429 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:46.429 "hdgst": ${hdgst:-false}, 00:26:46.429 "ddgst": ${ddgst:-false} 00:26:46.429 }, 00:26:46.429 "method": "bdev_nvme_attach_controller" 00:26:46.429 } 00:26:46.429 EOF 00:26:46.429 )") 00:26:46.429 19:13:03 -- nvmf/common.sh@542 -- # cat 00:26:46.429 [2024-11-26 19:13:03.107835] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:26:46.429 [2024-11-26 19:13:03.107883] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3216953 ] 00:26:46.429 19:13:03 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:46.429 19:13:03 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:46.429 { 00:26:46.429 "params": { 00:26:46.429 "name": "Nvme$subsystem", 00:26:46.429 "trtype": "$TEST_TRANSPORT", 00:26:46.429 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:46.429 "adrfam": "ipv4", 00:26:46.429 "trsvcid": "$NVMF_PORT", 00:26:46.429 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:46.429 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:46.429 "hdgst": ${hdgst:-false}, 00:26:46.429 "ddgst": ${ddgst:-false} 00:26:46.429 }, 00:26:46.429 "method": "bdev_nvme_attach_controller" 00:26:46.429 } 00:26:46.429 EOF 00:26:46.429 )") 00:26:46.429 19:13:03 -- nvmf/common.sh@542 -- # cat 00:26:46.429 19:13:03 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:46.429 19:13:03 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:46.429 { 00:26:46.429 "params": { 00:26:46.429 "name": "Nvme$subsystem", 00:26:46.429 "trtype": "$TEST_TRANSPORT", 00:26:46.430 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:46.430 "adrfam": "ipv4", 00:26:46.430 "trsvcid": "$NVMF_PORT", 00:26:46.430 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:46.430 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:46.430 "hdgst": ${hdgst:-false}, 00:26:46.430 "ddgst": ${ddgst:-false} 00:26:46.430 }, 00:26:46.430 "method": "bdev_nvme_attach_controller" 00:26:46.430 } 00:26:46.430 EOF 00:26:46.430 )") 00:26:46.430 19:13:03 -- nvmf/common.sh@542 -- # cat 00:26:46.430 19:13:03 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:46.430 19:13:03 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:46.430 { 00:26:46.430 "params": { 00:26:46.430 "name": "Nvme$subsystem", 00:26:46.430 "trtype": "$TEST_TRANSPORT", 00:26:46.430 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:46.430 "adrfam": "ipv4", 00:26:46.430 "trsvcid": "$NVMF_PORT", 00:26:46.430 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:46.430 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:46.430 "hdgst": ${hdgst:-false}, 00:26:46.430 "ddgst": ${ddgst:-false} 00:26:46.430 }, 00:26:46.430 "method": "bdev_nvme_attach_controller" 00:26:46.430 } 00:26:46.430 EOF 00:26:46.430 )") 00:26:46.430 19:13:03 -- nvmf/common.sh@542 -- # cat 00:26:46.430 19:13:03 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:46.430 19:13:03 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:46.430 { 00:26:46.430 "params": { 00:26:46.430 "name": "Nvme$subsystem", 00:26:46.430 "trtype": "$TEST_TRANSPORT", 00:26:46.430 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:46.430 "adrfam": "ipv4", 00:26:46.430 "trsvcid": "$NVMF_PORT", 00:26:46.430 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:46.430 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:46.430 "hdgst": ${hdgst:-false}, 00:26:46.430 "ddgst": ${ddgst:-false} 00:26:46.430 }, 00:26:46.430 "method": "bdev_nvme_attach_controller" 00:26:46.430 } 00:26:46.430 EOF 00:26:46.430 )") 00:26:46.430 EAL: No free 2048 kB hugepages reported on node 1 00:26:46.430 19:13:03 -- nvmf/common.sh@542 -- # cat 00:26:46.430 19:13:03 -- nvmf/common.sh@544 -- # jq . 00:26:46.430 19:13:03 -- nvmf/common.sh@545 -- # IFS=, 00:26:46.430 19:13:03 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:26:46.430 "params": { 00:26:46.430 "name": "Nvme1", 00:26:46.430 "trtype": "tcp", 00:26:46.430 "traddr": "10.0.0.2", 00:26:46.430 "adrfam": "ipv4", 00:26:46.430 "trsvcid": "4420", 00:26:46.430 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:26:46.430 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:26:46.430 "hdgst": false, 00:26:46.430 "ddgst": false 00:26:46.430 }, 00:26:46.430 "method": "bdev_nvme_attach_controller" 00:26:46.430 },{ 00:26:46.430 "params": { 00:26:46.430 "name": "Nvme2", 00:26:46.430 "trtype": "tcp", 00:26:46.430 "traddr": "10.0.0.2", 00:26:46.430 "adrfam": "ipv4", 00:26:46.430 "trsvcid": "4420", 00:26:46.430 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:26:46.430 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:26:46.430 "hdgst": false, 00:26:46.430 "ddgst": false 00:26:46.430 }, 00:26:46.430 "method": "bdev_nvme_attach_controller" 00:26:46.430 },{ 00:26:46.430 "params": { 00:26:46.430 "name": "Nvme3", 00:26:46.430 "trtype": "tcp", 00:26:46.430 "traddr": "10.0.0.2", 00:26:46.430 "adrfam": "ipv4", 00:26:46.430 "trsvcid": "4420", 00:26:46.430 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:26:46.430 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:26:46.430 "hdgst": false, 00:26:46.430 "ddgst": false 00:26:46.430 }, 00:26:46.430 "method": "bdev_nvme_attach_controller" 00:26:46.430 },{ 00:26:46.430 "params": { 00:26:46.430 "name": "Nvme4", 00:26:46.430 "trtype": "tcp", 00:26:46.430 "traddr": "10.0.0.2", 00:26:46.430 "adrfam": "ipv4", 00:26:46.430 "trsvcid": "4420", 00:26:46.430 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:26:46.430 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:26:46.430 "hdgst": false, 00:26:46.430 "ddgst": false 00:26:46.430 }, 00:26:46.430 "method": "bdev_nvme_attach_controller" 00:26:46.430 },{ 00:26:46.430 "params": { 00:26:46.430 "name": "Nvme5", 00:26:46.430 "trtype": "tcp", 00:26:46.430 "traddr": "10.0.0.2", 00:26:46.430 "adrfam": "ipv4", 00:26:46.430 "trsvcid": "4420", 00:26:46.430 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:26:46.430 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:26:46.430 "hdgst": false, 00:26:46.430 "ddgst": false 00:26:46.430 }, 00:26:46.430 "method": "bdev_nvme_attach_controller" 00:26:46.430 },{ 00:26:46.430 "params": { 00:26:46.430 "name": "Nvme6", 00:26:46.430 "trtype": "tcp", 00:26:46.430 "traddr": "10.0.0.2", 00:26:46.430 "adrfam": "ipv4", 00:26:46.430 "trsvcid": "4420", 00:26:46.430 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:26:46.430 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:26:46.430 "hdgst": false, 00:26:46.430 "ddgst": false 00:26:46.430 }, 00:26:46.430 "method": "bdev_nvme_attach_controller" 00:26:46.430 },{ 00:26:46.430 "params": { 00:26:46.430 "name": "Nvme7", 00:26:46.430 "trtype": "tcp", 00:26:46.430 "traddr": "10.0.0.2", 00:26:46.430 "adrfam": "ipv4", 00:26:46.430 "trsvcid": "4420", 00:26:46.430 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:26:46.430 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:26:46.430 "hdgst": false, 00:26:46.430 "ddgst": false 00:26:46.430 }, 00:26:46.430 "method": "bdev_nvme_attach_controller" 00:26:46.430 },{ 00:26:46.430 "params": { 00:26:46.430 "name": "Nvme8", 00:26:46.430 "trtype": "tcp", 00:26:46.430 "traddr": "10.0.0.2", 00:26:46.430 "adrfam": "ipv4", 00:26:46.430 "trsvcid": "4420", 00:26:46.430 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:26:46.430 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:26:46.430 "hdgst": false, 00:26:46.430 "ddgst": false 00:26:46.430 }, 00:26:46.430 "method": "bdev_nvme_attach_controller" 00:26:46.430 },{ 00:26:46.430 "params": { 00:26:46.430 "name": "Nvme9", 00:26:46.430 "trtype": "tcp", 00:26:46.430 "traddr": "10.0.0.2", 00:26:46.430 "adrfam": "ipv4", 00:26:46.430 "trsvcid": "4420", 00:26:46.430 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:26:46.430 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:26:46.430 "hdgst": false, 00:26:46.430 "ddgst": false 00:26:46.430 }, 00:26:46.430 "method": "bdev_nvme_attach_controller" 00:26:46.430 },{ 00:26:46.430 "params": { 00:26:46.430 "name": "Nvme10", 00:26:46.430 "trtype": "tcp", 00:26:46.430 "traddr": "10.0.0.2", 00:26:46.430 "adrfam": "ipv4", 00:26:46.430 "trsvcid": "4420", 00:26:46.430 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:26:46.430 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:26:46.430 "hdgst": false, 00:26:46.430 "ddgst": false 00:26:46.430 }, 00:26:46.430 "method": "bdev_nvme_attach_controller" 00:26:46.430 }' 00:26:46.430 [2024-11-26 19:13:03.165985] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:46.430 [2024-11-26 19:13:03.203825] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:47.806 Running I/O for 10 seconds... 00:26:47.806 19:13:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:47.806 19:13:04 -- common/autotest_common.sh@862 -- # return 0 00:26:47.806 19:13:04 -- target/shutdown.sh@126 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:26:47.806 19:13:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:47.806 19:13:04 -- common/autotest_common.sh@10 -- # set +x 00:26:47.806 19:13:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:47.806 19:13:04 -- target/shutdown.sh@129 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:26:47.806 19:13:04 -- target/shutdown.sh@131 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:26:47.806 19:13:04 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:26:47.806 19:13:04 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:26:47.806 19:13:04 -- target/shutdown.sh@57 -- # local ret=1 00:26:47.806 19:13:04 -- target/shutdown.sh@58 -- # local i 00:26:47.806 19:13:04 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:26:47.806 19:13:04 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:26:47.806 19:13:04 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:26:47.806 19:13:04 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:26:47.806 19:13:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:47.806 19:13:04 -- common/autotest_common.sh@10 -- # set +x 00:26:47.806 19:13:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:47.806 19:13:04 -- target/shutdown.sh@60 -- # read_io_count=3 00:26:47.806 19:13:04 -- target/shutdown.sh@63 -- # '[' 3 -ge 100 ']' 00:26:47.806 19:13:04 -- target/shutdown.sh@67 -- # sleep 0.25 00:26:48.066 19:13:04 -- target/shutdown.sh@59 -- # (( i-- )) 00:26:48.066 19:13:04 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:26:48.066 19:13:04 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:26:48.066 19:13:04 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:26:48.066 19:13:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:48.066 19:13:04 -- common/autotest_common.sh@10 -- # set +x 00:26:48.339 19:13:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:48.339 19:13:05 -- target/shutdown.sh@60 -- # read_io_count=167 00:26:48.339 19:13:05 -- target/shutdown.sh@63 -- # '[' 167 -ge 100 ']' 00:26:48.339 19:13:05 -- target/shutdown.sh@64 -- # ret=0 00:26:48.339 19:13:05 -- target/shutdown.sh@65 -- # break 00:26:48.339 19:13:05 -- target/shutdown.sh@69 -- # return 0 00:26:48.339 19:13:05 -- target/shutdown.sh@134 -- # killprocess 3216664 00:26:48.339 19:13:05 -- common/autotest_common.sh@936 -- # '[' -z 3216664 ']' 00:26:48.339 19:13:05 -- common/autotest_common.sh@940 -- # kill -0 3216664 00:26:48.339 19:13:05 -- common/autotest_common.sh@941 -- # uname 00:26:48.339 19:13:05 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:48.339 19:13:05 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3216664 00:26:48.339 19:13:05 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:48.339 19:13:05 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:48.339 19:13:05 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3216664' 00:26:48.339 killing process with pid 3216664 00:26:48.339 19:13:05 -- common/autotest_common.sh@955 -- # kill 3216664 00:26:48.339 19:13:05 -- common/autotest_common.sh@960 -- # wait 3216664 00:26:48.339 [2024-11-26 19:13:05.067116] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cfa0 is same with the state(5) to be set 00:26:48.339 [2024-11-26 19:13:05.067168] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cfa0 is same with the state(5) to be set 00:26:48.339 [2024-11-26 19:13:05.067177] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cfa0 is same with the state(5) to be set 00:26:48.339 [2024-11-26 19:13:05.067183] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cfa0 is same with the state(5) to be set 00:26:48.339 [2024-11-26 19:13:05.067190] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cfa0 is same with the state(5) to be set 00:26:48.339 [2024-11-26 19:13:05.067196] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cfa0 is same with the state(5) to be set 00:26:48.339 [2024-11-26 19:13:05.067203] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cfa0 is same with the state(5) to be set 00:26:48.339 [2024-11-26 19:13:05.067210] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cfa0 is same with the state(5) to be set 00:26:48.339 [2024-11-26 19:13:05.067217] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cfa0 is same with the state(5) to be set 00:26:48.339 [2024-11-26 19:13:05.067223] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cfa0 is same with the state(5) to be set 00:26:48.339 [2024-11-26 19:13:05.067230] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cfa0 is same with the state(5) to be set 00:26:48.339 [2024-11-26 19:13:05.067237] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cfa0 is same with the state(5) to be set 00:26:48.339 [2024-11-26 19:13:05.067244] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cfa0 is same with the state(5) to be set 00:26:48.339 [2024-11-26 19:13:05.067250] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cfa0 is same with the state(5) to be set 00:26:48.339 [2024-11-26 19:13:05.067256] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cfa0 is same with the state(5) to be set 00:26:48.339 [2024-11-26 19:13:05.067263] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cfa0 is same with the state(5) to be set 00:26:48.339 [2024-11-26 19:13:05.067269] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cfa0 is same with the state(5) to be set 00:26:48.339 [2024-11-26 19:13:05.067276] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cfa0 is same with the state(5) to be set 00:26:48.339 [2024-11-26 19:13:05.067287] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cfa0 is same with the state(5) to be set 00:26:48.339 [2024-11-26 19:13:05.067294] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cfa0 is same with the state(5) to be set 00:26:48.339 [2024-11-26 19:13:05.067300] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cfa0 is same with the state(5) to be set 00:26:48.339 [2024-11-26 19:13:05.067307] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cfa0 is same with the state(5) to be set 00:26:48.339 [2024-11-26 19:13:05.067313] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cfa0 is same with the state(5) to be set 00:26:48.339 [2024-11-26 19:13:05.067319] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cfa0 is same with the state(5) to be set 00:26:48.339 [2024-11-26 19:13:05.067326] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cfa0 is same with the state(5) to be set 00:26:48.339 [2024-11-26 19:13:05.067332] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cfa0 is same with the state(5) to be set 00:26:48.339 [2024-11-26 19:13:05.067339] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cfa0 is same with the state(5) to be set 00:26:48.339 [2024-11-26 19:13:05.067344] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cfa0 is same with the state(5) to be set 00:26:48.339 [2024-11-26 19:13:05.067351] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cfa0 is same with the state(5) to be set 00:26:48.339 [2024-11-26 19:13:05.067357] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cfa0 is same with the state(5) to be set 00:26:48.339 [2024-11-26 19:13:05.067364] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cfa0 is same with the state(5) to be set 00:26:48.339 [2024-11-26 19:13:05.067370] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cfa0 is same with the state(5) to be set 00:26:48.339 [2024-11-26 19:13:05.067376] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cfa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.067383] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cfa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.067389] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cfa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.067395] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cfa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.067401] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cfa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.067407] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cfa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.067415] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cfa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.067422] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cfa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.067428] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cfa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.067434] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cfa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.067440] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cfa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.067446] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cfa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.067453] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cfa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.067461] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cfa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.067467] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cfa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.067473] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cfa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.067480] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cfa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.067486] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cfa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.067492] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cfa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.067498] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cfa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.067505] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cfa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.067511] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cfa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.067517] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cfa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.067523] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cfa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.067530] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cfa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.067536] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cfa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.067542] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cfa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.067548] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cfa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.067555] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cfa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.067561] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cfa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.067567] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cfa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.068429] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2aaa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.068440] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2aaa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.068447] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2aaa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.068453] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2aaa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.068460] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2aaa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.068466] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2aaa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.068472] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2aaa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.068479] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2aaa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.068485] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2aaa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.068494] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2aaa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.068500] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2aaa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.068506] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2aaa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.068513] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2aaa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.068519] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2aaa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.068525] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2aaa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.068531] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2aaa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.068538] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2aaa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.068544] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2aaa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.068551] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2aaa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.068557] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2aaa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.068563] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2aaa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.068569] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2aaa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.068576] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2aaa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.068583] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2aaa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.068589] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2aaa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.068595] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2aaa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.068601] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2aaa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.068608] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2aaa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.068614] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2aaa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.068620] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2aaa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.068627] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2aaa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.068633] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2aaa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.068639] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2aaa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.068645] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2aaa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.068652] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2aaa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.068659] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2aaa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.068667] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2aaa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.068673] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2aaa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.068679] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2aaa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.068685] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2aaa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.068692] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2aaa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.068698] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2aaa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.068704] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2aaa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.068710] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2aaa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.068716] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2aaa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.068722] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2aaa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.068728] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2aaa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.068735] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2aaa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.068741] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2aaa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.068748] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2aaa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.068754] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2aaa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.068760] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2aaa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.068766] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2aaa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.068772] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2aaa0 is same with the state(5) to be set 00:26:48.340 [2024-11-26 19:13:05.068778] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2aaa0 is same with the state(5) to be set 00:26:48.341 [2024-11-26 19:13:05.068785] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2aaa0 is same with the state(5) to be set 00:26:48.341 [2024-11-26 19:13:05.068791] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2aaa0 is same with the state(5) to be set 00:26:48.341 [2024-11-26 19:13:05.068797] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2aaa0 is same with the state(5) to be set 00:26:48.341 [2024-11-26 19:13:05.068803] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2aaa0 is same with the state(5) to be set 00:26:48.341 [2024-11-26 19:13:05.068810] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2aaa0 is same with the state(5) to be set 00:26:48.341 [2024-11-26 19:13:05.068816] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2aaa0 is same with the state(5) to be set 00:26:48.341 [2024-11-26 19:13:05.068822] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2aaa0 is same with the state(5) to be set 00:26:48.341 [2024-11-26 19:13:05.068828] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2aaa0 is same with the state(5) to be set 00:26:48.341 [2024-11-26 19:13:05.069817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.341 [2024-11-26 19:13:05.069852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.341 [2024-11-26 19:13:05.069871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.341 [2024-11-26 19:13:05.069879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.341 [2024-11-26 19:13:05.069890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.341 [2024-11-26 19:13:05.069899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.341 [2024-11-26 19:13:05.069908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.341 [2024-11-26 19:13:05.069915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.341 [2024-11-26 19:13:05.069925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.341 [2024-11-26 19:13:05.069932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.341 [2024-11-26 19:13:05.069941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.341 [2024-11-26 19:13:05.069955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.341 [2024-11-26 19:13:05.069965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.341 [2024-11-26 19:13:05.069972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.341 [2024-11-26 19:13:05.069981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.341 [2024-11-26 19:13:05.069988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.341 [2024-11-26 19:13:05.069997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.341 [2024-11-26 19:13:05.070004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.341 [2024-11-26 19:13:05.070013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.341 [2024-11-26 19:13:05.070019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.341 [2024-11-26 19:13:05.070028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.341 [2024-11-26 19:13:05.070034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.341 [2024-11-26 19:13:05.070043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.341 [2024-11-26 19:13:05.070049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.341 [2024-11-26 19:13:05.070058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.341 [2024-11-26 19:13:05.070068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.341 [2024-11-26 19:13:05.070077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.341 [2024-11-26 19:13:05.070083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.341 [2024-11-26 19:13:05.070092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.341 [2024-11-26 19:13:05.070098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.341 [2024-11-26 19:13:05.070107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.341 [2024-11-26 19:13:05.070113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.341 [2024-11-26 19:13:05.070122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.341 [2024-11-26 19:13:05.070129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.341 [2024-11-26 19:13:05.070138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.341 [2024-11-26 19:13:05.070145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.341 [2024-11-26 19:13:05.070153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.341 [2024-11-26 19:13:05.070160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.341 [2024-11-26 19:13:05.070168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.341 [2024-11-26 19:13:05.070175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.341 [2024-11-26 19:13:05.070183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.341 [2024-11-26 19:13:05.070190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.341 [2024-11-26 19:13:05.070198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.341 [2024-11-26 19:13:05.070205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.341 [2024-11-26 19:13:05.070215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.341 [2024-11-26 19:13:05.070221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.341 [2024-11-26 19:13:05.070230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.341 [2024-11-26 19:13:05.070236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.341 [2024-11-26 19:13:05.070244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.341 [2024-11-26 19:13:05.070250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.341 [2024-11-26 19:13:05.070259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.341 [2024-11-26 19:13:05.070267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.341 [2024-11-26 19:13:05.070275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.341 [2024-11-26 19:13:05.070282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.341 [2024-11-26 19:13:05.070291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.341 [2024-11-26 19:13:05.070297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.341 [2024-11-26 19:13:05.070306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.342 [2024-11-26 19:13:05.070312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.342 [2024-11-26 19:13:05.070320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.342 [2024-11-26 19:13:05.070327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.342 [2024-11-26 19:13:05.070335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.342 [2024-11-26 19:13:05.070342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.342 [2024-11-26 19:13:05.070350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.342 [2024-11-26 19:13:05.070356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.342 [2024-11-26 19:13:05.070364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.342 [2024-11-26 19:13:05.070372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.342 [2024-11-26 19:13:05.070380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.342 [2024-11-26 19:13:05.070388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.342 [2024-11-26 19:13:05.070397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.342 [2024-11-26 19:13:05.070404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.342 [2024-11-26 19:13:05.070412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.342 [2024-11-26 19:13:05.070419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.342 [2024-11-26 19:13:05.070427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.342 [2024-11-26 19:13:05.070434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.342 [2024-11-26 19:13:05.070445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.342 [2024-11-26 19:13:05.070451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.342 [2024-11-26 19:13:05.070462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.342 [2024-11-26 19:13:05.070470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.342 [2024-11-26 19:13:05.070478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.342 [2024-11-26 19:13:05.070486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.342 [2024-11-26 19:13:05.070494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.342 [2024-11-26 19:13:05.070501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.342 [2024-11-26 19:13:05.070510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.342 [2024-11-26 19:13:05.070521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.342 [2024-11-26 19:13:05.070529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.342 [2024-11-26 19:13:05.070536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.342 [2024-11-26 19:13:05.070545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.342 [2024-11-26 19:13:05.070552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.342 [2024-11-26 19:13:05.070563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.342 [2024-11-26 19:13:05.070570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.342 [2024-11-26 19:13:05.070578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.342 [2024-11-26 19:13:05.070585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.342 [2024-11-26 19:13:05.070593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.342 [2024-11-26 19:13:05.070601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.342 [2024-11-26 19:13:05.070610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.342 [2024-11-26 19:13:05.070616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.342 [2024-11-26 19:13:05.070625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.342 [2024-11-26 19:13:05.070634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.342 [2024-11-26 19:13:05.070643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.342 [2024-11-26 19:13:05.070649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.342 [2024-11-26 19:13:05.070657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.342 [2024-11-26 19:13:05.070668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.342 [2024-11-26 19:13:05.070677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.342 [2024-11-26 19:13:05.070684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.342 [2024-11-26 19:13:05.070692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.342 [2024-11-26 19:13:05.070701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.342 [2024-11-26 19:13:05.070710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.342 [2024-11-26 19:13:05.070717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.342 [2024-11-26 19:13:05.070726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.342 [2024-11-26 19:13:05.070735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.342 [2024-11-26 19:13:05.070743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.342 [2024-11-26 19:13:05.070751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.342 [2024-11-26 19:13:05.070759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.342 [2024-11-26 19:13:05.070766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.342 [2024-11-26 19:13:05.070774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.342 [2024-11-26 19:13:05.070782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.342 [2024-11-26 19:13:05.070791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.343 [2024-11-26 19:13:05.070797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.343 [2024-11-26 19:13:05.070805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.343 [2024-11-26 19:13:05.070812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.343 [2024-11-26 19:13:05.070821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.343 [2024-11-26 19:13:05.070829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.343 [2024-11-26 19:13:05.070837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.343 [2024-11-26 19:13:05.070843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.343 [2024-11-26 19:13:05.070852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.343 [2024-11-26 19:13:05.070858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.343 [2024-11-26 19:13:05.070869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.343 [2024-11-26 19:13:05.070877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.343 [2024-11-26 19:13:05.070884] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x12aedc0 is same with the state(5) to be set 00:26:48.343 [2024-11-26 19:13:05.070938] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x12aedc0 was disconnected and freed. reset controller. 00:26:48.343 [2024-11-26 19:13:05.073393] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2af50 is same with the state(5) to be set 00:26:48.343 [2024-11-26 19:13:05.073418] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2af50 is same with the state(5) to be set 00:26:48.343 [2024-11-26 19:13:05.073425] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2af50 is same with the state(5) to be set 00:26:48.343 [2024-11-26 19:13:05.073432] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2af50 is same with the state(5) to be set 00:26:48.343 [2024-11-26 19:13:05.073439] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2af50 is same with the state(5) to be set 00:26:48.343 [2024-11-26 19:13:05.073446] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2af50 is same with the state(5) to be set 00:26:48.343 [2024-11-26 19:13:05.073452] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2af50 is same with the state(5) to be set 00:26:48.343 [2024-11-26 19:13:05.073459] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2af50 is same with the state(5) to be set 00:26:48.343 [2024-11-26 19:13:05.073465] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2af50 is same with the state(5) to be set 00:26:48.343 [2024-11-26 19:13:05.073471] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2af50 is same with the state(5) to be set 00:26:48.343 [2024-11-26 19:13:05.073478] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2af50 is same with the state(5) to be set 00:26:48.343 [2024-11-26 19:13:05.073484] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2af50 is same with the state(5) to be set 00:26:48.343 [2024-11-26 19:13:05.073490] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2af50 is same with the state(5) to be set 00:26:48.343 [2024-11-26 19:13:05.073496] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2af50 is same with the state(5) to be set 00:26:48.343 [2024-11-26 19:13:05.073502] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2af50 is same with the state(5) to be set 00:26:48.343 [2024-11-26 19:13:05.073508] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2af50 is same with the state(5) to be set 00:26:48.343 [2024-11-26 19:13:05.073515] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2af50 is same with the state(5) to be set 00:26:48.343 [2024-11-26 19:13:05.073521] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2af50 is same with the state(5) to be set 00:26:48.343 [2024-11-26 19:13:05.073527] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2af50 is same with the state(5) to be set 00:26:48.343 [2024-11-26 19:13:05.073533] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2af50 is same with the state(5) to be set 00:26:48.343 [2024-11-26 19:13:05.073541] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2af50 is same with the state(5) to be set 00:26:48.343 [2024-11-26 19:13:05.073547] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2af50 is same with the state(5) to be set 00:26:48.343 [2024-11-26 19:13:05.073558] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2af50 is same with the state(5) to be set 00:26:48.343 [2024-11-26 19:13:05.073565] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2af50 is same with the state(5) to be set 00:26:48.343 [2024-11-26 19:13:05.073571] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2af50 is same with the state(5) to be set 00:26:48.343 [2024-11-26 19:13:05.073578] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2af50 is same with the state(5) to be set 00:26:48.343 [2024-11-26 19:13:05.073584] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2af50 is same with the state(5) to be set 00:26:48.343 [2024-11-26 19:13:05.073590] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2af50 is same with the state(5) to be set 00:26:48.343 [2024-11-26 19:13:05.073596] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2af50 is same with the state(5) to be set 00:26:48.343 [2024-11-26 19:13:05.073602] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2af50 is same with the state(5) to be set 00:26:48.343 [2024-11-26 19:13:05.073609] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2af50 is same with the state(5) to be set 00:26:48.343 [2024-11-26 19:13:05.073615] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2af50 is same with the state(5) to be set 00:26:48.343 [2024-11-26 19:13:05.073621] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2af50 is same with the state(5) to be set 00:26:48.343 [2024-11-26 19:13:05.073628] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2af50 is same with the state(5) to be set 00:26:48.343 [2024-11-26 19:13:05.073635] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2af50 is same with the state(5) to be set 00:26:48.343 [2024-11-26 19:13:05.073641] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2af50 is same with the state(5) to be set 00:26:48.343 [2024-11-26 19:13:05.073648] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2af50 is same with the state(5) to be set 00:26:48.343 [2024-11-26 19:13:05.073654] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2af50 is same with the state(5) to be set 00:26:48.343 [2024-11-26 19:13:05.073660] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2af50 is same with the state(5) to be set 00:26:48.343 [2024-11-26 19:13:05.073666] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2af50 is same with the state(5) to be set 00:26:48.343 [2024-11-26 19:13:05.073672] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2af50 is same with the state(5) to be set 00:26:48.343 [2024-11-26 19:13:05.073679] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2af50 is same with the state(5) to be set 00:26:48.343 [2024-11-26 19:13:05.073686] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2af50 is same with the state(5) to be set 00:26:48.343 [2024-11-26 19:13:05.073692] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2af50 is same with the state(5) to be set 00:26:48.343 [2024-11-26 19:13:05.073699] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2af50 is same with the state(5) to be set 00:26:48.343 [2024-11-26 19:13:05.073706] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2af50 is same with the state(5) to be set 00:26:48.343 [2024-11-26 19:13:05.073713] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2af50 is same with the state(5) to be set 00:26:48.343 [2024-11-26 19:13:05.073719] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2af50 is same with the state(5) to be set 00:26:48.343 [2024-11-26 19:13:05.073726] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2af50 is same with the state(5) to be set 00:26:48.343 [2024-11-26 19:13:05.073732] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2af50 is same with the state(5) to be set 00:26:48.343 [2024-11-26 19:13:05.073744] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2af50 is same with the state(5) to be set 00:26:48.343 [2024-11-26 19:13:05.073751] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2af50 is same with the state(5) to be set 00:26:48.343 [2024-11-26 19:13:05.073758] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2af50 is same with the state(5) to be set 00:26:48.343 [2024-11-26 19:13:05.073764] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2af50 is same with the state(5) to be set 00:26:48.344 [2024-11-26 19:13:05.073770] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2af50 is same with the state(5) to be set 00:26:48.344 [2024-11-26 19:13:05.073777] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2af50 is same with the state(5) to be set 00:26:48.344 [2024-11-26 19:13:05.073785] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2af50 is same with the state(5) to be set 00:26:48.344 [2024-11-26 19:13:05.073791] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2af50 is same with the state(5) to be set 00:26:48.344 [2024-11-26 19:13:05.073797] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2af50 is same with the state(5) to be set 00:26:48.344 [2024-11-26 19:13:05.073803] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2af50 is same with the state(5) to be set 00:26:48.344 [2024-11-26 19:13:05.073810] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2af50 is same with the state(5) to be set 00:26:48.344 [2024-11-26 19:13:05.073817] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2af50 is same with the state(5) to be set 00:26:48.344 [2024-11-26 19:13:05.073823] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2af50 is same with the state(5) to be set 00:26:48.344 [2024-11-26 19:13:05.074814] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b3e0 is same with the state(5) to be set 00:26:48.344 [2024-11-26 19:13:05.074838] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b3e0 is same with the state(5) to be set 00:26:48.344 [2024-11-26 19:13:05.074845] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b3e0 is same with the state(5) to be set 00:26:48.344 [2024-11-26 19:13:05.074852] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b3e0 is same with the state(5) to be set 00:26:48.344 [2024-11-26 19:13:05.074859] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b3e0 is same with the state(5) to be set 00:26:48.344 [2024-11-26 19:13:05.074865] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b3e0 is same with the state(5) to be set 00:26:48.344 [2024-11-26 19:13:05.074871] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b3e0 is same with the state(5) to be set 00:26:48.344 [2024-11-26 19:13:05.074877] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b3e0 is same with the state(5) to be set 00:26:48.344 [2024-11-26 19:13:05.074883] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b3e0 is same with the state(5) to be set 00:26:48.344 [2024-11-26 19:13:05.074889] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b3e0 is same with the state(5) to be set 00:26:48.344 [2024-11-26 19:13:05.074896] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b3e0 is same with the state(5) to be set 00:26:48.344 [2024-11-26 19:13:05.074902] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b3e0 is same with the state(5) to be set 00:26:48.344 [2024-11-26 19:13:05.074908] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b3e0 is same with the state(5) to be set 00:26:48.344 [2024-11-26 19:13:05.074914] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b3e0 is same with the state(5) to be set 00:26:48.344 [2024-11-26 19:13:05.074924] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b3e0 is same with the state(5) to be set 00:26:48.344 [2024-11-26 19:13:05.074930] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b3e0 is same with the state(5) to be set 00:26:48.344 [2024-11-26 19:13:05.074936] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b3e0 is same with the state(5) to be set 00:26:48.344 [2024-11-26 19:13:05.074942] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b3e0 is same with the state(5) to be set 00:26:48.344 [2024-11-26 19:13:05.074953] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b3e0 is same with the state(5) to be set 00:26:48.344 [2024-11-26 19:13:05.074959] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b3e0 is same with the state(5) to be set 00:26:48.344 [2024-11-26 19:13:05.074966] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b3e0 is same with the state(5) to be set 00:26:48.344 [2024-11-26 19:13:05.074972] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b3e0 is same with the state(5) to be set 00:26:48.344 [2024-11-26 19:13:05.074978] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b3e0 is same with the state(5) to be set 00:26:48.344 [2024-11-26 19:13:05.074984] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b3e0 is same with the state(5) to be set 00:26:48.344 [2024-11-26 19:13:05.074990] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b3e0 is same with the state(5) to be set 00:26:48.344 [2024-11-26 19:13:05.074997] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b3e0 is same with the state(5) to be set 00:26:48.344 [2024-11-26 19:13:05.075003] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b3e0 is same with the state(5) to be set 00:26:48.344 [2024-11-26 19:13:05.075009] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b3e0 is same with the state(5) to be set 00:26:48.344 [2024-11-26 19:13:05.075015] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b3e0 is same with the state(5) to be set 00:26:48.344 [2024-11-26 19:13:05.075021] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b3e0 is same with the state(5) to be set 00:26:48.344 [2024-11-26 19:13:05.075027] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b3e0 is same with the state(5) to be set 00:26:48.344 [2024-11-26 19:13:05.075033] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b3e0 is same with the state(5) to be set 00:26:48.344 [2024-11-26 19:13:05.075039] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b3e0 is same with the state(5) to be set 00:26:48.344 [2024-11-26 19:13:05.075046] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b3e0 is same with the state(5) to be set 00:26:48.344 [2024-11-26 19:13:05.075053] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b3e0 is same with the state(5) to be set 00:26:48.344 [2024-11-26 19:13:05.075059] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b3e0 is same with the state(5) to be set 00:26:48.344 [2024-11-26 19:13:05.075065] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b3e0 is same with the state(5) to be set 00:26:48.344 [2024-11-26 19:13:05.075072] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b3e0 is same with the state(5) to be set 00:26:48.344 [2024-11-26 19:13:05.075079] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b3e0 is same with the state(5) to be set 00:26:48.344 [2024-11-26 19:13:05.075085] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b3e0 is same with the state(5) to be set 00:26:48.345 [2024-11-26 19:13:05.075091] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b3e0 is same with the state(5) to be set 00:26:48.345 [2024-11-26 19:13:05.075099] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b3e0 is same with the state(5) to be set 00:26:48.345 [2024-11-26 19:13:05.075105] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b3e0 is same with the state(5) to be set 00:26:48.345 [2024-11-26 19:13:05.075111] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b3e0 is same with the state(5) to be set 00:26:48.345 [2024-11-26 19:13:05.075118] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b3e0 is same with the state(5) to be set 00:26:48.345 [2024-11-26 19:13:05.075124] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b3e0 is same with the state(5) to be set 00:26:48.345 [2024-11-26 19:13:05.075130] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b3e0 is same with the state(5) to be set 00:26:48.345 [2024-11-26 19:13:05.075136] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b3e0 is same with the state(5) to be set 00:26:48.345 [2024-11-26 19:13:05.075142] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b3e0 is same with the state(5) to be set 00:26:48.345 [2024-11-26 19:13:05.075148] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b3e0 is same with the state(5) to be set 00:26:48.345 [2024-11-26 19:13:05.075155] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b3e0 is same with the state(5) to be set 00:26:48.345 [2024-11-26 19:13:05.075161] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b3e0 is same with the state(5) to be set 00:26:48.345 [2024-11-26 19:13:05.075167] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b3e0 is same with the state(5) to be set 00:26:48.345 [2024-11-26 19:13:05.075173] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b3e0 is same with the state(5) to be set 00:26:48.345 [2024-11-26 19:13:05.075179] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b3e0 is same with the state(5) to be set 00:26:48.345 [2024-11-26 19:13:05.075185] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b3e0 is same with the state(5) to be set 00:26:48.345 [2024-11-26 19:13:05.075191] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b3e0 is same with the state(5) to be set 00:26:48.345 [2024-11-26 19:13:05.075197] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b3e0 is same with the state(5) to be set 00:26:48.345 [2024-11-26 19:13:05.075203] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b3e0 is same with the state(5) to be set 00:26:48.345 [2024-11-26 19:13:05.075210] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b3e0 is same with the state(5) to be set 00:26:48.345 [2024-11-26 19:13:05.075216] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b3e0 is same with the state(5) to be set 00:26:48.345 [2024-11-26 19:13:05.075222] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b3e0 is same with the state(5) to be set 00:26:48.345 [2024-11-26 19:13:05.075228] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b3e0 is same with the state(5) to be set 00:26:48.345 [2024-11-26 19:13:05.075774] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b890 is same with the state(5) to be set 00:26:48.345 [2024-11-26 19:13:05.075800] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b890 is same with the state(5) to be set 00:26:48.345 [2024-11-26 19:13:05.075807] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b890 is same with the state(5) to be set 00:26:48.345 [2024-11-26 19:13:05.075814] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b890 is same with the state(5) to be set 00:26:48.345 [2024-11-26 19:13:05.075820] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b890 is same with the state(5) to be set 00:26:48.345 [2024-11-26 19:13:05.075834] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b890 is same with the state(5) to be set 00:26:48.345 [2024-11-26 19:13:05.075841] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b890 is same with the state(5) to be set 00:26:48.345 [2024-11-26 19:13:05.075847] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b890 is same with the state(5) to be set 00:26:48.345 [2024-11-26 19:13:05.075854] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b890 is same with the state(5) to be set 00:26:48.345 [2024-11-26 19:13:05.075860] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b890 is same with the state(5) to be set 00:26:48.345 [2024-11-26 19:13:05.075866] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b890 is same with the state(5) to be set 00:26:48.345 [2024-11-26 19:13:05.075873] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b890 is same with the state(5) to be set 00:26:48.345 [2024-11-26 19:13:05.075879] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b890 is same with the state(5) to be set 00:26:48.345 [2024-11-26 19:13:05.075885] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b890 is same with the state(5) to be set 00:26:48.345 [2024-11-26 19:13:05.075891] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b890 is same with the state(5) to be set 00:26:48.345 [2024-11-26 19:13:05.075897] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b890 is same with the state(5) to be set 00:26:48.345 [2024-11-26 19:13:05.075904] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b890 is same with the state(5) to be set 00:26:48.345 [2024-11-26 19:13:05.075910] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b890 is same with the state(5) to be set 00:26:48.345 [2024-11-26 19:13:05.075916] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b890 is same with the state(5) to be set 00:26:48.345 [2024-11-26 19:13:05.075923] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b890 is same with the state(5) to be set 00:26:48.345 [2024-11-26 19:13:05.075929] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b890 is same with the state(5) to be set 00:26:48.345 [2024-11-26 19:13:05.075936] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b890 is same with the state(5) to be set 00:26:48.345 [2024-11-26 19:13:05.075942] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b890 is same with the state(5) to be set 00:26:48.345 [2024-11-26 19:13:05.075952] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b890 is same with the state(5) to be set 00:26:48.345 [2024-11-26 19:13:05.075958] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b890 is same with the state(5) to be set 00:26:48.345 [2024-11-26 19:13:05.075964] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b890 is same with the state(5) to be set 00:26:48.345 [2024-11-26 19:13:05.075971] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b890 is same with the state(5) to be set 00:26:48.345 [2024-11-26 19:13:05.075977] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b890 is same with the state(5) to be set 00:26:48.345 [2024-11-26 19:13:05.075984] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b890 is same with the state(5) to be set 00:26:48.345 [2024-11-26 19:13:05.075990] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b890 is same with the state(5) to be set 00:26:48.345 [2024-11-26 19:13:05.075996] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b890 is same with the state(5) to be set 00:26:48.345 [2024-11-26 19:13:05.076002] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b890 is same with the state(5) to be set 00:26:48.345 [2024-11-26 19:13:05.076011] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b890 is same with the state(5) to be set 00:26:48.345 [2024-11-26 19:13:05.076018] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b890 is same with the state(5) to be set 00:26:48.345 [2024-11-26 19:13:05.076024] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b890 is same with the state(5) to be set 00:26:48.345 [2024-11-26 19:13:05.076030] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b890 is same with the state(5) to be set 00:26:48.345 [2024-11-26 19:13:05.076037] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b890 is same with the state(5) to be set 00:26:48.345 [2024-11-26 19:13:05.076042] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b890 is same with the state(5) to be set 00:26:48.345 [2024-11-26 19:13:05.076049] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b890 is same with the state(5) to be set 00:26:48.345 [2024-11-26 19:13:05.076055] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b890 is same with the state(5) to be set 00:26:48.345 [2024-11-26 19:13:05.076061] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b890 is same with the state(5) to be set 00:26:48.345 [2024-11-26 19:13:05.076067] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b890 is same with the state(5) to be set 00:26:48.345 [2024-11-26 19:13:05.076073] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b890 is same with the state(5) to be set 00:26:48.345 [2024-11-26 19:13:05.076079] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b890 is same with the state(5) to be set 00:26:48.345 [2024-11-26 19:13:05.076085] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b890 is same with the state(5) to be set 00:26:48.346 [2024-11-26 19:13:05.076092] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b890 is same with the state(5) to be set 00:26:48.346 [2024-11-26 19:13:05.076098] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b890 is same with the state(5) to be set 00:26:48.346 [2024-11-26 19:13:05.076105] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2b890 is same with the state(5) to be set 00:26:48.346 [2024-11-26 19:13:05.077490] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c1d0 is same with the state(5) to be set 00:26:48.346 [2024-11-26 19:13:05.077504] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c1d0 is same with the state(5) to be set 00:26:48.346 [2024-11-26 19:13:05.077519] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c1d0 is same with the state(5) to be set 00:26:48.346 [2024-11-26 19:13:05.077526] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c1d0 is same with the state(5) to be set 00:26:48.346 [2024-11-26 19:13:05.077532] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c1d0 is same with the state(5) to be set 00:26:48.346 [2024-11-26 19:13:05.077539] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c1d0 is same with the state(5) to be set 00:26:48.346 [2024-11-26 19:13:05.077546] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c1d0 is same with the state(5) to be set 00:26:48.346 [2024-11-26 19:13:05.077552] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c1d0 is same with the state(5) to be set 00:26:48.346 [2024-11-26 19:13:05.077558] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c1d0 is same with the state(5) to be set 00:26:48.346 [2024-11-26 19:13:05.077564] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c1d0 is same with the state(5) to be set 00:26:48.346 [2024-11-26 19:13:05.077571] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c1d0 is same with the state(5) to be set 00:26:48.346 [2024-11-26 19:13:05.077579] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c1d0 is same with the state(5) to be set 00:26:48.346 [2024-11-26 19:13:05.077586] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c1d0 is same with the state(5) to be set 00:26:48.346 [2024-11-26 19:13:05.077592] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c1d0 is same with the state(5) to be set 00:26:48.346 [2024-11-26 19:13:05.077598] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c1d0 is same with the state(5) to be set 00:26:48.346 [2024-11-26 19:13:05.077604] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c1d0 is same with the state(5) to be set 00:26:48.346 [2024-11-26 19:13:05.077610] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c1d0 is same with the state(5) to be set 00:26:48.346 [2024-11-26 19:13:05.077617] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c1d0 is same with the state(5) to be set 00:26:48.346 [2024-11-26 19:13:05.077623] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c1d0 is same with the state(5) to be set 00:26:48.346 [2024-11-26 19:13:05.077629] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c1d0 is same with the state(5) to be set 00:26:48.346 [2024-11-26 19:13:05.077636] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c1d0 is same with the state(5) to be set 00:26:48.346 [2024-11-26 19:13:05.077642] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c1d0 is same with the state(5) to be set 00:26:48.346 [2024-11-26 19:13:05.077648] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c1d0 is same with the state(5) to be set 00:26:48.346 [2024-11-26 19:13:05.077654] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c1d0 is same with the state(5) to be set 00:26:48.346 [2024-11-26 19:13:05.077660] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c1d0 is same with the state(5) to be set 00:26:48.346 [2024-11-26 19:13:05.077666] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c1d0 is same with the state(5) to be set 00:26:48.346 [2024-11-26 19:13:05.077672] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c1d0 is same with the state(5) to be set 00:26:48.346 [2024-11-26 19:13:05.077678] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c1d0 is same with the state(5) to be set 00:26:48.346 [2024-11-26 19:13:05.077684] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c1d0 is same with the state(5) to be set 00:26:48.346 [2024-11-26 19:13:05.077690] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c1d0 is same with the state(5) to be set 00:26:48.346 [2024-11-26 19:13:05.077696] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c1d0 is same with the state(5) to be set 00:26:48.346 [2024-11-26 19:13:05.077703] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c1d0 is same with the state(5) to be set 00:26:48.346 [2024-11-26 19:13:05.077710] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c1d0 is same with the state(5) to be set 00:26:48.346 [2024-11-26 19:13:05.077716] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c1d0 is same with the state(5) to be set 00:26:48.346 [2024-11-26 19:13:05.077723] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c1d0 is same with the state(5) to be set 00:26:48.346 [2024-11-26 19:13:05.077729] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c1d0 is same with the state(5) to be set 00:26:48.346 [2024-11-26 19:13:05.077736] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c1d0 is same with the state(5) to be set 00:26:48.346 [2024-11-26 19:13:05.077742] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c1d0 is same with the state(5) to be set 00:26:48.346 [2024-11-26 19:13:05.077749] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c1d0 is same with the state(5) to be set 00:26:48.346 [2024-11-26 19:13:05.077755] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c1d0 is same with the state(5) to be set 00:26:48.346 [2024-11-26 19:13:05.077762] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c1d0 is same with the state(5) to be set 00:26:48.346 [2024-11-26 19:13:05.077768] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c1d0 is same with the state(5) to be set 00:26:48.346 [2024-11-26 19:13:05.077774] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c1d0 is same with the state(5) to be set 00:26:48.346 [2024-11-26 19:13:05.077780] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c1d0 is same with the state(5) to be set 00:26:48.346 [2024-11-26 19:13:05.077786] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c1d0 is same with the state(5) to be set 00:26:48.346 [2024-11-26 19:13:05.077793] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c1d0 is same with the state(5) to be set 00:26:48.346 [2024-11-26 19:13:05.077799] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c1d0 is same with the state(5) to be set 00:26:48.346 [2024-11-26 19:13:05.077805] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c1d0 is same with the state(5) to be set 00:26:48.346 [2024-11-26 19:13:05.077812] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c1d0 is same with the state(5) to be set 00:26:48.346 [2024-11-26 19:13:05.077817] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c1d0 is same with the state(5) to be set 00:26:48.346 [2024-11-26 19:13:05.077824] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c1d0 is same with the state(5) to be set 00:26:48.346 [2024-11-26 19:13:05.077830] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c1d0 is same with the state(5) to be set 00:26:48.346 [2024-11-26 19:13:05.077836] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c1d0 is same with the state(5) to be set 00:26:48.346 [2024-11-26 19:13:05.077842] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c1d0 is same with the state(5) to be set 00:26:48.346 [2024-11-26 19:13:05.077849] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c1d0 is same with the state(5) to be set 00:26:48.346 [2024-11-26 19:13:05.077855] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c1d0 is same with the state(5) to be set 00:26:48.346 [2024-11-26 19:13:05.077861] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c1d0 is same with the state(5) to be set 00:26:48.346 [2024-11-26 19:13:05.077867] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c1d0 is same with the state(5) to be set 00:26:48.346 [2024-11-26 19:13:05.077873] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c1d0 is same with the state(5) to be set 00:26:48.346 [2024-11-26 19:13:05.077879] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c1d0 is same with the state(5) to be set 00:26:48.346 [2024-11-26 19:13:05.077886] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c1d0 is same with the state(5) to be set 00:26:48.346 [2024-11-26 19:13:05.077892] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c1d0 is same with the state(5) to be set 00:26:48.347 [2024-11-26 19:13:05.077898] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c1d0 is same with the state(5) to be set 00:26:48.347 [2024-11-26 19:13:05.078118] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:48.347 [2024-11-26 19:13:05.078140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.347 [2024-11-26 19:13:05.078152] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:48.347 [2024-11-26 19:13:05.078159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.347 [2024-11-26 19:13:05.078167] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:48.347 [2024-11-26 19:13:05.078174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.347 [2024-11-26 19:13:05.078181] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:48.347 [2024-11-26 19:13:05.078188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.347 [2024-11-26 19:13:05.078194] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14a5150 is same with the state(5) to be set 00:26:48.347 [2024-11-26 19:13:05.078222] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:48.347 [2024-11-26 19:13:05.078230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.347 [2024-11-26 19:13:05.078238] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:48.347 [2024-11-26 19:13:05.078245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.347 [2024-11-26 19:13:05.078252] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:48.347 [2024-11-26 19:13:05.078259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.347 [2024-11-26 19:13:05.078266] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:48.347 [2024-11-26 19:13:05.078272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.347 [2024-11-26 19:13:05.078278] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1321f10 is same with the state(5) to be set 00:26:48.347 [2024-11-26 19:13:05.078302] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:48.347 [2024-11-26 19:13:05.078311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.347 [2024-11-26 19:13:05.078319] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:48.347 [2024-11-26 19:13:05.078326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.347 [2024-11-26 19:13:05.078334] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:48.347 [2024-11-26 19:13:05.078340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.347 [2024-11-26 19:13:05.078348] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:48.347 [2024-11-26 19:13:05.078355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.347 [2024-11-26 19:13:05.078361] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1303540 is same with the state(5) to be set 00:26:48.347 [2024-11-26 19:13:05.078383] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:48.347 [2024-11-26 19:13:05.078396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.347 [2024-11-26 19:13:05.078404] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:48.347 [2024-11-26 19:13:05.078411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.347 [2024-11-26 19:13:05.078419] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:48.347 [2024-11-26 19:13:05.078426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.347 [2024-11-26 19:13:05.078434] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:48.347 [2024-11-26 19:13:05.078441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.347 [2024-11-26 19:13:05.078447] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x12d72f0 is same with the state(5) to be set 00:26:48.347 [2024-11-26 19:13:05.078466] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:48.347 [2024-11-26 19:13:05.078482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.347 [2024-11-26 19:13:05.078489] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:48.347 [2024-11-26 19:13:05.078496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.347 [2024-11-26 19:13:05.078503] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:48.347 [2024-11-26 19:13:05.078510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.347 [2024-11-26 19:13:05.078518] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:48.347 [2024-11-26 19:13:05.078524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.347 [2024-11-26 19:13:05.078530] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x130b1d0 is same with the state(5) to be set 00:26:48.347 [2024-11-26 19:13:05.078552] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:48.347 [2024-11-26 19:13:05.078560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.347 [2024-11-26 19:13:05.078567] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:48.347 [2024-11-26 19:13:05.078574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.347 [2024-11-26 19:13:05.078582] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:48.347 [2024-11-26 19:13:05.078588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.347 [2024-11-26 19:13:05.078595] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:48.347 [2024-11-26 19:13:05.078602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.347 [2024-11-26 19:13:05.078610] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1323d00 is same with the state(5) to be set 00:26:48.347 [2024-11-26 19:13:05.078633] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:48.347 [2024-11-26 19:13:05.078641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.347 [2024-11-26 19:13:05.078648] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:48.347 [2024-11-26 19:13:05.078654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.347 [2024-11-26 19:13:05.078662] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:48.347 [2024-11-26 19:13:05.078668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.347 [2024-11-26 19:13:05.078676] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:48.348 [2024-11-26 19:13:05.078682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.348 [2024-11-26 19:13:05.078688] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x12cfcd0 is same with the state(5) to be set 00:26:48.348 [2024-11-26 19:13:05.078713] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:48.348 [2024-11-26 19:13:05.078721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.348 [2024-11-26 19:13:05.078723] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c660 is same with the state(5) to be set 00:26:48.348 [2024-11-26 19:13:05.078728] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:48.348 [2024-11-26 19:13:05.078736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.348 [2024-11-26 19:13:05.078736] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c660 is same with the state(5) to be set 00:26:48.348 [2024-11-26 19:13:05.078743] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 ns[2024-11-26 19:13:05.078744] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c660 is same with id:0 cdw10:00000000 cdw11:00000000 00:26:48.348 the state(5) to be set 00:26:48.348 [2024-11-26 19:13:05.078754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 c[2024-11-26 19:13:05.078755] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c660 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.348 the state(5) to be set 00:26:48.348 [2024-11-26 19:13:05.078764] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c660 is same with the state(5) to be set 00:26:48.348 [2024-11-26 19:13:05.078766] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:48.348 [2024-11-26 19:13:05.078770] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c660 is same with the state(5) to be set 00:26:48.348 [2024-11-26 19:13:05.078774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.348 [2024-11-26 19:13:05.078777] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c660 is same with the state(5) to be set 00:26:48.348 [2024-11-26 19:13:05.078781] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x132e8e0 is same with the state(5) to be set 00:26:48.348 [2024-11-26 19:13:05.078785] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c660 is same with the state(5) to be set 00:26:48.348 [2024-11-26 19:13:05.078792] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c660 is same with the state(5) to be set 00:26:48.348 [2024-11-26 19:13:05.078798] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c660 is same with the state(5) to be set 00:26:48.348 [2024-11-26 19:13:05.078804] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c660 is same with the state(5) to be set 00:26:48.348 [2024-11-26 19:13:05.078807] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:48.348 [2024-11-26 19:13:05.078810] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c660 is same with the state(5) to be set 00:26:48.348 [2024-11-26 19:13:05.078816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 c[2024-11-26 19:13:05.078817] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c660 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.348 the state(5) to be set 00:26:48.348 [2024-11-26 19:13:05.078826] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c660 is same with the state(5) to be set 00:26:48.348 [2024-11-26 19:13:05.078826] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:48.348 [2024-11-26 19:13:05.078832] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c660 is same with the state(5) to be set 00:26:48.348 [2024-11-26 19:13:05.078835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.348 [2024-11-26 19:13:05.078839] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c660 is same with the state(5) to be set 00:26:48.348 [2024-11-26 19:13:05.078843] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:48.348 [2024-11-26 19:13:05.078846] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c660 is same with the state(5) to be set 00:26:48.348 [2024-11-26 19:13:05.078851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.348 [2024-11-26 19:13:05.078853] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c660 is same with the state(5) to be set 00:26:48.348 [2024-11-26 19:13:05.078859] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 ns[2024-11-26 19:13:05.078860] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c660 is same with id:0 cdw10:00000000 cdw11:00000000 00:26:48.348 the state(5) to be set 00:26:48.348 [2024-11-26 19:13:05.078870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 c[2024-11-26 19:13:05.078870] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c660 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.348 the state(5) to be set 00:26:48.348 [2024-11-26 19:13:05.078879] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14625e0 is same [2024-11-26 19:13:05.078880] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c660 is same with with the state(5) to be set 00:26:48.348 the state(5) to be set 00:26:48.348 [2024-11-26 19:13:05.078890] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c660 is same with the state(5) to be set 00:26:48.348 [2024-11-26 19:13:05.078895] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c660 is same with the state(5) to be set 00:26:48.348 [2024-11-26 19:13:05.078901] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c660 is same with the state(5) to be set 00:26:48.348 [2024-11-26 19:13:05.078907] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c660 is same with the state(5) to be set 00:26:48.348 [2024-11-26 19:13:05.078916] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c660 is same with the state(5) to be set 00:26:48.348 [2024-11-26 19:13:05.078922] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c660 is same with the state(5) to be set 00:26:48.348 [2024-11-26 19:13:05.078927] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c660 is same with the state(5) to be set 00:26:48.348 [2024-11-26 19:13:05.078934] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c660 is same with the state(5) to be set 00:26:48.348 [2024-11-26 19:13:05.078939] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c660 is same with the state(5) to be set 00:26:48.348 [2024-11-26 19:13:05.078945] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c660 is same with the state(5) to be set 00:26:48.348 [2024-11-26 19:13:05.078958] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c660 is same with the state(5) to be set 00:26:48.348 [2024-11-26 19:13:05.078964] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c660 is same with the state(5) to be set 00:26:48.348 [2024-11-26 19:13:05.078970] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c660 is same with the state(5) to be set 00:26:48.348 [2024-11-26 19:13:05.078977] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c660 is same with the state(5) to be set 00:26:48.348 [2024-11-26 19:13:05.078983] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c660 is same with the state(5) to be set 00:26:48.348 [2024-11-26 19:13:05.078989] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c660 is same with the state(5) to be set 00:26:48.348 [2024-11-26 19:13:05.078995] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c660 is same with the state(5) to be set 00:26:48.348 [2024-11-26 19:13:05.079001] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c660 is same with the state(5) to be set 00:26:48.348 [2024-11-26 19:13:05.079007] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c660 is same with the state(5) to be set 00:26:48.348 [2024-11-26 19:13:05.079013] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c660 is same with the state(5) to be set 00:26:48.348 [2024-11-26 19:13:05.079018] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c660 is same with the state(5) to be set 00:26:48.348 [2024-11-26 19:13:05.080158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.348 [2024-11-26 19:13:05.080178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.348 [2024-11-26 19:13:05.080191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.348 [2024-11-26 19:13:05.080198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.349 [2024-11-26 19:13:05.080207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.349 [2024-11-26 19:13:05.080214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.349 [2024-11-26 19:13:05.080222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.349 [2024-11-26 19:13:05.080228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.349 [2024-11-26 19:13:05.080237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.349 [2024-11-26 19:13:05.080247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.349 [2024-11-26 19:13:05.080255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.349 [2024-11-26 19:13:05.080262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.349 [2024-11-26 19:13:05.080270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.349 [2024-11-26 19:13:05.080277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.349 [2024-11-26 19:13:05.080289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.349 [2024-11-26 19:13:05.080295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.349 [2024-11-26 19:13:05.080304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.349 [2024-11-26 19:13:05.080310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.349 [2024-11-26 19:13:05.080320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.349 [2024-11-26 19:13:05.080327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.349 [2024-11-26 19:13:05.080335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.349 [2024-11-26 19:13:05.080342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.349 [2024-11-26 19:13:05.080351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.349 [2024-11-26 19:13:05.080357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.349 [2024-11-26 19:13:05.080366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.349 [2024-11-26 19:13:05.080372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.349 [2024-11-26 19:13:05.080381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.349 [2024-11-26 19:13:05.080387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.349 [2024-11-26 19:13:05.080395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.349 [2024-11-26 19:13:05.080402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.349 [2024-11-26 19:13:05.080410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.349 [2024-11-26 19:13:05.080417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.349 [2024-11-26 19:13:05.080425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.349 [2024-11-26 19:13:05.080431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.349 [2024-11-26 19:13:05.080441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.349 [2024-11-26 19:13:05.080448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.349 [2024-11-26 19:13:05.080456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.349 [2024-11-26 19:13:05.080462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.349 [2024-11-26 19:13:05.080470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.349 [2024-11-26 19:13:05.080477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.349 [2024-11-26 19:13:05.080485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.349 [2024-11-26 19:13:05.080491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.349 [2024-11-26 19:13:05.080499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.349 [2024-11-26 19:13:05.080506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.349 [2024-11-26 19:13:05.080514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.349 [2024-11-26 19:13:05.080521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.349 [2024-11-26 19:13:05.080531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.349 [2024-11-26 19:13:05.080538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.349 [2024-11-26 19:13:05.080546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.349 [2024-11-26 19:13:05.080553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.349 [2024-11-26 19:13:05.080561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.349 [2024-11-26 19:13:05.080568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.349 [2024-11-26 19:13:05.080577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.349 [2024-11-26 19:13:05.080583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.349 [2024-11-26 19:13:05.080591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.349 [2024-11-26 19:13:05.080598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.349 [2024-11-26 19:13:05.080606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.349 [2024-11-26 19:13:05.080612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.349 [2024-11-26 19:13:05.080621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.349 [2024-11-26 19:13:05.080628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.349 [2024-11-26 19:13:05.080637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.349 [2024-11-26 19:13:05.080643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.349 [2024-11-26 19:13:05.080652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.349 [2024-11-26 19:13:05.080658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.349 [2024-11-26 19:13:05.080666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.350 [2024-11-26 19:13:05.080673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.350 [2024-11-26 19:13:05.080681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.350 [2024-11-26 19:13:05.080688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.350 [2024-11-26 19:13:05.080696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.350 [2024-11-26 19:13:05.080702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.350 [2024-11-26 19:13:05.080711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.350 [2024-11-26 19:13:05.080717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.350 [2024-11-26 19:13:05.080726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.350 [2024-11-26 19:13:05.080733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.350 [2024-11-26 19:13:05.080741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.350 [2024-11-26 19:13:05.080748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.350 [2024-11-26 19:13:05.080756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.350 [2024-11-26 19:13:05.080762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.350 [2024-11-26 19:13:05.080772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.350 [2024-11-26 19:13:05.080778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.350 [2024-11-26 19:13:05.080787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.350 [2024-11-26 19:13:05.080794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.350 [2024-11-26 19:13:05.080802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.350 [2024-11-26 19:13:05.080809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.350 [2024-11-26 19:13:05.080820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.350 [2024-11-26 19:13:05.080826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.350 [2024-11-26 19:13:05.080835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.350 [2024-11-26 19:13:05.080841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.350 [2024-11-26 19:13:05.080850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.350 [2024-11-26 19:13:05.080856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.350 [2024-11-26 19:13:05.080865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.350 [2024-11-26 19:13:05.080872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.350 [2024-11-26 19:13:05.080880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.350 [2024-11-26 19:13:05.080887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.350 [2024-11-26 19:13:05.080895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.350 [2024-11-26 19:13:05.080902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.350 [2024-11-26 19:13:05.080910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.350 [2024-11-26 19:13:05.080917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.350 [2024-11-26 19:13:05.080925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.350 [2024-11-26 19:13:05.080932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.350 [2024-11-26 19:13:05.080940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.350 [2024-11-26 19:13:05.080952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.350 [2024-11-26 19:13:05.080961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.350 [2024-11-26 19:13:05.080967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.350 [2024-11-26 19:13:05.080976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.350 [2024-11-26 19:13:05.080984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.350 [2024-11-26 19:13:05.080993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.350 [2024-11-26 19:13:05.081000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.350 [2024-11-26 19:13:05.081008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.350 [2024-11-26 19:13:05.081016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.350 [2024-11-26 19:13:05.081026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.350 [2024-11-26 19:13:05.081032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.350 [2024-11-26 19:13:05.081041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.350 [2024-11-26 19:13:05.081047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.350 [2024-11-26 19:13:05.081055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.350 [2024-11-26 19:13:05.081062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.350 [2024-11-26 19:13:05.081070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.351 [2024-11-26 19:13:05.081077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.351 [2024-11-26 19:13:05.081085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.351 [2024-11-26 19:13:05.081091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.351 [2024-11-26 19:13:05.081100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.351 [2024-11-26 19:13:05.081106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.351 [2024-11-26 19:13:05.081114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.351 [2024-11-26 19:13:05.081121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.351 [2024-11-26 19:13:05.081129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.351 [2024-11-26 19:13:05.081135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.351 [2024-11-26 19:13:05.081143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.351 [2024-11-26 19:13:05.081150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.351 [2024-11-26 19:13:05.081157] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x12c8b00 is same with the state(5) to be set 00:26:48.351 [2024-11-26 19:13:05.081208] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x12c8b00 was disconnected and freed. reset controller. 00:26:48.351 [2024-11-26 19:13:05.081243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.351 [2024-11-26 19:13:05.081251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.351 [2024-11-26 19:13:05.081262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.351 [2024-11-26 19:13:05.081268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.351 [2024-11-26 19:13:05.081277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.351 [2024-11-26 19:13:05.081285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.351 [2024-11-26 19:13:05.081293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.351 [2024-11-26 19:13:05.081301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.351 [2024-11-26 19:13:05.081310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.351 [2024-11-26 19:13:05.081316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.351 [2024-11-26 19:13:05.081324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.351 [2024-11-26 19:13:05.081331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.351 [2024-11-26 19:13:05.081340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.351 [2024-11-26 19:13:05.081347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.351 [2024-11-26 19:13:05.081355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.351 [2024-11-26 19:13:05.081361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.351 [2024-11-26 19:13:05.081369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.351 [2024-11-26 19:13:05.081376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.351 [2024-11-26 19:13:05.081384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.351 [2024-11-26 19:13:05.081391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.351 [2024-11-26 19:13:05.081398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.351 [2024-11-26 19:13:05.081405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.351 [2024-11-26 19:13:05.081448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.351 [2024-11-26 19:13:05.081478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.351 [2024-11-26 19:13:05.081517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.351 [2024-11-26 19:13:05.081550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.351 [2024-11-26 19:13:05.081589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.351 [2024-11-26 19:13:05.081621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.351 [2024-11-26 19:13:05.081655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.351 [2024-11-26 19:13:05.081690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.351 [2024-11-26 19:13:05.081724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.351 [2024-11-26 19:13:05.081755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.351 [2024-11-26 19:13:05.081790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.351 [2024-11-26 19:13:05.081821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.351 [2024-11-26 19:13:05.081856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.351 [2024-11-26 19:13:05.081889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.351 [2024-11-26 19:13:05.081923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.351 [2024-11-26 19:13:05.081961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.351 [2024-11-26 19:13:05.081994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.351 [2024-11-26 19:13:05.082027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.351 [2024-11-26 19:13:05.082061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.351 [2024-11-26 19:13:05.082096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.351 [2024-11-26 19:13:05.082131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.351 [2024-11-26 19:13:05.082163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.351 [2024-11-26 19:13:05.082198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.351 [2024-11-26 19:13:05.082230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.351 [2024-11-26 19:13:05.082264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.351 [2024-11-26 19:13:05.082296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.351 [2024-11-26 19:13:05.082330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.352 [2024-11-26 19:13:05.082362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.352 [2024-11-26 19:13:05.082396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.352 [2024-11-26 19:13:05.082428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.352 [2024-11-26 19:13:05.082463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.352 [2024-11-26 19:13:05.082494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.352 [2024-11-26 19:13:05.082533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.352 [2024-11-26 19:13:05.082565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.352 [2024-11-26 19:13:05.082599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.352 [2024-11-26 19:13:05.082631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.352 [2024-11-26 19:13:05.082666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.352 [2024-11-26 19:13:05.082697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.352 [2024-11-26 19:13:05.082732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.352 [2024-11-26 19:13:05.082763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.352 [2024-11-26 19:13:05.082797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.352 [2024-11-26 19:13:05.082828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.352 [2024-11-26 19:13:05.082862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.352 [2024-11-26 19:13:05.082895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.352 [2024-11-26 19:13:05.082933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.352 [2024-11-26 19:13:05.082968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.352 [2024-11-26 19:13:05.088361] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c660 is same with the state(5) to be set 00:26:48.352 [2024-11-26 19:13:05.088371] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c660 is same with the state(5) to be set 00:26:48.352 [2024-11-26 19:13:05.088378] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c660 is same with the state(5) to be set 00:26:48.352 [2024-11-26 19:13:05.088385] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c660 is same with the state(5) to be set 00:26:48.352 [2024-11-26 19:13:05.088392] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c660 is same with the state(5) to be set 00:26:48.352 [2024-11-26 19:13:05.088397] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c660 is same with the state(5) to be set 00:26:48.352 [2024-11-26 19:13:05.088403] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c660 is same with the state(5) to be set 00:26:48.352 [2024-11-26 19:13:05.088409] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c660 is same with the state(5) to be set 00:26:48.352 [2024-11-26 19:13:05.088415] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c660 is same with the state(5) to be set 00:26:48.352 [2024-11-26 19:13:05.088421] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c660 is same with the state(5) to be set 00:26:48.352 [2024-11-26 19:13:05.088427] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c660 is same with the state(5) to be set 00:26:48.352 [2024-11-26 19:13:05.088433] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c660 is same with the state(5) to be set 00:26:48.352 [2024-11-26 19:13:05.088439] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c660 is same with the state(5) to be set 00:26:48.352 [2024-11-26 19:13:05.088447] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c660 is same with the state(5) to be set 00:26:48.352 [2024-11-26 19:13:05.088454] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c660 is same with the state(5) to be set 00:26:48.352 [2024-11-26 19:13:05.088459] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c660 is same with the state(5) to be set 00:26:48.352 [2024-11-26 19:13:05.088466] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c660 is same with the state(5) to be set 00:26:48.352 [2024-11-26 19:13:05.088471] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c660 is same with the state(5) to be set 00:26:48.352 [2024-11-26 19:13:05.088477] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c660 is same with the state(5) to be set 00:26:48.352 [2024-11-26 19:13:05.088483] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c660 is same with the state(5) to be set 00:26:48.352 [2024-11-26 19:13:05.088489] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2c660 is same with the state(5) to be set 00:26:48.352 [2024-11-26 19:13:05.089079] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cb10 is same with the state(5) to be set 00:26:48.352 [2024-11-26 19:13:05.089096] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cb10 is same with the state(5) to be set 00:26:48.352 [2024-11-26 19:13:05.089102] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cb10 is same with the state(5) to be set 00:26:48.352 [2024-11-26 19:13:05.089109] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cb10 is same with the state(5) to be set 00:26:48.352 [2024-11-26 19:13:05.089115] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cb10 is same with the state(5) to be set 00:26:48.352 [2024-11-26 19:13:05.089121] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cb10 is same with the state(5) to be set 00:26:48.352 [2024-11-26 19:13:05.089128] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cb10 is same with the state(5) to be set 00:26:48.352 [2024-11-26 19:13:05.089134] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cb10 is same with the state(5) to be set 00:26:48.352 [2024-11-26 19:13:05.089140] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cb10 is same with the state(5) to be set 00:26:48.352 [2024-11-26 19:13:05.089147] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cb10 is same with the state(5) to be set 00:26:48.352 [2024-11-26 19:13:05.089153] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cb10 is same with the state(5) to be set 00:26:48.352 [2024-11-26 19:13:05.089159] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cb10 is same with the state(5) to be set 00:26:48.352 [2024-11-26 19:13:05.089165] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cb10 is same with the state(5) to be set 00:26:48.352 [2024-11-26 19:13:05.089171] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cb10 is same with the state(5) to be set 00:26:48.352 [2024-11-26 19:13:05.089178] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cb10 is same with the state(5) to be set 00:26:48.352 [2024-11-26 19:13:05.089184] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cb10 is same with the state(5) to be set 00:26:48.352 [2024-11-26 19:13:05.089190] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cb10 is same with the state(5) to be set 00:26:48.352 [2024-11-26 19:13:05.089196] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cb10 is same with the state(5) to be set 00:26:48.352 [2024-11-26 19:13:05.089202] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cb10 is same with the state(5) to be set 00:26:48.352 [2024-11-26 19:13:05.089212] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cb10 is same with the state(5) to be set 00:26:48.352 [2024-11-26 19:13:05.089218] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cb10 is same with the state(5) to be set 00:26:48.352 [2024-11-26 19:13:05.089224] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cb10 is same with the state(5) to be set 00:26:48.352 [2024-11-26 19:13:05.089231] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cb10 is same with the state(5) to be set 00:26:48.352 [2024-11-26 19:13:05.089237] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cb10 is same with the state(5) to be set 00:26:48.352 [2024-11-26 19:13:05.089243] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cb10 is same with the state(5) to be set 00:26:48.352 [2024-11-26 19:13:05.089249] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cb10 is same with the state(5) to be set 00:26:48.353 [2024-11-26 19:13:05.089254] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cb10 is same with the state(5) to be set 00:26:48.353 [2024-11-26 19:13:05.089261] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cb10 is same with the state(5) to be set 00:26:48.353 [2024-11-26 19:13:05.089267] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cb10 is same with the state(5) to be set 00:26:48.353 [2024-11-26 19:13:05.089273] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cb10 is same with the state(5) to be set 00:26:48.353 [2024-11-26 19:13:05.089279] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cb10 is same with the state(5) to be set 00:26:48.353 [2024-11-26 19:13:05.089285] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cb10 is same with the state(5) to be set 00:26:48.353 [2024-11-26 19:13:05.089292] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cb10 is same with the state(5) to be set 00:26:48.353 [2024-11-26 19:13:05.089298] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cb10 is same with the state(5) to be set 00:26:48.353 [2024-11-26 19:13:05.089304] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cb10 is same with the state(5) to be set 00:26:48.353 [2024-11-26 19:13:05.089310] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cb10 is same with the state(5) to be set 00:26:48.353 [2024-11-26 19:13:05.089317] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cb10 is same with the state(5) to be set 00:26:48.353 [2024-11-26 19:13:05.089323] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cb10 is same with the state(5) to be set 00:26:48.353 [2024-11-26 19:13:05.089329] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cb10 is same with the state(5) to be set 00:26:48.353 [2024-11-26 19:13:05.089335] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cb10 is same with the state(5) to be set 00:26:48.353 [2024-11-26 19:13:05.089341] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cb10 is same with the state(5) to be set 00:26:48.353 [2024-11-26 19:13:05.089347] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cb10 is same with the state(5) to be set 00:26:48.353 [2024-11-26 19:13:05.089353] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cb10 is same with the state(5) to be set 00:26:48.353 [2024-11-26 19:13:05.089359] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cb10 is same with the state(5) to be set 00:26:48.353 [2024-11-26 19:13:05.089365] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cb10 is same with the state(5) to be set 00:26:48.353 [2024-11-26 19:13:05.089371] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cb10 is same with the state(5) to be set 00:26:48.353 [2024-11-26 19:13:05.089379] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cb10 is same with the state(5) to be set 00:26:48.353 [2024-11-26 19:13:05.089385] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cb10 is same with the state(5) to be set 00:26:48.353 [2024-11-26 19:13:05.089391] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cb10 is same with the state(5) to be set 00:26:48.353 [2024-11-26 19:13:05.089397] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cb10 is same with the state(5) to be set 00:26:48.353 [2024-11-26 19:13:05.089402] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cb10 is same with the state(5) to be set 00:26:48.353 [2024-11-26 19:13:05.089409] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cb10 is same with the state(5) to be set 00:26:48.353 [2024-11-26 19:13:05.089414] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cb10 is same with the state(5) to be set 00:26:48.353 [2024-11-26 19:13:05.089420] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cb10 is same with the state(5) to be set 00:26:48.353 [2024-11-26 19:13:05.089426] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cb10 is same with the state(5) to be set 00:26:48.353 [2024-11-26 19:13:05.089432] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cb10 is same with the state(5) to be set 00:26:48.353 [2024-11-26 19:13:05.089438] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cb10 is same with the state(5) to be set 00:26:48.353 [2024-11-26 19:13:05.089444] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cb10 is same with the state(5) to be set 00:26:48.353 [2024-11-26 19:13:05.089450] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cb10 is same with the state(5) to be set 00:26:48.353 [2024-11-26 19:13:05.089456] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cb10 is same with the state(5) to be set 00:26:48.353 [2024-11-26 19:13:05.089462] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cb10 is same with the state(5) to be set 00:26:48.353 [2024-11-26 19:13:05.089468] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cb10 is same with the state(5) to be set 00:26:48.353 [2024-11-26 19:13:05.089474] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b2cb10 is same with the state(5) to be set 00:26:48.353 [2024-11-26 19:13:05.095626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.353 [2024-11-26 19:13:05.095640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.353 [2024-11-26 19:13:05.095653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.353 [2024-11-26 19:13:05.095663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.353 [2024-11-26 19:13:05.095674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.353 [2024-11-26 19:13:05.095683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.353 [2024-11-26 19:13:05.095694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.353 [2024-11-26 19:13:05.095703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.353 [2024-11-26 19:13:05.095715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.353 [2024-11-26 19:13:05.095726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.353 [2024-11-26 19:13:05.095738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.353 [2024-11-26 19:13:05.095747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.353 [2024-11-26 19:13:05.095758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.353 [2024-11-26 19:13:05.095767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.353 [2024-11-26 19:13:05.095778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.353 [2024-11-26 19:13:05.095787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.353 [2024-11-26 19:13:05.095798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.353 [2024-11-26 19:13:05.095807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.353 [2024-11-26 19:13:05.095818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.353 [2024-11-26 19:13:05.095827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.353 [2024-11-26 19:13:05.095838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.353 [2024-11-26 19:13:05.095847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.353 [2024-11-26 19:13:05.095858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.353 [2024-11-26 19:13:05.095867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.353 [2024-11-26 19:13:05.095877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.353 [2024-11-26 19:13:05.095886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.353 [2024-11-26 19:13:05.095897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.353 [2024-11-26 19:13:05.095906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.353 [2024-11-26 19:13:05.095917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.354 [2024-11-26 19:13:05.095926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.354 [2024-11-26 19:13:05.095937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.354 [2024-11-26 19:13:05.095946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.354 [2024-11-26 19:13:05.095961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.354 [2024-11-26 19:13:05.095970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.354 [2024-11-26 19:13:05.095983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.354 [2024-11-26 19:13:05.095992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.354 [2024-11-26 19:13:05.096004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.354 [2024-11-26 19:13:05.096013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.354 [2024-11-26 19:13:05.096023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.354 [2024-11-26 19:13:05.096032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.354 [2024-11-26 19:13:05.096043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.354 [2024-11-26 19:13:05.096052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.354 [2024-11-26 19:13:05.096064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.354 [2024-11-26 19:13:05.096073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.354 [2024-11-26 19:13:05.096084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.354 [2024-11-26 19:13:05.096093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.354 [2024-11-26 19:13:05.096104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.354 [2024-11-26 19:13:05.096113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.354 [2024-11-26 19:13:05.096124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.354 [2024-11-26 19:13:05.096133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.354 [2024-11-26 19:13:05.096144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.354 [2024-11-26 19:13:05.096153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.354 [2024-11-26 19:13:05.096165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.354 [2024-11-26 19:13:05.096173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.354 [2024-11-26 19:13:05.096184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.354 [2024-11-26 19:13:05.096193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.354 [2024-11-26 19:13:05.096204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.354 [2024-11-26 19:13:05.096213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.354 [2024-11-26 19:13:05.096224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.354 [2024-11-26 19:13:05.096235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.354 [2024-11-26 19:13:05.096321] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x12ca0e0 was disconnected and freed. reset controller. 00:26:48.354 [2024-11-26 19:13:05.096512] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.354 [2024-11-26 19:13:05.096547] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x12d72f0 (9): Bad file descriptor 00:26:48.354 [2024-11-26 19:13:05.096576] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14a5150 (9): Bad file descriptor 00:26:48.354 [2024-11-26 19:13:05.096592] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1321f10 (9): Bad file descriptor 00:26:48.354 [2024-11-26 19:13:05.096612] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1303540 (9): Bad file descriptor 00:26:48.354 [2024-11-26 19:13:05.096631] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x130b1d0 (9): Bad file descriptor 00:26:48.354 [2024-11-26 19:13:05.096649] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1323d00 (9): Bad file descriptor 00:26:48.354 [2024-11-26 19:13:05.096668] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x12cfcd0 (9): Bad file descriptor 00:26:48.354 [2024-11-26 19:13:05.096683] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x132e8e0 (9): Bad file descriptor 00:26:48.354 [2024-11-26 19:13:05.096698] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14625e0 (9): Bad file descriptor 00:26:48.354 [2024-11-26 19:13:05.096729] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:48.354 [2024-11-26 19:13:05.096742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.354 [2024-11-26 19:13:05.096753] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:48.354 [2024-11-26 19:13:05.096762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.354 [2024-11-26 19:13:05.096772] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:48.354 [2024-11-26 19:13:05.096781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.354 [2024-11-26 19:13:05.096790] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:48.354 [2024-11-26 19:13:05.096799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.354 [2024-11-26 19:13:05.096808] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x130a780 is same with the state(5) to be set 00:26:48.354 [2024-11-26 19:13:05.097802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.354 [2024-11-26 19:13:05.097825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.354 [2024-11-26 19:13:05.097839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.354 [2024-11-26 19:13:05.097849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.354 [2024-11-26 19:13:05.097861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.354 [2024-11-26 19:13:05.097870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.354 [2024-11-26 19:13:05.097889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.354 [2024-11-26 19:13:05.097898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.354 [2024-11-26 19:13:05.097909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.354 [2024-11-26 19:13:05.097918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.354 [2024-11-26 19:13:05.097930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.354 [2024-11-26 19:13:05.097939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.354 [2024-11-26 19:13:05.097958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.354 [2024-11-26 19:13:05.097968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.355 [2024-11-26 19:13:05.097979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.355 [2024-11-26 19:13:05.097989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.355 [2024-11-26 19:13:05.098002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.355 [2024-11-26 19:13:05.098011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.355 [2024-11-26 19:13:05.098023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.355 [2024-11-26 19:13:05.098032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.355 [2024-11-26 19:13:05.098043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.355 [2024-11-26 19:13:05.098052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.355 [2024-11-26 19:13:05.098063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.355 [2024-11-26 19:13:05.098072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.355 [2024-11-26 19:13:05.098084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.355 [2024-11-26 19:13:05.098093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.355 [2024-11-26 19:13:05.098103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.355 [2024-11-26 19:13:05.098112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.355 [2024-11-26 19:13:05.098123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.355 [2024-11-26 19:13:05.098132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.355 [2024-11-26 19:13:05.098143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.355 [2024-11-26 19:13:05.098155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.355 [2024-11-26 19:13:05.098166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.355 [2024-11-26 19:13:05.098174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.355 [2024-11-26 19:13:05.098186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.355 [2024-11-26 19:13:05.098194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.355 [2024-11-26 19:13:05.098205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.355 [2024-11-26 19:13:05.098214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.355 [2024-11-26 19:13:05.098225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.355 [2024-11-26 19:13:05.098234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.355 [2024-11-26 19:13:05.098245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.355 [2024-11-26 19:13:05.098253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.355 [2024-11-26 19:13:05.098264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.355 [2024-11-26 19:13:05.098273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.355 [2024-11-26 19:13:05.098284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.355 [2024-11-26 19:13:05.098293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.355 [2024-11-26 19:13:05.098304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.355 [2024-11-26 19:13:05.098313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.355 [2024-11-26 19:13:05.098324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.355 [2024-11-26 19:13:05.098333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.355 [2024-11-26 19:13:05.098344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.355 [2024-11-26 19:13:05.098353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.355 [2024-11-26 19:13:05.098365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.355 [2024-11-26 19:13:05.098374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.355 [2024-11-26 19:13:05.098385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.355 [2024-11-26 19:13:05.098393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.355 [2024-11-26 19:13:05.098407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.355 [2024-11-26 19:13:05.098416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.355 [2024-11-26 19:13:05.098428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.355 [2024-11-26 19:13:05.098437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.355 [2024-11-26 19:13:05.098448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.355 [2024-11-26 19:13:05.098456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.355 [2024-11-26 19:13:05.098468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.355 [2024-11-26 19:13:05.098477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.355 [2024-11-26 19:13:05.098488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.355 [2024-11-26 19:13:05.098497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.355 [2024-11-26 19:13:05.098508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.355 [2024-11-26 19:13:05.098516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.355 [2024-11-26 19:13:05.098527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.355 [2024-11-26 19:13:05.098536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.355 [2024-11-26 19:13:05.098547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.355 [2024-11-26 19:13:05.098556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.355 [2024-11-26 19:13:05.098567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.355 [2024-11-26 19:13:05.098575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.355 [2024-11-26 19:13:05.098587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.355 [2024-11-26 19:13:05.098595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.355 [2024-11-26 19:13:05.098606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.355 [2024-11-26 19:13:05.098615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.356 [2024-11-26 19:13:05.098626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.356 [2024-11-26 19:13:05.098635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.356 [2024-11-26 19:13:05.098646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.356 [2024-11-26 19:13:05.098657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.356 [2024-11-26 19:13:05.098668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.356 [2024-11-26 19:13:05.098677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.356 [2024-11-26 19:13:05.098688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.356 [2024-11-26 19:13:05.098697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.356 [2024-11-26 19:13:05.098708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.356 [2024-11-26 19:13:05.098717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.356 [2024-11-26 19:13:05.098728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.356 [2024-11-26 19:13:05.098737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.356 [2024-11-26 19:13:05.098748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.356 [2024-11-26 19:13:05.098757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.356 [2024-11-26 19:13:05.098767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.356 [2024-11-26 19:13:05.098776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.356 [2024-11-26 19:13:05.098787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.356 [2024-11-26 19:13:05.098796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.356 [2024-11-26 19:13:05.098807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.356 [2024-11-26 19:13:05.098815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.356 [2024-11-26 19:13:05.098826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.356 [2024-11-26 19:13:05.098835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.356 [2024-11-26 19:13:05.098846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.356 [2024-11-26 19:13:05.098855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.356 [2024-11-26 19:13:05.098866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.356 [2024-11-26 19:13:05.098875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.356 [2024-11-26 19:13:05.098885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.356 [2024-11-26 19:13:05.098894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.356 [2024-11-26 19:13:05.098907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.356 [2024-11-26 19:13:05.098916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.356 [2024-11-26 19:13:05.098927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.356 [2024-11-26 19:13:05.098936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.356 [2024-11-26 19:13:05.098951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.356 [2024-11-26 19:13:05.098960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.356 [2024-11-26 19:13:05.098971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.356 [2024-11-26 19:13:05.098981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.356 [2024-11-26 19:13:05.098993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.356 [2024-11-26 19:13:05.099002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.356 [2024-11-26 19:13:05.099013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.356 [2024-11-26 19:13:05.099022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.356 [2024-11-26 19:13:05.099033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.356 [2024-11-26 19:13:05.099043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.356 [2024-11-26 19:13:05.099054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.356 [2024-11-26 19:13:05.099062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.356 [2024-11-26 19:13:05.099073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.356 [2024-11-26 19:13:05.099082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.356 [2024-11-26 19:13:05.099093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.356 [2024-11-26 19:13:05.099102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.356 [2024-11-26 19:13:05.099113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.356 [2024-11-26 19:13:05.099122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.356 [2024-11-26 19:13:05.099207] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x12c7560 was disconnected and freed. reset controller. 00:26:48.356 [2024-11-26 19:13:05.102251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.357 [2024-11-26 19:13:05.102277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.357 [2024-11-26 19:13:05.102299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.357 [2024-11-26 19:13:05.102309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.357 [2024-11-26 19:13:05.102322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.357 [2024-11-26 19:13:05.102332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.357 [2024-11-26 19:13:05.102344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.357 [2024-11-26 19:13:05.102354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.357 [2024-11-26 19:13:05.102366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.357 [2024-11-26 19:13:05.102375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.357 [2024-11-26 19:13:05.102387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.357 [2024-11-26 19:13:05.102396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.357 [2024-11-26 19:13:05.102409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.357 [2024-11-26 19:13:05.102418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.357 [2024-11-26 19:13:05.102430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.357 [2024-11-26 19:13:05.102440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.357 [2024-11-26 19:13:05.102452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.357 [2024-11-26 19:13:05.102461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.357 [2024-11-26 19:13:05.102473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.357 [2024-11-26 19:13:05.102483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.357 [2024-11-26 19:13:05.102494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.357 [2024-11-26 19:13:05.102504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.357 [2024-11-26 19:13:05.102516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.357 [2024-11-26 19:13:05.102526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.357 [2024-11-26 19:13:05.102537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.357 [2024-11-26 19:13:05.102547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.357 [2024-11-26 19:13:05.102559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.357 [2024-11-26 19:13:05.102570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.357 [2024-11-26 19:13:05.102582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.357 [2024-11-26 19:13:05.102591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.357 [2024-11-26 19:13:05.102604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.357 [2024-11-26 19:13:05.102613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.357 [2024-11-26 19:13:05.102624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.357 [2024-11-26 19:13:05.102634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.357 [2024-11-26 19:13:05.102646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.357 [2024-11-26 19:13:05.102655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.357 [2024-11-26 19:13:05.102667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.357 [2024-11-26 19:13:05.102676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.357 [2024-11-26 19:13:05.102688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.357 [2024-11-26 19:13:05.102697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.357 [2024-11-26 19:13:05.102709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.357 [2024-11-26 19:13:05.102719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.357 [2024-11-26 19:13:05.102731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.357 [2024-11-26 19:13:05.102740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.357 [2024-11-26 19:13:05.102751] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x144f410 is same with the state(5) to be set 00:26:48.357 [2024-11-26 19:13:05.102811] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x144f410 was disconnected and freed. reset controller. 00:26:48.357 [2024-11-26 19:13:05.104360] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:26:48.357 [2024-11-26 19:13:05.104396] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:26:48.357 [2024-11-26 19:13:05.104417] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:26:48.357 [2024-11-26 19:13:05.104566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.357 [2024-11-26 19:13:05.104735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.357 [2024-11-26 19:13:05.104751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x12d72f0 with addr=10.0.0.2, port=4420 00:26:48.357 [2024-11-26 19:13:05.104762] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x12d72f0 is same with the state(5) to be set 00:26:48.357 [2024-11-26 19:13:05.107496] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:26:48.357 [2024-11-26 19:13:05.107530] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:26:48.357 [2024-11-26 19:13:05.107778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.357 [2024-11-26 19:13:05.107953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.357 [2024-11-26 19:13:05.107970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x132e8e0 with addr=10.0.0.2, port=4420 00:26:48.357 [2024-11-26 19:13:05.107981] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x132e8e0 is same with the state(5) to be set 00:26:48.357 [2024-11-26 19:13:05.108119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.357 [2024-11-26 19:13:05.108297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.357 [2024-11-26 19:13:05.108311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14a5150 with addr=10.0.0.2, port=4420 00:26:48.357 [2024-11-26 19:13:05.108321] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14a5150 is same with the state(5) to be set 00:26:48.357 [2024-11-26 19:13:05.108336] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x12d72f0 (9): Bad file descriptor 00:26:48.357 [2024-11-26 19:13:05.108393] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x130a780 (9): Bad file descriptor 00:26:48.357 [2024-11-26 19:13:05.108468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.358 [2024-11-26 19:13:05.108484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.358 [2024-11-26 19:13:05.108503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.358 [2024-11-26 19:13:05.108513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.358 [2024-11-26 19:13:05.108528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.358 [2024-11-26 19:13:05.108538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.358 [2024-11-26 19:13:05.108553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.358 [2024-11-26 19:13:05.108563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.358 [2024-11-26 19:13:05.108577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.358 [2024-11-26 19:13:05.108587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.358 [2024-11-26 19:13:05.108603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.358 [2024-11-26 19:13:05.108613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.358 [2024-11-26 19:13:05.108628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.358 [2024-11-26 19:13:05.108638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.358 [2024-11-26 19:13:05.108653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.358 [2024-11-26 19:13:05.108663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.358 [2024-11-26 19:13:05.108686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.358 [2024-11-26 19:13:05.108696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.358 [2024-11-26 19:13:05.108712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.358 [2024-11-26 19:13:05.108721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.358 [2024-11-26 19:13:05.108736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.358 [2024-11-26 19:13:05.108746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.358 [2024-11-26 19:13:05.108761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.358 [2024-11-26 19:13:05.108771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.358 [2024-11-26 19:13:05.108787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.358 [2024-11-26 19:13:05.108796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.358 [2024-11-26 19:13:05.108812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.358 [2024-11-26 19:13:05.108822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.358 [2024-11-26 19:13:05.108837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.358 [2024-11-26 19:13:05.108847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.358 [2024-11-26 19:13:05.108862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.358 [2024-11-26 19:13:05.108872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.358 [2024-11-26 19:13:05.108887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.358 [2024-11-26 19:13:05.108897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.358 [2024-11-26 19:13:05.108912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.358 [2024-11-26 19:13:05.108922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.358 [2024-11-26 19:13:05.108937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.358 [2024-11-26 19:13:05.108953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.358 [2024-11-26 19:13:05.108970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.358 [2024-11-26 19:13:05.108979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.358 [2024-11-26 19:13:05.108995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.358 [2024-11-26 19:13:05.109007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.358 [2024-11-26 19:13:05.109023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.358 [2024-11-26 19:13:05.109033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.358 [2024-11-26 19:13:05.109048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.358 [2024-11-26 19:13:05.109058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.358 [2024-11-26 19:13:05.109074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.358 [2024-11-26 19:13:05.109083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.358 [2024-11-26 19:13:05.109098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.358 [2024-11-26 19:13:05.109108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.358 [2024-11-26 19:13:05.109123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.358 [2024-11-26 19:13:05.109133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.358 [2024-11-26 19:13:05.109147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.358 [2024-11-26 19:13:05.109157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.358 [2024-11-26 19:13:05.109172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.358 [2024-11-26 19:13:05.109181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.358 [2024-11-26 19:13:05.109196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.358 [2024-11-26 19:13:05.109206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.358 [2024-11-26 19:13:05.109221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.358 [2024-11-26 19:13:05.109230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.358 [2024-11-26 19:13:05.109246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.358 [2024-11-26 19:13:05.109255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.358 [2024-11-26 19:13:05.109270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.358 [2024-11-26 19:13:05.109280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.358 [2024-11-26 19:13:05.109294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.358 [2024-11-26 19:13:05.109304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.358 [2024-11-26 19:13:05.109321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.358 [2024-11-26 19:13:05.109331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.358 [2024-11-26 19:13:05.109345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.358 [2024-11-26 19:13:05.109355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.358 [2024-11-26 19:13:05.109369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.358 [2024-11-26 19:13:05.109379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.359 [2024-11-26 19:13:05.109394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.359 [2024-11-26 19:13:05.109404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.359 [2024-11-26 19:13:05.109419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.359 [2024-11-26 19:13:05.109428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.359 [2024-11-26 19:13:05.109443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.359 [2024-11-26 19:13:05.109452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.359 [2024-11-26 19:13:05.109467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.359 [2024-11-26 19:13:05.109477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.359 [2024-11-26 19:13:05.109491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.359 [2024-11-26 19:13:05.109501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.359 [2024-11-26 19:13:05.109516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.359 [2024-11-26 19:13:05.109526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.359 [2024-11-26 19:13:05.109541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.359 [2024-11-26 19:13:05.109551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.359 [2024-11-26 19:13:05.109566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.359 [2024-11-26 19:13:05.109575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.359 [2024-11-26 19:13:05.109590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.359 [2024-11-26 19:13:05.109599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.359 [2024-11-26 19:13:05.109614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.359 [2024-11-26 19:13:05.109626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.359 [2024-11-26 19:13:05.109640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.359 [2024-11-26 19:13:05.109650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.359 [2024-11-26 19:13:05.109665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.359 [2024-11-26 19:13:05.109675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.359 [2024-11-26 19:13:05.109690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.359 [2024-11-26 19:13:05.109700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.359 [2024-11-26 19:13:05.109715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.359 [2024-11-26 19:13:05.109724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.359 [2024-11-26 19:13:05.109739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.359 [2024-11-26 19:13:05.109749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.359 [2024-11-26 19:13:05.109764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.359 [2024-11-26 19:13:05.109774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.359 [2024-11-26 19:13:05.109788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.359 [2024-11-26 19:13:05.109798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.359 [2024-11-26 19:13:05.109812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.359 [2024-11-26 19:13:05.109822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.359 [2024-11-26 19:13:05.109837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.359 [2024-11-26 19:13:05.109847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.359 [2024-11-26 19:13:05.109861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.359 [2024-11-26 19:13:05.109871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.359 [2024-11-26 19:13:05.109887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.359 [2024-11-26 19:13:05.109897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.359 [2024-11-26 19:13:05.109912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.359 [2024-11-26 19:13:05.109921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.359 [2024-11-26 19:13:05.109938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.359 [2024-11-26 19:13:05.109953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.359 [2024-11-26 19:13:05.109968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.359 [2024-11-26 19:13:05.109978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.359 [2024-11-26 19:13:05.109992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.359 [2024-11-26 19:13:05.110002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.359 [2024-11-26 19:13:05.110017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.359 [2024-11-26 19:13:05.110027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.359 [2024-11-26 19:13:05.110042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.359 [2024-11-26 19:13:05.110052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.359 [2024-11-26 19:13:05.110071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.359 [2024-11-26 19:13:05.110081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.359 [2024-11-26 19:13:05.111055] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x145b750 is same with the state(5) to be set 00:26:48.359 [2024-11-26 19:13:05.111113] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x145b750 was disconnected and freed. reset controller. 00:26:48.359 [2024-11-26 19:13:05.111122] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:48.359 [2024-11-26 19:13:05.111173] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:26:48.359 [2024-11-26 19:13:05.111482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.360 [2024-11-26 19:13:05.111493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.360 [2024-11-26 19:13:05.111507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.360 [2024-11-26 19:13:05.111514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.360 [2024-11-26 19:13:05.111526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.360 [2024-11-26 19:13:05.111534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.360 [2024-11-26 19:13:05.111555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.360 [2024-11-26 19:13:05.111567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.360 [2024-11-26 19:13:05.111579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.360 [2024-11-26 19:13:05.111587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.360 [2024-11-26 19:13:05.111601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.360 [2024-11-26 19:13:05.111609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.360 [2024-11-26 19:13:05.111621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.360 [2024-11-26 19:13:05.111628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.360 [2024-11-26 19:13:05.111640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.360 [2024-11-26 19:13:05.111647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.360 [2024-11-26 19:13:05.111659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.360 [2024-11-26 19:13:05.111666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.360 [2024-11-26 19:13:05.111678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.360 [2024-11-26 19:13:05.111685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.360 [2024-11-26 19:13:05.111696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.360 [2024-11-26 19:13:05.111704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.360 [2024-11-26 19:13:05.111715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.360 [2024-11-26 19:13:05.111723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.360 [2024-11-26 19:13:05.111734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.360 [2024-11-26 19:13:05.111741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.360 [2024-11-26 19:13:05.111753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.360 [2024-11-26 19:13:05.111760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.360 [2024-11-26 19:13:05.111772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.360 [2024-11-26 19:13:05.111779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.360 [2024-11-26 19:13:05.111791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.360 [2024-11-26 19:13:05.111798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.360 [2024-11-26 19:13:05.111810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.360 [2024-11-26 19:13:05.111817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.360 [2024-11-26 19:13:05.111828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.360 [2024-11-26 19:13:05.111842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.360 [2024-11-26 19:13:05.111853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.360 [2024-11-26 19:13:05.111861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.360 [2024-11-26 19:13:05.111872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.360 [2024-11-26 19:13:05.111879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.360 [2024-11-26 19:13:05.111891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.360 [2024-11-26 19:13:05.111898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.360 [2024-11-26 19:13:05.111910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.360 [2024-11-26 19:13:05.111918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.360 [2024-11-26 19:13:05.112657] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x12cb6c0 is same with the state(5) to be set 00:26:48.360 [2024-11-26 19:13:05.112717] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x12cb6c0 was disconnected and freed. reset controller. 00:26:48.360 [2024-11-26 19:13:05.112725] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:48.360 [2024-11-26 19:13:05.112781] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:26:48.360 [2024-11-26 19:13:05.112991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.360 [2024-11-26 19:13:05.113198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.360 [2024-11-26 19:13:05.113210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1303540 with addr=10.0.0.2, port=4420 00:26:48.360 [2024-11-26 19:13:05.113218] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1303540 is same with the state(5) to be set 00:26:48.360 [2024-11-26 19:13:05.113401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.360 [2024-11-26 19:13:05.113599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.360 [2024-11-26 19:13:05.113610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1321f10 with addr=10.0.0.2, port=4420 00:26:48.360 [2024-11-26 19:13:05.113618] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1321f10 is same with the state(5) to be set 00:26:48.360 [2024-11-26 19:13:05.113628] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x132e8e0 (9): Bad file descriptor 00:26:48.360 [2024-11-26 19:13:05.113638] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14a5150 (9): Bad file descriptor 00:26:48.360 [2024-11-26 19:13:05.113646] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.360 [2024-11-26 19:13:05.113653] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.360 [2024-11-26 19:13:05.113661] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.360 [2024-11-26 19:13:05.113687] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:48.360 [2024-11-26 19:13:05.113983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.360 [2024-11-26 19:13:05.113999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.360 [2024-11-26 19:13:05.114012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.360 [2024-11-26 19:13:05.114019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.360 [2024-11-26 19:13:05.114028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.360 [2024-11-26 19:13:05.114035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.360 [2024-11-26 19:13:05.114045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.361 [2024-11-26 19:13:05.114051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.361 [2024-11-26 19:13:05.114060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.361 [2024-11-26 19:13:05.114067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.361 [2024-11-26 19:13:05.114076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.361 [2024-11-26 19:13:05.114083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.361 [2024-11-26 19:13:05.114092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.361 [2024-11-26 19:13:05.114099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.361 [2024-11-26 19:13:05.114107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.361 [2024-11-26 19:13:05.114114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.361 [2024-11-26 19:13:05.114123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.361 [2024-11-26 19:13:05.114130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.361 [2024-11-26 19:13:05.114139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.361 [2024-11-26 19:13:05.114146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.361 [2024-11-26 19:13:05.114154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.361 [2024-11-26 19:13:05.114161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.361 [2024-11-26 19:13:05.114170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.361 [2024-11-26 19:13:05.114177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.361 [2024-11-26 19:13:05.114186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.361 [2024-11-26 19:13:05.114192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.361 [2024-11-26 19:13:05.114201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.361 [2024-11-26 19:13:05.114210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.361 [2024-11-26 19:13:05.114219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.361 [2024-11-26 19:13:05.114226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.361 [2024-11-26 19:13:05.114234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.361 [2024-11-26 19:13:05.114241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.361 [2024-11-26 19:13:05.114250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.361 [2024-11-26 19:13:05.114257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.361 [2024-11-26 19:13:05.114265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.361 [2024-11-26 19:13:05.114272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.361 [2024-11-26 19:13:05.114281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.361 [2024-11-26 19:13:05.114288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.361 [2024-11-26 19:13:05.114296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.361 [2024-11-26 19:13:05.114303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.361 [2024-11-26 19:13:05.114312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.361 [2024-11-26 19:13:05.114318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.361 [2024-11-26 19:13:05.114327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.361 [2024-11-26 19:13:05.114334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.361 [2024-11-26 19:13:05.114343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.361 [2024-11-26 19:13:05.114349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.361 [2024-11-26 19:13:05.114358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.361 [2024-11-26 19:13:05.114365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.361 [2024-11-26 19:13:05.114374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.361 [2024-11-26 19:13:05.114381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.361 [2024-11-26 19:13:05.114390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.361 [2024-11-26 19:13:05.114397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.361 [2024-11-26 19:13:05.114407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.361 [2024-11-26 19:13:05.114415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.361 [2024-11-26 19:13:05.114423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.361 [2024-11-26 19:13:05.114430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.361 [2024-11-26 19:13:05.114439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.362 [2024-11-26 19:13:05.114446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.362 [2024-11-26 19:13:05.114455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.362 [2024-11-26 19:13:05.114463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.362 [2024-11-26 19:13:05.114472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.362 [2024-11-26 19:13:05.114479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.362 [2024-11-26 19:13:05.114488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.362 [2024-11-26 19:13:05.114495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.362 [2024-11-26 19:13:05.114504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.362 [2024-11-26 19:13:05.114511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.362 [2024-11-26 19:13:05.114520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.362 [2024-11-26 19:13:05.114526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.362 [2024-11-26 19:13:05.114535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.362 [2024-11-26 19:13:05.114542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.362 [2024-11-26 19:13:05.114551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.362 [2024-11-26 19:13:05.114558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.362 [2024-11-26 19:13:05.114567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.362 [2024-11-26 19:13:05.114574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.362 [2024-11-26 19:13:05.114583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.362 [2024-11-26 19:13:05.114590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.362 [2024-11-26 19:13:05.114599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.362 [2024-11-26 19:13:05.114607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.362 [2024-11-26 19:13:05.114616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.362 [2024-11-26 19:13:05.114623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.362 [2024-11-26 19:13:05.114632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.362 [2024-11-26 19:13:05.114639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.362 [2024-11-26 19:13:05.114647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.362 [2024-11-26 19:13:05.114654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.362 [2024-11-26 19:13:05.114663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.362 [2024-11-26 19:13:05.114670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.362 [2024-11-26 19:13:05.114679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.362 [2024-11-26 19:13:05.114686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.362 [2024-11-26 19:13:05.114694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.362 [2024-11-26 19:13:05.114702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.362 [2024-11-26 19:13:05.114710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.362 [2024-11-26 19:13:05.114717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.362 [2024-11-26 19:13:05.114726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.362 [2024-11-26 19:13:05.114733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.362 [2024-11-26 19:13:05.114742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.362 [2024-11-26 19:13:05.114748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.362 [2024-11-26 19:13:05.114757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.362 [2024-11-26 19:13:05.114764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.362 [2024-11-26 19:13:05.114772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.362 [2024-11-26 19:13:05.114779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.362 [2024-11-26 19:13:05.114788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.362 [2024-11-26 19:13:05.114795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.362 [2024-11-26 19:13:05.114805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.362 [2024-11-26 19:13:05.114812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.362 [2024-11-26 19:13:05.114821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.362 [2024-11-26 19:13:05.114828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.362 [2024-11-26 19:13:05.114837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.362 [2024-11-26 19:13:05.114844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.362 [2024-11-26 19:13:05.114852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.362 [2024-11-26 19:13:05.114859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.362 [2024-11-26 19:13:05.114868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.362 [2024-11-26 19:13:05.114875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.362 [2024-11-26 19:13:05.114883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.362 [2024-11-26 19:13:05.114890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.362 [2024-11-26 19:13:05.114899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.362 [2024-11-26 19:13:05.114906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.362 [2024-11-26 19:13:05.114915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.362 [2024-11-26 19:13:05.114922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.363 [2024-11-26 19:13:05.114931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.363 [2024-11-26 19:13:05.114938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.363 [2024-11-26 19:13:05.115095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.363 [2024-11-26 19:13:05.115103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.363 [2024-11-26 19:13:05.115112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.363 [2024-11-26 19:13:05.115119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.363 [2024-11-26 19:13:05.115128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.363 [2024-11-26 19:13:05.115136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.363 [2024-11-26 19:13:05.115144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.363 [2024-11-26 19:13:05.115153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.363 [2024-11-26 19:13:05.115161] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x12c5fc0 is same with the state(5) to be set 00:26:48.363 [2024-11-26 19:13:05.116262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.363 [2024-11-26 19:13:05.116279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.363 [2024-11-26 19:13:05.116291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.363 [2024-11-26 19:13:05.116298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.363 [2024-11-26 19:13:05.116307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.363 [2024-11-26 19:13:05.116314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.363 [2024-11-26 19:13:05.116324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.363 [2024-11-26 19:13:05.116330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.363 [2024-11-26 19:13:05.116339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.363 [2024-11-26 19:13:05.116346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.363 [2024-11-26 19:13:05.116355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.363 [2024-11-26 19:13:05.116362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.363 [2024-11-26 19:13:05.116371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.363 [2024-11-26 19:13:05.116378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.363 [2024-11-26 19:13:05.116386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.363 [2024-11-26 19:13:05.116393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.363 [2024-11-26 19:13:05.116402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.363 [2024-11-26 19:13:05.116409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.363 [2024-11-26 19:13:05.116417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.363 [2024-11-26 19:13:05.116424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.363 [2024-11-26 19:13:05.116433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.363 [2024-11-26 19:13:05.116440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.363 [2024-11-26 19:13:05.116449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.363 [2024-11-26 19:13:05.116459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.363 [2024-11-26 19:13:05.116468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.363 [2024-11-26 19:13:05.116474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.363 [2024-11-26 19:13:05.116483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.363 [2024-11-26 19:13:05.116490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.363 [2024-11-26 19:13:05.116499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.363 [2024-11-26 19:13:05.116506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.363 [2024-11-26 19:13:05.116515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.363 [2024-11-26 19:13:05.116522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.363 [2024-11-26 19:13:05.116530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.363 [2024-11-26 19:13:05.116537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.363 [2024-11-26 19:13:05.116546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.363 [2024-11-26 19:13:05.116553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.363 [2024-11-26 19:13:05.116562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.363 [2024-11-26 19:13:05.116569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.363 [2024-11-26 19:13:05.116577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.363 [2024-11-26 19:13:05.116584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.363 [2024-11-26 19:13:05.116593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.363 [2024-11-26 19:13:05.116599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.363 [2024-11-26 19:13:05.116608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.363 [2024-11-26 19:13:05.116615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.363 [2024-11-26 19:13:05.116623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.363 [2024-11-26 19:13:05.116630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.363 [2024-11-26 19:13:05.116639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.363 [2024-11-26 19:13:05.116645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.363 [2024-11-26 19:13:05.116655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.363 [2024-11-26 19:13:05.116663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.363 [2024-11-26 19:13:05.116671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.364 [2024-11-26 19:13:05.116678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.364 [2024-11-26 19:13:05.116687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.364 [2024-11-26 19:13:05.116694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.364 [2024-11-26 19:13:05.116702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.364 [2024-11-26 19:13:05.116709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.364 [2024-11-26 19:13:05.116718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.364 [2024-11-26 19:13:05.116725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.364 [2024-11-26 19:13:05.116734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.364 [2024-11-26 19:13:05.116742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.364 [2024-11-26 19:13:05.116751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.364 [2024-11-26 19:13:05.116758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.364 [2024-11-26 19:13:05.116767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.364 [2024-11-26 19:13:05.116774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.364 [2024-11-26 19:13:05.116783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.364 [2024-11-26 19:13:05.116790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.364 [2024-11-26 19:13:05.116798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.364 [2024-11-26 19:13:05.116805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.364 [2024-11-26 19:13:05.116814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.364 [2024-11-26 19:13:05.116821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.364 [2024-11-26 19:13:05.116829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.364 [2024-11-26 19:13:05.116836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.364 [2024-11-26 19:13:05.116845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.364 [2024-11-26 19:13:05.116853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.364 [2024-11-26 19:13:05.116862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.364 [2024-11-26 19:13:05.116869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.364 [2024-11-26 19:13:05.116877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.364 [2024-11-26 19:13:05.116884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.364 [2024-11-26 19:13:05.116893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.364 [2024-11-26 19:13:05.116900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.364 [2024-11-26 19:13:05.116908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.364 [2024-11-26 19:13:05.116915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.364 [2024-11-26 19:13:05.116924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.364 [2024-11-26 19:13:05.116931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.364 [2024-11-26 19:13:05.116939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.364 [2024-11-26 19:13:05.116953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.364 [2024-11-26 19:13:05.116962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.364 [2024-11-26 19:13:05.116969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.364 [2024-11-26 19:13:05.116977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.364 [2024-11-26 19:13:05.116985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.364 [2024-11-26 19:13:05.116993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.364 [2024-11-26 19:13:05.117000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.364 [2024-11-26 19:13:05.117009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.364 [2024-11-26 19:13:05.117016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.364 [2024-11-26 19:13:05.117024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.364 [2024-11-26 19:13:05.117031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.364 [2024-11-26 19:13:05.117040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.364 [2024-11-26 19:13:05.117047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.364 [2024-11-26 19:13:05.117057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.364 [2024-11-26 19:13:05.117064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.364 [2024-11-26 19:13:05.117073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.364 [2024-11-26 19:13:05.117080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.364 [2024-11-26 19:13:05.117088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.364 [2024-11-26 19:13:05.117095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.364 [2024-11-26 19:13:05.117104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.364 [2024-11-26 19:13:05.117111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.364 [2024-11-26 19:13:05.117119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.364 [2024-11-26 19:13:05.117126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.364 [2024-11-26 19:13:05.117136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.364 [2024-11-26 19:13:05.117143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.364 [2024-11-26 19:13:05.117151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.364 [2024-11-26 19:13:05.117158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.364 [2024-11-26 19:13:05.117167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.364 [2024-11-26 19:13:05.117174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.365 [2024-11-26 19:13:05.117182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.365 [2024-11-26 19:13:05.117189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.365 [2024-11-26 19:13:05.117197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.365 [2024-11-26 19:13:05.117204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.365 [2024-11-26 19:13:05.117213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.365 [2024-11-26 19:13:05.117220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.365 [2024-11-26 19:13:05.117228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.365 [2024-11-26 19:13:05.117235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.365 [2024-11-26 19:13:05.117244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.365 [2024-11-26 19:13:05.117254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.365 [2024-11-26 19:13:05.117262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.365 [2024-11-26 19:13:05.117269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.365 [2024-11-26 19:13:05.117278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.365 [2024-11-26 19:13:05.117285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.365 [2024-11-26 19:13:05.117293] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x12ce290 is same with the state(5) to be set 00:26:48.365 [2024-11-26 19:13:05.118629] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.365 [2024-11-26 19:13:05.118647] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:26:48.365 [2024-11-26 19:13:05.118658] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:26:48.365 [2024-11-26 19:13:05.118667] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:26:48.365 [2024-11-26 19:13:05.118677] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:26:48.365 [2024-11-26 19:13:05.118713] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1303540 (9): Bad file descriptor 00:26:48.365 [2024-11-26 19:13:05.118723] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1321f10 (9): Bad file descriptor 00:26:48.365 [2024-11-26 19:13:05.118732] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode6] Ctrlr is in error state 00:26:48.365 [2024-11-26 19:13:05.118738] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode6] controller reinitialization failed 00:26:48.365 [2024-11-26 19:13:05.118747] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:26:48.365 [2024-11-26 19:13:05.118758] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode7] Ctrlr is in error state 00:26:48.365 [2024-11-26 19:13:05.118765] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode7] controller reinitialization failed 00:26:48.365 [2024-11-26 19:13:05.118772] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:26:48.365 [2024-11-26 19:13:05.118785] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:48.365 [2024-11-26 19:13:05.118796] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:48.365 [2024-11-26 19:13:05.118827] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:48.365 [2024-11-26 19:13:05.118838] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:48.365 [2024-11-26 19:13:05.119333] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.365 [2024-11-26 19:13:05.119346] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.365 [2024-11-26 19:13:05.119602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.365 [2024-11-26 19:13:05.119805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.365 [2024-11-26 19:13:05.119818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x130b1d0 with addr=10.0.0.2, port=4420 00:26:48.365 [2024-11-26 19:13:05.119827] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x130b1d0 is same with the state(5) to be set 00:26:48.365 [2024-11-26 19:13:05.120034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.365 [2024-11-26 19:13:05.120202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.365 [2024-11-26 19:13:05.120215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1323d00 with addr=10.0.0.2, port=4420 00:26:48.365 [2024-11-26 19:13:05.120222] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1323d00 is same with the state(5) to be set 00:26:48.365 [2024-11-26 19:13:05.120367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.365 [2024-11-26 19:13:05.120431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.365 [2024-11-26 19:13:05.120441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14625e0 with addr=10.0.0.2, port=4420 00:26:48.365 [2024-11-26 19:13:05.120448] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14625e0 is same with the state(5) to be set 00:26:48.365 [2024-11-26 19:13:05.120574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.365 [2024-11-26 19:13:05.120793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.365 [2024-11-26 19:13:05.120805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x12cfcd0 with addr=10.0.0.2, port=4420 00:26:48.365 [2024-11-26 19:13:05.120812] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x12cfcd0 is same with the state(5) to be set 00:26:48.365 [2024-11-26 19:13:05.120819] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:26:48.365 [2024-11-26 19:13:05.120825] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:26:48.365 [2024-11-26 19:13:05.120833] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:26:48.365 [2024-11-26 19:13:05.120845] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:26:48.365 [2024-11-26 19:13:05.120851] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:26:48.365 [2024-11-26 19:13:05.120858] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:26:48.365 [2024-11-26 19:13:05.121162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.365 [2024-11-26 19:13:05.121175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.365 [2024-11-26 19:13:05.121188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.365 [2024-11-26 19:13:05.121195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.365 [2024-11-26 19:13:05.121205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.365 [2024-11-26 19:13:05.121211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.365 [2024-11-26 19:13:05.121221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.365 [2024-11-26 19:13:05.121227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.365 [2024-11-26 19:13:05.121236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.365 [2024-11-26 19:13:05.121243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.365 [2024-11-26 19:13:05.121252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.366 [2024-11-26 19:13:05.121262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.366 [2024-11-26 19:13:05.121270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.366 [2024-11-26 19:13:05.121276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.366 [2024-11-26 19:13:05.121285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.366 [2024-11-26 19:13:05.121292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.366 [2024-11-26 19:13:05.121300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.366 [2024-11-26 19:13:05.121307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.366 [2024-11-26 19:13:05.121316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.366 [2024-11-26 19:13:05.121323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.366 [2024-11-26 19:13:05.121331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.366 [2024-11-26 19:13:05.121338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.366 [2024-11-26 19:13:05.121347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.366 [2024-11-26 19:13:05.121354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.366 [2024-11-26 19:13:05.121362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.366 [2024-11-26 19:13:05.121368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.366 [2024-11-26 19:13:05.121377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.366 [2024-11-26 19:13:05.121383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.366 [2024-11-26 19:13:05.121392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.366 [2024-11-26 19:13:05.121398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.366 [2024-11-26 19:13:05.121406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.366 [2024-11-26 19:13:05.121413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.366 [2024-11-26 19:13:05.121421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.366 [2024-11-26 19:13:05.121428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.366 [2024-11-26 19:13:05.121436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.366 [2024-11-26 19:13:05.121443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.366 [2024-11-26 19:13:05.121452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.366 [2024-11-26 19:13:05.121459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.366 [2024-11-26 19:13:05.121468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.366 [2024-11-26 19:13:05.121474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.366 [2024-11-26 19:13:05.121483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.366 [2024-11-26 19:13:05.121489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.366 [2024-11-26 19:13:05.121497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.366 [2024-11-26 19:13:05.121504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.366 [2024-11-26 19:13:05.121513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.366 [2024-11-26 19:13:05.121519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.366 [2024-11-26 19:13:05.121527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.366 [2024-11-26 19:13:05.121534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.366 [2024-11-26 19:13:05.121542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.366 [2024-11-26 19:13:05.121549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.366 [2024-11-26 19:13:05.121558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.366 [2024-11-26 19:13:05.121564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.366 [2024-11-26 19:13:05.121572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.366 [2024-11-26 19:13:05.121579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.366 [2024-11-26 19:13:05.121588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.366 [2024-11-26 19:13:05.121594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.366 [2024-11-26 19:13:05.121603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.366 [2024-11-26 19:13:05.121609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.366 [2024-11-26 19:13:05.121618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.366 [2024-11-26 19:13:05.121625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.366 [2024-11-26 19:13:05.121633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.366 [2024-11-26 19:13:05.121641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.366 [2024-11-26 19:13:05.121650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.366 [2024-11-26 19:13:05.121657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.366 [2024-11-26 19:13:05.121667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.366 [2024-11-26 19:13:05.121674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.366 [2024-11-26 19:13:05.121683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.366 [2024-11-26 19:13:05.121690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.366 [2024-11-26 19:13:05.121699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.366 [2024-11-26 19:13:05.121705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.366 [2024-11-26 19:13:05.121713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.366 [2024-11-26 19:13:05.121720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.366 [2024-11-26 19:13:05.121728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.366 [2024-11-26 19:13:05.121735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.367 [2024-11-26 19:13:05.121743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.367 [2024-11-26 19:13:05.121750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.367 [2024-11-26 19:13:05.121758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.367 [2024-11-26 19:13:05.121765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.367 [2024-11-26 19:13:05.121773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.367 [2024-11-26 19:13:05.121780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.367 [2024-11-26 19:13:05.121788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.367 [2024-11-26 19:13:05.121794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.367 [2024-11-26 19:13:05.121802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.367 [2024-11-26 19:13:05.121809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.367 [2024-11-26 19:13:05.121817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.367 [2024-11-26 19:13:05.121824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.367 [2024-11-26 19:13:05.121834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.367 [2024-11-26 19:13:05.121840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.367 [2024-11-26 19:13:05.121848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.367 [2024-11-26 19:13:05.121856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.367 [2024-11-26 19:13:05.121864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.367 [2024-11-26 19:13:05.121870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.367 [2024-11-26 19:13:05.121879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.367 [2024-11-26 19:13:05.121886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.367 [2024-11-26 19:13:05.121895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.367 [2024-11-26 19:13:05.121902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.367 [2024-11-26 19:13:05.121910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.367 [2024-11-26 19:13:05.121917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.367 [2024-11-26 19:13:05.121925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.367 [2024-11-26 19:13:05.121932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.367 [2024-11-26 19:13:05.121941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.367 [2024-11-26 19:13:05.121960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.367 [2024-11-26 19:13:05.121969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.367 [2024-11-26 19:13:05.121975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.367 [2024-11-26 19:13:05.121983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.367 [2024-11-26 19:13:05.121990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.367 [2024-11-26 19:13:05.121998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.367 [2024-11-26 19:13:05.122005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.367 [2024-11-26 19:13:05.122013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.367 [2024-11-26 19:13:05.122020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.367 [2024-11-26 19:13:05.122028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.367 [2024-11-26 19:13:05.122036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.367 [2024-11-26 19:13:05.122044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.367 [2024-11-26 19:13:05.122051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.367 [2024-11-26 19:13:05.122059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.367 [2024-11-26 19:13:05.122066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.367 [2024-11-26 19:13:05.122074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.367 [2024-11-26 19:13:05.122081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.367 [2024-11-26 19:13:05.122089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.367 [2024-11-26 19:13:05.122096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.367 [2024-11-26 19:13:05.122104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.367 [2024-11-26 19:13:05.122111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.367 [2024-11-26 19:13:05.122119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.367 [2024-11-26 19:13:05.122127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.368 [2024-11-26 19:13:05.122136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.368 [2024-11-26 19:13:05.122142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.368 [2024-11-26 19:13:05.122150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.368 [2024-11-26 19:13:05.122157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.368 [2024-11-26 19:13:05.122164] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x12cccb0 is same with the state(5) to be set 00:26:48.368 [2024-11-26 19:13:05.124933] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.368 [2024-11-26 19:13:05.124955] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.368 task offset: 29184 on job bdev=Nvme1n1 fails 00:26:48.368 00:26:48.368 Latency(us) 00:26:48.368 [2024-11-26T18:13:05.295Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:48.368 [2024-11-26T18:13:05.295Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:48.368 [2024-11-26T18:13:05.295Z] Job: Nvme1n1 ended in about 0.48 seconds with error 00:26:48.368 Verification LBA range: start 0x0 length 0x400 00:26:48.368 Nvme1n1 : 0.48 429.06 26.82 132.02 0.00 113054.94 10143.83 111240.24 00:26:48.368 [2024-11-26T18:13:05.295Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:48.368 [2024-11-26T18:13:05.295Z] Job: Nvme2n1 ended in about 0.51 seconds with error 00:26:48.368 Verification LBA range: start 0x0 length 0x400 00:26:48.368 Nvme2n1 : 0.51 403.54 25.22 43.10 0.00 138918.82 7465.41 132211.76 00:26:48.368 [2024-11-26T18:13:05.295Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:48.368 [2024-11-26T18:13:05.295Z] Job: Nvme3n1 ended in about 0.52 seconds with error 00:26:48.368 Verification LBA range: start 0x0 length 0x400 00:26:48.368 Nvme3n1 : 0.52 403.37 25.21 124.11 0.00 117063.05 48781.58 126740.93 00:26:48.368 [2024-11-26T18:13:05.295Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:48.368 [2024-11-26T18:13:05.295Z] Job: Nvme4n1 ended in about 0.52 seconds with error 00:26:48.368 Verification LBA range: start 0x0 length 0x400 00:26:48.368 Nvme4n1 : 0.52 399.27 24.95 122.85 0.00 116939.02 53112.65 119446.48 00:26:48.368 [2024-11-26T18:13:05.295Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:48.368 [2024-11-26T18:13:05.295Z] Job: Nvme5n1 ended in about 0.51 seconds with error 00:26:48.368 Verification LBA range: start 0x0 length 0x400 00:26:48.368 Nvme5n1 : 0.51 408.78 25.55 125.78 0.00 112535.87 47185.92 94371.84 00:26:48.368 [2024-11-26T18:13:05.295Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:48.368 [2024-11-26T18:13:05.295Z] Job: Nvme6n1 ended in about 0.51 seconds with error 00:26:48.368 Verification LBA range: start 0x0 length 0x400 00:26:48.368 Nvme6n1 : 0.51 411.79 25.74 126.71 0.00 110166.69 21769.35 97563.16 00:26:48.368 [2024-11-26T18:13:05.295Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:48.368 [2024-11-26T18:13:05.295Z] Job: Nvme7n1 ended in about 0.51 seconds with error 00:26:48.368 Verification LBA range: start 0x0 length 0x400 00:26:48.368 Nvme7n1 : 0.51 410.81 25.68 126.40 0.00 108903.74 38295.82 91636.42 00:26:48.368 [2024-11-26T18:13:05.295Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:48.368 [2024-11-26T18:13:05.295Z] Job: Nvme8n1 ended in about 0.52 seconds with error 00:26:48.368 Verification LBA range: start 0x0 length 0x400 00:26:48.368 Nvme8n1 : 0.52 398.08 24.88 42.51 0.00 130339.16 4502.04 108048.92 00:26:48.368 [2024-11-26T18:13:05.295Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:48.368 [2024-11-26T18:13:05.295Z] Job: Nvme9n1 ended in about 0.53 seconds with error 00:26:48.368 Verification LBA range: start 0x0 length 0x400 00:26:48.368 Nvme9n1 : 0.53 310.65 19.42 121.23 0.00 132341.73 80238.86 113975.65 00:26:48.368 [2024-11-26T18:13:05.295Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:48.368 [2024-11-26T18:13:05.295Z] Job: Nvme10n1 ended in about 0.52 seconds with error 00:26:48.368 Verification LBA range: start 0x0 length 0x400 00:26:48.368 Nvme10n1 : 0.52 313.53 19.60 122.35 0.00 129142.41 81150.66 102578.09 00:26:48.368 [2024-11-26T18:13:05.295Z] =================================================================================================================== 00:26:48.368 [2024-11-26T18:13:05.295Z] Total : 3888.87 243.05 1087.06 0.00 120128.00 4502.04 132211.76 00:26:48.368 [2024-11-26 19:13:05.148490] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:26:48.368 [2024-11-26 19:13:05.148530] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode9] resetting controller 00:26:48.368 [2024-11-26 19:13:05.148566] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x130b1d0 (9): Bad file descriptor 00:26:48.368 [2024-11-26 19:13:05.148580] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1323d00 (9): Bad file descriptor 00:26:48.368 [2024-11-26 19:13:05.148594] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14625e0 (9): Bad file descriptor 00:26:48.368 [2024-11-26 19:13:05.148604] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x12cfcd0 (9): Bad file descriptor 00:26:48.368 [2024-11-26 19:13:05.148968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.368 [2024-11-26 19:13:05.149210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.368 [2024-11-26 19:13:05.149222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x130a780 with addr=10.0.0.2, port=4420 00:26:48.368 [2024-11-26 19:13:05.149232] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x130a780 is same with the state(5) to be set 00:26:48.368 [2024-11-26 19:13:05.149240] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:26:48.368 [2024-11-26 19:13:05.149247] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:26:48.368 [2024-11-26 19:13:05.149260] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:26:48.368 [2024-11-26 19:13:05.149274] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:26:48.368 [2024-11-26 19:13:05.149280] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:26:48.368 [2024-11-26 19:13:05.149286] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:26:48.368 [2024-11-26 19:13:05.149296] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode8] Ctrlr is in error state 00:26:48.368 [2024-11-26 19:13:05.149302] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode8] controller reinitialization failed 00:26:48.368 [2024-11-26 19:13:05.149309] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:26:48.368 [2024-11-26 19:13:05.149318] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:26:48.368 [2024-11-26 19:13:05.149323] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:26:48.368 [2024-11-26 19:13:05.149330] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:26:48.368 [2024-11-26 19:13:05.149365] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:48.368 [2024-11-26 19:13:05.149375] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:48.368 [2024-11-26 19:13:05.149384] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:48.368 [2024-11-26 19:13:05.149392] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:48.368 [2024-11-26 19:13:05.149411] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:48.368 [2024-11-26 19:13:05.149660] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:48.368 [2024-11-26 19:13:05.149682] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.369 [2024-11-26 19:13:05.149690] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.369 [2024-11-26 19:13:05.149695] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.369 [2024-11-26 19:13:05.149700] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.369 [2024-11-26 19:13:05.149720] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x130a780 (9): Bad file descriptor 00:26:48.369 [2024-11-26 19:13:05.150019] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:26:48.369 [2024-11-26 19:13:05.150033] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:26:48.369 [2024-11-26 19:13:05.150185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.369 [2024-11-26 19:13:05.150396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.369 [2024-11-26 19:13:05.150408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x12d72f0 with addr=10.0.0.2, port=4420 00:26:48.369 [2024-11-26 19:13:05.150416] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x12d72f0 is same with the state(5) to be set 00:26:48.369 [2024-11-26 19:13:05.150424] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode9] Ctrlr is in error state 00:26:48.369 [2024-11-26 19:13:05.150429] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode9] controller reinitialization failed 00:26:48.369 [2024-11-26 19:13:05.150436] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode9] in failed state. 00:26:48.369 [2024-11-26 19:13:05.150462] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:26:48.369 [2024-11-26 19:13:05.150475] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:26:48.369 [2024-11-26 19:13:05.150492] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.369 [2024-11-26 19:13:05.150631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.369 [2024-11-26 19:13:05.150793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.369 [2024-11-26 19:13:05.150803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14a5150 with addr=10.0.0.2, port=4420 00:26:48.369 [2024-11-26 19:13:05.150811] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14a5150 is same with the state(5) to be set 00:26:48.369 [2024-11-26 19:13:05.150907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.369 [2024-11-26 19:13:05.151070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.369 [2024-11-26 19:13:05.151081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x132e8e0 with addr=10.0.0.2, port=4420 00:26:48.369 [2024-11-26 19:13:05.151089] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x132e8e0 is same with the state(5) to be set 00:26:48.369 [2024-11-26 19:13:05.151098] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x12d72f0 (9): Bad file descriptor 00:26:48.369 [2024-11-26 19:13:05.151262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.369 [2024-11-26 19:13:05.151486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.369 [2024-11-26 19:13:05.151496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1321f10 with addr=10.0.0.2, port=4420 00:26:48.369 [2024-11-26 19:13:05.151503] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1321f10 is same with the state(5) to be set 00:26:48.369 [2024-11-26 19:13:05.151724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.369 [2024-11-26 19:13:05.151824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:48.369 [2024-11-26 19:13:05.151835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1303540 with addr=10.0.0.2, port=4420 00:26:48.369 [2024-11-26 19:13:05.151842] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1303540 is same with the state(5) to be set 00:26:48.369 [2024-11-26 19:13:05.151850] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14a5150 (9): Bad file descriptor 00:26:48.369 [2024-11-26 19:13:05.151858] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x132e8e0 (9): Bad file descriptor 00:26:48.369 [2024-11-26 19:13:05.151866] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:48.369 [2024-11-26 19:13:05.151871] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:48.369 [2024-11-26 19:13:05.151878] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:48.369 [2024-11-26 19:13:05.151901] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.369 [2024-11-26 19:13:05.151909] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1321f10 (9): Bad file descriptor 00:26:48.369 [2024-11-26 19:13:05.151917] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1303540 (9): Bad file descriptor 00:26:48.369 [2024-11-26 19:13:05.151924] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode7] Ctrlr is in error state 00:26:48.369 [2024-11-26 19:13:05.151930] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode7] controller reinitialization failed 00:26:48.369 [2024-11-26 19:13:05.151936] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:26:48.369 [2024-11-26 19:13:05.151945] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode6] Ctrlr is in error state 00:26:48.369 [2024-11-26 19:13:05.151968] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode6] controller reinitialization failed 00:26:48.369 [2024-11-26 19:13:05.151975] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:26:48.369 [2024-11-26 19:13:05.152000] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.369 [2024-11-26 19:13:05.152007] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.369 [2024-11-26 19:13:05.152012] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:26:48.369 [2024-11-26 19:13:05.152018] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:26:48.369 [2024-11-26 19:13:05.152024] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:26:48.369 [2024-11-26 19:13:05.152032] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:26:48.369 [2024-11-26 19:13:05.152038] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:26:48.369 [2024-11-26 19:13:05.152044] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:26:48.369 [2024-11-26 19:13:05.152066] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.369 [2024-11-26 19:13:05.152072] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.628 19:13:05 -- target/shutdown.sh@135 -- # nvmfpid= 00:26:48.628 19:13:05 -- target/shutdown.sh@138 -- # sleep 1 00:26:50.007 19:13:06 -- target/shutdown.sh@141 -- # kill -9 3216953 00:26:50.007 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 141: kill: (3216953) - No such process 00:26:50.007 19:13:06 -- target/shutdown.sh@141 -- # true 00:26:50.007 19:13:06 -- target/shutdown.sh@143 -- # stoptarget 00:26:50.007 19:13:06 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:26:50.007 19:13:06 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:26:50.007 19:13:06 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:26:50.007 19:13:06 -- target/shutdown.sh@45 -- # nvmftestfini 00:26:50.007 19:13:06 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:50.007 19:13:06 -- nvmf/common.sh@116 -- # sync 00:26:50.007 19:13:06 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:50.007 19:13:06 -- nvmf/common.sh@119 -- # set +e 00:26:50.007 19:13:06 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:50.007 19:13:06 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:50.007 rmmod nvme_tcp 00:26:50.007 rmmod nvme_fabrics 00:26:50.007 rmmod nvme_keyring 00:26:50.007 19:13:06 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:50.007 19:13:06 -- nvmf/common.sh@123 -- # set -e 00:26:50.007 19:13:06 -- nvmf/common.sh@124 -- # return 0 00:26:50.007 19:13:06 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:26:50.007 19:13:06 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:50.007 19:13:06 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:50.007 19:13:06 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:50.007 19:13:06 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:50.007 19:13:06 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:50.007 19:13:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:50.007 19:13:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:50.007 19:13:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:51.911 19:13:08 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:51.911 00:26:51.911 real 0m7.284s 00:26:51.911 user 0m17.146s 00:26:51.911 sys 0m1.168s 00:26:51.911 19:13:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:51.911 19:13:08 -- common/autotest_common.sh@10 -- # set +x 00:26:51.911 ************************************ 00:26:51.911 END TEST nvmf_shutdown_tc3 00:26:51.911 ************************************ 00:26:51.911 19:13:08 -- target/shutdown.sh@150 -- # trap - SIGINT SIGTERM EXIT 00:26:51.911 00:26:51.911 real 0m29.911s 00:26:51.911 user 1m14.704s 00:26:51.911 sys 0m7.894s 00:26:51.911 19:13:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:51.911 19:13:08 -- common/autotest_common.sh@10 -- # set +x 00:26:51.911 ************************************ 00:26:51.911 END TEST nvmf_shutdown 00:26:51.911 ************************************ 00:26:51.911 19:13:08 -- nvmf/nvmf.sh@86 -- # timing_exit target 00:26:51.911 19:13:08 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:51.911 19:13:08 -- common/autotest_common.sh@10 -- # set +x 00:26:51.911 19:13:08 -- nvmf/nvmf.sh@88 -- # timing_enter host 00:26:51.911 19:13:08 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:51.911 19:13:08 -- common/autotest_common.sh@10 -- # set +x 00:26:51.911 19:13:08 -- nvmf/nvmf.sh@90 -- # [[ 0 -eq 0 ]] 00:26:51.911 19:13:08 -- nvmf/nvmf.sh@91 -- # run_test nvmf_multicontroller /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:26:51.911 19:13:08 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:51.911 19:13:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:51.911 19:13:08 -- common/autotest_common.sh@10 -- # set +x 00:26:51.911 ************************************ 00:26:51.911 START TEST nvmf_multicontroller 00:26:51.911 ************************************ 00:26:51.911 19:13:08 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:26:52.170 * Looking for test storage... 00:26:52.170 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:52.170 19:13:08 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:52.170 19:13:08 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:52.170 19:13:08 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:52.170 19:13:08 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:52.170 19:13:08 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:52.170 19:13:08 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:52.170 19:13:08 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:52.170 19:13:08 -- scripts/common.sh@335 -- # IFS=.-: 00:26:52.170 19:13:08 -- scripts/common.sh@335 -- # read -ra ver1 00:26:52.170 19:13:08 -- scripts/common.sh@336 -- # IFS=.-: 00:26:52.170 19:13:08 -- scripts/common.sh@336 -- # read -ra ver2 00:26:52.170 19:13:08 -- scripts/common.sh@337 -- # local 'op=<' 00:26:52.170 19:13:08 -- scripts/common.sh@339 -- # ver1_l=2 00:26:52.170 19:13:08 -- scripts/common.sh@340 -- # ver2_l=1 00:26:52.170 19:13:08 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:52.170 19:13:08 -- scripts/common.sh@343 -- # case "$op" in 00:26:52.170 19:13:08 -- scripts/common.sh@344 -- # : 1 00:26:52.170 19:13:08 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:52.170 19:13:08 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:52.170 19:13:08 -- scripts/common.sh@364 -- # decimal 1 00:26:52.170 19:13:08 -- scripts/common.sh@352 -- # local d=1 00:26:52.170 19:13:08 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:52.170 19:13:08 -- scripts/common.sh@354 -- # echo 1 00:26:52.170 19:13:08 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:52.170 19:13:08 -- scripts/common.sh@365 -- # decimal 2 00:26:52.170 19:13:08 -- scripts/common.sh@352 -- # local d=2 00:26:52.170 19:13:08 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:52.170 19:13:08 -- scripts/common.sh@354 -- # echo 2 00:26:52.170 19:13:08 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:52.170 19:13:08 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:52.170 19:13:08 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:52.170 19:13:08 -- scripts/common.sh@367 -- # return 0 00:26:52.170 19:13:08 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:52.170 19:13:08 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:52.170 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:52.170 --rc genhtml_branch_coverage=1 00:26:52.170 --rc genhtml_function_coverage=1 00:26:52.170 --rc genhtml_legend=1 00:26:52.170 --rc geninfo_all_blocks=1 00:26:52.170 --rc geninfo_unexecuted_blocks=1 00:26:52.170 00:26:52.170 ' 00:26:52.170 19:13:08 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:52.170 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:52.170 --rc genhtml_branch_coverage=1 00:26:52.170 --rc genhtml_function_coverage=1 00:26:52.170 --rc genhtml_legend=1 00:26:52.170 --rc geninfo_all_blocks=1 00:26:52.170 --rc geninfo_unexecuted_blocks=1 00:26:52.170 00:26:52.170 ' 00:26:52.170 19:13:08 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:52.170 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:52.170 --rc genhtml_branch_coverage=1 00:26:52.170 --rc genhtml_function_coverage=1 00:26:52.170 --rc genhtml_legend=1 00:26:52.170 --rc geninfo_all_blocks=1 00:26:52.170 --rc geninfo_unexecuted_blocks=1 00:26:52.170 00:26:52.170 ' 00:26:52.170 19:13:08 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:52.170 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:52.170 --rc genhtml_branch_coverage=1 00:26:52.170 --rc genhtml_function_coverage=1 00:26:52.170 --rc genhtml_legend=1 00:26:52.170 --rc geninfo_all_blocks=1 00:26:52.170 --rc geninfo_unexecuted_blocks=1 00:26:52.170 00:26:52.170 ' 00:26:52.170 19:13:08 -- host/multicontroller.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:52.170 19:13:08 -- nvmf/common.sh@7 -- # uname -s 00:26:52.170 19:13:08 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:52.170 19:13:08 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:52.170 19:13:08 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:52.170 19:13:08 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:52.170 19:13:08 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:52.170 19:13:08 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:52.170 19:13:08 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:52.170 19:13:08 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:52.170 19:13:08 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:52.170 19:13:08 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:52.170 19:13:08 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:26:52.170 19:13:08 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:26:52.170 19:13:08 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:52.170 19:13:08 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:52.170 19:13:08 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:52.170 19:13:08 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:52.170 19:13:08 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:52.170 19:13:08 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:52.170 19:13:08 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:52.170 19:13:08 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:52.170 19:13:08 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:52.170 19:13:08 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:52.170 19:13:08 -- paths/export.sh@5 -- # export PATH 00:26:52.171 19:13:08 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:52.171 19:13:08 -- nvmf/common.sh@46 -- # : 0 00:26:52.171 19:13:08 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:52.171 19:13:08 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:52.171 19:13:08 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:52.171 19:13:08 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:52.171 19:13:08 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:52.171 19:13:08 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:52.171 19:13:08 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:52.171 19:13:08 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:52.171 19:13:08 -- host/multicontroller.sh@11 -- # MALLOC_BDEV_SIZE=64 00:26:52.171 19:13:08 -- host/multicontroller.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:26:52.171 19:13:08 -- host/multicontroller.sh@13 -- # NVMF_HOST_FIRST_PORT=60000 00:26:52.171 19:13:08 -- host/multicontroller.sh@14 -- # NVMF_HOST_SECOND_PORT=60001 00:26:52.171 19:13:08 -- host/multicontroller.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:26:52.171 19:13:08 -- host/multicontroller.sh@18 -- # '[' tcp == rdma ']' 00:26:52.171 19:13:08 -- host/multicontroller.sh@23 -- # nvmftestinit 00:26:52.171 19:13:08 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:52.171 19:13:08 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:52.171 19:13:08 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:52.171 19:13:08 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:52.171 19:13:08 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:52.171 19:13:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:52.171 19:13:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:52.171 19:13:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:52.171 19:13:08 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:52.171 19:13:08 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:52.171 19:13:08 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:52.171 19:13:08 -- common/autotest_common.sh@10 -- # set +x 00:26:57.441 19:13:14 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:57.441 19:13:14 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:57.441 19:13:14 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:57.441 19:13:14 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:57.441 19:13:14 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:57.441 19:13:14 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:57.441 19:13:14 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:57.441 19:13:14 -- nvmf/common.sh@294 -- # net_devs=() 00:26:57.441 19:13:14 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:57.441 19:13:14 -- nvmf/common.sh@295 -- # e810=() 00:26:57.441 19:13:14 -- nvmf/common.sh@295 -- # local -ga e810 00:26:57.441 19:13:14 -- nvmf/common.sh@296 -- # x722=() 00:26:57.441 19:13:14 -- nvmf/common.sh@296 -- # local -ga x722 00:26:57.441 19:13:14 -- nvmf/common.sh@297 -- # mlx=() 00:26:57.441 19:13:14 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:57.441 19:13:14 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:57.441 19:13:14 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:57.441 19:13:14 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:57.441 19:13:14 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:57.441 19:13:14 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:57.441 19:13:14 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:57.441 19:13:14 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:57.441 19:13:14 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:57.441 19:13:14 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:57.441 19:13:14 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:57.441 19:13:14 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:57.441 19:13:14 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:57.441 19:13:14 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:57.441 19:13:14 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:57.441 19:13:14 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:57.441 19:13:14 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:57.441 19:13:14 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:57.442 19:13:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:57.442 19:13:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:26:57.442 Found 0000:86:00.0 (0x8086 - 0x159b) 00:26:57.442 19:13:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:57.442 19:13:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:57.442 19:13:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:57.442 19:13:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:57.442 19:13:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:57.442 19:13:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:57.442 19:13:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:26:57.442 Found 0000:86:00.1 (0x8086 - 0x159b) 00:26:57.442 19:13:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:57.442 19:13:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:57.442 19:13:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:57.442 19:13:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:57.442 19:13:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:57.442 19:13:14 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:57.442 19:13:14 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:57.442 19:13:14 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:57.442 19:13:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:57.442 19:13:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:57.442 19:13:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:57.442 19:13:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:57.442 19:13:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:26:57.442 Found net devices under 0000:86:00.0: cvl_0_0 00:26:57.442 19:13:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:57.442 19:13:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:57.442 19:13:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:57.442 19:13:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:57.442 19:13:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:57.442 19:13:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:26:57.442 Found net devices under 0000:86:00.1: cvl_0_1 00:26:57.442 19:13:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:57.442 19:13:14 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:57.442 19:13:14 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:57.442 19:13:14 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:57.442 19:13:14 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:57.442 19:13:14 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:57.442 19:13:14 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:57.442 19:13:14 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:57.442 19:13:14 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:57.442 19:13:14 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:57.442 19:13:14 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:57.442 19:13:14 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:57.442 19:13:14 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:57.442 19:13:14 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:57.442 19:13:14 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:57.442 19:13:14 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:57.442 19:13:14 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:57.442 19:13:14 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:57.442 19:13:14 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:57.442 19:13:14 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:57.442 19:13:14 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:57.442 19:13:14 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:57.442 19:13:14 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:57.442 19:13:14 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:57.442 19:13:14 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:57.442 19:13:14 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:57.442 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:57.442 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.277 ms 00:26:57.442 00:26:57.442 --- 10.0.0.2 ping statistics --- 00:26:57.442 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:57.442 rtt min/avg/max/mdev = 0.277/0.277/0.277/0.000 ms 00:26:57.442 19:13:14 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:57.442 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:57.442 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.140 ms 00:26:57.442 00:26:57.442 --- 10.0.0.1 ping statistics --- 00:26:57.442 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:57.442 rtt min/avg/max/mdev = 0.140/0.140/0.140/0.000 ms 00:26:57.442 19:13:14 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:57.442 19:13:14 -- nvmf/common.sh@410 -- # return 0 00:26:57.442 19:13:14 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:57.442 19:13:14 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:57.442 19:13:14 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:57.442 19:13:14 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:57.442 19:13:14 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:57.442 19:13:14 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:57.442 19:13:14 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:57.442 19:13:14 -- host/multicontroller.sh@25 -- # nvmfappstart -m 0xE 00:26:57.442 19:13:14 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:57.442 19:13:14 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:57.442 19:13:14 -- common/autotest_common.sh@10 -- # set +x 00:26:57.442 19:13:14 -- nvmf/common.sh@469 -- # nvmfpid=3221018 00:26:57.442 19:13:14 -- nvmf/common.sh@470 -- # waitforlisten 3221018 00:26:57.442 19:13:14 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:26:57.442 19:13:14 -- common/autotest_common.sh@829 -- # '[' -z 3221018 ']' 00:26:57.442 19:13:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:57.442 19:13:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:57.442 19:13:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:57.442 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:57.442 19:13:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:57.442 19:13:14 -- common/autotest_common.sh@10 -- # set +x 00:26:57.442 [2024-11-26 19:13:14.349158] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:26:57.442 [2024-11-26 19:13:14.349205] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:57.701 EAL: No free 2048 kB hugepages reported on node 1 00:26:57.701 [2024-11-26 19:13:14.408690] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:26:57.701 [2024-11-26 19:13:14.447586] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:57.701 [2024-11-26 19:13:14.447716] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:57.701 [2024-11-26 19:13:14.447725] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:57.701 [2024-11-26 19:13:14.447732] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:57.701 [2024-11-26 19:13:14.447848] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:26:57.701 [2024-11-26 19:13:14.447869] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:26:57.701 [2024-11-26 19:13:14.447880] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:58.636 19:13:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:58.636 19:13:15 -- common/autotest_common.sh@862 -- # return 0 00:26:58.636 19:13:15 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:58.636 19:13:15 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:58.636 19:13:15 -- common/autotest_common.sh@10 -- # set +x 00:26:58.636 19:13:15 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:58.636 19:13:15 -- host/multicontroller.sh@27 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:26:58.636 19:13:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:58.636 19:13:15 -- common/autotest_common.sh@10 -- # set +x 00:26:58.636 [2024-11-26 19:13:15.235628] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:58.636 19:13:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:58.636 19:13:15 -- host/multicontroller.sh@29 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:26:58.636 19:13:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:58.636 19:13:15 -- common/autotest_common.sh@10 -- # set +x 00:26:58.636 Malloc0 00:26:58.636 19:13:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:58.636 19:13:15 -- host/multicontroller.sh@30 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:26:58.636 19:13:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:58.636 19:13:15 -- common/autotest_common.sh@10 -- # set +x 00:26:58.636 19:13:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:58.636 19:13:15 -- host/multicontroller.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:26:58.636 19:13:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:58.636 19:13:15 -- common/autotest_common.sh@10 -- # set +x 00:26:58.636 19:13:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:58.636 19:13:15 -- host/multicontroller.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:58.636 19:13:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:58.636 19:13:15 -- common/autotest_common.sh@10 -- # set +x 00:26:58.636 [2024-11-26 19:13:15.296446] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:58.636 19:13:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:58.636 19:13:15 -- host/multicontroller.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:26:58.636 19:13:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:58.636 19:13:15 -- common/autotest_common.sh@10 -- # set +x 00:26:58.636 [2024-11-26 19:13:15.304405] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:26:58.636 19:13:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:58.636 19:13:15 -- host/multicontroller.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:26:58.636 19:13:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:58.636 19:13:15 -- common/autotest_common.sh@10 -- # set +x 00:26:58.636 Malloc1 00:26:58.636 19:13:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:58.636 19:13:15 -- host/multicontroller.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:26:58.636 19:13:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:58.636 19:13:15 -- common/autotest_common.sh@10 -- # set +x 00:26:58.636 19:13:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:58.636 19:13:15 -- host/multicontroller.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc1 00:26:58.636 19:13:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:58.636 19:13:15 -- common/autotest_common.sh@10 -- # set +x 00:26:58.636 19:13:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:58.636 19:13:15 -- host/multicontroller.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:26:58.636 19:13:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:58.636 19:13:15 -- common/autotest_common.sh@10 -- # set +x 00:26:58.636 19:13:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:58.636 19:13:15 -- host/multicontroller.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4421 00:26:58.636 19:13:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:58.636 19:13:15 -- common/autotest_common.sh@10 -- # set +x 00:26:58.636 19:13:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:58.636 19:13:15 -- host/multicontroller.sh@44 -- # bdevperf_pid=3221079 00:26:58.636 19:13:15 -- host/multicontroller.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w write -t 1 -f 00:26:58.636 19:13:15 -- host/multicontroller.sh@46 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; pap "$testdir/try.txt"; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:26:58.636 19:13:15 -- host/multicontroller.sh@47 -- # waitforlisten 3221079 /var/tmp/bdevperf.sock 00:26:58.636 19:13:15 -- common/autotest_common.sh@829 -- # '[' -z 3221079 ']' 00:26:58.636 19:13:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:26:58.636 19:13:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:58.636 19:13:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:26:58.636 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:26:58.636 19:13:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:58.636 19:13:15 -- common/autotest_common.sh@10 -- # set +x 00:26:59.572 19:13:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:59.572 19:13:16 -- common/autotest_common.sh@862 -- # return 0 00:26:59.572 19:13:16 -- host/multicontroller.sh@50 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:26:59.572 19:13:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:59.572 19:13:16 -- common/autotest_common.sh@10 -- # set +x 00:26:59.572 NVMe0n1 00:26:59.572 19:13:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:59.572 19:13:16 -- host/multicontroller.sh@54 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:26:59.572 19:13:16 -- host/multicontroller.sh@54 -- # grep -c NVMe 00:26:59.572 19:13:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:59.572 19:13:16 -- common/autotest_common.sh@10 -- # set +x 00:26:59.572 19:13:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:59.572 1 00:26:59.572 19:13:16 -- host/multicontroller.sh@60 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:26:59.572 19:13:16 -- common/autotest_common.sh@650 -- # local es=0 00:26:59.572 19:13:16 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:26:59.572 19:13:16 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:26:59.572 19:13:16 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:59.572 19:13:16 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:26:59.572 19:13:16 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:59.572 19:13:16 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:26:59.572 19:13:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:59.572 19:13:16 -- common/autotest_common.sh@10 -- # set +x 00:26:59.572 request: 00:26:59.572 { 00:26:59.572 "name": "NVMe0", 00:26:59.572 "trtype": "tcp", 00:26:59.572 "traddr": "10.0.0.2", 00:26:59.572 "hostnqn": "nqn.2021-09-7.io.spdk:00001", 00:26:59.572 "hostaddr": "10.0.0.2", 00:26:59.572 "hostsvcid": "60000", 00:26:59.572 "adrfam": "ipv4", 00:26:59.572 "trsvcid": "4420", 00:26:59.572 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:26:59.572 "method": "bdev_nvme_attach_controller", 00:26:59.572 "req_id": 1 00:26:59.572 } 00:26:59.572 Got JSON-RPC error response 00:26:59.572 response: 00:26:59.572 { 00:26:59.572 "code": -114, 00:26:59.572 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:26:59.572 } 00:26:59.572 19:13:16 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:26:59.572 19:13:16 -- common/autotest_common.sh@653 -- # es=1 00:26:59.572 19:13:16 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:26:59.572 19:13:16 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:26:59.572 19:13:16 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:26:59.572 19:13:16 -- host/multicontroller.sh@65 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:26:59.572 19:13:16 -- common/autotest_common.sh@650 -- # local es=0 00:26:59.572 19:13:16 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:26:59.572 19:13:16 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:26:59.572 19:13:16 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:59.572 19:13:16 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:26:59.572 19:13:16 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:59.572 19:13:16 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:26:59.572 19:13:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:59.572 19:13:16 -- common/autotest_common.sh@10 -- # set +x 00:26:59.572 request: 00:26:59.572 { 00:26:59.572 "name": "NVMe0", 00:26:59.572 "trtype": "tcp", 00:26:59.572 "traddr": "10.0.0.2", 00:26:59.572 "hostaddr": "10.0.0.2", 00:26:59.572 "hostsvcid": "60000", 00:26:59.572 "adrfam": "ipv4", 00:26:59.572 "trsvcid": "4420", 00:26:59.572 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:26:59.572 "method": "bdev_nvme_attach_controller", 00:26:59.572 "req_id": 1 00:26:59.572 } 00:26:59.572 Got JSON-RPC error response 00:26:59.572 response: 00:26:59.572 { 00:26:59.572 "code": -114, 00:26:59.572 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:26:59.572 } 00:26:59.572 19:13:16 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:26:59.572 19:13:16 -- common/autotest_common.sh@653 -- # es=1 00:26:59.572 19:13:16 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:26:59.572 19:13:16 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:26:59.572 19:13:16 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:26:59.572 19:13:16 -- host/multicontroller.sh@69 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:26:59.572 19:13:16 -- common/autotest_common.sh@650 -- # local es=0 00:26:59.572 19:13:16 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:26:59.572 19:13:16 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:26:59.572 19:13:16 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:59.572 19:13:16 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:26:59.572 19:13:16 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:59.572 19:13:16 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:26:59.572 19:13:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:59.572 19:13:16 -- common/autotest_common.sh@10 -- # set +x 00:26:59.572 request: 00:26:59.572 { 00:26:59.572 "name": "NVMe0", 00:26:59.572 "trtype": "tcp", 00:26:59.572 "traddr": "10.0.0.2", 00:26:59.572 "hostaddr": "10.0.0.2", 00:26:59.572 "hostsvcid": "60000", 00:26:59.572 "adrfam": "ipv4", 00:26:59.572 "trsvcid": "4420", 00:26:59.572 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:26:59.572 "multipath": "disable", 00:26:59.572 "method": "bdev_nvme_attach_controller", 00:26:59.572 "req_id": 1 00:26:59.572 } 00:26:59.572 Got JSON-RPC error response 00:26:59.572 response: 00:26:59.572 { 00:26:59.572 "code": -114, 00:26:59.572 "message": "A controller named NVMe0 already exists and multipath is disabled\n" 00:26:59.572 } 00:26:59.572 19:13:16 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:26:59.572 19:13:16 -- common/autotest_common.sh@653 -- # es=1 00:26:59.572 19:13:16 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:26:59.572 19:13:16 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:26:59.572 19:13:16 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:26:59.573 19:13:16 -- host/multicontroller.sh@74 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:26:59.573 19:13:16 -- common/autotest_common.sh@650 -- # local es=0 00:26:59.573 19:13:16 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:26:59.573 19:13:16 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:26:59.573 19:13:16 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:59.573 19:13:16 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:26:59.573 19:13:16 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:59.573 19:13:16 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:26:59.573 19:13:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:59.573 19:13:16 -- common/autotest_common.sh@10 -- # set +x 00:26:59.573 request: 00:26:59.573 { 00:26:59.573 "name": "NVMe0", 00:26:59.573 "trtype": "tcp", 00:26:59.573 "traddr": "10.0.0.2", 00:26:59.573 "hostaddr": "10.0.0.2", 00:26:59.573 "hostsvcid": "60000", 00:26:59.573 "adrfam": "ipv4", 00:26:59.573 "trsvcid": "4420", 00:26:59.573 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:26:59.573 "multipath": "failover", 00:26:59.573 "method": "bdev_nvme_attach_controller", 00:26:59.573 "req_id": 1 00:26:59.573 } 00:26:59.573 Got JSON-RPC error response 00:26:59.573 response: 00:26:59.573 { 00:26:59.573 "code": -114, 00:26:59.573 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:26:59.573 } 00:26:59.573 19:13:16 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:26:59.573 19:13:16 -- common/autotest_common.sh@653 -- # es=1 00:26:59.573 19:13:16 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:26:59.573 19:13:16 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:26:59.573 19:13:16 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:26:59.573 19:13:16 -- host/multicontroller.sh@79 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:26:59.573 19:13:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:59.573 19:13:16 -- common/autotest_common.sh@10 -- # set +x 00:26:59.831 00:26:59.831 19:13:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:59.831 19:13:16 -- host/multicontroller.sh@83 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:26:59.831 19:13:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:59.831 19:13:16 -- common/autotest_common.sh@10 -- # set +x 00:26:59.831 19:13:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:59.831 19:13:16 -- host/multicontroller.sh@87 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe1 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:26:59.832 19:13:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:59.832 19:13:16 -- common/autotest_common.sh@10 -- # set +x 00:27:00.090 00:27:00.090 19:13:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:00.090 19:13:16 -- host/multicontroller.sh@90 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:27:00.090 19:13:16 -- host/multicontroller.sh@90 -- # grep -c NVMe 00:27:00.090 19:13:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:00.091 19:13:16 -- common/autotest_common.sh@10 -- # set +x 00:27:00.091 19:13:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:00.091 19:13:16 -- host/multicontroller.sh@90 -- # '[' 2 '!=' 2 ']' 00:27:00.091 19:13:16 -- host/multicontroller.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:27:01.466 0 00:27:01.466 19:13:17 -- host/multicontroller.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe1 00:27:01.466 19:13:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:01.466 19:13:17 -- common/autotest_common.sh@10 -- # set +x 00:27:01.466 19:13:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:01.466 19:13:17 -- host/multicontroller.sh@100 -- # killprocess 3221079 00:27:01.466 19:13:17 -- common/autotest_common.sh@936 -- # '[' -z 3221079 ']' 00:27:01.466 19:13:17 -- common/autotest_common.sh@940 -- # kill -0 3221079 00:27:01.466 19:13:18 -- common/autotest_common.sh@941 -- # uname 00:27:01.466 19:13:18 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:01.466 19:13:18 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3221079 00:27:01.466 19:13:18 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:01.466 19:13:18 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:01.466 19:13:18 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3221079' 00:27:01.466 killing process with pid 3221079 00:27:01.466 19:13:18 -- common/autotest_common.sh@955 -- # kill 3221079 00:27:01.466 19:13:18 -- common/autotest_common.sh@960 -- # wait 3221079 00:27:01.466 19:13:18 -- host/multicontroller.sh@102 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:01.466 19:13:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:01.466 19:13:18 -- common/autotest_common.sh@10 -- # set +x 00:27:01.466 19:13:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:01.466 19:13:18 -- host/multicontroller.sh@103 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:27:01.466 19:13:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:01.466 19:13:18 -- common/autotest_common.sh@10 -- # set +x 00:27:01.466 19:13:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:01.466 19:13:18 -- host/multicontroller.sh@105 -- # trap - SIGINT SIGTERM EXIT 00:27:01.466 19:13:18 -- host/multicontroller.sh@107 -- # pap /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:27:01.466 19:13:18 -- common/autotest_common.sh@1607 -- # read -r file 00:27:01.466 19:13:18 -- common/autotest_common.sh@1606 -- # sort -u 00:27:01.466 19:13:18 -- common/autotest_common.sh@1606 -- # find /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt -type f 00:27:01.466 19:13:18 -- common/autotest_common.sh@1608 -- # cat 00:27:01.466 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:27:01.466 [2024-11-26 19:13:15.405731] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:27:01.466 [2024-11-26 19:13:15.405779] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3221079 ] 00:27:01.466 EAL: No free 2048 kB hugepages reported on node 1 00:27:01.466 [2024-11-26 19:13:15.460120] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:01.466 [2024-11-26 19:13:15.498073] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:01.466 [2024-11-26 19:13:16.841442] bdev.c:4553:bdev_name_add: *ERROR*: Bdev name 60cd0ad2-8f23-47e9-9221-98124c8a72d1 already exists 00:27:01.466 [2024-11-26 19:13:16.841469] bdev.c:7603:bdev_register: *ERROR*: Unable to add uuid:60cd0ad2-8f23-47e9-9221-98124c8a72d1 alias for bdev NVMe1n1 00:27:01.466 [2024-11-26 19:13:16.841478] bdev_nvme.c:4236:nvme_bdev_create: *ERROR*: spdk_bdev_register() failed 00:27:01.466 Running I/O for 1 seconds... 00:27:01.466 00:27:01.466 Latency(us) 00:27:01.466 [2024-11-26T18:13:18.393Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:01.466 [2024-11-26T18:13:18.393Z] Job: NVMe0n1 (Core Mask 0x1, workload: write, depth: 128, IO size: 4096) 00:27:01.466 NVMe0n1 : 1.00 25420.50 99.30 0.00 0.00 5028.92 1488.81 8776.13 00:27:01.466 [2024-11-26T18:13:18.393Z] =================================================================================================================== 00:27:01.466 [2024-11-26T18:13:18.393Z] Total : 25420.50 99.30 0.00 0.00 5028.92 1488.81 8776.13 00:27:01.466 Received shutdown signal, test time was about 1.000000 seconds 00:27:01.466 00:27:01.466 Latency(us) 00:27:01.466 [2024-11-26T18:13:18.393Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:01.466 [2024-11-26T18:13:18.393Z] =================================================================================================================== 00:27:01.466 [2024-11-26T18:13:18.393Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:01.466 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:27:01.466 19:13:18 -- common/autotest_common.sh@1613 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:27:01.466 19:13:18 -- common/autotest_common.sh@1607 -- # read -r file 00:27:01.466 19:13:18 -- host/multicontroller.sh@108 -- # nvmftestfini 00:27:01.466 19:13:18 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:01.466 19:13:18 -- nvmf/common.sh@116 -- # sync 00:27:01.466 19:13:18 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:01.466 19:13:18 -- nvmf/common.sh@119 -- # set +e 00:27:01.466 19:13:18 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:01.466 19:13:18 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:01.466 rmmod nvme_tcp 00:27:01.466 rmmod nvme_fabrics 00:27:01.466 rmmod nvme_keyring 00:27:01.466 19:13:18 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:01.466 19:13:18 -- nvmf/common.sh@123 -- # set -e 00:27:01.466 19:13:18 -- nvmf/common.sh@124 -- # return 0 00:27:01.466 19:13:18 -- nvmf/common.sh@477 -- # '[' -n 3221018 ']' 00:27:01.466 19:13:18 -- nvmf/common.sh@478 -- # killprocess 3221018 00:27:01.466 19:13:18 -- common/autotest_common.sh@936 -- # '[' -z 3221018 ']' 00:27:01.466 19:13:18 -- common/autotest_common.sh@940 -- # kill -0 3221018 00:27:01.466 19:13:18 -- common/autotest_common.sh@941 -- # uname 00:27:01.466 19:13:18 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:01.466 19:13:18 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3221018 00:27:01.466 19:13:18 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:01.466 19:13:18 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:01.466 19:13:18 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3221018' 00:27:01.466 killing process with pid 3221018 00:27:01.466 19:13:18 -- common/autotest_common.sh@955 -- # kill 3221018 00:27:01.466 19:13:18 -- common/autotest_common.sh@960 -- # wait 3221018 00:27:01.728 19:13:18 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:01.728 19:13:18 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:01.728 19:13:18 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:01.728 19:13:18 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:01.728 19:13:18 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:01.728 19:13:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:01.728 19:13:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:01.728 19:13:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:04.262 19:13:20 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:04.262 00:27:04.262 real 0m11.889s 00:27:04.262 user 0m17.217s 00:27:04.262 sys 0m4.719s 00:27:04.262 19:13:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:04.262 19:13:20 -- common/autotest_common.sh@10 -- # set +x 00:27:04.262 ************************************ 00:27:04.262 END TEST nvmf_multicontroller 00:27:04.262 ************************************ 00:27:04.262 19:13:20 -- nvmf/nvmf.sh@92 -- # run_test nvmf_aer /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:27:04.262 19:13:20 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:04.262 19:13:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:04.262 19:13:20 -- common/autotest_common.sh@10 -- # set +x 00:27:04.262 ************************************ 00:27:04.262 START TEST nvmf_aer 00:27:04.262 ************************************ 00:27:04.262 19:13:20 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:27:04.262 * Looking for test storage... 00:27:04.262 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:04.262 19:13:20 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:04.262 19:13:20 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:04.262 19:13:20 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:04.262 19:13:20 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:04.262 19:13:20 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:04.262 19:13:20 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:04.262 19:13:20 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:04.262 19:13:20 -- scripts/common.sh@335 -- # IFS=.-: 00:27:04.262 19:13:20 -- scripts/common.sh@335 -- # read -ra ver1 00:27:04.262 19:13:20 -- scripts/common.sh@336 -- # IFS=.-: 00:27:04.262 19:13:20 -- scripts/common.sh@336 -- # read -ra ver2 00:27:04.262 19:13:20 -- scripts/common.sh@337 -- # local 'op=<' 00:27:04.262 19:13:20 -- scripts/common.sh@339 -- # ver1_l=2 00:27:04.262 19:13:20 -- scripts/common.sh@340 -- # ver2_l=1 00:27:04.262 19:13:20 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:04.262 19:13:20 -- scripts/common.sh@343 -- # case "$op" in 00:27:04.262 19:13:20 -- scripts/common.sh@344 -- # : 1 00:27:04.262 19:13:20 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:04.262 19:13:20 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:04.262 19:13:20 -- scripts/common.sh@364 -- # decimal 1 00:27:04.262 19:13:20 -- scripts/common.sh@352 -- # local d=1 00:27:04.262 19:13:20 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:04.262 19:13:20 -- scripts/common.sh@354 -- # echo 1 00:27:04.262 19:13:20 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:04.262 19:13:20 -- scripts/common.sh@365 -- # decimal 2 00:27:04.262 19:13:20 -- scripts/common.sh@352 -- # local d=2 00:27:04.262 19:13:20 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:04.262 19:13:20 -- scripts/common.sh@354 -- # echo 2 00:27:04.262 19:13:20 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:04.262 19:13:20 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:04.262 19:13:20 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:04.262 19:13:20 -- scripts/common.sh@367 -- # return 0 00:27:04.262 19:13:20 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:04.262 19:13:20 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:04.262 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:04.262 --rc genhtml_branch_coverage=1 00:27:04.262 --rc genhtml_function_coverage=1 00:27:04.262 --rc genhtml_legend=1 00:27:04.262 --rc geninfo_all_blocks=1 00:27:04.262 --rc geninfo_unexecuted_blocks=1 00:27:04.262 00:27:04.262 ' 00:27:04.262 19:13:20 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:04.262 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:04.262 --rc genhtml_branch_coverage=1 00:27:04.262 --rc genhtml_function_coverage=1 00:27:04.262 --rc genhtml_legend=1 00:27:04.262 --rc geninfo_all_blocks=1 00:27:04.262 --rc geninfo_unexecuted_blocks=1 00:27:04.263 00:27:04.263 ' 00:27:04.263 19:13:20 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:04.263 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:04.263 --rc genhtml_branch_coverage=1 00:27:04.263 --rc genhtml_function_coverage=1 00:27:04.263 --rc genhtml_legend=1 00:27:04.263 --rc geninfo_all_blocks=1 00:27:04.263 --rc geninfo_unexecuted_blocks=1 00:27:04.263 00:27:04.263 ' 00:27:04.263 19:13:20 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:04.263 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:04.263 --rc genhtml_branch_coverage=1 00:27:04.263 --rc genhtml_function_coverage=1 00:27:04.263 --rc genhtml_legend=1 00:27:04.263 --rc geninfo_all_blocks=1 00:27:04.263 --rc geninfo_unexecuted_blocks=1 00:27:04.263 00:27:04.263 ' 00:27:04.263 19:13:20 -- host/aer.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:04.263 19:13:20 -- nvmf/common.sh@7 -- # uname -s 00:27:04.263 19:13:20 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:04.263 19:13:20 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:04.263 19:13:20 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:04.263 19:13:20 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:04.263 19:13:20 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:04.263 19:13:20 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:04.263 19:13:20 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:04.263 19:13:20 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:04.263 19:13:20 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:04.263 19:13:20 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:04.263 19:13:20 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:27:04.263 19:13:20 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:27:04.263 19:13:20 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:04.263 19:13:20 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:04.263 19:13:20 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:04.263 19:13:20 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:04.263 19:13:20 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:04.263 19:13:20 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:04.263 19:13:20 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:04.263 19:13:20 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:04.263 19:13:20 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:04.263 19:13:20 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:04.263 19:13:20 -- paths/export.sh@5 -- # export PATH 00:27:04.263 19:13:20 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:04.263 19:13:20 -- nvmf/common.sh@46 -- # : 0 00:27:04.263 19:13:20 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:04.263 19:13:20 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:04.263 19:13:20 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:04.263 19:13:20 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:04.263 19:13:20 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:04.263 19:13:20 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:04.263 19:13:20 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:04.263 19:13:20 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:04.263 19:13:20 -- host/aer.sh@11 -- # nvmftestinit 00:27:04.263 19:13:20 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:04.263 19:13:20 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:04.263 19:13:20 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:04.263 19:13:20 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:04.263 19:13:20 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:04.263 19:13:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:04.263 19:13:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:04.263 19:13:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:04.263 19:13:20 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:04.263 19:13:20 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:04.263 19:13:20 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:04.263 19:13:20 -- common/autotest_common.sh@10 -- # set +x 00:27:09.533 19:13:25 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:09.533 19:13:25 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:09.533 19:13:25 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:09.533 19:13:25 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:09.533 19:13:25 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:09.533 19:13:25 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:09.533 19:13:25 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:09.533 19:13:25 -- nvmf/common.sh@294 -- # net_devs=() 00:27:09.533 19:13:25 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:09.533 19:13:25 -- nvmf/common.sh@295 -- # e810=() 00:27:09.533 19:13:25 -- nvmf/common.sh@295 -- # local -ga e810 00:27:09.533 19:13:25 -- nvmf/common.sh@296 -- # x722=() 00:27:09.533 19:13:25 -- nvmf/common.sh@296 -- # local -ga x722 00:27:09.533 19:13:25 -- nvmf/common.sh@297 -- # mlx=() 00:27:09.533 19:13:25 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:09.533 19:13:25 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:09.533 19:13:25 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:09.533 19:13:25 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:09.533 19:13:25 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:09.533 19:13:25 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:09.533 19:13:25 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:09.533 19:13:25 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:09.533 19:13:25 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:09.533 19:13:25 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:09.533 19:13:25 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:09.533 19:13:25 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:09.533 19:13:25 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:09.533 19:13:25 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:09.533 19:13:25 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:09.533 19:13:25 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:09.533 19:13:25 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:09.533 19:13:25 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:09.533 19:13:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:09.533 19:13:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:27:09.533 Found 0000:86:00.0 (0x8086 - 0x159b) 00:27:09.533 19:13:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:09.533 19:13:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:09.533 19:13:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:09.533 19:13:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:09.533 19:13:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:09.533 19:13:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:09.533 19:13:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:27:09.533 Found 0000:86:00.1 (0x8086 - 0x159b) 00:27:09.533 19:13:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:09.533 19:13:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:09.533 19:13:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:09.533 19:13:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:09.533 19:13:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:09.533 19:13:25 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:09.533 19:13:25 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:09.533 19:13:25 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:09.533 19:13:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:09.533 19:13:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:09.533 19:13:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:09.533 19:13:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:09.533 19:13:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:27:09.533 Found net devices under 0000:86:00.0: cvl_0_0 00:27:09.533 19:13:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:09.533 19:13:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:09.533 19:13:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:09.533 19:13:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:09.533 19:13:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:09.533 19:13:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:27:09.533 Found net devices under 0000:86:00.1: cvl_0_1 00:27:09.533 19:13:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:09.533 19:13:25 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:09.533 19:13:25 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:09.533 19:13:25 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:09.533 19:13:25 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:09.533 19:13:25 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:09.533 19:13:25 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:09.533 19:13:25 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:09.533 19:13:25 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:09.533 19:13:25 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:09.533 19:13:25 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:09.533 19:13:25 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:09.533 19:13:25 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:09.533 19:13:25 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:09.533 19:13:25 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:09.533 19:13:25 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:09.533 19:13:25 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:09.533 19:13:25 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:09.533 19:13:25 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:09.533 19:13:26 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:09.533 19:13:26 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:09.533 19:13:26 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:09.533 19:13:26 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:09.533 19:13:26 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:09.533 19:13:26 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:09.533 19:13:26 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:09.533 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:09.533 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.425 ms 00:27:09.533 00:27:09.533 --- 10.0.0.2 ping statistics --- 00:27:09.533 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:09.533 rtt min/avg/max/mdev = 0.425/0.425/0.425/0.000 ms 00:27:09.533 19:13:26 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:09.533 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:09.533 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.143 ms 00:27:09.533 00:27:09.533 --- 10.0.0.1 ping statistics --- 00:27:09.533 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:09.533 rtt min/avg/max/mdev = 0.143/0.143/0.143/0.000 ms 00:27:09.533 19:13:26 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:09.533 19:13:26 -- nvmf/common.sh@410 -- # return 0 00:27:09.533 19:13:26 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:09.533 19:13:26 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:09.533 19:13:26 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:09.533 19:13:26 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:09.533 19:13:26 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:09.533 19:13:26 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:09.533 19:13:26 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:09.533 19:13:26 -- host/aer.sh@12 -- # nvmfappstart -m 0xF 00:27:09.533 19:13:26 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:09.533 19:13:26 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:09.533 19:13:26 -- common/autotest_common.sh@10 -- # set +x 00:27:09.533 19:13:26 -- nvmf/common.sh@469 -- # nvmfpid=3225081 00:27:09.533 19:13:26 -- nvmf/common.sh@470 -- # waitforlisten 3225081 00:27:09.533 19:13:26 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:27:09.533 19:13:26 -- common/autotest_common.sh@829 -- # '[' -z 3225081 ']' 00:27:09.533 19:13:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:09.533 19:13:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:09.533 19:13:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:09.533 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:09.533 19:13:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:09.533 19:13:26 -- common/autotest_common.sh@10 -- # set +x 00:27:09.533 [2024-11-26 19:13:26.196591] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:27:09.533 [2024-11-26 19:13:26.196635] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:09.533 EAL: No free 2048 kB hugepages reported on node 1 00:27:09.533 [2024-11-26 19:13:26.254520] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:27:09.533 [2024-11-26 19:13:26.294242] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:09.533 [2024-11-26 19:13:26.294376] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:09.533 [2024-11-26 19:13:26.294384] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:09.533 [2024-11-26 19:13:26.294391] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:09.533 [2024-11-26 19:13:26.294429] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:09.533 [2024-11-26 19:13:26.294456] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:09.533 [2024-11-26 19:13:26.294473] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:09.533 [2024-11-26 19:13:26.294475] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:10.468 19:13:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:10.468 19:13:27 -- common/autotest_common.sh@862 -- # return 0 00:27:10.468 19:13:27 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:10.468 19:13:27 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:10.468 19:13:27 -- common/autotest_common.sh@10 -- # set +x 00:27:10.468 19:13:27 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:10.468 19:13:27 -- host/aer.sh@14 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:27:10.468 19:13:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:10.468 19:13:27 -- common/autotest_common.sh@10 -- # set +x 00:27:10.468 [2024-11-26 19:13:27.070532] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:10.468 19:13:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:10.468 19:13:27 -- host/aer.sh@16 -- # rpc_cmd bdev_malloc_create 64 512 --name Malloc0 00:27:10.468 19:13:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:10.468 19:13:27 -- common/autotest_common.sh@10 -- # set +x 00:27:10.468 Malloc0 00:27:10.468 19:13:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:10.468 19:13:27 -- host/aer.sh@17 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 2 00:27:10.468 19:13:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:10.468 19:13:27 -- common/autotest_common.sh@10 -- # set +x 00:27:10.468 19:13:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:10.468 19:13:27 -- host/aer.sh@18 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:10.468 19:13:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:10.468 19:13:27 -- common/autotest_common.sh@10 -- # set +x 00:27:10.468 19:13:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:10.468 19:13:27 -- host/aer.sh@19 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:10.468 19:13:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:10.468 19:13:27 -- common/autotest_common.sh@10 -- # set +x 00:27:10.468 [2024-11-26 19:13:27.122190] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:10.468 19:13:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:10.468 19:13:27 -- host/aer.sh@21 -- # rpc_cmd nvmf_get_subsystems 00:27:10.468 19:13:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:10.468 19:13:27 -- common/autotest_common.sh@10 -- # set +x 00:27:10.468 [2024-11-26 19:13:27.129988] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:27:10.468 [ 00:27:10.468 { 00:27:10.468 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:27:10.468 "subtype": "Discovery", 00:27:10.468 "listen_addresses": [], 00:27:10.468 "allow_any_host": true, 00:27:10.468 "hosts": [] 00:27:10.468 }, 00:27:10.468 { 00:27:10.468 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:27:10.468 "subtype": "NVMe", 00:27:10.468 "listen_addresses": [ 00:27:10.468 { 00:27:10.468 "transport": "TCP", 00:27:10.468 "trtype": "TCP", 00:27:10.468 "adrfam": "IPv4", 00:27:10.468 "traddr": "10.0.0.2", 00:27:10.468 "trsvcid": "4420" 00:27:10.468 } 00:27:10.468 ], 00:27:10.468 "allow_any_host": true, 00:27:10.468 "hosts": [], 00:27:10.468 "serial_number": "SPDK00000000000001", 00:27:10.468 "model_number": "SPDK bdev Controller", 00:27:10.468 "max_namespaces": 2, 00:27:10.468 "min_cntlid": 1, 00:27:10.468 "max_cntlid": 65519, 00:27:10.468 "namespaces": [ 00:27:10.468 { 00:27:10.468 "nsid": 1, 00:27:10.468 "bdev_name": "Malloc0", 00:27:10.468 "name": "Malloc0", 00:27:10.468 "nguid": "834F4EEBD79F42B183CE66001BC55672", 00:27:10.468 "uuid": "834f4eeb-d79f-42b1-83ce-66001bc55672" 00:27:10.468 } 00:27:10.468 ] 00:27:10.468 } 00:27:10.468 ] 00:27:10.468 19:13:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:10.468 19:13:27 -- host/aer.sh@23 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:27:10.468 19:13:27 -- host/aer.sh@24 -- # rm -f /tmp/aer_touch_file 00:27:10.468 19:13:27 -- host/aer.sh@33 -- # aerpid=3225266 00:27:10.468 19:13:27 -- host/aer.sh@36 -- # waitforfile /tmp/aer_touch_file 00:27:10.468 19:13:27 -- host/aer.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -n 2 -t /tmp/aer_touch_file 00:27:10.468 19:13:27 -- common/autotest_common.sh@1254 -- # local i=0 00:27:10.468 19:13:27 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:27:10.468 19:13:27 -- common/autotest_common.sh@1256 -- # '[' 0 -lt 200 ']' 00:27:10.468 19:13:27 -- common/autotest_common.sh@1257 -- # i=1 00:27:10.468 19:13:27 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:27:10.468 EAL: No free 2048 kB hugepages reported on node 1 00:27:10.468 19:13:27 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:27:10.468 19:13:27 -- common/autotest_common.sh@1256 -- # '[' 1 -lt 200 ']' 00:27:10.468 19:13:27 -- common/autotest_common.sh@1257 -- # i=2 00:27:10.468 19:13:27 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:27:10.468 19:13:27 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:27:10.468 19:13:27 -- common/autotest_common.sh@1261 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:27:10.468 19:13:27 -- common/autotest_common.sh@1265 -- # return 0 00:27:10.468 19:13:27 -- host/aer.sh@39 -- # rpc_cmd bdev_malloc_create 64 4096 --name Malloc1 00:27:10.468 19:13:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:10.468 19:13:27 -- common/autotest_common.sh@10 -- # set +x 00:27:10.468 Malloc1 00:27:10.468 19:13:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:10.468 19:13:27 -- host/aer.sh@40 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 2 00:27:10.468 19:13:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:10.468 19:13:27 -- common/autotest_common.sh@10 -- # set +x 00:27:10.727 19:13:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:10.727 19:13:27 -- host/aer.sh@41 -- # rpc_cmd nvmf_get_subsystems 00:27:10.727 19:13:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:10.727 19:13:27 -- common/autotest_common.sh@10 -- # set +x 00:27:10.727 Asynchronous Event Request test 00:27:10.727 Attaching to 10.0.0.2 00:27:10.727 Attached to 10.0.0.2 00:27:10.727 Registering asynchronous event callbacks... 00:27:10.727 Starting namespace attribute notice tests for all controllers... 00:27:10.727 10.0.0.2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:27:10.727 aer_cb - Changed Namespace 00:27:10.727 Cleaning up... 00:27:10.727 [ 00:27:10.727 { 00:27:10.727 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:27:10.727 "subtype": "Discovery", 00:27:10.727 "listen_addresses": [], 00:27:10.727 "allow_any_host": true, 00:27:10.727 "hosts": [] 00:27:10.727 }, 00:27:10.727 { 00:27:10.727 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:27:10.727 "subtype": "NVMe", 00:27:10.727 "listen_addresses": [ 00:27:10.727 { 00:27:10.727 "transport": "TCP", 00:27:10.727 "trtype": "TCP", 00:27:10.727 "adrfam": "IPv4", 00:27:10.727 "traddr": "10.0.0.2", 00:27:10.727 "trsvcid": "4420" 00:27:10.727 } 00:27:10.727 ], 00:27:10.727 "allow_any_host": true, 00:27:10.727 "hosts": [], 00:27:10.727 "serial_number": "SPDK00000000000001", 00:27:10.727 "model_number": "SPDK bdev Controller", 00:27:10.727 "max_namespaces": 2, 00:27:10.727 "min_cntlid": 1, 00:27:10.727 "max_cntlid": 65519, 00:27:10.727 "namespaces": [ 00:27:10.727 { 00:27:10.727 "nsid": 1, 00:27:10.727 "bdev_name": "Malloc0", 00:27:10.727 "name": "Malloc0", 00:27:10.727 "nguid": "834F4EEBD79F42B183CE66001BC55672", 00:27:10.727 "uuid": "834f4eeb-d79f-42b1-83ce-66001bc55672" 00:27:10.727 }, 00:27:10.727 { 00:27:10.727 "nsid": 2, 00:27:10.727 "bdev_name": "Malloc1", 00:27:10.727 "name": "Malloc1", 00:27:10.727 "nguid": "2B6C2C0C49FD44A8BD57DBC3096674CA", 00:27:10.727 "uuid": "2b6c2c0c-49fd-44a8-bd57-dbc3096674ca" 00:27:10.727 } 00:27:10.727 ] 00:27:10.727 } 00:27:10.727 ] 00:27:10.727 19:13:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:10.727 19:13:27 -- host/aer.sh@43 -- # wait 3225266 00:27:10.727 19:13:27 -- host/aer.sh@45 -- # rpc_cmd bdev_malloc_delete Malloc0 00:27:10.727 19:13:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:10.727 19:13:27 -- common/autotest_common.sh@10 -- # set +x 00:27:10.727 19:13:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:10.727 19:13:27 -- host/aer.sh@46 -- # rpc_cmd bdev_malloc_delete Malloc1 00:27:10.727 19:13:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:10.727 19:13:27 -- common/autotest_common.sh@10 -- # set +x 00:27:10.727 19:13:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:10.727 19:13:27 -- host/aer.sh@47 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:10.727 19:13:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:10.727 19:13:27 -- common/autotest_common.sh@10 -- # set +x 00:27:10.727 19:13:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:10.727 19:13:27 -- host/aer.sh@49 -- # trap - SIGINT SIGTERM EXIT 00:27:10.727 19:13:27 -- host/aer.sh@51 -- # nvmftestfini 00:27:10.727 19:13:27 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:10.727 19:13:27 -- nvmf/common.sh@116 -- # sync 00:27:10.727 19:13:27 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:10.727 19:13:27 -- nvmf/common.sh@119 -- # set +e 00:27:10.727 19:13:27 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:10.727 19:13:27 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:10.727 rmmod nvme_tcp 00:27:10.727 rmmod nvme_fabrics 00:27:10.728 rmmod nvme_keyring 00:27:10.728 19:13:27 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:10.728 19:13:27 -- nvmf/common.sh@123 -- # set -e 00:27:10.728 19:13:27 -- nvmf/common.sh@124 -- # return 0 00:27:10.728 19:13:27 -- nvmf/common.sh@477 -- # '[' -n 3225081 ']' 00:27:10.728 19:13:27 -- nvmf/common.sh@478 -- # killprocess 3225081 00:27:10.728 19:13:27 -- common/autotest_common.sh@936 -- # '[' -z 3225081 ']' 00:27:10.728 19:13:27 -- common/autotest_common.sh@940 -- # kill -0 3225081 00:27:10.728 19:13:27 -- common/autotest_common.sh@941 -- # uname 00:27:10.728 19:13:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:10.728 19:13:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3225081 00:27:10.728 19:13:27 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:10.728 19:13:27 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:10.728 19:13:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3225081' 00:27:10.728 killing process with pid 3225081 00:27:10.728 19:13:27 -- common/autotest_common.sh@955 -- # kill 3225081 00:27:10.728 [2024-11-26 19:13:27.591270] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:27:10.728 19:13:27 -- common/autotest_common.sh@960 -- # wait 3225081 00:27:10.986 19:13:27 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:10.986 19:13:27 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:10.986 19:13:27 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:10.986 19:13:27 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:10.986 19:13:27 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:10.986 19:13:27 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:10.986 19:13:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:10.986 19:13:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:12.898 19:13:29 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:13.158 00:27:13.158 real 0m9.125s 00:27:13.158 user 0m7.651s 00:27:13.158 sys 0m4.218s 00:27:13.158 19:13:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:13.158 19:13:29 -- common/autotest_common.sh@10 -- # set +x 00:27:13.158 ************************************ 00:27:13.158 END TEST nvmf_aer 00:27:13.158 ************************************ 00:27:13.158 19:13:29 -- nvmf/nvmf.sh@93 -- # run_test nvmf_async_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:27:13.158 19:13:29 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:13.158 19:13:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:13.158 19:13:29 -- common/autotest_common.sh@10 -- # set +x 00:27:13.158 ************************************ 00:27:13.158 START TEST nvmf_async_init 00:27:13.158 ************************************ 00:27:13.158 19:13:29 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:27:13.158 * Looking for test storage... 00:27:13.158 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:13.158 19:13:29 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:13.158 19:13:29 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:13.158 19:13:29 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:13.158 19:13:30 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:13.158 19:13:30 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:13.158 19:13:30 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:13.158 19:13:30 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:13.158 19:13:30 -- scripts/common.sh@335 -- # IFS=.-: 00:27:13.158 19:13:30 -- scripts/common.sh@335 -- # read -ra ver1 00:27:13.158 19:13:30 -- scripts/common.sh@336 -- # IFS=.-: 00:27:13.158 19:13:30 -- scripts/common.sh@336 -- # read -ra ver2 00:27:13.158 19:13:30 -- scripts/common.sh@337 -- # local 'op=<' 00:27:13.158 19:13:30 -- scripts/common.sh@339 -- # ver1_l=2 00:27:13.158 19:13:30 -- scripts/common.sh@340 -- # ver2_l=1 00:27:13.158 19:13:30 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:13.158 19:13:30 -- scripts/common.sh@343 -- # case "$op" in 00:27:13.158 19:13:30 -- scripts/common.sh@344 -- # : 1 00:27:13.158 19:13:30 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:13.158 19:13:30 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:13.158 19:13:30 -- scripts/common.sh@364 -- # decimal 1 00:27:13.158 19:13:30 -- scripts/common.sh@352 -- # local d=1 00:27:13.158 19:13:30 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:13.158 19:13:30 -- scripts/common.sh@354 -- # echo 1 00:27:13.158 19:13:30 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:13.158 19:13:30 -- scripts/common.sh@365 -- # decimal 2 00:27:13.158 19:13:30 -- scripts/common.sh@352 -- # local d=2 00:27:13.158 19:13:30 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:13.158 19:13:30 -- scripts/common.sh@354 -- # echo 2 00:27:13.158 19:13:30 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:13.158 19:13:30 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:13.158 19:13:30 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:13.158 19:13:30 -- scripts/common.sh@367 -- # return 0 00:27:13.158 19:13:30 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:13.158 19:13:30 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:13.158 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:13.158 --rc genhtml_branch_coverage=1 00:27:13.158 --rc genhtml_function_coverage=1 00:27:13.158 --rc genhtml_legend=1 00:27:13.158 --rc geninfo_all_blocks=1 00:27:13.158 --rc geninfo_unexecuted_blocks=1 00:27:13.158 00:27:13.158 ' 00:27:13.158 19:13:30 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:13.158 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:13.158 --rc genhtml_branch_coverage=1 00:27:13.158 --rc genhtml_function_coverage=1 00:27:13.158 --rc genhtml_legend=1 00:27:13.158 --rc geninfo_all_blocks=1 00:27:13.158 --rc geninfo_unexecuted_blocks=1 00:27:13.158 00:27:13.158 ' 00:27:13.158 19:13:30 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:13.158 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:13.158 --rc genhtml_branch_coverage=1 00:27:13.158 --rc genhtml_function_coverage=1 00:27:13.158 --rc genhtml_legend=1 00:27:13.158 --rc geninfo_all_blocks=1 00:27:13.158 --rc geninfo_unexecuted_blocks=1 00:27:13.158 00:27:13.158 ' 00:27:13.158 19:13:30 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:13.158 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:13.158 --rc genhtml_branch_coverage=1 00:27:13.158 --rc genhtml_function_coverage=1 00:27:13.158 --rc genhtml_legend=1 00:27:13.158 --rc geninfo_all_blocks=1 00:27:13.158 --rc geninfo_unexecuted_blocks=1 00:27:13.158 00:27:13.158 ' 00:27:13.158 19:13:30 -- host/async_init.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:13.158 19:13:30 -- nvmf/common.sh@7 -- # uname -s 00:27:13.158 19:13:30 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:13.158 19:13:30 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:13.158 19:13:30 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:13.158 19:13:30 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:13.158 19:13:30 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:13.158 19:13:30 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:13.158 19:13:30 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:13.158 19:13:30 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:13.158 19:13:30 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:13.158 19:13:30 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:13.158 19:13:30 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:27:13.158 19:13:30 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:27:13.158 19:13:30 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:13.158 19:13:30 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:13.158 19:13:30 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:13.158 19:13:30 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:13.159 19:13:30 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:13.159 19:13:30 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:13.159 19:13:30 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:13.159 19:13:30 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:13.159 19:13:30 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:13.159 19:13:30 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:13.159 19:13:30 -- paths/export.sh@5 -- # export PATH 00:27:13.159 19:13:30 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:13.159 19:13:30 -- nvmf/common.sh@46 -- # : 0 00:27:13.159 19:13:30 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:13.159 19:13:30 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:13.159 19:13:30 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:13.159 19:13:30 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:13.159 19:13:30 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:13.159 19:13:30 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:13.159 19:13:30 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:13.159 19:13:30 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:13.159 19:13:30 -- host/async_init.sh@13 -- # null_bdev_size=1024 00:27:13.159 19:13:30 -- host/async_init.sh@14 -- # null_block_size=512 00:27:13.159 19:13:30 -- host/async_init.sh@15 -- # null_bdev=null0 00:27:13.159 19:13:30 -- host/async_init.sh@16 -- # nvme_bdev=nvme0 00:27:13.159 19:13:30 -- host/async_init.sh@20 -- # tr -d - 00:27:13.159 19:13:30 -- host/async_init.sh@20 -- # uuidgen 00:27:13.159 19:13:30 -- host/async_init.sh@20 -- # nguid=8f0c01033310408daf568d00a8051244 00:27:13.159 19:13:30 -- host/async_init.sh@22 -- # nvmftestinit 00:27:13.159 19:13:30 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:13.159 19:13:30 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:13.159 19:13:30 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:13.159 19:13:30 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:13.159 19:13:30 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:13.159 19:13:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:13.159 19:13:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:13.159 19:13:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:13.159 19:13:30 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:13.159 19:13:30 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:13.159 19:13:30 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:13.159 19:13:30 -- common/autotest_common.sh@10 -- # set +x 00:27:18.431 19:13:34 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:18.431 19:13:34 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:18.431 19:13:34 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:18.431 19:13:34 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:18.431 19:13:34 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:18.431 19:13:34 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:18.431 19:13:34 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:18.431 19:13:34 -- nvmf/common.sh@294 -- # net_devs=() 00:27:18.431 19:13:34 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:18.431 19:13:34 -- nvmf/common.sh@295 -- # e810=() 00:27:18.431 19:13:34 -- nvmf/common.sh@295 -- # local -ga e810 00:27:18.431 19:13:34 -- nvmf/common.sh@296 -- # x722=() 00:27:18.431 19:13:34 -- nvmf/common.sh@296 -- # local -ga x722 00:27:18.431 19:13:34 -- nvmf/common.sh@297 -- # mlx=() 00:27:18.431 19:13:34 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:18.431 19:13:34 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:18.431 19:13:34 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:18.431 19:13:34 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:18.431 19:13:34 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:18.431 19:13:34 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:18.431 19:13:34 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:18.431 19:13:34 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:18.431 19:13:34 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:18.431 19:13:34 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:18.431 19:13:34 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:18.431 19:13:34 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:18.431 19:13:34 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:18.431 19:13:34 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:18.431 19:13:34 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:18.431 19:13:34 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:18.431 19:13:34 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:18.431 19:13:34 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:18.431 19:13:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:18.431 19:13:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:27:18.431 Found 0000:86:00.0 (0x8086 - 0x159b) 00:27:18.431 19:13:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:18.431 19:13:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:18.431 19:13:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:18.431 19:13:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:18.431 19:13:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:18.431 19:13:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:18.431 19:13:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:27:18.431 Found 0000:86:00.1 (0x8086 - 0x159b) 00:27:18.432 19:13:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:18.432 19:13:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:18.432 19:13:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:18.432 19:13:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:18.432 19:13:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:18.432 19:13:35 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:18.432 19:13:35 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:18.432 19:13:35 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:18.432 19:13:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:18.432 19:13:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:18.432 19:13:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:18.432 19:13:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:18.432 19:13:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:27:18.432 Found net devices under 0000:86:00.0: cvl_0_0 00:27:18.432 19:13:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:18.432 19:13:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:18.432 19:13:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:18.432 19:13:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:18.432 19:13:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:18.432 19:13:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:27:18.432 Found net devices under 0000:86:00.1: cvl_0_1 00:27:18.432 19:13:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:18.432 19:13:35 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:18.432 19:13:35 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:18.432 19:13:35 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:18.432 19:13:35 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:18.432 19:13:35 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:18.432 19:13:35 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:18.432 19:13:35 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:18.432 19:13:35 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:18.432 19:13:35 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:18.432 19:13:35 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:18.432 19:13:35 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:18.432 19:13:35 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:18.432 19:13:35 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:18.432 19:13:35 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:18.432 19:13:35 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:18.432 19:13:35 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:18.432 19:13:35 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:18.432 19:13:35 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:18.432 19:13:35 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:18.432 19:13:35 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:18.432 19:13:35 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:18.432 19:13:35 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:18.432 19:13:35 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:18.432 19:13:35 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:18.432 19:13:35 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:18.432 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:18.432 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.434 ms 00:27:18.432 00:27:18.432 --- 10.0.0.2 ping statistics --- 00:27:18.432 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:18.432 rtt min/avg/max/mdev = 0.434/0.434/0.434/0.000 ms 00:27:18.432 19:13:35 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:18.432 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:18.432 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.218 ms 00:27:18.432 00:27:18.432 --- 10.0.0.1 ping statistics --- 00:27:18.432 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:18.432 rtt min/avg/max/mdev = 0.218/0.218/0.218/0.000 ms 00:27:18.432 19:13:35 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:18.432 19:13:35 -- nvmf/common.sh@410 -- # return 0 00:27:18.432 19:13:35 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:18.432 19:13:35 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:18.432 19:13:35 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:18.432 19:13:35 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:18.432 19:13:35 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:18.432 19:13:35 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:18.432 19:13:35 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:18.432 19:13:35 -- host/async_init.sh@23 -- # nvmfappstart -m 0x1 00:27:18.432 19:13:35 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:18.432 19:13:35 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:18.432 19:13:35 -- common/autotest_common.sh@10 -- # set +x 00:27:18.432 19:13:35 -- nvmf/common.sh@469 -- # nvmfpid=3228652 00:27:18.432 19:13:35 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:27:18.432 19:13:35 -- nvmf/common.sh@470 -- # waitforlisten 3228652 00:27:18.432 19:13:35 -- common/autotest_common.sh@829 -- # '[' -z 3228652 ']' 00:27:18.432 19:13:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:18.432 19:13:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:18.432 19:13:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:18.432 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:18.432 19:13:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:18.432 19:13:35 -- common/autotest_common.sh@10 -- # set +x 00:27:18.432 [2024-11-26 19:13:35.323273] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:27:18.432 [2024-11-26 19:13:35.323325] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:18.432 EAL: No free 2048 kB hugepages reported on node 1 00:27:18.691 [2024-11-26 19:13:35.384526] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:18.691 [2024-11-26 19:13:35.425301] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:18.691 [2024-11-26 19:13:35.425413] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:18.691 [2024-11-26 19:13:35.425421] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:18.691 [2024-11-26 19:13:35.425428] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:18.691 [2024-11-26 19:13:35.425450] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:19.257 19:13:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:19.257 19:13:36 -- common/autotest_common.sh@862 -- # return 0 00:27:19.258 19:13:36 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:19.258 19:13:36 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:19.258 19:13:36 -- common/autotest_common.sh@10 -- # set +x 00:27:19.258 19:13:36 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:19.258 19:13:36 -- host/async_init.sh@26 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:27:19.258 19:13:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:19.258 19:13:36 -- common/autotest_common.sh@10 -- # set +x 00:27:19.516 [2024-11-26 19:13:36.183695] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:19.516 19:13:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:19.516 19:13:36 -- host/async_init.sh@27 -- # rpc_cmd bdev_null_create null0 1024 512 00:27:19.516 19:13:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:19.516 19:13:36 -- common/autotest_common.sh@10 -- # set +x 00:27:19.516 null0 00:27:19.516 19:13:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:19.516 19:13:36 -- host/async_init.sh@28 -- # rpc_cmd bdev_wait_for_examine 00:27:19.517 19:13:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:19.517 19:13:36 -- common/autotest_common.sh@10 -- # set +x 00:27:19.517 19:13:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:19.517 19:13:36 -- host/async_init.sh@29 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a 00:27:19.517 19:13:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:19.517 19:13:36 -- common/autotest_common.sh@10 -- # set +x 00:27:19.517 19:13:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:19.517 19:13:36 -- host/async_init.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 -g 8f0c01033310408daf568d00a8051244 00:27:19.517 19:13:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:19.517 19:13:36 -- common/autotest_common.sh@10 -- # set +x 00:27:19.517 19:13:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:19.517 19:13:36 -- host/async_init.sh@31 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:27:19.517 19:13:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:19.517 19:13:36 -- common/autotest_common.sh@10 -- # set +x 00:27:19.517 [2024-11-26 19:13:36.231925] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:19.517 19:13:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:19.517 19:13:36 -- host/async_init.sh@37 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode0 00:27:19.517 19:13:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:19.517 19:13:36 -- common/autotest_common.sh@10 -- # set +x 00:27:19.776 nvme0n1 00:27:19.776 19:13:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:19.776 19:13:36 -- host/async_init.sh@41 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:27:19.776 19:13:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:19.776 19:13:36 -- common/autotest_common.sh@10 -- # set +x 00:27:19.776 [ 00:27:19.776 { 00:27:19.776 "name": "nvme0n1", 00:27:19.776 "aliases": [ 00:27:19.776 "8f0c0103-3310-408d-af56-8d00a8051244" 00:27:19.776 ], 00:27:19.776 "product_name": "NVMe disk", 00:27:19.776 "block_size": 512, 00:27:19.776 "num_blocks": 2097152, 00:27:19.776 "uuid": "8f0c0103-3310-408d-af56-8d00a8051244", 00:27:19.776 "assigned_rate_limits": { 00:27:19.776 "rw_ios_per_sec": 0, 00:27:19.776 "rw_mbytes_per_sec": 0, 00:27:19.776 "r_mbytes_per_sec": 0, 00:27:19.776 "w_mbytes_per_sec": 0 00:27:19.776 }, 00:27:19.776 "claimed": false, 00:27:19.776 "zoned": false, 00:27:19.776 "supported_io_types": { 00:27:19.776 "read": true, 00:27:19.776 "write": true, 00:27:19.776 "unmap": false, 00:27:19.776 "write_zeroes": true, 00:27:19.776 "flush": true, 00:27:19.776 "reset": true, 00:27:19.776 "compare": true, 00:27:19.776 "compare_and_write": true, 00:27:19.776 "abort": true, 00:27:19.776 "nvme_admin": true, 00:27:19.776 "nvme_io": true 00:27:19.776 }, 00:27:19.776 "driver_specific": { 00:27:19.776 "nvme": [ 00:27:19.776 { 00:27:19.776 "trid": { 00:27:19.776 "trtype": "TCP", 00:27:19.776 "adrfam": "IPv4", 00:27:19.776 "traddr": "10.0.0.2", 00:27:19.776 "trsvcid": "4420", 00:27:19.776 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:27:19.776 }, 00:27:19.776 "ctrlr_data": { 00:27:19.776 "cntlid": 1, 00:27:19.776 "vendor_id": "0x8086", 00:27:19.776 "model_number": "SPDK bdev Controller", 00:27:19.776 "serial_number": "00000000000000000000", 00:27:19.776 "firmware_revision": "24.01.1", 00:27:19.776 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:27:19.776 "oacs": { 00:27:19.776 "security": 0, 00:27:19.776 "format": 0, 00:27:19.776 "firmware": 0, 00:27:19.776 "ns_manage": 0 00:27:19.776 }, 00:27:19.776 "multi_ctrlr": true, 00:27:19.776 "ana_reporting": false 00:27:19.776 }, 00:27:19.776 "vs": { 00:27:19.776 "nvme_version": "1.3" 00:27:19.776 }, 00:27:19.776 "ns_data": { 00:27:19.776 "id": 1, 00:27:19.776 "can_share": true 00:27:19.776 } 00:27:19.776 } 00:27:19.776 ], 00:27:19.776 "mp_policy": "active_passive" 00:27:19.776 } 00:27:19.776 } 00:27:19.776 ] 00:27:19.776 19:13:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:19.776 19:13:36 -- host/async_init.sh@44 -- # rpc_cmd bdev_nvme_reset_controller nvme0 00:27:19.776 19:13:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:19.776 19:13:36 -- common/autotest_common.sh@10 -- # set +x 00:27:19.776 [2024-11-26 19:13:36.489212] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:27:19.776 [2024-11-26 19:13:36.489264] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2048c50 (9): Bad file descriptor 00:27:19.776 [2024-11-26 19:13:36.621021] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:27:19.776 19:13:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:19.776 19:13:36 -- host/async_init.sh@47 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:27:19.776 19:13:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:19.776 19:13:36 -- common/autotest_common.sh@10 -- # set +x 00:27:19.776 [ 00:27:19.776 { 00:27:19.776 "name": "nvme0n1", 00:27:19.776 "aliases": [ 00:27:19.776 "8f0c0103-3310-408d-af56-8d00a8051244" 00:27:19.776 ], 00:27:19.776 "product_name": "NVMe disk", 00:27:19.776 "block_size": 512, 00:27:19.776 "num_blocks": 2097152, 00:27:19.776 "uuid": "8f0c0103-3310-408d-af56-8d00a8051244", 00:27:19.776 "assigned_rate_limits": { 00:27:19.776 "rw_ios_per_sec": 0, 00:27:19.776 "rw_mbytes_per_sec": 0, 00:27:19.776 "r_mbytes_per_sec": 0, 00:27:19.776 "w_mbytes_per_sec": 0 00:27:19.776 }, 00:27:19.776 "claimed": false, 00:27:19.776 "zoned": false, 00:27:19.776 "supported_io_types": { 00:27:19.776 "read": true, 00:27:19.776 "write": true, 00:27:19.776 "unmap": false, 00:27:19.776 "write_zeroes": true, 00:27:19.776 "flush": true, 00:27:19.776 "reset": true, 00:27:19.776 "compare": true, 00:27:19.776 "compare_and_write": true, 00:27:19.776 "abort": true, 00:27:19.776 "nvme_admin": true, 00:27:19.776 "nvme_io": true 00:27:19.776 }, 00:27:19.776 "driver_specific": { 00:27:19.776 "nvme": [ 00:27:19.776 { 00:27:19.776 "trid": { 00:27:19.776 "trtype": "TCP", 00:27:19.776 "adrfam": "IPv4", 00:27:19.776 "traddr": "10.0.0.2", 00:27:19.776 "trsvcid": "4420", 00:27:19.776 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:27:19.776 }, 00:27:19.776 "ctrlr_data": { 00:27:19.776 "cntlid": 2, 00:27:19.776 "vendor_id": "0x8086", 00:27:19.776 "model_number": "SPDK bdev Controller", 00:27:19.776 "serial_number": "00000000000000000000", 00:27:19.776 "firmware_revision": "24.01.1", 00:27:19.776 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:27:19.776 "oacs": { 00:27:19.776 "security": 0, 00:27:19.776 "format": 0, 00:27:19.776 "firmware": 0, 00:27:19.776 "ns_manage": 0 00:27:19.776 }, 00:27:19.776 "multi_ctrlr": true, 00:27:19.776 "ana_reporting": false 00:27:19.776 }, 00:27:19.776 "vs": { 00:27:19.776 "nvme_version": "1.3" 00:27:19.776 }, 00:27:19.776 "ns_data": { 00:27:19.776 "id": 1, 00:27:19.776 "can_share": true 00:27:19.776 } 00:27:19.776 } 00:27:19.776 ], 00:27:19.776 "mp_policy": "active_passive" 00:27:19.776 } 00:27:19.776 } 00:27:19.776 ] 00:27:19.776 19:13:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:19.776 19:13:36 -- host/async_init.sh@50 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:27:19.776 19:13:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:19.777 19:13:36 -- common/autotest_common.sh@10 -- # set +x 00:27:19.777 19:13:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:19.777 19:13:36 -- host/async_init.sh@53 -- # mktemp 00:27:19.777 19:13:36 -- host/async_init.sh@53 -- # key_path=/tmp/tmp.O961DHBf0J 00:27:19.777 19:13:36 -- host/async_init.sh@54 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:27:19.777 19:13:36 -- host/async_init.sh@55 -- # chmod 0600 /tmp/tmp.O961DHBf0J 00:27:19.777 19:13:36 -- host/async_init.sh@56 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode0 --disable 00:27:19.777 19:13:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:19.777 19:13:36 -- common/autotest_common.sh@10 -- # set +x 00:27:19.777 19:13:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:19.777 19:13:36 -- host/async_init.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 --secure-channel 00:27:19.777 19:13:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:19.777 19:13:36 -- common/autotest_common.sh@10 -- # set +x 00:27:19.777 [2024-11-26 19:13:36.681788] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:27:19.777 [2024-11-26 19:13:36.681896] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:27:19.777 19:13:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:19.777 19:13:36 -- host/async_init.sh@59 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.O961DHBf0J 00:27:19.777 19:13:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:19.777 19:13:36 -- common/autotest_common.sh@10 -- # set +x 00:27:19.777 19:13:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:19.777 19:13:36 -- host/async_init.sh@65 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4421 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.O961DHBf0J 00:27:19.777 19:13:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:19.777 19:13:36 -- common/autotest_common.sh@10 -- # set +x 00:27:20.036 [2024-11-26 19:13:36.701840] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:27:20.036 nvme0n1 00:27:20.036 19:13:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:20.036 19:13:36 -- host/async_init.sh@69 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:27:20.036 19:13:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:20.036 19:13:36 -- common/autotest_common.sh@10 -- # set +x 00:27:20.036 [ 00:27:20.036 { 00:27:20.036 "name": "nvme0n1", 00:27:20.036 "aliases": [ 00:27:20.036 "8f0c0103-3310-408d-af56-8d00a8051244" 00:27:20.036 ], 00:27:20.036 "product_name": "NVMe disk", 00:27:20.036 "block_size": 512, 00:27:20.036 "num_blocks": 2097152, 00:27:20.036 "uuid": "8f0c0103-3310-408d-af56-8d00a8051244", 00:27:20.036 "assigned_rate_limits": { 00:27:20.036 "rw_ios_per_sec": 0, 00:27:20.036 "rw_mbytes_per_sec": 0, 00:27:20.036 "r_mbytes_per_sec": 0, 00:27:20.036 "w_mbytes_per_sec": 0 00:27:20.036 }, 00:27:20.036 "claimed": false, 00:27:20.036 "zoned": false, 00:27:20.036 "supported_io_types": { 00:27:20.036 "read": true, 00:27:20.036 "write": true, 00:27:20.036 "unmap": false, 00:27:20.036 "write_zeroes": true, 00:27:20.036 "flush": true, 00:27:20.036 "reset": true, 00:27:20.036 "compare": true, 00:27:20.036 "compare_and_write": true, 00:27:20.036 "abort": true, 00:27:20.036 "nvme_admin": true, 00:27:20.036 "nvme_io": true 00:27:20.036 }, 00:27:20.036 "driver_specific": { 00:27:20.036 "nvme": [ 00:27:20.036 { 00:27:20.036 "trid": { 00:27:20.036 "trtype": "TCP", 00:27:20.036 "adrfam": "IPv4", 00:27:20.036 "traddr": "10.0.0.2", 00:27:20.036 "trsvcid": "4421", 00:27:20.036 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:27:20.036 }, 00:27:20.036 "ctrlr_data": { 00:27:20.036 "cntlid": 3, 00:27:20.036 "vendor_id": "0x8086", 00:27:20.036 "model_number": "SPDK bdev Controller", 00:27:20.036 "serial_number": "00000000000000000000", 00:27:20.036 "firmware_revision": "24.01.1", 00:27:20.036 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:27:20.036 "oacs": { 00:27:20.036 "security": 0, 00:27:20.036 "format": 0, 00:27:20.036 "firmware": 0, 00:27:20.036 "ns_manage": 0 00:27:20.036 }, 00:27:20.036 "multi_ctrlr": true, 00:27:20.036 "ana_reporting": false 00:27:20.036 }, 00:27:20.036 "vs": { 00:27:20.036 "nvme_version": "1.3" 00:27:20.036 }, 00:27:20.036 "ns_data": { 00:27:20.036 "id": 1, 00:27:20.036 "can_share": true 00:27:20.036 } 00:27:20.036 } 00:27:20.036 ], 00:27:20.036 "mp_policy": "active_passive" 00:27:20.036 } 00:27:20.036 } 00:27:20.036 ] 00:27:20.036 19:13:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:20.036 19:13:36 -- host/async_init.sh@72 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:27:20.036 19:13:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:20.036 19:13:36 -- common/autotest_common.sh@10 -- # set +x 00:27:20.036 19:13:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:20.036 19:13:36 -- host/async_init.sh@75 -- # rm -f /tmp/tmp.O961DHBf0J 00:27:20.036 19:13:36 -- host/async_init.sh@77 -- # trap - SIGINT SIGTERM EXIT 00:27:20.036 19:13:36 -- host/async_init.sh@78 -- # nvmftestfini 00:27:20.036 19:13:36 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:20.036 19:13:36 -- nvmf/common.sh@116 -- # sync 00:27:20.036 19:13:36 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:20.036 19:13:36 -- nvmf/common.sh@119 -- # set +e 00:27:20.036 19:13:36 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:20.036 19:13:36 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:20.036 rmmod nvme_tcp 00:27:20.036 rmmod nvme_fabrics 00:27:20.036 rmmod nvme_keyring 00:27:20.036 19:13:36 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:20.036 19:13:36 -- nvmf/common.sh@123 -- # set -e 00:27:20.036 19:13:36 -- nvmf/common.sh@124 -- # return 0 00:27:20.036 19:13:36 -- nvmf/common.sh@477 -- # '[' -n 3228652 ']' 00:27:20.036 19:13:36 -- nvmf/common.sh@478 -- # killprocess 3228652 00:27:20.036 19:13:36 -- common/autotest_common.sh@936 -- # '[' -z 3228652 ']' 00:27:20.036 19:13:36 -- common/autotest_common.sh@940 -- # kill -0 3228652 00:27:20.036 19:13:36 -- common/autotest_common.sh@941 -- # uname 00:27:20.036 19:13:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:20.036 19:13:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3228652 00:27:20.036 19:13:36 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:20.036 19:13:36 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:20.036 19:13:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3228652' 00:27:20.036 killing process with pid 3228652 00:27:20.036 19:13:36 -- common/autotest_common.sh@955 -- # kill 3228652 00:27:20.036 19:13:36 -- common/autotest_common.sh@960 -- # wait 3228652 00:27:20.295 19:13:37 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:20.295 19:13:37 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:20.295 19:13:37 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:20.295 19:13:37 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:20.295 19:13:37 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:20.295 19:13:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:20.295 19:13:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:20.295 19:13:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:22.831 19:13:39 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:22.831 00:27:22.831 real 0m9.280s 00:27:22.831 user 0m3.506s 00:27:22.831 sys 0m4.333s 00:27:22.831 19:13:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:22.831 19:13:39 -- common/autotest_common.sh@10 -- # set +x 00:27:22.831 ************************************ 00:27:22.831 END TEST nvmf_async_init 00:27:22.831 ************************************ 00:27:22.831 19:13:39 -- nvmf/nvmf.sh@94 -- # run_test dma /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:27:22.831 19:13:39 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:22.831 19:13:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:22.831 19:13:39 -- common/autotest_common.sh@10 -- # set +x 00:27:22.831 ************************************ 00:27:22.831 START TEST dma 00:27:22.831 ************************************ 00:27:22.831 19:13:39 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:27:22.831 * Looking for test storage... 00:27:22.831 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:22.831 19:13:39 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:22.831 19:13:39 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:22.831 19:13:39 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:22.831 19:13:39 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:22.831 19:13:39 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:22.831 19:13:39 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:22.831 19:13:39 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:22.831 19:13:39 -- scripts/common.sh@335 -- # IFS=.-: 00:27:22.831 19:13:39 -- scripts/common.sh@335 -- # read -ra ver1 00:27:22.831 19:13:39 -- scripts/common.sh@336 -- # IFS=.-: 00:27:22.831 19:13:39 -- scripts/common.sh@336 -- # read -ra ver2 00:27:22.831 19:13:39 -- scripts/common.sh@337 -- # local 'op=<' 00:27:22.831 19:13:39 -- scripts/common.sh@339 -- # ver1_l=2 00:27:22.831 19:13:39 -- scripts/common.sh@340 -- # ver2_l=1 00:27:22.831 19:13:39 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:22.831 19:13:39 -- scripts/common.sh@343 -- # case "$op" in 00:27:22.831 19:13:39 -- scripts/common.sh@344 -- # : 1 00:27:22.831 19:13:39 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:22.831 19:13:39 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:22.831 19:13:39 -- scripts/common.sh@364 -- # decimal 1 00:27:22.831 19:13:39 -- scripts/common.sh@352 -- # local d=1 00:27:22.831 19:13:39 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:22.831 19:13:39 -- scripts/common.sh@354 -- # echo 1 00:27:22.831 19:13:39 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:22.831 19:13:39 -- scripts/common.sh@365 -- # decimal 2 00:27:22.831 19:13:39 -- scripts/common.sh@352 -- # local d=2 00:27:22.831 19:13:39 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:22.831 19:13:39 -- scripts/common.sh@354 -- # echo 2 00:27:22.831 19:13:39 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:22.831 19:13:39 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:22.831 19:13:39 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:22.831 19:13:39 -- scripts/common.sh@367 -- # return 0 00:27:22.831 19:13:39 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:22.831 19:13:39 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:22.831 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:22.831 --rc genhtml_branch_coverage=1 00:27:22.831 --rc genhtml_function_coverage=1 00:27:22.831 --rc genhtml_legend=1 00:27:22.831 --rc geninfo_all_blocks=1 00:27:22.831 --rc geninfo_unexecuted_blocks=1 00:27:22.831 00:27:22.831 ' 00:27:22.831 19:13:39 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:22.831 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:22.831 --rc genhtml_branch_coverage=1 00:27:22.831 --rc genhtml_function_coverage=1 00:27:22.831 --rc genhtml_legend=1 00:27:22.831 --rc geninfo_all_blocks=1 00:27:22.831 --rc geninfo_unexecuted_blocks=1 00:27:22.831 00:27:22.831 ' 00:27:22.831 19:13:39 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:22.831 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:22.831 --rc genhtml_branch_coverage=1 00:27:22.831 --rc genhtml_function_coverage=1 00:27:22.831 --rc genhtml_legend=1 00:27:22.831 --rc geninfo_all_blocks=1 00:27:22.831 --rc geninfo_unexecuted_blocks=1 00:27:22.831 00:27:22.831 ' 00:27:22.831 19:13:39 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:22.831 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:22.831 --rc genhtml_branch_coverage=1 00:27:22.831 --rc genhtml_function_coverage=1 00:27:22.831 --rc genhtml_legend=1 00:27:22.831 --rc geninfo_all_blocks=1 00:27:22.831 --rc geninfo_unexecuted_blocks=1 00:27:22.831 00:27:22.831 ' 00:27:22.831 19:13:39 -- host/dma.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:22.831 19:13:39 -- nvmf/common.sh@7 -- # uname -s 00:27:22.831 19:13:39 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:22.831 19:13:39 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:22.831 19:13:39 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:22.831 19:13:39 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:22.831 19:13:39 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:22.831 19:13:39 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:22.831 19:13:39 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:22.831 19:13:39 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:22.831 19:13:39 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:22.831 19:13:39 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:22.831 19:13:39 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:27:22.831 19:13:39 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:27:22.831 19:13:39 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:22.831 19:13:39 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:22.831 19:13:39 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:22.831 19:13:39 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:22.831 19:13:39 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:22.831 19:13:39 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:22.831 19:13:39 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:22.832 19:13:39 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:22.832 19:13:39 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:22.832 19:13:39 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:22.832 19:13:39 -- paths/export.sh@5 -- # export PATH 00:27:22.832 19:13:39 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:22.832 19:13:39 -- nvmf/common.sh@46 -- # : 0 00:27:22.832 19:13:39 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:22.832 19:13:39 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:22.832 19:13:39 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:22.832 19:13:39 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:22.832 19:13:39 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:22.832 19:13:39 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:22.832 19:13:39 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:22.832 19:13:39 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:22.832 19:13:39 -- host/dma.sh@12 -- # '[' tcp '!=' rdma ']' 00:27:22.832 19:13:39 -- host/dma.sh@13 -- # exit 0 00:27:22.832 00:27:22.832 real 0m0.201s 00:27:22.832 user 0m0.115s 00:27:22.832 sys 0m0.099s 00:27:22.832 19:13:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:22.832 19:13:39 -- common/autotest_common.sh@10 -- # set +x 00:27:22.832 ************************************ 00:27:22.832 END TEST dma 00:27:22.832 ************************************ 00:27:22.832 19:13:39 -- nvmf/nvmf.sh@97 -- # run_test nvmf_identify /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:27:22.832 19:13:39 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:22.832 19:13:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:22.832 19:13:39 -- common/autotest_common.sh@10 -- # set +x 00:27:22.832 ************************************ 00:27:22.832 START TEST nvmf_identify 00:27:22.832 ************************************ 00:27:22.832 19:13:39 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:27:22.832 * Looking for test storage... 00:27:22.832 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:22.832 19:13:39 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:22.832 19:13:39 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:22.832 19:13:39 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:22.832 19:13:39 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:22.832 19:13:39 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:22.832 19:13:39 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:22.832 19:13:39 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:22.832 19:13:39 -- scripts/common.sh@335 -- # IFS=.-: 00:27:22.832 19:13:39 -- scripts/common.sh@335 -- # read -ra ver1 00:27:22.832 19:13:39 -- scripts/common.sh@336 -- # IFS=.-: 00:27:22.832 19:13:39 -- scripts/common.sh@336 -- # read -ra ver2 00:27:22.832 19:13:39 -- scripts/common.sh@337 -- # local 'op=<' 00:27:22.832 19:13:39 -- scripts/common.sh@339 -- # ver1_l=2 00:27:22.832 19:13:39 -- scripts/common.sh@340 -- # ver2_l=1 00:27:22.832 19:13:39 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:22.832 19:13:39 -- scripts/common.sh@343 -- # case "$op" in 00:27:22.832 19:13:39 -- scripts/common.sh@344 -- # : 1 00:27:22.832 19:13:39 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:22.832 19:13:39 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:22.832 19:13:39 -- scripts/common.sh@364 -- # decimal 1 00:27:22.832 19:13:39 -- scripts/common.sh@352 -- # local d=1 00:27:22.832 19:13:39 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:22.832 19:13:39 -- scripts/common.sh@354 -- # echo 1 00:27:22.832 19:13:39 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:22.832 19:13:39 -- scripts/common.sh@365 -- # decimal 2 00:27:22.832 19:13:39 -- scripts/common.sh@352 -- # local d=2 00:27:22.832 19:13:39 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:22.832 19:13:39 -- scripts/common.sh@354 -- # echo 2 00:27:22.832 19:13:39 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:22.832 19:13:39 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:22.832 19:13:39 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:22.832 19:13:39 -- scripts/common.sh@367 -- # return 0 00:27:22.832 19:13:39 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:22.832 19:13:39 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:22.832 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:22.832 --rc genhtml_branch_coverage=1 00:27:22.832 --rc genhtml_function_coverage=1 00:27:22.832 --rc genhtml_legend=1 00:27:22.832 --rc geninfo_all_blocks=1 00:27:22.832 --rc geninfo_unexecuted_blocks=1 00:27:22.832 00:27:22.832 ' 00:27:22.832 19:13:39 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:22.832 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:22.832 --rc genhtml_branch_coverage=1 00:27:22.832 --rc genhtml_function_coverage=1 00:27:22.832 --rc genhtml_legend=1 00:27:22.832 --rc geninfo_all_blocks=1 00:27:22.832 --rc geninfo_unexecuted_blocks=1 00:27:22.832 00:27:22.832 ' 00:27:22.832 19:13:39 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:22.832 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:22.832 --rc genhtml_branch_coverage=1 00:27:22.832 --rc genhtml_function_coverage=1 00:27:22.832 --rc genhtml_legend=1 00:27:22.832 --rc geninfo_all_blocks=1 00:27:22.832 --rc geninfo_unexecuted_blocks=1 00:27:22.832 00:27:22.832 ' 00:27:22.832 19:13:39 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:22.832 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:22.832 --rc genhtml_branch_coverage=1 00:27:22.832 --rc genhtml_function_coverage=1 00:27:22.832 --rc genhtml_legend=1 00:27:22.832 --rc geninfo_all_blocks=1 00:27:22.832 --rc geninfo_unexecuted_blocks=1 00:27:22.832 00:27:22.832 ' 00:27:22.832 19:13:39 -- host/identify.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:22.832 19:13:39 -- nvmf/common.sh@7 -- # uname -s 00:27:22.832 19:13:39 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:22.832 19:13:39 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:22.832 19:13:39 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:22.832 19:13:39 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:22.832 19:13:39 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:22.832 19:13:39 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:22.832 19:13:39 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:22.832 19:13:39 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:22.833 19:13:39 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:22.833 19:13:39 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:22.833 19:13:39 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:27:22.833 19:13:39 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:27:22.833 19:13:39 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:22.833 19:13:39 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:22.833 19:13:39 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:22.833 19:13:39 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:22.833 19:13:39 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:22.833 19:13:39 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:22.833 19:13:39 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:22.833 19:13:39 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:22.833 19:13:39 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:22.833 19:13:39 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:22.833 19:13:39 -- paths/export.sh@5 -- # export PATH 00:27:22.833 19:13:39 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:22.833 19:13:39 -- nvmf/common.sh@46 -- # : 0 00:27:22.833 19:13:39 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:22.833 19:13:39 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:22.833 19:13:39 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:22.833 19:13:39 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:22.833 19:13:39 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:22.833 19:13:39 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:22.833 19:13:39 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:22.833 19:13:39 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:22.833 19:13:39 -- host/identify.sh@11 -- # MALLOC_BDEV_SIZE=64 00:27:22.833 19:13:39 -- host/identify.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:27:22.833 19:13:39 -- host/identify.sh@14 -- # nvmftestinit 00:27:22.833 19:13:39 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:22.833 19:13:39 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:22.833 19:13:39 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:22.833 19:13:39 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:22.833 19:13:39 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:22.833 19:13:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:22.833 19:13:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:22.833 19:13:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:22.833 19:13:39 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:22.833 19:13:39 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:22.833 19:13:39 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:22.833 19:13:39 -- common/autotest_common.sh@10 -- # set +x 00:27:28.132 19:13:44 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:28.132 19:13:44 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:28.132 19:13:44 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:28.132 19:13:44 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:28.132 19:13:44 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:28.132 19:13:44 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:28.132 19:13:44 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:28.132 19:13:44 -- nvmf/common.sh@294 -- # net_devs=() 00:27:28.133 19:13:44 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:28.133 19:13:44 -- nvmf/common.sh@295 -- # e810=() 00:27:28.133 19:13:44 -- nvmf/common.sh@295 -- # local -ga e810 00:27:28.133 19:13:44 -- nvmf/common.sh@296 -- # x722=() 00:27:28.133 19:13:44 -- nvmf/common.sh@296 -- # local -ga x722 00:27:28.133 19:13:44 -- nvmf/common.sh@297 -- # mlx=() 00:27:28.133 19:13:44 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:28.133 19:13:44 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:28.133 19:13:44 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:28.133 19:13:44 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:28.133 19:13:44 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:28.133 19:13:44 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:28.133 19:13:44 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:28.133 19:13:44 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:28.133 19:13:44 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:28.133 19:13:44 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:28.133 19:13:44 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:28.133 19:13:44 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:28.133 19:13:44 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:28.133 19:13:44 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:28.133 19:13:44 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:28.133 19:13:44 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:28.133 19:13:44 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:28.133 19:13:44 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:28.133 19:13:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:28.133 19:13:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:27:28.133 Found 0000:86:00.0 (0x8086 - 0x159b) 00:27:28.133 19:13:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:28.133 19:13:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:28.133 19:13:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:28.133 19:13:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:28.133 19:13:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:28.133 19:13:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:28.133 19:13:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:27:28.133 Found 0000:86:00.1 (0x8086 - 0x159b) 00:27:28.133 19:13:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:28.133 19:13:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:28.133 19:13:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:28.133 19:13:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:28.133 19:13:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:28.133 19:13:44 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:28.133 19:13:44 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:28.133 19:13:44 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:28.133 19:13:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:28.133 19:13:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:28.133 19:13:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:28.133 19:13:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:28.133 19:13:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:27:28.133 Found net devices under 0000:86:00.0: cvl_0_0 00:27:28.133 19:13:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:28.133 19:13:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:28.133 19:13:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:28.133 19:13:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:28.133 19:13:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:28.133 19:13:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:27:28.133 Found net devices under 0000:86:00.1: cvl_0_1 00:27:28.133 19:13:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:28.133 19:13:44 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:28.133 19:13:44 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:28.133 19:13:44 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:28.133 19:13:44 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:28.133 19:13:44 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:28.133 19:13:44 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:28.133 19:13:44 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:28.133 19:13:44 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:28.133 19:13:44 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:28.133 19:13:44 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:28.133 19:13:44 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:28.133 19:13:44 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:28.133 19:13:44 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:28.133 19:13:44 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:28.133 19:13:44 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:28.133 19:13:44 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:28.133 19:13:44 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:28.133 19:13:44 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:28.133 19:13:44 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:28.133 19:13:44 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:28.133 19:13:44 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:28.133 19:13:44 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:28.133 19:13:44 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:28.133 19:13:44 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:28.133 19:13:44 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:28.133 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:28.133 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.442 ms 00:27:28.133 00:27:28.133 --- 10.0.0.2 ping statistics --- 00:27:28.133 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:28.133 rtt min/avg/max/mdev = 0.442/0.442/0.442/0.000 ms 00:27:28.133 19:13:44 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:28.133 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:28.133 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.201 ms 00:27:28.133 00:27:28.133 --- 10.0.0.1 ping statistics --- 00:27:28.133 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:28.133 rtt min/avg/max/mdev = 0.201/0.201/0.201/0.000 ms 00:27:28.133 19:13:44 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:28.133 19:13:44 -- nvmf/common.sh@410 -- # return 0 00:27:28.133 19:13:44 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:28.133 19:13:44 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:28.133 19:13:44 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:28.133 19:13:44 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:28.133 19:13:44 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:28.133 19:13:44 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:28.133 19:13:44 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:28.133 19:13:44 -- host/identify.sh@16 -- # timing_enter start_nvmf_tgt 00:27:28.133 19:13:44 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:28.133 19:13:44 -- common/autotest_common.sh@10 -- # set +x 00:27:28.133 19:13:44 -- host/identify.sh@19 -- # nvmfpid=3232499 00:27:28.133 19:13:44 -- host/identify.sh@21 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:27:28.133 19:13:44 -- host/identify.sh@23 -- # waitforlisten 3232499 00:27:28.133 19:13:44 -- common/autotest_common.sh@829 -- # '[' -z 3232499 ']' 00:27:28.133 19:13:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:28.133 19:13:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:28.133 19:13:44 -- host/identify.sh@18 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:27:28.133 19:13:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:28.133 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:28.133 19:13:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:28.133 19:13:44 -- common/autotest_common.sh@10 -- # set +x 00:27:28.133 [2024-11-26 19:13:44.978375] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:27:28.133 [2024-11-26 19:13:44.978419] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:28.133 EAL: No free 2048 kB hugepages reported on node 1 00:27:28.133 [2024-11-26 19:13:45.037222] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:27:28.393 [2024-11-26 19:13:45.078686] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:28.393 [2024-11-26 19:13:45.078804] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:28.393 [2024-11-26 19:13:45.078812] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:28.393 [2024-11-26 19:13:45.078818] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:28.393 [2024-11-26 19:13:45.078862] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:28.393 [2024-11-26 19:13:45.078977] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:28.393 [2024-11-26 19:13:45.079068] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:28.393 [2024-11-26 19:13:45.079069] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:28.961 19:13:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:28.961 19:13:45 -- common/autotest_common.sh@862 -- # return 0 00:27:28.961 19:13:45 -- host/identify.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:27:28.961 19:13:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:28.961 19:13:45 -- common/autotest_common.sh@10 -- # set +x 00:27:28.961 [2024-11-26 19:13:45.810350] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:28.961 19:13:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:28.961 19:13:45 -- host/identify.sh@25 -- # timing_exit start_nvmf_tgt 00:27:28.961 19:13:45 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:28.961 19:13:45 -- common/autotest_common.sh@10 -- # set +x 00:27:28.961 19:13:45 -- host/identify.sh@27 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:28.961 19:13:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:28.961 19:13:45 -- common/autotest_common.sh@10 -- # set +x 00:27:28.961 Malloc0 00:27:28.961 19:13:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:28.961 19:13:45 -- host/identify.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:28.961 19:13:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:28.961 19:13:45 -- common/autotest_common.sh@10 -- # set +x 00:27:29.223 19:13:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:29.223 19:13:45 -- host/identify.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 --nguid ABCDEF0123456789ABCDEF0123456789 --eui64 ABCDEF0123456789 00:27:29.223 19:13:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:29.223 19:13:45 -- common/autotest_common.sh@10 -- # set +x 00:27:29.223 19:13:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:29.223 19:13:45 -- host/identify.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:29.223 19:13:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:29.223 19:13:45 -- common/autotest_common.sh@10 -- # set +x 00:27:29.223 [2024-11-26 19:13:45.902467] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:29.223 19:13:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:29.223 19:13:45 -- host/identify.sh@35 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:27:29.223 19:13:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:29.223 19:13:45 -- common/autotest_common.sh@10 -- # set +x 00:27:29.223 19:13:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:29.223 19:13:45 -- host/identify.sh@37 -- # rpc_cmd nvmf_get_subsystems 00:27:29.223 19:13:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:29.223 19:13:45 -- common/autotest_common.sh@10 -- # set +x 00:27:29.223 [2024-11-26 19:13:45.918273] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:27:29.223 [ 00:27:29.223 { 00:27:29.223 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:27:29.223 "subtype": "Discovery", 00:27:29.223 "listen_addresses": [ 00:27:29.223 { 00:27:29.223 "transport": "TCP", 00:27:29.223 "trtype": "TCP", 00:27:29.223 "adrfam": "IPv4", 00:27:29.223 "traddr": "10.0.0.2", 00:27:29.223 "trsvcid": "4420" 00:27:29.223 } 00:27:29.223 ], 00:27:29.223 "allow_any_host": true, 00:27:29.223 "hosts": [] 00:27:29.223 }, 00:27:29.223 { 00:27:29.223 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:27:29.223 "subtype": "NVMe", 00:27:29.223 "listen_addresses": [ 00:27:29.223 { 00:27:29.223 "transport": "TCP", 00:27:29.223 "trtype": "TCP", 00:27:29.223 "adrfam": "IPv4", 00:27:29.223 "traddr": "10.0.0.2", 00:27:29.223 "trsvcid": "4420" 00:27:29.223 } 00:27:29.223 ], 00:27:29.223 "allow_any_host": true, 00:27:29.223 "hosts": [], 00:27:29.223 "serial_number": "SPDK00000000000001", 00:27:29.223 "model_number": "SPDK bdev Controller", 00:27:29.223 "max_namespaces": 32, 00:27:29.223 "min_cntlid": 1, 00:27:29.223 "max_cntlid": 65519, 00:27:29.223 "namespaces": [ 00:27:29.223 { 00:27:29.223 "nsid": 1, 00:27:29.223 "bdev_name": "Malloc0", 00:27:29.223 "name": "Malloc0", 00:27:29.223 "nguid": "ABCDEF0123456789ABCDEF0123456789", 00:27:29.223 "eui64": "ABCDEF0123456789", 00:27:29.223 "uuid": "ae32f93e-4115-47da-9686-6749853be26a" 00:27:29.223 } 00:27:29.223 ] 00:27:29.223 } 00:27:29.223 ] 00:27:29.223 19:13:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:29.223 19:13:45 -- host/identify.sh@39 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' -L all 00:27:29.223 [2024-11-26 19:13:45.953357] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:27:29.223 [2024-11-26 19:13:45.953400] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3232750 ] 00:27:29.223 EAL: No free 2048 kB hugepages reported on node 1 00:27:29.223 [2024-11-26 19:13:45.985386] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to connect adminq (no timeout) 00:27:29.223 [2024-11-26 19:13:45.985425] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:27:29.223 [2024-11-26 19:13:45.985430] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:27:29.223 [2024-11-26 19:13:45.985440] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:27:29.223 [2024-11-26 19:13:45.985447] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:27:29.223 [2024-11-26 19:13:45.985775] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for connect adminq (no timeout) 00:27:29.223 [2024-11-26 19:13:45.985807] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x17569f0 0 00:27:29.223 [2024-11-26 19:13:45.998956] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:27:29.223 [2024-11-26 19:13:45.998968] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:27:29.223 [2024-11-26 19:13:45.998972] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:27:29.223 [2024-11-26 19:13:45.998975] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:27:29.223 [2024-11-26 19:13:45.999009] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:27:29.223 [2024-11-26 19:13:45.999015] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:27:29.223 [2024-11-26 19:13:45.999018] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x17569f0) 00:27:29.223 [2024-11-26 19:13:45.999029] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:27:29.223 [2024-11-26 19:13:45.999045] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17b1ec0, cid 0, qid 0 00:27:29.223 [2024-11-26 19:13:46.006959] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:27:29.223 [2024-11-26 19:13:46.006967] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:27:29.223 [2024-11-26 19:13:46.006971] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:27:29.223 [2024-11-26 19:13:46.006975] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17b1ec0) on tqpair=0x17569f0 00:27:29.223 [2024-11-26 19:13:46.006985] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:27:29.223 [2024-11-26 19:13:46.006991] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs (no timeout) 00:27:29.223 [2024-11-26 19:13:46.006996] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs wait for vs (no timeout) 00:27:29.223 [2024-11-26 19:13:46.007007] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:27:29.223 [2024-11-26 19:13:46.007011] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:27:29.223 [2024-11-26 19:13:46.007015] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x17569f0) 00:27:29.223 [2024-11-26 19:13:46.007021] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.223 [2024-11-26 19:13:46.007034] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17b1ec0, cid 0, qid 0 00:27:29.223 [2024-11-26 19:13:46.007206] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:27:29.223 [2024-11-26 19:13:46.007212] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:27:29.223 [2024-11-26 19:13:46.007215] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:27:29.223 [2024-11-26 19:13:46.007218] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17b1ec0) on tqpair=0x17569f0 00:27:29.223 [2024-11-26 19:13:46.007224] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap (no timeout) 00:27:29.223 [2024-11-26 19:13:46.007231] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap wait for cap (no timeout) 00:27:29.223 [2024-11-26 19:13:46.007240] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:27:29.223 [2024-11-26 19:13:46.007243] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:27:29.223 [2024-11-26 19:13:46.007247] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x17569f0) 00:27:29.223 [2024-11-26 19:13:46.007252] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.223 [2024-11-26 19:13:46.007263] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17b1ec0, cid 0, qid 0 00:27:29.223 [2024-11-26 19:13:46.007332] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:27:29.223 [2024-11-26 19:13:46.007338] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:27:29.223 [2024-11-26 19:13:46.007341] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:27:29.223 [2024-11-26 19:13:46.007344] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17b1ec0) on tqpair=0x17569f0 00:27:29.223 [2024-11-26 19:13:46.007350] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en (no timeout) 00:27:29.223 [2024-11-26 19:13:46.007357] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en wait for cc (timeout 15000 ms) 00:27:29.223 [2024-11-26 19:13:46.007363] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:27:29.223 [2024-11-26 19:13:46.007367] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:27:29.223 [2024-11-26 19:13:46.007370] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x17569f0) 00:27:29.223 [2024-11-26 19:13:46.007375] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.223 [2024-11-26 19:13:46.007385] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17b1ec0, cid 0, qid 0 00:27:29.223 [2024-11-26 19:13:46.007456] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:27:29.223 [2024-11-26 19:13:46.007462] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:27:29.223 [2024-11-26 19:13:46.007465] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:27:29.223 [2024-11-26 19:13:46.007468] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17b1ec0) on tqpair=0x17569f0 00:27:29.223 [2024-11-26 19:13:46.007473] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:27:29.223 [2024-11-26 19:13:46.007481] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:27:29.223 [2024-11-26 19:13:46.007485] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:27:29.223 [2024-11-26 19:13:46.007488] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x17569f0) 00:27:29.223 [2024-11-26 19:13:46.007494] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.223 [2024-11-26 19:13:46.007503] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17b1ec0, cid 0, qid 0 00:27:29.223 [2024-11-26 19:13:46.007569] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:27:29.223 [2024-11-26 19:13:46.007575] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:27:29.223 [2024-11-26 19:13:46.007578] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:27:29.224 [2024-11-26 19:13:46.007581] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17b1ec0) on tqpair=0x17569f0 00:27:29.224 [2024-11-26 19:13:46.007586] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 0 && CSTS.RDY = 0 00:27:29.224 [2024-11-26 19:13:46.007590] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to controller is disabled (timeout 15000 ms) 00:27:29.224 [2024-11-26 19:13:46.007597] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:27:29.224 [2024-11-26 19:13:46.007704] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Setting CC.EN = 1 00:27:29.224 [2024-11-26 19:13:46.007708] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:27:29.224 [2024-11-26 19:13:46.007715] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:27:29.224 [2024-11-26 19:13:46.007718] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:27:29.224 [2024-11-26 19:13:46.007722] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x17569f0) 00:27:29.224 [2024-11-26 19:13:46.007727] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.224 [2024-11-26 19:13:46.007737] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17b1ec0, cid 0, qid 0 00:27:29.224 [2024-11-26 19:13:46.007800] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:27:29.224 [2024-11-26 19:13:46.007805] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:27:29.224 [2024-11-26 19:13:46.007809] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:27:29.224 [2024-11-26 19:13:46.007812] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17b1ec0) on tqpair=0x17569f0 00:27:29.224 [2024-11-26 19:13:46.007816] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:27:29.224 [2024-11-26 19:13:46.007825] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:27:29.224 [2024-11-26 19:13:46.007828] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:27:29.224 [2024-11-26 19:13:46.007832] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x17569f0) 00:27:29.224 [2024-11-26 19:13:46.007837] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.224 [2024-11-26 19:13:46.007847] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17b1ec0, cid 0, qid 0 00:27:29.224 [2024-11-26 19:13:46.007911] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:27:29.224 [2024-11-26 19:13:46.007916] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:27:29.224 [2024-11-26 19:13:46.007920] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:27:29.224 [2024-11-26 19:13:46.007923] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17b1ec0) on tqpair=0x17569f0 00:27:29.224 [2024-11-26 19:13:46.007928] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:27:29.224 [2024-11-26 19:13:46.007932] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to reset admin queue (timeout 30000 ms) 00:27:29.224 [2024-11-26 19:13:46.007939] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to identify controller (no timeout) 00:27:29.224 [2024-11-26 19:13:46.007954] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for identify controller (timeout 30000 ms) 00:27:29.224 [2024-11-26 19:13:46.007963] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:27:29.224 [2024-11-26 19:13:46.007966] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:27:29.224 [2024-11-26 19:13:46.007969] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x17569f0) 00:27:29.224 [2024-11-26 19:13:46.007976] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.224 [2024-11-26 19:13:46.007985] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17b1ec0, cid 0, qid 0 00:27:29.224 [2024-11-26 19:13:46.008081] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:27:29.224 [2024-11-26 19:13:46.008087] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:27:29.224 [2024-11-26 19:13:46.008093] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:27:29.224 [2024-11-26 19:13:46.008096] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x17569f0): datao=0, datal=4096, cccid=0 00:27:29.224 [2024-11-26 19:13:46.008100] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x17b1ec0) on tqpair(0x17569f0): expected_datao=0, payload_size=4096 00:27:29.224 [2024-11-26 19:13:46.008107] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:27:29.224 [2024-11-26 19:13:46.008111] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:27:29.224 [2024-11-26 19:13:46.008132] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:27:29.224 [2024-11-26 19:13:46.008138] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:27:29.224 [2024-11-26 19:13:46.008141] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:27:29.224 [2024-11-26 19:13:46.008144] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17b1ec0) on tqpair=0x17569f0 00:27:29.224 [2024-11-26 19:13:46.008152] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_xfer_size 4294967295 00:27:29.224 [2024-11-26 19:13:46.008157] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] MDTS max_xfer_size 131072 00:27:29.224 [2024-11-26 19:13:46.008161] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CNTLID 0x0001 00:27:29.224 [2024-11-26 19:13:46.008165] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_sges 16 00:27:29.224 [2024-11-26 19:13:46.008169] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] fuses compare and write: 1 00:27:29.224 [2024-11-26 19:13:46.008173] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to configure AER (timeout 30000 ms) 00:27:29.224 [2024-11-26 19:13:46.008184] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for configure aer (timeout 30000 ms) 00:27:29.224 [2024-11-26 19:13:46.008190] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:27:29.224 [2024-11-26 19:13:46.008194] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:27:29.224 [2024-11-26 19:13:46.008197] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x17569f0) 00:27:29.224 [2024-11-26 19:13:46.008203] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:27:29.224 [2024-11-26 19:13:46.008214] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17b1ec0, cid 0, qid 0 00:27:29.224 [2024-11-26 19:13:46.008279] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:27:29.224 [2024-11-26 19:13:46.008285] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:27:29.224 [2024-11-26 19:13:46.008289] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:27:29.224 [2024-11-26 19:13:46.008292] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17b1ec0) on tqpair=0x17569f0 00:27:29.224 [2024-11-26 19:13:46.008298] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:27:29.224 [2024-11-26 19:13:46.008302] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:27:29.224 [2024-11-26 19:13:46.008305] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x17569f0) 00:27:29.224 [2024-11-26 19:13:46.008310] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:27:29.224 [2024-11-26 19:13:46.008315] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:27:29.224 [2024-11-26 19:13:46.008319] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:27:29.224 [2024-11-26 19:13:46.008322] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x17569f0) 00:27:29.224 [2024-11-26 19:13:46.008327] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:27:29.224 [2024-11-26 19:13:46.008334] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:27:29.224 [2024-11-26 19:13:46.008337] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:27:29.224 [2024-11-26 19:13:46.008341] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x17569f0) 00:27:29.224 [2024-11-26 19:13:46.008345] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:27:29.224 [2024-11-26 19:13:46.008351] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:27:29.224 [2024-11-26 19:13:46.008354] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:27:29.224 [2024-11-26 19:13:46.008357] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x17569f0) 00:27:29.224 [2024-11-26 19:13:46.008362] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:27:29.224 [2024-11-26 19:13:46.008366] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to set keep alive timeout (timeout 30000 ms) 00:27:29.224 [2024-11-26 19:13:46.008377] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:27:29.224 [2024-11-26 19:13:46.008383] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:27:29.224 [2024-11-26 19:13:46.008386] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:27:29.224 [2024-11-26 19:13:46.008389] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x17569f0) 00:27:29.224 [2024-11-26 19:13:46.008394] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.224 [2024-11-26 19:13:46.008405] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17b1ec0, cid 0, qid 0 00:27:29.224 [2024-11-26 19:13:46.008410] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17b2020, cid 1, qid 0 00:27:29.224 [2024-11-26 19:13:46.008414] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17b2180, cid 2, qid 0 00:27:29.224 [2024-11-26 19:13:46.008418] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17b22e0, cid 3, qid 0 00:27:29.224 [2024-11-26 19:13:46.008422] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17b2440, cid 4, qid 0 00:27:29.224 [2024-11-26 19:13:46.008524] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:27:29.224 [2024-11-26 19:13:46.008530] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:27:29.224 [2024-11-26 19:13:46.008533] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:27:29.224 [2024-11-26 19:13:46.008536] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17b2440) on tqpair=0x17569f0 00:27:29.224 [2024-11-26 19:13:46.008542] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Sending keep alive every 5000000 us 00:27:29.224 [2024-11-26 19:13:46.008546] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to ready (no timeout) 00:27:29.224 [2024-11-26 19:13:46.008555] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:27:29.224 [2024-11-26 19:13:46.008558] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:27:29.224 [2024-11-26 19:13:46.008562] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x17569f0) 00:27:29.225 [2024-11-26 19:13:46.008567] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.225 [2024-11-26 19:13:46.008577] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17b2440, cid 4, qid 0 00:27:29.225 [2024-11-26 19:13:46.008649] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:27:29.225 [2024-11-26 19:13:46.008655] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:27:29.225 [2024-11-26 19:13:46.008658] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:27:29.225 [2024-11-26 19:13:46.008661] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x17569f0): datao=0, datal=4096, cccid=4 00:27:29.225 [2024-11-26 19:13:46.008667] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x17b2440) on tqpair(0x17569f0): expected_datao=0, payload_size=4096 00:27:29.225 [2024-11-26 19:13:46.008674] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:27:29.225 [2024-11-26 19:13:46.008677] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:27:29.225 [2024-11-26 19:13:46.008691] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:27:29.225 [2024-11-26 19:13:46.008697] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:27:29.225 [2024-11-26 19:13:46.008700] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:27:29.225 [2024-11-26 19:13:46.008703] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17b2440) on tqpair=0x17569f0 00:27:29.225 [2024-11-26 19:13:46.008713] nvme_ctrlr.c:4024:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr already in ready state 00:27:29.225 [2024-11-26 19:13:46.008733] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:27:29.225 [2024-11-26 19:13:46.008737] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:27:29.225 [2024-11-26 19:13:46.008740] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x17569f0) 00:27:29.225 [2024-11-26 19:13:46.008746] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.225 [2024-11-26 19:13:46.008752] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:27:29.225 [2024-11-26 19:13:46.008755] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:27:29.225 [2024-11-26 19:13:46.008758] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x17569f0) 00:27:29.225 [2024-11-26 19:13:46.008763] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:27:29.225 [2024-11-26 19:13:46.008776] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17b2440, cid 4, qid 0 00:27:29.225 [2024-11-26 19:13:46.008781] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17b25a0, cid 5, qid 0 00:27:29.225 [2024-11-26 19:13:46.008878] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:27:29.225 [2024-11-26 19:13:46.008884] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:27:29.225 [2024-11-26 19:13:46.008887] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:27:29.225 [2024-11-26 19:13:46.008890] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x17569f0): datao=0, datal=1024, cccid=4 00:27:29.225 [2024-11-26 19:13:46.008894] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x17b2440) on tqpair(0x17569f0): expected_datao=0, payload_size=1024 00:27:29.225 [2024-11-26 19:13:46.008900] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:27:29.225 [2024-11-26 19:13:46.008904] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:27:29.225 [2024-11-26 19:13:46.008909] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:27:29.225 [2024-11-26 19:13:46.008913] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:27:29.225 [2024-11-26 19:13:46.008916] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:27:29.225 [2024-11-26 19:13:46.008920] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17b25a0) on tqpair=0x17569f0 00:27:29.225 [2024-11-26 19:13:46.049093] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:27:29.225 [2024-11-26 19:13:46.049107] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:27:29.225 [2024-11-26 19:13:46.049110] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:27:29.225 [2024-11-26 19:13:46.049114] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17b2440) on tqpair=0x17569f0 00:27:29.225 [2024-11-26 19:13:46.049126] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:27:29.225 [2024-11-26 19:13:46.049130] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:27:29.225 [2024-11-26 19:13:46.049133] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x17569f0) 00:27:29.225 [2024-11-26 19:13:46.049143] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:02ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.225 [2024-11-26 19:13:46.049159] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17b2440, cid 4, qid 0 00:27:29.225 [2024-11-26 19:13:46.049245] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:27:29.225 [2024-11-26 19:13:46.049251] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:27:29.225 [2024-11-26 19:13:46.049254] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:27:29.225 [2024-11-26 19:13:46.049257] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x17569f0): datao=0, datal=3072, cccid=4 00:27:29.225 [2024-11-26 19:13:46.049261] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x17b2440) on tqpair(0x17569f0): expected_datao=0, payload_size=3072 00:27:29.225 [2024-11-26 19:13:46.049267] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:27:29.225 [2024-11-26 19:13:46.049271] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:27:29.225 [2024-11-26 19:13:46.049284] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:27:29.225 [2024-11-26 19:13:46.049290] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:27:29.225 [2024-11-26 19:13:46.049293] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:27:29.225 [2024-11-26 19:13:46.049296] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17b2440) on tqpair=0x17569f0 00:27:29.225 [2024-11-26 19:13:46.049304] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:27:29.225 [2024-11-26 19:13:46.049308] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:27:29.225 [2024-11-26 19:13:46.049311] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x17569f0) 00:27:29.225 [2024-11-26 19:13:46.049317] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00010070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.225 [2024-11-26 19:13:46.049329] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17b2440, cid 4, qid 0 00:27:29.225 [2024-11-26 19:13:46.049401] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:27:29.225 [2024-11-26 19:13:46.049407] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:27:29.225 [2024-11-26 19:13:46.049410] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:27:29.225 [2024-11-26 19:13:46.049413] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x17569f0): datao=0, datal=8, cccid=4 00:27:29.225 [2024-11-26 19:13:46.049417] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x17b2440) on tqpair(0x17569f0): expected_datao=0, payload_size=8 00:27:29.225 [2024-11-26 19:13:46.049423] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:27:29.225 [2024-11-26 19:13:46.049427] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:27:29.225 [2024-11-26 19:13:46.090100] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:27:29.225 [2024-11-26 19:13:46.090113] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:27:29.225 [2024-11-26 19:13:46.090117] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:27:29.225 [2024-11-26 19:13:46.090120] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17b2440) on tqpair=0x17569f0 00:27:29.225 ===================================================== 00:27:29.225 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2014-08.org.nvmexpress.discovery 00:27:29.225 ===================================================== 00:27:29.225 Controller Capabilities/Features 00:27:29.225 ================================ 00:27:29.225 Vendor ID: 0000 00:27:29.225 Subsystem Vendor ID: 0000 00:27:29.225 Serial Number: .................... 00:27:29.225 Model Number: ........................................ 00:27:29.225 Firmware Version: 24.01.1 00:27:29.225 Recommended Arb Burst: 0 00:27:29.225 IEEE OUI Identifier: 00 00 00 00:27:29.225 Multi-path I/O 00:27:29.225 May have multiple subsystem ports: No 00:27:29.225 May have multiple controllers: No 00:27:29.225 Associated with SR-IOV VF: No 00:27:29.225 Max Data Transfer Size: 131072 00:27:29.225 Max Number of Namespaces: 0 00:27:29.225 Max Number of I/O Queues: 1024 00:27:29.225 NVMe Specification Version (VS): 1.3 00:27:29.225 NVMe Specification Version (Identify): 1.3 00:27:29.225 Maximum Queue Entries: 128 00:27:29.225 Contiguous Queues Required: Yes 00:27:29.225 Arbitration Mechanisms Supported 00:27:29.225 Weighted Round Robin: Not Supported 00:27:29.225 Vendor Specific: Not Supported 00:27:29.225 Reset Timeout: 15000 ms 00:27:29.225 Doorbell Stride: 4 bytes 00:27:29.225 NVM Subsystem Reset: Not Supported 00:27:29.225 Command Sets Supported 00:27:29.225 NVM Command Set: Supported 00:27:29.225 Boot Partition: Not Supported 00:27:29.225 Memory Page Size Minimum: 4096 bytes 00:27:29.225 Memory Page Size Maximum: 4096 bytes 00:27:29.225 Persistent Memory Region: Not Supported 00:27:29.225 Optional Asynchronous Events Supported 00:27:29.225 Namespace Attribute Notices: Not Supported 00:27:29.225 Firmware Activation Notices: Not Supported 00:27:29.225 ANA Change Notices: Not Supported 00:27:29.225 PLE Aggregate Log Change Notices: Not Supported 00:27:29.225 LBA Status Info Alert Notices: Not Supported 00:27:29.225 EGE Aggregate Log Change Notices: Not Supported 00:27:29.225 Normal NVM Subsystem Shutdown event: Not Supported 00:27:29.225 Zone Descriptor Change Notices: Not Supported 00:27:29.225 Discovery Log Change Notices: Supported 00:27:29.225 Controller Attributes 00:27:29.225 128-bit Host Identifier: Not Supported 00:27:29.225 Non-Operational Permissive Mode: Not Supported 00:27:29.225 NVM Sets: Not Supported 00:27:29.225 Read Recovery Levels: Not Supported 00:27:29.225 Endurance Groups: Not Supported 00:27:29.225 Predictable Latency Mode: Not Supported 00:27:29.225 Traffic Based Keep ALive: Not Supported 00:27:29.225 Namespace Granularity: Not Supported 00:27:29.225 SQ Associations: Not Supported 00:27:29.225 UUID List: Not Supported 00:27:29.225 Multi-Domain Subsystem: Not Supported 00:27:29.225 Fixed Capacity Management: Not Supported 00:27:29.225 Variable Capacity Management: Not Supported 00:27:29.225 Delete Endurance Group: Not Supported 00:27:29.225 Delete NVM Set: Not Supported 00:27:29.225 Extended LBA Formats Supported: Not Supported 00:27:29.226 Flexible Data Placement Supported: Not Supported 00:27:29.226 00:27:29.226 Controller Memory Buffer Support 00:27:29.226 ================================ 00:27:29.226 Supported: No 00:27:29.226 00:27:29.226 Persistent Memory Region Support 00:27:29.226 ================================ 00:27:29.226 Supported: No 00:27:29.226 00:27:29.226 Admin Command Set Attributes 00:27:29.226 ============================ 00:27:29.226 Security Send/Receive: Not Supported 00:27:29.226 Format NVM: Not Supported 00:27:29.226 Firmware Activate/Download: Not Supported 00:27:29.226 Namespace Management: Not Supported 00:27:29.226 Device Self-Test: Not Supported 00:27:29.226 Directives: Not Supported 00:27:29.226 NVMe-MI: Not Supported 00:27:29.226 Virtualization Management: Not Supported 00:27:29.226 Doorbell Buffer Config: Not Supported 00:27:29.226 Get LBA Status Capability: Not Supported 00:27:29.226 Command & Feature Lockdown Capability: Not Supported 00:27:29.226 Abort Command Limit: 1 00:27:29.226 Async Event Request Limit: 4 00:27:29.226 Number of Firmware Slots: N/A 00:27:29.226 Firmware Slot 1 Read-Only: N/A 00:27:29.226 Firmware Activation Without Reset: N/A 00:27:29.226 Multiple Update Detection Support: N/A 00:27:29.226 Firmware Update Granularity: No Information Provided 00:27:29.226 Per-Namespace SMART Log: No 00:27:29.226 Asymmetric Namespace Access Log Page: Not Supported 00:27:29.226 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:27:29.226 Command Effects Log Page: Not Supported 00:27:29.226 Get Log Page Extended Data: Supported 00:27:29.226 Telemetry Log Pages: Not Supported 00:27:29.226 Persistent Event Log Pages: Not Supported 00:27:29.226 Supported Log Pages Log Page: May Support 00:27:29.226 Commands Supported & Effects Log Page: Not Supported 00:27:29.226 Feature Identifiers & Effects Log Page:May Support 00:27:29.226 NVMe-MI Commands & Effects Log Page: May Support 00:27:29.226 Data Area 4 for Telemetry Log: Not Supported 00:27:29.226 Error Log Page Entries Supported: 128 00:27:29.226 Keep Alive: Not Supported 00:27:29.226 00:27:29.226 NVM Command Set Attributes 00:27:29.226 ========================== 00:27:29.226 Submission Queue Entry Size 00:27:29.226 Max: 1 00:27:29.226 Min: 1 00:27:29.226 Completion Queue Entry Size 00:27:29.226 Max: 1 00:27:29.226 Min: 1 00:27:29.226 Number of Namespaces: 0 00:27:29.226 Compare Command: Not Supported 00:27:29.226 Write Uncorrectable Command: Not Supported 00:27:29.226 Dataset Management Command: Not Supported 00:27:29.226 Write Zeroes Command: Not Supported 00:27:29.226 Set Features Save Field: Not Supported 00:27:29.226 Reservations: Not Supported 00:27:29.226 Timestamp: Not Supported 00:27:29.226 Copy: Not Supported 00:27:29.226 Volatile Write Cache: Not Present 00:27:29.226 Atomic Write Unit (Normal): 1 00:27:29.226 Atomic Write Unit (PFail): 1 00:27:29.226 Atomic Compare & Write Unit: 1 00:27:29.226 Fused Compare & Write: Supported 00:27:29.226 Scatter-Gather List 00:27:29.226 SGL Command Set: Supported 00:27:29.226 SGL Keyed: Supported 00:27:29.226 SGL Bit Bucket Descriptor: Not Supported 00:27:29.226 SGL Metadata Pointer: Not Supported 00:27:29.226 Oversized SGL: Not Supported 00:27:29.226 SGL Metadata Address: Not Supported 00:27:29.226 SGL Offset: Supported 00:27:29.226 Transport SGL Data Block: Not Supported 00:27:29.226 Replay Protected Memory Block: Not Supported 00:27:29.226 00:27:29.226 Firmware Slot Information 00:27:29.226 ========================= 00:27:29.226 Active slot: 0 00:27:29.226 00:27:29.226 00:27:29.226 Error Log 00:27:29.226 ========= 00:27:29.226 00:27:29.226 Active Namespaces 00:27:29.226 ================= 00:27:29.226 Discovery Log Page 00:27:29.226 ================== 00:27:29.226 Generation Counter: 2 00:27:29.226 Number of Records: 2 00:27:29.226 Record Format: 0 00:27:29.226 00:27:29.226 Discovery Log Entry 0 00:27:29.226 ---------------------- 00:27:29.226 Transport Type: 3 (TCP) 00:27:29.226 Address Family: 1 (IPv4) 00:27:29.226 Subsystem Type: 3 (Current Discovery Subsystem) 00:27:29.226 Entry Flags: 00:27:29.226 Duplicate Returned Information: 1 00:27:29.226 Explicit Persistent Connection Support for Discovery: 1 00:27:29.226 Transport Requirements: 00:27:29.226 Secure Channel: Not Required 00:27:29.226 Port ID: 0 (0x0000) 00:27:29.226 Controller ID: 65535 (0xffff) 00:27:29.226 Admin Max SQ Size: 128 00:27:29.226 Transport Service Identifier: 4420 00:27:29.226 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:27:29.226 Transport Address: 10.0.0.2 00:27:29.226 Discovery Log Entry 1 00:27:29.226 ---------------------- 00:27:29.226 Transport Type: 3 (TCP) 00:27:29.226 Address Family: 1 (IPv4) 00:27:29.226 Subsystem Type: 2 (NVM Subsystem) 00:27:29.226 Entry Flags: 00:27:29.226 Duplicate Returned Information: 0 00:27:29.226 Explicit Persistent Connection Support for Discovery: 0 00:27:29.226 Transport Requirements: 00:27:29.226 Secure Channel: Not Required 00:27:29.226 Port ID: 0 (0x0000) 00:27:29.226 Controller ID: 65535 (0xffff) 00:27:29.226 Admin Max SQ Size: 128 00:27:29.226 Transport Service Identifier: 4420 00:27:29.226 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:cnode1 00:27:29.226 Transport Address: 10.0.0.2 [2024-11-26 19:13:46.090203] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Prepare to destruct SSD 00:27:29.226 [2024-11-26 19:13:46.090215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:29.226 [2024-11-26 19:13:46.090221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:29.226 [2024-11-26 19:13:46.090227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:29.226 [2024-11-26 19:13:46.090232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:29.226 [2024-11-26 19:13:46.090240] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:27:29.226 [2024-11-26 19:13:46.090244] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:27:29.226 [2024-11-26 19:13:46.090247] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x17569f0) 00:27:29.226 [2024-11-26 19:13:46.090254] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.226 [2024-11-26 19:13:46.090267] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17b22e0, cid 3, qid 0 00:27:29.226 [2024-11-26 19:13:46.090345] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:27:29.226 [2024-11-26 19:13:46.090351] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:27:29.226 [2024-11-26 19:13:46.090354] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:27:29.226 [2024-11-26 19:13:46.090358] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17b22e0) on tqpair=0x17569f0 00:27:29.226 [2024-11-26 19:13:46.090364] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:27:29.226 [2024-11-26 19:13:46.090367] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:27:29.226 [2024-11-26 19:13:46.090370] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x17569f0) 00:27:29.226 [2024-11-26 19:13:46.090376] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.226 [2024-11-26 19:13:46.090389] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17b22e0, cid 3, qid 0 00:27:29.226 [2024-11-26 19:13:46.090475] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:27:29.226 [2024-11-26 19:13:46.090480] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:27:29.226 [2024-11-26 19:13:46.090483] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:27:29.226 [2024-11-26 19:13:46.090486] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17b22e0) on tqpair=0x17569f0 00:27:29.226 [2024-11-26 19:13:46.090492] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] RTD3E = 0 us 00:27:29.226 [2024-11-26 19:13:46.090496] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown timeout = 10000 ms 00:27:29.226 [2024-11-26 19:13:46.090504] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:27:29.226 [2024-11-26 19:13:46.090507] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:27:29.226 [2024-11-26 19:13:46.090510] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x17569f0) 00:27:29.226 [2024-11-26 19:13:46.090516] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.226 [2024-11-26 19:13:46.090525] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17b22e0, cid 3, qid 0 00:27:29.226 [2024-11-26 19:13:46.090592] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:27:29.226 [2024-11-26 19:13:46.090598] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:27:29.226 [2024-11-26 19:13:46.090601] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:27:29.226 [2024-11-26 19:13:46.090604] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17b22e0) on tqpair=0x17569f0 00:27:29.226 [2024-11-26 19:13:46.090613] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:27:29.226 [2024-11-26 19:13:46.090617] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:27:29.226 [2024-11-26 19:13:46.090620] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x17569f0) 00:27:29.226 [2024-11-26 19:13:46.090626] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.226 [2024-11-26 19:13:46.090635] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17b22e0, cid 3, qid 0 00:27:29.227 [2024-11-26 19:13:46.090718] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:27:29.227 [2024-11-26 19:13:46.090723] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:27:29.227 [2024-11-26 19:13:46.090728] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:27:29.227 [2024-11-26 19:13:46.090731] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17b22e0) on tqpair=0x17569f0 00:27:29.227 [2024-11-26 19:13:46.090741] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:27:29.227 [2024-11-26 19:13:46.090745] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:27:29.227 [2024-11-26 19:13:46.090748] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x17569f0) 00:27:29.227 [2024-11-26 19:13:46.090753] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.227 [2024-11-26 19:13:46.090763] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17b22e0, cid 3, qid 0 00:27:29.227 [2024-11-26 19:13:46.090831] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:27:29.227 [2024-11-26 19:13:46.090836] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:27:29.227 [2024-11-26 19:13:46.090839] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:27:29.227 [2024-11-26 19:13:46.090842] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17b22e0) on tqpair=0x17569f0 00:27:29.227 [2024-11-26 19:13:46.090851] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:27:29.227 [2024-11-26 19:13:46.090855] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:27:29.227 [2024-11-26 19:13:46.090858] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x17569f0) 00:27:29.227 [2024-11-26 19:13:46.090863] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.227 [2024-11-26 19:13:46.090873] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17b22e0, cid 3, qid 0 00:27:29.227 [2024-11-26 19:13:46.090945] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:27:29.227 [2024-11-26 19:13:46.090957] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:27:29.227 [2024-11-26 19:13:46.090960] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:27:29.227 [2024-11-26 19:13:46.090964] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17b22e0) on tqpair=0x17569f0 00:27:29.227 [2024-11-26 19:13:46.090972] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:27:29.227 [2024-11-26 19:13:46.090976] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:27:29.227 [2024-11-26 19:13:46.090979] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x17569f0) 00:27:29.227 [2024-11-26 19:13:46.090984] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.227 [2024-11-26 19:13:46.090994] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17b22e0, cid 3, qid 0 00:27:29.227 [2024-11-26 19:13:46.091062] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:27:29.227 [2024-11-26 19:13:46.091067] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:27:29.227 [2024-11-26 19:13:46.091070] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:27:29.227 [2024-11-26 19:13:46.091074] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17b22e0) on tqpair=0x17569f0 00:27:29.227 [2024-11-26 19:13:46.091082] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:27:29.227 [2024-11-26 19:13:46.091085] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:27:29.227 [2024-11-26 19:13:46.091088] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x17569f0) 00:27:29.227 [2024-11-26 19:13:46.091094] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.227 [2024-11-26 19:13:46.091103] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17b22e0, cid 3, qid 0 00:27:29.227 [2024-11-26 19:13:46.091171] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:27:29.227 [2024-11-26 19:13:46.091176] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:27:29.227 [2024-11-26 19:13:46.091179] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:27:29.227 [2024-11-26 19:13:46.091184] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17b22e0) on tqpair=0x17569f0 00:27:29.227 [2024-11-26 19:13:46.091193] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:27:29.227 [2024-11-26 19:13:46.091197] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:27:29.227 [2024-11-26 19:13:46.091200] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x17569f0) 00:27:29.227 [2024-11-26 19:13:46.091205] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.227 [2024-11-26 19:13:46.091214] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17b22e0, cid 3, qid 0 00:27:29.227 [2024-11-26 19:13:46.091279] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:27:29.227 [2024-11-26 19:13:46.091285] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:27:29.227 [2024-11-26 19:13:46.091288] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:27:29.227 [2024-11-26 19:13:46.091291] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17b22e0) on tqpair=0x17569f0 00:27:29.227 [2024-11-26 19:13:46.091300] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:27:29.227 [2024-11-26 19:13:46.091303] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:27:29.227 [2024-11-26 19:13:46.091306] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x17569f0) 00:27:29.227 [2024-11-26 19:13:46.091312] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.227 [2024-11-26 19:13:46.091321] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17b22e0, cid 3, qid 0 00:27:29.227 [2024-11-26 19:13:46.091394] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:27:29.227 [2024-11-26 19:13:46.091400] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:27:29.227 [2024-11-26 19:13:46.091403] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:27:29.227 [2024-11-26 19:13:46.091406] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17b22e0) on tqpair=0x17569f0 00:27:29.227 [2024-11-26 19:13:46.091415] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:27:29.227 [2024-11-26 19:13:46.091419] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:27:29.227 [2024-11-26 19:13:46.091422] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x17569f0) 00:27:29.227 [2024-11-26 19:13:46.091428] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.227 [2024-11-26 19:13:46.091437] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17b22e0, cid 3, qid 0 00:27:29.227 [2024-11-26 19:13:46.091499] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:27:29.227 [2024-11-26 19:13:46.091505] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:27:29.227 [2024-11-26 19:13:46.091508] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:27:29.227 [2024-11-26 19:13:46.091511] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17b22e0) on tqpair=0x17569f0 00:27:29.227 [2024-11-26 19:13:46.091520] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:27:29.227 [2024-11-26 19:13:46.091523] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:27:29.227 [2024-11-26 19:13:46.091526] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x17569f0) 00:27:29.227 [2024-11-26 19:13:46.091532] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.227 [2024-11-26 19:13:46.091541] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17b22e0, cid 3, qid 0 00:27:29.227 [2024-11-26 19:13:46.091608] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:27:29.227 [2024-11-26 19:13:46.091613] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:27:29.227 [2024-11-26 19:13:46.091616] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:27:29.227 [2024-11-26 19:13:46.091619] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17b22e0) on tqpair=0x17569f0 00:27:29.227 [2024-11-26 19:13:46.091630] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:27:29.227 [2024-11-26 19:13:46.091634] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:27:29.227 [2024-11-26 19:13:46.091637] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x17569f0) 00:27:29.227 [2024-11-26 19:13:46.091642] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.227 [2024-11-26 19:13:46.091652] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17b22e0, cid 3, qid 0 00:27:29.227 [2024-11-26 19:13:46.091714] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:27:29.227 [2024-11-26 19:13:46.091720] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:27:29.227 [2024-11-26 19:13:46.091723] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:27:29.227 [2024-11-26 19:13:46.091726] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17b22e0) on tqpair=0x17569f0 00:27:29.227 [2024-11-26 19:13:46.091735] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:27:29.227 [2024-11-26 19:13:46.091738] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:27:29.227 [2024-11-26 19:13:46.091741] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x17569f0) 00:27:29.227 [2024-11-26 19:13:46.091747] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.228 [2024-11-26 19:13:46.091756] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17b22e0, cid 3, qid 0 00:27:29.228 [2024-11-26 19:13:46.094957] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:27:29.228 [2024-11-26 19:13:46.094966] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:27:29.228 [2024-11-26 19:13:46.094969] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:27:29.228 [2024-11-26 19:13:46.094972] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17b22e0) on tqpair=0x17569f0 00:27:29.228 [2024-11-26 19:13:46.094984] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:27:29.228 [2024-11-26 19:13:46.094987] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:27:29.228 [2024-11-26 19:13:46.094991] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x17569f0) 00:27:29.228 [2024-11-26 19:13:46.094996] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.228 [2024-11-26 19:13:46.095007] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x17b22e0, cid 3, qid 0 00:27:29.228 [2024-11-26 19:13:46.095167] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:27:29.228 [2024-11-26 19:13:46.095173] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:27:29.228 [2024-11-26 19:13:46.095176] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:27:29.228 [2024-11-26 19:13:46.095179] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x17b22e0) on tqpair=0x17569f0 00:27:29.228 [2024-11-26 19:13:46.095186] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown complete in 4 milliseconds 00:27:29.228 00:27:29.228 19:13:46 -- host/identify.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -L all 00:27:29.228 [2024-11-26 19:13:46.129118] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:27:29.228 [2024-11-26 19:13:46.129164] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3232755 ] 00:27:29.228 EAL: No free 2048 kB hugepages reported on node 1 00:27:29.490 [2024-11-26 19:13:46.158040] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to connect adminq (no timeout) 00:27:29.490 [2024-11-26 19:13:46.158077] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:27:29.490 [2024-11-26 19:13:46.158082] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:27:29.490 [2024-11-26 19:13:46.158093] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:27:29.490 [2024-11-26 19:13:46.158098] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:27:29.490 [2024-11-26 19:13:46.158408] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for connect adminq (no timeout) 00:27:29.490 [2024-11-26 19:13:46.158432] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x6439f0 0 00:27:29.490 [2024-11-26 19:13:46.164955] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:27:29.490 [2024-11-26 19:13:46.164965] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:27:29.490 [2024-11-26 19:13:46.164969] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:27:29.490 [2024-11-26 19:13:46.164972] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:27:29.490 [2024-11-26 19:13:46.165000] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:27:29.490 [2024-11-26 19:13:46.165005] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:27:29.490 [2024-11-26 19:13:46.165009] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x6439f0) 00:27:29.490 [2024-11-26 19:13:46.165019] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:27:29.490 [2024-11-26 19:13:46.165034] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69eec0, cid 0, qid 0 00:27:29.490 [2024-11-26 19:13:46.172960] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:27:29.490 [2024-11-26 19:13:46.172968] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:27:29.490 [2024-11-26 19:13:46.172971] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:27:29.490 [2024-11-26 19:13:46.172975] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69eec0) on tqpair=0x6439f0 00:27:29.490 [2024-11-26 19:13:46.172985] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:27:29.490 [2024-11-26 19:13:46.172991] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs (no timeout) 00:27:29.490 [2024-11-26 19:13:46.172995] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs wait for vs (no timeout) 00:27:29.490 [2024-11-26 19:13:46.173005] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:27:29.490 [2024-11-26 19:13:46.173008] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:27:29.490 [2024-11-26 19:13:46.173012] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x6439f0) 00:27:29.490 [2024-11-26 19:13:46.173019] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.490 [2024-11-26 19:13:46.173032] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69eec0, cid 0, qid 0 00:27:29.490 [2024-11-26 19:13:46.173195] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:27:29.490 [2024-11-26 19:13:46.173201] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:27:29.490 [2024-11-26 19:13:46.173204] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:27:29.490 [2024-11-26 19:13:46.173208] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69eec0) on tqpair=0x6439f0 00:27:29.490 [2024-11-26 19:13:46.173212] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap (no timeout) 00:27:29.490 [2024-11-26 19:13:46.173218] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap wait for cap (no timeout) 00:27:29.490 [2024-11-26 19:13:46.173224] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:27:29.490 [2024-11-26 19:13:46.173230] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:27:29.490 [2024-11-26 19:13:46.173234] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x6439f0) 00:27:29.490 [2024-11-26 19:13:46.173239] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.490 [2024-11-26 19:13:46.173250] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69eec0, cid 0, qid 0 00:27:29.490 [2024-11-26 19:13:46.173321] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:27:29.490 [2024-11-26 19:13:46.173327] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:27:29.490 [2024-11-26 19:13:46.173330] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:27:29.490 [2024-11-26 19:13:46.173333] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69eec0) on tqpair=0x6439f0 00:27:29.490 [2024-11-26 19:13:46.173337] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en (no timeout) 00:27:29.490 [2024-11-26 19:13:46.173344] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en wait for cc (timeout 15000 ms) 00:27:29.490 [2024-11-26 19:13:46.173349] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:27:29.490 [2024-11-26 19:13:46.173353] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:27:29.490 [2024-11-26 19:13:46.173356] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x6439f0) 00:27:29.490 [2024-11-26 19:13:46.173362] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.490 [2024-11-26 19:13:46.173371] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69eec0, cid 0, qid 0 00:27:29.490 [2024-11-26 19:13:46.173440] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:27:29.490 [2024-11-26 19:13:46.173445] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:27:29.490 [2024-11-26 19:13:46.173448] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:27:29.490 [2024-11-26 19:13:46.173452] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69eec0) on tqpair=0x6439f0 00:27:29.490 [2024-11-26 19:13:46.173456] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:27:29.490 [2024-11-26 19:13:46.173464] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:27:29.490 [2024-11-26 19:13:46.173467] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:27:29.490 [2024-11-26 19:13:46.173470] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x6439f0) 00:27:29.490 [2024-11-26 19:13:46.173476] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.490 [2024-11-26 19:13:46.173485] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69eec0, cid 0, qid 0 00:27:29.490 [2024-11-26 19:13:46.173550] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:27:29.490 [2024-11-26 19:13:46.173555] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:27:29.490 [2024-11-26 19:13:46.173558] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:27:29.490 [2024-11-26 19:13:46.173562] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69eec0) on tqpair=0x6439f0 00:27:29.490 [2024-11-26 19:13:46.173565] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 0 && CSTS.RDY = 0 00:27:29.490 [2024-11-26 19:13:46.173569] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to controller is disabled (timeout 15000 ms) 00:27:29.490 [2024-11-26 19:13:46.173576] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:27:29.490 [2024-11-26 19:13:46.173681] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Setting CC.EN = 1 00:27:29.490 [2024-11-26 19:13:46.173684] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:27:29.490 [2024-11-26 19:13:46.173692] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:27:29.490 [2024-11-26 19:13:46.173696] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:27:29.490 [2024-11-26 19:13:46.173699] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x6439f0) 00:27:29.490 [2024-11-26 19:13:46.173704] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.490 [2024-11-26 19:13:46.173714] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69eec0, cid 0, qid 0 00:27:29.490 [2024-11-26 19:13:46.173776] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:27:29.490 [2024-11-26 19:13:46.173782] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:27:29.490 [2024-11-26 19:13:46.173785] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:27:29.490 [2024-11-26 19:13:46.173788] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69eec0) on tqpair=0x6439f0 00:27:29.490 [2024-11-26 19:13:46.173792] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:27:29.490 [2024-11-26 19:13:46.173800] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:27:29.490 [2024-11-26 19:13:46.173804] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:27:29.490 [2024-11-26 19:13:46.173807] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x6439f0) 00:27:29.490 [2024-11-26 19:13:46.173813] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.490 [2024-11-26 19:13:46.173822] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69eec0, cid 0, qid 0 00:27:29.490 [2024-11-26 19:13:46.173887] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:27:29.490 [2024-11-26 19:13:46.173892] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:27:29.490 [2024-11-26 19:13:46.173895] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:27:29.490 [2024-11-26 19:13:46.173898] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69eec0) on tqpair=0x6439f0 00:27:29.490 [2024-11-26 19:13:46.173902] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:27:29.490 [2024-11-26 19:13:46.173906] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to reset admin queue (timeout 30000 ms) 00:27:29.490 [2024-11-26 19:13:46.173913] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller (no timeout) 00:27:29.490 [2024-11-26 19:13:46.173920] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify controller (timeout 30000 ms) 00:27:29.491 [2024-11-26 19:13:46.173927] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:27:29.491 [2024-11-26 19:13:46.173930] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:27:29.491 [2024-11-26 19:13:46.173933] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x6439f0) 00:27:29.491 [2024-11-26 19:13:46.173939] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.491 [2024-11-26 19:13:46.173954] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69eec0, cid 0, qid 0 00:27:29.491 [2024-11-26 19:13:46.174061] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:27:29.491 [2024-11-26 19:13:46.174067] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:27:29.491 [2024-11-26 19:13:46.174070] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:27:29.491 [2024-11-26 19:13:46.174073] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x6439f0): datao=0, datal=4096, cccid=0 00:27:29.491 [2024-11-26 19:13:46.174077] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x69eec0) on tqpair(0x6439f0): expected_datao=0, payload_size=4096 00:27:29.491 [2024-11-26 19:13:46.174085] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:27:29.491 [2024-11-26 19:13:46.174089] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:27:29.491 [2024-11-26 19:13:46.174103] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:27:29.491 [2024-11-26 19:13:46.174109] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:27:29.491 [2024-11-26 19:13:46.174112] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:27:29.491 [2024-11-26 19:13:46.174115] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69eec0) on tqpair=0x6439f0 00:27:29.491 [2024-11-26 19:13:46.174122] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_xfer_size 4294967295 00:27:29.491 [2024-11-26 19:13:46.174126] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] MDTS max_xfer_size 131072 00:27:29.491 [2024-11-26 19:13:46.174130] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CNTLID 0x0001 00:27:29.491 [2024-11-26 19:13:46.174133] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_sges 16 00:27:29.491 [2024-11-26 19:13:46.174137] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] fuses compare and write: 1 00:27:29.491 [2024-11-26 19:13:46.174141] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to configure AER (timeout 30000 ms) 00:27:29.491 [2024-11-26 19:13:46.174150] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for configure aer (timeout 30000 ms) 00:27:29.491 [2024-11-26 19:13:46.174156] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:27:29.491 [2024-11-26 19:13:46.174159] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:27:29.491 [2024-11-26 19:13:46.174163] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x6439f0) 00:27:29.491 [2024-11-26 19:13:46.174169] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:27:29.491 [2024-11-26 19:13:46.174179] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69eec0, cid 0, qid 0 00:27:29.491 [2024-11-26 19:13:46.174250] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:27:29.491 [2024-11-26 19:13:46.174255] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:27:29.491 [2024-11-26 19:13:46.174258] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:27:29.491 [2024-11-26 19:13:46.174261] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69eec0) on tqpair=0x6439f0 00:27:29.491 [2024-11-26 19:13:46.174267] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:27:29.491 [2024-11-26 19:13:46.174270] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:27:29.491 [2024-11-26 19:13:46.174273] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x6439f0) 00:27:29.491 [2024-11-26 19:13:46.174279] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:27:29.491 [2024-11-26 19:13:46.174284] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:27:29.491 [2024-11-26 19:13:46.174287] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:27:29.491 [2024-11-26 19:13:46.174290] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x6439f0) 00:27:29.491 [2024-11-26 19:13:46.174295] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:27:29.491 [2024-11-26 19:13:46.174300] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:27:29.491 [2024-11-26 19:13:46.174304] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:27:29.491 [2024-11-26 19:13:46.174307] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x6439f0) 00:27:29.491 [2024-11-26 19:13:46.174312] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:27:29.491 [2024-11-26 19:13:46.174319] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:27:29.491 [2024-11-26 19:13:46.174322] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:27:29.491 [2024-11-26 19:13:46.174325] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x6439f0) 00:27:29.491 [2024-11-26 19:13:46.174330] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:27:29.491 [2024-11-26 19:13:46.174334] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set keep alive timeout (timeout 30000 ms) 00:27:29.491 [2024-11-26 19:13:46.174344] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:27:29.491 [2024-11-26 19:13:46.174350] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:27:29.491 [2024-11-26 19:13:46.174353] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:27:29.491 [2024-11-26 19:13:46.174356] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x6439f0) 00:27:29.491 [2024-11-26 19:13:46.174361] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.491 [2024-11-26 19:13:46.174373] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69eec0, cid 0, qid 0 00:27:29.491 [2024-11-26 19:13:46.174377] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69f020, cid 1, qid 0 00:27:29.491 [2024-11-26 19:13:46.174381] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69f180, cid 2, qid 0 00:27:29.491 [2024-11-26 19:13:46.174385] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69f2e0, cid 3, qid 0 00:27:29.491 [2024-11-26 19:13:46.174389] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69f440, cid 4, qid 0 00:27:29.491 [2024-11-26 19:13:46.174494] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:27:29.491 [2024-11-26 19:13:46.174500] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:27:29.491 [2024-11-26 19:13:46.174503] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:27:29.491 [2024-11-26 19:13:46.174506] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69f440) on tqpair=0x6439f0 00:27:29.491 [2024-11-26 19:13:46.174510] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Sending keep alive every 5000000 us 00:27:29.491 [2024-11-26 19:13:46.174514] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller iocs specific (timeout 30000 ms) 00:27:29.491 [2024-11-26 19:13:46.174521] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set number of queues (timeout 30000 ms) 00:27:29.491 [2024-11-26 19:13:46.174528] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set number of queues (timeout 30000 ms) 00:27:29.491 [2024-11-26 19:13:46.174534] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:27:29.491 [2024-11-26 19:13:46.174537] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:27:29.491 [2024-11-26 19:13:46.174540] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x6439f0) 00:27:29.491 [2024-11-26 19:13:46.174546] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:4 cdw10:00000007 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:27:29.491 [2024-11-26 19:13:46.174555] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69f440, cid 4, qid 0 00:27:29.491 [2024-11-26 19:13:46.174621] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:27:29.491 [2024-11-26 19:13:46.174627] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:27:29.491 [2024-11-26 19:13:46.174630] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:27:29.491 [2024-11-26 19:13:46.174633] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69f440) on tqpair=0x6439f0 00:27:29.491 [2024-11-26 19:13:46.174683] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify active ns (timeout 30000 ms) 00:27:29.491 [2024-11-26 19:13:46.174693] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify active ns (timeout 30000 ms) 00:27:29.491 [2024-11-26 19:13:46.174699] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:27:29.491 [2024-11-26 19:13:46.174703] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:27:29.491 [2024-11-26 19:13:46.174706] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x6439f0) 00:27:29.491 [2024-11-26 19:13:46.174711] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.491 [2024-11-26 19:13:46.174721] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69f440, cid 4, qid 0 00:27:29.491 [2024-11-26 19:13:46.174792] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:27:29.491 [2024-11-26 19:13:46.174797] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:27:29.491 [2024-11-26 19:13:46.174800] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:27:29.491 [2024-11-26 19:13:46.174804] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x6439f0): datao=0, datal=4096, cccid=4 00:27:29.491 [2024-11-26 19:13:46.174808] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x69f440) on tqpair(0x6439f0): expected_datao=0, payload_size=4096 00:27:29.491 [2024-11-26 19:13:46.174819] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:27:29.491 [2024-11-26 19:13:46.174823] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:27:29.491 [2024-11-26 19:13:46.174861] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:27:29.491 [2024-11-26 19:13:46.174866] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:27:29.491 [2024-11-26 19:13:46.174869] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:27:29.491 [2024-11-26 19:13:46.174872] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69f440) on tqpair=0x6439f0 00:27:29.491 [2024-11-26 19:13:46.174881] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Namespace 1 was added 00:27:29.491 [2024-11-26 19:13:46.174888] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns (timeout 30000 ms) 00:27:29.491 [2024-11-26 19:13:46.174896] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify ns (timeout 30000 ms) 00:27:29.491 [2024-11-26 19:13:46.174901] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:27:29.491 [2024-11-26 19:13:46.174904] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:27:29.491 [2024-11-26 19:13:46.174908] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x6439f0) 00:27:29.492 [2024-11-26 19:13:46.174913] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000000 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.492 [2024-11-26 19:13:46.174923] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69f440, cid 4, qid 0 00:27:29.492 [2024-11-26 19:13:46.175004] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:27:29.492 [2024-11-26 19:13:46.175010] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:27:29.492 [2024-11-26 19:13:46.175013] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:27:29.492 [2024-11-26 19:13:46.175016] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x6439f0): datao=0, datal=4096, cccid=4 00:27:29.492 [2024-11-26 19:13:46.175020] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x69f440) on tqpair(0x6439f0): expected_datao=0, payload_size=4096 00:27:29.492 [2024-11-26 19:13:46.175031] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:27:29.492 [2024-11-26 19:13:46.175034] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:27:29.492 [2024-11-26 19:13:46.175064] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:27:29.492 [2024-11-26 19:13:46.175070] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:27:29.492 [2024-11-26 19:13:46.175072] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:27:29.492 [2024-11-26 19:13:46.175077] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69f440) on tqpair=0x6439f0 00:27:29.492 [2024-11-26 19:13:46.175090] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:27:29.492 [2024-11-26 19:13:46.175098] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:27:29.492 [2024-11-26 19:13:46.175104] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:27:29.492 [2024-11-26 19:13:46.175107] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:27:29.492 [2024-11-26 19:13:46.175110] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x6439f0) 00:27:29.492 [2024-11-26 19:13:46.175116] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.492 [2024-11-26 19:13:46.175127] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69f440, cid 4, qid 0 00:27:29.492 [2024-11-26 19:13:46.175198] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:27:29.492 [2024-11-26 19:13:46.175203] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:27:29.492 [2024-11-26 19:13:46.175206] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:27:29.492 [2024-11-26 19:13:46.175209] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x6439f0): datao=0, datal=4096, cccid=4 00:27:29.492 [2024-11-26 19:13:46.175213] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x69f440) on tqpair(0x6439f0): expected_datao=0, payload_size=4096 00:27:29.492 [2024-11-26 19:13:46.175224] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:27:29.492 [2024-11-26 19:13:46.175227] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:27:29.492 [2024-11-26 19:13:46.175252] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:27:29.492 [2024-11-26 19:13:46.175258] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:27:29.492 [2024-11-26 19:13:46.175261] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:27:29.492 [2024-11-26 19:13:46.175264] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69f440) on tqpair=0x6439f0 00:27:29.492 [2024-11-26 19:13:46.175270] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns iocs specific (timeout 30000 ms) 00:27:29.492 [2024-11-26 19:13:46.175276] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported log pages (timeout 30000 ms) 00:27:29.492 [2024-11-26 19:13:46.175283] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported features (timeout 30000 ms) 00:27:29.492 [2024-11-26 19:13:46.175289] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set doorbell buffer config (timeout 30000 ms) 00:27:29.492 [2024-11-26 19:13:46.175293] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set host ID (timeout 30000 ms) 00:27:29.492 [2024-11-26 19:13:46.175297] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] NVMe-oF transport - not sending Set Features - Host ID 00:27:29.492 [2024-11-26 19:13:46.175301] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to transport ready (timeout 30000 ms) 00:27:29.492 [2024-11-26 19:13:46.175306] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to ready (no timeout) 00:27:29.492 [2024-11-26 19:13:46.175317] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:27:29.492 [2024-11-26 19:13:46.175321] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:27:29.492 [2024-11-26 19:13:46.175324] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x6439f0) 00:27:29.492 [2024-11-26 19:13:46.175329] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:4 cdw10:00000001 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.492 [2024-11-26 19:13:46.175337] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:27:29.492 [2024-11-26 19:13:46.175340] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:27:29.492 [2024-11-26 19:13:46.175343] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x6439f0) 00:27:29.492 [2024-11-26 19:13:46.175348] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:27:29.492 [2024-11-26 19:13:46.175360] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69f440, cid 4, qid 0 00:27:29.492 [2024-11-26 19:13:46.175365] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69f5a0, cid 5, qid 0 00:27:29.492 [2024-11-26 19:13:46.175442] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:27:29.492 [2024-11-26 19:13:46.175447] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:27:29.492 [2024-11-26 19:13:46.175450] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:27:29.492 [2024-11-26 19:13:46.175453] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69f440) on tqpair=0x6439f0 00:27:29.492 [2024-11-26 19:13:46.175458] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:27:29.492 [2024-11-26 19:13:46.175463] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:27:29.492 [2024-11-26 19:13:46.175466] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:27:29.492 [2024-11-26 19:13:46.175470] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69f5a0) on tqpair=0x6439f0 00:27:29.492 [2024-11-26 19:13:46.175477] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:27:29.492 [2024-11-26 19:13:46.175481] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:27:29.492 [2024-11-26 19:13:46.175484] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x6439f0) 00:27:29.492 [2024-11-26 19:13:46.175489] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:5 cdw10:00000002 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.492 [2024-11-26 19:13:46.175499] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69f5a0, cid 5, qid 0 00:27:29.492 [2024-11-26 19:13:46.175567] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:27:29.492 [2024-11-26 19:13:46.175572] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:27:29.492 [2024-11-26 19:13:46.175575] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:27:29.492 [2024-11-26 19:13:46.175579] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69f5a0) on tqpair=0x6439f0 00:27:29.492 [2024-11-26 19:13:46.175586] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:27:29.492 [2024-11-26 19:13:46.175590] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:27:29.492 [2024-11-26 19:13:46.175593] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x6439f0) 00:27:29.492 [2024-11-26 19:13:46.175598] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:5 cdw10:00000004 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.492 [2024-11-26 19:13:46.175607] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69f5a0, cid 5, qid 0 00:27:29.492 [2024-11-26 19:13:46.175676] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:27:29.492 [2024-11-26 19:13:46.175682] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:27:29.492 [2024-11-26 19:13:46.175685] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:27:29.492 [2024-11-26 19:13:46.175688] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69f5a0) on tqpair=0x6439f0 00:27:29.492 [2024-11-26 19:13:46.175696] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:27:29.492 [2024-11-26 19:13:46.175699] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:27:29.492 [2024-11-26 19:13:46.175702] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x6439f0) 00:27:29.492 [2024-11-26 19:13:46.175707] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:5 cdw10:00000007 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.492 [2024-11-26 19:13:46.175718] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69f5a0, cid 5, qid 0 00:27:29.492 [2024-11-26 19:13:46.178956] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:27:29.492 [2024-11-26 19:13:46.178964] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:27:29.492 [2024-11-26 19:13:46.178967] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:27:29.492 [2024-11-26 19:13:46.178971] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69f5a0) on tqpair=0x6439f0 00:27:29.492 [2024-11-26 19:13:46.178985] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:27:29.492 [2024-11-26 19:13:46.178988] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:27:29.492 [2024-11-26 19:13:46.178991] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x6439f0) 00:27:29.492 [2024-11-26 19:13:46.178998] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.492 [2024-11-26 19:13:46.179003] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:27:29.492 [2024-11-26 19:13:46.179007] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:27:29.492 [2024-11-26 19:13:46.179010] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x6439f0) 00:27:29.492 [2024-11-26 19:13:46.179015] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:ffffffff cdw10:007f0002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.492 [2024-11-26 19:13:46.179021] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:27:29.492 [2024-11-26 19:13:46.179024] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:27:29.492 [2024-11-26 19:13:46.179027] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=6 on tqpair(0x6439f0) 00:27:29.492 [2024-11-26 19:13:46.179033] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:ffffffff cdw10:007f0003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.492 [2024-11-26 19:13:46.179038] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:27:29.492 [2024-11-26 19:13:46.179042] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:27:29.492 [2024-11-26 19:13:46.179045] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x6439f0) 00:27:29.492 [2024-11-26 19:13:46.179050] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:7 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.492 [2024-11-26 19:13:46.179062] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69f5a0, cid 5, qid 0 00:27:29.493 [2024-11-26 19:13:46.179067] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69f440, cid 4, qid 0 00:27:29.493 [2024-11-26 19:13:46.179071] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69f700, cid 6, qid 0 00:27:29.493 [2024-11-26 19:13:46.179075] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69f860, cid 7, qid 0 00:27:29.493 [2024-11-26 19:13:46.179297] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:27:29.493 [2024-11-26 19:13:46.179303] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:27:29.493 [2024-11-26 19:13:46.179306] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:27:29.493 [2024-11-26 19:13:46.179310] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x6439f0): datao=0, datal=8192, cccid=5 00:27:29.493 [2024-11-26 19:13:46.179313] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x69f5a0) on tqpair(0x6439f0): expected_datao=0, payload_size=8192 00:27:29.493 [2024-11-26 19:13:46.179328] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:27:29.493 [2024-11-26 19:13:46.179332] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:27:29.493 [2024-11-26 19:13:46.179337] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:27:29.493 [2024-11-26 19:13:46.179342] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:27:29.493 [2024-11-26 19:13:46.179344] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:27:29.493 [2024-11-26 19:13:46.179350] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x6439f0): datao=0, datal=512, cccid=4 00:27:29.493 [2024-11-26 19:13:46.179354] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x69f440) on tqpair(0x6439f0): expected_datao=0, payload_size=512 00:27:29.493 [2024-11-26 19:13:46.179360] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:27:29.493 [2024-11-26 19:13:46.179363] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:27:29.493 [2024-11-26 19:13:46.179367] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:27:29.493 [2024-11-26 19:13:46.179372] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:27:29.493 [2024-11-26 19:13:46.179375] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:27:29.493 [2024-11-26 19:13:46.179378] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x6439f0): datao=0, datal=512, cccid=6 00:27:29.493 [2024-11-26 19:13:46.179382] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x69f700) on tqpair(0x6439f0): expected_datao=0, payload_size=512 00:27:29.493 [2024-11-26 19:13:46.179388] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:27:29.493 [2024-11-26 19:13:46.179391] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:27:29.493 [2024-11-26 19:13:46.179396] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:27:29.493 [2024-11-26 19:13:46.179400] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:27:29.493 [2024-11-26 19:13:46.179403] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:27:29.493 [2024-11-26 19:13:46.179406] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x6439f0): datao=0, datal=4096, cccid=7 00:27:29.493 [2024-11-26 19:13:46.179410] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x69f860) on tqpair(0x6439f0): expected_datao=0, payload_size=4096 00:27:29.493 [2024-11-26 19:13:46.179416] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:27:29.493 [2024-11-26 19:13:46.179419] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:27:29.493 [2024-11-26 19:13:46.179427] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:27:29.493 [2024-11-26 19:13:46.179431] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:27:29.493 [2024-11-26 19:13:46.179434] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:27:29.493 [2024-11-26 19:13:46.179437] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69f5a0) on tqpair=0x6439f0 00:27:29.493 [2024-11-26 19:13:46.179449] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:27:29.493 [2024-11-26 19:13:46.179454] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:27:29.493 [2024-11-26 19:13:46.179457] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:27:29.493 [2024-11-26 19:13:46.179460] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69f440) on tqpair=0x6439f0 00:27:29.493 [2024-11-26 19:13:46.179467] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:27:29.493 [2024-11-26 19:13:46.179472] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:27:29.493 [2024-11-26 19:13:46.179476] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:27:29.493 [2024-11-26 19:13:46.179479] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69f700) on tqpair=0x6439f0 00:27:29.493 [2024-11-26 19:13:46.179484] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:27:29.493 [2024-11-26 19:13:46.179489] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:27:29.493 [2024-11-26 19:13:46.179492] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:27:29.493 [2024-11-26 19:13:46.179496] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69f860) on tqpair=0x6439f0 00:27:29.493 ===================================================== 00:27:29.493 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:29.493 ===================================================== 00:27:29.493 Controller Capabilities/Features 00:27:29.493 ================================ 00:27:29.493 Vendor ID: 8086 00:27:29.493 Subsystem Vendor ID: 8086 00:27:29.493 Serial Number: SPDK00000000000001 00:27:29.493 Model Number: SPDK bdev Controller 00:27:29.493 Firmware Version: 24.01.1 00:27:29.493 Recommended Arb Burst: 6 00:27:29.493 IEEE OUI Identifier: e4 d2 5c 00:27:29.493 Multi-path I/O 00:27:29.493 May have multiple subsystem ports: Yes 00:27:29.493 May have multiple controllers: Yes 00:27:29.493 Associated with SR-IOV VF: No 00:27:29.493 Max Data Transfer Size: 131072 00:27:29.493 Max Number of Namespaces: 32 00:27:29.493 Max Number of I/O Queues: 127 00:27:29.493 NVMe Specification Version (VS): 1.3 00:27:29.493 NVMe Specification Version (Identify): 1.3 00:27:29.493 Maximum Queue Entries: 128 00:27:29.493 Contiguous Queues Required: Yes 00:27:29.493 Arbitration Mechanisms Supported 00:27:29.493 Weighted Round Robin: Not Supported 00:27:29.493 Vendor Specific: Not Supported 00:27:29.493 Reset Timeout: 15000 ms 00:27:29.493 Doorbell Stride: 4 bytes 00:27:29.493 NVM Subsystem Reset: Not Supported 00:27:29.493 Command Sets Supported 00:27:29.493 NVM Command Set: Supported 00:27:29.493 Boot Partition: Not Supported 00:27:29.493 Memory Page Size Minimum: 4096 bytes 00:27:29.493 Memory Page Size Maximum: 4096 bytes 00:27:29.493 Persistent Memory Region: Not Supported 00:27:29.493 Optional Asynchronous Events Supported 00:27:29.493 Namespace Attribute Notices: Supported 00:27:29.493 Firmware Activation Notices: Not Supported 00:27:29.493 ANA Change Notices: Not Supported 00:27:29.493 PLE Aggregate Log Change Notices: Not Supported 00:27:29.493 LBA Status Info Alert Notices: Not Supported 00:27:29.493 EGE Aggregate Log Change Notices: Not Supported 00:27:29.493 Normal NVM Subsystem Shutdown event: Not Supported 00:27:29.493 Zone Descriptor Change Notices: Not Supported 00:27:29.493 Discovery Log Change Notices: Not Supported 00:27:29.493 Controller Attributes 00:27:29.493 128-bit Host Identifier: Supported 00:27:29.493 Non-Operational Permissive Mode: Not Supported 00:27:29.493 NVM Sets: Not Supported 00:27:29.493 Read Recovery Levels: Not Supported 00:27:29.493 Endurance Groups: Not Supported 00:27:29.493 Predictable Latency Mode: Not Supported 00:27:29.493 Traffic Based Keep ALive: Not Supported 00:27:29.493 Namespace Granularity: Not Supported 00:27:29.493 SQ Associations: Not Supported 00:27:29.493 UUID List: Not Supported 00:27:29.493 Multi-Domain Subsystem: Not Supported 00:27:29.493 Fixed Capacity Management: Not Supported 00:27:29.493 Variable Capacity Management: Not Supported 00:27:29.493 Delete Endurance Group: Not Supported 00:27:29.493 Delete NVM Set: Not Supported 00:27:29.493 Extended LBA Formats Supported: Not Supported 00:27:29.493 Flexible Data Placement Supported: Not Supported 00:27:29.493 00:27:29.493 Controller Memory Buffer Support 00:27:29.493 ================================ 00:27:29.493 Supported: No 00:27:29.493 00:27:29.493 Persistent Memory Region Support 00:27:29.493 ================================ 00:27:29.493 Supported: No 00:27:29.493 00:27:29.493 Admin Command Set Attributes 00:27:29.493 ============================ 00:27:29.493 Security Send/Receive: Not Supported 00:27:29.493 Format NVM: Not Supported 00:27:29.493 Firmware Activate/Download: Not Supported 00:27:29.493 Namespace Management: Not Supported 00:27:29.493 Device Self-Test: Not Supported 00:27:29.493 Directives: Not Supported 00:27:29.493 NVMe-MI: Not Supported 00:27:29.493 Virtualization Management: Not Supported 00:27:29.493 Doorbell Buffer Config: Not Supported 00:27:29.493 Get LBA Status Capability: Not Supported 00:27:29.493 Command & Feature Lockdown Capability: Not Supported 00:27:29.493 Abort Command Limit: 4 00:27:29.493 Async Event Request Limit: 4 00:27:29.493 Number of Firmware Slots: N/A 00:27:29.493 Firmware Slot 1 Read-Only: N/A 00:27:29.493 Firmware Activation Without Reset: N/A 00:27:29.493 Multiple Update Detection Support: N/A 00:27:29.493 Firmware Update Granularity: No Information Provided 00:27:29.493 Per-Namespace SMART Log: No 00:27:29.493 Asymmetric Namespace Access Log Page: Not Supported 00:27:29.493 Subsystem NQN: nqn.2016-06.io.spdk:cnode1 00:27:29.493 Command Effects Log Page: Supported 00:27:29.493 Get Log Page Extended Data: Supported 00:27:29.493 Telemetry Log Pages: Not Supported 00:27:29.493 Persistent Event Log Pages: Not Supported 00:27:29.493 Supported Log Pages Log Page: May Support 00:27:29.493 Commands Supported & Effects Log Page: Not Supported 00:27:29.493 Feature Identifiers & Effects Log Page:May Support 00:27:29.493 NVMe-MI Commands & Effects Log Page: May Support 00:27:29.493 Data Area 4 for Telemetry Log: Not Supported 00:27:29.493 Error Log Page Entries Supported: 128 00:27:29.493 Keep Alive: Supported 00:27:29.494 Keep Alive Granularity: 10000 ms 00:27:29.494 00:27:29.494 NVM Command Set Attributes 00:27:29.494 ========================== 00:27:29.494 Submission Queue Entry Size 00:27:29.494 Max: 64 00:27:29.494 Min: 64 00:27:29.494 Completion Queue Entry Size 00:27:29.494 Max: 16 00:27:29.494 Min: 16 00:27:29.494 Number of Namespaces: 32 00:27:29.494 Compare Command: Supported 00:27:29.494 Write Uncorrectable Command: Not Supported 00:27:29.494 Dataset Management Command: Supported 00:27:29.494 Write Zeroes Command: Supported 00:27:29.494 Set Features Save Field: Not Supported 00:27:29.494 Reservations: Supported 00:27:29.494 Timestamp: Not Supported 00:27:29.494 Copy: Supported 00:27:29.494 Volatile Write Cache: Present 00:27:29.494 Atomic Write Unit (Normal): 1 00:27:29.494 Atomic Write Unit (PFail): 1 00:27:29.494 Atomic Compare & Write Unit: 1 00:27:29.494 Fused Compare & Write: Supported 00:27:29.494 Scatter-Gather List 00:27:29.494 SGL Command Set: Supported 00:27:29.494 SGL Keyed: Supported 00:27:29.494 SGL Bit Bucket Descriptor: Not Supported 00:27:29.494 SGL Metadata Pointer: Not Supported 00:27:29.494 Oversized SGL: Not Supported 00:27:29.494 SGL Metadata Address: Not Supported 00:27:29.494 SGL Offset: Supported 00:27:29.494 Transport SGL Data Block: Not Supported 00:27:29.494 Replay Protected Memory Block: Not Supported 00:27:29.494 00:27:29.494 Firmware Slot Information 00:27:29.494 ========================= 00:27:29.494 Active slot: 1 00:27:29.494 Slot 1 Firmware Revision: 24.01.1 00:27:29.494 00:27:29.494 00:27:29.494 Commands Supported and Effects 00:27:29.494 ============================== 00:27:29.494 Admin Commands 00:27:29.494 -------------- 00:27:29.494 Get Log Page (02h): Supported 00:27:29.494 Identify (06h): Supported 00:27:29.494 Abort (08h): Supported 00:27:29.494 Set Features (09h): Supported 00:27:29.494 Get Features (0Ah): Supported 00:27:29.494 Asynchronous Event Request (0Ch): Supported 00:27:29.494 Keep Alive (18h): Supported 00:27:29.494 I/O Commands 00:27:29.494 ------------ 00:27:29.494 Flush (00h): Supported LBA-Change 00:27:29.494 Write (01h): Supported LBA-Change 00:27:29.494 Read (02h): Supported 00:27:29.494 Compare (05h): Supported 00:27:29.494 Write Zeroes (08h): Supported LBA-Change 00:27:29.494 Dataset Management (09h): Supported LBA-Change 00:27:29.494 Copy (19h): Supported LBA-Change 00:27:29.494 Unknown (79h): Supported LBA-Change 00:27:29.494 Unknown (7Ah): Supported 00:27:29.494 00:27:29.494 Error Log 00:27:29.494 ========= 00:27:29.494 00:27:29.494 Arbitration 00:27:29.494 =========== 00:27:29.494 Arbitration Burst: 1 00:27:29.494 00:27:29.494 Power Management 00:27:29.494 ================ 00:27:29.494 Number of Power States: 1 00:27:29.494 Current Power State: Power State #0 00:27:29.494 Power State #0: 00:27:29.494 Max Power: 0.00 W 00:27:29.494 Non-Operational State: Operational 00:27:29.494 Entry Latency: Not Reported 00:27:29.494 Exit Latency: Not Reported 00:27:29.494 Relative Read Throughput: 0 00:27:29.494 Relative Read Latency: 0 00:27:29.494 Relative Write Throughput: 0 00:27:29.494 Relative Write Latency: 0 00:27:29.494 Idle Power: Not Reported 00:27:29.494 Active Power: Not Reported 00:27:29.494 Non-Operational Permissive Mode: Not Supported 00:27:29.494 00:27:29.494 Health Information 00:27:29.494 ================== 00:27:29.494 Critical Warnings: 00:27:29.494 Available Spare Space: OK 00:27:29.494 Temperature: OK 00:27:29.494 Device Reliability: OK 00:27:29.494 Read Only: No 00:27:29.494 Volatile Memory Backup: OK 00:27:29.494 Current Temperature: 0 Kelvin (-273 Celsius) 00:27:29.494 Temperature Threshold: [2024-11-26 19:13:46.179583] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:27:29.494 [2024-11-26 19:13:46.179588] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:27:29.494 [2024-11-26 19:13:46.179592] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x6439f0) 00:27:29.494 [2024-11-26 19:13:46.179598] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:7 cdw10:00000005 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.494 [2024-11-26 19:13:46.179610] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69f860, cid 7, qid 0 00:27:29.494 [2024-11-26 19:13:46.179687] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:27:29.494 [2024-11-26 19:13:46.179693] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:27:29.494 [2024-11-26 19:13:46.179696] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:27:29.494 [2024-11-26 19:13:46.179699] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69f860) on tqpair=0x6439f0 00:27:29.494 [2024-11-26 19:13:46.179723] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Prepare to destruct SSD 00:27:29.494 [2024-11-26 19:13:46.179733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:29.494 [2024-11-26 19:13:46.179739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:29.494 [2024-11-26 19:13:46.179744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:29.494 [2024-11-26 19:13:46.179750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:29.494 [2024-11-26 19:13:46.179757] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:27:29.494 [2024-11-26 19:13:46.179760] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:27:29.494 [2024-11-26 19:13:46.179763] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x6439f0) 00:27:29.494 [2024-11-26 19:13:46.179769] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.494 [2024-11-26 19:13:46.179780] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69f2e0, cid 3, qid 0 00:27:29.494 [2024-11-26 19:13:46.179847] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:27:29.494 [2024-11-26 19:13:46.179852] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:27:29.494 [2024-11-26 19:13:46.179855] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:27:29.494 [2024-11-26 19:13:46.179859] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69f2e0) on tqpair=0x6439f0 00:27:29.494 [2024-11-26 19:13:46.179864] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:27:29.494 [2024-11-26 19:13:46.179868] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:27:29.494 [2024-11-26 19:13:46.179871] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x6439f0) 00:27:29.494 [2024-11-26 19:13:46.179876] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.494 [2024-11-26 19:13:46.179888] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69f2e0, cid 3, qid 0 00:27:29.494 [2024-11-26 19:13:46.183955] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:27:29.494 [2024-11-26 19:13:46.183963] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:27:29.494 [2024-11-26 19:13:46.183965] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:27:29.494 [2024-11-26 19:13:46.183969] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69f2e0) on tqpair=0x6439f0 00:27:29.494 [2024-11-26 19:13:46.183973] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] RTD3E = 0 us 00:27:29.494 [2024-11-26 19:13:46.183977] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown timeout = 10000 ms 00:27:29.494 [2024-11-26 19:13:46.183987] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:27:29.494 [2024-11-26 19:13:46.183990] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:27:29.494 [2024-11-26 19:13:46.183994] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x6439f0) 00:27:29.494 [2024-11-26 19:13:46.184000] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.494 [2024-11-26 19:13:46.184013] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69f2e0, cid 3, qid 0 00:27:29.494 [2024-11-26 19:13:46.184167] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:27:29.494 [2024-11-26 19:13:46.184173] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:27:29.494 [2024-11-26 19:13:46.184176] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:27:29.495 [2024-11-26 19:13:46.184179] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69f2e0) on tqpair=0x6439f0 00:27:29.495 [2024-11-26 19:13:46.184186] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown complete in 0 milliseconds 00:27:29.495 0 Kelvin (-273 Celsius) 00:27:29.495 Available Spare: 0% 00:27:29.495 Available Spare Threshold: 0% 00:27:29.495 Life Percentage Used: 0% 00:27:29.495 Data Units Read: 0 00:27:29.495 Data Units Written: 0 00:27:29.495 Host Read Commands: 0 00:27:29.495 Host Write Commands: 0 00:27:29.495 Controller Busy Time: 0 minutes 00:27:29.495 Power Cycles: 0 00:27:29.495 Power On Hours: 0 hours 00:27:29.495 Unsafe Shutdowns: 0 00:27:29.495 Unrecoverable Media Errors: 0 00:27:29.495 Lifetime Error Log Entries: 0 00:27:29.495 Warning Temperature Time: 0 minutes 00:27:29.495 Critical Temperature Time: 0 minutes 00:27:29.495 00:27:29.495 Number of Queues 00:27:29.495 ================ 00:27:29.495 Number of I/O Submission Queues: 127 00:27:29.495 Number of I/O Completion Queues: 127 00:27:29.495 00:27:29.495 Active Namespaces 00:27:29.495 ================= 00:27:29.495 Namespace ID:1 00:27:29.495 Error Recovery Timeout: Unlimited 00:27:29.495 Command Set Identifier: NVM (00h) 00:27:29.495 Deallocate: Supported 00:27:29.495 Deallocated/Unwritten Error: Not Supported 00:27:29.495 Deallocated Read Value: Unknown 00:27:29.495 Deallocate in Write Zeroes: Not Supported 00:27:29.495 Deallocated Guard Field: 0xFFFF 00:27:29.495 Flush: Supported 00:27:29.495 Reservation: Supported 00:27:29.495 Namespace Sharing Capabilities: Multiple Controllers 00:27:29.495 Size (in LBAs): 131072 (0GiB) 00:27:29.495 Capacity (in LBAs): 131072 (0GiB) 00:27:29.495 Utilization (in LBAs): 131072 (0GiB) 00:27:29.495 NGUID: ABCDEF0123456789ABCDEF0123456789 00:27:29.495 EUI64: ABCDEF0123456789 00:27:29.495 UUID: ae32f93e-4115-47da-9686-6749853be26a 00:27:29.495 Thin Provisioning: Not Supported 00:27:29.495 Per-NS Atomic Units: Yes 00:27:29.495 Atomic Boundary Size (Normal): 0 00:27:29.495 Atomic Boundary Size (PFail): 0 00:27:29.495 Atomic Boundary Offset: 0 00:27:29.495 Maximum Single Source Range Length: 65535 00:27:29.495 Maximum Copy Length: 65535 00:27:29.495 Maximum Source Range Count: 1 00:27:29.495 NGUID/EUI64 Never Reused: No 00:27:29.495 Namespace Write Protected: No 00:27:29.495 Number of LBA Formats: 1 00:27:29.495 Current LBA Format: LBA Format #00 00:27:29.495 LBA Format #00: Data Size: 512 Metadata Size: 0 00:27:29.495 00:27:29.495 19:13:46 -- host/identify.sh@51 -- # sync 00:27:29.495 19:13:46 -- host/identify.sh@52 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:29.495 19:13:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:29.495 19:13:46 -- common/autotest_common.sh@10 -- # set +x 00:27:29.495 19:13:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:29.495 19:13:46 -- host/identify.sh@54 -- # trap - SIGINT SIGTERM EXIT 00:27:29.495 19:13:46 -- host/identify.sh@56 -- # nvmftestfini 00:27:29.495 19:13:46 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:29.495 19:13:46 -- nvmf/common.sh@116 -- # sync 00:27:29.495 19:13:46 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:29.495 19:13:46 -- nvmf/common.sh@119 -- # set +e 00:27:29.495 19:13:46 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:29.495 19:13:46 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:29.495 rmmod nvme_tcp 00:27:29.495 rmmod nvme_fabrics 00:27:29.495 rmmod nvme_keyring 00:27:29.495 19:13:46 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:29.495 19:13:46 -- nvmf/common.sh@123 -- # set -e 00:27:29.495 19:13:46 -- nvmf/common.sh@124 -- # return 0 00:27:29.495 19:13:46 -- nvmf/common.sh@477 -- # '[' -n 3232499 ']' 00:27:29.495 19:13:46 -- nvmf/common.sh@478 -- # killprocess 3232499 00:27:29.495 19:13:46 -- common/autotest_common.sh@936 -- # '[' -z 3232499 ']' 00:27:29.495 19:13:46 -- common/autotest_common.sh@940 -- # kill -0 3232499 00:27:29.495 19:13:46 -- common/autotest_common.sh@941 -- # uname 00:27:29.495 19:13:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:29.495 19:13:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3232499 00:27:29.495 19:13:46 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:29.495 19:13:46 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:29.495 19:13:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3232499' 00:27:29.495 killing process with pid 3232499 00:27:29.495 19:13:46 -- common/autotest_common.sh@955 -- # kill 3232499 00:27:29.495 [2024-11-26 19:13:46.326504] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:27:29.495 19:13:46 -- common/autotest_common.sh@960 -- # wait 3232499 00:27:29.753 19:13:46 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:29.753 19:13:46 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:29.753 19:13:46 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:29.753 19:13:46 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:29.753 19:13:46 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:29.753 19:13:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:29.753 19:13:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:29.753 19:13:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:31.657 19:13:48 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:31.916 00:27:31.916 real 0m9.158s 00:27:31.916 user 0m7.395s 00:27:31.916 sys 0m4.361s 00:27:31.916 19:13:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:31.916 19:13:48 -- common/autotest_common.sh@10 -- # set +x 00:27:31.916 ************************************ 00:27:31.916 END TEST nvmf_identify 00:27:31.916 ************************************ 00:27:31.916 19:13:48 -- nvmf/nvmf.sh@98 -- # run_test nvmf_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:27:31.916 19:13:48 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:31.916 19:13:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:31.916 19:13:48 -- common/autotest_common.sh@10 -- # set +x 00:27:31.916 ************************************ 00:27:31.916 START TEST nvmf_perf 00:27:31.916 ************************************ 00:27:31.916 19:13:48 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:27:31.916 * Looking for test storage... 00:27:31.916 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:31.916 19:13:48 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:31.916 19:13:48 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:31.916 19:13:48 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:31.916 19:13:48 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:31.916 19:13:48 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:31.916 19:13:48 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:31.916 19:13:48 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:31.916 19:13:48 -- scripts/common.sh@335 -- # IFS=.-: 00:27:31.916 19:13:48 -- scripts/common.sh@335 -- # read -ra ver1 00:27:31.916 19:13:48 -- scripts/common.sh@336 -- # IFS=.-: 00:27:31.916 19:13:48 -- scripts/common.sh@336 -- # read -ra ver2 00:27:31.916 19:13:48 -- scripts/common.sh@337 -- # local 'op=<' 00:27:31.916 19:13:48 -- scripts/common.sh@339 -- # ver1_l=2 00:27:31.916 19:13:48 -- scripts/common.sh@340 -- # ver2_l=1 00:27:31.916 19:13:48 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:31.916 19:13:48 -- scripts/common.sh@343 -- # case "$op" in 00:27:31.916 19:13:48 -- scripts/common.sh@344 -- # : 1 00:27:31.916 19:13:48 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:31.916 19:13:48 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:31.916 19:13:48 -- scripts/common.sh@364 -- # decimal 1 00:27:31.916 19:13:48 -- scripts/common.sh@352 -- # local d=1 00:27:31.916 19:13:48 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:31.916 19:13:48 -- scripts/common.sh@354 -- # echo 1 00:27:31.916 19:13:48 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:31.916 19:13:48 -- scripts/common.sh@365 -- # decimal 2 00:27:31.916 19:13:48 -- scripts/common.sh@352 -- # local d=2 00:27:31.916 19:13:48 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:31.916 19:13:48 -- scripts/common.sh@354 -- # echo 2 00:27:31.916 19:13:48 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:31.916 19:13:48 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:31.916 19:13:48 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:31.916 19:13:48 -- scripts/common.sh@367 -- # return 0 00:27:31.916 19:13:48 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:31.916 19:13:48 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:31.916 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:31.916 --rc genhtml_branch_coverage=1 00:27:31.916 --rc genhtml_function_coverage=1 00:27:31.916 --rc genhtml_legend=1 00:27:31.916 --rc geninfo_all_blocks=1 00:27:31.916 --rc geninfo_unexecuted_blocks=1 00:27:31.916 00:27:31.916 ' 00:27:31.916 19:13:48 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:31.916 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:31.916 --rc genhtml_branch_coverage=1 00:27:31.916 --rc genhtml_function_coverage=1 00:27:31.916 --rc genhtml_legend=1 00:27:31.916 --rc geninfo_all_blocks=1 00:27:31.916 --rc geninfo_unexecuted_blocks=1 00:27:31.916 00:27:31.916 ' 00:27:31.916 19:13:48 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:31.916 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:31.916 --rc genhtml_branch_coverage=1 00:27:31.916 --rc genhtml_function_coverage=1 00:27:31.916 --rc genhtml_legend=1 00:27:31.916 --rc geninfo_all_blocks=1 00:27:31.916 --rc geninfo_unexecuted_blocks=1 00:27:31.916 00:27:31.916 ' 00:27:31.916 19:13:48 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:31.916 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:31.916 --rc genhtml_branch_coverage=1 00:27:31.916 --rc genhtml_function_coverage=1 00:27:31.916 --rc genhtml_legend=1 00:27:31.916 --rc geninfo_all_blocks=1 00:27:31.916 --rc geninfo_unexecuted_blocks=1 00:27:31.916 00:27:31.916 ' 00:27:31.916 19:13:48 -- host/perf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:31.916 19:13:48 -- nvmf/common.sh@7 -- # uname -s 00:27:31.916 19:13:48 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:31.916 19:13:48 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:31.916 19:13:48 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:31.916 19:13:48 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:31.916 19:13:48 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:31.916 19:13:48 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:31.916 19:13:48 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:31.916 19:13:48 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:31.916 19:13:48 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:31.916 19:13:48 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:31.916 19:13:48 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:27:31.916 19:13:48 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:27:31.916 19:13:48 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:31.916 19:13:48 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:31.916 19:13:48 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:31.916 19:13:48 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:31.916 19:13:48 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:31.916 19:13:48 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:31.916 19:13:48 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:31.916 19:13:48 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:31.916 19:13:48 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:31.916 19:13:48 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:31.916 19:13:48 -- paths/export.sh@5 -- # export PATH 00:27:31.916 19:13:48 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:31.916 19:13:48 -- nvmf/common.sh@46 -- # : 0 00:27:31.916 19:13:48 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:31.916 19:13:48 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:31.916 19:13:48 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:31.916 19:13:48 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:31.916 19:13:48 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:31.916 19:13:48 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:31.916 19:13:48 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:31.916 19:13:48 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:31.916 19:13:48 -- host/perf.sh@12 -- # MALLOC_BDEV_SIZE=64 00:27:31.916 19:13:48 -- host/perf.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:27:31.916 19:13:48 -- host/perf.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:27:31.916 19:13:48 -- host/perf.sh@17 -- # nvmftestinit 00:27:31.916 19:13:48 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:31.916 19:13:48 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:31.916 19:13:48 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:31.916 19:13:48 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:31.916 19:13:48 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:31.916 19:13:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:31.916 19:13:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:31.916 19:13:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:31.916 19:13:48 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:31.916 19:13:48 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:31.916 19:13:48 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:31.916 19:13:48 -- common/autotest_common.sh@10 -- # set +x 00:27:37.284 19:13:54 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:37.284 19:13:54 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:37.543 19:13:54 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:37.543 19:13:54 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:37.543 19:13:54 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:37.543 19:13:54 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:37.543 19:13:54 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:37.543 19:13:54 -- nvmf/common.sh@294 -- # net_devs=() 00:27:37.543 19:13:54 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:37.543 19:13:54 -- nvmf/common.sh@295 -- # e810=() 00:27:37.543 19:13:54 -- nvmf/common.sh@295 -- # local -ga e810 00:27:37.543 19:13:54 -- nvmf/common.sh@296 -- # x722=() 00:27:37.543 19:13:54 -- nvmf/common.sh@296 -- # local -ga x722 00:27:37.543 19:13:54 -- nvmf/common.sh@297 -- # mlx=() 00:27:37.543 19:13:54 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:37.543 19:13:54 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:37.543 19:13:54 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:37.543 19:13:54 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:37.543 19:13:54 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:37.543 19:13:54 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:37.543 19:13:54 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:37.543 19:13:54 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:37.543 19:13:54 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:37.543 19:13:54 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:37.543 19:13:54 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:37.543 19:13:54 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:37.543 19:13:54 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:37.543 19:13:54 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:37.543 19:13:54 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:37.543 19:13:54 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:37.543 19:13:54 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:37.543 19:13:54 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:37.543 19:13:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:37.543 19:13:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:27:37.543 Found 0000:86:00.0 (0x8086 - 0x159b) 00:27:37.543 19:13:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:37.543 19:13:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:37.543 19:13:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:37.543 19:13:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:37.543 19:13:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:37.543 19:13:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:37.543 19:13:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:27:37.543 Found 0000:86:00.1 (0x8086 - 0x159b) 00:27:37.543 19:13:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:37.543 19:13:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:37.543 19:13:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:37.543 19:13:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:37.543 19:13:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:37.543 19:13:54 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:37.543 19:13:54 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:37.543 19:13:54 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:37.543 19:13:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:37.543 19:13:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:37.543 19:13:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:37.543 19:13:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:37.543 19:13:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:27:37.543 Found net devices under 0000:86:00.0: cvl_0_0 00:27:37.543 19:13:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:37.543 19:13:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:37.543 19:13:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:37.543 19:13:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:37.543 19:13:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:37.543 19:13:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:27:37.543 Found net devices under 0000:86:00.1: cvl_0_1 00:27:37.543 19:13:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:37.543 19:13:54 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:37.543 19:13:54 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:37.543 19:13:54 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:37.543 19:13:54 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:37.543 19:13:54 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:37.543 19:13:54 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:37.543 19:13:54 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:37.543 19:13:54 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:37.543 19:13:54 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:37.543 19:13:54 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:37.543 19:13:54 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:37.543 19:13:54 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:37.543 19:13:54 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:37.543 19:13:54 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:37.543 19:13:54 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:37.543 19:13:54 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:37.543 19:13:54 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:37.543 19:13:54 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:37.543 19:13:54 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:37.544 19:13:54 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:37.544 19:13:54 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:37.544 19:13:54 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:37.544 19:13:54 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:37.544 19:13:54 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:37.544 19:13:54 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:37.544 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:37.544 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.350 ms 00:27:37.544 00:27:37.544 --- 10.0.0.2 ping statistics --- 00:27:37.544 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:37.544 rtt min/avg/max/mdev = 0.350/0.350/0.350/0.000 ms 00:27:37.544 19:13:54 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:37.544 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:37.544 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.206 ms 00:27:37.544 00:27:37.544 --- 10.0.0.1 ping statistics --- 00:27:37.544 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:37.544 rtt min/avg/max/mdev = 0.206/0.206/0.206/0.000 ms 00:27:37.544 19:13:54 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:37.544 19:13:54 -- nvmf/common.sh@410 -- # return 0 00:27:37.544 19:13:54 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:37.544 19:13:54 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:37.544 19:13:54 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:37.544 19:13:54 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:37.544 19:13:54 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:37.544 19:13:54 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:37.544 19:13:54 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:37.803 19:13:54 -- host/perf.sh@18 -- # nvmfappstart -m 0xF 00:27:37.803 19:13:54 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:37.803 19:13:54 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:37.803 19:13:54 -- common/autotest_common.sh@10 -- # set +x 00:27:37.803 19:13:54 -- nvmf/common.sh@469 -- # nvmfpid=3236294 00:27:37.803 19:13:54 -- nvmf/common.sh@470 -- # waitforlisten 3236294 00:27:37.803 19:13:54 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:27:37.803 19:13:54 -- common/autotest_common.sh@829 -- # '[' -z 3236294 ']' 00:27:37.803 19:13:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:37.803 19:13:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:37.803 19:13:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:37.803 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:37.803 19:13:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:37.803 19:13:54 -- common/autotest_common.sh@10 -- # set +x 00:27:37.803 [2024-11-26 19:13:54.558481] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:27:37.803 [2024-11-26 19:13:54.558525] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:37.803 EAL: No free 2048 kB hugepages reported on node 1 00:27:37.803 [2024-11-26 19:13:54.621895] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:27:37.803 [2024-11-26 19:13:54.662181] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:37.803 [2024-11-26 19:13:54.662298] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:37.803 [2024-11-26 19:13:54.662307] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:37.803 [2024-11-26 19:13:54.662313] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:37.803 [2024-11-26 19:13:54.662356] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:37.803 [2024-11-26 19:13:54.662380] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:37.803 [2024-11-26 19:13:54.662468] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:37.803 [2024-11-26 19:13:54.662469] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:38.738 19:13:55 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:38.738 19:13:55 -- common/autotest_common.sh@862 -- # return 0 00:27:38.738 19:13:55 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:38.738 19:13:55 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:38.738 19:13:55 -- common/autotest_common.sh@10 -- # set +x 00:27:38.738 19:13:55 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:38.738 19:13:55 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:27:38.738 19:13:55 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_subsystem_config 00:27:42.022 19:13:58 -- host/perf.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_get_config bdev 00:27:42.022 19:13:58 -- host/perf.sh@30 -- # jq -r '.[].params | select(.name=="Nvme0").traddr' 00:27:42.022 19:13:58 -- host/perf.sh@30 -- # local_nvme_trid=0000:5e:00.0 00:27:42.022 19:13:58 -- host/perf.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:27:42.022 19:13:58 -- host/perf.sh@31 -- # bdevs=' Malloc0' 00:27:42.022 19:13:58 -- host/perf.sh@33 -- # '[' -n 0000:5e:00.0 ']' 00:27:42.022 19:13:58 -- host/perf.sh@34 -- # bdevs=' Malloc0 Nvme0n1' 00:27:42.022 19:13:58 -- host/perf.sh@37 -- # '[' tcp == rdma ']' 00:27:42.022 19:13:58 -- host/perf.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:27:42.280 [2024-11-26 19:13:59.008303] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:42.280 19:13:59 -- host/perf.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:42.537 19:13:59 -- host/perf.sh@45 -- # for bdev in $bdevs 00:27:42.537 19:13:59 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:42.537 19:13:59 -- host/perf.sh@45 -- # for bdev in $bdevs 00:27:42.537 19:13:59 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:27:42.794 19:13:59 -- host/perf.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:43.051 [2024-11-26 19:13:59.799420] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:43.051 19:13:59 -- host/perf.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:27:43.309 19:14:00 -- host/perf.sh@52 -- # '[' -n 0000:5e:00.0 ']' 00:27:43.309 19:14:00 -- host/perf.sh@53 -- # perf_app -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:5e:00.0' 00:27:43.309 19:14:00 -- host/perf.sh@21 -- # '[' 0 -eq 1 ']' 00:27:43.309 19:14:00 -- host/perf.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:5e:00.0' 00:27:44.685 Initializing NVMe Controllers 00:27:44.685 Attached to NVMe Controller at 0000:5e:00.0 [8086:0a54] 00:27:44.685 Associating PCIE (0000:5e:00.0) NSID 1 with lcore 0 00:27:44.685 Initialization complete. Launching workers. 00:27:44.685 ======================================================== 00:27:44.685 Latency(us) 00:27:44.685 Device Information : IOPS MiB/s Average min max 00:27:44.685 PCIE (0000:5e:00.0) NSID 1 from core 0: 98911.98 386.37 323.04 9.78 4430.39 00:27:44.685 ======================================================== 00:27:44.685 Total : 98911.98 386.37 323.04 9.78 4430.39 00:27:44.685 00:27:44.685 19:14:01 -- host/perf.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:44.685 EAL: No free 2048 kB hugepages reported on node 1 00:27:46.059 Initializing NVMe Controllers 00:27:46.059 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:46.059 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:46.059 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:27:46.059 Initialization complete. Launching workers. 00:27:46.059 ======================================================== 00:27:46.059 Latency(us) 00:27:46.059 Device Information : IOPS MiB/s Average min max 00:27:46.059 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 100.00 0.39 10364.28 109.91 45884.22 00:27:46.059 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 46.00 0.18 21837.07 7963.39 47899.27 00:27:46.059 ======================================================== 00:27:46.059 Total : 146.00 0.57 13979.00 109.91 47899.27 00:27:46.059 00:27:46.059 19:14:02 -- host/perf.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 4096 -w randrw -M 50 -t 1 -HI -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:46.059 EAL: No free 2048 kB hugepages reported on node 1 00:27:47.435 Initializing NVMe Controllers 00:27:47.435 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:47.435 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:47.435 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:27:47.435 Initialization complete. Launching workers. 00:27:47.435 ======================================================== 00:27:47.435 Latency(us) 00:27:47.435 Device Information : IOPS MiB/s Average min max 00:27:47.435 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 11329.73 44.26 2824.60 427.29 6647.58 00:27:47.435 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 3883.94 15.17 8273.84 5680.91 16213.59 00:27:47.435 ======================================================== 00:27:47.435 Total : 15213.67 59.43 4215.75 427.29 16213.59 00:27:47.435 00:27:47.436 19:14:03 -- host/perf.sh@59 -- # [[ e810 == \e\8\1\0 ]] 00:27:47.436 19:14:03 -- host/perf.sh@59 -- # [[ tcp == \r\d\m\a ]] 00:27:47.436 19:14:03 -- host/perf.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -O 16384 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:47.436 EAL: No free 2048 kB hugepages reported on node 1 00:27:49.972 Initializing NVMe Controllers 00:27:49.972 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:49.972 Controller IO queue size 128, less than required. 00:27:49.972 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:27:49.972 Controller IO queue size 128, less than required. 00:27:49.972 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:27:49.972 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:49.972 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:27:49.972 Initialization complete. Launching workers. 00:27:49.972 ======================================================== 00:27:49.972 Latency(us) 00:27:49.972 Device Information : IOPS MiB/s Average min max 00:27:49.972 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1909.42 477.35 68051.09 39795.14 128547.43 00:27:49.972 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 611.31 152.83 216951.28 61511.92 320640.09 00:27:49.972 ======================================================== 00:27:49.972 Total : 2520.73 630.18 104161.53 39795.14 320640.09 00:27:49.972 00:27:49.972 19:14:06 -- host/perf.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 36964 -O 4096 -w randrw -M 50 -t 5 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0xf -P 4 00:27:49.972 EAL: No free 2048 kB hugepages reported on node 1 00:27:49.972 No valid NVMe controllers or AIO or URING devices found 00:27:49.972 Initializing NVMe Controllers 00:27:49.972 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:49.972 Controller IO queue size 128, less than required. 00:27:49.972 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:27:49.972 WARNING: IO size 36964 (-o) is not a multiple of nsid 1 sector size 512. Removing this ns from test 00:27:49.972 Controller IO queue size 128, less than required. 00:27:49.972 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:27:49.972 WARNING: IO size 36964 (-o) is not a multiple of nsid 2 sector size 512. Removing this ns from test 00:27:49.972 WARNING: Some requested NVMe devices were skipped 00:27:49.972 19:14:06 -- host/perf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' --transport-stat 00:27:49.972 EAL: No free 2048 kB hugepages reported on node 1 00:27:52.504 Initializing NVMe Controllers 00:27:52.504 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:52.504 Controller IO queue size 128, less than required. 00:27:52.504 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:27:52.504 Controller IO queue size 128, less than required. 00:27:52.504 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:27:52.504 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:52.504 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:27:52.504 Initialization complete. Launching workers. 00:27:52.504 00:27:52.504 ==================== 00:27:52.504 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 statistics: 00:27:52.504 TCP transport: 00:27:52.504 polls: 12944 00:27:52.504 idle_polls: 9027 00:27:52.504 sock_completions: 3917 00:27:52.504 nvme_completions: 6514 00:27:52.504 submitted_requests: 10000 00:27:52.504 queued_requests: 1 00:27:52.504 00:27:52.504 ==================== 00:27:52.504 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 statistics: 00:27:52.504 TCP transport: 00:27:52.504 polls: 13244 00:27:52.504 idle_polls: 8036 00:27:52.504 sock_completions: 5208 00:27:52.504 nvme_completions: 7055 00:27:52.504 submitted_requests: 10751 00:27:52.504 queued_requests: 1 00:27:52.504 ======================================================== 00:27:52.504 Latency(us) 00:27:52.504 Device Information : IOPS MiB/s Average min max 00:27:52.504 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1689.34 422.33 76978.13 38028.65 136027.75 00:27:52.504 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 1824.63 456.16 71318.54 32371.46 104718.35 00:27:52.504 ======================================================== 00:27:52.504 Total : 3513.96 878.49 74039.39 32371.46 136027.75 00:27:52.504 00:27:52.504 19:14:09 -- host/perf.sh@66 -- # sync 00:27:52.504 19:14:09 -- host/perf.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:52.504 19:14:09 -- host/perf.sh@69 -- # '[' 1 -eq 1 ']' 00:27:52.504 19:14:09 -- host/perf.sh@71 -- # '[' -n 0000:5e:00.0 ']' 00:27:52.504 19:14:09 -- host/perf.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore Nvme0n1 lvs_0 00:27:55.785 19:14:12 -- host/perf.sh@72 -- # ls_guid=b2240f70-d51d-4715-9925-01e6ee13078a 00:27:55.785 19:14:12 -- host/perf.sh@73 -- # get_lvs_free_mb b2240f70-d51d-4715-9925-01e6ee13078a 00:27:55.785 19:14:12 -- common/autotest_common.sh@1353 -- # local lvs_uuid=b2240f70-d51d-4715-9925-01e6ee13078a 00:27:55.785 19:14:12 -- common/autotest_common.sh@1354 -- # local lvs_info 00:27:55.785 19:14:12 -- common/autotest_common.sh@1355 -- # local fc 00:27:55.785 19:14:12 -- common/autotest_common.sh@1356 -- # local cs 00:27:55.785 19:14:12 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:27:56.044 19:14:12 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:27:56.044 { 00:27:56.044 "uuid": "b2240f70-d51d-4715-9925-01e6ee13078a", 00:27:56.044 "name": "lvs_0", 00:27:56.044 "base_bdev": "Nvme0n1", 00:27:56.044 "total_data_clusters": 238234, 00:27:56.044 "free_clusters": 238234, 00:27:56.044 "block_size": 512, 00:27:56.044 "cluster_size": 4194304 00:27:56.044 } 00:27:56.044 ]' 00:27:56.044 19:14:12 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="b2240f70-d51d-4715-9925-01e6ee13078a") .free_clusters' 00:27:56.044 19:14:12 -- common/autotest_common.sh@1358 -- # fc=238234 00:27:56.044 19:14:12 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="b2240f70-d51d-4715-9925-01e6ee13078a") .cluster_size' 00:27:56.044 19:14:12 -- common/autotest_common.sh@1359 -- # cs=4194304 00:27:56.044 19:14:12 -- common/autotest_common.sh@1362 -- # free_mb=952936 00:27:56.044 19:14:12 -- common/autotest_common.sh@1363 -- # echo 952936 00:27:56.044 952936 00:27:56.044 19:14:12 -- host/perf.sh@77 -- # '[' 952936 -gt 20480 ']' 00:27:56.044 19:14:12 -- host/perf.sh@78 -- # free_mb=20480 00:27:56.044 19:14:12 -- host/perf.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u b2240f70-d51d-4715-9925-01e6ee13078a lbd_0 20480 00:27:56.611 19:14:13 -- host/perf.sh@80 -- # lb_guid=0b8bf728-d643-4f72-bfb8-d4965ca533d8 00:27:56.611 19:14:13 -- host/perf.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore 0b8bf728-d643-4f72-bfb8-d4965ca533d8 lvs_n_0 00:27:57.177 19:14:14 -- host/perf.sh@83 -- # ls_nested_guid=68a396a8-354a-4ee6-9e24-f38b0ef4f464 00:27:57.177 19:14:14 -- host/perf.sh@84 -- # get_lvs_free_mb 68a396a8-354a-4ee6-9e24-f38b0ef4f464 00:27:57.177 19:14:14 -- common/autotest_common.sh@1353 -- # local lvs_uuid=68a396a8-354a-4ee6-9e24-f38b0ef4f464 00:27:57.177 19:14:14 -- common/autotest_common.sh@1354 -- # local lvs_info 00:27:57.177 19:14:14 -- common/autotest_common.sh@1355 -- # local fc 00:27:57.177 19:14:14 -- common/autotest_common.sh@1356 -- # local cs 00:27:57.177 19:14:14 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:27:57.436 19:14:14 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:27:57.436 { 00:27:57.436 "uuid": "b2240f70-d51d-4715-9925-01e6ee13078a", 00:27:57.436 "name": "lvs_0", 00:27:57.436 "base_bdev": "Nvme0n1", 00:27:57.436 "total_data_clusters": 238234, 00:27:57.436 "free_clusters": 233114, 00:27:57.436 "block_size": 512, 00:27:57.436 "cluster_size": 4194304 00:27:57.436 }, 00:27:57.436 { 00:27:57.436 "uuid": "68a396a8-354a-4ee6-9e24-f38b0ef4f464", 00:27:57.436 "name": "lvs_n_0", 00:27:57.436 "base_bdev": "0b8bf728-d643-4f72-bfb8-d4965ca533d8", 00:27:57.436 "total_data_clusters": 5114, 00:27:57.436 "free_clusters": 5114, 00:27:57.436 "block_size": 512, 00:27:57.436 "cluster_size": 4194304 00:27:57.436 } 00:27:57.436 ]' 00:27:57.436 19:14:14 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="68a396a8-354a-4ee6-9e24-f38b0ef4f464") .free_clusters' 00:27:57.436 19:14:14 -- common/autotest_common.sh@1358 -- # fc=5114 00:27:57.436 19:14:14 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="68a396a8-354a-4ee6-9e24-f38b0ef4f464") .cluster_size' 00:27:57.436 19:14:14 -- common/autotest_common.sh@1359 -- # cs=4194304 00:27:57.436 19:14:14 -- common/autotest_common.sh@1362 -- # free_mb=20456 00:27:57.436 19:14:14 -- common/autotest_common.sh@1363 -- # echo 20456 00:27:57.436 20456 00:27:57.436 19:14:14 -- host/perf.sh@85 -- # '[' 20456 -gt 20480 ']' 00:27:57.436 19:14:14 -- host/perf.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 68a396a8-354a-4ee6-9e24-f38b0ef4f464 lbd_nest_0 20456 00:27:57.695 19:14:14 -- host/perf.sh@88 -- # lb_nested_guid=0f8d89bb-6444-4125-952d-13dcfca8211e 00:27:57.695 19:14:14 -- host/perf.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:57.954 19:14:14 -- host/perf.sh@90 -- # for bdev in $lb_nested_guid 00:27:57.954 19:14:14 -- host/perf.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 0f8d89bb-6444-4125-952d-13dcfca8211e 00:27:58.212 19:14:14 -- host/perf.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:58.212 19:14:15 -- host/perf.sh@95 -- # qd_depth=("1" "32" "128") 00:27:58.212 19:14:15 -- host/perf.sh@96 -- # io_size=("512" "131072") 00:27:58.212 19:14:15 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:27:58.212 19:14:15 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:27:58.212 19:14:15 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:58.212 EAL: No free 2048 kB hugepages reported on node 1 00:28:10.412 Initializing NVMe Controllers 00:28:10.412 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:28:10.412 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:28:10.412 Initialization complete. Launching workers. 00:28:10.412 ======================================================== 00:28:10.412 Latency(us) 00:28:10.412 Device Information : IOPS MiB/s Average min max 00:28:10.412 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 50.99 0.02 19671.13 129.21 47884.40 00:28:10.412 ======================================================== 00:28:10.412 Total : 50.99 0.02 19671.13 129.21 47884.40 00:28:10.412 00:28:10.412 19:14:25 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:28:10.412 19:14:25 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:28:10.412 EAL: No free 2048 kB hugepages reported on node 1 00:28:20.385 Initializing NVMe Controllers 00:28:20.385 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:28:20.385 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:28:20.385 Initialization complete. Launching workers. 00:28:20.385 ======================================================== 00:28:20.385 Latency(us) 00:28:20.385 Device Information : IOPS MiB/s Average min max 00:28:20.385 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 72.80 9.10 13787.20 5913.78 55814.39 00:28:20.385 ======================================================== 00:28:20.385 Total : 72.80 9.10 13787.20 5913.78 55814.39 00:28:20.385 00:28:20.385 19:14:35 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:28:20.385 19:14:35 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:28:20.385 19:14:35 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:28:20.385 EAL: No free 2048 kB hugepages reported on node 1 00:28:30.359 Initializing NVMe Controllers 00:28:30.359 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:28:30.359 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:28:30.359 Initialization complete. Launching workers. 00:28:30.359 ======================================================== 00:28:30.359 Latency(us) 00:28:30.359 Device Information : IOPS MiB/s Average min max 00:28:30.359 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 8533.90 4.17 3760.80 229.05 47875.26 00:28:30.359 ======================================================== 00:28:30.360 Total : 8533.90 4.17 3760.80 229.05 47875.26 00:28:30.360 00:28:30.360 19:14:46 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:28:30.360 19:14:46 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:28:30.360 EAL: No free 2048 kB hugepages reported on node 1 00:28:40.335 Initializing NVMe Controllers 00:28:40.335 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:28:40.335 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:28:40.335 Initialization complete. Launching workers. 00:28:40.335 ======================================================== 00:28:40.335 Latency(us) 00:28:40.335 Device Information : IOPS MiB/s Average min max 00:28:40.335 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 3294.49 411.81 9713.95 564.30 22270.04 00:28:40.335 ======================================================== 00:28:40.335 Total : 3294.49 411.81 9713.95 564.30 22270.04 00:28:40.335 00:28:40.335 19:14:56 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:28:40.335 19:14:56 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:28:40.335 19:14:56 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:28:40.335 EAL: No free 2048 kB hugepages reported on node 1 00:28:50.309 Initializing NVMe Controllers 00:28:50.309 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:28:50.309 Controller IO queue size 128, less than required. 00:28:50.309 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:28:50.309 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:28:50.309 Initialization complete. Launching workers. 00:28:50.309 ======================================================== 00:28:50.309 Latency(us) 00:28:50.309 Device Information : IOPS MiB/s Average min max 00:28:50.309 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 15947.25 7.79 8031.86 1159.94 47799.70 00:28:50.309 ======================================================== 00:28:50.309 Total : 15947.25 7.79 8031.86 1159.94 47799.70 00:28:50.309 00:28:50.309 19:15:06 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:28:50.309 19:15:06 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:28:50.309 EAL: No free 2048 kB hugepages reported on node 1 00:29:00.279 Initializing NVMe Controllers 00:29:00.279 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:29:00.279 Controller IO queue size 128, less than required. 00:29:00.279 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:29:00.279 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:29:00.279 Initialization complete. Launching workers. 00:29:00.279 ======================================================== 00:29:00.279 Latency(us) 00:29:00.279 Device Information : IOPS MiB/s Average min max 00:29:00.279 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1216.10 152.01 105640.08 32317.64 191461.85 00:29:00.279 ======================================================== 00:29:00.279 Total : 1216.10 152.01 105640.08 32317.64 191461.85 00:29:00.279 00:29:00.279 19:15:16 -- host/perf.sh@104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:29:00.279 19:15:17 -- host/perf.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 0f8d89bb-6444-4125-952d-13dcfca8211e 00:29:01.215 19:15:17 -- host/perf.sh@106 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:29:01.215 19:15:17 -- host/perf.sh@107 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 0b8bf728-d643-4f72-bfb8-d4965ca533d8 00:29:01.473 19:15:18 -- host/perf.sh@108 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:29:01.767 19:15:18 -- host/perf.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:29:01.767 19:15:18 -- host/perf.sh@114 -- # nvmftestfini 00:29:01.767 19:15:18 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:01.767 19:15:18 -- nvmf/common.sh@116 -- # sync 00:29:01.767 19:15:18 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:01.767 19:15:18 -- nvmf/common.sh@119 -- # set +e 00:29:01.767 19:15:18 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:01.767 19:15:18 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:01.767 rmmod nvme_tcp 00:29:01.767 rmmod nvme_fabrics 00:29:01.767 rmmod nvme_keyring 00:29:01.767 19:15:18 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:01.767 19:15:18 -- nvmf/common.sh@123 -- # set -e 00:29:01.767 19:15:18 -- nvmf/common.sh@124 -- # return 0 00:29:01.767 19:15:18 -- nvmf/common.sh@477 -- # '[' -n 3236294 ']' 00:29:01.767 19:15:18 -- nvmf/common.sh@478 -- # killprocess 3236294 00:29:01.767 19:15:18 -- common/autotest_common.sh@936 -- # '[' -z 3236294 ']' 00:29:01.767 19:15:18 -- common/autotest_common.sh@940 -- # kill -0 3236294 00:29:01.767 19:15:18 -- common/autotest_common.sh@941 -- # uname 00:29:01.767 19:15:18 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:01.767 19:15:18 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3236294 00:29:01.767 19:15:18 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:01.767 19:15:18 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:01.767 19:15:18 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3236294' 00:29:01.767 killing process with pid 3236294 00:29:01.767 19:15:18 -- common/autotest_common.sh@955 -- # kill 3236294 00:29:01.767 19:15:18 -- common/autotest_common.sh@960 -- # wait 3236294 00:29:03.143 19:15:20 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:29:03.143 19:15:20 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:03.143 19:15:20 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:03.143 19:15:20 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:03.143 19:15:20 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:03.143 19:15:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:03.143 19:15:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:03.143 19:15:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:05.738 19:15:22 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:05.738 00:29:05.738 real 1m33.496s 00:29:05.738 user 5m34.364s 00:29:05.738 sys 0m16.804s 00:29:05.738 19:15:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:05.738 19:15:22 -- common/autotest_common.sh@10 -- # set +x 00:29:05.738 ************************************ 00:29:05.738 END TEST nvmf_perf 00:29:05.738 ************************************ 00:29:05.738 19:15:22 -- nvmf/nvmf.sh@99 -- # run_test nvmf_fio_host /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:29:05.738 19:15:22 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:29:05.738 19:15:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:05.738 19:15:22 -- common/autotest_common.sh@10 -- # set +x 00:29:05.738 ************************************ 00:29:05.738 START TEST nvmf_fio_host 00:29:05.738 ************************************ 00:29:05.738 19:15:22 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:29:05.738 * Looking for test storage... 00:29:05.738 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:29:05.738 19:15:22 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:29:05.738 19:15:22 -- common/autotest_common.sh@1690 -- # lcov --version 00:29:05.738 19:15:22 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:29:05.738 19:15:22 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:29:05.738 19:15:22 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:29:05.738 19:15:22 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:29:05.738 19:15:22 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:29:05.738 19:15:22 -- scripts/common.sh@335 -- # IFS=.-: 00:29:05.738 19:15:22 -- scripts/common.sh@335 -- # read -ra ver1 00:29:05.738 19:15:22 -- scripts/common.sh@336 -- # IFS=.-: 00:29:05.738 19:15:22 -- scripts/common.sh@336 -- # read -ra ver2 00:29:05.738 19:15:22 -- scripts/common.sh@337 -- # local 'op=<' 00:29:05.738 19:15:22 -- scripts/common.sh@339 -- # ver1_l=2 00:29:05.738 19:15:22 -- scripts/common.sh@340 -- # ver2_l=1 00:29:05.738 19:15:22 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:29:05.738 19:15:22 -- scripts/common.sh@343 -- # case "$op" in 00:29:05.738 19:15:22 -- scripts/common.sh@344 -- # : 1 00:29:05.738 19:15:22 -- scripts/common.sh@363 -- # (( v = 0 )) 00:29:05.738 19:15:22 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:29:05.738 19:15:22 -- scripts/common.sh@364 -- # decimal 1 00:29:05.738 19:15:22 -- scripts/common.sh@352 -- # local d=1 00:29:05.738 19:15:22 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:29:05.738 19:15:22 -- scripts/common.sh@354 -- # echo 1 00:29:05.738 19:15:22 -- scripts/common.sh@364 -- # ver1[v]=1 00:29:05.738 19:15:22 -- scripts/common.sh@365 -- # decimal 2 00:29:05.738 19:15:22 -- scripts/common.sh@352 -- # local d=2 00:29:05.738 19:15:22 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:29:05.738 19:15:22 -- scripts/common.sh@354 -- # echo 2 00:29:05.738 19:15:22 -- scripts/common.sh@365 -- # ver2[v]=2 00:29:05.739 19:15:22 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:29:05.739 19:15:22 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:29:05.739 19:15:22 -- scripts/common.sh@367 -- # return 0 00:29:05.739 19:15:22 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:29:05.739 19:15:22 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:29:05.739 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:05.739 --rc genhtml_branch_coverage=1 00:29:05.739 --rc genhtml_function_coverage=1 00:29:05.739 --rc genhtml_legend=1 00:29:05.739 --rc geninfo_all_blocks=1 00:29:05.739 --rc geninfo_unexecuted_blocks=1 00:29:05.739 00:29:05.739 ' 00:29:05.739 19:15:22 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:29:05.739 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:05.739 --rc genhtml_branch_coverage=1 00:29:05.739 --rc genhtml_function_coverage=1 00:29:05.739 --rc genhtml_legend=1 00:29:05.739 --rc geninfo_all_blocks=1 00:29:05.739 --rc geninfo_unexecuted_blocks=1 00:29:05.739 00:29:05.739 ' 00:29:05.739 19:15:22 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:29:05.739 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:05.739 --rc genhtml_branch_coverage=1 00:29:05.739 --rc genhtml_function_coverage=1 00:29:05.739 --rc genhtml_legend=1 00:29:05.739 --rc geninfo_all_blocks=1 00:29:05.739 --rc geninfo_unexecuted_blocks=1 00:29:05.739 00:29:05.739 ' 00:29:05.739 19:15:22 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:29:05.739 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:05.739 --rc genhtml_branch_coverage=1 00:29:05.739 --rc genhtml_function_coverage=1 00:29:05.739 --rc genhtml_legend=1 00:29:05.739 --rc geninfo_all_blocks=1 00:29:05.739 --rc geninfo_unexecuted_blocks=1 00:29:05.739 00:29:05.739 ' 00:29:05.739 19:15:22 -- host/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:05.739 19:15:22 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:05.739 19:15:22 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:05.739 19:15:22 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:05.739 19:15:22 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:05.739 19:15:22 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:05.739 19:15:22 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:05.739 19:15:22 -- paths/export.sh@5 -- # export PATH 00:29:05.739 19:15:22 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:05.739 19:15:22 -- host/fio.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:05.739 19:15:22 -- nvmf/common.sh@7 -- # uname -s 00:29:05.739 19:15:22 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:05.739 19:15:22 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:05.739 19:15:22 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:05.739 19:15:22 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:05.739 19:15:22 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:05.739 19:15:22 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:05.739 19:15:22 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:05.739 19:15:22 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:05.739 19:15:22 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:05.739 19:15:22 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:05.739 19:15:22 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:29:05.739 19:15:22 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:29:05.739 19:15:22 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:05.739 19:15:22 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:05.739 19:15:22 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:05.739 19:15:22 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:05.739 19:15:22 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:05.739 19:15:22 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:05.739 19:15:22 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:05.739 19:15:22 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:05.739 19:15:22 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:05.739 19:15:22 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:05.739 19:15:22 -- paths/export.sh@5 -- # export PATH 00:29:05.740 19:15:22 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:05.740 19:15:22 -- nvmf/common.sh@46 -- # : 0 00:29:05.740 19:15:22 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:05.740 19:15:22 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:05.740 19:15:22 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:05.740 19:15:22 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:05.740 19:15:22 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:05.740 19:15:22 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:05.740 19:15:22 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:05.740 19:15:22 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:05.740 19:15:22 -- host/fio.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:29:05.740 19:15:22 -- host/fio.sh@14 -- # nvmftestinit 00:29:05.740 19:15:22 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:05.740 19:15:22 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:05.740 19:15:22 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:05.740 19:15:22 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:05.740 19:15:22 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:05.740 19:15:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:05.740 19:15:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:05.740 19:15:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:05.740 19:15:22 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:05.740 19:15:22 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:05.740 19:15:22 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:05.740 19:15:22 -- common/autotest_common.sh@10 -- # set +x 00:29:11.061 19:15:27 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:11.061 19:15:27 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:11.061 19:15:27 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:11.061 19:15:27 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:11.061 19:15:27 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:11.061 19:15:27 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:11.061 19:15:27 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:11.061 19:15:27 -- nvmf/common.sh@294 -- # net_devs=() 00:29:11.061 19:15:27 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:11.061 19:15:27 -- nvmf/common.sh@295 -- # e810=() 00:29:11.061 19:15:27 -- nvmf/common.sh@295 -- # local -ga e810 00:29:11.061 19:15:27 -- nvmf/common.sh@296 -- # x722=() 00:29:11.061 19:15:27 -- nvmf/common.sh@296 -- # local -ga x722 00:29:11.061 19:15:27 -- nvmf/common.sh@297 -- # mlx=() 00:29:11.061 19:15:27 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:11.061 19:15:27 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:11.061 19:15:27 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:11.061 19:15:27 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:11.061 19:15:27 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:11.061 19:15:27 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:11.061 19:15:27 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:11.061 19:15:27 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:11.061 19:15:27 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:11.061 19:15:27 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:11.061 19:15:27 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:11.061 19:15:27 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:11.061 19:15:27 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:11.061 19:15:27 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:11.061 19:15:27 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:11.061 19:15:27 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:11.061 19:15:27 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:11.061 19:15:27 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:11.061 19:15:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:11.061 19:15:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:29:11.061 Found 0000:86:00.0 (0x8086 - 0x159b) 00:29:11.061 19:15:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:11.061 19:15:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:11.061 19:15:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:11.061 19:15:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:11.061 19:15:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:11.061 19:15:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:11.061 19:15:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:29:11.061 Found 0000:86:00.1 (0x8086 - 0x159b) 00:29:11.061 19:15:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:11.061 19:15:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:11.061 19:15:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:11.061 19:15:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:11.061 19:15:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:11.061 19:15:27 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:11.061 19:15:27 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:11.061 19:15:27 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:11.061 19:15:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:11.061 19:15:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:11.061 19:15:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:11.061 19:15:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:11.061 19:15:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:29:11.061 Found net devices under 0000:86:00.0: cvl_0_0 00:29:11.061 19:15:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:11.061 19:15:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:11.061 19:15:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:11.061 19:15:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:11.061 19:15:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:11.061 19:15:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:29:11.061 Found net devices under 0000:86:00.1: cvl_0_1 00:29:11.061 19:15:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:11.061 19:15:27 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:11.061 19:15:27 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:11.061 19:15:27 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:11.061 19:15:27 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:11.061 19:15:27 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:11.061 19:15:27 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:11.061 19:15:27 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:11.061 19:15:27 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:11.061 19:15:27 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:11.061 19:15:27 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:11.061 19:15:27 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:11.061 19:15:27 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:11.061 19:15:27 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:11.061 19:15:27 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:11.061 19:15:27 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:11.061 19:15:27 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:11.061 19:15:27 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:11.061 19:15:27 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:11.061 19:15:27 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:11.061 19:15:27 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:11.061 19:15:27 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:11.061 19:15:27 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:11.061 19:15:27 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:11.061 19:15:27 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:11.061 19:15:27 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:11.061 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:11.061 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.331 ms 00:29:11.061 00:29:11.061 --- 10.0.0.2 ping statistics --- 00:29:11.061 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:11.061 rtt min/avg/max/mdev = 0.331/0.331/0.331/0.000 ms 00:29:11.061 19:15:27 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:11.061 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:11.061 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.198 ms 00:29:11.061 00:29:11.061 --- 10.0.0.1 ping statistics --- 00:29:11.061 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:11.061 rtt min/avg/max/mdev = 0.198/0.198/0.198/0.000 ms 00:29:11.061 19:15:27 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:11.061 19:15:27 -- nvmf/common.sh@410 -- # return 0 00:29:11.061 19:15:27 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:29:11.061 19:15:27 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:11.061 19:15:27 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:11.061 19:15:27 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:11.061 19:15:27 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:11.061 19:15:27 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:11.061 19:15:27 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:11.061 19:15:27 -- host/fio.sh@16 -- # [[ y != y ]] 00:29:11.061 19:15:27 -- host/fio.sh@21 -- # timing_enter start_nvmf_tgt 00:29:11.061 19:15:27 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:11.061 19:15:27 -- common/autotest_common.sh@10 -- # set +x 00:29:11.061 19:15:27 -- host/fio.sh@23 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:29:11.061 19:15:27 -- host/fio.sh@24 -- # nvmfpid=3255415 00:29:11.061 19:15:27 -- host/fio.sh@26 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:29:11.061 19:15:27 -- host/fio.sh@28 -- # waitforlisten 3255415 00:29:11.061 19:15:27 -- common/autotest_common.sh@829 -- # '[' -z 3255415 ']' 00:29:11.061 19:15:27 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:11.061 19:15:27 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:11.061 19:15:27 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:11.061 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:11.061 19:15:27 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:11.061 19:15:27 -- common/autotest_common.sh@10 -- # set +x 00:29:11.061 [2024-11-26 19:15:27.818329] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:11.061 [2024-11-26 19:15:27.818372] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:11.061 EAL: No free 2048 kB hugepages reported on node 1 00:29:11.061 [2024-11-26 19:15:27.873572] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:29:11.061 [2024-11-26 19:15:27.914047] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:11.061 [2024-11-26 19:15:27.914160] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:11.061 [2024-11-26 19:15:27.914168] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:11.061 [2024-11-26 19:15:27.914175] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:11.061 [2024-11-26 19:15:27.914220] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:11.061 [2024-11-26 19:15:27.914315] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:29:11.061 [2024-11-26 19:15:27.917964] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:29:11.061 [2024-11-26 19:15:27.917967] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:11.999 19:15:28 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:11.999 19:15:28 -- common/autotest_common.sh@862 -- # return 0 00:29:11.999 19:15:28 -- host/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:29:11.999 [2024-11-26 19:15:28.846987] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:11.999 19:15:28 -- host/fio.sh@30 -- # timing_exit start_nvmf_tgt 00:29:11.999 19:15:28 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:11.999 19:15:28 -- common/autotest_common.sh@10 -- # set +x 00:29:11.999 19:15:28 -- host/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:29:12.258 Malloc1 00:29:12.258 19:15:29 -- host/fio.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:29:12.516 19:15:29 -- host/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:29:12.775 19:15:29 -- host/fio.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:29:12.775 [2024-11-26 19:15:29.641047] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:12.775 19:15:29 -- host/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:29:13.034 19:15:29 -- host/fio.sh@38 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:29:13.034 19:15:29 -- host/fio.sh@41 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:29:13.034 19:15:29 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:29:13.034 19:15:29 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:29:13.034 19:15:29 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:13.034 19:15:29 -- common/autotest_common.sh@1328 -- # local sanitizers 00:29:13.034 19:15:29 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:29:13.034 19:15:29 -- common/autotest_common.sh@1330 -- # shift 00:29:13.034 19:15:29 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:29:13.034 19:15:29 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:13.034 19:15:29 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:29:13.034 19:15:29 -- common/autotest_common.sh@1334 -- # grep libasan 00:29:13.034 19:15:29 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:13.034 19:15:29 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:13.034 19:15:29 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:13.034 19:15:29 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:13.034 19:15:29 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:29:13.034 19:15:29 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:29:13.034 19:15:29 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:13.034 19:15:29 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:13.034 19:15:29 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:13.034 19:15:29 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:29:13.034 19:15:29 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:29:13.293 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:29:13.293 fio-3.35 00:29:13.293 Starting 1 thread 00:29:13.552 EAL: No free 2048 kB hugepages reported on node 1 00:29:16.088 00:29:16.088 test: (groupid=0, jobs=1): err= 0: pid=3256057: Tue Nov 26 19:15:32 2024 00:29:16.088 read: IOPS=12.5k, BW=48.7MiB/s (51.1MB/s)(97.7MiB/2005msec) 00:29:16.088 slat (nsec): min=1569, max=252559, avg=1725.42, stdev=2182.45 00:29:16.088 clat (usec): min=3105, max=9637, avg=5678.73, stdev=424.66 00:29:16.088 lat (usec): min=3133, max=9639, avg=5680.45, stdev=424.65 00:29:16.088 clat percentiles (usec): 00:29:16.088 | 1.00th=[ 4621], 5.00th=[ 5014], 10.00th=[ 5145], 20.00th=[ 5342], 00:29:16.088 | 30.00th=[ 5473], 40.00th=[ 5604], 50.00th=[ 5669], 60.00th=[ 5800], 00:29:16.088 | 70.00th=[ 5866], 80.00th=[ 5997], 90.00th=[ 6194], 95.00th=[ 6325], 00:29:16.088 | 99.00th=[ 6587], 99.50th=[ 6718], 99.90th=[ 8160], 99.95th=[ 8586], 00:29:16.088 | 99.99th=[ 9634] 00:29:16.088 bw ( KiB/s): min=49120, max=50392, per=99.98%, avg=49902.00, stdev=552.54, samples=4 00:29:16.088 iops : min=12280, max=12598, avg=12475.50, stdev=138.13, samples=4 00:29:16.088 write: IOPS=12.5k, BW=48.7MiB/s (51.1MB/s)(97.7MiB/2005msec); 0 zone resets 00:29:16.088 slat (nsec): min=1601, max=222610, avg=1789.95, stdev=1583.21 00:29:16.088 clat (usec): min=2422, max=8778, avg=4554.19, stdev=365.77 00:29:16.088 lat (usec): min=2437, max=8780, avg=4555.98, stdev=365.84 00:29:16.088 clat percentiles (usec): 00:29:16.088 | 1.00th=[ 3720], 5.00th=[ 4015], 10.00th=[ 4146], 20.00th=[ 4293], 00:29:16.088 | 30.00th=[ 4359], 40.00th=[ 4490], 50.00th=[ 4555], 60.00th=[ 4621], 00:29:16.088 | 70.00th=[ 4686], 80.00th=[ 4817], 90.00th=[ 4948], 95.00th=[ 5080], 00:29:16.088 | 99.00th=[ 5342], 99.50th=[ 5604], 99.90th=[ 7439], 99.95th=[ 8094], 00:29:16.088 | 99.99th=[ 8717] 00:29:16.088 bw ( KiB/s): min=49728, max=50168, per=100.00%, avg=49878.00, stdev=205.56, samples=4 00:29:16.088 iops : min=12432, max=12542, avg=12469.50, stdev=51.39, samples=4 00:29:16.088 lat (msec) : 4=2.57%, 10=97.43% 00:29:16.088 cpu : usr=71.66%, sys=26.95%, ctx=91, majf=0, minf=5 00:29:16.088 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.9% 00:29:16.088 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:16.088 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:29:16.088 issued rwts: total=25018,24999,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:16.088 latency : target=0, window=0, percentile=100.00%, depth=128 00:29:16.088 00:29:16.088 Run status group 0 (all jobs): 00:29:16.088 READ: bw=48.7MiB/s (51.1MB/s), 48.7MiB/s-48.7MiB/s (51.1MB/s-51.1MB/s), io=97.7MiB (102MB), run=2005-2005msec 00:29:16.088 WRITE: bw=48.7MiB/s (51.1MB/s), 48.7MiB/s-48.7MiB/s (51.1MB/s-51.1MB/s), io=97.7MiB (102MB), run=2005-2005msec 00:29:16.088 19:15:32 -- host/fio.sh@45 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:29:16.088 19:15:32 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:29:16.088 19:15:32 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:29:16.088 19:15:32 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:16.088 19:15:32 -- common/autotest_common.sh@1328 -- # local sanitizers 00:29:16.088 19:15:32 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:29:16.088 19:15:32 -- common/autotest_common.sh@1330 -- # shift 00:29:16.088 19:15:32 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:29:16.088 19:15:32 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:16.088 19:15:32 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:29:16.088 19:15:32 -- common/autotest_common.sh@1334 -- # grep libasan 00:29:16.088 19:15:32 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:16.088 19:15:32 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:16.088 19:15:32 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:16.088 19:15:32 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:16.088 19:15:32 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:29:16.088 19:15:32 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:29:16.088 19:15:32 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:16.088 19:15:32 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:16.088 19:15:32 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:16.088 19:15:32 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:29:16.088 19:15:32 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:29:16.088 test: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=spdk, iodepth=128 00:29:16.088 fio-3.35 00:29:16.088 Starting 1 thread 00:29:16.088 EAL: No free 2048 kB hugepages reported on node 1 00:29:18.620 00:29:18.620 test: (groupid=0, jobs=1): err= 0: pid=3256631: Tue Nov 26 19:15:35 2024 00:29:18.620 read: IOPS=11.4k, BW=177MiB/s (186MB/s)(356MiB/2005msec) 00:29:18.620 slat (nsec): min=2523, max=82820, avg=2844.28, stdev=1383.49 00:29:18.620 clat (usec): min=1348, max=12586, avg=6545.23, stdev=1523.48 00:29:18.620 lat (usec): min=1351, max=12604, avg=6548.07, stdev=1523.65 00:29:18.620 clat percentiles (usec): 00:29:18.620 | 1.00th=[ 3523], 5.00th=[ 4178], 10.00th=[ 4621], 20.00th=[ 5145], 00:29:18.620 | 30.00th=[ 5604], 40.00th=[ 6063], 50.00th=[ 6521], 60.00th=[ 7046], 00:29:18.620 | 70.00th=[ 7439], 80.00th=[ 7767], 90.00th=[ 8356], 95.00th=[ 8979], 00:29:18.620 | 99.00th=[10552], 99.50th=[11076], 99.90th=[11863], 99.95th=[12125], 00:29:18.620 | 99.99th=[12518] 00:29:18.620 bw ( KiB/s): min=86048, max=95872, per=50.38%, avg=91536.00, stdev=4421.14, samples=4 00:29:18.620 iops : min= 5378, max= 5992, avg=5721.00, stdev=276.32, samples=4 00:29:18.620 write: IOPS=6743, BW=105MiB/s (110MB/s)(187MiB/1774msec); 0 zone resets 00:29:18.620 slat (usec): min=29, max=374, avg=31.86, stdev= 7.11 00:29:18.620 clat (usec): min=2169, max=14348, avg=8162.21, stdev=1461.42 00:29:18.620 lat (usec): min=2201, max=14476, avg=8194.07, stdev=1462.94 00:29:18.620 clat percentiles (usec): 00:29:18.620 | 1.00th=[ 5473], 5.00th=[ 6128], 10.00th=[ 6521], 20.00th=[ 6980], 00:29:18.620 | 30.00th=[ 7308], 40.00th=[ 7635], 50.00th=[ 7963], 60.00th=[ 8291], 00:29:18.620 | 70.00th=[ 8717], 80.00th=[ 9372], 90.00th=[10290], 95.00th=[10945], 00:29:18.621 | 99.00th=[11994], 99.50th=[12649], 99.90th=[13698], 99.95th=[13960], 00:29:18.621 | 99.99th=[14222] 00:29:18.621 bw ( KiB/s): min=90496, max=99712, per=88.32%, avg=95296.00, stdev=4414.92, samples=4 00:29:18.621 iops : min= 5656, max= 6232, avg=5956.00, stdev=275.93, samples=4 00:29:18.621 lat (msec) : 2=0.07%, 4=2.32%, 10=92.05%, 20=5.57% 00:29:18.621 cpu : usr=86.18%, sys=13.12%, ctx=32, majf=0, minf=1 00:29:18.621 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.7% 00:29:18.621 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.621 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:29:18.621 issued rwts: total=22770,11963,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:18.621 latency : target=0, window=0, percentile=100.00%, depth=128 00:29:18.621 00:29:18.621 Run status group 0 (all jobs): 00:29:18.621 READ: bw=177MiB/s (186MB/s), 177MiB/s-177MiB/s (186MB/s-186MB/s), io=356MiB (373MB), run=2005-2005msec 00:29:18.621 WRITE: bw=105MiB/s (110MB/s), 105MiB/s-105MiB/s (110MB/s-110MB/s), io=187MiB (196MB), run=1774-1774msec 00:29:18.621 19:15:35 -- host/fio.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:29:18.621 19:15:35 -- host/fio.sh@49 -- # '[' 1 -eq 1 ']' 00:29:18.621 19:15:35 -- host/fio.sh@51 -- # bdfs=($(get_nvme_bdfs)) 00:29:18.621 19:15:35 -- host/fio.sh@51 -- # get_nvme_bdfs 00:29:18.621 19:15:35 -- common/autotest_common.sh@1508 -- # bdfs=() 00:29:18.621 19:15:35 -- common/autotest_common.sh@1508 -- # local bdfs 00:29:18.621 19:15:35 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:29:18.621 19:15:35 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:29:18.621 19:15:35 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:29:18.879 19:15:35 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:29:18.879 19:15:35 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:5e:00.0 00:29:18.879 19:15:35 -- host/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:5e:00.0 -i 10.0.0.2 00:29:22.165 Nvme0n1 00:29:22.165 19:15:38 -- host/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore -c 1073741824 Nvme0n1 lvs_0 00:29:24.696 19:15:41 -- host/fio.sh@53 -- # ls_guid=e3976bc0-cf15-46f9-9098-d108417ac7c8 00:29:24.696 19:15:41 -- host/fio.sh@54 -- # get_lvs_free_mb e3976bc0-cf15-46f9-9098-d108417ac7c8 00:29:24.696 19:15:41 -- common/autotest_common.sh@1353 -- # local lvs_uuid=e3976bc0-cf15-46f9-9098-d108417ac7c8 00:29:24.696 19:15:41 -- common/autotest_common.sh@1354 -- # local lvs_info 00:29:24.696 19:15:41 -- common/autotest_common.sh@1355 -- # local fc 00:29:24.696 19:15:41 -- common/autotest_common.sh@1356 -- # local cs 00:29:24.696 19:15:41 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:29:24.696 19:15:41 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:29:24.696 { 00:29:24.696 "uuid": "e3976bc0-cf15-46f9-9098-d108417ac7c8", 00:29:24.696 "name": "lvs_0", 00:29:24.696 "base_bdev": "Nvme0n1", 00:29:24.696 "total_data_clusters": 930, 00:29:24.696 "free_clusters": 930, 00:29:24.696 "block_size": 512, 00:29:24.696 "cluster_size": 1073741824 00:29:24.696 } 00:29:24.696 ]' 00:29:24.696 19:15:41 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="e3976bc0-cf15-46f9-9098-d108417ac7c8") .free_clusters' 00:29:24.954 19:15:41 -- common/autotest_common.sh@1358 -- # fc=930 00:29:24.954 19:15:41 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="e3976bc0-cf15-46f9-9098-d108417ac7c8") .cluster_size' 00:29:24.954 19:15:41 -- common/autotest_common.sh@1359 -- # cs=1073741824 00:29:24.954 19:15:41 -- common/autotest_common.sh@1362 -- # free_mb=952320 00:29:24.954 19:15:41 -- common/autotest_common.sh@1363 -- # echo 952320 00:29:24.954 952320 00:29:24.954 19:15:41 -- host/fio.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_0 lbd_0 952320 00:29:25.212 0d3a0c22-9602-42cd-9560-ad0efb2267e8 00:29:25.212 19:15:42 -- host/fio.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000001 00:29:25.470 19:15:42 -- host/fio.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 lvs_0/lbd_0 00:29:25.728 19:15:42 -- host/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:29:25.728 19:15:42 -- host/fio.sh@59 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:29:25.728 19:15:42 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:29:25.728 19:15:42 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:29:25.728 19:15:42 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:25.728 19:15:42 -- common/autotest_common.sh@1328 -- # local sanitizers 00:29:25.728 19:15:42 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:29:25.728 19:15:42 -- common/autotest_common.sh@1330 -- # shift 00:29:25.728 19:15:42 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:29:25.728 19:15:42 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:25.728 19:15:42 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:29:25.728 19:15:42 -- common/autotest_common.sh@1334 -- # grep libasan 00:29:25.728 19:15:42 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:25.728 19:15:42 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:25.728 19:15:42 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:25.728 19:15:42 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:25.728 19:15:42 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:29:25.728 19:15:42 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:29:25.728 19:15:42 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:25.985 19:15:42 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:25.985 19:15:42 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:25.985 19:15:42 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:29:25.985 19:15:42 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:29:26.242 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:29:26.242 fio-3.35 00:29:26.242 Starting 1 thread 00:29:26.242 EAL: No free 2048 kB hugepages reported on node 1 00:29:28.773 [2024-11-26 19:15:45.163674] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ecb3e0 is same with the state(5) to be set 00:29:28.773 00:29:28.773 test: (groupid=0, jobs=1): err= 0: pid=3258413: Tue Nov 26 19:15:45 2024 00:29:28.773 read: IOPS=8421, BW=32.9MiB/s (34.5MB/s)(66.0MiB/2006msec) 00:29:28.773 slat (nsec): min=1572, max=88493, avg=1654.80, stdev=949.14 00:29:28.773 clat (usec): min=631, max=169464, avg=8390.75, stdev=10041.56 00:29:28.773 lat (usec): min=632, max=169478, avg=8392.41, stdev=10041.71 00:29:28.773 clat percentiles (msec): 00:29:28.773 | 1.00th=[ 7], 5.00th=[ 7], 10.00th=[ 7], 20.00th=[ 8], 00:29:28.773 | 30.00th=[ 8], 40.00th=[ 8], 50.00th=[ 8], 60.00th=[ 8], 00:29:28.773 | 70.00th=[ 9], 80.00th=[ 9], 90.00th=[ 9], 95.00th=[ 9], 00:29:28.773 | 99.00th=[ 10], 99.50th=[ 11], 99.90th=[ 169], 99.95th=[ 169], 00:29:28.773 | 99.99th=[ 169] 00:29:28.773 bw ( KiB/s): min=23928, max=37104, per=99.90%, avg=33652.00, stdev=6487.85, samples=4 00:29:28.773 iops : min= 5982, max= 9276, avg=8413.00, stdev=1621.96, samples=4 00:29:28.773 write: IOPS=8419, BW=32.9MiB/s (34.5MB/s)(66.0MiB/2006msec); 0 zone resets 00:29:28.773 slat (nsec): min=1598, max=91626, avg=1725.82, stdev=740.30 00:29:28.773 clat (usec): min=271, max=168328, avg=6717.45, stdev=9393.59 00:29:28.773 lat (usec): min=273, max=168333, avg=6719.18, stdev=9393.76 00:29:28.773 clat percentiles (msec): 00:29:28.773 | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 6], 00:29:28.773 | 30.00th=[ 6], 40.00th=[ 7], 50.00th=[ 7], 60.00th=[ 7], 00:29:28.773 | 70.00th=[ 7], 80.00th=[ 7], 90.00th=[ 7], 95.00th=[ 8], 00:29:28.773 | 99.00th=[ 8], 99.50th=[ 9], 99.90th=[ 169], 99.95th=[ 169], 00:29:28.773 | 99.99th=[ 169] 00:29:28.773 bw ( KiB/s): min=24984, max=36800, per=99.94%, avg=33658.00, stdev=5785.39, samples=4 00:29:28.773 iops : min= 6246, max= 9200, avg=8414.50, stdev=1446.35, samples=4 00:29:28.773 lat (usec) : 500=0.01%, 750=0.01%, 1000=0.01% 00:29:28.773 lat (msec) : 2=0.05%, 4=0.24%, 10=99.20%, 20=0.10%, 250=0.38% 00:29:28.773 cpu : usr=72.42%, sys=26.58%, ctx=101, majf=0, minf=5 00:29:28.773 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:29:28.773 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.773 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:29:28.773 issued rwts: total=16893,16889,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:28.773 latency : target=0, window=0, percentile=100.00%, depth=128 00:29:28.774 00:29:28.774 Run status group 0 (all jobs): 00:29:28.774 READ: bw=32.9MiB/s (34.5MB/s), 32.9MiB/s-32.9MiB/s (34.5MB/s-34.5MB/s), io=66.0MiB (69.2MB), run=2006-2006msec 00:29:28.774 WRITE: bw=32.9MiB/s (34.5MB/s), 32.9MiB/s-32.9MiB/s (34.5MB/s-34.5MB/s), io=66.0MiB (69.2MB), run=2006-2006msec 00:29:28.774 19:15:45 -- host/fio.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:29:28.774 19:15:45 -- host/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --clear-method none lvs_0/lbd_0 lvs_n_0 00:29:29.707 19:15:46 -- host/fio.sh@64 -- # ls_nested_guid=6d254a68-6c04-4eae-acc2-417029fad32f 00:29:29.707 19:15:46 -- host/fio.sh@65 -- # get_lvs_free_mb 6d254a68-6c04-4eae-acc2-417029fad32f 00:29:29.707 19:15:46 -- common/autotest_common.sh@1353 -- # local lvs_uuid=6d254a68-6c04-4eae-acc2-417029fad32f 00:29:29.707 19:15:46 -- common/autotest_common.sh@1354 -- # local lvs_info 00:29:29.707 19:15:46 -- common/autotest_common.sh@1355 -- # local fc 00:29:29.707 19:15:46 -- common/autotest_common.sh@1356 -- # local cs 00:29:29.707 19:15:46 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:29:29.964 19:15:46 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:29:29.965 { 00:29:29.965 "uuid": "e3976bc0-cf15-46f9-9098-d108417ac7c8", 00:29:29.965 "name": "lvs_0", 00:29:29.965 "base_bdev": "Nvme0n1", 00:29:29.965 "total_data_clusters": 930, 00:29:29.965 "free_clusters": 0, 00:29:29.965 "block_size": 512, 00:29:29.965 "cluster_size": 1073741824 00:29:29.965 }, 00:29:29.965 { 00:29:29.965 "uuid": "6d254a68-6c04-4eae-acc2-417029fad32f", 00:29:29.965 "name": "lvs_n_0", 00:29:29.965 "base_bdev": "0d3a0c22-9602-42cd-9560-ad0efb2267e8", 00:29:29.965 "total_data_clusters": 237847, 00:29:29.965 "free_clusters": 237847, 00:29:29.965 "block_size": 512, 00:29:29.965 "cluster_size": 4194304 00:29:29.965 } 00:29:29.965 ]' 00:29:29.965 19:15:46 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="6d254a68-6c04-4eae-acc2-417029fad32f") .free_clusters' 00:29:29.965 19:15:46 -- common/autotest_common.sh@1358 -- # fc=237847 00:29:29.965 19:15:46 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="6d254a68-6c04-4eae-acc2-417029fad32f") .cluster_size' 00:29:29.965 19:15:46 -- common/autotest_common.sh@1359 -- # cs=4194304 00:29:29.965 19:15:46 -- common/autotest_common.sh@1362 -- # free_mb=951388 00:29:29.965 19:15:46 -- common/autotest_common.sh@1363 -- # echo 951388 00:29:29.965 951388 00:29:29.965 19:15:46 -- host/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_n_0 lbd_nest_0 951388 00:29:30.530 81170e8d-df90-49a6-982e-1567b6afd14f 00:29:30.530 19:15:47 -- host/fio.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000001 00:29:30.530 19:15:47 -- host/fio.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 lvs_n_0/lbd_nest_0 00:29:30.787 19:15:47 -- host/fio.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:29:31.045 19:15:47 -- host/fio.sh@70 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:29:31.045 19:15:47 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:29:31.045 19:15:47 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:29:31.045 19:15:47 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:31.045 19:15:47 -- common/autotest_common.sh@1328 -- # local sanitizers 00:29:31.045 19:15:47 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:29:31.045 19:15:47 -- common/autotest_common.sh@1330 -- # shift 00:29:31.045 19:15:47 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:29:31.045 19:15:47 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:31.045 19:15:47 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:29:31.045 19:15:47 -- common/autotest_common.sh@1334 -- # grep libasan 00:29:31.045 19:15:47 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:31.045 19:15:47 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:31.045 19:15:47 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:31.045 19:15:47 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:31.045 19:15:47 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:29:31.045 19:15:47 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:29:31.045 19:15:47 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:31.045 19:15:47 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:31.045 19:15:47 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:31.045 19:15:47 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:29:31.045 19:15:47 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:29:31.303 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:29:31.303 fio-3.35 00:29:31.303 Starting 1 thread 00:29:31.303 EAL: No free 2048 kB hugepages reported on node 1 00:29:33.834 00:29:33.834 test: (groupid=0, jobs=1): err= 0: pid=3259262: Tue Nov 26 19:15:50 2024 00:29:33.834 read: IOPS=8095, BW=31.6MiB/s (33.2MB/s)(63.5MiB/2007msec) 00:29:33.834 slat (nsec): min=1539, max=95586, avg=1663.73, stdev=1057.09 00:29:33.834 clat (usec): min=2990, max=14297, avg=8726.69, stdev=735.60 00:29:33.834 lat (usec): min=2993, max=14299, avg=8728.35, stdev=735.55 00:29:33.834 clat percentiles (usec): 00:29:33.834 | 1.00th=[ 7046], 5.00th=[ 7570], 10.00th=[ 7832], 20.00th=[ 8160], 00:29:33.834 | 30.00th=[ 8356], 40.00th=[ 8586], 50.00th=[ 8717], 60.00th=[ 8848], 00:29:33.834 | 70.00th=[ 9110], 80.00th=[ 9241], 90.00th=[ 9634], 95.00th=[ 9896], 00:29:33.834 | 99.00th=[10552], 99.50th=[10814], 99.90th=[11731], 99.95th=[12518], 00:29:33.834 | 99.99th=[14222] 00:29:33.834 bw ( KiB/s): min=31320, max=32904, per=100.00%, avg=32386.00, stdev=746.97, samples=4 00:29:33.834 iops : min= 7830, max= 8226, avg=8096.50, stdev=186.74, samples=4 00:29:33.834 write: IOPS=8093, BW=31.6MiB/s (33.1MB/s)(63.4MiB/2007msec); 0 zone resets 00:29:33.834 slat (nsec): min=1620, max=82514, avg=1737.67, stdev=702.73 00:29:33.834 clat (usec): min=1449, max=14284, avg=6991.12, stdev=669.80 00:29:33.834 lat (usec): min=1454, max=14286, avg=6992.86, stdev=669.79 00:29:33.834 clat percentiles (usec): 00:29:33.834 | 1.00th=[ 5538], 5.00th=[ 5997], 10.00th=[ 6259], 20.00th=[ 6456], 00:29:33.834 | 30.00th=[ 6652], 40.00th=[ 6849], 50.00th=[ 6980], 60.00th=[ 7111], 00:29:33.834 | 70.00th=[ 7308], 80.00th=[ 7504], 90.00th=[ 7701], 95.00th=[ 7963], 00:29:33.834 | 99.00th=[ 8586], 99.50th=[ 9110], 99.90th=[12518], 99.95th=[13304], 00:29:33.834 | 99.99th=[13435] 00:29:33.834 bw ( KiB/s): min=32136, max=32528, per=99.91%, avg=32342.00, stdev=165.17, samples=4 00:29:33.834 iops : min= 8034, max= 8132, avg=8085.50, stdev=41.29, samples=4 00:29:33.834 lat (msec) : 2=0.01%, 4=0.11%, 10=98.13%, 20=1.75% 00:29:33.834 cpu : usr=71.64%, sys=27.62%, ctx=80, majf=0, minf=5 00:29:33.834 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:29:33.834 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:33.834 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:29:33.834 issued rwts: total=16248,16243,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:33.834 latency : target=0, window=0, percentile=100.00%, depth=128 00:29:33.834 00:29:33.834 Run status group 0 (all jobs): 00:29:33.834 READ: bw=31.6MiB/s (33.2MB/s), 31.6MiB/s-31.6MiB/s (33.2MB/s-33.2MB/s), io=63.5MiB (66.6MB), run=2007-2007msec 00:29:33.834 WRITE: bw=31.6MiB/s (33.1MB/s), 31.6MiB/s-31.6MiB/s (33.1MB/s-33.1MB/s), io=63.4MiB (66.5MB), run=2007-2007msec 00:29:33.834 19:15:50 -- host/fio.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:29:33.834 19:15:50 -- host/fio.sh@74 -- # sync 00:29:33.834 19:15:50 -- host/fio.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -t 120 bdev_lvol_delete lvs_n_0/lbd_nest_0 00:29:38.023 19:15:54 -- host/fio.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:29:38.023 19:15:54 -- host/fio.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete lvs_0/lbd_0 00:29:40.555 19:15:57 -- host/fio.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:29:40.813 19:15:57 -- host/fio.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_detach_controller Nvme0 00:29:42.785 19:15:59 -- host/fio.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:29:42.785 19:15:59 -- host/fio.sh@85 -- # rm -f ./local-test-0-verify.state 00:29:42.785 19:15:59 -- host/fio.sh@86 -- # nvmftestfini 00:29:42.785 19:15:59 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:42.785 19:15:59 -- nvmf/common.sh@116 -- # sync 00:29:42.785 19:15:59 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:42.785 19:15:59 -- nvmf/common.sh@119 -- # set +e 00:29:42.785 19:15:59 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:42.785 19:15:59 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:42.785 rmmod nvme_tcp 00:29:42.785 rmmod nvme_fabrics 00:29:42.785 rmmod nvme_keyring 00:29:42.785 19:15:59 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:42.785 19:15:59 -- nvmf/common.sh@123 -- # set -e 00:29:42.785 19:15:59 -- nvmf/common.sh@124 -- # return 0 00:29:42.785 19:15:59 -- nvmf/common.sh@477 -- # '[' -n 3255415 ']' 00:29:42.785 19:15:59 -- nvmf/common.sh@478 -- # killprocess 3255415 00:29:42.785 19:15:59 -- common/autotest_common.sh@936 -- # '[' -z 3255415 ']' 00:29:42.785 19:15:59 -- common/autotest_common.sh@940 -- # kill -0 3255415 00:29:42.785 19:15:59 -- common/autotest_common.sh@941 -- # uname 00:29:42.785 19:15:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:42.785 19:15:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3255415 00:29:42.785 19:15:59 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:42.785 19:15:59 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:42.785 19:15:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3255415' 00:29:42.785 killing process with pid 3255415 00:29:42.785 19:15:59 -- common/autotest_common.sh@955 -- # kill 3255415 00:29:42.785 19:15:59 -- common/autotest_common.sh@960 -- # wait 3255415 00:29:42.785 19:15:59 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:29:42.785 19:15:59 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:42.785 19:15:59 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:42.785 19:15:59 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:42.786 19:15:59 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:42.786 19:15:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:42.786 19:15:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:42.786 19:15:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:45.320 19:16:01 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:45.320 00:29:45.320 real 0m39.519s 00:29:45.320 user 2m38.641s 00:29:45.320 sys 0m8.471s 00:29:45.320 19:16:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:45.320 19:16:01 -- common/autotest_common.sh@10 -- # set +x 00:29:45.320 ************************************ 00:29:45.320 END TEST nvmf_fio_host 00:29:45.320 ************************************ 00:29:45.320 19:16:01 -- nvmf/nvmf.sh@100 -- # run_test nvmf_failover /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:29:45.320 19:16:01 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:29:45.320 19:16:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:45.320 19:16:01 -- common/autotest_common.sh@10 -- # set +x 00:29:45.320 ************************************ 00:29:45.320 START TEST nvmf_failover 00:29:45.320 ************************************ 00:29:45.320 19:16:01 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:29:45.320 * Looking for test storage... 00:29:45.320 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:29:45.320 19:16:01 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:29:45.320 19:16:01 -- common/autotest_common.sh@1690 -- # lcov --version 00:29:45.320 19:16:01 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:29:45.320 19:16:01 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:29:45.320 19:16:01 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:29:45.320 19:16:01 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:29:45.320 19:16:01 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:29:45.320 19:16:01 -- scripts/common.sh@335 -- # IFS=.-: 00:29:45.320 19:16:01 -- scripts/common.sh@335 -- # read -ra ver1 00:29:45.320 19:16:01 -- scripts/common.sh@336 -- # IFS=.-: 00:29:45.320 19:16:01 -- scripts/common.sh@336 -- # read -ra ver2 00:29:45.320 19:16:01 -- scripts/common.sh@337 -- # local 'op=<' 00:29:45.320 19:16:01 -- scripts/common.sh@339 -- # ver1_l=2 00:29:45.320 19:16:01 -- scripts/common.sh@340 -- # ver2_l=1 00:29:45.320 19:16:01 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:29:45.320 19:16:01 -- scripts/common.sh@343 -- # case "$op" in 00:29:45.320 19:16:01 -- scripts/common.sh@344 -- # : 1 00:29:45.320 19:16:01 -- scripts/common.sh@363 -- # (( v = 0 )) 00:29:45.320 19:16:01 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:29:45.320 19:16:01 -- scripts/common.sh@364 -- # decimal 1 00:29:45.320 19:16:01 -- scripts/common.sh@352 -- # local d=1 00:29:45.320 19:16:01 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:29:45.320 19:16:01 -- scripts/common.sh@354 -- # echo 1 00:29:45.320 19:16:01 -- scripts/common.sh@364 -- # ver1[v]=1 00:29:45.320 19:16:01 -- scripts/common.sh@365 -- # decimal 2 00:29:45.320 19:16:01 -- scripts/common.sh@352 -- # local d=2 00:29:45.320 19:16:01 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:29:45.320 19:16:01 -- scripts/common.sh@354 -- # echo 2 00:29:45.320 19:16:01 -- scripts/common.sh@365 -- # ver2[v]=2 00:29:45.320 19:16:01 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:29:45.320 19:16:01 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:29:45.320 19:16:01 -- scripts/common.sh@367 -- # return 0 00:29:45.320 19:16:01 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:29:45.320 19:16:01 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:29:45.320 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:45.320 --rc genhtml_branch_coverage=1 00:29:45.320 --rc genhtml_function_coverage=1 00:29:45.320 --rc genhtml_legend=1 00:29:45.320 --rc geninfo_all_blocks=1 00:29:45.320 --rc geninfo_unexecuted_blocks=1 00:29:45.320 00:29:45.320 ' 00:29:45.320 19:16:01 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:29:45.320 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:45.320 --rc genhtml_branch_coverage=1 00:29:45.320 --rc genhtml_function_coverage=1 00:29:45.320 --rc genhtml_legend=1 00:29:45.320 --rc geninfo_all_blocks=1 00:29:45.320 --rc geninfo_unexecuted_blocks=1 00:29:45.320 00:29:45.320 ' 00:29:45.320 19:16:01 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:29:45.320 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:45.320 --rc genhtml_branch_coverage=1 00:29:45.320 --rc genhtml_function_coverage=1 00:29:45.320 --rc genhtml_legend=1 00:29:45.320 --rc geninfo_all_blocks=1 00:29:45.320 --rc geninfo_unexecuted_blocks=1 00:29:45.320 00:29:45.320 ' 00:29:45.320 19:16:01 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:29:45.320 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:45.320 --rc genhtml_branch_coverage=1 00:29:45.320 --rc genhtml_function_coverage=1 00:29:45.320 --rc genhtml_legend=1 00:29:45.320 --rc geninfo_all_blocks=1 00:29:45.320 --rc geninfo_unexecuted_blocks=1 00:29:45.320 00:29:45.320 ' 00:29:45.320 19:16:01 -- host/failover.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:45.320 19:16:01 -- nvmf/common.sh@7 -- # uname -s 00:29:45.320 19:16:01 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:45.320 19:16:01 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:45.320 19:16:01 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:45.320 19:16:01 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:45.320 19:16:01 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:45.320 19:16:01 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:45.320 19:16:01 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:45.320 19:16:01 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:45.320 19:16:01 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:45.320 19:16:01 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:45.321 19:16:01 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:29:45.321 19:16:01 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:29:45.321 19:16:01 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:45.321 19:16:01 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:45.321 19:16:01 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:45.321 19:16:01 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:45.321 19:16:01 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:45.321 19:16:01 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:45.321 19:16:01 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:45.321 19:16:01 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:45.321 19:16:01 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:45.321 19:16:01 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:45.321 19:16:01 -- paths/export.sh@5 -- # export PATH 00:29:45.321 19:16:01 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:45.321 19:16:01 -- nvmf/common.sh@46 -- # : 0 00:29:45.321 19:16:01 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:45.321 19:16:01 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:45.321 19:16:01 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:45.321 19:16:01 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:45.321 19:16:01 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:45.321 19:16:01 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:45.321 19:16:01 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:45.321 19:16:01 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:45.321 19:16:01 -- host/failover.sh@11 -- # MALLOC_BDEV_SIZE=64 00:29:45.321 19:16:01 -- host/failover.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:29:45.321 19:16:01 -- host/failover.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:29:45.321 19:16:01 -- host/failover.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:29:45.321 19:16:01 -- host/failover.sh@18 -- # nvmftestinit 00:29:45.321 19:16:01 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:45.321 19:16:01 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:45.321 19:16:01 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:45.321 19:16:01 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:45.321 19:16:01 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:45.321 19:16:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:45.321 19:16:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:45.321 19:16:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:45.321 19:16:01 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:45.321 19:16:01 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:45.321 19:16:01 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:45.321 19:16:01 -- common/autotest_common.sh@10 -- # set +x 00:29:50.589 19:16:06 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:50.589 19:16:06 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:50.589 19:16:06 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:50.589 19:16:06 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:50.589 19:16:06 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:50.589 19:16:06 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:50.589 19:16:06 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:50.589 19:16:06 -- nvmf/common.sh@294 -- # net_devs=() 00:29:50.590 19:16:06 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:50.590 19:16:06 -- nvmf/common.sh@295 -- # e810=() 00:29:50.590 19:16:06 -- nvmf/common.sh@295 -- # local -ga e810 00:29:50.590 19:16:06 -- nvmf/common.sh@296 -- # x722=() 00:29:50.590 19:16:06 -- nvmf/common.sh@296 -- # local -ga x722 00:29:50.590 19:16:06 -- nvmf/common.sh@297 -- # mlx=() 00:29:50.590 19:16:06 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:50.590 19:16:06 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:50.590 19:16:06 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:50.590 19:16:06 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:50.590 19:16:06 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:50.590 19:16:06 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:50.590 19:16:06 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:50.590 19:16:06 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:50.590 19:16:06 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:50.590 19:16:06 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:50.590 19:16:06 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:50.590 19:16:06 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:50.590 19:16:06 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:50.590 19:16:06 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:50.590 19:16:06 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:50.590 19:16:06 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:50.590 19:16:06 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:50.590 19:16:06 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:50.590 19:16:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:50.590 19:16:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:29:50.590 Found 0000:86:00.0 (0x8086 - 0x159b) 00:29:50.590 19:16:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:50.590 19:16:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:50.590 19:16:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:50.590 19:16:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:50.590 19:16:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:50.590 19:16:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:50.590 19:16:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:29:50.590 Found 0000:86:00.1 (0x8086 - 0x159b) 00:29:50.590 19:16:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:50.590 19:16:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:50.590 19:16:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:50.590 19:16:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:50.590 19:16:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:50.590 19:16:06 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:50.590 19:16:06 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:50.590 19:16:06 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:50.590 19:16:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:50.590 19:16:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:50.590 19:16:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:50.590 19:16:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:50.590 19:16:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:29:50.590 Found net devices under 0000:86:00.0: cvl_0_0 00:29:50.590 19:16:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:50.590 19:16:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:50.590 19:16:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:50.590 19:16:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:50.590 19:16:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:50.590 19:16:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:29:50.590 Found net devices under 0000:86:00.1: cvl_0_1 00:29:50.590 19:16:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:50.590 19:16:06 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:50.590 19:16:06 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:50.590 19:16:06 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:50.590 19:16:06 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:50.590 19:16:06 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:50.590 19:16:06 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:50.590 19:16:06 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:50.590 19:16:06 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:50.590 19:16:06 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:50.590 19:16:06 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:50.590 19:16:06 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:50.590 19:16:06 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:50.590 19:16:06 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:50.590 19:16:06 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:50.590 19:16:06 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:50.590 19:16:06 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:50.590 19:16:06 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:50.590 19:16:06 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:50.590 19:16:06 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:50.590 19:16:06 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:50.590 19:16:06 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:50.590 19:16:06 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:50.590 19:16:07 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:50.590 19:16:07 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:50.590 19:16:07 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:50.590 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:50.590 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.340 ms 00:29:50.590 00:29:50.590 --- 10.0.0.2 ping statistics --- 00:29:50.590 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:50.590 rtt min/avg/max/mdev = 0.340/0.340/0.340/0.000 ms 00:29:50.590 19:16:07 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:50.590 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:50.590 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.205 ms 00:29:50.590 00:29:50.590 --- 10.0.0.1 ping statistics --- 00:29:50.590 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:50.590 rtt min/avg/max/mdev = 0.205/0.205/0.205/0.000 ms 00:29:50.590 19:16:07 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:50.590 19:16:07 -- nvmf/common.sh@410 -- # return 0 00:29:50.590 19:16:07 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:29:50.590 19:16:07 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:50.590 19:16:07 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:50.590 19:16:07 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:50.590 19:16:07 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:50.590 19:16:07 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:50.590 19:16:07 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:50.590 19:16:07 -- host/failover.sh@20 -- # nvmfappstart -m 0xE 00:29:50.590 19:16:07 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:50.590 19:16:07 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:50.590 19:16:07 -- common/autotest_common.sh@10 -- # set +x 00:29:50.590 19:16:07 -- nvmf/common.sh@469 -- # nvmfpid=3264753 00:29:50.590 19:16:07 -- nvmf/common.sh@470 -- # waitforlisten 3264753 00:29:50.590 19:16:07 -- common/autotest_common.sh@829 -- # '[' -z 3264753 ']' 00:29:50.590 19:16:07 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:29:50.590 19:16:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:50.590 19:16:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:50.590 19:16:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:50.590 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:50.590 19:16:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:50.590 19:16:07 -- common/autotest_common.sh@10 -- # set +x 00:29:50.590 [2024-11-26 19:16:07.148376] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:50.590 [2024-11-26 19:16:07.148421] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:50.590 EAL: No free 2048 kB hugepages reported on node 1 00:29:50.590 [2024-11-26 19:16:07.206483] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:29:50.590 [2024-11-26 19:16:07.246452] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:50.590 [2024-11-26 19:16:07.246566] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:50.590 [2024-11-26 19:16:07.246574] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:50.590 [2024-11-26 19:16:07.246582] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:50.590 [2024-11-26 19:16:07.246683] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:29:50.590 [2024-11-26 19:16:07.246781] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:29:50.590 [2024-11-26 19:16:07.246782] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:51.155 19:16:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:51.155 19:16:07 -- common/autotest_common.sh@862 -- # return 0 00:29:51.155 19:16:07 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:51.155 19:16:07 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:51.155 19:16:07 -- common/autotest_common.sh@10 -- # set +x 00:29:51.155 19:16:08 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:51.155 19:16:08 -- host/failover.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:29:51.413 [2024-11-26 19:16:08.195642] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:51.413 19:16:08 -- host/failover.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc0 00:29:51.670 Malloc0 00:29:51.670 19:16:08 -- host/failover.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:29:51.928 19:16:08 -- host/failover.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:29:51.928 19:16:08 -- host/failover.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:29:52.186 [2024-11-26 19:16:08.998180] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:52.186 19:16:09 -- host/failover.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:29:52.443 [2024-11-26 19:16:09.186739] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:29:52.443 19:16:09 -- host/failover.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:29:52.701 [2024-11-26 19:16:09.375386] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:29:52.701 19:16:09 -- host/failover.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 15 -f 00:29:52.701 19:16:09 -- host/failover.sh@31 -- # bdevperf_pid=3265129 00:29:52.701 19:16:09 -- host/failover.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:29:52.701 19:16:09 -- host/failover.sh@34 -- # waitforlisten 3265129 /var/tmp/bdevperf.sock 00:29:52.701 19:16:09 -- common/autotest_common.sh@829 -- # '[' -z 3265129 ']' 00:29:52.701 19:16:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:29:52.701 19:16:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:52.701 19:16:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:29:52.701 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:29:52.701 19:16:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:52.701 19:16:09 -- common/autotest_common.sh@10 -- # set +x 00:29:53.638 19:16:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:53.638 19:16:10 -- common/autotest_common.sh@862 -- # return 0 00:29:53.638 19:16:10 -- host/failover.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:29:53.638 NVMe0n1 00:29:53.896 19:16:10 -- host/failover.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:29:54.154 00:29:54.154 19:16:10 -- host/failover.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:29:54.154 19:16:10 -- host/failover.sh@39 -- # run_test_pid=3265364 00:29:54.154 19:16:10 -- host/failover.sh@41 -- # sleep 1 00:29:55.091 19:16:11 -- host/failover.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:29:55.350 [2024-11-26 19:16:12.034312] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.350 [2024-11-26 19:16:12.034366] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.350 [2024-11-26 19:16:12.034374] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.350 [2024-11-26 19:16:12.034381] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.350 [2024-11-26 19:16:12.034388] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.350 [2024-11-26 19:16:12.034394] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.350 [2024-11-26 19:16:12.034400] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.350 [2024-11-26 19:16:12.034406] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.350 [2024-11-26 19:16:12.034412] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.350 [2024-11-26 19:16:12.034422] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.350 [2024-11-26 19:16:12.034428] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.350 [2024-11-26 19:16:12.034434] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.350 [2024-11-26 19:16:12.034441] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.350 [2024-11-26 19:16:12.034446] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.350 [2024-11-26 19:16:12.034453] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.350 [2024-11-26 19:16:12.034459] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.350 [2024-11-26 19:16:12.034465] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.350 [2024-11-26 19:16:12.034470] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.350 [2024-11-26 19:16:12.034476] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.350 [2024-11-26 19:16:12.034482] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.350 [2024-11-26 19:16:12.034488] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.351 [2024-11-26 19:16:12.034494] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.351 [2024-11-26 19:16:12.034500] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.351 [2024-11-26 19:16:12.034508] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.351 [2024-11-26 19:16:12.034514] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.351 [2024-11-26 19:16:12.034520] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.351 [2024-11-26 19:16:12.034526] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.351 [2024-11-26 19:16:12.034532] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.351 [2024-11-26 19:16:12.034538] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.351 [2024-11-26 19:16:12.034544] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.351 [2024-11-26 19:16:12.034550] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.351 [2024-11-26 19:16:12.034556] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.351 [2024-11-26 19:16:12.034562] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.351 [2024-11-26 19:16:12.034568] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.351 [2024-11-26 19:16:12.034574] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.351 [2024-11-26 19:16:12.034581] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.351 [2024-11-26 19:16:12.034587] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.351 [2024-11-26 19:16:12.034594] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.351 [2024-11-26 19:16:12.034601] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.351 [2024-11-26 19:16:12.034607] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.351 [2024-11-26 19:16:12.034612] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.351 [2024-11-26 19:16:12.034618] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.351 [2024-11-26 19:16:12.034624] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.351 [2024-11-26 19:16:12.034630] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.351 [2024-11-26 19:16:12.034636] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.351 [2024-11-26 19:16:12.034642] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.351 [2024-11-26 19:16:12.034648] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.351 [2024-11-26 19:16:12.034654] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.351 [2024-11-26 19:16:12.034660] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.351 [2024-11-26 19:16:12.034665] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.351 [2024-11-26 19:16:12.034671] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.351 [2024-11-26 19:16:12.034677] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.351 [2024-11-26 19:16:12.034683] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.351 [2024-11-26 19:16:12.034690] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.351 [2024-11-26 19:16:12.034696] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.351 [2024-11-26 19:16:12.034703] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.351 [2024-11-26 19:16:12.034709] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.351 [2024-11-26 19:16:12.034716] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.351 [2024-11-26 19:16:12.034722] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.351 [2024-11-26 19:16:12.034728] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.351 [2024-11-26 19:16:12.034734] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.351 [2024-11-26 19:16:12.034740] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.351 [2024-11-26 19:16:12.034746] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.351 [2024-11-26 19:16:12.034752] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.351 [2024-11-26 19:16:12.034759] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.351 [2024-11-26 19:16:12.034764] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.351 [2024-11-26 19:16:12.034771] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.351 [2024-11-26 19:16:12.034777] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.351 [2024-11-26 19:16:12.034783] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.351 [2024-11-26 19:16:12.034789] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5212c0 is same with the state(5) to be set 00:29:55.351 19:16:12 -- host/failover.sh@45 -- # sleep 3 00:29:58.642 19:16:15 -- host/failover.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:29:58.642 00:29:58.642 19:16:15 -- host/failover.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:29:58.642 [2024-11-26 19:16:15.554145] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x522810 is same with the state(5) to be set 00:29:58.642 [2024-11-26 19:16:15.554189] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x522810 is same with the state(5) to be set 00:29:58.642 [2024-11-26 19:16:15.554197] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x522810 is same with the state(5) to be set 00:29:58.643 [2024-11-26 19:16:15.554204] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x522810 is same with the state(5) to be set 00:29:58.643 [2024-11-26 19:16:15.554210] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x522810 is same with the state(5) to be set 00:29:58.643 [2024-11-26 19:16:15.554216] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x522810 is same with the state(5) to be set 00:29:58.643 [2024-11-26 19:16:15.554222] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x522810 is same with the state(5) to be set 00:29:58.643 [2024-11-26 19:16:15.554228] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x522810 is same with the state(5) to be set 00:29:58.643 [2024-11-26 19:16:15.554234] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x522810 is same with the state(5) to be set 00:29:58.643 [2024-11-26 19:16:15.554240] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x522810 is same with the state(5) to be set 00:29:58.643 [2024-11-26 19:16:15.554246] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x522810 is same with the state(5) to be set 00:29:58.643 [2024-11-26 19:16:15.554252] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x522810 is same with the state(5) to be set 00:29:58.643 [2024-11-26 19:16:15.554258] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x522810 is same with the state(5) to be set 00:29:58.643 [2024-11-26 19:16:15.554264] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x522810 is same with the state(5) to be set 00:29:58.643 [2024-11-26 19:16:15.554270] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x522810 is same with the state(5) to be set 00:29:58.643 [2024-11-26 19:16:15.554276] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x522810 is same with the state(5) to be set 00:29:58.643 [2024-11-26 19:16:15.554282] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x522810 is same with the state(5) to be set 00:29:58.643 [2024-11-26 19:16:15.554288] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x522810 is same with the state(5) to be set 00:29:58.643 [2024-11-26 19:16:15.554300] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x522810 is same with the state(5) to be set 00:29:58.643 [2024-11-26 19:16:15.554306] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x522810 is same with the state(5) to be set 00:29:58.643 [2024-11-26 19:16:15.554312] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x522810 is same with the state(5) to be set 00:29:58.643 [2024-11-26 19:16:15.554318] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x522810 is same with the state(5) to be set 00:29:58.643 [2024-11-26 19:16:15.554324] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x522810 is same with the state(5) to be set 00:29:58.643 [2024-11-26 19:16:15.554330] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x522810 is same with the state(5) to be set 00:29:58.643 [2024-11-26 19:16:15.554336] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x522810 is same with the state(5) to be set 00:29:58.643 [2024-11-26 19:16:15.554341] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x522810 is same with the state(5) to be set 00:29:58.643 [2024-11-26 19:16:15.554348] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x522810 is same with the state(5) to be set 00:29:58.643 [2024-11-26 19:16:15.554354] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x522810 is same with the state(5) to be set 00:29:58.643 [2024-11-26 19:16:15.554359] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x522810 is same with the state(5) to be set 00:29:58.902 19:16:15 -- host/failover.sh@50 -- # sleep 3 00:30:02.190 19:16:18 -- host/failover.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:02.190 [2024-11-26 19:16:18.755025] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:02.190 19:16:18 -- host/failover.sh@55 -- # sleep 1 00:30:03.125 19:16:19 -- host/failover.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:30:03.125 [2024-11-26 19:16:19.959346] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x523910 is same with the state(5) to be set 00:30:03.125 [2024-11-26 19:16:19.959390] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x523910 is same with the state(5) to be set 00:30:03.125 [2024-11-26 19:16:19.959397] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x523910 is same with the state(5) to be set 00:30:03.125 [2024-11-26 19:16:19.959404] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x523910 is same with the state(5) to be set 00:30:03.125 [2024-11-26 19:16:19.959411] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x523910 is same with the state(5) to be set 00:30:03.125 [2024-11-26 19:16:19.959417] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x523910 is same with the state(5) to be set 00:30:03.125 [2024-11-26 19:16:19.959423] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x523910 is same with the state(5) to be set 00:30:03.125 [2024-11-26 19:16:19.959429] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x523910 is same with the state(5) to be set 00:30:03.125 [2024-11-26 19:16:19.959435] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x523910 is same with the state(5) to be set 00:30:03.125 [2024-11-26 19:16:19.959440] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x523910 is same with the state(5) to be set 00:30:03.125 [2024-11-26 19:16:19.959446] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x523910 is same with the state(5) to be set 00:30:03.125 [2024-11-26 19:16:19.959452] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x523910 is same with the state(5) to be set 00:30:03.126 [2024-11-26 19:16:19.959458] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x523910 is same with the state(5) to be set 00:30:03.126 [2024-11-26 19:16:19.959469] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x523910 is same with the state(5) to be set 00:30:03.126 [2024-11-26 19:16:19.959476] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x523910 is same with the state(5) to be set 00:30:03.126 [2024-11-26 19:16:19.959482] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x523910 is same with the state(5) to be set 00:30:03.126 [2024-11-26 19:16:19.959487] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x523910 is same with the state(5) to be set 00:30:03.126 [2024-11-26 19:16:19.959493] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x523910 is same with the state(5) to be set 00:30:03.126 [2024-11-26 19:16:19.959499] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x523910 is same with the state(5) to be set 00:30:03.126 [2024-11-26 19:16:19.959505] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x523910 is same with the state(5) to be set 00:30:03.126 [2024-11-26 19:16:19.959511] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x523910 is same with the state(5) to be set 00:30:03.126 [2024-11-26 19:16:19.959517] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x523910 is same with the state(5) to be set 00:30:03.126 [2024-11-26 19:16:19.959523] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x523910 is same with the state(5) to be set 00:30:03.126 [2024-11-26 19:16:19.959529] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x523910 is same with the state(5) to be set 00:30:03.126 [2024-11-26 19:16:19.959535] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x523910 is same with the state(5) to be set 00:30:03.126 [2024-11-26 19:16:19.959541] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x523910 is same with the state(5) to be set 00:30:03.126 [2024-11-26 19:16:19.959548] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x523910 is same with the state(5) to be set 00:30:03.126 [2024-11-26 19:16:19.959554] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x523910 is same with the state(5) to be set 00:30:03.126 [2024-11-26 19:16:19.959560] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x523910 is same with the state(5) to be set 00:30:03.126 [2024-11-26 19:16:19.959567] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x523910 is same with the state(5) to be set 00:30:03.126 19:16:19 -- host/failover.sh@59 -- # wait 3265364 00:30:09.701 0 00:30:09.701 19:16:25 -- host/failover.sh@61 -- # killprocess 3265129 00:30:09.701 19:16:25 -- common/autotest_common.sh@936 -- # '[' -z 3265129 ']' 00:30:09.701 19:16:25 -- common/autotest_common.sh@940 -- # kill -0 3265129 00:30:09.701 19:16:25 -- common/autotest_common.sh@941 -- # uname 00:30:09.701 19:16:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:09.701 19:16:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3265129 00:30:09.701 19:16:26 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:30:09.701 19:16:26 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:30:09.701 19:16:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3265129' 00:30:09.701 killing process with pid 3265129 00:30:09.701 19:16:26 -- common/autotest_common.sh@955 -- # kill 3265129 00:30:09.701 19:16:26 -- common/autotest_common.sh@960 -- # wait 3265129 00:30:09.701 19:16:26 -- host/failover.sh@63 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:30:09.701 [2024-11-26 19:16:09.444289] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:30:09.701 [2024-11-26 19:16:09.444334] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3265129 ] 00:30:09.701 EAL: No free 2048 kB hugepages reported on node 1 00:30:09.701 [2024-11-26 19:16:09.500004] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:09.701 [2024-11-26 19:16:09.538359] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:30:09.701 Running I/O for 15 seconds... 00:30:09.701 [2024-11-26 19:16:12.035006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:18752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.701 [2024-11-26 19:16:12.035044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.701 [2024-11-26 19:16:12.035062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:18768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.701 [2024-11-26 19:16:12.035070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.701 [2024-11-26 19:16:12.035079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:18224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.701 [2024-11-26 19:16:12.035086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.701 [2024-11-26 19:16:12.035095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:18232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.701 [2024-11-26 19:16:12.035102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.701 [2024-11-26 19:16:12.035110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:18240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.701 [2024-11-26 19:16:12.035117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.701 [2024-11-26 19:16:12.035126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:18264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.701 [2024-11-26 19:16:12.035132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.701 [2024-11-26 19:16:12.035141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:18280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.701 [2024-11-26 19:16:12.035147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.701 [2024-11-26 19:16:12.035155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:18288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.701 [2024-11-26 19:16:12.035162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.701 [2024-11-26 19:16:12.035170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:18304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.701 [2024-11-26 19:16:12.035177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.701 [2024-11-26 19:16:12.035185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:18320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.701 [2024-11-26 19:16:12.035192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.701 [2024-11-26 19:16:12.035200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:18784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.701 [2024-11-26 19:16:12.035206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.701 [2024-11-26 19:16:12.035220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:18792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.701 [2024-11-26 19:16:12.035227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.701 [2024-11-26 19:16:12.035235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:18808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.702 [2024-11-26 19:16:12.035241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.702 [2024-11-26 19:16:12.035249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:18816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.702 [2024-11-26 19:16:12.035256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.702 [2024-11-26 19:16:12.035264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:18832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.702 [2024-11-26 19:16:12.035270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.702 [2024-11-26 19:16:12.035278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:18840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.702 [2024-11-26 19:16:12.035285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.702 [2024-11-26 19:16:12.035293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:18872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.702 [2024-11-26 19:16:12.035300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.702 [2024-11-26 19:16:12.035308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:18904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.702 [2024-11-26 19:16:12.035314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.702 [2024-11-26 19:16:12.035322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:18920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.702 [2024-11-26 19:16:12.035329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.702 [2024-11-26 19:16:12.035337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:18328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.702 [2024-11-26 19:16:12.035344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.702 [2024-11-26 19:16:12.035352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:18344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.702 [2024-11-26 19:16:12.035359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.702 [2024-11-26 19:16:12.035367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:18352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.702 [2024-11-26 19:16:12.035373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.702 [2024-11-26 19:16:12.035381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:18360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.702 [2024-11-26 19:16:12.035388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.702 [2024-11-26 19:16:12.035396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:18368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.702 [2024-11-26 19:16:12.035404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.702 [2024-11-26 19:16:12.035412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:18392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.702 [2024-11-26 19:16:12.035419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.702 [2024-11-26 19:16:12.035427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:18400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.702 [2024-11-26 19:16:12.035433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.702 [2024-11-26 19:16:12.035441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.702 [2024-11-26 19:16:12.035448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.702 [2024-11-26 19:16:12.035458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:18928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.702 [2024-11-26 19:16:12.035464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.702 [2024-11-26 19:16:12.035472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:18936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.702 [2024-11-26 19:16:12.035478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.702 [2024-11-26 19:16:12.035487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:18944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.702 [2024-11-26 19:16:12.035493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.702 [2024-11-26 19:16:12.035501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:18952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.702 [2024-11-26 19:16:12.035508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.702 [2024-11-26 19:16:12.035516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:18960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.702 [2024-11-26 19:16:12.035522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.702 [2024-11-26 19:16:12.035530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:18968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.702 [2024-11-26 19:16:12.035538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.702 [2024-11-26 19:16:12.035546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:18992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.702 [2024-11-26 19:16:12.035553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.702 [2024-11-26 19:16:12.035561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:19000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.702 [2024-11-26 19:16:12.035568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.702 [2024-11-26 19:16:12.035576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:19016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.702 [2024-11-26 19:16:12.035582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.702 [2024-11-26 19:16:12.035592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:18416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.702 [2024-11-26 19:16:12.035599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.702 [2024-11-26 19:16:12.035607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:18432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.702 [2024-11-26 19:16:12.035613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.702 [2024-11-26 19:16:12.035621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:18504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.702 [2024-11-26 19:16:12.035628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.702 [2024-11-26 19:16:12.035636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.702 [2024-11-26 19:16:12.035642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.702 [2024-11-26 19:16:12.035651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:18536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.702 [2024-11-26 19:16:12.035657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.702 [2024-11-26 19:16:12.035666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:18544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.702 [2024-11-26 19:16:12.035672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.702 [2024-11-26 19:16:12.035683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:18552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.703 [2024-11-26 19:16:12.035690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.703 [2024-11-26 19:16:12.035698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:18584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.703 [2024-11-26 19:16:12.035704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.703 [2024-11-26 19:16:12.035713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:19032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.703 [2024-11-26 19:16:12.035719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.703 [2024-11-26 19:16:12.035727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:19040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.703 [2024-11-26 19:16:12.035734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.703 [2024-11-26 19:16:12.035742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:19048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.703 [2024-11-26 19:16:12.035748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.703 [2024-11-26 19:16:12.035756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:19056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.703 [2024-11-26 19:16:12.035763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.703 [2024-11-26 19:16:12.035771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:19064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.703 [2024-11-26 19:16:12.035779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.703 [2024-11-26 19:16:12.035787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:19072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.703 [2024-11-26 19:16:12.035793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.703 [2024-11-26 19:16:12.035801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:19080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.703 [2024-11-26 19:16:12.035807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.703 [2024-11-26 19:16:12.035816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:19088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.703 [2024-11-26 19:16:12.035822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.703 [2024-11-26 19:16:12.035830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:19096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.703 [2024-11-26 19:16:12.035836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.703 [2024-11-26 19:16:12.035844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:19104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.703 [2024-11-26 19:16:12.035850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.703 [2024-11-26 19:16:12.035858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:19112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.703 [2024-11-26 19:16:12.035865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.703 [2024-11-26 19:16:12.035873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:19120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.703 [2024-11-26 19:16:12.035879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.703 [2024-11-26 19:16:12.035887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:19128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.703 [2024-11-26 19:16:12.035893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.703 [2024-11-26 19:16:12.035901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:19136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.703 [2024-11-26 19:16:12.035907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.703 [2024-11-26 19:16:12.035917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:19144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.703 [2024-11-26 19:16:12.035924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.703 [2024-11-26 19:16:12.035931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:19152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.703 [2024-11-26 19:16:12.035938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.703 [2024-11-26 19:16:12.035945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:19160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.703 [2024-11-26 19:16:12.035961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.703 [2024-11-26 19:16:12.035972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:19168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.703 [2024-11-26 19:16:12.035982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.703 [2024-11-26 19:16:12.035991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:19176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.703 [2024-11-26 19:16:12.035998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.703 [2024-11-26 19:16:12.036005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:19184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.703 [2024-11-26 19:16:12.036012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.703 [2024-11-26 19:16:12.036020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:19192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.703 [2024-11-26 19:16:12.036028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.703 [2024-11-26 19:16:12.036036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.703 [2024-11-26 19:16:12.036043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.703 [2024-11-26 19:16:12.036051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:19208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.703 [2024-11-26 19:16:12.036057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.703 [2024-11-26 19:16:12.036065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:19216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.703 [2024-11-26 19:16:12.036071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.703 [2024-11-26 19:16:12.036079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.703 [2024-11-26 19:16:12.036086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.703 [2024-11-26 19:16:12.036093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:19232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.703 [2024-11-26 19:16:12.036100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.703 [2024-11-26 19:16:12.036108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:19240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.703 [2024-11-26 19:16:12.036114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.703 [2024-11-26 19:16:12.036122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:18592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.703 [2024-11-26 19:16:12.036128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.703 [2024-11-26 19:16:12.036136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:18600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.703 [2024-11-26 19:16:12.036143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.703 [2024-11-26 19:16:12.036151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:18648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.703 [2024-11-26 19:16:12.036157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.703 [2024-11-26 19:16:12.036176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:18656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.704 [2024-11-26 19:16:12.036182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.704 [2024-11-26 19:16:12.036190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:18688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.704 [2024-11-26 19:16:12.036196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.704 [2024-11-26 19:16:12.036205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:18696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.704 [2024-11-26 19:16:12.036211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.704 [2024-11-26 19:16:12.036219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:18728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.704 [2024-11-26 19:16:12.036226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.704 [2024-11-26 19:16:12.036234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:18736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.704 [2024-11-26 19:16:12.036240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.704 [2024-11-26 19:16:12.036248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:19248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.704 [2024-11-26 19:16:12.036254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.704 [2024-11-26 19:16:12.036262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:19256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.704 [2024-11-26 19:16:12.036270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.704 [2024-11-26 19:16:12.036279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.704 [2024-11-26 19:16:12.036285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.704 [2024-11-26 19:16:12.036293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:19272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.704 [2024-11-26 19:16:12.036300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.704 [2024-11-26 19:16:12.036307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:19280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.704 [2024-11-26 19:16:12.036314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.704 [2024-11-26 19:16:12.036322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:19288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.704 [2024-11-26 19:16:12.036329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.704 [2024-11-26 19:16:12.036337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:19296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.704 [2024-11-26 19:16:12.036343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.704 [2024-11-26 19:16:12.036351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:19304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.704 [2024-11-26 19:16:12.036358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.704 [2024-11-26 19:16:12.036366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.704 [2024-11-26 19:16:12.036373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.704 [2024-11-26 19:16:12.036381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:19320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.704 [2024-11-26 19:16:12.036387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.704 [2024-11-26 19:16:12.036395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:19328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.704 [2024-11-26 19:16:12.036402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.704 [2024-11-26 19:16:12.036411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:19336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.704 [2024-11-26 19:16:12.036417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.704 [2024-11-26 19:16:12.036425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:19344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.704 [2024-11-26 19:16:12.036432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.704 [2024-11-26 19:16:12.036440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:19352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.704 [2024-11-26 19:16:12.036447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.704 [2024-11-26 19:16:12.036455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:18744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.704 [2024-11-26 19:16:12.036461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.704 [2024-11-26 19:16:12.036469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:18760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.704 [2024-11-26 19:16:12.036475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.704 [2024-11-26 19:16:12.036484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:18776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.704 [2024-11-26 19:16:12.036490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.704 [2024-11-26 19:16:12.036498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:18800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.704 [2024-11-26 19:16:12.036506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.704 [2024-11-26 19:16:12.036514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:18824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.704 [2024-11-26 19:16:12.036520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.704 [2024-11-26 19:16:12.036528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:18848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.704 [2024-11-26 19:16:12.036535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.704 [2024-11-26 19:16:12.036545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:18856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.704 [2024-11-26 19:16:12.036552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.704 [2024-11-26 19:16:12.036560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:18864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.704 [2024-11-26 19:16:12.036567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.704 [2024-11-26 19:16:12.036574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:19360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.704 [2024-11-26 19:16:12.036581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.704 [2024-11-26 19:16:12.036589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.704 [2024-11-26 19:16:12.036595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.704 [2024-11-26 19:16:12.036603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:19376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.704 [2024-11-26 19:16:12.036610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.704 [2024-11-26 19:16:12.036617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:19384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.704 [2024-11-26 19:16:12.036624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.704 [2024-11-26 19:16:12.036632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:19392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.704 [2024-11-26 19:16:12.036638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.705 [2024-11-26 19:16:12.036646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:19400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.705 [2024-11-26 19:16:12.036652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.705 [2024-11-26 19:16:12.036660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:19408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.705 [2024-11-26 19:16:12.036667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.705 [2024-11-26 19:16:12.036674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:19416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.705 [2024-11-26 19:16:12.036681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.705 [2024-11-26 19:16:12.036689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:19424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.705 [2024-11-26 19:16:12.036696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.705 [2024-11-26 19:16:12.036703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:19432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.705 [2024-11-26 19:16:12.036710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.705 [2024-11-26 19:16:12.036718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:19440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.705 [2024-11-26 19:16:12.036726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.705 [2024-11-26 19:16:12.036734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.705 [2024-11-26 19:16:12.036742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.705 [2024-11-26 19:16:12.036751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:19456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.705 [2024-11-26 19:16:12.036757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.705 [2024-11-26 19:16:12.036765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:19464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.705 [2024-11-26 19:16:12.036772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.705 [2024-11-26 19:16:12.036779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:19472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.705 [2024-11-26 19:16:12.036786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.705 [2024-11-26 19:16:12.036794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.705 [2024-11-26 19:16:12.036800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.705 [2024-11-26 19:16:12.036808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:19488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.705 [2024-11-26 19:16:12.036815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.705 [2024-11-26 19:16:12.036823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:19496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.705 [2024-11-26 19:16:12.036830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.705 [2024-11-26 19:16:12.036837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:19504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.705 [2024-11-26 19:16:12.036843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.705 [2024-11-26 19:16:12.036851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:18880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.705 [2024-11-26 19:16:12.036858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.705 [2024-11-26 19:16:12.036866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:18888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.705 [2024-11-26 19:16:12.036872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.705 [2024-11-26 19:16:12.036880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:18896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.705 [2024-11-26 19:16:12.036886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.705 [2024-11-26 19:16:12.036894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:18912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.705 [2024-11-26 19:16:12.036901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.705 [2024-11-26 19:16:12.036908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:18976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.705 [2024-11-26 19:16:12.036917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.705 [2024-11-26 19:16:12.036925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:18984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.705 [2024-11-26 19:16:12.036931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.705 [2024-11-26 19:16:12.036939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:19008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.705 [2024-11-26 19:16:12.036952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.705 [2024-11-26 19:16:12.036960] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdc8fb0 is same with the state(5) to be set 00:30:09.705 [2024-11-26 19:16:12.036969] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:30:09.705 [2024-11-26 19:16:12.036974] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:30:09.705 [2024-11-26 19:16:12.036982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19024 len:8 PRP1 0x0 PRP2 0x0 00:30:09.705 [2024-11-26 19:16:12.036988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.705 [2024-11-26 19:16:12.037028] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xdc8fb0 was disconnected and freed. reset controller. 00:30:09.705 [2024-11-26 19:16:12.037042] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:30:09.705 [2024-11-26 19:16:12.037066] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:30:09.705 [2024-11-26 19:16:12.037073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.705 [2024-11-26 19:16:12.037080] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:30:09.705 [2024-11-26 19:16:12.037087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.705 [2024-11-26 19:16:12.037094] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:30:09.705 [2024-11-26 19:16:12.037100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.705 [2024-11-26 19:16:12.037107] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:30:09.705 [2024-11-26 19:16:12.037113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.705 [2024-11-26 19:16:12.037120] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.705 [2024-11-26 19:16:12.038928] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.705 [2024-11-26 19:16:12.038956] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xda9960 (9): Bad file descriptor 00:30:09.705 [2024-11-26 19:16:12.055647] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:30:09.705 [2024-11-26 19:16:15.554610] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:30:09.705 [2024-11-26 19:16:15.554643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.705 [2024-11-26 19:16:15.554652] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:30:09.705 [2024-11-26 19:16:15.554667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.705 [2024-11-26 19:16:15.554674] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:30:09.705 [2024-11-26 19:16:15.554681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.705 [2024-11-26 19:16:15.554689] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:30:09.706 [2024-11-26 19:16:15.554695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.706 [2024-11-26 19:16:15.554702] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xda9960 is same with the state(5) to be set 00:30:09.706 [2024-11-26 19:16:15.554750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:109272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.706 [2024-11-26 19:16:15.554759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.706 [2024-11-26 19:16:15.554772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:109304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.706 [2024-11-26 19:16:15.554778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.706 [2024-11-26 19:16:15.554787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:109312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.706 [2024-11-26 19:16:15.554793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.706 [2024-11-26 19:16:15.554801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:109328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.706 [2024-11-26 19:16:15.554808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.706 [2024-11-26 19:16:15.554816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:109352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.706 [2024-11-26 19:16:15.554823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.706 [2024-11-26 19:16:15.554831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:109360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.706 [2024-11-26 19:16:15.554838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.706 [2024-11-26 19:16:15.554847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:109368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.706 [2024-11-26 19:16:15.554853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.706 [2024-11-26 19:16:15.554861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:109376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.706 [2024-11-26 19:16:15.554868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.706 [2024-11-26 19:16:15.554876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:109384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.706 [2024-11-26 19:16:15.554883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.706 [2024-11-26 19:16:15.554890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:109392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.706 [2024-11-26 19:16:15.554899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.706 [2024-11-26 19:16:15.554907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:109400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.706 [2024-11-26 19:16:15.554914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.706 [2024-11-26 19:16:15.554922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:109408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.706 [2024-11-26 19:16:15.554928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.706 [2024-11-26 19:16:15.554937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:108816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.706 [2024-11-26 19:16:15.554944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.706 [2024-11-26 19:16:15.554958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:108832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.706 [2024-11-26 19:16:15.554965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.706 [2024-11-26 19:16:15.554973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:108872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.706 [2024-11-26 19:16:15.554980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.706 [2024-11-26 19:16:15.554988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:108888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.706 [2024-11-26 19:16:15.554994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.706 [2024-11-26 19:16:15.555002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:108904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.706 [2024-11-26 19:16:15.555009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.706 [2024-11-26 19:16:15.555017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:108912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.706 [2024-11-26 19:16:15.555024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.706 [2024-11-26 19:16:15.555032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:108920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.706 [2024-11-26 19:16:15.555039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.706 [2024-11-26 19:16:15.555047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:108928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.706 [2024-11-26 19:16:15.555053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.706 [2024-11-26 19:16:15.555062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:109416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.706 [2024-11-26 19:16:15.555068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.706 [2024-11-26 19:16:15.555076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:109424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.706 [2024-11-26 19:16:15.555083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.706 [2024-11-26 19:16:15.555093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:109432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.706 [2024-11-26 19:16:15.555099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.706 [2024-11-26 19:16:15.555107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:109440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.706 [2024-11-26 19:16:15.555114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.706 [2024-11-26 19:16:15.555121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:109448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.706 [2024-11-26 19:16:15.555128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.706 [2024-11-26 19:16:15.555136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:109456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.706 [2024-11-26 19:16:15.555142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.706 [2024-11-26 19:16:15.555150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:109464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.706 [2024-11-26 19:16:15.555156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.706 [2024-11-26 19:16:15.555164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:109472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.706 [2024-11-26 19:16:15.555171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.706 [2024-11-26 19:16:15.555179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:109480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.706 [2024-11-26 19:16:15.555185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.706 [2024-11-26 19:16:15.555193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:109488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.706 [2024-11-26 19:16:15.555200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.707 [2024-11-26 19:16:15.555208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:109496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.707 [2024-11-26 19:16:15.555214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.707 [2024-11-26 19:16:15.555222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:109504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.707 [2024-11-26 19:16:15.555229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.707 [2024-11-26 19:16:15.555237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:109512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.707 [2024-11-26 19:16:15.555244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.707 [2024-11-26 19:16:15.555252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:108936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.707 [2024-11-26 19:16:15.555260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.707 [2024-11-26 19:16:15.555268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:108944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.707 [2024-11-26 19:16:15.555277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.707 [2024-11-26 19:16:15.555285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:108960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.707 [2024-11-26 19:16:15.555291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.707 [2024-11-26 19:16:15.555299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:108992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.707 [2024-11-26 19:16:15.555306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.707 [2024-11-26 19:16:15.555315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:109032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.707 [2024-11-26 19:16:15.555321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.707 [2024-11-26 19:16:15.555329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:109048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.707 [2024-11-26 19:16:15.555337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.707 [2024-11-26 19:16:15.555345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:109064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.707 [2024-11-26 19:16:15.555351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.707 [2024-11-26 19:16:15.555359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:109080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.707 [2024-11-26 19:16:15.555366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.707 [2024-11-26 19:16:15.555374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:109520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.707 [2024-11-26 19:16:15.555380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.707 [2024-11-26 19:16:15.555388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:109528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.707 [2024-11-26 19:16:15.555395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.707 [2024-11-26 19:16:15.555403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:109536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.707 [2024-11-26 19:16:15.555409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.707 [2024-11-26 19:16:15.555418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:109544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.707 [2024-11-26 19:16:15.555425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.707 [2024-11-26 19:16:15.555433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:109552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.707 [2024-11-26 19:16:15.555440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.707 [2024-11-26 19:16:15.555448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:109560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.707 [2024-11-26 19:16:15.555455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.707 [2024-11-26 19:16:15.555463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:109568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.707 [2024-11-26 19:16:15.555472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.707 [2024-11-26 19:16:15.555480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:109576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.707 [2024-11-26 19:16:15.555487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.707 [2024-11-26 19:16:15.555494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:109584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.707 [2024-11-26 19:16:15.555501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.707 [2024-11-26 19:16:15.555509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:109592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.707 [2024-11-26 19:16:15.555516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.707 [2024-11-26 19:16:15.555523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:109600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.707 [2024-11-26 19:16:15.555530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.707 [2024-11-26 19:16:15.555538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:109608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.707 [2024-11-26 19:16:15.555544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.707 [2024-11-26 19:16:15.555552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:109616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.707 [2024-11-26 19:16:15.555558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.707 [2024-11-26 19:16:15.555566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:109624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.707 [2024-11-26 19:16:15.555573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.707 [2024-11-26 19:16:15.555581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:109632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.707 [2024-11-26 19:16:15.555587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.707 [2024-11-26 19:16:15.555595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:109640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.707 [2024-11-26 19:16:15.555601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.707 [2024-11-26 19:16:15.555609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:109648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.707 [2024-11-26 19:16:15.555616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.707 [2024-11-26 19:16:15.555624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:109656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.707 [2024-11-26 19:16:15.555630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.707 [2024-11-26 19:16:15.555638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:109664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.707 [2024-11-26 19:16:15.555644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.708 [2024-11-26 19:16:15.555654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:109672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.708 [2024-11-26 19:16:15.555661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.708 [2024-11-26 19:16:15.555670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:109680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.708 [2024-11-26 19:16:15.555676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.708 [2024-11-26 19:16:15.555684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:109688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.708 [2024-11-26 19:16:15.555691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.708 [2024-11-26 19:16:15.555699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:109696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.708 [2024-11-26 19:16:15.555706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.708 [2024-11-26 19:16:15.555714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:109704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.708 [2024-11-26 19:16:15.555721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.708 [2024-11-26 19:16:15.555729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:109712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.708 [2024-11-26 19:16:15.555735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.708 [2024-11-26 19:16:15.555743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:109720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.708 [2024-11-26 19:16:15.555750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.708 [2024-11-26 19:16:15.555757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:109728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.708 [2024-11-26 19:16:15.555764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.708 [2024-11-26 19:16:15.555772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:109736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.708 [2024-11-26 19:16:15.555778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.708 [2024-11-26 19:16:15.555786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:109744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.708 [2024-11-26 19:16:15.555793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.708 [2024-11-26 19:16:15.555800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:109752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.708 [2024-11-26 19:16:15.555807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.708 [2024-11-26 19:16:15.555815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:109760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.708 [2024-11-26 19:16:15.555821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.708 [2024-11-26 19:16:15.555829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:109768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.708 [2024-11-26 19:16:15.555838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.708 [2024-11-26 19:16:15.555845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:109776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.708 [2024-11-26 19:16:15.555852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.708 [2024-11-26 19:16:15.555860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:109784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.708 [2024-11-26 19:16:15.555866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.708 [2024-11-26 19:16:15.555874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:109792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.708 [2024-11-26 19:16:15.555881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.708 [2024-11-26 19:16:15.555889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:109800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.708 [2024-11-26 19:16:15.555896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.708 [2024-11-26 19:16:15.555903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:109808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.708 [2024-11-26 19:16:15.555910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.708 [2024-11-26 19:16:15.555918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:109816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.708 [2024-11-26 19:16:15.555925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.708 [2024-11-26 19:16:15.555933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:109824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.708 [2024-11-26 19:16:15.555939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.708 [2024-11-26 19:16:15.555952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:109832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.708 [2024-11-26 19:16:15.555962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.708 [2024-11-26 19:16:15.555975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:109840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.708 [2024-11-26 19:16:15.555982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.708 [2024-11-26 19:16:15.555991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:109848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.708 [2024-11-26 19:16:15.555997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.708 [2024-11-26 19:16:15.556005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:109856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.708 [2024-11-26 19:16:15.556011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.708 [2024-11-26 19:16:15.556019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:109864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.708 [2024-11-26 19:16:15.556026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.708 [2024-11-26 19:16:15.556036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:109872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.708 [2024-11-26 19:16:15.556042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.708 [2024-11-26 19:16:15.556050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:109880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.708 [2024-11-26 19:16:15.556057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.708 [2024-11-26 19:16:15.556065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:109888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.708 [2024-11-26 19:16:15.556071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.708 [2024-11-26 19:16:15.556079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:109896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.708 [2024-11-26 19:16:15.556085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.708 [2024-11-26 19:16:15.556093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:109904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.708 [2024-11-26 19:16:15.556099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.708 [2024-11-26 19:16:15.556107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:109912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.708 [2024-11-26 19:16:15.556113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.708 [2024-11-26 19:16:15.556121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:109920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.709 [2024-11-26 19:16:15.556127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.709 [2024-11-26 19:16:15.556138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:109928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.709 [2024-11-26 19:16:15.556144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.709 [2024-11-26 19:16:15.556152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:109936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.709 [2024-11-26 19:16:15.556159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.709 [2024-11-26 19:16:15.556167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:109112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.709 [2024-11-26 19:16:15.556173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.709 [2024-11-26 19:16:15.556181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:109136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.709 [2024-11-26 19:16:15.556187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.709 [2024-11-26 19:16:15.556195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:109144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.709 [2024-11-26 19:16:15.556202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.709 [2024-11-26 19:16:15.556209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:109168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.709 [2024-11-26 19:16:15.556217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.709 [2024-11-26 19:16:15.556225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:109176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.709 [2024-11-26 19:16:15.556232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.709 [2024-11-26 19:16:15.556240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:109184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.709 [2024-11-26 19:16:15.556246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.709 [2024-11-26 19:16:15.556254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:109192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.709 [2024-11-26 19:16:15.556260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.709 [2024-11-26 19:16:15.556268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:109208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.709 [2024-11-26 19:16:15.556274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.709 [2024-11-26 19:16:15.556282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:109944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.709 [2024-11-26 19:16:15.556289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.709 [2024-11-26 19:16:15.556296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:109952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.709 [2024-11-26 19:16:15.556303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.709 [2024-11-26 19:16:15.556310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:109960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.709 [2024-11-26 19:16:15.556317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.709 [2024-11-26 19:16:15.556325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:109968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.709 [2024-11-26 19:16:15.556331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.709 [2024-11-26 19:16:15.556339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:109976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.709 [2024-11-26 19:16:15.556345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.709 [2024-11-26 19:16:15.556353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:109984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.709 [2024-11-26 19:16:15.556360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.709 [2024-11-26 19:16:15.556368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:109992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.709 [2024-11-26 19:16:15.556375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.709 [2024-11-26 19:16:15.556383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:110000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.709 [2024-11-26 19:16:15.556390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.709 [2024-11-26 19:16:15.556400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:110008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.709 [2024-11-26 19:16:15.556406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.709 [2024-11-26 19:16:15.556414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:110016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.709 [2024-11-26 19:16:15.556421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.709 [2024-11-26 19:16:15.556429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:110024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.709 [2024-11-26 19:16:15.556435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.709 [2024-11-26 19:16:15.556443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:110032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.709 [2024-11-26 19:16:15.556450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.709 [2024-11-26 19:16:15.556458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:110040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.709 [2024-11-26 19:16:15.556464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.709 [2024-11-26 19:16:15.556472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:110048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.709 [2024-11-26 19:16:15.556479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.709 [2024-11-26 19:16:15.556487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:110056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.709 [2024-11-26 19:16:15.556493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.709 [2024-11-26 19:16:15.556501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:110064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.709 [2024-11-26 19:16:15.556508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.709 [2024-11-26 19:16:15.556516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:110072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.709 [2024-11-26 19:16:15.556522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.709 [2024-11-26 19:16:15.556530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:110080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.709 [2024-11-26 19:16:15.556536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.709 [2024-11-26 19:16:15.556544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:109256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.709 [2024-11-26 19:16:15.556551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.709 [2024-11-26 19:16:15.556558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:109264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.709 [2024-11-26 19:16:15.556565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.709 [2024-11-26 19:16:15.556573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:109280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.709 [2024-11-26 19:16:15.556581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.710 [2024-11-26 19:16:15.556590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:109288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.710 [2024-11-26 19:16:15.556596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.710 [2024-11-26 19:16:15.556604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:109296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.710 [2024-11-26 19:16:15.556611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.710 [2024-11-26 19:16:15.556619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:109320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.710 [2024-11-26 19:16:15.556626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.710 [2024-11-26 19:16:15.556634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:109336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.710 [2024-11-26 19:16:15.556640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.710 [2024-11-26 19:16:15.556659] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:30:09.710 [2024-11-26 19:16:15.556666] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:30:09.710 [2024-11-26 19:16:15.556672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:109344 len:8 PRP1 0x0 PRP2 0x0 00:30:09.710 [2024-11-26 19:16:15.556679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.710 [2024-11-26 19:16:15.556718] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xdb5dd0 was disconnected and freed. reset controller. 00:30:09.710 [2024-11-26 19:16:15.556726] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4421 to 10.0.0.2:4422 00:30:09.710 [2024-11-26 19:16:15.556734] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.710 [2024-11-26 19:16:15.558680] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.710 [2024-11-26 19:16:15.558710] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xda9960 (9): Bad file descriptor 00:30:09.710 [2024-11-26 19:16:15.617066] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:30:09.710 [2024-11-26 19:16:19.959662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:79360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.710 [2024-11-26 19:16:19.959697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.710 [2024-11-26 19:16:19.959714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:79376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.710 [2024-11-26 19:16:19.959722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.710 [2024-11-26 19:16:19.959731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:79384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.710 [2024-11-26 19:16:19.959738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.710 [2024-11-26 19:16:19.959747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:79408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.710 [2024-11-26 19:16:19.959754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.710 [2024-11-26 19:16:19.959768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:79424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.710 [2024-11-26 19:16:19.959776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.710 [2024-11-26 19:16:19.959784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:79440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.710 [2024-11-26 19:16:19.959792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.710 [2024-11-26 19:16:19.959800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:79456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.710 [2024-11-26 19:16:19.959807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.710 [2024-11-26 19:16:19.959815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:79464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.710 [2024-11-26 19:16:19.959822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.710 [2024-11-26 19:16:19.959830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:79480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.710 [2024-11-26 19:16:19.959836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.710 [2024-11-26 19:16:19.959844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:79488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.710 [2024-11-26 19:16:19.959850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.710 [2024-11-26 19:16:19.959858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:79512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.710 [2024-11-26 19:16:19.959865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.710 [2024-11-26 19:16:19.959873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:79544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.710 [2024-11-26 19:16:19.959879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.710 [2024-11-26 19:16:19.959889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:79560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.710 [2024-11-26 19:16:19.959895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.710 [2024-11-26 19:16:19.959904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:79576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.710 [2024-11-26 19:16:19.959910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.710 [2024-11-26 19:16:19.959920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:79584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.710 [2024-11-26 19:16:19.959927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.710 [2024-11-26 19:16:19.959936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:79592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.710 [2024-11-26 19:16:19.959943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.710 [2024-11-26 19:16:19.959961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:79600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.710 [2024-11-26 19:16:19.959971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.710 [2024-11-26 19:16:19.959985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:79608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.710 [2024-11-26 19:16:19.959994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.710 [2024-11-26 19:16:19.960004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:78848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.710 [2024-11-26 19:16:19.960010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.710 [2024-11-26 19:16:19.960020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:78872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.710 [2024-11-26 19:16:19.960027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.710 [2024-11-26 19:16:19.960036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:78888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.711 [2024-11-26 19:16:19.960043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.711 [2024-11-26 19:16:19.960052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:78904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.711 [2024-11-26 19:16:19.960059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.711 [2024-11-26 19:16:19.960067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:78912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.711 [2024-11-26 19:16:19.960074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.711 [2024-11-26 19:16:19.960082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:78920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.711 [2024-11-26 19:16:19.960088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.711 [2024-11-26 19:16:19.960096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:78936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.711 [2024-11-26 19:16:19.960103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.711 [2024-11-26 19:16:19.960112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:78968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.711 [2024-11-26 19:16:19.960119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.711 [2024-11-26 19:16:19.960128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:79616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.711 [2024-11-26 19:16:19.960135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.711 [2024-11-26 19:16:19.960143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:79624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.711 [2024-11-26 19:16:19.960150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.711 [2024-11-26 19:16:19.960158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:79632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.711 [2024-11-26 19:16:19.960164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.711 [2024-11-26 19:16:19.960172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:79640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.711 [2024-11-26 19:16:19.960181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.711 [2024-11-26 19:16:19.960190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:79648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.711 [2024-11-26 19:16:19.960198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.711 [2024-11-26 19:16:19.960207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:79656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.711 [2024-11-26 19:16:19.960213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.711 [2024-11-26 19:16:19.960222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:79664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.711 [2024-11-26 19:16:19.960229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.711 [2024-11-26 19:16:19.960238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:79672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.711 [2024-11-26 19:16:19.960245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.711 [2024-11-26 19:16:19.960253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:79680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.711 [2024-11-26 19:16:19.960260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.711 [2024-11-26 19:16:19.960268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:79688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.711 [2024-11-26 19:16:19.960276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.711 [2024-11-26 19:16:19.960284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:79696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.711 [2024-11-26 19:16:19.960292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.711 [2024-11-26 19:16:19.960300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:79704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.711 [2024-11-26 19:16:19.960307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.711 [2024-11-26 19:16:19.960315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:79712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.711 [2024-11-26 19:16:19.960321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.711 [2024-11-26 19:16:19.960330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:79720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.711 [2024-11-26 19:16:19.960337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.711 [2024-11-26 19:16:19.960345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:79728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.711 [2024-11-26 19:16:19.960352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.711 [2024-11-26 19:16:19.960361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:79736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.711 [2024-11-26 19:16:19.960368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.711 [2024-11-26 19:16:19.960379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:79744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.711 [2024-11-26 19:16:19.960385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.711 [2024-11-26 19:16:19.960394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:79752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.711 [2024-11-26 19:16:19.960400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.711 [2024-11-26 19:16:19.960408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:79760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.711 [2024-11-26 19:16:19.960416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.711 [2024-11-26 19:16:19.960425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:79768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.711 [2024-11-26 19:16:19.960432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.711 [2024-11-26 19:16:19.960442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:79776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.711 [2024-11-26 19:16:19.960449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.711 [2024-11-26 19:16:19.960457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:79784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.711 [2024-11-26 19:16:19.960463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.711 [2024-11-26 19:16:19.960472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:79792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.711 [2024-11-26 19:16:19.960479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.711 [2024-11-26 19:16:19.960488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:79800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.711 [2024-11-26 19:16:19.960495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.712 [2024-11-26 19:16:19.960504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:78976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.712 [2024-11-26 19:16:19.960512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.712 [2024-11-26 19:16:19.960521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:79000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.712 [2024-11-26 19:16:19.960528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.712 [2024-11-26 19:16:19.960536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:79016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.712 [2024-11-26 19:16:19.960542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.712 [2024-11-26 19:16:19.960551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:79048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.712 [2024-11-26 19:16:19.960557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.712 [2024-11-26 19:16:19.960565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:79056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.712 [2024-11-26 19:16:19.960578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.712 [2024-11-26 19:16:19.960587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:79064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.712 [2024-11-26 19:16:19.960594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.712 [2024-11-26 19:16:19.960603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:79080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.712 [2024-11-26 19:16:19.960609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.712 [2024-11-26 19:16:19.960617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:79088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.712 [2024-11-26 19:16:19.960625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.712 [2024-11-26 19:16:19.960635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:79096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.712 [2024-11-26 19:16:19.960644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.712 [2024-11-26 19:16:19.960654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:79112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.712 [2024-11-26 19:16:19.960663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.712 [2024-11-26 19:16:19.960672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:79120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.712 [2024-11-26 19:16:19.960679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.712 [2024-11-26 19:16:19.960687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:79128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.712 [2024-11-26 19:16:19.960695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.712 [2024-11-26 19:16:19.960704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:79136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.712 [2024-11-26 19:16:19.960711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.712 [2024-11-26 19:16:19.960720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:79144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.712 [2024-11-26 19:16:19.960726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.712 [2024-11-26 19:16:19.960734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:79152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.712 [2024-11-26 19:16:19.960740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.712 [2024-11-26 19:16:19.960749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:79160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.712 [2024-11-26 19:16:19.960756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.712 [2024-11-26 19:16:19.960764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:79808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.712 [2024-11-26 19:16:19.960771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.712 [2024-11-26 19:16:19.960780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:79816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.712 [2024-11-26 19:16:19.960789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.712 [2024-11-26 19:16:19.960797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:79824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.712 [2024-11-26 19:16:19.960804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.712 [2024-11-26 19:16:19.960812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:79832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.712 [2024-11-26 19:16:19.960818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.712 [2024-11-26 19:16:19.960826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:79840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.712 [2024-11-26 19:16:19.960832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.712 [2024-11-26 19:16:19.960841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:79848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.712 [2024-11-26 19:16:19.960848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.713 [2024-11-26 19:16:19.960857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:79856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.713 [2024-11-26 19:16:19.960864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.713 [2024-11-26 19:16:19.960872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:79168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.713 [2024-11-26 19:16:19.960879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.713 [2024-11-26 19:16:19.960887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:79184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.713 [2024-11-26 19:16:19.960893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.713 [2024-11-26 19:16:19.960902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:79192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.713 [2024-11-26 19:16:19.960908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.713 [2024-11-26 19:16:19.960917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:79200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.713 [2024-11-26 19:16:19.960925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.713 [2024-11-26 19:16:19.960934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:79232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.713 [2024-11-26 19:16:19.960941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.713 [2024-11-26 19:16:19.960952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:79240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.713 [2024-11-26 19:16:19.960959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.713 [2024-11-26 19:16:19.960967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:79248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.713 [2024-11-26 19:16:19.960974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.713 [2024-11-26 19:16:19.960983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:79256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.713 [2024-11-26 19:16:19.960990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.713 [2024-11-26 19:16:19.960999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:79264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.713 [2024-11-26 19:16:19.961006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.713 [2024-11-26 19:16:19.961015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:79272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.713 [2024-11-26 19:16:19.961022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.713 [2024-11-26 19:16:19.961031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:79280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.713 [2024-11-26 19:16:19.961037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.713 [2024-11-26 19:16:19.961045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:79288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.713 [2024-11-26 19:16:19.961052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.713 [2024-11-26 19:16:19.961060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:79296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.713 [2024-11-26 19:16:19.961066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.713 [2024-11-26 19:16:19.961074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:79320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.713 [2024-11-26 19:16:19.961082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.713 [2024-11-26 19:16:19.961091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:79328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.713 [2024-11-26 19:16:19.961098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.713 [2024-11-26 19:16:19.961106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:79336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.713 [2024-11-26 19:16:19.961113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.713 [2024-11-26 19:16:19.961120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:79864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.713 [2024-11-26 19:16:19.961127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.713 [2024-11-26 19:16:19.961136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:79872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.713 [2024-11-26 19:16:19.961143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.713 [2024-11-26 19:16:19.961152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:79880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.713 [2024-11-26 19:16:19.961160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.713 [2024-11-26 19:16:19.961169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:79888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.713 [2024-11-26 19:16:19.961177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.713 [2024-11-26 19:16:19.961186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:79896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.713 [2024-11-26 19:16:19.961192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.713 [2024-11-26 19:16:19.961200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:79904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.713 [2024-11-26 19:16:19.961206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.713 [2024-11-26 19:16:19.961214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:79912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.713 [2024-11-26 19:16:19.961220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.713 [2024-11-26 19:16:19.961229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:79920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.713 [2024-11-26 19:16:19.961236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.713 [2024-11-26 19:16:19.961246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:79928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.713 [2024-11-26 19:16:19.961253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.713 [2024-11-26 19:16:19.961261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:79936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.713 [2024-11-26 19:16:19.961268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.713 [2024-11-26 19:16:19.961276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:79944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.713 [2024-11-26 19:16:19.961283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.713 [2024-11-26 19:16:19.961291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:79952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.713 [2024-11-26 19:16:19.961297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.713 [2024-11-26 19:16:19.961306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:79960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.713 [2024-11-26 19:16:19.961313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.713 [2024-11-26 19:16:19.961322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:79344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.713 [2024-11-26 19:16:19.961328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.713 [2024-11-26 19:16:19.961337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:79352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.713 [2024-11-26 19:16:19.961343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.713 [2024-11-26 19:16:19.961351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:79368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.713 [2024-11-26 19:16:19.961357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.713 [2024-11-26 19:16:19.961367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:79392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.714 [2024-11-26 19:16:19.961374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.714 [2024-11-26 19:16:19.961383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:79400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.714 [2024-11-26 19:16:19.961390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.714 [2024-11-26 19:16:19.961399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:79416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.714 [2024-11-26 19:16:19.961406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.714 [2024-11-26 19:16:19.961414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:79432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.714 [2024-11-26 19:16:19.961420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.714 [2024-11-26 19:16:19.961428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:79448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.714 [2024-11-26 19:16:19.961435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.714 [2024-11-26 19:16:19.961443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:79968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.714 [2024-11-26 19:16:19.961450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.714 [2024-11-26 19:16:19.961458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:79976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.714 [2024-11-26 19:16:19.961464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.714 [2024-11-26 19:16:19.961472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:79984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.714 [2024-11-26 19:16:19.961481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.714 [2024-11-26 19:16:19.961489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:79992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.714 [2024-11-26 19:16:19.961496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.714 [2024-11-26 19:16:19.961504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:80000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.714 [2024-11-26 19:16:19.961510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.714 [2024-11-26 19:16:19.961518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:80008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.714 [2024-11-26 19:16:19.961524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.714 [2024-11-26 19:16:19.961532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:80016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.714 [2024-11-26 19:16:19.961539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.714 [2024-11-26 19:16:19.961547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:80024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.714 [2024-11-26 19:16:19.961556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.714 [2024-11-26 19:16:19.961564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:80032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.714 [2024-11-26 19:16:19.961571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.714 [2024-11-26 19:16:19.961580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:80040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:09.714 [2024-11-26 19:16:19.961589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.714 [2024-11-26 19:16:19.961597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:79472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.714 [2024-11-26 19:16:19.961604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.714 [2024-11-26 19:16:19.961612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:79496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.714 [2024-11-26 19:16:19.961619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.714 [2024-11-26 19:16:19.961626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:79504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.714 [2024-11-26 19:16:19.961634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.714 [2024-11-26 19:16:19.961644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:79520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.714 [2024-11-26 19:16:19.961651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.714 [2024-11-26 19:16:19.961660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:79528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.714 [2024-11-26 19:16:19.961667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.714 [2024-11-26 19:16:19.961675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:79536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.714 [2024-11-26 19:16:19.961682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.714 [2024-11-26 19:16:19.961690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:79552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:09.714 [2024-11-26 19:16:19.961697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.714 [2024-11-26 19:16:19.961706] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdcaf90 is same with the state(5) to be set 00:30:09.714 [2024-11-26 19:16:19.961716] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:30:09.714 [2024-11-26 19:16:19.961723] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:30:09.714 [2024-11-26 19:16:19.961731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:79568 len:8 PRP1 0x0 PRP2 0x0 00:30:09.714 [2024-11-26 19:16:19.961737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.714 [2024-11-26 19:16:19.961778] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xdcaf90 was disconnected and freed. reset controller. 00:30:09.714 [2024-11-26 19:16:19.961788] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4422 to 10.0.0.2:4420 00:30:09.714 [2024-11-26 19:16:19.961811] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:30:09.714 [2024-11-26 19:16:19.961821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.714 [2024-11-26 19:16:19.961829] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:30:09.714 [2024-11-26 19:16:19.961836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.714 [2024-11-26 19:16:19.961844] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:30:09.714 [2024-11-26 19:16:19.961851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.714 [2024-11-26 19:16:19.961858] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:30:09.714 [2024-11-26 19:16:19.961865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:09.715 [2024-11-26 19:16:19.961872] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:09.715 [2024-11-26 19:16:19.963801] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:09.715 [2024-11-26 19:16:19.963832] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xda9960 (9): Bad file descriptor 00:30:09.715 [2024-11-26 19:16:20.110151] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:30:09.715 00:30:09.715 Latency(us) 00:30:09.715 [2024-11-26T18:16:26.642Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:09.715 [2024-11-26T18:16:26.642Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:30:09.715 Verification LBA range: start 0x0 length 0x4000 00:30:09.715 NVMe0n1 : 15.01 16815.76 65.69 1037.84 0.00 7156.22 423.85 12993.22 00:30:09.715 [2024-11-26T18:16:26.642Z] =================================================================================================================== 00:30:09.715 [2024-11-26T18:16:26.642Z] Total : 16815.76 65.69 1037.84 0.00 7156.22 423.85 12993.22 00:30:09.715 Received shutdown signal, test time was about 15.000000 seconds 00:30:09.715 00:30:09.715 Latency(us) 00:30:09.715 [2024-11-26T18:16:26.642Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:09.715 [2024-11-26T18:16:26.642Z] =================================================================================================================== 00:30:09.715 [2024-11-26T18:16:26.642Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:30:09.715 19:16:26 -- host/failover.sh@65 -- # grep -c 'Resetting controller successful' 00:30:09.715 19:16:26 -- host/failover.sh@65 -- # count=3 00:30:09.715 19:16:26 -- host/failover.sh@67 -- # (( count != 3 )) 00:30:09.715 19:16:26 -- host/failover.sh@73 -- # bdevperf_pid=3267927 00:30:09.715 19:16:26 -- host/failover.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 1 -f 00:30:09.715 19:16:26 -- host/failover.sh@75 -- # waitforlisten 3267927 /var/tmp/bdevperf.sock 00:30:09.715 19:16:26 -- common/autotest_common.sh@829 -- # '[' -z 3267927 ']' 00:30:09.715 19:16:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:30:09.715 19:16:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:09.715 19:16:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:30:09.715 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:30:09.715 19:16:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:09.715 19:16:26 -- common/autotest_common.sh@10 -- # set +x 00:30:10.280 19:16:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:10.280 19:16:27 -- common/autotest_common.sh@862 -- # return 0 00:30:10.280 19:16:27 -- host/failover.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:30:10.539 [2024-11-26 19:16:27.276832] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:30:10.539 19:16:27 -- host/failover.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:30:10.797 [2024-11-26 19:16:27.469379] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:30:10.797 19:16:27 -- host/failover.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:30:11.054 NVMe0n1 00:30:11.054 19:16:27 -- host/failover.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:30:11.312 00:30:11.313 19:16:28 -- host/failover.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:30:11.571 00:30:11.571 19:16:28 -- host/failover.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:30:11.571 19:16:28 -- host/failover.sh@82 -- # grep -q NVMe0 00:30:11.830 19:16:28 -- host/failover.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:30:12.089 19:16:28 -- host/failover.sh@87 -- # sleep 3 00:30:15.374 19:16:31 -- host/failover.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:30:15.374 19:16:31 -- host/failover.sh@88 -- # grep -q NVMe0 00:30:15.374 19:16:32 -- host/failover.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:30:15.374 19:16:32 -- host/failover.sh@90 -- # run_test_pid=3268876 00:30:15.374 19:16:32 -- host/failover.sh@92 -- # wait 3268876 00:30:16.310 0 00:30:16.310 19:16:33 -- host/failover.sh@94 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:30:16.310 [2024-11-26 19:16:26.278522] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:30:16.310 [2024-11-26 19:16:26.278576] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3267927 ] 00:30:16.310 EAL: No free 2048 kB hugepages reported on node 1 00:30:16.310 [2024-11-26 19:16:26.334744] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:16.310 [2024-11-26 19:16:26.369771] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:30:16.310 [2024-11-26 19:16:28.841751] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:30:16.310 [2024-11-26 19:16:28.841797] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:30:16.310 [2024-11-26 19:16:28.841808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.310 [2024-11-26 19:16:28.841817] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:30:16.310 [2024-11-26 19:16:28.841824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.310 [2024-11-26 19:16:28.841832] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:30:16.310 [2024-11-26 19:16:28.841839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.311 [2024-11-26 19:16:28.841846] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:30:16.311 [2024-11-26 19:16:28.841853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.311 [2024-11-26 19:16:28.841860] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.311 [2024-11-26 19:16:28.841882] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.311 [2024-11-26 19:16:28.841897] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c4f960 (9): Bad file descriptor 00:30:16.311 [2024-11-26 19:16:28.852306] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:30:16.311 Running I/O for 1 seconds... 00:30:16.311 00:30:16.311 Latency(us) 00:30:16.311 [2024-11-26T18:16:33.238Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:16.311 [2024-11-26T18:16:33.238Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:30:16.311 Verification LBA range: start 0x0 length 0x4000 00:30:16.311 NVMe0n1 : 1.01 17020.05 66.48 0.00 0.00 7490.19 1004.41 8149.26 00:30:16.311 [2024-11-26T18:16:33.238Z] =================================================================================================================== 00:30:16.311 [2024-11-26T18:16:33.238Z] Total : 17020.05 66.48 0.00 0.00 7490.19 1004.41 8149.26 00:30:16.311 19:16:33 -- host/failover.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:30:16.311 19:16:33 -- host/failover.sh@95 -- # grep -q NVMe0 00:30:16.570 19:16:33 -- host/failover.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:30:16.828 19:16:33 -- host/failover.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:30:16.828 19:16:33 -- host/failover.sh@99 -- # grep -q NVMe0 00:30:16.828 19:16:33 -- host/failover.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:30:17.190 19:16:33 -- host/failover.sh@101 -- # sleep 3 00:30:20.548 19:16:36 -- host/failover.sh@103 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:30:20.548 19:16:36 -- host/failover.sh@103 -- # grep -q NVMe0 00:30:20.548 19:16:37 -- host/failover.sh@108 -- # killprocess 3267927 00:30:20.548 19:16:37 -- common/autotest_common.sh@936 -- # '[' -z 3267927 ']' 00:30:20.548 19:16:37 -- common/autotest_common.sh@940 -- # kill -0 3267927 00:30:20.548 19:16:37 -- common/autotest_common.sh@941 -- # uname 00:30:20.548 19:16:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:20.548 19:16:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3267927 00:30:20.548 19:16:37 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:30:20.548 19:16:37 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:30:20.548 19:16:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3267927' 00:30:20.548 killing process with pid 3267927 00:30:20.548 19:16:37 -- common/autotest_common.sh@955 -- # kill 3267927 00:30:20.548 19:16:37 -- common/autotest_common.sh@960 -- # wait 3267927 00:30:20.548 19:16:37 -- host/failover.sh@110 -- # sync 00:30:20.548 19:16:37 -- host/failover.sh@111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:30:20.807 19:16:37 -- host/failover.sh@113 -- # trap - SIGINT SIGTERM EXIT 00:30:20.807 19:16:37 -- host/failover.sh@115 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:30:20.807 19:16:37 -- host/failover.sh@116 -- # nvmftestfini 00:30:20.807 19:16:37 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:20.807 19:16:37 -- nvmf/common.sh@116 -- # sync 00:30:20.807 19:16:37 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:20.807 19:16:37 -- nvmf/common.sh@119 -- # set +e 00:30:20.807 19:16:37 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:20.807 19:16:37 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:20.807 rmmod nvme_tcp 00:30:20.807 rmmod nvme_fabrics 00:30:20.807 rmmod nvme_keyring 00:30:20.807 19:16:37 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:20.807 19:16:37 -- nvmf/common.sh@123 -- # set -e 00:30:20.807 19:16:37 -- nvmf/common.sh@124 -- # return 0 00:30:20.807 19:16:37 -- nvmf/common.sh@477 -- # '[' -n 3264753 ']' 00:30:20.807 19:16:37 -- nvmf/common.sh@478 -- # killprocess 3264753 00:30:20.807 19:16:37 -- common/autotest_common.sh@936 -- # '[' -z 3264753 ']' 00:30:20.807 19:16:37 -- common/autotest_common.sh@940 -- # kill -0 3264753 00:30:20.807 19:16:37 -- common/autotest_common.sh@941 -- # uname 00:30:20.807 19:16:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:20.807 19:16:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3264753 00:30:20.808 19:16:37 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:30:20.808 19:16:37 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:30:20.808 19:16:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3264753' 00:30:20.808 killing process with pid 3264753 00:30:20.808 19:16:37 -- common/autotest_common.sh@955 -- # kill 3264753 00:30:20.808 19:16:37 -- common/autotest_common.sh@960 -- # wait 3264753 00:30:21.067 19:16:37 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:30:21.067 19:16:37 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:21.067 19:16:37 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:21.067 19:16:37 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:21.067 19:16:37 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:21.067 19:16:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:21.067 19:16:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:21.067 19:16:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:22.985 19:16:39 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:22.985 00:30:22.985 real 0m38.167s 00:30:22.985 user 2m3.431s 00:30:22.985 sys 0m7.678s 00:30:22.985 19:16:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:22.985 19:16:39 -- common/autotest_common.sh@10 -- # set +x 00:30:22.985 ************************************ 00:30:22.985 END TEST nvmf_failover 00:30:22.985 ************************************ 00:30:23.244 19:16:39 -- nvmf/nvmf.sh@101 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:30:23.244 19:16:39 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:30:23.244 19:16:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:23.244 19:16:39 -- common/autotest_common.sh@10 -- # set +x 00:30:23.244 ************************************ 00:30:23.244 START TEST nvmf_discovery 00:30:23.244 ************************************ 00:30:23.244 19:16:39 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:30:23.244 * Looking for test storage... 00:30:23.244 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:30:23.244 19:16:40 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:30:23.244 19:16:40 -- common/autotest_common.sh@1690 -- # lcov --version 00:30:23.244 19:16:40 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:30:23.244 19:16:40 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:30:23.244 19:16:40 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:30:23.244 19:16:40 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:30:23.244 19:16:40 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:30:23.245 19:16:40 -- scripts/common.sh@335 -- # IFS=.-: 00:30:23.245 19:16:40 -- scripts/common.sh@335 -- # read -ra ver1 00:30:23.245 19:16:40 -- scripts/common.sh@336 -- # IFS=.-: 00:30:23.245 19:16:40 -- scripts/common.sh@336 -- # read -ra ver2 00:30:23.245 19:16:40 -- scripts/common.sh@337 -- # local 'op=<' 00:30:23.245 19:16:40 -- scripts/common.sh@339 -- # ver1_l=2 00:30:23.245 19:16:40 -- scripts/common.sh@340 -- # ver2_l=1 00:30:23.245 19:16:40 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:30:23.245 19:16:40 -- scripts/common.sh@343 -- # case "$op" in 00:30:23.245 19:16:40 -- scripts/common.sh@344 -- # : 1 00:30:23.245 19:16:40 -- scripts/common.sh@363 -- # (( v = 0 )) 00:30:23.245 19:16:40 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:30:23.245 19:16:40 -- scripts/common.sh@364 -- # decimal 1 00:30:23.245 19:16:40 -- scripts/common.sh@352 -- # local d=1 00:30:23.245 19:16:40 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:30:23.245 19:16:40 -- scripts/common.sh@354 -- # echo 1 00:30:23.245 19:16:40 -- scripts/common.sh@364 -- # ver1[v]=1 00:30:23.245 19:16:40 -- scripts/common.sh@365 -- # decimal 2 00:30:23.245 19:16:40 -- scripts/common.sh@352 -- # local d=2 00:30:23.245 19:16:40 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:30:23.245 19:16:40 -- scripts/common.sh@354 -- # echo 2 00:30:23.245 19:16:40 -- scripts/common.sh@365 -- # ver2[v]=2 00:30:23.245 19:16:40 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:30:23.245 19:16:40 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:30:23.245 19:16:40 -- scripts/common.sh@367 -- # return 0 00:30:23.245 19:16:40 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:30:23.245 19:16:40 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:30:23.245 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:23.245 --rc genhtml_branch_coverage=1 00:30:23.245 --rc genhtml_function_coverage=1 00:30:23.245 --rc genhtml_legend=1 00:30:23.245 --rc geninfo_all_blocks=1 00:30:23.245 --rc geninfo_unexecuted_blocks=1 00:30:23.245 00:30:23.245 ' 00:30:23.245 19:16:40 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:30:23.245 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:23.245 --rc genhtml_branch_coverage=1 00:30:23.245 --rc genhtml_function_coverage=1 00:30:23.245 --rc genhtml_legend=1 00:30:23.245 --rc geninfo_all_blocks=1 00:30:23.245 --rc geninfo_unexecuted_blocks=1 00:30:23.245 00:30:23.245 ' 00:30:23.245 19:16:40 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:30:23.245 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:23.245 --rc genhtml_branch_coverage=1 00:30:23.245 --rc genhtml_function_coverage=1 00:30:23.245 --rc genhtml_legend=1 00:30:23.245 --rc geninfo_all_blocks=1 00:30:23.245 --rc geninfo_unexecuted_blocks=1 00:30:23.245 00:30:23.245 ' 00:30:23.245 19:16:40 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:30:23.245 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:23.245 --rc genhtml_branch_coverage=1 00:30:23.245 --rc genhtml_function_coverage=1 00:30:23.245 --rc genhtml_legend=1 00:30:23.245 --rc geninfo_all_blocks=1 00:30:23.245 --rc geninfo_unexecuted_blocks=1 00:30:23.245 00:30:23.245 ' 00:30:23.245 19:16:40 -- host/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:30:23.245 19:16:40 -- nvmf/common.sh@7 -- # uname -s 00:30:23.245 19:16:40 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:23.245 19:16:40 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:23.245 19:16:40 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:23.245 19:16:40 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:23.245 19:16:40 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:23.245 19:16:40 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:23.245 19:16:40 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:23.245 19:16:40 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:23.245 19:16:40 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:23.245 19:16:40 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:23.245 19:16:40 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:30:23.245 19:16:40 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:30:23.245 19:16:40 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:23.245 19:16:40 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:23.245 19:16:40 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:23.245 19:16:40 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:23.245 19:16:40 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:23.245 19:16:40 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:23.245 19:16:40 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:23.245 19:16:40 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:23.245 19:16:40 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:23.245 19:16:40 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:23.245 19:16:40 -- paths/export.sh@5 -- # export PATH 00:30:23.245 19:16:40 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:23.245 19:16:40 -- nvmf/common.sh@46 -- # : 0 00:30:23.245 19:16:40 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:30:23.245 19:16:40 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:30:23.245 19:16:40 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:30:23.245 19:16:40 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:23.245 19:16:40 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:23.245 19:16:40 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:30:23.245 19:16:40 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:30:23.245 19:16:40 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:30:23.245 19:16:40 -- host/discovery.sh@11 -- # '[' tcp == rdma ']' 00:30:23.245 19:16:40 -- host/discovery.sh@16 -- # DISCOVERY_PORT=8009 00:30:23.245 19:16:40 -- host/discovery.sh@17 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:30:23.245 19:16:40 -- host/discovery.sh@20 -- # NQN=nqn.2016-06.io.spdk:cnode 00:30:23.245 19:16:40 -- host/discovery.sh@22 -- # HOST_NQN=nqn.2021-12.io.spdk:test 00:30:23.245 19:16:40 -- host/discovery.sh@23 -- # HOST_SOCK=/tmp/host.sock 00:30:23.245 19:16:40 -- host/discovery.sh@25 -- # nvmftestinit 00:30:23.245 19:16:40 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:30:23.245 19:16:40 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:30:23.245 19:16:40 -- nvmf/common.sh@436 -- # prepare_net_devs 00:30:23.245 19:16:40 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:30:23.245 19:16:40 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:30:23.245 19:16:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:23.245 19:16:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:23.245 19:16:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:23.245 19:16:40 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:30:23.245 19:16:40 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:30:23.245 19:16:40 -- nvmf/common.sh@284 -- # xtrace_disable 00:30:23.245 19:16:40 -- common/autotest_common.sh@10 -- # set +x 00:30:29.802 19:16:45 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:30:29.802 19:16:45 -- nvmf/common.sh@290 -- # pci_devs=() 00:30:29.802 19:16:45 -- nvmf/common.sh@290 -- # local -a pci_devs 00:30:29.802 19:16:45 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:30:29.802 19:16:45 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:30:29.802 19:16:45 -- nvmf/common.sh@292 -- # pci_drivers=() 00:30:29.802 19:16:45 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:30:29.802 19:16:45 -- nvmf/common.sh@294 -- # net_devs=() 00:30:29.802 19:16:45 -- nvmf/common.sh@294 -- # local -ga net_devs 00:30:29.802 19:16:45 -- nvmf/common.sh@295 -- # e810=() 00:30:29.802 19:16:45 -- nvmf/common.sh@295 -- # local -ga e810 00:30:29.802 19:16:45 -- nvmf/common.sh@296 -- # x722=() 00:30:29.802 19:16:45 -- nvmf/common.sh@296 -- # local -ga x722 00:30:29.802 19:16:45 -- nvmf/common.sh@297 -- # mlx=() 00:30:29.802 19:16:45 -- nvmf/common.sh@297 -- # local -ga mlx 00:30:29.802 19:16:45 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:30:29.802 19:16:45 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:30:29.802 19:16:45 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:30:29.802 19:16:45 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:30:29.802 19:16:45 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:30:29.802 19:16:45 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:30:29.802 19:16:45 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:30:29.802 19:16:45 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:30:29.802 19:16:45 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:30:29.802 19:16:45 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:30:29.802 19:16:45 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:30:29.802 19:16:45 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:30:29.802 19:16:45 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:30:29.802 19:16:45 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:30:29.802 19:16:45 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:30:29.802 19:16:45 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:30:29.802 19:16:45 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:30:29.802 19:16:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:29.802 19:16:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:30:29.802 Found 0000:86:00.0 (0x8086 - 0x159b) 00:30:29.802 19:16:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:29.802 19:16:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:29.802 19:16:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:29.802 19:16:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:29.802 19:16:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:29.802 19:16:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:29.802 19:16:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:30:29.802 Found 0000:86:00.1 (0x8086 - 0x159b) 00:30:29.802 19:16:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:29.802 19:16:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:29.802 19:16:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:29.802 19:16:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:29.802 19:16:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:29.802 19:16:45 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:30:29.803 19:16:45 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:30:29.803 19:16:45 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:30:29.803 19:16:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:29.803 19:16:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:29.803 19:16:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:29.803 19:16:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:29.803 19:16:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:30:29.803 Found net devices under 0000:86:00.0: cvl_0_0 00:30:29.803 19:16:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:29.803 19:16:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:29.803 19:16:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:29.803 19:16:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:29.803 19:16:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:29.803 19:16:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:30:29.803 Found net devices under 0000:86:00.1: cvl_0_1 00:30:29.803 19:16:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:29.803 19:16:45 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:30:29.803 19:16:45 -- nvmf/common.sh@402 -- # is_hw=yes 00:30:29.803 19:16:45 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:30:29.803 19:16:45 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:30:29.803 19:16:45 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:30:29.803 19:16:45 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:30:29.803 19:16:45 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:30:29.803 19:16:45 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:30:29.803 19:16:45 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:30:29.803 19:16:45 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:30:29.803 19:16:45 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:30:29.803 19:16:45 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:30:29.803 19:16:45 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:30:29.803 19:16:45 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:30:29.803 19:16:45 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:30:29.803 19:16:45 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:30:29.803 19:16:45 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:30:29.803 19:16:45 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:30:29.803 19:16:45 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:30:29.803 19:16:45 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:30:29.803 19:16:45 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:30:29.803 19:16:45 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:30:29.803 19:16:45 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:30:29.803 19:16:45 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:30:29.803 19:16:45 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:30:29.803 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:30:29.803 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.352 ms 00:30:29.803 00:30:29.803 --- 10.0.0.2 ping statistics --- 00:30:29.803 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:29.803 rtt min/avg/max/mdev = 0.352/0.352/0.352/0.000 ms 00:30:29.803 19:16:45 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:30:29.803 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:30:29.803 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.206 ms 00:30:29.803 00:30:29.803 --- 10.0.0.1 ping statistics --- 00:30:29.803 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:29.803 rtt min/avg/max/mdev = 0.206/0.206/0.206/0.000 ms 00:30:29.803 19:16:45 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:30:29.803 19:16:45 -- nvmf/common.sh@410 -- # return 0 00:30:29.803 19:16:45 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:30:29.803 19:16:45 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:30:29.803 19:16:45 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:30:29.803 19:16:45 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:30:29.803 19:16:45 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:30:29.803 19:16:45 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:30:29.803 19:16:45 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:30:29.803 19:16:45 -- host/discovery.sh@30 -- # nvmfappstart -m 0x2 00:30:29.803 19:16:45 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:29.803 19:16:45 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:29.803 19:16:45 -- common/autotest_common.sh@10 -- # set +x 00:30:29.803 19:16:45 -- nvmf/common.sh@469 -- # nvmfpid=3273352 00:30:29.803 19:16:45 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:30:29.803 19:16:45 -- nvmf/common.sh@470 -- # waitforlisten 3273352 00:30:29.803 19:16:45 -- common/autotest_common.sh@829 -- # '[' -z 3273352 ']' 00:30:29.803 19:16:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:29.803 19:16:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:29.803 19:16:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:29.803 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:29.803 19:16:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:29.803 19:16:45 -- common/autotest_common.sh@10 -- # set +x 00:30:29.803 [2024-11-26 19:16:46.015100] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:30:29.803 [2024-11-26 19:16:46.015143] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:29.803 EAL: No free 2048 kB hugepages reported on node 1 00:30:29.803 [2024-11-26 19:16:46.075450] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:29.803 [2024-11-26 19:16:46.114003] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:29.803 [2024-11-26 19:16:46.114116] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:29.803 [2024-11-26 19:16:46.114124] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:29.803 [2024-11-26 19:16:46.114130] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:29.803 [2024-11-26 19:16:46.114151] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:30.062 19:16:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:30.062 19:16:46 -- common/autotest_common.sh@862 -- # return 0 00:30:30.062 19:16:46 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:30.062 19:16:46 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:30.062 19:16:46 -- common/autotest_common.sh@10 -- # set +x 00:30:30.062 19:16:46 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:30.062 19:16:46 -- host/discovery.sh@32 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:30:30.062 19:16:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:30.062 19:16:46 -- common/autotest_common.sh@10 -- # set +x 00:30:30.062 [2024-11-26 19:16:46.863802] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:30.062 19:16:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:30.062 19:16:46 -- host/discovery.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2014-08.org.nvmexpress.discovery -t tcp -a 10.0.0.2 -s 8009 00:30:30.062 19:16:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:30.062 19:16:46 -- common/autotest_common.sh@10 -- # set +x 00:30:30.062 [2024-11-26 19:16:46.871987] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:30:30.062 19:16:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:30.062 19:16:46 -- host/discovery.sh@35 -- # rpc_cmd bdev_null_create null0 1000 512 00:30:30.062 19:16:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:30.062 19:16:46 -- common/autotest_common.sh@10 -- # set +x 00:30:30.062 null0 00:30:30.062 19:16:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:30.062 19:16:46 -- host/discovery.sh@36 -- # rpc_cmd bdev_null_create null1 1000 512 00:30:30.062 19:16:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:30.063 19:16:46 -- common/autotest_common.sh@10 -- # set +x 00:30:30.063 null1 00:30:30.063 19:16:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:30.063 19:16:46 -- host/discovery.sh@37 -- # rpc_cmd bdev_wait_for_examine 00:30:30.063 19:16:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:30.063 19:16:46 -- common/autotest_common.sh@10 -- # set +x 00:30:30.063 19:16:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:30.063 19:16:46 -- host/discovery.sh@45 -- # hostpid=3273383 00:30:30.063 19:16:46 -- host/discovery.sh@46 -- # waitforlisten 3273383 /tmp/host.sock 00:30:30.063 19:16:46 -- common/autotest_common.sh@829 -- # '[' -z 3273383 ']' 00:30:30.063 19:16:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:30:30.063 19:16:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:30.063 19:16:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:30:30.063 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:30:30.063 19:16:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:30.063 19:16:46 -- host/discovery.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock 00:30:30.063 19:16:46 -- common/autotest_common.sh@10 -- # set +x 00:30:30.063 [2024-11-26 19:16:46.945363] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:30:30.063 [2024-11-26 19:16:46.945405] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3273383 ] 00:30:30.063 EAL: No free 2048 kB hugepages reported on node 1 00:30:30.322 [2024-11-26 19:16:47.001078] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:30.322 [2024-11-26 19:16:47.040248] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:30.322 [2024-11-26 19:16:47.040368] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:30:30.889 19:16:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:30.889 19:16:47 -- common/autotest_common.sh@862 -- # return 0 00:30:30.889 19:16:47 -- host/discovery.sh@48 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:30:30.889 19:16:47 -- host/discovery.sh@50 -- # rpc_cmd -s /tmp/host.sock log_set_flag bdev_nvme 00:30:30.889 19:16:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:30.889 19:16:47 -- common/autotest_common.sh@10 -- # set +x 00:30:30.889 19:16:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:30.889 19:16:47 -- host/discovery.sh@51 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test 00:30:30.889 19:16:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:30.889 19:16:47 -- common/autotest_common.sh@10 -- # set +x 00:30:30.889 19:16:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:30.889 19:16:47 -- host/discovery.sh@72 -- # notify_id=0 00:30:30.889 19:16:47 -- host/discovery.sh@78 -- # get_subsystem_names 00:30:30.889 19:16:47 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:30:30.889 19:16:47 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:30:30.889 19:16:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:30.889 19:16:47 -- host/discovery.sh@59 -- # sort 00:30:30.889 19:16:47 -- common/autotest_common.sh@10 -- # set +x 00:30:30.889 19:16:47 -- host/discovery.sh@59 -- # xargs 00:30:30.889 19:16:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:31.147 19:16:47 -- host/discovery.sh@78 -- # [[ '' == '' ]] 00:30:31.147 19:16:47 -- host/discovery.sh@79 -- # get_bdev_list 00:30:31.147 19:16:47 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:30:31.147 19:16:47 -- host/discovery.sh@55 -- # xargs 00:30:31.147 19:16:47 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:30:31.147 19:16:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:31.147 19:16:47 -- host/discovery.sh@55 -- # sort 00:30:31.147 19:16:47 -- common/autotest_common.sh@10 -- # set +x 00:30:31.147 19:16:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:31.147 19:16:47 -- host/discovery.sh@79 -- # [[ '' == '' ]] 00:30:31.147 19:16:47 -- host/discovery.sh@81 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 00:30:31.147 19:16:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:31.147 19:16:47 -- common/autotest_common.sh@10 -- # set +x 00:30:31.147 19:16:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:31.147 19:16:47 -- host/discovery.sh@82 -- # get_subsystem_names 00:30:31.147 19:16:47 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:30:31.147 19:16:47 -- host/discovery.sh@59 -- # xargs 00:30:31.147 19:16:47 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:30:31.147 19:16:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:31.147 19:16:47 -- host/discovery.sh@59 -- # sort 00:30:31.147 19:16:47 -- common/autotest_common.sh@10 -- # set +x 00:30:31.147 19:16:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:31.147 19:16:47 -- host/discovery.sh@82 -- # [[ '' == '' ]] 00:30:31.147 19:16:47 -- host/discovery.sh@83 -- # get_bdev_list 00:30:31.147 19:16:47 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:30:31.147 19:16:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:31.147 19:16:47 -- common/autotest_common.sh@10 -- # set +x 00:30:31.147 19:16:47 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:30:31.147 19:16:47 -- host/discovery.sh@55 -- # xargs 00:30:31.147 19:16:47 -- host/discovery.sh@55 -- # sort 00:30:31.147 19:16:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:31.147 19:16:47 -- host/discovery.sh@83 -- # [[ '' == '' ]] 00:30:31.147 19:16:47 -- host/discovery.sh@85 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 00:30:31.147 19:16:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:31.147 19:16:47 -- common/autotest_common.sh@10 -- # set +x 00:30:31.147 19:16:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:31.147 19:16:47 -- host/discovery.sh@86 -- # get_subsystem_names 00:30:31.147 19:16:47 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:30:31.147 19:16:47 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:30:31.147 19:16:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:31.147 19:16:47 -- common/autotest_common.sh@10 -- # set +x 00:30:31.147 19:16:47 -- host/discovery.sh@59 -- # sort 00:30:31.147 19:16:47 -- host/discovery.sh@59 -- # xargs 00:30:31.147 19:16:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:31.147 19:16:48 -- host/discovery.sh@86 -- # [[ '' == '' ]] 00:30:31.147 19:16:48 -- host/discovery.sh@87 -- # get_bdev_list 00:30:31.147 19:16:48 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:30:31.147 19:16:48 -- host/discovery.sh@55 -- # xargs 00:30:31.147 19:16:48 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:30:31.147 19:16:48 -- host/discovery.sh@55 -- # sort 00:30:31.147 19:16:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:31.147 19:16:48 -- common/autotest_common.sh@10 -- # set +x 00:30:31.148 19:16:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:31.148 19:16:48 -- host/discovery.sh@87 -- # [[ '' == '' ]] 00:30:31.148 19:16:48 -- host/discovery.sh@91 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:30:31.148 19:16:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:31.148 19:16:48 -- common/autotest_common.sh@10 -- # set +x 00:30:31.148 [2024-11-26 19:16:48.059155] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:31.148 19:16:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:31.148 19:16:48 -- host/discovery.sh@92 -- # get_subsystem_names 00:30:31.148 19:16:48 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:30:31.148 19:16:48 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:30:31.148 19:16:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:31.148 19:16:48 -- host/discovery.sh@59 -- # sort 00:30:31.148 19:16:48 -- common/autotest_common.sh@10 -- # set +x 00:30:31.148 19:16:48 -- host/discovery.sh@59 -- # xargs 00:30:31.406 19:16:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:31.406 19:16:48 -- host/discovery.sh@92 -- # [[ '' == '' ]] 00:30:31.406 19:16:48 -- host/discovery.sh@93 -- # get_bdev_list 00:30:31.406 19:16:48 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:30:31.406 19:16:48 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:30:31.406 19:16:48 -- host/discovery.sh@55 -- # sort 00:30:31.406 19:16:48 -- host/discovery.sh@55 -- # xargs 00:30:31.406 19:16:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:31.406 19:16:48 -- common/autotest_common.sh@10 -- # set +x 00:30:31.406 19:16:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:31.406 19:16:48 -- host/discovery.sh@93 -- # [[ '' == '' ]] 00:30:31.406 19:16:48 -- host/discovery.sh@94 -- # get_notification_count 00:30:31.406 19:16:48 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:30:31.406 19:16:48 -- host/discovery.sh@74 -- # jq '. | length' 00:30:31.406 19:16:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:31.406 19:16:48 -- common/autotest_common.sh@10 -- # set +x 00:30:31.406 19:16:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:31.406 19:16:48 -- host/discovery.sh@74 -- # notification_count=0 00:30:31.406 19:16:48 -- host/discovery.sh@75 -- # notify_id=0 00:30:31.406 19:16:48 -- host/discovery.sh@95 -- # [[ 0 == 0 ]] 00:30:31.406 19:16:48 -- host/discovery.sh@99 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2021-12.io.spdk:test 00:30:31.406 19:16:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:31.406 19:16:48 -- common/autotest_common.sh@10 -- # set +x 00:30:31.406 19:16:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:31.406 19:16:48 -- host/discovery.sh@100 -- # sleep 1 00:30:31.974 [2024-11-26 19:16:48.822518] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:30:31.974 [2024-11-26 19:16:48.822539] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:30:31.974 [2024-11-26 19:16:48.822551] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:30:32.233 [2024-11-26 19:16:48.910816] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:30:32.233 [2024-11-26 19:16:49.013829] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:30:32.233 [2024-11-26 19:16:49.013847] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:30:32.492 19:16:49 -- host/discovery.sh@101 -- # get_subsystem_names 00:30:32.492 19:16:49 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:30:32.492 19:16:49 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:30:32.492 19:16:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:32.492 19:16:49 -- host/discovery.sh@59 -- # sort 00:30:32.492 19:16:49 -- common/autotest_common.sh@10 -- # set +x 00:30:32.492 19:16:49 -- host/discovery.sh@59 -- # xargs 00:30:32.492 19:16:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:32.492 19:16:49 -- host/discovery.sh@101 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:30:32.492 19:16:49 -- host/discovery.sh@102 -- # get_bdev_list 00:30:32.492 19:16:49 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:30:32.492 19:16:49 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:30:32.492 19:16:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:32.492 19:16:49 -- host/discovery.sh@55 -- # sort 00:30:32.492 19:16:49 -- common/autotest_common.sh@10 -- # set +x 00:30:32.492 19:16:49 -- host/discovery.sh@55 -- # xargs 00:30:32.492 19:16:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:32.492 19:16:49 -- host/discovery.sh@102 -- # [[ nvme0n1 == \n\v\m\e\0\n\1 ]] 00:30:32.492 19:16:49 -- host/discovery.sh@103 -- # get_subsystem_paths nvme0 00:30:32.492 19:16:49 -- host/discovery.sh@63 -- # sort -n 00:30:32.492 19:16:49 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:30:32.492 19:16:49 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:30:32.492 19:16:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:32.492 19:16:49 -- common/autotest_common.sh@10 -- # set +x 00:30:32.492 19:16:49 -- host/discovery.sh@63 -- # xargs 00:30:32.492 19:16:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:32.492 19:16:49 -- host/discovery.sh@103 -- # [[ 4420 == \4\4\2\0 ]] 00:30:32.492 19:16:49 -- host/discovery.sh@104 -- # get_notification_count 00:30:32.492 19:16:49 -- host/discovery.sh@74 -- # jq '. | length' 00:30:32.492 19:16:49 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:30:32.492 19:16:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:32.492 19:16:49 -- common/autotest_common.sh@10 -- # set +x 00:30:32.492 19:16:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:32.492 19:16:49 -- host/discovery.sh@74 -- # notification_count=1 00:30:32.492 19:16:49 -- host/discovery.sh@75 -- # notify_id=1 00:30:32.492 19:16:49 -- host/discovery.sh@105 -- # [[ 1 == 1 ]] 00:30:32.492 19:16:49 -- host/discovery.sh@108 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null1 00:30:32.492 19:16:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:32.492 19:16:49 -- common/autotest_common.sh@10 -- # set +x 00:30:32.492 19:16:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:32.492 19:16:49 -- host/discovery.sh@109 -- # sleep 1 00:30:33.869 19:16:50 -- host/discovery.sh@110 -- # get_bdev_list 00:30:33.869 19:16:50 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:30:33.869 19:16:50 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:30:33.869 19:16:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:33.869 19:16:50 -- host/discovery.sh@55 -- # sort 00:30:33.869 19:16:50 -- common/autotest_common.sh@10 -- # set +x 00:30:33.869 19:16:50 -- host/discovery.sh@55 -- # xargs 00:30:33.869 19:16:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:33.869 19:16:50 -- host/discovery.sh@110 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:30:33.869 19:16:50 -- host/discovery.sh@111 -- # get_notification_count 00:30:33.869 19:16:50 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 1 00:30:33.869 19:16:50 -- host/discovery.sh@74 -- # jq '. | length' 00:30:33.869 19:16:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:33.869 19:16:50 -- common/autotest_common.sh@10 -- # set +x 00:30:33.869 19:16:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:33.869 19:16:50 -- host/discovery.sh@74 -- # notification_count=1 00:30:33.869 19:16:50 -- host/discovery.sh@75 -- # notify_id=2 00:30:33.869 19:16:50 -- host/discovery.sh@112 -- # [[ 1 == 1 ]] 00:30:33.869 19:16:50 -- host/discovery.sh@116 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 00:30:33.869 19:16:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:33.869 19:16:50 -- common/autotest_common.sh@10 -- # set +x 00:30:33.869 [2024-11-26 19:16:50.465849] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:30:33.869 [2024-11-26 19:16:50.466861] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:30:33.869 [2024-11-26 19:16:50.466887] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:30:33.869 19:16:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:33.869 19:16:50 -- host/discovery.sh@117 -- # sleep 1 00:30:33.869 [2024-11-26 19:16:50.594257] bdev_nvme.c:6683:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new path for nvme0 00:30:33.869 [2024-11-26 19:16:50.657805] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:30:33.869 [2024-11-26 19:16:50.657822] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:30:33.869 [2024-11-26 19:16:50.657828] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:30:34.806 19:16:51 -- host/discovery.sh@118 -- # get_subsystem_names 00:30:34.806 19:16:51 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:30:34.806 19:16:51 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:30:34.806 19:16:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:34.806 19:16:51 -- host/discovery.sh@59 -- # sort 00:30:34.806 19:16:51 -- common/autotest_common.sh@10 -- # set +x 00:30:34.806 19:16:51 -- host/discovery.sh@59 -- # xargs 00:30:34.806 19:16:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:34.806 19:16:51 -- host/discovery.sh@118 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:30:34.806 19:16:51 -- host/discovery.sh@119 -- # get_bdev_list 00:30:34.806 19:16:51 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:30:34.806 19:16:51 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:30:34.806 19:16:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:34.806 19:16:51 -- host/discovery.sh@55 -- # sort 00:30:34.806 19:16:51 -- common/autotest_common.sh@10 -- # set +x 00:30:34.806 19:16:51 -- host/discovery.sh@55 -- # xargs 00:30:34.806 19:16:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:34.806 19:16:51 -- host/discovery.sh@119 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:30:34.806 19:16:51 -- host/discovery.sh@120 -- # get_subsystem_paths nvme0 00:30:34.806 19:16:51 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:30:34.806 19:16:51 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:30:34.806 19:16:51 -- host/discovery.sh@63 -- # sort -n 00:30:34.807 19:16:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:34.807 19:16:51 -- host/discovery.sh@63 -- # xargs 00:30:34.807 19:16:51 -- common/autotest_common.sh@10 -- # set +x 00:30:34.807 19:16:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:34.807 19:16:51 -- host/discovery.sh@120 -- # [[ 4420 4421 == \4\4\2\0\ \4\4\2\1 ]] 00:30:34.807 19:16:51 -- host/discovery.sh@121 -- # get_notification_count 00:30:34.807 19:16:51 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:30:34.807 19:16:51 -- host/discovery.sh@74 -- # jq '. | length' 00:30:34.807 19:16:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:34.807 19:16:51 -- common/autotest_common.sh@10 -- # set +x 00:30:34.807 19:16:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:34.807 19:16:51 -- host/discovery.sh@74 -- # notification_count=0 00:30:34.807 19:16:51 -- host/discovery.sh@75 -- # notify_id=2 00:30:34.807 19:16:51 -- host/discovery.sh@122 -- # [[ 0 == 0 ]] 00:30:34.807 19:16:51 -- host/discovery.sh@126 -- # rpc_cmd nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:30:34.807 19:16:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:34.807 19:16:51 -- common/autotest_common.sh@10 -- # set +x 00:30:34.807 [2024-11-26 19:16:51.666044] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:30:34.807 [2024-11-26 19:16:51.666067] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:30:34.807 19:16:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:34.807 19:16:51 -- host/discovery.sh@127 -- # sleep 1 00:30:34.807 [2024-11-26 19:16:51.675165] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:30:34.807 [2024-11-26 19:16:51.675186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:34.807 [2024-11-26 19:16:51.675194] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:30:34.807 [2024-11-26 19:16:51.675202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:34.807 [2024-11-26 19:16:51.675209] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:30:34.807 [2024-11-26 19:16:51.675216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:34.807 [2024-11-26 19:16:51.675223] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:30:34.807 [2024-11-26 19:16:51.675229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:34.807 [2024-11-26 19:16:51.675235] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b6e90 is same with the state(5) to be set 00:30:34.807 [2024-11-26 19:16:51.685178] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b6e90 (9): Bad file descriptor 00:30:34.807 [2024-11-26 19:16:51.695219] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:30:34.807 [2024-11-26 19:16:51.695458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.807 [2024-11-26 19:16:51.695567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.807 [2024-11-26 19:16:51.695580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b6e90 with addr=10.0.0.2, port=4420 00:30:34.807 [2024-11-26 19:16:51.695589] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b6e90 is same with the state(5) to be set 00:30:34.807 [2024-11-26 19:16:51.695601] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b6e90 (9): Bad file descriptor 00:30:34.807 [2024-11-26 19:16:51.695618] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:30:34.807 [2024-11-26 19:16:51.695625] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:30:34.807 [2024-11-26 19:16:51.695633] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:30:34.807 [2024-11-26 19:16:51.695644] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:34.807 [2024-11-26 19:16:51.705270] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:30:34.807 [2024-11-26 19:16:51.705441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.807 [2024-11-26 19:16:51.705585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.807 [2024-11-26 19:16:51.705596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b6e90 with addr=10.0.0.2, port=4420 00:30:34.807 [2024-11-26 19:16:51.705604] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b6e90 is same with the state(5) to be set 00:30:34.807 [2024-11-26 19:16:51.705614] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b6e90 (9): Bad file descriptor 00:30:34.807 [2024-11-26 19:16:51.705624] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:30:34.807 [2024-11-26 19:16:51.705631] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:30:34.807 [2024-11-26 19:16:51.705638] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:30:34.807 [2024-11-26 19:16:51.705647] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:34.807 [2024-11-26 19:16:51.715323] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:30:34.807 [2024-11-26 19:16:51.715502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.807 [2024-11-26 19:16:51.715770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.807 [2024-11-26 19:16:51.715784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b6e90 with addr=10.0.0.2, port=4420 00:30:34.807 [2024-11-26 19:16:51.715793] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b6e90 is same with the state(5) to be set 00:30:34.807 [2024-11-26 19:16:51.715806] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b6e90 (9): Bad file descriptor 00:30:34.807 [2024-11-26 19:16:51.715822] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:30:34.807 [2024-11-26 19:16:51.715830] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:30:34.807 [2024-11-26 19:16:51.715838] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:30:34.807 [2024-11-26 19:16:51.715847] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:34.807 [2024-11-26 19:16:51.725380] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:30:34.807 [2024-11-26 19:16:51.725543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.807 [2024-11-26 19:16:51.725698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.807 [2024-11-26 19:16:51.725711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b6e90 with addr=10.0.0.2, port=4420 00:30:34.807 [2024-11-26 19:16:51.725721] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b6e90 is same with the state(5) to be set 00:30:34.807 [2024-11-26 19:16:51.725733] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b6e90 (9): Bad file descriptor 00:30:34.807 [2024-11-26 19:16:51.725743] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:30:34.807 [2024-11-26 19:16:51.725750] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:30:34.807 [2024-11-26 19:16:51.725756] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:30:34.807 [2024-11-26 19:16:51.725766] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:35.066 [2024-11-26 19:16:51.735433] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:30:35.066 [2024-11-26 19:16:51.735565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.066 [2024-11-26 19:16:51.735741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.066 [2024-11-26 19:16:51.735752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b6e90 with addr=10.0.0.2, port=4420 00:30:35.066 [2024-11-26 19:16:51.735759] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b6e90 is same with the state(5) to be set 00:30:35.066 [2024-11-26 19:16:51.735770] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b6e90 (9): Bad file descriptor 00:30:35.066 [2024-11-26 19:16:51.735780] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:30:35.066 [2024-11-26 19:16:51.735787] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:30:35.066 [2024-11-26 19:16:51.735794] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:30:35.066 [2024-11-26 19:16:51.735804] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:35.066 [2024-11-26 19:16:51.745483] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:30:35.066 [2024-11-26 19:16:51.745718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.066 [2024-11-26 19:16:51.745869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.066 [2024-11-26 19:16:51.745880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b6e90 with addr=10.0.0.2, port=4420 00:30:35.066 [2024-11-26 19:16:51.745888] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b6e90 is same with the state(5) to be set 00:30:35.066 [2024-11-26 19:16:51.745898] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b6e90 (9): Bad file descriptor 00:30:35.066 [2024-11-26 19:16:51.745908] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:30:35.066 [2024-11-26 19:16:51.745915] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:30:35.066 [2024-11-26 19:16:51.745921] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:30:35.066 [2024-11-26 19:16:51.745930] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:35.066 [2024-11-26 19:16:51.752320] bdev_nvme.c:6546:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 not found 00:30:35.066 [2024-11-26 19:16:51.752337] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:30:36.001 19:16:52 -- host/discovery.sh@128 -- # get_subsystem_names 00:30:36.001 19:16:52 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:30:36.001 19:16:52 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:30:36.001 19:16:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:36.001 19:16:52 -- host/discovery.sh@59 -- # sort 00:30:36.001 19:16:52 -- common/autotest_common.sh@10 -- # set +x 00:30:36.001 19:16:52 -- host/discovery.sh@59 -- # xargs 00:30:36.001 19:16:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:36.001 19:16:52 -- host/discovery.sh@128 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:30:36.001 19:16:52 -- host/discovery.sh@129 -- # get_bdev_list 00:30:36.001 19:16:52 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:30:36.001 19:16:52 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:30:36.001 19:16:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:36.001 19:16:52 -- host/discovery.sh@55 -- # sort 00:30:36.001 19:16:52 -- common/autotest_common.sh@10 -- # set +x 00:30:36.001 19:16:52 -- host/discovery.sh@55 -- # xargs 00:30:36.001 19:16:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:36.001 19:16:52 -- host/discovery.sh@129 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:30:36.001 19:16:52 -- host/discovery.sh@130 -- # get_subsystem_paths nvme0 00:30:36.001 19:16:52 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:30:36.001 19:16:52 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:30:36.001 19:16:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:36.001 19:16:52 -- host/discovery.sh@63 -- # sort -n 00:30:36.001 19:16:52 -- common/autotest_common.sh@10 -- # set +x 00:30:36.001 19:16:52 -- host/discovery.sh@63 -- # xargs 00:30:36.001 19:16:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:36.001 19:16:52 -- host/discovery.sh@130 -- # [[ 4421 == \4\4\2\1 ]] 00:30:36.001 19:16:52 -- host/discovery.sh@131 -- # get_notification_count 00:30:36.001 19:16:52 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:30:36.001 19:16:52 -- host/discovery.sh@74 -- # jq '. | length' 00:30:36.001 19:16:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:36.001 19:16:52 -- common/autotest_common.sh@10 -- # set +x 00:30:36.001 19:16:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:36.001 19:16:52 -- host/discovery.sh@74 -- # notification_count=0 00:30:36.001 19:16:52 -- host/discovery.sh@75 -- # notify_id=2 00:30:36.001 19:16:52 -- host/discovery.sh@132 -- # [[ 0 == 0 ]] 00:30:36.001 19:16:52 -- host/discovery.sh@134 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_stop_discovery -b nvme 00:30:36.001 19:16:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:36.001 19:16:52 -- common/autotest_common.sh@10 -- # set +x 00:30:36.001 19:16:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:36.001 19:16:52 -- host/discovery.sh@135 -- # sleep 1 00:30:37.378 19:16:53 -- host/discovery.sh@136 -- # get_subsystem_names 00:30:37.378 19:16:53 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:30:37.378 19:16:53 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:30:37.378 19:16:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:37.378 19:16:53 -- host/discovery.sh@59 -- # sort 00:30:37.378 19:16:53 -- common/autotest_common.sh@10 -- # set +x 00:30:37.378 19:16:53 -- host/discovery.sh@59 -- # xargs 00:30:37.378 19:16:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:37.378 19:16:53 -- host/discovery.sh@136 -- # [[ '' == '' ]] 00:30:37.378 19:16:53 -- host/discovery.sh@137 -- # get_bdev_list 00:30:37.378 19:16:53 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:30:37.378 19:16:53 -- host/discovery.sh@55 -- # xargs 00:30:37.378 19:16:53 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:30:37.378 19:16:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:37.378 19:16:53 -- host/discovery.sh@55 -- # sort 00:30:37.378 19:16:53 -- common/autotest_common.sh@10 -- # set +x 00:30:37.378 19:16:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:37.378 19:16:53 -- host/discovery.sh@137 -- # [[ '' == '' ]] 00:30:37.378 19:16:53 -- host/discovery.sh@138 -- # get_notification_count 00:30:37.378 19:16:53 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:30:37.378 19:16:53 -- host/discovery.sh@74 -- # jq '. | length' 00:30:37.378 19:16:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:37.378 19:16:53 -- common/autotest_common.sh@10 -- # set +x 00:30:37.378 19:16:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:37.378 19:16:54 -- host/discovery.sh@74 -- # notification_count=2 00:30:37.378 19:16:54 -- host/discovery.sh@75 -- # notify_id=4 00:30:37.378 19:16:54 -- host/discovery.sh@139 -- # [[ 2 == 2 ]] 00:30:37.378 19:16:54 -- host/discovery.sh@142 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:30:37.378 19:16:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:37.378 19:16:54 -- common/autotest_common.sh@10 -- # set +x 00:30:38.313 [2024-11-26 19:16:55.027389] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:30:38.313 [2024-11-26 19:16:55.027408] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:30:38.313 [2024-11-26 19:16:55.027419] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:30:38.313 [2024-11-26 19:16:55.114681] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new subsystem nvme0 00:30:38.572 [2024-11-26 19:16:55.377735] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:30:38.572 [2024-11-26 19:16:55.377762] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:30:38.572 19:16:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:38.572 19:16:55 -- host/discovery.sh@144 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:30:38.572 19:16:55 -- common/autotest_common.sh@650 -- # local es=0 00:30:38.572 19:16:55 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:30:38.572 19:16:55 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:30:38.572 19:16:55 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:30:38.572 19:16:55 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:30:38.572 19:16:55 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:30:38.572 19:16:55 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:30:38.572 19:16:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:38.572 19:16:55 -- common/autotest_common.sh@10 -- # set +x 00:30:38.572 request: 00:30:38.572 { 00:30:38.572 "name": "nvme", 00:30:38.573 "trtype": "tcp", 00:30:38.573 "traddr": "10.0.0.2", 00:30:38.573 "hostnqn": "nqn.2021-12.io.spdk:test", 00:30:38.573 "adrfam": "ipv4", 00:30:38.573 "trsvcid": "8009", 00:30:38.573 "wait_for_attach": true, 00:30:38.573 "method": "bdev_nvme_start_discovery", 00:30:38.573 "req_id": 1 00:30:38.573 } 00:30:38.573 Got JSON-RPC error response 00:30:38.573 response: 00:30:38.573 { 00:30:38.573 "code": -17, 00:30:38.573 "message": "File exists" 00:30:38.573 } 00:30:38.573 19:16:55 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:30:38.573 19:16:55 -- common/autotest_common.sh@653 -- # es=1 00:30:38.573 19:16:55 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:30:38.573 19:16:55 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:30:38.573 19:16:55 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:30:38.573 19:16:55 -- host/discovery.sh@146 -- # get_discovery_ctrlrs 00:30:38.573 19:16:55 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:30:38.573 19:16:55 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:30:38.573 19:16:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:38.573 19:16:55 -- host/discovery.sh@67 -- # sort 00:30:38.573 19:16:55 -- common/autotest_common.sh@10 -- # set +x 00:30:38.573 19:16:55 -- host/discovery.sh@67 -- # xargs 00:30:38.573 19:16:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:38.573 19:16:55 -- host/discovery.sh@146 -- # [[ nvme == \n\v\m\e ]] 00:30:38.573 19:16:55 -- host/discovery.sh@147 -- # get_bdev_list 00:30:38.573 19:16:55 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:30:38.573 19:16:55 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:30:38.573 19:16:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:38.573 19:16:55 -- host/discovery.sh@55 -- # sort 00:30:38.573 19:16:55 -- common/autotest_common.sh@10 -- # set +x 00:30:38.573 19:16:55 -- host/discovery.sh@55 -- # xargs 00:30:38.573 19:16:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:38.573 19:16:55 -- host/discovery.sh@147 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:30:38.573 19:16:55 -- host/discovery.sh@150 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:30:38.573 19:16:55 -- common/autotest_common.sh@650 -- # local es=0 00:30:38.573 19:16:55 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:30:38.573 19:16:55 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:30:38.831 19:16:55 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:30:38.831 19:16:55 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:30:38.832 19:16:55 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:30:38.832 19:16:55 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:30:38.832 19:16:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:38.832 19:16:55 -- common/autotest_common.sh@10 -- # set +x 00:30:38.832 request: 00:30:38.832 { 00:30:38.832 "name": "nvme_second", 00:30:38.832 "trtype": "tcp", 00:30:38.832 "traddr": "10.0.0.2", 00:30:38.832 "hostnqn": "nqn.2021-12.io.spdk:test", 00:30:38.832 "adrfam": "ipv4", 00:30:38.832 "trsvcid": "8009", 00:30:38.832 "wait_for_attach": true, 00:30:38.832 "method": "bdev_nvme_start_discovery", 00:30:38.832 "req_id": 1 00:30:38.832 } 00:30:38.832 Got JSON-RPC error response 00:30:38.832 response: 00:30:38.832 { 00:30:38.832 "code": -17, 00:30:38.832 "message": "File exists" 00:30:38.832 } 00:30:38.832 19:16:55 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:30:38.832 19:16:55 -- common/autotest_common.sh@653 -- # es=1 00:30:38.832 19:16:55 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:30:38.832 19:16:55 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:30:38.832 19:16:55 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:30:38.832 19:16:55 -- host/discovery.sh@152 -- # get_discovery_ctrlrs 00:30:38.832 19:16:55 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:30:38.832 19:16:55 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:30:38.832 19:16:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:38.832 19:16:55 -- host/discovery.sh@67 -- # sort 00:30:38.832 19:16:55 -- common/autotest_common.sh@10 -- # set +x 00:30:38.832 19:16:55 -- host/discovery.sh@67 -- # xargs 00:30:38.832 19:16:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:38.832 19:16:55 -- host/discovery.sh@152 -- # [[ nvme == \n\v\m\e ]] 00:30:38.832 19:16:55 -- host/discovery.sh@153 -- # get_bdev_list 00:30:38.832 19:16:55 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:30:38.832 19:16:55 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:30:38.832 19:16:55 -- host/discovery.sh@55 -- # xargs 00:30:38.832 19:16:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:38.832 19:16:55 -- host/discovery.sh@55 -- # sort 00:30:38.832 19:16:55 -- common/autotest_common.sh@10 -- # set +x 00:30:38.832 19:16:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:38.832 19:16:55 -- host/discovery.sh@153 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:30:38.832 19:16:55 -- host/discovery.sh@156 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:30:38.832 19:16:55 -- common/autotest_common.sh@650 -- # local es=0 00:30:38.832 19:16:55 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:30:38.832 19:16:55 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:30:38.832 19:16:55 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:30:38.832 19:16:55 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:30:38.832 19:16:55 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:30:38.832 19:16:55 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:30:38.832 19:16:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:38.832 19:16:55 -- common/autotest_common.sh@10 -- # set +x 00:30:39.766 [2024-11-26 19:16:56.606701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.766 [2024-11-26 19:16:56.606937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.766 [2024-11-26 19:16:56.606956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11e7df0 with addr=10.0.0.2, port=8010 00:30:39.766 [2024-11-26 19:16:56.606971] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:30:39.766 [2024-11-26 19:16:56.606978] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:30:39.766 [2024-11-26 19:16:56.606985] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:30:40.703 [2024-11-26 19:16:57.609170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.703 [2024-11-26 19:16:57.609442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.703 [2024-11-26 19:16:57.609455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11e7680 with addr=10.0.0.2, port=8010 00:30:40.703 [2024-11-26 19:16:57.609468] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:30:40.703 [2024-11-26 19:16:57.609476] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:30:40.703 [2024-11-26 19:16:57.609483] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:30:42.080 [2024-11-26 19:16:58.611330] bdev_nvme.c:6802:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] timed out while attaching discovery ctrlr 00:30:42.081 request: 00:30:42.081 { 00:30:42.081 "name": "nvme_second", 00:30:42.081 "trtype": "tcp", 00:30:42.081 "traddr": "10.0.0.2", 00:30:42.081 "hostnqn": "nqn.2021-12.io.spdk:test", 00:30:42.081 "adrfam": "ipv4", 00:30:42.081 "trsvcid": "8010", 00:30:42.081 "attach_timeout_ms": 3000, 00:30:42.081 "method": "bdev_nvme_start_discovery", 00:30:42.081 "req_id": 1 00:30:42.081 } 00:30:42.081 Got JSON-RPC error response 00:30:42.081 response: 00:30:42.081 { 00:30:42.081 "code": -110, 00:30:42.081 "message": "Connection timed out" 00:30:42.081 } 00:30:42.081 19:16:58 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:30:42.081 19:16:58 -- common/autotest_common.sh@653 -- # es=1 00:30:42.081 19:16:58 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:30:42.081 19:16:58 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:30:42.081 19:16:58 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:30:42.081 19:16:58 -- host/discovery.sh@158 -- # get_discovery_ctrlrs 00:30:42.081 19:16:58 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:30:42.081 19:16:58 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:30:42.081 19:16:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:42.081 19:16:58 -- host/discovery.sh@67 -- # sort 00:30:42.081 19:16:58 -- common/autotest_common.sh@10 -- # set +x 00:30:42.081 19:16:58 -- host/discovery.sh@67 -- # xargs 00:30:42.081 19:16:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:42.081 19:16:58 -- host/discovery.sh@158 -- # [[ nvme == \n\v\m\e ]] 00:30:42.081 19:16:58 -- host/discovery.sh@160 -- # trap - SIGINT SIGTERM EXIT 00:30:42.081 19:16:58 -- host/discovery.sh@162 -- # kill 3273383 00:30:42.081 19:16:58 -- host/discovery.sh@163 -- # nvmftestfini 00:30:42.081 19:16:58 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:42.081 19:16:58 -- nvmf/common.sh@116 -- # sync 00:30:42.081 19:16:58 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:42.081 19:16:58 -- nvmf/common.sh@119 -- # set +e 00:30:42.081 19:16:58 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:42.081 19:16:58 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:42.081 rmmod nvme_tcp 00:30:42.081 rmmod nvme_fabrics 00:30:42.081 rmmod nvme_keyring 00:30:42.081 19:16:58 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:42.081 19:16:58 -- nvmf/common.sh@123 -- # set -e 00:30:42.081 19:16:58 -- nvmf/common.sh@124 -- # return 0 00:30:42.081 19:16:58 -- nvmf/common.sh@477 -- # '[' -n 3273352 ']' 00:30:42.081 19:16:58 -- nvmf/common.sh@478 -- # killprocess 3273352 00:30:42.081 19:16:58 -- common/autotest_common.sh@936 -- # '[' -z 3273352 ']' 00:30:42.081 19:16:58 -- common/autotest_common.sh@940 -- # kill -0 3273352 00:30:42.081 19:16:58 -- common/autotest_common.sh@941 -- # uname 00:30:42.081 19:16:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:42.081 19:16:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3273352 00:30:42.081 19:16:58 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:30:42.081 19:16:58 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:30:42.081 19:16:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3273352' 00:30:42.081 killing process with pid 3273352 00:30:42.081 19:16:58 -- common/autotest_common.sh@955 -- # kill 3273352 00:30:42.081 19:16:58 -- common/autotest_common.sh@960 -- # wait 3273352 00:30:42.081 19:16:58 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:30:42.081 19:16:58 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:42.081 19:16:58 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:42.081 19:16:58 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:42.081 19:16:58 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:42.081 19:16:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:42.081 19:16:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:42.081 19:16:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:44.617 19:17:01 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:44.617 00:30:44.617 real 0m21.094s 00:30:44.617 user 0m27.803s 00:30:44.617 sys 0m5.840s 00:30:44.617 19:17:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:44.617 19:17:01 -- common/autotest_common.sh@10 -- # set +x 00:30:44.617 ************************************ 00:30:44.617 END TEST nvmf_discovery 00:30:44.617 ************************************ 00:30:44.617 19:17:01 -- nvmf/nvmf.sh@102 -- # run_test nvmf_discovery_remove_ifc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:30:44.617 19:17:01 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:30:44.617 19:17:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:44.617 19:17:01 -- common/autotest_common.sh@10 -- # set +x 00:30:44.617 ************************************ 00:30:44.617 START TEST nvmf_discovery_remove_ifc 00:30:44.617 ************************************ 00:30:44.617 19:17:01 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:30:44.617 * Looking for test storage... 00:30:44.617 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:30:44.617 19:17:01 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:30:44.617 19:17:01 -- common/autotest_common.sh@1690 -- # lcov --version 00:30:44.617 19:17:01 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:30:44.617 19:17:01 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:30:44.617 19:17:01 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:30:44.617 19:17:01 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:30:44.617 19:17:01 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:30:44.617 19:17:01 -- scripts/common.sh@335 -- # IFS=.-: 00:30:44.617 19:17:01 -- scripts/common.sh@335 -- # read -ra ver1 00:30:44.617 19:17:01 -- scripts/common.sh@336 -- # IFS=.-: 00:30:44.617 19:17:01 -- scripts/common.sh@336 -- # read -ra ver2 00:30:44.617 19:17:01 -- scripts/common.sh@337 -- # local 'op=<' 00:30:44.617 19:17:01 -- scripts/common.sh@339 -- # ver1_l=2 00:30:44.617 19:17:01 -- scripts/common.sh@340 -- # ver2_l=1 00:30:44.617 19:17:01 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:30:44.617 19:17:01 -- scripts/common.sh@343 -- # case "$op" in 00:30:44.617 19:17:01 -- scripts/common.sh@344 -- # : 1 00:30:44.617 19:17:01 -- scripts/common.sh@363 -- # (( v = 0 )) 00:30:44.617 19:17:01 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:30:44.617 19:17:01 -- scripts/common.sh@364 -- # decimal 1 00:30:44.617 19:17:01 -- scripts/common.sh@352 -- # local d=1 00:30:44.617 19:17:01 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:30:44.617 19:17:01 -- scripts/common.sh@354 -- # echo 1 00:30:44.617 19:17:01 -- scripts/common.sh@364 -- # ver1[v]=1 00:30:44.617 19:17:01 -- scripts/common.sh@365 -- # decimal 2 00:30:44.617 19:17:01 -- scripts/common.sh@352 -- # local d=2 00:30:44.617 19:17:01 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:30:44.617 19:17:01 -- scripts/common.sh@354 -- # echo 2 00:30:44.617 19:17:01 -- scripts/common.sh@365 -- # ver2[v]=2 00:30:44.617 19:17:01 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:30:44.617 19:17:01 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:30:44.617 19:17:01 -- scripts/common.sh@367 -- # return 0 00:30:44.617 19:17:01 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:30:44.617 19:17:01 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:30:44.617 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:44.617 --rc genhtml_branch_coverage=1 00:30:44.617 --rc genhtml_function_coverage=1 00:30:44.617 --rc genhtml_legend=1 00:30:44.617 --rc geninfo_all_blocks=1 00:30:44.617 --rc geninfo_unexecuted_blocks=1 00:30:44.617 00:30:44.617 ' 00:30:44.617 19:17:01 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:30:44.617 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:44.617 --rc genhtml_branch_coverage=1 00:30:44.617 --rc genhtml_function_coverage=1 00:30:44.617 --rc genhtml_legend=1 00:30:44.617 --rc geninfo_all_blocks=1 00:30:44.617 --rc geninfo_unexecuted_blocks=1 00:30:44.617 00:30:44.617 ' 00:30:44.617 19:17:01 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:30:44.617 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:44.617 --rc genhtml_branch_coverage=1 00:30:44.617 --rc genhtml_function_coverage=1 00:30:44.617 --rc genhtml_legend=1 00:30:44.617 --rc geninfo_all_blocks=1 00:30:44.617 --rc geninfo_unexecuted_blocks=1 00:30:44.617 00:30:44.617 ' 00:30:44.617 19:17:01 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:30:44.617 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:44.617 --rc genhtml_branch_coverage=1 00:30:44.617 --rc genhtml_function_coverage=1 00:30:44.617 --rc genhtml_legend=1 00:30:44.617 --rc geninfo_all_blocks=1 00:30:44.617 --rc geninfo_unexecuted_blocks=1 00:30:44.617 00:30:44.617 ' 00:30:44.617 19:17:01 -- host/discovery_remove_ifc.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:30:44.617 19:17:01 -- nvmf/common.sh@7 -- # uname -s 00:30:44.617 19:17:01 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:44.617 19:17:01 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:44.617 19:17:01 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:44.617 19:17:01 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:44.617 19:17:01 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:44.617 19:17:01 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:44.617 19:17:01 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:44.617 19:17:01 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:44.617 19:17:01 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:44.617 19:17:01 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:44.617 19:17:01 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:30:44.617 19:17:01 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:30:44.617 19:17:01 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:44.617 19:17:01 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:44.617 19:17:01 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:44.617 19:17:01 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:44.617 19:17:01 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:44.617 19:17:01 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:44.617 19:17:01 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:44.617 19:17:01 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:44.617 19:17:01 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:44.617 19:17:01 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:44.617 19:17:01 -- paths/export.sh@5 -- # export PATH 00:30:44.618 19:17:01 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:44.618 19:17:01 -- nvmf/common.sh@46 -- # : 0 00:30:44.618 19:17:01 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:30:44.618 19:17:01 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:30:44.618 19:17:01 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:30:44.618 19:17:01 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:44.618 19:17:01 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:44.618 19:17:01 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:30:44.618 19:17:01 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:30:44.618 19:17:01 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:30:44.618 19:17:01 -- host/discovery_remove_ifc.sh@14 -- # '[' tcp == rdma ']' 00:30:44.618 19:17:01 -- host/discovery_remove_ifc.sh@19 -- # discovery_port=8009 00:30:44.618 19:17:01 -- host/discovery_remove_ifc.sh@20 -- # discovery_nqn=nqn.2014-08.org.nvmexpress.discovery 00:30:44.618 19:17:01 -- host/discovery_remove_ifc.sh@23 -- # nqn=nqn.2016-06.io.spdk:cnode 00:30:44.618 19:17:01 -- host/discovery_remove_ifc.sh@25 -- # host_nqn=nqn.2021-12.io.spdk:test 00:30:44.618 19:17:01 -- host/discovery_remove_ifc.sh@26 -- # host_sock=/tmp/host.sock 00:30:44.618 19:17:01 -- host/discovery_remove_ifc.sh@39 -- # nvmftestinit 00:30:44.618 19:17:01 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:30:44.618 19:17:01 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:30:44.618 19:17:01 -- nvmf/common.sh@436 -- # prepare_net_devs 00:30:44.618 19:17:01 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:30:44.618 19:17:01 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:30:44.618 19:17:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:44.618 19:17:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:44.618 19:17:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:44.618 19:17:01 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:30:44.618 19:17:01 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:30:44.618 19:17:01 -- nvmf/common.sh@284 -- # xtrace_disable 00:30:44.618 19:17:01 -- common/autotest_common.sh@10 -- # set +x 00:30:49.910 19:17:06 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:30:49.910 19:17:06 -- nvmf/common.sh@290 -- # pci_devs=() 00:30:49.910 19:17:06 -- nvmf/common.sh@290 -- # local -a pci_devs 00:30:49.910 19:17:06 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:30:49.910 19:17:06 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:30:49.910 19:17:06 -- nvmf/common.sh@292 -- # pci_drivers=() 00:30:49.910 19:17:06 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:30:49.910 19:17:06 -- nvmf/common.sh@294 -- # net_devs=() 00:30:49.910 19:17:06 -- nvmf/common.sh@294 -- # local -ga net_devs 00:30:49.910 19:17:06 -- nvmf/common.sh@295 -- # e810=() 00:30:49.910 19:17:06 -- nvmf/common.sh@295 -- # local -ga e810 00:30:49.910 19:17:06 -- nvmf/common.sh@296 -- # x722=() 00:30:49.910 19:17:06 -- nvmf/common.sh@296 -- # local -ga x722 00:30:49.910 19:17:06 -- nvmf/common.sh@297 -- # mlx=() 00:30:49.910 19:17:06 -- nvmf/common.sh@297 -- # local -ga mlx 00:30:49.910 19:17:06 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:30:49.910 19:17:06 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:30:49.910 19:17:06 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:30:49.910 19:17:06 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:30:49.910 19:17:06 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:30:49.910 19:17:06 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:30:49.910 19:17:06 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:30:49.910 19:17:06 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:30:49.910 19:17:06 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:30:49.910 19:17:06 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:30:49.910 19:17:06 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:30:49.910 19:17:06 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:30:49.911 19:17:06 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:30:49.911 19:17:06 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:30:49.911 19:17:06 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:30:49.911 19:17:06 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:30:49.911 19:17:06 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:30:49.911 19:17:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:49.911 19:17:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:30:49.911 Found 0000:86:00.0 (0x8086 - 0x159b) 00:30:49.911 19:17:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:49.911 19:17:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:49.911 19:17:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:49.911 19:17:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:49.911 19:17:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:49.911 19:17:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:49.911 19:17:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:30:49.911 Found 0000:86:00.1 (0x8086 - 0x159b) 00:30:49.911 19:17:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:49.911 19:17:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:49.911 19:17:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:49.911 19:17:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:49.911 19:17:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:49.911 19:17:06 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:30:49.911 19:17:06 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:30:49.911 19:17:06 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:30:49.911 19:17:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:49.911 19:17:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:49.911 19:17:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:49.911 19:17:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:49.911 19:17:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:30:49.911 Found net devices under 0000:86:00.0: cvl_0_0 00:30:49.911 19:17:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:49.911 19:17:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:49.911 19:17:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:49.911 19:17:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:49.911 19:17:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:49.911 19:17:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:30:49.911 Found net devices under 0000:86:00.1: cvl_0_1 00:30:49.911 19:17:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:49.911 19:17:06 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:30:49.911 19:17:06 -- nvmf/common.sh@402 -- # is_hw=yes 00:30:49.911 19:17:06 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:30:49.911 19:17:06 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:30:49.911 19:17:06 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:30:49.911 19:17:06 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:30:49.911 19:17:06 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:30:49.911 19:17:06 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:30:49.911 19:17:06 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:30:49.911 19:17:06 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:30:49.911 19:17:06 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:30:49.911 19:17:06 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:30:49.911 19:17:06 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:30:49.911 19:17:06 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:30:49.911 19:17:06 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:30:49.911 19:17:06 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:30:49.911 19:17:06 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:30:49.911 19:17:06 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:30:49.911 19:17:06 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:30:49.911 19:17:06 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:30:49.911 19:17:06 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:30:49.911 19:17:06 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:30:49.911 19:17:06 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:30:49.911 19:17:06 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:30:50.172 19:17:06 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:30:50.172 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:30:50.172 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.443 ms 00:30:50.172 00:30:50.172 --- 10.0.0.2 ping statistics --- 00:30:50.172 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:50.172 rtt min/avg/max/mdev = 0.443/0.443/0.443/0.000 ms 00:30:50.172 19:17:06 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:30:50.172 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:30:50.172 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.172 ms 00:30:50.172 00:30:50.172 --- 10.0.0.1 ping statistics --- 00:30:50.172 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:50.172 rtt min/avg/max/mdev = 0.172/0.172/0.172/0.000 ms 00:30:50.172 19:17:06 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:30:50.172 19:17:06 -- nvmf/common.sh@410 -- # return 0 00:30:50.172 19:17:06 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:30:50.172 19:17:06 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:30:50.172 19:17:06 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:30:50.172 19:17:06 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:30:50.172 19:17:06 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:30:50.172 19:17:06 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:30:50.172 19:17:06 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:30:50.172 19:17:06 -- host/discovery_remove_ifc.sh@40 -- # nvmfappstart -m 0x2 00:30:50.172 19:17:06 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:50.172 19:17:06 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:50.172 19:17:06 -- common/autotest_common.sh@10 -- # set +x 00:30:50.172 19:17:06 -- nvmf/common.sh@469 -- # nvmfpid=3278960 00:30:50.172 19:17:06 -- nvmf/common.sh@470 -- # waitforlisten 3278960 00:30:50.172 19:17:06 -- common/autotest_common.sh@829 -- # '[' -z 3278960 ']' 00:30:50.172 19:17:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:50.172 19:17:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:50.172 19:17:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:50.172 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:50.172 19:17:06 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:30:50.172 19:17:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:50.172 19:17:06 -- common/autotest_common.sh@10 -- # set +x 00:30:50.172 [2024-11-26 19:17:06.934756] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:30:50.173 [2024-11-26 19:17:06.934800] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:50.173 EAL: No free 2048 kB hugepages reported on node 1 00:30:50.173 [2024-11-26 19:17:06.993920] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:50.173 [2024-11-26 19:17:07.032556] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:50.173 [2024-11-26 19:17:07.032665] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:50.173 [2024-11-26 19:17:07.032674] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:50.173 [2024-11-26 19:17:07.032681] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:50.173 [2024-11-26 19:17:07.032701] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:51.108 19:17:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:51.108 19:17:07 -- common/autotest_common.sh@862 -- # return 0 00:30:51.108 19:17:07 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:51.108 19:17:07 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:51.108 19:17:07 -- common/autotest_common.sh@10 -- # set +x 00:30:51.108 19:17:07 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:51.108 19:17:07 -- host/discovery_remove_ifc.sh@43 -- # rpc_cmd 00:30:51.108 19:17:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:51.108 19:17:07 -- common/autotest_common.sh@10 -- # set +x 00:30:51.108 [2024-11-26 19:17:07.779474] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:51.108 [2024-11-26 19:17:07.787607] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:30:51.108 null0 00:30:51.108 [2024-11-26 19:17:07.819612] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:51.108 19:17:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:51.108 19:17:07 -- host/discovery_remove_ifc.sh@59 -- # hostpid=3279209 00:30:51.108 19:17:07 -- host/discovery_remove_ifc.sh@60 -- # waitforlisten 3279209 /tmp/host.sock 00:30:51.108 19:17:07 -- host/discovery_remove_ifc.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock --wait-for-rpc -L bdev_nvme 00:30:51.108 19:17:07 -- common/autotest_common.sh@829 -- # '[' -z 3279209 ']' 00:30:51.108 19:17:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:30:51.108 19:17:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:51.108 19:17:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:30:51.108 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:30:51.108 19:17:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:51.108 19:17:07 -- common/autotest_common.sh@10 -- # set +x 00:30:51.108 [2024-11-26 19:17:07.869877] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:30:51.108 [2024-11-26 19:17:07.869918] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3279209 ] 00:30:51.108 EAL: No free 2048 kB hugepages reported on node 1 00:30:51.108 [2024-11-26 19:17:07.925067] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:51.108 [2024-11-26 19:17:07.964232] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:51.108 [2024-11-26 19:17:07.964353] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:30:51.108 19:17:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:51.108 19:17:08 -- common/autotest_common.sh@862 -- # return 0 00:30:51.109 19:17:08 -- host/discovery_remove_ifc.sh@62 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:30:51.109 19:17:08 -- host/discovery_remove_ifc.sh@65 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_set_options -e 1 00:30:51.109 19:17:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:51.109 19:17:08 -- common/autotest_common.sh@10 -- # set +x 00:30:51.367 19:17:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:51.367 19:17:08 -- host/discovery_remove_ifc.sh@66 -- # rpc_cmd -s /tmp/host.sock framework_start_init 00:30:51.367 19:17:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:51.367 19:17:08 -- common/autotest_common.sh@10 -- # set +x 00:30:51.367 19:17:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:51.367 19:17:08 -- host/discovery_remove_ifc.sh@69 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test --ctrlr-loss-timeout-sec 2 --reconnect-delay-sec 1 --fast-io-fail-timeout-sec 1 --wait-for-attach 00:30:51.367 19:17:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:51.367 19:17:08 -- common/autotest_common.sh@10 -- # set +x 00:30:52.303 [2024-11-26 19:17:09.115471] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:30:52.303 [2024-11-26 19:17:09.115493] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:30:52.303 [2024-11-26 19:17:09.115505] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:30:52.562 [2024-11-26 19:17:09.241894] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:30:52.562 [2024-11-26 19:17:09.337689] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:30:52.562 [2024-11-26 19:17:09.337724] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:30:52.562 [2024-11-26 19:17:09.337746] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:30:52.562 [2024-11-26 19:17:09.337758] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:30:52.562 [2024-11-26 19:17:09.337776] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:30:52.562 19:17:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:52.562 19:17:09 -- host/discovery_remove_ifc.sh@72 -- # wait_for_bdev nvme0n1 00:30:52.562 19:17:09 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:30:52.562 19:17:09 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:30:52.562 19:17:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:52.562 19:17:09 -- common/autotest_common.sh@10 -- # set +x 00:30:52.562 19:17:09 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:30:52.562 19:17:09 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:30:52.562 19:17:09 -- host/discovery_remove_ifc.sh@29 -- # sort 00:30:52.562 [2024-11-26 19:17:09.344645] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0x9db7d0 was disconnected and freed. delete nvme_qpair. 00:30:52.562 19:17:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:52.562 19:17:09 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != \n\v\m\e\0\n\1 ]] 00:30:52.562 19:17:09 -- host/discovery_remove_ifc.sh@75 -- # ip netns exec cvl_0_0_ns_spdk ip addr del 10.0.0.2/24 dev cvl_0_0 00:30:52.562 19:17:09 -- host/discovery_remove_ifc.sh@76 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 down 00:30:52.562 19:17:09 -- host/discovery_remove_ifc.sh@79 -- # wait_for_bdev '' 00:30:52.562 19:17:09 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:30:52.562 19:17:09 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:30:52.562 19:17:09 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:30:52.562 19:17:09 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:30:52.562 19:17:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:52.562 19:17:09 -- host/discovery_remove_ifc.sh@29 -- # sort 00:30:52.562 19:17:09 -- common/autotest_common.sh@10 -- # set +x 00:30:52.821 19:17:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:52.821 19:17:09 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:30:52.821 19:17:09 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:30:53.757 19:17:10 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:30:53.757 19:17:10 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:30:53.757 19:17:10 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:30:53.757 19:17:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:53.757 19:17:10 -- host/discovery_remove_ifc.sh@29 -- # sort 00:30:53.757 19:17:10 -- common/autotest_common.sh@10 -- # set +x 00:30:53.757 19:17:10 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:30:53.757 19:17:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:53.757 19:17:10 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:30:53.757 19:17:10 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:30:54.692 19:17:11 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:30:54.692 19:17:11 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:30:54.692 19:17:11 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:30:54.692 19:17:11 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:30:54.692 19:17:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:54.692 19:17:11 -- host/discovery_remove_ifc.sh@29 -- # sort 00:30:54.692 19:17:11 -- common/autotest_common.sh@10 -- # set +x 00:30:54.692 19:17:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:54.950 19:17:11 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:30:54.950 19:17:11 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:30:55.886 19:17:12 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:30:55.886 19:17:12 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:30:55.886 19:17:12 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:30:55.886 19:17:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:55.886 19:17:12 -- host/discovery_remove_ifc.sh@29 -- # sort 00:30:55.886 19:17:12 -- common/autotest_common.sh@10 -- # set +x 00:30:55.886 19:17:12 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:30:55.886 19:17:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:55.886 19:17:12 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:30:55.886 19:17:12 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:30:56.820 19:17:13 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:30:56.820 19:17:13 -- host/discovery_remove_ifc.sh@29 -- # sort 00:30:56.820 19:17:13 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:30:56.820 19:17:13 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:30:56.820 19:17:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:56.820 19:17:13 -- common/autotest_common.sh@10 -- # set +x 00:30:56.820 19:17:13 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:30:56.820 19:17:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:56.820 19:17:13 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:30:56.820 19:17:13 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:30:58.196 19:17:14 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:30:58.196 19:17:14 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:30:58.196 19:17:14 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:30:58.196 19:17:14 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:30:58.196 19:17:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:58.196 19:17:14 -- host/discovery_remove_ifc.sh@29 -- # sort 00:30:58.196 19:17:14 -- common/autotest_common.sh@10 -- # set +x 00:30:58.196 19:17:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:58.196 [2024-11-26 19:17:14.779250] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 110: Connection timed out 00:30:58.196 [2024-11-26 19:17:14.779291] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:30:58.196 [2024-11-26 19:17:14.779301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.196 [2024-11-26 19:17:14.779310] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:30:58.196 [2024-11-26 19:17:14.779318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.196 [2024-11-26 19:17:14.779325] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:30:58.196 [2024-11-26 19:17:14.779332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.196 [2024-11-26 19:17:14.779339] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:30:58.196 [2024-11-26 19:17:14.779345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.196 [2024-11-26 19:17:14.779354] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:30:58.196 [2024-11-26 19:17:14.779361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:58.196 [2024-11-26 19:17:14.779367] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9a2a50 is same with the state(5) to be set 00:30:58.196 19:17:14 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:30:58.196 19:17:14 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:30:58.196 [2024-11-26 19:17:14.789271] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x9a2a50 (9): Bad file descriptor 00:30:58.196 [2024-11-26 19:17:14.799311] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:30:59.132 19:17:15 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:30:59.132 19:17:15 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:30:59.132 19:17:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:59.132 19:17:15 -- common/autotest_common.sh@10 -- # set +x 00:30:59.132 19:17:15 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:30:59.132 19:17:15 -- host/discovery_remove_ifc.sh@29 -- # sort 00:30:59.132 19:17:15 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:30:59.132 [2024-11-26 19:17:15.823965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:31:00.068 [2024-11-26 19:17:16.847970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:31:00.068 [2024-11-26 19:17:16.848022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9a2a50 with addr=10.0.0.2, port=4420 00:31:00.068 [2024-11-26 19:17:16.848040] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9a2a50 is same with the state(5) to be set 00:31:00.068 [2024-11-26 19:17:16.848066] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:31:00.068 [2024-11-26 19:17:16.848077] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:31:00.068 [2024-11-26 19:17:16.848086] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:31:00.068 [2024-11-26 19:17:16.848103] nvme_ctrlr.c:1017:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] already in failed state 00:31:00.068 [2024-11-26 19:17:16.848476] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x9a2a50 (9): Bad file descriptor 00:31:00.068 [2024-11-26 19:17:16.848503] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:00.068 [2024-11-26 19:17:16.848527] bdev_nvme.c:6510:remove_discovery_entry: *INFO*: Discovery[10.0.0.2:8009] Remove discovery entry: nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 00:31:00.068 [2024-11-26 19:17:16.848551] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:31:00.068 [2024-11-26 19:17:16.848564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:00.068 [2024-11-26 19:17:16.848576] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:31:00.068 [2024-11-26 19:17:16.848586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:00.068 [2024-11-26 19:17:16.848597] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:31:00.068 [2024-11-26 19:17:16.848607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:00.068 [2024-11-26 19:17:16.848617] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:31:00.068 [2024-11-26 19:17:16.848627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:00.068 [2024-11-26 19:17:16.848637] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:31:00.068 [2024-11-26 19:17:16.848648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:00.068 [2024-11-26 19:17:16.848657] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] in failed state. 00:31:00.068 [2024-11-26 19:17:16.849068] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x9a1f40 (9): Bad file descriptor 00:31:00.068 [2024-11-26 19:17:16.850082] nvme_fabric.c: 214:nvme_fabric_prop_get_cmd_async: *ERROR*: Failed to send Property Get fabrics command 00:31:00.068 [2024-11-26 19:17:16.850098] nvme_ctrlr.c:1136:nvme_ctrlr_shutdown_async: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] Failed to read the CC register 00:31:00.068 19:17:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:00.068 19:17:16 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:31:00.068 19:17:16 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:31:01.003 19:17:17 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:31:01.003 19:17:17 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:31:01.003 19:17:17 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:31:01.003 19:17:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:01.003 19:17:17 -- host/discovery_remove_ifc.sh@29 -- # sort 00:31:01.003 19:17:17 -- common/autotest_common.sh@10 -- # set +x 00:31:01.003 19:17:17 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:31:01.003 19:17:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:01.003 19:17:17 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != '' ]] 00:31:01.003 19:17:17 -- host/discovery_remove_ifc.sh@82 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:31:01.003 19:17:17 -- host/discovery_remove_ifc.sh@83 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:31:01.262 19:17:17 -- host/discovery_remove_ifc.sh@86 -- # wait_for_bdev nvme1n1 00:31:01.262 19:17:17 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:31:01.262 19:17:17 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:31:01.262 19:17:17 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:31:01.262 19:17:17 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:31:01.262 19:17:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:01.262 19:17:17 -- host/discovery_remove_ifc.sh@29 -- # sort 00:31:01.262 19:17:17 -- common/autotest_common.sh@10 -- # set +x 00:31:01.262 19:17:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:01.262 19:17:18 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:31:01.262 19:17:18 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:31:02.198 [2024-11-26 19:17:18.901507] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:31:02.198 [2024-11-26 19:17:18.901527] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:31:02.198 [2024-11-26 19:17:18.901538] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:31:02.198 [2024-11-26 19:17:19.027925] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme1 00:31:02.198 19:17:19 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:31:02.198 19:17:19 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:31:02.198 19:17:19 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:31:02.198 19:17:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:02.198 19:17:19 -- host/discovery_remove_ifc.sh@29 -- # sort 00:31:02.198 19:17:19 -- common/autotest_common.sh@10 -- # set +x 00:31:02.198 19:17:19 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:31:02.198 19:17:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:02.198 [2024-11-26 19:17:19.083047] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:31:02.198 [2024-11-26 19:17:19.083080] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:31:02.198 [2024-11-26 19:17:19.083096] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:31:02.198 [2024-11-26 19:17:19.083110] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme1 done 00:31:02.198 [2024-11-26 19:17:19.083117] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:31:02.198 19:17:19 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:31:02.198 19:17:19 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:31:02.198 [2024-11-26 19:17:19.089837] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0x9b0f60 was disconnected and freed. delete nvme_qpair. 00:31:03.586 19:17:20 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:31:03.586 19:17:20 -- host/discovery_remove_ifc.sh@29 -- # sort 00:31:03.586 19:17:20 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:31:03.586 19:17:20 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:31:03.586 19:17:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:03.586 19:17:20 -- common/autotest_common.sh@10 -- # set +x 00:31:03.586 19:17:20 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:31:03.586 19:17:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:03.586 19:17:20 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme1n1 != \n\v\m\e\1\n\1 ]] 00:31:03.586 19:17:20 -- host/discovery_remove_ifc.sh@88 -- # trap - SIGINT SIGTERM EXIT 00:31:03.586 19:17:20 -- host/discovery_remove_ifc.sh@90 -- # killprocess 3279209 00:31:03.586 19:17:20 -- common/autotest_common.sh@936 -- # '[' -z 3279209 ']' 00:31:03.586 19:17:20 -- common/autotest_common.sh@940 -- # kill -0 3279209 00:31:03.586 19:17:20 -- common/autotest_common.sh@941 -- # uname 00:31:03.586 19:17:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:31:03.586 19:17:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3279209 00:31:03.586 19:17:20 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:31:03.586 19:17:20 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:31:03.586 19:17:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3279209' 00:31:03.586 killing process with pid 3279209 00:31:03.586 19:17:20 -- common/autotest_common.sh@955 -- # kill 3279209 00:31:03.586 19:17:20 -- common/autotest_common.sh@960 -- # wait 3279209 00:31:03.586 19:17:20 -- host/discovery_remove_ifc.sh@91 -- # nvmftestfini 00:31:03.586 19:17:20 -- nvmf/common.sh@476 -- # nvmfcleanup 00:31:03.586 19:17:20 -- nvmf/common.sh@116 -- # sync 00:31:03.586 19:17:20 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:31:03.586 19:17:20 -- nvmf/common.sh@119 -- # set +e 00:31:03.586 19:17:20 -- nvmf/common.sh@120 -- # for i in {1..20} 00:31:03.586 19:17:20 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:31:03.586 rmmod nvme_tcp 00:31:03.586 rmmod nvme_fabrics 00:31:03.586 rmmod nvme_keyring 00:31:03.586 19:17:20 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:31:03.586 19:17:20 -- nvmf/common.sh@123 -- # set -e 00:31:03.586 19:17:20 -- nvmf/common.sh@124 -- # return 0 00:31:03.586 19:17:20 -- nvmf/common.sh@477 -- # '[' -n 3278960 ']' 00:31:03.586 19:17:20 -- nvmf/common.sh@478 -- # killprocess 3278960 00:31:03.586 19:17:20 -- common/autotest_common.sh@936 -- # '[' -z 3278960 ']' 00:31:03.586 19:17:20 -- common/autotest_common.sh@940 -- # kill -0 3278960 00:31:03.586 19:17:20 -- common/autotest_common.sh@941 -- # uname 00:31:03.586 19:17:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:31:03.586 19:17:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3278960 00:31:03.586 19:17:20 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:31:03.586 19:17:20 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:31:03.586 19:17:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3278960' 00:31:03.586 killing process with pid 3278960 00:31:03.586 19:17:20 -- common/autotest_common.sh@955 -- # kill 3278960 00:31:03.586 19:17:20 -- common/autotest_common.sh@960 -- # wait 3278960 00:31:03.847 19:17:20 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:31:03.847 19:17:20 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:31:03.847 19:17:20 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:31:03.847 19:17:20 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:31:03.847 19:17:20 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:31:03.847 19:17:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:03.847 19:17:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:31:03.847 19:17:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:06.381 19:17:22 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:31:06.381 00:31:06.381 real 0m21.664s 00:31:06.381 user 0m26.102s 00:31:06.381 sys 0m5.568s 00:31:06.381 19:17:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:31:06.381 19:17:22 -- common/autotest_common.sh@10 -- # set +x 00:31:06.381 ************************************ 00:31:06.381 END TEST nvmf_discovery_remove_ifc 00:31:06.381 ************************************ 00:31:06.381 19:17:22 -- nvmf/nvmf.sh@106 -- # [[ tcp == \t\c\p ]] 00:31:06.381 19:17:22 -- nvmf/nvmf.sh@107 -- # run_test nvmf_digest /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:31:06.381 19:17:22 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:31:06.381 19:17:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:06.381 19:17:22 -- common/autotest_common.sh@10 -- # set +x 00:31:06.381 ************************************ 00:31:06.381 START TEST nvmf_digest 00:31:06.381 ************************************ 00:31:06.381 19:17:22 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:31:06.381 * Looking for test storage... 00:31:06.381 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:31:06.381 19:17:22 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:31:06.381 19:17:22 -- common/autotest_common.sh@1690 -- # lcov --version 00:31:06.381 19:17:22 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:31:06.381 19:17:22 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:31:06.381 19:17:22 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:31:06.381 19:17:22 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:31:06.381 19:17:22 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:31:06.381 19:17:22 -- scripts/common.sh@335 -- # IFS=.-: 00:31:06.381 19:17:22 -- scripts/common.sh@335 -- # read -ra ver1 00:31:06.381 19:17:22 -- scripts/common.sh@336 -- # IFS=.-: 00:31:06.381 19:17:22 -- scripts/common.sh@336 -- # read -ra ver2 00:31:06.381 19:17:22 -- scripts/common.sh@337 -- # local 'op=<' 00:31:06.381 19:17:22 -- scripts/common.sh@339 -- # ver1_l=2 00:31:06.381 19:17:22 -- scripts/common.sh@340 -- # ver2_l=1 00:31:06.381 19:17:22 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:31:06.381 19:17:22 -- scripts/common.sh@343 -- # case "$op" in 00:31:06.381 19:17:22 -- scripts/common.sh@344 -- # : 1 00:31:06.381 19:17:22 -- scripts/common.sh@363 -- # (( v = 0 )) 00:31:06.381 19:17:22 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:31:06.381 19:17:22 -- scripts/common.sh@364 -- # decimal 1 00:31:06.381 19:17:22 -- scripts/common.sh@352 -- # local d=1 00:31:06.381 19:17:22 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:31:06.381 19:17:22 -- scripts/common.sh@354 -- # echo 1 00:31:06.381 19:17:22 -- scripts/common.sh@364 -- # ver1[v]=1 00:31:06.381 19:17:22 -- scripts/common.sh@365 -- # decimal 2 00:31:06.381 19:17:22 -- scripts/common.sh@352 -- # local d=2 00:31:06.381 19:17:22 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:31:06.382 19:17:22 -- scripts/common.sh@354 -- # echo 2 00:31:06.382 19:17:22 -- scripts/common.sh@365 -- # ver2[v]=2 00:31:06.382 19:17:22 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:31:06.382 19:17:22 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:31:06.382 19:17:22 -- scripts/common.sh@367 -- # return 0 00:31:06.382 19:17:22 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:31:06.382 19:17:22 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:31:06.382 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:06.382 --rc genhtml_branch_coverage=1 00:31:06.382 --rc genhtml_function_coverage=1 00:31:06.382 --rc genhtml_legend=1 00:31:06.382 --rc geninfo_all_blocks=1 00:31:06.382 --rc geninfo_unexecuted_blocks=1 00:31:06.382 00:31:06.382 ' 00:31:06.382 19:17:22 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:31:06.382 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:06.382 --rc genhtml_branch_coverage=1 00:31:06.382 --rc genhtml_function_coverage=1 00:31:06.382 --rc genhtml_legend=1 00:31:06.382 --rc geninfo_all_blocks=1 00:31:06.382 --rc geninfo_unexecuted_blocks=1 00:31:06.382 00:31:06.382 ' 00:31:06.382 19:17:22 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:31:06.382 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:06.382 --rc genhtml_branch_coverage=1 00:31:06.382 --rc genhtml_function_coverage=1 00:31:06.382 --rc genhtml_legend=1 00:31:06.382 --rc geninfo_all_blocks=1 00:31:06.382 --rc geninfo_unexecuted_blocks=1 00:31:06.382 00:31:06.382 ' 00:31:06.382 19:17:22 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:31:06.382 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:06.382 --rc genhtml_branch_coverage=1 00:31:06.382 --rc genhtml_function_coverage=1 00:31:06.382 --rc genhtml_legend=1 00:31:06.382 --rc geninfo_all_blocks=1 00:31:06.382 --rc geninfo_unexecuted_blocks=1 00:31:06.382 00:31:06.382 ' 00:31:06.382 19:17:22 -- host/digest.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:31:06.382 19:17:22 -- nvmf/common.sh@7 -- # uname -s 00:31:06.382 19:17:22 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:31:06.382 19:17:22 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:31:06.382 19:17:22 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:31:06.382 19:17:22 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:31:06.382 19:17:22 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:31:06.382 19:17:22 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:31:06.382 19:17:22 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:31:06.382 19:17:22 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:31:06.382 19:17:22 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:31:06.382 19:17:22 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:31:06.382 19:17:22 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:31:06.382 19:17:22 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:31:06.382 19:17:22 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:31:06.382 19:17:22 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:31:06.382 19:17:22 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:31:06.382 19:17:22 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:31:06.382 19:17:22 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:31:06.382 19:17:22 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:06.382 19:17:22 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:06.382 19:17:22 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:06.382 19:17:22 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:06.382 19:17:22 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:06.382 19:17:22 -- paths/export.sh@5 -- # export PATH 00:31:06.382 19:17:22 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:06.382 19:17:22 -- nvmf/common.sh@46 -- # : 0 00:31:06.382 19:17:22 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:31:06.382 19:17:22 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:31:06.382 19:17:22 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:31:06.382 19:17:22 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:31:06.382 19:17:22 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:31:06.382 19:17:22 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:31:06.382 19:17:22 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:31:06.382 19:17:22 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:31:06.382 19:17:22 -- host/digest.sh@14 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:31:06.382 19:17:22 -- host/digest.sh@15 -- # bperfsock=/var/tmp/bperf.sock 00:31:06.382 19:17:22 -- host/digest.sh@16 -- # runtime=2 00:31:06.382 19:17:22 -- host/digest.sh@130 -- # [[ tcp != \t\c\p ]] 00:31:06.382 19:17:22 -- host/digest.sh@132 -- # nvmftestinit 00:31:06.382 19:17:22 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:31:06.382 19:17:22 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:31:06.382 19:17:22 -- nvmf/common.sh@436 -- # prepare_net_devs 00:31:06.382 19:17:22 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:31:06.382 19:17:22 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:31:06.382 19:17:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:06.382 19:17:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:31:06.382 19:17:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:06.382 19:17:22 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:31:06.382 19:17:22 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:31:06.382 19:17:22 -- nvmf/common.sh@284 -- # xtrace_disable 00:31:06.382 19:17:22 -- common/autotest_common.sh@10 -- # set +x 00:31:11.653 19:17:28 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:31:11.653 19:17:28 -- nvmf/common.sh@290 -- # pci_devs=() 00:31:11.653 19:17:28 -- nvmf/common.sh@290 -- # local -a pci_devs 00:31:11.653 19:17:28 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:31:11.653 19:17:28 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:31:11.653 19:17:28 -- nvmf/common.sh@292 -- # pci_drivers=() 00:31:11.653 19:17:28 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:31:11.653 19:17:28 -- nvmf/common.sh@294 -- # net_devs=() 00:31:11.653 19:17:28 -- nvmf/common.sh@294 -- # local -ga net_devs 00:31:11.653 19:17:28 -- nvmf/common.sh@295 -- # e810=() 00:31:11.653 19:17:28 -- nvmf/common.sh@295 -- # local -ga e810 00:31:11.653 19:17:28 -- nvmf/common.sh@296 -- # x722=() 00:31:11.653 19:17:28 -- nvmf/common.sh@296 -- # local -ga x722 00:31:11.653 19:17:28 -- nvmf/common.sh@297 -- # mlx=() 00:31:11.653 19:17:28 -- nvmf/common.sh@297 -- # local -ga mlx 00:31:11.653 19:17:28 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:31:11.653 19:17:28 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:31:11.653 19:17:28 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:31:11.653 19:17:28 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:31:11.653 19:17:28 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:31:11.653 19:17:28 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:31:11.653 19:17:28 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:31:11.653 19:17:28 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:31:11.653 19:17:28 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:31:11.653 19:17:28 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:31:11.653 19:17:28 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:31:11.653 19:17:28 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:31:11.653 19:17:28 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:31:11.653 19:17:28 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:31:11.653 19:17:28 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:31:11.653 19:17:28 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:31:11.653 19:17:28 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:31:11.653 19:17:28 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:31:11.653 19:17:28 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:31:11.653 Found 0000:86:00.0 (0x8086 - 0x159b) 00:31:11.653 19:17:28 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:31:11.653 19:17:28 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:31:11.653 19:17:28 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:31:11.653 19:17:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:31:11.653 19:17:28 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:31:11.653 19:17:28 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:31:11.653 19:17:28 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:31:11.653 Found 0000:86:00.1 (0x8086 - 0x159b) 00:31:11.653 19:17:28 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:31:11.654 19:17:28 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:31:11.654 19:17:28 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:31:11.654 19:17:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:31:11.654 19:17:28 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:31:11.654 19:17:28 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:31:11.654 19:17:28 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:31:11.654 19:17:28 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:31:11.654 19:17:28 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:31:11.654 19:17:28 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:11.654 19:17:28 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:31:11.654 19:17:28 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:11.654 19:17:28 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:31:11.654 Found net devices under 0000:86:00.0: cvl_0_0 00:31:11.654 19:17:28 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:31:11.654 19:17:28 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:31:11.654 19:17:28 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:11.654 19:17:28 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:31:11.654 19:17:28 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:11.654 19:17:28 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:31:11.654 Found net devices under 0000:86:00.1: cvl_0_1 00:31:11.654 19:17:28 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:31:11.654 19:17:28 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:31:11.654 19:17:28 -- nvmf/common.sh@402 -- # is_hw=yes 00:31:11.654 19:17:28 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:31:11.654 19:17:28 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:31:11.654 19:17:28 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:31:11.654 19:17:28 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:31:11.654 19:17:28 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:31:11.654 19:17:28 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:31:11.654 19:17:28 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:31:11.654 19:17:28 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:31:11.654 19:17:28 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:31:11.654 19:17:28 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:31:11.654 19:17:28 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:31:11.654 19:17:28 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:31:11.654 19:17:28 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:31:11.654 19:17:28 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:31:11.654 19:17:28 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:31:11.654 19:17:28 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:31:11.654 19:17:28 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:31:11.654 19:17:28 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:31:11.654 19:17:28 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:31:11.654 19:17:28 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:31:11.654 19:17:28 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:31:11.654 19:17:28 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:31:11.654 19:17:28 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:31:11.654 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:31:11.654 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.439 ms 00:31:11.654 00:31:11.654 --- 10.0.0.2 ping statistics --- 00:31:11.654 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:31:11.654 rtt min/avg/max/mdev = 0.439/0.439/0.439/0.000 ms 00:31:11.654 19:17:28 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:31:11.654 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:31:11.654 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.197 ms 00:31:11.654 00:31:11.654 --- 10.0.0.1 ping statistics --- 00:31:11.654 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:31:11.654 rtt min/avg/max/mdev = 0.197/0.197/0.197/0.000 ms 00:31:11.654 19:17:28 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:31:11.654 19:17:28 -- nvmf/common.sh@410 -- # return 0 00:31:11.654 19:17:28 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:31:11.654 19:17:28 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:31:11.654 19:17:28 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:31:11.654 19:17:28 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:31:11.654 19:17:28 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:31:11.654 19:17:28 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:31:11.654 19:17:28 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:31:11.654 19:17:28 -- host/digest.sh@134 -- # trap cleanup SIGINT SIGTERM EXIT 00:31:11.654 19:17:28 -- host/digest.sh@135 -- # run_test nvmf_digest_clean run_digest 00:31:11.654 19:17:28 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:31:11.654 19:17:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:11.654 19:17:28 -- common/autotest_common.sh@10 -- # set +x 00:31:11.654 ************************************ 00:31:11.654 START TEST nvmf_digest_clean 00:31:11.654 ************************************ 00:31:11.654 19:17:28 -- common/autotest_common.sh@1114 -- # run_digest 00:31:11.654 19:17:28 -- host/digest.sh@119 -- # nvmfappstart --wait-for-rpc 00:31:11.654 19:17:28 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:31:11.654 19:17:28 -- common/autotest_common.sh@722 -- # xtrace_disable 00:31:11.654 19:17:28 -- common/autotest_common.sh@10 -- # set +x 00:31:11.654 19:17:28 -- nvmf/common.sh@469 -- # nvmfpid=3284697 00:31:11.654 19:17:28 -- nvmf/common.sh@470 -- # waitforlisten 3284697 00:31:11.654 19:17:28 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:31:11.654 19:17:28 -- common/autotest_common.sh@829 -- # '[' -z 3284697 ']' 00:31:11.654 19:17:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:31:11.654 19:17:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:31:11.654 19:17:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:31:11.654 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:31:11.654 19:17:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:31:11.654 19:17:28 -- common/autotest_common.sh@10 -- # set +x 00:31:11.654 [2024-11-26 19:17:28.411830] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:31:11.654 [2024-11-26 19:17:28.411882] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:31:11.654 EAL: No free 2048 kB hugepages reported on node 1 00:31:11.654 [2024-11-26 19:17:28.475605] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:31:11.654 [2024-11-26 19:17:28.515992] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:31:11.654 [2024-11-26 19:17:28.516103] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:31:11.654 [2024-11-26 19:17:28.516115] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:31:11.654 [2024-11-26 19:17:28.516121] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:31:11.654 [2024-11-26 19:17:28.516141] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:31:11.654 19:17:28 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:31:11.654 19:17:28 -- common/autotest_common.sh@862 -- # return 0 00:31:11.654 19:17:28 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:31:11.654 19:17:28 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:11.654 19:17:28 -- common/autotest_common.sh@10 -- # set +x 00:31:11.913 19:17:28 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:31:11.913 19:17:28 -- host/digest.sh@120 -- # common_target_config 00:31:11.913 19:17:28 -- host/digest.sh@43 -- # rpc_cmd 00:31:11.913 19:17:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:11.913 19:17:28 -- common/autotest_common.sh@10 -- # set +x 00:31:11.913 null0 00:31:11.913 [2024-11-26 19:17:28.673861] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:31:11.913 [2024-11-26 19:17:28.698066] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:11.913 19:17:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:11.913 19:17:28 -- host/digest.sh@122 -- # run_bperf randread 4096 128 00:31:11.913 19:17:28 -- host/digest.sh@77 -- # local rw bs qd 00:31:11.913 19:17:28 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:31:11.913 19:17:28 -- host/digest.sh@80 -- # rw=randread 00:31:11.913 19:17:28 -- host/digest.sh@80 -- # bs=4096 00:31:11.913 19:17:28 -- host/digest.sh@80 -- # qd=128 00:31:11.913 19:17:28 -- host/digest.sh@82 -- # bperfpid=3284746 00:31:11.913 19:17:28 -- host/digest.sh@83 -- # waitforlisten 3284746 /var/tmp/bperf.sock 00:31:11.913 19:17:28 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:31:11.913 19:17:28 -- common/autotest_common.sh@829 -- # '[' -z 3284746 ']' 00:31:11.913 19:17:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:31:11.913 19:17:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:31:11.913 19:17:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:31:11.913 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:31:11.913 19:17:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:31:11.913 19:17:28 -- common/autotest_common.sh@10 -- # set +x 00:31:11.913 [2024-11-26 19:17:28.748355] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:31:11.913 [2024-11-26 19:17:28.748396] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3284746 ] 00:31:11.913 EAL: No free 2048 kB hugepages reported on node 1 00:31:11.913 [2024-11-26 19:17:28.802679] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:31:12.172 [2024-11-26 19:17:28.843627] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:31:12.172 19:17:28 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:31:12.172 19:17:28 -- common/autotest_common.sh@862 -- # return 0 00:31:12.172 19:17:28 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:31:12.172 19:17:28 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:31:12.172 19:17:28 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:31:12.430 19:17:29 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:31:12.430 19:17:29 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:31:12.688 nvme0n1 00:31:12.688 19:17:29 -- host/digest.sh@91 -- # bperf_py perform_tests 00:31:12.688 19:17:29 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:31:12.947 Running I/O for 2 seconds... 00:31:14.856 00:31:14.856 Latency(us) 00:31:14.856 [2024-11-26T18:17:31.783Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:31:14.856 [2024-11-26T18:17:31.783Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:31:14.856 nvme0n1 : 2.04 20368.09 79.56 0.00 0.00 6155.49 2635.69 46274.11 00:31:14.856 [2024-11-26T18:17:31.783Z] =================================================================================================================== 00:31:14.856 [2024-11-26T18:17:31.783Z] Total : 20368.09 79.56 0.00 0.00 6155.49 2635.69 46274.11 00:31:14.856 0 00:31:14.856 19:17:31 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:31:14.856 19:17:31 -- host/digest.sh@92 -- # get_accel_stats 00:31:14.856 19:17:31 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:31:14.856 19:17:31 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:31:14.856 | select(.opcode=="crc32c") 00:31:14.856 | "\(.module_name) \(.executed)"' 00:31:14.856 19:17:31 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:31:15.115 19:17:31 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:31:15.115 19:17:31 -- host/digest.sh@93 -- # exp_module=software 00:31:15.115 19:17:31 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:31:15.115 19:17:31 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:31:15.115 19:17:31 -- host/digest.sh@97 -- # killprocess 3284746 00:31:15.115 19:17:31 -- common/autotest_common.sh@936 -- # '[' -z 3284746 ']' 00:31:15.115 19:17:31 -- common/autotest_common.sh@940 -- # kill -0 3284746 00:31:15.115 19:17:31 -- common/autotest_common.sh@941 -- # uname 00:31:15.115 19:17:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:31:15.115 19:17:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3284746 00:31:15.115 19:17:31 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:31:15.115 19:17:31 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:31:15.115 19:17:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3284746' 00:31:15.115 killing process with pid 3284746 00:31:15.115 19:17:31 -- common/autotest_common.sh@955 -- # kill 3284746 00:31:15.115 Received shutdown signal, test time was about 2.000000 seconds 00:31:15.115 00:31:15.115 Latency(us) 00:31:15.115 [2024-11-26T18:17:32.042Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:31:15.115 [2024-11-26T18:17:32.042Z] =================================================================================================================== 00:31:15.115 [2024-11-26T18:17:32.042Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:31:15.115 19:17:31 -- common/autotest_common.sh@960 -- # wait 3284746 00:31:15.374 19:17:32 -- host/digest.sh@123 -- # run_bperf randread 131072 16 00:31:15.374 19:17:32 -- host/digest.sh@77 -- # local rw bs qd 00:31:15.374 19:17:32 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:31:15.374 19:17:32 -- host/digest.sh@80 -- # rw=randread 00:31:15.374 19:17:32 -- host/digest.sh@80 -- # bs=131072 00:31:15.374 19:17:32 -- host/digest.sh@80 -- # qd=16 00:31:15.374 19:17:32 -- host/digest.sh@82 -- # bperfpid=3285416 00:31:15.374 19:17:32 -- host/digest.sh@83 -- # waitforlisten 3285416 /var/tmp/bperf.sock 00:31:15.374 19:17:32 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:31:15.374 19:17:32 -- common/autotest_common.sh@829 -- # '[' -z 3285416 ']' 00:31:15.374 19:17:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:31:15.374 19:17:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:31:15.374 19:17:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:31:15.374 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:31:15.374 19:17:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:31:15.374 19:17:32 -- common/autotest_common.sh@10 -- # set +x 00:31:15.374 [2024-11-26 19:17:32.149191] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:31:15.374 [2024-11-26 19:17:32.149245] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3285416 ] 00:31:15.374 I/O size of 131072 is greater than zero copy threshold (65536). 00:31:15.374 Zero copy mechanism will not be used. 00:31:15.374 EAL: No free 2048 kB hugepages reported on node 1 00:31:15.374 [2024-11-26 19:17:32.205176] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:31:15.374 [2024-11-26 19:17:32.240601] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:31:15.374 19:17:32 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:31:15.374 19:17:32 -- common/autotest_common.sh@862 -- # return 0 00:31:15.374 19:17:32 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:31:15.374 19:17:32 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:31:15.374 19:17:32 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:31:15.633 19:17:32 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:31:15.633 19:17:32 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:31:15.892 nvme0n1 00:31:15.892 19:17:32 -- host/digest.sh@91 -- # bperf_py perform_tests 00:31:15.892 19:17:32 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:31:16.150 I/O size of 131072 is greater than zero copy threshold (65536). 00:31:16.150 Zero copy mechanism will not be used. 00:31:16.150 Running I/O for 2 seconds... 00:31:18.053 00:31:18.054 Latency(us) 00:31:18.054 [2024-11-26T18:17:34.981Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:31:18.054 [2024-11-26T18:17:34.981Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:31:18.054 nvme0n1 : 2.00 6372.17 796.52 0.00 0.00 2508.54 552.07 6810.05 00:31:18.054 [2024-11-26T18:17:34.981Z] =================================================================================================================== 00:31:18.054 [2024-11-26T18:17:34.981Z] Total : 6372.17 796.52 0.00 0.00 2508.54 552.07 6810.05 00:31:18.054 0 00:31:18.054 19:17:34 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:31:18.054 19:17:34 -- host/digest.sh@92 -- # get_accel_stats 00:31:18.054 19:17:34 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:31:18.054 19:17:34 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:31:18.054 | select(.opcode=="crc32c") 00:31:18.054 | "\(.module_name) \(.executed)"' 00:31:18.054 19:17:34 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:31:18.312 19:17:35 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:31:18.312 19:17:35 -- host/digest.sh@93 -- # exp_module=software 00:31:18.312 19:17:35 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:31:18.312 19:17:35 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:31:18.312 19:17:35 -- host/digest.sh@97 -- # killprocess 3285416 00:31:18.312 19:17:35 -- common/autotest_common.sh@936 -- # '[' -z 3285416 ']' 00:31:18.312 19:17:35 -- common/autotest_common.sh@940 -- # kill -0 3285416 00:31:18.312 19:17:35 -- common/autotest_common.sh@941 -- # uname 00:31:18.312 19:17:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:31:18.312 19:17:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3285416 00:31:18.312 19:17:35 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:31:18.312 19:17:35 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:31:18.312 19:17:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3285416' 00:31:18.312 killing process with pid 3285416 00:31:18.312 19:17:35 -- common/autotest_common.sh@955 -- # kill 3285416 00:31:18.312 Received shutdown signal, test time was about 2.000000 seconds 00:31:18.312 00:31:18.312 Latency(us) 00:31:18.312 [2024-11-26T18:17:35.239Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:31:18.312 [2024-11-26T18:17:35.239Z] =================================================================================================================== 00:31:18.312 [2024-11-26T18:17:35.239Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:31:18.312 19:17:35 -- common/autotest_common.sh@960 -- # wait 3285416 00:31:18.570 19:17:35 -- host/digest.sh@124 -- # run_bperf randwrite 4096 128 00:31:18.570 19:17:35 -- host/digest.sh@77 -- # local rw bs qd 00:31:18.570 19:17:35 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:31:18.570 19:17:35 -- host/digest.sh@80 -- # rw=randwrite 00:31:18.570 19:17:35 -- host/digest.sh@80 -- # bs=4096 00:31:18.570 19:17:35 -- host/digest.sh@80 -- # qd=128 00:31:18.570 19:17:35 -- host/digest.sh@82 -- # bperfpid=3285902 00:31:18.570 19:17:35 -- host/digest.sh@83 -- # waitforlisten 3285902 /var/tmp/bperf.sock 00:31:18.570 19:17:35 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:31:18.570 19:17:35 -- common/autotest_common.sh@829 -- # '[' -z 3285902 ']' 00:31:18.570 19:17:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:31:18.570 19:17:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:31:18.570 19:17:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:31:18.570 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:31:18.571 19:17:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:31:18.571 19:17:35 -- common/autotest_common.sh@10 -- # set +x 00:31:18.571 [2024-11-26 19:17:35.335733] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:31:18.571 [2024-11-26 19:17:35.335781] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3285902 ] 00:31:18.571 EAL: No free 2048 kB hugepages reported on node 1 00:31:18.571 [2024-11-26 19:17:35.391005] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:31:18.571 [2024-11-26 19:17:35.425434] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:31:18.571 19:17:35 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:31:18.571 19:17:35 -- common/autotest_common.sh@862 -- # return 0 00:31:18.571 19:17:35 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:31:18.571 19:17:35 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:31:18.571 19:17:35 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:31:18.829 19:17:35 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:31:18.829 19:17:35 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:31:19.397 nvme0n1 00:31:19.397 19:17:36 -- host/digest.sh@91 -- # bperf_py perform_tests 00:31:19.397 19:17:36 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:31:19.397 Running I/O for 2 seconds... 00:31:21.300 00:31:21.300 Latency(us) 00:31:21.300 [2024-11-26T18:17:38.227Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:31:21.300 [2024-11-26T18:17:38.227Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:31:21.300 nvme0n1 : 2.00 27612.83 107.86 0.00 0.00 4628.37 4331.07 11454.55 00:31:21.300 [2024-11-26T18:17:38.227Z] =================================================================================================================== 00:31:21.300 [2024-11-26T18:17:38.227Z] Total : 27612.83 107.86 0.00 0.00 4628.37 4331.07 11454.55 00:31:21.300 0 00:31:21.300 19:17:38 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:31:21.300 19:17:38 -- host/digest.sh@92 -- # get_accel_stats 00:31:21.300 19:17:38 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:31:21.300 19:17:38 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:31:21.300 | select(.opcode=="crc32c") 00:31:21.300 | "\(.module_name) \(.executed)"' 00:31:21.300 19:17:38 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:31:21.559 19:17:38 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:31:21.559 19:17:38 -- host/digest.sh@93 -- # exp_module=software 00:31:21.559 19:17:38 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:31:21.559 19:17:38 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:31:21.559 19:17:38 -- host/digest.sh@97 -- # killprocess 3285902 00:31:21.559 19:17:38 -- common/autotest_common.sh@936 -- # '[' -z 3285902 ']' 00:31:21.559 19:17:38 -- common/autotest_common.sh@940 -- # kill -0 3285902 00:31:21.559 19:17:38 -- common/autotest_common.sh@941 -- # uname 00:31:21.559 19:17:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:31:21.559 19:17:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3285902 00:31:21.559 19:17:38 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:31:21.559 19:17:38 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:31:21.559 19:17:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3285902' 00:31:21.559 killing process with pid 3285902 00:31:21.559 19:17:38 -- common/autotest_common.sh@955 -- # kill 3285902 00:31:21.559 Received shutdown signal, test time was about 2.000000 seconds 00:31:21.559 00:31:21.559 Latency(us) 00:31:21.559 [2024-11-26T18:17:38.486Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:31:21.559 [2024-11-26T18:17:38.486Z] =================================================================================================================== 00:31:21.559 [2024-11-26T18:17:38.486Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:31:21.559 19:17:38 -- common/autotest_common.sh@960 -- # wait 3285902 00:31:21.818 19:17:38 -- host/digest.sh@125 -- # run_bperf randwrite 131072 16 00:31:21.818 19:17:38 -- host/digest.sh@77 -- # local rw bs qd 00:31:21.818 19:17:38 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:31:21.818 19:17:38 -- host/digest.sh@80 -- # rw=randwrite 00:31:21.818 19:17:38 -- host/digest.sh@80 -- # bs=131072 00:31:21.818 19:17:38 -- host/digest.sh@80 -- # qd=16 00:31:21.818 19:17:38 -- host/digest.sh@82 -- # bperfpid=3286384 00:31:21.818 19:17:38 -- host/digest.sh@83 -- # waitforlisten 3286384 /var/tmp/bperf.sock 00:31:21.818 19:17:38 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:31:21.818 19:17:38 -- common/autotest_common.sh@829 -- # '[' -z 3286384 ']' 00:31:21.818 19:17:38 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:31:21.818 19:17:38 -- common/autotest_common.sh@834 -- # local max_retries=100 00:31:21.818 19:17:38 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:31:21.818 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:31:21.818 19:17:38 -- common/autotest_common.sh@838 -- # xtrace_disable 00:31:21.818 19:17:38 -- common/autotest_common.sh@10 -- # set +x 00:31:21.818 [2024-11-26 19:17:38.630024] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:31:21.818 [2024-11-26 19:17:38.630071] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3286384 ] 00:31:21.818 I/O size of 131072 is greater than zero copy threshold (65536). 00:31:21.818 Zero copy mechanism will not be used. 00:31:21.818 EAL: No free 2048 kB hugepages reported on node 1 00:31:21.818 [2024-11-26 19:17:38.685667] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:31:21.818 [2024-11-26 19:17:38.724914] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:31:22.077 19:17:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:31:22.077 19:17:38 -- common/autotest_common.sh@862 -- # return 0 00:31:22.077 19:17:38 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:31:22.077 19:17:38 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:31:22.077 19:17:38 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:31:22.337 19:17:39 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:31:22.337 19:17:39 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:31:22.601 nvme0n1 00:31:22.601 19:17:39 -- host/digest.sh@91 -- # bperf_py perform_tests 00:31:22.601 19:17:39 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:31:22.601 I/O size of 131072 is greater than zero copy threshold (65536). 00:31:22.601 Zero copy mechanism will not be used. 00:31:22.601 Running I/O for 2 seconds... 00:31:24.505 00:31:24.505 Latency(us) 00:31:24.505 [2024-11-26T18:17:41.432Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:31:24.505 [2024-11-26T18:17:41.432Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:31:24.505 nvme0n1 : 2.00 7459.78 932.47 0.00 0.00 2141.04 1552.92 4644.51 00:31:24.505 [2024-11-26T18:17:41.432Z] =================================================================================================================== 00:31:24.505 [2024-11-26T18:17:41.432Z] Total : 7459.78 932.47 0.00 0.00 2141.04 1552.92 4644.51 00:31:24.505 0 00:31:24.505 19:17:41 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:31:24.505 19:17:41 -- host/digest.sh@92 -- # get_accel_stats 00:31:24.505 19:17:41 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:31:24.505 19:17:41 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:31:24.505 | select(.opcode=="crc32c") 00:31:24.505 | "\(.module_name) \(.executed)"' 00:31:24.505 19:17:41 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:31:24.764 19:17:41 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:31:24.764 19:17:41 -- host/digest.sh@93 -- # exp_module=software 00:31:24.764 19:17:41 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:31:24.764 19:17:41 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:31:24.764 19:17:41 -- host/digest.sh@97 -- # killprocess 3286384 00:31:24.764 19:17:41 -- common/autotest_common.sh@936 -- # '[' -z 3286384 ']' 00:31:24.764 19:17:41 -- common/autotest_common.sh@940 -- # kill -0 3286384 00:31:24.764 19:17:41 -- common/autotest_common.sh@941 -- # uname 00:31:24.764 19:17:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:31:24.764 19:17:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3286384 00:31:24.764 19:17:41 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:31:24.764 19:17:41 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:31:24.764 19:17:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3286384' 00:31:24.764 killing process with pid 3286384 00:31:24.764 19:17:41 -- common/autotest_common.sh@955 -- # kill 3286384 00:31:24.764 Received shutdown signal, test time was about 2.000000 seconds 00:31:24.764 00:31:24.764 Latency(us) 00:31:24.764 [2024-11-26T18:17:41.691Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:31:24.764 [2024-11-26T18:17:41.691Z] =================================================================================================================== 00:31:24.764 [2024-11-26T18:17:41.691Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:31:24.764 19:17:41 -- common/autotest_common.sh@960 -- # wait 3286384 00:31:25.022 19:17:41 -- host/digest.sh@126 -- # killprocess 3284697 00:31:25.022 19:17:41 -- common/autotest_common.sh@936 -- # '[' -z 3284697 ']' 00:31:25.022 19:17:41 -- common/autotest_common.sh@940 -- # kill -0 3284697 00:31:25.022 19:17:41 -- common/autotest_common.sh@941 -- # uname 00:31:25.022 19:17:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:31:25.022 19:17:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3284697 00:31:25.022 19:17:41 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:31:25.022 19:17:41 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:31:25.022 19:17:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3284697' 00:31:25.022 killing process with pid 3284697 00:31:25.022 19:17:41 -- common/autotest_common.sh@955 -- # kill 3284697 00:31:25.022 19:17:41 -- common/autotest_common.sh@960 -- # wait 3284697 00:31:25.281 00:31:25.281 real 0m13.691s 00:31:25.281 user 0m25.561s 00:31:25.281 sys 0m4.854s 00:31:25.281 19:17:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:31:25.281 19:17:42 -- common/autotest_common.sh@10 -- # set +x 00:31:25.281 ************************************ 00:31:25.281 END TEST nvmf_digest_clean 00:31:25.281 ************************************ 00:31:25.281 19:17:42 -- host/digest.sh@136 -- # run_test nvmf_digest_error run_digest_error 00:31:25.281 19:17:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:31:25.281 19:17:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:25.281 19:17:42 -- common/autotest_common.sh@10 -- # set +x 00:31:25.281 ************************************ 00:31:25.281 START TEST nvmf_digest_error 00:31:25.281 ************************************ 00:31:25.281 19:17:42 -- common/autotest_common.sh@1114 -- # run_digest_error 00:31:25.281 19:17:42 -- host/digest.sh@101 -- # nvmfappstart --wait-for-rpc 00:31:25.281 19:17:42 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:31:25.281 19:17:42 -- common/autotest_common.sh@722 -- # xtrace_disable 00:31:25.281 19:17:42 -- common/autotest_common.sh@10 -- # set +x 00:31:25.281 19:17:42 -- nvmf/common.sh@469 -- # nvmfpid=3287101 00:31:25.281 19:17:42 -- nvmf/common.sh@470 -- # waitforlisten 3287101 00:31:25.281 19:17:42 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:31:25.281 19:17:42 -- common/autotest_common.sh@829 -- # '[' -z 3287101 ']' 00:31:25.281 19:17:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:31:25.281 19:17:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:31:25.281 19:17:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:31:25.281 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:31:25.281 19:17:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:31:25.281 19:17:42 -- common/autotest_common.sh@10 -- # set +x 00:31:25.281 [2024-11-26 19:17:42.144774] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:31:25.281 [2024-11-26 19:17:42.144823] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:31:25.281 EAL: No free 2048 kB hugepages reported on node 1 00:31:25.281 [2024-11-26 19:17:42.203809] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:31:25.540 [2024-11-26 19:17:42.239206] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:31:25.540 [2024-11-26 19:17:42.239318] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:31:25.540 [2024-11-26 19:17:42.239326] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:31:25.540 [2024-11-26 19:17:42.239333] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:31:25.540 [2024-11-26 19:17:42.239349] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:31:25.540 19:17:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:31:25.540 19:17:42 -- common/autotest_common.sh@862 -- # return 0 00:31:25.540 19:17:42 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:31:25.540 19:17:42 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:25.540 19:17:42 -- common/autotest_common.sh@10 -- # set +x 00:31:25.540 19:17:42 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:31:25.540 19:17:42 -- host/digest.sh@103 -- # rpc_cmd accel_assign_opc -o crc32c -m error 00:31:25.540 19:17:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:25.540 19:17:42 -- common/autotest_common.sh@10 -- # set +x 00:31:25.540 [2024-11-26 19:17:42.323828] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation crc32c will be assigned to module error 00:31:25.540 19:17:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:25.540 19:17:42 -- host/digest.sh@104 -- # common_target_config 00:31:25.540 19:17:42 -- host/digest.sh@43 -- # rpc_cmd 00:31:25.540 19:17:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:25.540 19:17:42 -- common/autotest_common.sh@10 -- # set +x 00:31:25.540 null0 00:31:25.540 [2024-11-26 19:17:42.408717] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:31:25.540 [2024-11-26 19:17:42.432916] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:25.540 19:17:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:25.540 19:17:42 -- host/digest.sh@107 -- # run_bperf_err randread 4096 128 00:31:25.540 19:17:42 -- host/digest.sh@54 -- # local rw bs qd 00:31:25.540 19:17:42 -- host/digest.sh@56 -- # rw=randread 00:31:25.540 19:17:42 -- host/digest.sh@56 -- # bs=4096 00:31:25.540 19:17:42 -- host/digest.sh@56 -- # qd=128 00:31:25.540 19:17:42 -- host/digest.sh@58 -- # bperfpid=3287132 00:31:25.540 19:17:42 -- host/digest.sh@60 -- # waitforlisten 3287132 /var/tmp/bperf.sock 00:31:25.540 19:17:42 -- common/autotest_common.sh@829 -- # '[' -z 3287132 ']' 00:31:25.540 19:17:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:31:25.540 19:17:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:31:25.540 19:17:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:31:25.540 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:31:25.540 19:17:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:31:25.540 19:17:42 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z 00:31:25.540 19:17:42 -- common/autotest_common.sh@10 -- # set +x 00:31:25.799 [2024-11-26 19:17:42.478308] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:31:25.799 [2024-11-26 19:17:42.478348] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3287132 ] 00:31:25.799 EAL: No free 2048 kB hugepages reported on node 1 00:31:25.799 [2024-11-26 19:17:42.533383] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:31:25.799 [2024-11-26 19:17:42.572419] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:31:26.734 19:17:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:31:26.734 19:17:43 -- common/autotest_common.sh@862 -- # return 0 00:31:26.734 19:17:43 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:31:26.734 19:17:43 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:31:26.735 19:17:43 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:31:26.735 19:17:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:26.735 19:17:43 -- common/autotest_common.sh@10 -- # set +x 00:31:26.735 19:17:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:26.735 19:17:43 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:31:26.735 19:17:43 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:31:26.994 nvme0n1 00:31:26.994 19:17:43 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:31:26.994 19:17:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:26.994 19:17:43 -- common/autotest_common.sh@10 -- # set +x 00:31:26.994 19:17:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:26.994 19:17:43 -- host/digest.sh@69 -- # bperf_py perform_tests 00:31:26.994 19:17:43 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:31:27.254 Running I/O for 2 seconds... 00:31:27.254 [2024-11-26 19:17:43.980698] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:27.254 [2024-11-26 19:17:43.980731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:12519 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:27.254 [2024-11-26 19:17:43.980741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:27.254 [2024-11-26 19:17:43.993208] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:27.254 [2024-11-26 19:17:43.993233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24087 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:27.254 [2024-11-26 19:17:43.993248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:27.254 [2024-11-26 19:17:44.005188] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:27.254 [2024-11-26 19:17:44.005211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:15203 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:27.254 [2024-11-26 19:17:44.005219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:27.254 [2024-11-26 19:17:44.017159] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:27.254 [2024-11-26 19:17:44.017180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:6596 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:27.254 [2024-11-26 19:17:44.017189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:27.254 [2024-11-26 19:17:44.029374] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:27.254 [2024-11-26 19:17:44.029396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:773 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:27.254 [2024-11-26 19:17:44.029405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:27.254 [2024-11-26 19:17:44.041337] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:27.254 [2024-11-26 19:17:44.041358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:2257 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:27.254 [2024-11-26 19:17:44.041366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:27.254 [2024-11-26 19:17:44.053652] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:27.254 [2024-11-26 19:17:44.053673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:3874 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:27.254 [2024-11-26 19:17:44.053681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:27.254 [2024-11-26 19:17:44.065609] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:27.254 [2024-11-26 19:17:44.065629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:20456 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:27.254 [2024-11-26 19:17:44.065637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:27.254 [2024-11-26 19:17:44.077464] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:27.254 [2024-11-26 19:17:44.077486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:200 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:27.254 [2024-11-26 19:17:44.077494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:27.254 [2024-11-26 19:17:44.089535] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:27.254 [2024-11-26 19:17:44.089556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:21218 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:27.254 [2024-11-26 19:17:44.089564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:27.254 [2024-11-26 19:17:44.101602] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:27.254 [2024-11-26 19:17:44.101629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:23400 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:27.254 [2024-11-26 19:17:44.101638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:27.254 [2024-11-26 19:17:44.113953] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:27.254 [2024-11-26 19:17:44.113974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:19192 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:27.254 [2024-11-26 19:17:44.113983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:27.254 [2024-11-26 19:17:44.125872] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:27.254 [2024-11-26 19:17:44.125893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:5261 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:27.254 [2024-11-26 19:17:44.125901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:27.254 [2024-11-26 19:17:44.138002] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:27.254 [2024-11-26 19:17:44.138023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:24562 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:27.254 [2024-11-26 19:17:44.138032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:27.254 [2024-11-26 19:17:44.150070] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:27.254 [2024-11-26 19:17:44.150091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:24201 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:27.254 [2024-11-26 19:17:44.150100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:27.254 [2024-11-26 19:17:44.162320] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:27.254 [2024-11-26 19:17:44.162341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:2135 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:27.254 [2024-11-26 19:17:44.162350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:27.254 [2024-11-26 19:17:44.174304] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:27.254 [2024-11-26 19:17:44.174325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:13859 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:27.254 [2024-11-26 19:17:44.174334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:27.513 [2024-11-26 19:17:44.186738] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:27.513 [2024-11-26 19:17:44.186759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:9372 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:27.513 [2024-11-26 19:17:44.186767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:27.513 [2024-11-26 19:17:44.198851] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:27.513 [2024-11-26 19:17:44.198872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:19275 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:27.513 [2024-11-26 19:17:44.198880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:27.513 [2024-11-26 19:17:44.210953] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:27.513 [2024-11-26 19:17:44.210974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:9557 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:27.513 [2024-11-26 19:17:44.210982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:27.514 [2024-11-26 19:17:44.222940] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:27.514 [2024-11-26 19:17:44.222965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:1223 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:27.514 [2024-11-26 19:17:44.222973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:27.514 [2024-11-26 19:17:44.234916] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:27.514 [2024-11-26 19:17:44.234936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:5223 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:27.514 [2024-11-26 19:17:44.234944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:27.514 [2024-11-26 19:17:44.247612] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:27.514 [2024-11-26 19:17:44.247633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:9956 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:27.514 [2024-11-26 19:17:44.247647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:27.514 [2024-11-26 19:17:44.259709] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:27.514 [2024-11-26 19:17:44.259730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:9525 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:27.514 [2024-11-26 19:17:44.259739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:27.514 [2024-11-26 19:17:44.271538] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:27.514 [2024-11-26 19:17:44.271559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:18726 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:27.514 [2024-11-26 19:17:44.271567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:27.514 [2024-11-26 19:17:44.283361] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:27.514 [2024-11-26 19:17:44.283382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:21455 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:27.514 [2024-11-26 19:17:44.283390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:27.514 [2024-11-26 19:17:44.295717] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:27.514 [2024-11-26 19:17:44.295738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:6904 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:27.514 [2024-11-26 19:17:44.295746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:27.514 [2024-11-26 19:17:44.307951] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:27.514 [2024-11-26 19:17:44.307974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:9000 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:27.514 [2024-11-26 19:17:44.307985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:27.514 [2024-11-26 19:17:44.320172] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:27.514 [2024-11-26 19:17:44.320193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:17246 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:27.514 [2024-11-26 19:17:44.320201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:27.514 [2024-11-26 19:17:44.332079] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:27.514 [2024-11-26 19:17:44.332099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:7741 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:27.514 [2024-11-26 19:17:44.332108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:27.514 [2024-11-26 19:17:44.344310] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:27.514 [2024-11-26 19:17:44.344330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:7070 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:27.514 [2024-11-26 19:17:44.344338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:27.514 [2024-11-26 19:17:44.356440] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:27.514 [2024-11-26 19:17:44.356460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:14415 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:27.514 [2024-11-26 19:17:44.356468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:27.514 [2024-11-26 19:17:44.368774] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:27.514 [2024-11-26 19:17:44.368795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:11515 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:27.514 [2024-11-26 19:17:44.368804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:27.514 [2024-11-26 19:17:44.381143] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:27.514 [2024-11-26 19:17:44.381163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:3083 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:27.514 [2024-11-26 19:17:44.381171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:27.514 [2024-11-26 19:17:44.393437] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:27.514 [2024-11-26 19:17:44.393457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:6491 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:27.514 [2024-11-26 19:17:44.393465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:27.514 [2024-11-26 19:17:44.405723] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:27.514 [2024-11-26 19:17:44.405744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:20924 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:27.514 [2024-11-26 19:17:44.405753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:27.514 [2024-11-26 19:17:44.417620] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:27.514 [2024-11-26 19:17:44.417645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:19197 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:27.514 [2024-11-26 19:17:44.417654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:27.514 [2024-11-26 19:17:44.429666] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:27.514 [2024-11-26 19:17:44.429688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:21632 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:27.514 [2024-11-26 19:17:44.429696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:27.774 [2024-11-26 19:17:44.442076] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:27.774 [2024-11-26 19:17:44.442096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:3877 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:27.774 [2024-11-26 19:17:44.442104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:27.774 [2024-11-26 19:17:44.454280] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:27.774 [2024-11-26 19:17:44.454302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:18032 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:27.774 [2024-11-26 19:17:44.454310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:27.774 [2024-11-26 19:17:44.466868] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:27.774 [2024-11-26 19:17:44.466890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:9168 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:27.774 [2024-11-26 19:17:44.466898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:27.774 [2024-11-26 19:17:44.478945] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:27.774 [2024-11-26 19:17:44.478971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:10199 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:27.774 [2024-11-26 19:17:44.478979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:27.774 [2024-11-26 19:17:44.491277] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:27.774 [2024-11-26 19:17:44.491300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:4193 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:27.774 [2024-11-26 19:17:44.491308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:27.774 [2024-11-26 19:17:44.503757] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:27.774 [2024-11-26 19:17:44.503778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:4445 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:27.774 [2024-11-26 19:17:44.503786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:27.774 [2024-11-26 19:17:44.516021] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:27.774 [2024-11-26 19:17:44.516042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:16721 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:27.774 [2024-11-26 19:17:44.516054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:27.774 [2024-11-26 19:17:44.528250] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:27.774 [2024-11-26 19:17:44.528272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:14651 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:27.774 [2024-11-26 19:17:44.528280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:27.774 [2024-11-26 19:17:44.540461] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:27.774 [2024-11-26 19:17:44.540482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:20195 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:27.774 [2024-11-26 19:17:44.540490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:27.774 [2024-11-26 19:17:44.552643] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:27.774 [2024-11-26 19:17:44.552665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:15205 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:27.774 [2024-11-26 19:17:44.552673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:27.774 [2024-11-26 19:17:44.564574] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:27.774 [2024-11-26 19:17:44.564596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:22222 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:27.774 [2024-11-26 19:17:44.564604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:27.774 [2024-11-26 19:17:44.576384] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:27.774 [2024-11-26 19:17:44.576407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:18627 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:27.774 [2024-11-26 19:17:44.576415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:27.774 [2024-11-26 19:17:44.588972] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:27.774 [2024-11-26 19:17:44.588995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:8436 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:27.774 [2024-11-26 19:17:44.589003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:27.774 [2024-11-26 19:17:44.601908] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:27.774 [2024-11-26 19:17:44.601929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:10585 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:27.774 [2024-11-26 19:17:44.601938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:27.774 [2024-11-26 19:17:44.614530] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:27.774 [2024-11-26 19:17:44.614560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:11014 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:27.774 [2024-11-26 19:17:44.614568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:27.774 [2024-11-26 19:17:44.626683] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:27.774 [2024-11-26 19:17:44.626707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:6522 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:27.774 [2024-11-26 19:17:44.626716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:27.774 [2024-11-26 19:17:44.639086] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:27.774 [2024-11-26 19:17:44.639107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:838 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:27.774 [2024-11-26 19:17:44.639115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:27.774 [2024-11-26 19:17:44.651994] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:27.775 [2024-11-26 19:17:44.652015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:3578 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:27.775 [2024-11-26 19:17:44.652023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:27.775 [2024-11-26 19:17:44.665587] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:27.775 [2024-11-26 19:17:44.665609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:24101 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:27.775 [2024-11-26 19:17:44.665619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:32 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:27.775 [2024-11-26 19:17:44.679740] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:27.775 [2024-11-26 19:17:44.679763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:12121 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:27.775 [2024-11-26 19:17:44.679773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:27.775 [2024-11-26 19:17:44.693330] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:27.775 [2024-11-26 19:17:44.693354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:18176 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:27.775 [2024-11-26 19:17:44.693363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.034 [2024-11-26 19:17:44.705608] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.034 [2024-11-26 19:17:44.705631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:1017 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.034 [2024-11-26 19:17:44.705639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.034 [2024-11-26 19:17:44.717826] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.034 [2024-11-26 19:17:44.717848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:5064 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.034 [2024-11-26 19:17:44.717856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.034 [2024-11-26 19:17:44.730705] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.034 [2024-11-26 19:17:44.730727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:15690 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.034 [2024-11-26 19:17:44.730735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.034 [2024-11-26 19:17:44.742860] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.034 [2024-11-26 19:17:44.742881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:4024 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.034 [2024-11-26 19:17:44.742889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.034 [2024-11-26 19:17:44.755286] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.034 [2024-11-26 19:17:44.755307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:10233 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.034 [2024-11-26 19:17:44.755315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.034 [2024-11-26 19:17:44.766932] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.034 [2024-11-26 19:17:44.766960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:14590 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.034 [2024-11-26 19:17:44.766969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.034 [2024-11-26 19:17:44.778777] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.034 [2024-11-26 19:17:44.778798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:18214 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.034 [2024-11-26 19:17:44.778807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.034 [2024-11-26 19:17:44.789323] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.034 [2024-11-26 19:17:44.789346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:17778 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.034 [2024-11-26 19:17:44.789354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.034 [2024-11-26 19:17:44.800529] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.034 [2024-11-26 19:17:44.800551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:4746 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.034 [2024-11-26 19:17:44.800560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.034 [2024-11-26 19:17:44.812033] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.034 [2024-11-26 19:17:44.812054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:3651 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.034 [2024-11-26 19:17:44.812062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.034 [2024-11-26 19:17:44.823838] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.034 [2024-11-26 19:17:44.823860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:8117 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.034 [2024-11-26 19:17:44.823868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.034 [2024-11-26 19:17:44.836033] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.034 [2024-11-26 19:17:44.836055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:18086 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.034 [2024-11-26 19:17:44.836067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.034 [2024-11-26 19:17:44.848343] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.034 [2024-11-26 19:17:44.848364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:20016 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.034 [2024-11-26 19:17:44.848372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.034 [2024-11-26 19:17:44.860353] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.035 [2024-11-26 19:17:44.860374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:24967 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.035 [2024-11-26 19:17:44.860383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.035 [2024-11-26 19:17:44.872220] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.035 [2024-11-26 19:17:44.872241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:16052 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.035 [2024-11-26 19:17:44.872249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.035 [2024-11-26 19:17:44.884198] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.035 [2024-11-26 19:17:44.884219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:15928 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.035 [2024-11-26 19:17:44.884228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.035 [2024-11-26 19:17:44.896560] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.035 [2024-11-26 19:17:44.896580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:24922 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.035 [2024-11-26 19:17:44.896588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.035 [2024-11-26 19:17:44.908611] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.035 [2024-11-26 19:17:44.908633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:18468 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.035 [2024-11-26 19:17:44.908641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.035 [2024-11-26 19:17:44.920810] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.035 [2024-11-26 19:17:44.920831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:5834 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.035 [2024-11-26 19:17:44.920840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.035 [2024-11-26 19:17:44.932623] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.035 [2024-11-26 19:17:44.932643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:10620 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.035 [2024-11-26 19:17:44.932651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.035 [2024-11-26 19:17:44.944365] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.035 [2024-11-26 19:17:44.944389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:11371 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.035 [2024-11-26 19:17:44.944398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.035 [2024-11-26 19:17:44.956308] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.035 [2024-11-26 19:17:44.956330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:6378 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.035 [2024-11-26 19:17:44.956338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.295 [2024-11-26 19:17:44.968113] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.295 [2024-11-26 19:17:44.968133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:14225 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.295 [2024-11-26 19:17:44.968142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.295 [2024-11-26 19:17:44.980244] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.295 [2024-11-26 19:17:44.980264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:23098 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.295 [2024-11-26 19:17:44.980272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:37 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.295 [2024-11-26 19:17:44.992162] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.295 [2024-11-26 19:17:44.992183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:24499 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.296 [2024-11-26 19:17:44.992191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.296 [2024-11-26 19:17:45.004297] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.296 [2024-11-26 19:17:45.004318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:24085 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.296 [2024-11-26 19:17:45.004327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.296 [2024-11-26 19:17:45.016568] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.296 [2024-11-26 19:17:45.016589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:3987 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.296 [2024-11-26 19:17:45.016597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.296 [2024-11-26 19:17:45.028480] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.296 [2024-11-26 19:17:45.028501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:3239 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.296 [2024-11-26 19:17:45.028509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.296 [2024-11-26 19:17:45.040469] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.296 [2024-11-26 19:17:45.040490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:17781 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.296 [2024-11-26 19:17:45.040497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.296 [2024-11-26 19:17:45.052634] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.296 [2024-11-26 19:17:45.052654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:5971 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.296 [2024-11-26 19:17:45.052662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.296 [2024-11-26 19:17:45.064605] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.296 [2024-11-26 19:17:45.064626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:4681 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.296 [2024-11-26 19:17:45.064635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.296 [2024-11-26 19:17:45.076714] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.296 [2024-11-26 19:17:45.076734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:6503 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.296 [2024-11-26 19:17:45.076743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.296 [2024-11-26 19:17:45.088422] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.296 [2024-11-26 19:17:45.088442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:6113 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.296 [2024-11-26 19:17:45.088450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.296 [2024-11-26 19:17:45.100222] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.296 [2024-11-26 19:17:45.100242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:7107 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.296 [2024-11-26 19:17:45.100250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:37 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.296 [2024-11-26 19:17:45.112228] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.296 [2024-11-26 19:17:45.112249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:7709 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.296 [2024-11-26 19:17:45.112258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.296 [2024-11-26 19:17:45.124098] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.296 [2024-11-26 19:17:45.124118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:16272 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.296 [2024-11-26 19:17:45.124126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.296 [2024-11-26 19:17:45.135930] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.296 [2024-11-26 19:17:45.135955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:7962 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.296 [2024-11-26 19:17:45.135964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.296 [2024-11-26 19:17:45.148129] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.296 [2024-11-26 19:17:45.148153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:5104 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.296 [2024-11-26 19:17:45.148161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.296 [2024-11-26 19:17:45.159912] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.296 [2024-11-26 19:17:45.159932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:5735 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.296 [2024-11-26 19:17:45.159941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.296 [2024-11-26 19:17:45.171743] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.296 [2024-11-26 19:17:45.171764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:24233 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.296 [2024-11-26 19:17:45.171772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.296 [2024-11-26 19:17:45.183759] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.296 [2024-11-26 19:17:45.183780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:11056 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.296 [2024-11-26 19:17:45.183788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.296 [2024-11-26 19:17:45.196231] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.296 [2024-11-26 19:17:45.196252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:25561 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.296 [2024-11-26 19:17:45.196260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.296 [2024-11-26 19:17:45.208363] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.296 [2024-11-26 19:17:45.208384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:8562 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.296 [2024-11-26 19:17:45.208392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.556 [2024-11-26 19:17:45.220587] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.556 [2024-11-26 19:17:45.220607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:21670 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.556 [2024-11-26 19:17:45.220615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.556 [2024-11-26 19:17:45.232764] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.556 [2024-11-26 19:17:45.232784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:10791 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.556 [2024-11-26 19:17:45.232792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.556 [2024-11-26 19:17:45.244439] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.556 [2024-11-26 19:17:45.244460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:12525 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.556 [2024-11-26 19:17:45.244468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.556 [2024-11-26 19:17:45.256190] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.556 [2024-11-26 19:17:45.256211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:15992 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.556 [2024-11-26 19:17:45.256219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.556 [2024-11-26 19:17:45.268524] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.556 [2024-11-26 19:17:45.268545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:5102 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.556 [2024-11-26 19:17:45.268553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.556 [2024-11-26 19:17:45.280445] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.556 [2024-11-26 19:17:45.280465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:5614 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.556 [2024-11-26 19:17:45.280473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.556 [2024-11-26 19:17:45.292624] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.556 [2024-11-26 19:17:45.292645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:13317 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.556 [2024-11-26 19:17:45.292653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.556 [2024-11-26 19:17:45.304761] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.556 [2024-11-26 19:17:45.304781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:24480 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.556 [2024-11-26 19:17:45.304789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.556 [2024-11-26 19:17:45.317243] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.556 [2024-11-26 19:17:45.317263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:11604 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.556 [2024-11-26 19:17:45.317271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.556 [2024-11-26 19:17:45.329380] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.556 [2024-11-26 19:17:45.329401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:3688 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.556 [2024-11-26 19:17:45.329409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.556 [2024-11-26 19:17:45.341651] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.556 [2024-11-26 19:17:45.341671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:14195 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.556 [2024-11-26 19:17:45.341679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.556 [2024-11-26 19:17:45.353790] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.556 [2024-11-26 19:17:45.353811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:11271 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.556 [2024-11-26 19:17:45.353822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.556 [2024-11-26 19:17:45.365879] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.556 [2024-11-26 19:17:45.365899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:1568 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.556 [2024-11-26 19:17:45.365907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.556 [2024-11-26 19:17:45.378204] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.556 [2024-11-26 19:17:45.378223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:14180 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.556 [2024-11-26 19:17:45.378231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.556 [2024-11-26 19:17:45.390537] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.556 [2024-11-26 19:17:45.390558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:242 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.556 [2024-11-26 19:17:45.390566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.556 [2024-11-26 19:17:45.403302] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.557 [2024-11-26 19:17:45.403322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:1460 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.557 [2024-11-26 19:17:45.403330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.557 [2024-11-26 19:17:45.416286] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.557 [2024-11-26 19:17:45.416308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:6663 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.557 [2024-11-26 19:17:45.416317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.557 [2024-11-26 19:17:45.428582] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.557 [2024-11-26 19:17:45.428603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:12967 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.557 [2024-11-26 19:17:45.428611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.557 [2024-11-26 19:17:45.440537] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.557 [2024-11-26 19:17:45.440559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:13233 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.557 [2024-11-26 19:17:45.440567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.557 [2024-11-26 19:17:45.452114] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.557 [2024-11-26 19:17:45.452135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:12192 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.557 [2024-11-26 19:17:45.452143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.557 [2024-11-26 19:17:45.463873] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.557 [2024-11-26 19:17:45.463900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:20781 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.557 [2024-11-26 19:17:45.463908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.557 [2024-11-26 19:17:45.476199] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.557 [2024-11-26 19:17:45.476219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:19936 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.557 [2024-11-26 19:17:45.476228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.816 [2024-11-26 19:17:45.488873] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.816 [2024-11-26 19:17:45.488893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:17996 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.816 [2024-11-26 19:17:45.488901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.816 [2024-11-26 19:17:45.501392] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.816 [2024-11-26 19:17:45.501412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:4023 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.816 [2024-11-26 19:17:45.501420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.816 [2024-11-26 19:17:45.512320] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.816 [2024-11-26 19:17:45.512341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:4649 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.816 [2024-11-26 19:17:45.512349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.816 [2024-11-26 19:17:45.524601] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.816 [2024-11-26 19:17:45.524621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:23730 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.816 [2024-11-26 19:17:45.524629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.816 [2024-11-26 19:17:45.536814] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.816 [2024-11-26 19:17:45.536835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:11473 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.816 [2024-11-26 19:17:45.536844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.816 [2024-11-26 19:17:45.549234] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.816 [2024-11-26 19:17:45.549254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:18640 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.816 [2024-11-26 19:17:45.549262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.816 [2024-11-26 19:17:45.561139] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.816 [2024-11-26 19:17:45.561159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:8191 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.816 [2024-11-26 19:17:45.561167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.816 [2024-11-26 19:17:45.572913] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.816 [2024-11-26 19:17:45.572934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:7853 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.816 [2024-11-26 19:17:45.572942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.816 [2024-11-26 19:17:45.584902] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.816 [2024-11-26 19:17:45.584922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:8895 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.816 [2024-11-26 19:17:45.584930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.816 [2024-11-26 19:17:45.596707] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.816 [2024-11-26 19:17:45.596728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:1206 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.816 [2024-11-26 19:17:45.596736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.816 [2024-11-26 19:17:45.608783] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.816 [2024-11-26 19:17:45.608803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:13350 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.816 [2024-11-26 19:17:45.608811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.816 [2024-11-26 19:17:45.621585] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.816 [2024-11-26 19:17:45.621606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:23892 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.816 [2024-11-26 19:17:45.621615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.816 [2024-11-26 19:17:45.633443] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.817 [2024-11-26 19:17:45.633464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:20737 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.817 [2024-11-26 19:17:45.633472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.817 [2024-11-26 19:17:45.645068] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.817 [2024-11-26 19:17:45.645089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:15906 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.817 [2024-11-26 19:17:45.645097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.817 [2024-11-26 19:17:45.657650] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.817 [2024-11-26 19:17:45.657670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:23683 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.817 [2024-11-26 19:17:45.657678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.817 [2024-11-26 19:17:45.669308] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.817 [2024-11-26 19:17:45.669329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:10776 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.817 [2024-11-26 19:17:45.669341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.817 [2024-11-26 19:17:45.680802] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.817 [2024-11-26 19:17:45.680822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:22519 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.817 [2024-11-26 19:17:45.680830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.817 [2024-11-26 19:17:45.693038] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.817 [2024-11-26 19:17:45.693059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:15038 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.817 [2024-11-26 19:17:45.693067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.817 [2024-11-26 19:17:45.705919] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.817 [2024-11-26 19:17:45.705940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:22891 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.817 [2024-11-26 19:17:45.705954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.817 [2024-11-26 19:17:45.717861] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.817 [2024-11-26 19:17:45.717881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:23642 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.817 [2024-11-26 19:17:45.717890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:28.817 [2024-11-26 19:17:45.730490] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:28.817 [2024-11-26 19:17:45.730511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:13676 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:28.817 [2024-11-26 19:17:45.730519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:29.076 [2024-11-26 19:17:45.742516] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:29.076 [2024-11-26 19:17:45.742537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:6435 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:29.076 [2024-11-26 19:17:45.742545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:29.076 [2024-11-26 19:17:45.759613] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:29.076 [2024-11-26 19:17:45.759634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:19365 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:29.076 [2024-11-26 19:17:45.759642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:29.076 [2024-11-26 19:17:45.771525] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:29.076 [2024-11-26 19:17:45.771546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:2925 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:29.076 [2024-11-26 19:17:45.771554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:29.076 [2024-11-26 19:17:45.783785] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:29.076 [2024-11-26 19:17:45.783806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:24223 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:29.076 [2024-11-26 19:17:45.783815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:29.076 [2024-11-26 19:17:45.795698] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:29.076 [2024-11-26 19:17:45.795720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:13019 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:29.076 [2024-11-26 19:17:45.795729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:29.076 [2024-11-26 19:17:45.807614] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:29.076 [2024-11-26 19:17:45.807634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:19045 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:29.076 [2024-11-26 19:17:45.807642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:29.076 [2024-11-26 19:17:45.819517] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:29.076 [2024-11-26 19:17:45.819538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:24720 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:29.076 [2024-11-26 19:17:45.819546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:29.076 [2024-11-26 19:17:45.831648] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:29.076 [2024-11-26 19:17:45.831669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:20029 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:29.076 [2024-11-26 19:17:45.831678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:29.076 [2024-11-26 19:17:45.843968] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:29.076 [2024-11-26 19:17:45.843989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:24159 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:29.076 [2024-11-26 19:17:45.843997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:29.076 [2024-11-26 19:17:45.856232] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:29.076 [2024-11-26 19:17:45.856253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:6482 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:29.076 [2024-11-26 19:17:45.856262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:29.076 [2024-11-26 19:17:45.868320] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:29.076 [2024-11-26 19:17:45.868343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:14583 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:29.076 [2024-11-26 19:17:45.868351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:29.076 [2024-11-26 19:17:45.880821] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:29.076 [2024-11-26 19:17:45.880842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:2660 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:29.076 [2024-11-26 19:17:45.880854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:29.076 [2024-11-26 19:17:45.893118] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:29.076 [2024-11-26 19:17:45.893139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:3352 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:29.076 [2024-11-26 19:17:45.893147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:29.076 [2024-11-26 19:17:45.905449] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:29.077 [2024-11-26 19:17:45.905469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:25215 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:29.077 [2024-11-26 19:17:45.905477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:29.077 [2024-11-26 19:17:45.917531] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:29.077 [2024-11-26 19:17:45.917551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:14273 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:29.077 [2024-11-26 19:17:45.917559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:29.077 [2024-11-26 19:17:45.929249] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:29.077 [2024-11-26 19:17:45.929269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:25250 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:29.077 [2024-11-26 19:17:45.929277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:29.077 [2024-11-26 19:17:45.941478] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:29.077 [2024-11-26 19:17:45.941499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:14688 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:29.077 [2024-11-26 19:17:45.941507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:29.077 [2024-11-26 19:17:45.953699] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:29.077 [2024-11-26 19:17:45.953719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:5236 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:29.077 [2024-11-26 19:17:45.953727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:29.077 [2024-11-26 19:17:45.965727] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x18dca40) 00:31:29.077 [2024-11-26 19:17:45.965748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:24578 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:29.077 [2024-11-26 19:17:45.965756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:29.336 00:31:29.336 Latency(us) 00:31:29.336 [2024-11-26T18:17:46.263Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:31:29.336 [2024-11-26T18:17:46.263Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:31:29.336 nvme0n1 : 2.05 20553.85 80.29 0.00 0.00 6100.30 2735.42 46046.16 00:31:29.336 [2024-11-26T18:17:46.263Z] =================================================================================================================== 00:31:29.336 [2024-11-26T18:17:46.263Z] Total : 20553.85 80.29 0.00 0.00 6100.30 2735.42 46046.16 00:31:29.336 0 00:31:29.336 19:17:46 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:31:29.336 19:17:46 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:31:29.336 19:17:46 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:31:29.336 | .driver_specific 00:31:29.336 | .nvme_error 00:31:29.336 | .status_code 00:31:29.336 | .command_transient_transport_error' 00:31:29.336 19:17:46 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:31:29.336 19:17:46 -- host/digest.sh@71 -- # (( 164 > 0 )) 00:31:29.336 19:17:46 -- host/digest.sh@73 -- # killprocess 3287132 00:31:29.336 19:17:46 -- common/autotest_common.sh@936 -- # '[' -z 3287132 ']' 00:31:29.336 19:17:46 -- common/autotest_common.sh@940 -- # kill -0 3287132 00:31:29.336 19:17:46 -- common/autotest_common.sh@941 -- # uname 00:31:29.336 19:17:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:31:29.336 19:17:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3287132 00:31:29.595 19:17:46 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:31:29.595 19:17:46 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:31:29.595 19:17:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3287132' 00:31:29.595 killing process with pid 3287132 00:31:29.595 19:17:46 -- common/autotest_common.sh@955 -- # kill 3287132 00:31:29.595 Received shutdown signal, test time was about 2.000000 seconds 00:31:29.595 00:31:29.595 Latency(us) 00:31:29.595 [2024-11-26T18:17:46.522Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:31:29.595 [2024-11-26T18:17:46.522Z] =================================================================================================================== 00:31:29.595 [2024-11-26T18:17:46.522Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:31:29.595 19:17:46 -- common/autotest_common.sh@960 -- # wait 3287132 00:31:29.595 19:17:46 -- host/digest.sh@108 -- # run_bperf_err randread 131072 16 00:31:29.595 19:17:46 -- host/digest.sh@54 -- # local rw bs qd 00:31:29.595 19:17:46 -- host/digest.sh@56 -- # rw=randread 00:31:29.595 19:17:46 -- host/digest.sh@56 -- # bs=131072 00:31:29.595 19:17:46 -- host/digest.sh@56 -- # qd=16 00:31:29.595 19:17:46 -- host/digest.sh@58 -- # bperfpid=3287832 00:31:29.595 19:17:46 -- host/digest.sh@60 -- # waitforlisten 3287832 /var/tmp/bperf.sock 00:31:29.595 19:17:46 -- common/autotest_common.sh@829 -- # '[' -z 3287832 ']' 00:31:29.595 19:17:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:31:29.595 19:17:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:31:29.595 19:17:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:31:29.595 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:31:29.595 19:17:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:31:29.595 19:17:46 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z 00:31:29.595 19:17:46 -- common/autotest_common.sh@10 -- # set +x 00:31:29.595 [2024-11-26 19:17:46.481360] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:31:29.595 [2024-11-26 19:17:46.481408] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3287832 ] 00:31:29.595 I/O size of 131072 is greater than zero copy threshold (65536). 00:31:29.595 Zero copy mechanism will not be used. 00:31:29.595 EAL: No free 2048 kB hugepages reported on node 1 00:31:29.855 [2024-11-26 19:17:46.534423] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:31:29.855 [2024-11-26 19:17:46.571558] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:31:30.422 19:17:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:31:30.422 19:17:47 -- common/autotest_common.sh@862 -- # return 0 00:31:30.422 19:17:47 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:31:30.422 19:17:47 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:31:30.681 19:17:47 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:31:30.681 19:17:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:30.681 19:17:47 -- common/autotest_common.sh@10 -- # set +x 00:31:30.681 19:17:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:30.681 19:17:47 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:31:30.681 19:17:47 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:31:30.940 nvme0n1 00:31:30.940 19:17:47 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:31:30.940 19:17:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:30.940 19:17:47 -- common/autotest_common.sh@10 -- # set +x 00:31:30.940 19:17:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:30.940 19:17:47 -- host/digest.sh@69 -- # bperf_py perform_tests 00:31:30.940 19:17:47 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:31:31.200 I/O size of 131072 is greater than zero copy threshold (65536). 00:31:31.200 Zero copy mechanism will not be used. 00:31:31.200 Running I/O for 2 seconds... 00:31:31.200 [2024-11-26 19:17:47.952102] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.200 [2024-11-26 19:17:47.952135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.200 [2024-11-26 19:17:47.952145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:31.200 [2024-11-26 19:17:47.956821] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.200 [2024-11-26 19:17:47.956849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.200 [2024-11-26 19:17:47.956858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:31.200 [2024-11-26 19:17:47.961578] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.200 [2024-11-26 19:17:47.961601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.200 [2024-11-26 19:17:47.961609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:31.200 [2024-11-26 19:17:47.967318] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.200 [2024-11-26 19:17:47.967339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.200 [2024-11-26 19:17:47.967351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:31.200 [2024-11-26 19:17:47.973093] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.200 [2024-11-26 19:17:47.973114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.200 [2024-11-26 19:17:47.973122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:31.200 [2024-11-26 19:17:47.978752] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.200 [2024-11-26 19:17:47.978773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.200 [2024-11-26 19:17:47.978782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:31.200 [2024-11-26 19:17:47.984676] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.200 [2024-11-26 19:17:47.984697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.200 [2024-11-26 19:17:47.984705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:31.200 [2024-11-26 19:17:47.990659] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.200 [2024-11-26 19:17:47.990680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.200 [2024-11-26 19:17:47.990688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:31.200 [2024-11-26 19:17:47.996307] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.200 [2024-11-26 19:17:47.996330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.200 [2024-11-26 19:17:47.996337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:31.200 [2024-11-26 19:17:48.002158] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.200 [2024-11-26 19:17:48.002180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.200 [2024-11-26 19:17:48.002188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:31.200 [2024-11-26 19:17:48.007882] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.200 [2024-11-26 19:17:48.007903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.200 [2024-11-26 19:17:48.007911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:31.200 [2024-11-26 19:17:48.013421] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.200 [2024-11-26 19:17:48.013442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.200 [2024-11-26 19:17:48.013450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:31.200 [2024-11-26 19:17:48.018912] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.201 [2024-11-26 19:17:48.018933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.201 [2024-11-26 19:17:48.018942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:31.201 [2024-11-26 19:17:48.024242] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.201 [2024-11-26 19:17:48.024263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.201 [2024-11-26 19:17:48.024272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:31.201 [2024-11-26 19:17:48.029378] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.201 [2024-11-26 19:17:48.029399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.201 [2024-11-26 19:17:48.029415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:31.201 [2024-11-26 19:17:48.034570] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.201 [2024-11-26 19:17:48.034591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.201 [2024-11-26 19:17:48.034599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:31.201 [2024-11-26 19:17:48.039761] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.201 [2024-11-26 19:17:48.039782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.201 [2024-11-26 19:17:48.039789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:31.201 [2024-11-26 19:17:48.044978] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.201 [2024-11-26 19:17:48.044998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.201 [2024-11-26 19:17:48.045007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:31.201 [2024-11-26 19:17:48.050268] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.201 [2024-11-26 19:17:48.050289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.201 [2024-11-26 19:17:48.050297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:31.201 [2024-11-26 19:17:48.056169] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.201 [2024-11-26 19:17:48.056189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.201 [2024-11-26 19:17:48.056197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:31.201 [2024-11-26 19:17:48.062003] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.201 [2024-11-26 19:17:48.062024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.201 [2024-11-26 19:17:48.062032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:31.201 [2024-11-26 19:17:48.067730] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.201 [2024-11-26 19:17:48.067751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.201 [2024-11-26 19:17:48.067758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:31.201 [2024-11-26 19:17:48.073609] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.201 [2024-11-26 19:17:48.073629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.201 [2024-11-26 19:17:48.073638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:31.201 [2024-11-26 19:17:48.079465] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.201 [2024-11-26 19:17:48.079486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.201 [2024-11-26 19:17:48.079494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:31.201 [2024-11-26 19:17:48.085346] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.201 [2024-11-26 19:17:48.085367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.201 [2024-11-26 19:17:48.085375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:31.201 [2024-11-26 19:17:48.091789] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.201 [2024-11-26 19:17:48.091810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.201 [2024-11-26 19:17:48.091818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:31.201 [2024-11-26 19:17:48.098737] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.201 [2024-11-26 19:17:48.098760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.201 [2024-11-26 19:17:48.098768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:31.201 [2024-11-26 19:17:48.105839] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.201 [2024-11-26 19:17:48.105862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.201 [2024-11-26 19:17:48.105870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:31.201 [2024-11-26 19:17:48.111404] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.201 [2024-11-26 19:17:48.111426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.201 [2024-11-26 19:17:48.111434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:31.201 [2024-11-26 19:17:48.118866] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.201 [2024-11-26 19:17:48.118889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.201 [2024-11-26 19:17:48.118897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:31.461 [2024-11-26 19:17:48.123640] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.461 [2024-11-26 19:17:48.123662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.461 [2024-11-26 19:17:48.123671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:31.461 [2024-11-26 19:17:48.129262] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.462 [2024-11-26 19:17:48.129285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.462 [2024-11-26 19:17:48.129296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:31.462 [2024-11-26 19:17:48.135393] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.462 [2024-11-26 19:17:48.135417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.462 [2024-11-26 19:17:48.135425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:31.462 [2024-11-26 19:17:48.141067] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.462 [2024-11-26 19:17:48.141089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:7648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.462 [2024-11-26 19:17:48.141098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:31.462 [2024-11-26 19:17:48.146961] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.462 [2024-11-26 19:17:48.146984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.462 [2024-11-26 19:17:48.146993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:31.462 [2024-11-26 19:17:48.153215] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.462 [2024-11-26 19:17:48.153238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:12736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.462 [2024-11-26 19:17:48.153247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:31.462 [2024-11-26 19:17:48.159670] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.462 [2024-11-26 19:17:48.159693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:11616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.462 [2024-11-26 19:17:48.159701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:31.462 [2024-11-26 19:17:48.166622] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.462 [2024-11-26 19:17:48.166644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.462 [2024-11-26 19:17:48.166653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:31.462 [2024-11-26 19:17:48.172652] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.462 [2024-11-26 19:17:48.172675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:21568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.462 [2024-11-26 19:17:48.172683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:31.462 [2024-11-26 19:17:48.179122] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.462 [2024-11-26 19:17:48.179144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.462 [2024-11-26 19:17:48.179153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:31.462 [2024-11-26 19:17:48.183627] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.462 [2024-11-26 19:17:48.183653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.462 [2024-11-26 19:17:48.183661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:31.462 [2024-11-26 19:17:48.190893] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.462 [2024-11-26 19:17:48.190915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.462 [2024-11-26 19:17:48.190924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:31.462 [2024-11-26 19:17:48.199115] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.462 [2024-11-26 19:17:48.199137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:22336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.462 [2024-11-26 19:17:48.199145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:31.462 [2024-11-26 19:17:48.206339] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.462 [2024-11-26 19:17:48.206362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:18624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.462 [2024-11-26 19:17:48.206371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:31.462 [2024-11-26 19:17:48.213462] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.462 [2024-11-26 19:17:48.213484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.462 [2024-11-26 19:17:48.213495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:31.462 [2024-11-26 19:17:48.222120] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.462 [2024-11-26 19:17:48.222141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:8864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.462 [2024-11-26 19:17:48.222149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:31.462 [2024-11-26 19:17:48.229407] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.462 [2024-11-26 19:17:48.229428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.462 [2024-11-26 19:17:48.229437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:31.462 [2024-11-26 19:17:48.235152] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.462 [2024-11-26 19:17:48.235173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:3264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.462 [2024-11-26 19:17:48.235181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:31.462 [2024-11-26 19:17:48.240879] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.462 [2024-11-26 19:17:48.240901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:21568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.462 [2024-11-26 19:17:48.240909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:31.462 [2024-11-26 19:17:48.246493] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.462 [2024-11-26 19:17:48.246514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:7808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.462 [2024-11-26 19:17:48.246521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:31.462 [2024-11-26 19:17:48.251840] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.462 [2024-11-26 19:17:48.251862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.462 [2024-11-26 19:17:48.251870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:31.462 [2024-11-26 19:17:48.257343] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.462 [2024-11-26 19:17:48.257364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:11744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.462 [2024-11-26 19:17:48.257373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:31.462 [2024-11-26 19:17:48.262112] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.462 [2024-11-26 19:17:48.262133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:21152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.462 [2024-11-26 19:17:48.262141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:31.462 [2024-11-26 19:17:48.266548] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.462 [2024-11-26 19:17:48.266570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:3808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.462 [2024-11-26 19:17:48.266578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:31.462 [2024-11-26 19:17:48.270672] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.462 [2024-11-26 19:17:48.270693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:12096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.462 [2024-11-26 19:17:48.270701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:31.462 [2024-11-26 19:17:48.274823] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.462 [2024-11-26 19:17:48.274845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:17600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.462 [2024-11-26 19:17:48.274853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:31.462 [2024-11-26 19:17:48.279847] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.462 [2024-11-26 19:17:48.279869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.462 [2024-11-26 19:17:48.279877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:31.463 [2024-11-26 19:17:48.285056] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.463 [2024-11-26 19:17:48.285077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:17440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.463 [2024-11-26 19:17:48.285090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:31.463 [2024-11-26 19:17:48.290027] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.463 [2024-11-26 19:17:48.290049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.463 [2024-11-26 19:17:48.290057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:31.463 [2024-11-26 19:17:48.296052] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.463 [2024-11-26 19:17:48.296074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:12480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.463 [2024-11-26 19:17:48.296082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:31.463 [2024-11-26 19:17:48.301110] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.463 [2024-11-26 19:17:48.301132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:23328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.463 [2024-11-26 19:17:48.301140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:31.463 [2024-11-26 19:17:48.305865] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.463 [2024-11-26 19:17:48.305887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:23520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.463 [2024-11-26 19:17:48.305895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:31.463 [2024-11-26 19:17:48.310955] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.463 [2024-11-26 19:17:48.310977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.463 [2024-11-26 19:17:48.310985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:31.463 [2024-11-26 19:17:48.316300] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.463 [2024-11-26 19:17:48.316321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.463 [2024-11-26 19:17:48.316329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:31.463 [2024-11-26 19:17:48.321651] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.463 [2024-11-26 19:17:48.321673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.463 [2024-11-26 19:17:48.321681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:31.463 [2024-11-26 19:17:48.327092] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.463 [2024-11-26 19:17:48.327114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.463 [2024-11-26 19:17:48.327123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:31.463 [2024-11-26 19:17:48.332840] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.463 [2024-11-26 19:17:48.332865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.463 [2024-11-26 19:17:48.332873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:31.463 [2024-11-26 19:17:48.338407] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.463 [2024-11-26 19:17:48.338430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:8352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.463 [2024-11-26 19:17:48.338438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:31.463 [2024-11-26 19:17:48.344133] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.463 [2024-11-26 19:17:48.344156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:22880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.463 [2024-11-26 19:17:48.344164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:31.463 [2024-11-26 19:17:48.348342] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.463 [2024-11-26 19:17:48.348364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.463 [2024-11-26 19:17:48.348372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:31.463 [2024-11-26 19:17:48.352573] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.463 [2024-11-26 19:17:48.352595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.463 [2024-11-26 19:17:48.352603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:31.463 [2024-11-26 19:17:48.356750] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.463 [2024-11-26 19:17:48.356772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:2208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.463 [2024-11-26 19:17:48.356781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:31.463 [2024-11-26 19:17:48.360856] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.463 [2024-11-26 19:17:48.360878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.463 [2024-11-26 19:17:48.360887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:31.463 [2024-11-26 19:17:48.364968] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.463 [2024-11-26 19:17:48.364990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:17344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.463 [2024-11-26 19:17:48.364999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:31.463 [2024-11-26 19:17:48.368661] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.463 [2024-11-26 19:17:48.368683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:22592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.463 [2024-11-26 19:17:48.368696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:31.463 [2024-11-26 19:17:48.372636] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.463 [2024-11-26 19:17:48.372657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.463 [2024-11-26 19:17:48.372666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:31.463 [2024-11-26 19:17:48.377258] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.463 [2024-11-26 19:17:48.377280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.463 [2024-11-26 19:17:48.377288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:31.463 [2024-11-26 19:17:48.382133] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.463 [2024-11-26 19:17:48.382156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:22848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.463 [2024-11-26 19:17:48.382164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:31.724 [2024-11-26 19:17:48.387477] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.724 [2024-11-26 19:17:48.387498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:12800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.724 [2024-11-26 19:17:48.387506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:31.724 [2024-11-26 19:17:48.392524] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.724 [2024-11-26 19:17:48.392547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:3904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.724 [2024-11-26 19:17:48.392556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:31.724 [2024-11-26 19:17:48.397957] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.724 [2024-11-26 19:17:48.397979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:25120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.724 [2024-11-26 19:17:48.397987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:31.724 [2024-11-26 19:17:48.403757] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.724 [2024-11-26 19:17:48.403779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.724 [2024-11-26 19:17:48.403787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:31.724 [2024-11-26 19:17:48.409223] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.724 [2024-11-26 19:17:48.409246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:10272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.724 [2024-11-26 19:17:48.409255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:31.724 [2024-11-26 19:17:48.415098] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.724 [2024-11-26 19:17:48.415124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:19968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.724 [2024-11-26 19:17:48.415132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:31.724 [2024-11-26 19:17:48.421176] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.724 [2024-11-26 19:17:48.421199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:8544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.724 [2024-11-26 19:17:48.421207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:31.724 [2024-11-26 19:17:48.427258] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.724 [2024-11-26 19:17:48.427280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:9376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.724 [2024-11-26 19:17:48.427288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:31.724 [2024-11-26 19:17:48.433351] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.724 [2024-11-26 19:17:48.433373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:24512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.724 [2024-11-26 19:17:48.433381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:31.724 [2024-11-26 19:17:48.439172] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.724 [2024-11-26 19:17:48.439194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.724 [2024-11-26 19:17:48.439202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:31.724 [2024-11-26 19:17:48.445077] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.724 [2024-11-26 19:17:48.445100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:9056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.724 [2024-11-26 19:17:48.445108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:31.724 [2024-11-26 19:17:48.451499] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.724 [2024-11-26 19:17:48.451521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:7296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.724 [2024-11-26 19:17:48.451529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:31.724 [2024-11-26 19:17:48.457142] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.724 [2024-11-26 19:17:48.457164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:15456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.724 [2024-11-26 19:17:48.457173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:31.724 [2024-11-26 19:17:48.462667] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.724 [2024-11-26 19:17:48.462690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.724 [2024-11-26 19:17:48.462699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:31.724 [2024-11-26 19:17:48.468292] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.724 [2024-11-26 19:17:48.468315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:1600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.724 [2024-11-26 19:17:48.468323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:31.724 [2024-11-26 19:17:48.474545] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.724 [2024-11-26 19:17:48.474567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:3744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.724 [2024-11-26 19:17:48.474575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:31.724 [2024-11-26 19:17:48.480455] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.724 [2024-11-26 19:17:48.480477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:20384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.724 [2024-11-26 19:17:48.480485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:31.724 [2024-11-26 19:17:48.486107] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.724 [2024-11-26 19:17:48.486129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.724 [2024-11-26 19:17:48.486137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:31.724 [2024-11-26 19:17:48.492192] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.724 [2024-11-26 19:17:48.492213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:6816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.725 [2024-11-26 19:17:48.492221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:31.725 [2024-11-26 19:17:48.498243] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.725 [2024-11-26 19:17:48.498265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:23200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.725 [2024-11-26 19:17:48.498274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:31.725 [2024-11-26 19:17:48.503912] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.725 [2024-11-26 19:17:48.503934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:22752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.725 [2024-11-26 19:17:48.503942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:31.725 [2024-11-26 19:17:48.509738] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.725 [2024-11-26 19:17:48.509760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:5600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.725 [2024-11-26 19:17:48.509767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:31.725 [2024-11-26 19:17:48.515134] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.725 [2024-11-26 19:17:48.515157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:1728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.725 [2024-11-26 19:17:48.515171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:31.725 [2024-11-26 19:17:48.520536] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.725 [2024-11-26 19:17:48.520558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:12960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.725 [2024-11-26 19:17:48.520566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:31.725 [2024-11-26 19:17:48.525636] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.725 [2024-11-26 19:17:48.525659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.725 [2024-11-26 19:17:48.525667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:31.725 [2024-11-26 19:17:48.530759] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.725 [2024-11-26 19:17:48.530782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:14592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.725 [2024-11-26 19:17:48.530791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:31.725 [2024-11-26 19:17:48.535876] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.725 [2024-11-26 19:17:48.535899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:7008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.725 [2024-11-26 19:17:48.535907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:31.725 [2024-11-26 19:17:48.541013] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.725 [2024-11-26 19:17:48.541035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:20064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.725 [2024-11-26 19:17:48.541043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:31.725 [2024-11-26 19:17:48.546174] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.725 [2024-11-26 19:17:48.546196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:11424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.725 [2024-11-26 19:17:48.546204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:31.725 [2024-11-26 19:17:48.552243] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.725 [2024-11-26 19:17:48.552264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:24576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.725 [2024-11-26 19:17:48.552273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:31.725 [2024-11-26 19:17:48.558266] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.725 [2024-11-26 19:17:48.558288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:10944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.725 [2024-11-26 19:17:48.558295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:31.725 [2024-11-26 19:17:48.564130] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.725 [2024-11-26 19:17:48.564156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.725 [2024-11-26 19:17:48.564165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:31.725 [2024-11-26 19:17:48.569976] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.725 [2024-11-26 19:17:48.569997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:8224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.725 [2024-11-26 19:17:48.570005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:31.725 [2024-11-26 19:17:48.575657] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.725 [2024-11-26 19:17:48.575679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:64 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.725 [2024-11-26 19:17:48.575687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:31.725 [2024-11-26 19:17:48.581368] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.725 [2024-11-26 19:17:48.581390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:13632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.725 [2024-11-26 19:17:48.581398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:31.725 [2024-11-26 19:17:48.587401] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.725 [2024-11-26 19:17:48.587423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.725 [2024-11-26 19:17:48.587432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:31.725 [2024-11-26 19:17:48.593483] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.725 [2024-11-26 19:17:48.593504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.725 [2024-11-26 19:17:48.593512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:31.725 [2024-11-26 19:17:48.599590] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.725 [2024-11-26 19:17:48.599611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:2144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.725 [2024-11-26 19:17:48.599619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:31.725 [2024-11-26 19:17:48.605256] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.725 [2024-11-26 19:17:48.605277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:12704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.725 [2024-11-26 19:17:48.605285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:31.725 [2024-11-26 19:17:48.611270] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.725 [2024-11-26 19:17:48.611291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.725 [2024-11-26 19:17:48.611299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:31.725 [2024-11-26 19:17:48.617072] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.725 [2024-11-26 19:17:48.617094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:21408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.725 [2024-11-26 19:17:48.617102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:31.725 [2024-11-26 19:17:48.622709] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.725 [2024-11-26 19:17:48.622731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:5504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.725 [2024-11-26 19:17:48.622739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:31.725 [2024-11-26 19:17:48.628358] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.725 [2024-11-26 19:17:48.628380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:9184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.725 [2024-11-26 19:17:48.628388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:31.725 [2024-11-26 19:17:48.635089] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.725 [2024-11-26 19:17:48.635113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:12640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.725 [2024-11-26 19:17:48.635121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:31.725 [2024-11-26 19:17:48.642562] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.725 [2024-11-26 19:17:48.642584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.725 [2024-11-26 19:17:48.642593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:31.984 [2024-11-26 19:17:48.649915] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.984 [2024-11-26 19:17:48.649937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.984 [2024-11-26 19:17:48.649945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:31.984 [2024-11-26 19:17:48.656395] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.984 [2024-11-26 19:17:48.656417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:18080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.984 [2024-11-26 19:17:48.656425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:31.984 [2024-11-26 19:17:48.662208] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.984 [2024-11-26 19:17:48.662229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:18880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.984 [2024-11-26 19:17:48.662237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:31.984 [2024-11-26 19:17:48.667933] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.984 [2024-11-26 19:17:48.667960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:23424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.984 [2024-11-26 19:17:48.667973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:31.984 [2024-11-26 19:17:48.673764] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.984 [2024-11-26 19:17:48.673786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:16416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.984 [2024-11-26 19:17:48.673794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:31.984 [2024-11-26 19:17:48.679869] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.984 [2024-11-26 19:17:48.679891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:15968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.984 [2024-11-26 19:17:48.679900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:31.984 [2024-11-26 19:17:48.685626] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.984 [2024-11-26 19:17:48.685647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.984 [2024-11-26 19:17:48.685656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:31.984 [2024-11-26 19:17:48.690780] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.984 [2024-11-26 19:17:48.690802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.984 [2024-11-26 19:17:48.690810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:31.984 [2024-11-26 19:17:48.696151] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.985 [2024-11-26 19:17:48.696173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:15744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.985 [2024-11-26 19:17:48.696181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:31.985 [2024-11-26 19:17:48.701769] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.985 [2024-11-26 19:17:48.701790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:24000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.985 [2024-11-26 19:17:48.701797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:31.985 [2024-11-26 19:17:48.707537] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.985 [2024-11-26 19:17:48.707559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:7360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.985 [2024-11-26 19:17:48.707568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:31.985 [2024-11-26 19:17:48.713112] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.985 [2024-11-26 19:17:48.713135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:15072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.985 [2024-11-26 19:17:48.713144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:31.985 [2024-11-26 19:17:48.718778] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.985 [2024-11-26 19:17:48.718804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:7040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.985 [2024-11-26 19:17:48.718812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:31.985 [2024-11-26 19:17:48.724351] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.985 [2024-11-26 19:17:48.724372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.985 [2024-11-26 19:17:48.724380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:31.985 [2024-11-26 19:17:48.730199] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.985 [2024-11-26 19:17:48.730221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:17792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.985 [2024-11-26 19:17:48.730230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:31.985 [2024-11-26 19:17:48.735798] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.985 [2024-11-26 19:17:48.735821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:9312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.985 [2024-11-26 19:17:48.735829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:31.985 [2024-11-26 19:17:48.741163] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.985 [2024-11-26 19:17:48.741185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:9568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.985 [2024-11-26 19:17:48.741193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:31.985 [2024-11-26 19:17:48.746392] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.985 [2024-11-26 19:17:48.746414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:5632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.985 [2024-11-26 19:17:48.746422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:31.985 [2024-11-26 19:17:48.752073] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.985 [2024-11-26 19:17:48.752095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:14176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.985 [2024-11-26 19:17:48.752103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:31.985 [2024-11-26 19:17:48.757901] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.985 [2024-11-26 19:17:48.757923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:1440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.985 [2024-11-26 19:17:48.757931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:31.985 [2024-11-26 19:17:48.763782] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.985 [2024-11-26 19:17:48.763805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:6016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.985 [2024-11-26 19:17:48.763813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:31.985 [2024-11-26 19:17:48.769893] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.985 [2024-11-26 19:17:48.769915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:3552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.985 [2024-11-26 19:17:48.769923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:31.985 [2024-11-26 19:17:48.775962] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.985 [2024-11-26 19:17:48.775984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.985 [2024-11-26 19:17:48.775992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:31.985 [2024-11-26 19:17:48.781745] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.985 [2024-11-26 19:17:48.781766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:7680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.985 [2024-11-26 19:17:48.781774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:31.985 [2024-11-26 19:17:48.787260] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.985 [2024-11-26 19:17:48.787282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:6464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.985 [2024-11-26 19:17:48.787290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:31.985 [2024-11-26 19:17:48.793030] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.985 [2024-11-26 19:17:48.793051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:20224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.985 [2024-11-26 19:17:48.793060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:31.985 [2024-11-26 19:17:48.798787] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.985 [2024-11-26 19:17:48.798810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:20736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.985 [2024-11-26 19:17:48.798818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:31.985 [2024-11-26 19:17:48.804809] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.985 [2024-11-26 19:17:48.804832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:10976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.985 [2024-11-26 19:17:48.804840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:31.985 [2024-11-26 19:17:48.812434] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.985 [2024-11-26 19:17:48.812457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:10080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.985 [2024-11-26 19:17:48.812465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:31.985 [2024-11-26 19:17:48.819664] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.985 [2024-11-26 19:17:48.819819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.985 [2024-11-26 19:17:48.819828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:31.985 [2024-11-26 19:17:48.826368] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.985 [2024-11-26 19:17:48.826390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:22176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.985 [2024-11-26 19:17:48.826399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:31.986 [2024-11-26 19:17:48.833794] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.986 [2024-11-26 19:17:48.833817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.986 [2024-11-26 19:17:48.833826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:31.986 [2024-11-26 19:17:48.840406] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.986 [2024-11-26 19:17:48.840429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:20704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.986 [2024-11-26 19:17:48.840438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:31.986 [2024-11-26 19:17:48.848918] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.986 [2024-11-26 19:17:48.848942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:9376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.986 [2024-11-26 19:17:48.848956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:31.986 [2024-11-26 19:17:48.856624] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.986 [2024-11-26 19:17:48.856647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:24896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.986 [2024-11-26 19:17:48.856657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:31.986 [2024-11-26 19:17:48.862710] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.986 [2024-11-26 19:17:48.862734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:17056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.986 [2024-11-26 19:17:48.862741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:31.986 [2024-11-26 19:17:48.868161] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.986 [2024-11-26 19:17:48.868185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:15008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.986 [2024-11-26 19:17:48.868195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:31.986 [2024-11-26 19:17:48.873612] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.986 [2024-11-26 19:17:48.873635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.986 [2024-11-26 19:17:48.873644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:31.986 [2024-11-26 19:17:48.878473] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.986 [2024-11-26 19:17:48.878497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:14528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.986 [2024-11-26 19:17:48.878506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:31.986 [2024-11-26 19:17:48.883866] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.986 [2024-11-26 19:17:48.883889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:2560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.986 [2024-11-26 19:17:48.883898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:31.986 [2024-11-26 19:17:48.891857] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.986 [2024-11-26 19:17:48.891881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.986 [2024-11-26 19:17:48.891890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:31.986 [2024-11-26 19:17:48.898000] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.986 [2024-11-26 19:17:48.898023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:7616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.986 [2024-11-26 19:17:48.898032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:31.986 [2024-11-26 19:17:48.905603] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:31.986 [2024-11-26 19:17:48.905628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:7008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:31.986 [2024-11-26 19:17:48.905637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:32.246 [2024-11-26 19:17:48.912907] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.246 [2024-11-26 19:17:48.912931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.246 [2024-11-26 19:17:48.912940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:32.246 [2024-11-26 19:17:48.918624] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.246 [2024-11-26 19:17:48.918647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:2208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.246 [2024-11-26 19:17:48.918655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:32.246 [2024-11-26 19:17:48.924078] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.246 [2024-11-26 19:17:48.924101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:5952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.246 [2024-11-26 19:17:48.924109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:32.246 [2024-11-26 19:17:48.929691] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.246 [2024-11-26 19:17:48.929714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.246 [2024-11-26 19:17:48.929726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:32.246 [2024-11-26 19:17:48.936814] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.246 [2024-11-26 19:17:48.936837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.246 [2024-11-26 19:17:48.936845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:32.246 [2024-11-26 19:17:48.944310] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.246 [2024-11-26 19:17:48.944334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.246 [2024-11-26 19:17:48.944342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:32.246 [2024-11-26 19:17:48.950998] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.247 [2024-11-26 19:17:48.951021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:1664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.247 [2024-11-26 19:17:48.951029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:32.247 [2024-11-26 19:17:48.958634] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.247 [2024-11-26 19:17:48.958658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:11040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.247 [2024-11-26 19:17:48.958667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:32.247 [2024-11-26 19:17:48.966526] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.247 [2024-11-26 19:17:48.966550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:10880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.247 [2024-11-26 19:17:48.966559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:32.247 [2024-11-26 19:17:48.973867] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.247 [2024-11-26 19:17:48.973892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:3360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.247 [2024-11-26 19:17:48.973902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:32.247 [2024-11-26 19:17:48.980907] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.247 [2024-11-26 19:17:48.980931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:13280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.247 [2024-11-26 19:17:48.980940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:32.247 [2024-11-26 19:17:48.987918] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.247 [2024-11-26 19:17:48.987942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:21056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.247 [2024-11-26 19:17:48.987958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:32.247 [2024-11-26 19:17:48.994042] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.247 [2024-11-26 19:17:48.994070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:8160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.247 [2024-11-26 19:17:48.994079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:32.247 [2024-11-26 19:17:49.000975] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.247 [2024-11-26 19:17:49.000999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:17504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.247 [2024-11-26 19:17:49.001007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:32.247 [2024-11-26 19:17:49.008016] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.247 [2024-11-26 19:17:49.008039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.247 [2024-11-26 19:17:49.008048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:32.247 [2024-11-26 19:17:49.015088] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.247 [2024-11-26 19:17:49.015112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:3040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.247 [2024-11-26 19:17:49.015122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:32.247 [2024-11-26 19:17:49.022992] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.247 [2024-11-26 19:17:49.023016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:17824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.247 [2024-11-26 19:17:49.023024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:32.247 [2024-11-26 19:17:49.029226] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.247 [2024-11-26 19:17:49.029251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:4000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.247 [2024-11-26 19:17:49.029260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:32.247 [2024-11-26 19:17:49.035083] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.247 [2024-11-26 19:17:49.035106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:4384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.247 [2024-11-26 19:17:49.035115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:32.247 [2024-11-26 19:17:49.041337] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.247 [2024-11-26 19:17:49.041361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:14400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.247 [2024-11-26 19:17:49.041369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:32.247 [2024-11-26 19:17:49.046465] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.247 [2024-11-26 19:17:49.046489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.247 [2024-11-26 19:17:49.046497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:32.247 [2024-11-26 19:17:49.051271] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.247 [2024-11-26 19:17:49.051294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:7584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.247 [2024-11-26 19:17:49.051303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:32.247 [2024-11-26 19:17:49.056116] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.247 [2024-11-26 19:17:49.056138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.247 [2024-11-26 19:17:49.056146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:32.247 [2024-11-26 19:17:49.060928] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.247 [2024-11-26 19:17:49.060958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:7456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.247 [2024-11-26 19:17:49.060967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:32.247 [2024-11-26 19:17:49.065630] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.247 [2024-11-26 19:17:49.065652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:1312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.247 [2024-11-26 19:17:49.065660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:32.247 [2024-11-26 19:17:49.070397] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.247 [2024-11-26 19:17:49.070420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:1888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.247 [2024-11-26 19:17:49.070428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:32.247 [2024-11-26 19:17:49.075167] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.247 [2024-11-26 19:17:49.075190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:9856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.247 [2024-11-26 19:17:49.075198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:32.247 [2024-11-26 19:17:49.079862] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.247 [2024-11-26 19:17:49.079883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:5792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.247 [2024-11-26 19:17:49.079892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:32.247 [2024-11-26 19:17:49.084656] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.248 [2024-11-26 19:17:49.084678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.248 [2024-11-26 19:17:49.084686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:32.248 [2024-11-26 19:17:49.089405] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.248 [2024-11-26 19:17:49.089428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:21472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.248 [2024-11-26 19:17:49.089441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:32.248 [2024-11-26 19:17:49.094102] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.248 [2024-11-26 19:17:49.094125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:20320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.248 [2024-11-26 19:17:49.094133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:32.248 [2024-11-26 19:17:49.098724] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.248 [2024-11-26 19:17:49.098747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:22112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.248 [2024-11-26 19:17:49.098755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:32.248 [2024-11-26 19:17:49.103463] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.248 [2024-11-26 19:17:49.103486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:21568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.248 [2024-11-26 19:17:49.103494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:32.248 [2024-11-26 19:17:49.108213] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.248 [2024-11-26 19:17:49.108235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:19456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.248 [2024-11-26 19:17:49.108244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:32.248 [2024-11-26 19:17:49.112974] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.248 [2024-11-26 19:17:49.112996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.248 [2024-11-26 19:17:49.113006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:32.248 [2024-11-26 19:17:49.117732] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.248 [2024-11-26 19:17:49.117754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:12448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.248 [2024-11-26 19:17:49.117763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:32.248 [2024-11-26 19:17:49.122473] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.248 [2024-11-26 19:17:49.122497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:25088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.248 [2024-11-26 19:17:49.122505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:32.248 [2024-11-26 19:17:49.127139] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.248 [2024-11-26 19:17:49.127162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.248 [2024-11-26 19:17:49.127170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:32.248 [2024-11-26 19:17:49.131739] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.248 [2024-11-26 19:17:49.131766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:1152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.248 [2024-11-26 19:17:49.131774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:32.248 [2024-11-26 19:17:49.136541] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.248 [2024-11-26 19:17:49.136563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.248 [2024-11-26 19:17:49.136571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:32.248 [2024-11-26 19:17:49.141392] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.248 [2024-11-26 19:17:49.141417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.248 [2024-11-26 19:17:49.141425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:32.248 [2024-11-26 19:17:49.146181] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.248 [2024-11-26 19:17:49.146204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:11552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.248 [2024-11-26 19:17:49.146211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:32.248 [2024-11-26 19:17:49.150939] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.248 [2024-11-26 19:17:49.150974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:21280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.248 [2024-11-26 19:17:49.150983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:32.248 [2024-11-26 19:17:49.155813] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.248 [2024-11-26 19:17:49.155836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.248 [2024-11-26 19:17:49.155844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:32.248 [2024-11-26 19:17:49.160656] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.248 [2024-11-26 19:17:49.160677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:6496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.248 [2024-11-26 19:17:49.160686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:32.248 [2024-11-26 19:17:49.165257] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.248 [2024-11-26 19:17:49.165280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:5632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.248 [2024-11-26 19:17:49.165289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:32.511 [2024-11-26 19:17:49.170058] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.511 [2024-11-26 19:17:49.170080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:24128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.511 [2024-11-26 19:17:49.170089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:32.511 [2024-11-26 19:17:49.174735] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.511 [2024-11-26 19:17:49.174759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:12064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.511 [2024-11-26 19:17:49.174767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:32.511 [2024-11-26 19:17:49.179349] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.511 [2024-11-26 19:17:49.179372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:22432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.511 [2024-11-26 19:17:49.179380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:32.511 [2024-11-26 19:17:49.183827] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.511 [2024-11-26 19:17:49.183850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:11840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.511 [2024-11-26 19:17:49.183858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:32.511 [2024-11-26 19:17:49.188292] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.511 [2024-11-26 19:17:49.188314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.511 [2024-11-26 19:17:49.188323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:32.511 [2024-11-26 19:17:49.192942] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.511 [2024-11-26 19:17:49.192970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.511 [2024-11-26 19:17:49.192979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:32.511 [2024-11-26 19:17:49.197632] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.511 [2024-11-26 19:17:49.197654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:6432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.511 [2024-11-26 19:17:49.197662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:32.511 [2024-11-26 19:17:49.202242] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.511 [2024-11-26 19:17:49.202264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:3264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.511 [2024-11-26 19:17:49.202272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:32.511 [2024-11-26 19:17:49.206953] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.511 [2024-11-26 19:17:49.206975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:9312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.511 [2024-11-26 19:17:49.206983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:32.511 [2024-11-26 19:17:49.211637] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.511 [2024-11-26 19:17:49.211664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:11616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.511 [2024-11-26 19:17:49.211672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:32.511 [2024-11-26 19:17:49.216578] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.511 [2024-11-26 19:17:49.216619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:16096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.511 [2024-11-26 19:17:49.216628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:32.511 [2024-11-26 19:17:49.221552] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.511 [2024-11-26 19:17:49.221576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:8864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.511 [2024-11-26 19:17:49.221586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:32.511 [2024-11-26 19:17:49.226507] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.511 [2024-11-26 19:17:49.226531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:15968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.511 [2024-11-26 19:17:49.226540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:32.511 [2024-11-26 19:17:49.231330] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.511 [2024-11-26 19:17:49.231353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:20640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.511 [2024-11-26 19:17:49.231362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:32.511 [2024-11-26 19:17:49.236240] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.511 [2024-11-26 19:17:49.236263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:8384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.511 [2024-11-26 19:17:49.236273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:32.511 [2024-11-26 19:17:49.240993] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.511 [2024-11-26 19:17:49.241017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.511 [2024-11-26 19:17:49.241027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:32.511 [2024-11-26 19:17:49.245814] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.511 [2024-11-26 19:17:49.245838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:13888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.511 [2024-11-26 19:17:49.245847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:32.511 [2024-11-26 19:17:49.250684] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.511 [2024-11-26 19:17:49.250708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:15808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.511 [2024-11-26 19:17:49.250717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:32.511 [2024-11-26 19:17:49.255453] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.511 [2024-11-26 19:17:49.255477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:23520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.511 [2024-11-26 19:17:49.255486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:32.511 [2024-11-26 19:17:49.260301] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.511 [2024-11-26 19:17:49.260324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.511 [2024-11-26 19:17:49.260334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:32.511 [2024-11-26 19:17:49.264940] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.511 [2024-11-26 19:17:49.264969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:22688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.511 [2024-11-26 19:17:49.264979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:32.511 [2024-11-26 19:17:49.269598] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.511 [2024-11-26 19:17:49.269621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:5312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.512 [2024-11-26 19:17:49.269631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:32.512 [2024-11-26 19:17:49.274425] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.512 [2024-11-26 19:17:49.274448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:3040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.512 [2024-11-26 19:17:49.274456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:32.512 [2024-11-26 19:17:49.278945] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.512 [2024-11-26 19:17:49.278974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:13120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.512 [2024-11-26 19:17:49.278983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:32.512 [2024-11-26 19:17:49.283500] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.512 [2024-11-26 19:17:49.283523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:14240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.512 [2024-11-26 19:17:49.283531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:32.512 [2024-11-26 19:17:49.288698] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.512 [2024-11-26 19:17:49.288721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:25504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.512 [2024-11-26 19:17:49.288729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:32.512 [2024-11-26 19:17:49.293800] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.512 [2024-11-26 19:17:49.293823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.512 [2024-11-26 19:17:49.293836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:32.512 [2024-11-26 19:17:49.298731] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.512 [2024-11-26 19:17:49.298754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:1952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.512 [2024-11-26 19:17:49.298763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:32.512 [2024-11-26 19:17:49.304806] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.512 [2024-11-26 19:17:49.304829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.512 [2024-11-26 19:17:49.304837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:32.512 [2024-11-26 19:17:49.310877] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.512 [2024-11-26 19:17:49.310906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.512 [2024-11-26 19:17:49.310914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:32.512 [2024-11-26 19:17:49.317838] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.512 [2024-11-26 19:17:49.317862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:14880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.512 [2024-11-26 19:17:49.317870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:32.512 [2024-11-26 19:17:49.324219] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.512 [2024-11-26 19:17:49.324242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.512 [2024-11-26 19:17:49.324250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:32.512 [2024-11-26 19:17:49.329850] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.512 [2024-11-26 19:17:49.329873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:10176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.512 [2024-11-26 19:17:49.329882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:32.512 [2024-11-26 19:17:49.335420] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.512 [2024-11-26 19:17:49.335442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.512 [2024-11-26 19:17:49.335451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:32.512 [2024-11-26 19:17:49.340695] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.512 [2024-11-26 19:17:49.340718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:15616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.512 [2024-11-26 19:17:49.340727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:32.512 [2024-11-26 19:17:49.345938] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.512 [2024-11-26 19:17:49.345970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.512 [2024-11-26 19:17:49.345978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:32.512 [2024-11-26 19:17:49.351498] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.512 [2024-11-26 19:17:49.351521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:2016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.512 [2024-11-26 19:17:49.351529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:32.512 [2024-11-26 19:17:49.356297] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.512 [2024-11-26 19:17:49.356319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:21632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.512 [2024-11-26 19:17:49.356327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:32.512 [2024-11-26 19:17:49.359553] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.512 [2024-11-26 19:17:49.359577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:8864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.512 [2024-11-26 19:17:49.359585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:32.512 [2024-11-26 19:17:49.364198] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.512 [2024-11-26 19:17:49.364220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:22112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.512 [2024-11-26 19:17:49.364229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:32.512 [2024-11-26 19:17:49.369422] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.512 [2024-11-26 19:17:49.369444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.512 [2024-11-26 19:17:49.369453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:32.512 [2024-11-26 19:17:49.374432] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.512 [2024-11-26 19:17:49.374453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.512 [2024-11-26 19:17:49.374461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:32.512 [2024-11-26 19:17:49.378622] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.512 [2024-11-26 19:17:49.378643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.512 [2024-11-26 19:17:49.378650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:32.512 [2024-11-26 19:17:49.383079] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.512 [2024-11-26 19:17:49.383101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:2112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.512 [2024-11-26 19:17:49.383109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:32.512 [2024-11-26 19:17:49.388569] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.512 [2024-11-26 19:17:49.388591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:21472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.512 [2024-11-26 19:17:49.388600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:32.512 [2024-11-26 19:17:49.393927] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.512 [2024-11-26 19:17:49.393955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.512 [2024-11-26 19:17:49.393965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:32.512 [2024-11-26 19:17:49.398854] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.512 [2024-11-26 19:17:49.398876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:1312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.512 [2024-11-26 19:17:49.398884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:32.512 [2024-11-26 19:17:49.403590] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.512 [2024-11-26 19:17:49.403613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:4032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.512 [2024-11-26 19:17:49.403621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:32.512 [2024-11-26 19:17:49.408014] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.512 [2024-11-26 19:17:49.408036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:6848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.512 [2024-11-26 19:17:49.408045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:32.512 [2024-11-26 19:17:49.412014] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.513 [2024-11-26 19:17:49.412036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:10592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.513 [2024-11-26 19:17:49.412044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:32.513 [2024-11-26 19:17:49.416586] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.513 [2024-11-26 19:17:49.416609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:7936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.513 [2024-11-26 19:17:49.416617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:32.513 [2024-11-26 19:17:49.421069] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.513 [2024-11-26 19:17:49.421091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:9728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.513 [2024-11-26 19:17:49.421099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:32.513 [2024-11-26 19:17:49.425519] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.513 [2024-11-26 19:17:49.425540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:17248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.513 [2024-11-26 19:17:49.425552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:32.513 [2024-11-26 19:17:49.430236] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.513 [2024-11-26 19:17:49.430258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:9568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.513 [2024-11-26 19:17:49.430267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:32.796 [2024-11-26 19:17:49.435192] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.796 [2024-11-26 19:17:49.435214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:18752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.796 [2024-11-26 19:17:49.435223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:32.796 [2024-11-26 19:17:49.439772] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.796 [2024-11-26 19:17:49.439794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:24032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.796 [2024-11-26 19:17:49.439802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:32.796 [2024-11-26 19:17:49.444352] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.796 [2024-11-26 19:17:49.444375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:12352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.796 [2024-11-26 19:17:49.444383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:32.796 [2024-11-26 19:17:49.448929] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.796 [2024-11-26 19:17:49.448959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:8320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.796 [2024-11-26 19:17:49.448968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:32.796 [2024-11-26 19:17:49.453637] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.796 [2024-11-26 19:17:49.453660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:20736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.796 [2024-11-26 19:17:49.453669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:32.796 [2024-11-26 19:17:49.458359] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.796 [2024-11-26 19:17:49.458382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:2144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.796 [2024-11-26 19:17:49.458390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:32.796 [2024-11-26 19:17:49.463068] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.796 [2024-11-26 19:17:49.463091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:23040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.796 [2024-11-26 19:17:49.463099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:32.796 [2024-11-26 19:17:49.467349] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.796 [2024-11-26 19:17:49.467371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:4832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.796 [2024-11-26 19:17:49.467380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:32.797 [2024-11-26 19:17:49.472016] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.797 [2024-11-26 19:17:49.472039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:10784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.797 [2024-11-26 19:17:49.472048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:32.797 [2024-11-26 19:17:49.476773] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.797 [2024-11-26 19:17:49.476796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:23616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.797 [2024-11-26 19:17:49.476804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:32.797 [2024-11-26 19:17:49.481420] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.797 [2024-11-26 19:17:49.481443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:20192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.797 [2024-11-26 19:17:49.481451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:32.797 [2024-11-26 19:17:49.486177] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.797 [2024-11-26 19:17:49.486199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:10880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.797 [2024-11-26 19:17:49.486207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:32.797 [2024-11-26 19:17:49.490683] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.797 [2024-11-26 19:17:49.490705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:12736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.797 [2024-11-26 19:17:49.490713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:32.797 [2024-11-26 19:17:49.495146] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.797 [2024-11-26 19:17:49.495168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:12928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.797 [2024-11-26 19:17:49.495176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:32.797 [2024-11-26 19:17:49.499632] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.797 [2024-11-26 19:17:49.499654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:17216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.797 [2024-11-26 19:17:49.499662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:32.797 [2024-11-26 19:17:49.504916] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.797 [2024-11-26 19:17:49.504939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:21280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.797 [2024-11-26 19:17:49.504955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:32.797 [2024-11-26 19:17:49.510150] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.797 [2024-11-26 19:17:49.510172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:2976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.797 [2024-11-26 19:17:49.510180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:32.797 [2024-11-26 19:17:49.514944] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.797 [2024-11-26 19:17:49.514974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:11840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.797 [2024-11-26 19:17:49.514982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:32.797 [2024-11-26 19:17:49.519561] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.797 [2024-11-26 19:17:49.519582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:6592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.797 [2024-11-26 19:17:49.519591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:32.797 [2024-11-26 19:17:49.524132] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.797 [2024-11-26 19:17:49.524154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:4832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.797 [2024-11-26 19:17:49.524162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:32.797 [2024-11-26 19:17:49.528722] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.797 [2024-11-26 19:17:49.528744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.797 [2024-11-26 19:17:49.528752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:32.797 [2024-11-26 19:17:49.533276] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.797 [2024-11-26 19:17:49.533298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.797 [2024-11-26 19:17:49.533306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:32.797 [2024-11-26 19:17:49.537904] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.797 [2024-11-26 19:17:49.537926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:25248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.797 [2024-11-26 19:17:49.537934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:32.797 [2024-11-26 19:17:49.542511] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.797 [2024-11-26 19:17:49.542534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:8672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.797 [2024-11-26 19:17:49.542542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:32.797 [2024-11-26 19:17:49.547308] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.797 [2024-11-26 19:17:49.547334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.797 [2024-11-26 19:17:49.547343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:32.797 [2024-11-26 19:17:49.552301] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.797 [2024-11-26 19:17:49.552326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:13120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.797 [2024-11-26 19:17:49.552334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:32.797 [2024-11-26 19:17:49.556863] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.797 [2024-11-26 19:17:49.556891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:10336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.797 [2024-11-26 19:17:49.556900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:32.797 [2024-11-26 19:17:49.561117] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.797 [2024-11-26 19:17:49.561140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:7552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.797 [2024-11-26 19:17:49.561151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:32.797 [2024-11-26 19:17:49.564830] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.797 [2024-11-26 19:17:49.564852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:3456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.797 [2024-11-26 19:17:49.564860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:32.797 [2024-11-26 19:17:49.568765] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.797 [2024-11-26 19:17:49.568789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:17568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.797 [2024-11-26 19:17:49.568797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:32.797 [2024-11-26 19:17:49.573282] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.798 [2024-11-26 19:17:49.573304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:2944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.798 [2024-11-26 19:17:49.573312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:32.798 [2024-11-26 19:17:49.577937] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.798 [2024-11-26 19:17:49.577964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:6688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.798 [2024-11-26 19:17:49.577973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:32.798 [2024-11-26 19:17:49.582542] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.798 [2024-11-26 19:17:49.582564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:24032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.798 [2024-11-26 19:17:49.582572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:32.798 [2024-11-26 19:17:49.587037] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.798 [2024-11-26 19:17:49.587058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:14112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.798 [2024-11-26 19:17:49.587066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:32.798 [2024-11-26 19:17:49.591492] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.798 [2024-11-26 19:17:49.591514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:23136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.798 [2024-11-26 19:17:49.591522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:32.798 [2024-11-26 19:17:49.595881] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.798 [2024-11-26 19:17:49.595904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:22976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.798 [2024-11-26 19:17:49.595912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:32.798 [2024-11-26 19:17:49.600402] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.798 [2024-11-26 19:17:49.600424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:10080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.798 [2024-11-26 19:17:49.600432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:32.798 [2024-11-26 19:17:49.604795] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.798 [2024-11-26 19:17:49.604817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:23424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.798 [2024-11-26 19:17:49.604825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:32.798 [2024-11-26 19:17:49.609259] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.798 [2024-11-26 19:17:49.609281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:10624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.798 [2024-11-26 19:17:49.609289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:32.798 [2024-11-26 19:17:49.614029] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.798 [2024-11-26 19:17:49.614051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:5088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.798 [2024-11-26 19:17:49.614060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:32.798 [2024-11-26 19:17:49.618957] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.798 [2024-11-26 19:17:49.618980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:6560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.798 [2024-11-26 19:17:49.618988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:32.798 [2024-11-26 19:17:49.624886] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.798 [2024-11-26 19:17:49.624916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:8448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.798 [2024-11-26 19:17:49.624929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:32.798 [2024-11-26 19:17:49.632239] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.798 [2024-11-26 19:17:49.632263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:12096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.798 [2024-11-26 19:17:49.632271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:32.798 [2024-11-26 19:17:49.638967] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.798 [2024-11-26 19:17:49.638990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:6848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.798 [2024-11-26 19:17:49.638998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:32.798 [2024-11-26 19:17:49.647396] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.798 [2024-11-26 19:17:49.647419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:20992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.798 [2024-11-26 19:17:49.647428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:32.798 [2024-11-26 19:17:49.654987] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.798 [2024-11-26 19:17:49.655010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:18496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.798 [2024-11-26 19:17:49.655018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:32.798 [2024-11-26 19:17:49.662882] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.798 [2024-11-26 19:17:49.662906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:10272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.798 [2024-11-26 19:17:49.662915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:32.798 [2024-11-26 19:17:49.671549] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.798 [2024-11-26 19:17:49.671572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:16992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.798 [2024-11-26 19:17:49.671581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:32.798 [2024-11-26 19:17:49.678877] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.798 [2024-11-26 19:17:49.678900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:6112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.798 [2024-11-26 19:17:49.678909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:32.798 [2024-11-26 19:17:49.685381] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.798 [2024-11-26 19:17:49.685405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:16544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.798 [2024-11-26 19:17:49.685415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:32.798 [2024-11-26 19:17:49.690564] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.798 [2024-11-26 19:17:49.690591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:12896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.798 [2024-11-26 19:17:49.690600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:32.798 [2024-11-26 19:17:49.695212] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.798 [2024-11-26 19:17:49.695236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.798 [2024-11-26 19:17:49.695245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:32.798 [2024-11-26 19:17:49.701208] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.798 [2024-11-26 19:17:49.701231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:4288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.799 [2024-11-26 19:17:49.701239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:32.799 [2024-11-26 19:17:49.706882] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:32.799 [2024-11-26 19:17:49.706905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:13952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:32.799 [2024-11-26 19:17:49.706913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:33.067 [2024-11-26 19:17:49.712706] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:33.067 [2024-11-26 19:17:49.712730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:16064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:33.067 [2024-11-26 19:17:49.712738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:33.067 [2024-11-26 19:17:49.718417] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:33.067 [2024-11-26 19:17:49.718439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:6400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:33.067 [2024-11-26 19:17:49.718448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:33.067 [2024-11-26 19:17:49.723777] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:33.067 [2024-11-26 19:17:49.723801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:10304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:33.067 [2024-11-26 19:17:49.723810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:33.067 [2024-11-26 19:17:49.727659] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:33.067 [2024-11-26 19:17:49.727682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:10560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:33.067 [2024-11-26 19:17:49.727693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:33.067 [2024-11-26 19:17:49.731479] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:33.067 [2024-11-26 19:17:49.731501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:13184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:33.067 [2024-11-26 19:17:49.731509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:33.067 [2024-11-26 19:17:49.735438] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:33.067 [2024-11-26 19:17:49.735460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:17952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:33.067 [2024-11-26 19:17:49.735469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:33.067 [2024-11-26 19:17:49.740245] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:33.067 [2024-11-26 19:17:49.740267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:23392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:33.067 [2024-11-26 19:17:49.740276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:33.067 [2024-11-26 19:17:49.745377] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:33.068 [2024-11-26 19:17:49.745399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:10656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:33.068 [2024-11-26 19:17:49.745408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:33.068 [2024-11-26 19:17:49.750793] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:33.068 [2024-11-26 19:17:49.750815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:8448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:33.068 [2024-11-26 19:17:49.750823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:33.068 [2024-11-26 19:17:49.755864] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:33.068 [2024-11-26 19:17:49.755886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:14208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:33.068 [2024-11-26 19:17:49.755894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:33.068 [2024-11-26 19:17:49.760978] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:33.068 [2024-11-26 19:17:49.760998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:4576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:33.068 [2024-11-26 19:17:49.761006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:33.068 [2024-11-26 19:17:49.765498] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:33.068 [2024-11-26 19:17:49.765519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:22144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:33.068 [2024-11-26 19:17:49.765527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:33.068 [2024-11-26 19:17:49.770206] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:33.068 [2024-11-26 19:17:49.770226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:3520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:33.068 [2024-11-26 19:17:49.770234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:33.068 [2024-11-26 19:17:49.774798] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:33.068 [2024-11-26 19:17:49.774820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:1856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:33.068 [2024-11-26 19:17:49.774832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:33.068 [2024-11-26 19:17:49.779346] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:33.068 [2024-11-26 19:17:49.779367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:11520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:33.068 [2024-11-26 19:17:49.779376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:33.068 [2024-11-26 19:17:49.784621] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:33.068 [2024-11-26 19:17:49.784642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:2304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:33.068 [2024-11-26 19:17:49.784650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:33.068 [2024-11-26 19:17:49.788653] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:33.068 [2024-11-26 19:17:49.788674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:33.068 [2024-11-26 19:17:49.788682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:33.068 [2024-11-26 19:17:49.793469] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:33.068 [2024-11-26 19:17:49.793491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:16672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:33.068 [2024-11-26 19:17:49.793499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:33.068 [2024-11-26 19:17:49.797757] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:33.068 [2024-11-26 19:17:49.797777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:7296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:33.068 [2024-11-26 19:17:49.797786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:33.068 [2024-11-26 19:17:49.802519] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:33.068 [2024-11-26 19:17:49.802540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:13344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:33.068 [2024-11-26 19:17:49.802548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:33.068 [2024-11-26 19:17:49.807305] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:33.068 [2024-11-26 19:17:49.807326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:14592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:33.068 [2024-11-26 19:17:49.807334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:33.068 [2024-11-26 19:17:49.812076] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:33.068 [2024-11-26 19:17:49.812098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:12128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:33.068 [2024-11-26 19:17:49.812106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:33.068 [2024-11-26 19:17:49.817028] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:33.068 [2024-11-26 19:17:49.817054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:9600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:33.068 [2024-11-26 19:17:49.817063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:33.068 [2024-11-26 19:17:49.823409] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:33.068 [2024-11-26 19:17:49.823430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:11360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:33.068 [2024-11-26 19:17:49.823439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:33.068 [2024-11-26 19:17:49.827791] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:33.068 [2024-11-26 19:17:49.827813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:14912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:33.068 [2024-11-26 19:17:49.827821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:33.068 [2024-11-26 19:17:49.832470] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:33.068 [2024-11-26 19:17:49.832491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:16832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:33.068 [2024-11-26 19:17:49.832499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:33.068 [2024-11-26 19:17:49.837143] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:33.068 [2024-11-26 19:17:49.837164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:22432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:33.068 [2024-11-26 19:17:49.837172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:33.068 [2024-11-26 19:17:49.841814] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:33.068 [2024-11-26 19:17:49.841834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:20768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:33.068 [2024-11-26 19:17:49.841842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:33.068 [2024-11-26 19:17:49.846680] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:33.068 [2024-11-26 19:17:49.846700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:1152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:33.068 [2024-11-26 19:17:49.846708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:33.068 [2024-11-26 19:17:49.851382] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:33.068 [2024-11-26 19:17:49.851402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:10784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:33.068 [2024-11-26 19:17:49.851410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:33.068 [2024-11-26 19:17:49.856131] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:33.068 [2024-11-26 19:17:49.856152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:6176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:33.068 [2024-11-26 19:17:49.856165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:33.068 [2024-11-26 19:17:49.860904] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:33.068 [2024-11-26 19:17:49.860925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:24384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:33.068 [2024-11-26 19:17:49.860933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:33.068 [2024-11-26 19:17:49.865573] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:33.068 [2024-11-26 19:17:49.865594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:4160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:33.068 [2024-11-26 19:17:49.865602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:33.068 [2024-11-26 19:17:49.870238] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:33.068 [2024-11-26 19:17:49.870259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:13440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:33.068 [2024-11-26 19:17:49.870267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:33.068 [2024-11-26 19:17:49.875724] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:33.069 [2024-11-26 19:17:49.875746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:24224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:33.069 [2024-11-26 19:17:49.875754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:33.069 [2024-11-26 19:17:49.880775] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:33.069 [2024-11-26 19:17:49.880796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:17792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:33.069 [2024-11-26 19:17:49.880804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:33.069 [2024-11-26 19:17:49.885571] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:33.069 [2024-11-26 19:17:49.885592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:9184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:33.069 [2024-11-26 19:17:49.885600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:33.069 [2024-11-26 19:17:49.890355] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:33.069 [2024-11-26 19:17:49.890377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:15072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:33.069 [2024-11-26 19:17:49.890385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:33.069 [2024-11-26 19:17:49.895019] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:33.069 [2024-11-26 19:17:49.895041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:21664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:33.069 [2024-11-26 19:17:49.895049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:33.069 [2024-11-26 19:17:49.899710] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:33.069 [2024-11-26 19:17:49.899735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:24800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:33.069 [2024-11-26 19:17:49.899743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:33.069 [2024-11-26 19:17:49.904316] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:33.069 [2024-11-26 19:17:49.904337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:16352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:33.069 [2024-11-26 19:17:49.904345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:33.069 [2024-11-26 19:17:49.908882] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:33.069 [2024-11-26 19:17:49.908903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:4384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:33.069 [2024-11-26 19:17:49.908912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:33.069 [2024-11-26 19:17:49.913491] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:33.069 [2024-11-26 19:17:49.913512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:8512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:33.069 [2024-11-26 19:17:49.913520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:33.069 [2024-11-26 19:17:49.918081] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:33.069 [2024-11-26 19:17:49.918102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:17504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:33.069 [2024-11-26 19:17:49.918110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:33.069 [2024-11-26 19:17:49.922523] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:33.069 [2024-11-26 19:17:49.922545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:12960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:33.069 [2024-11-26 19:17:49.922553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:33.069 [2024-11-26 19:17:49.927152] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:33.069 [2024-11-26 19:17:49.927173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:17696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:33.069 [2024-11-26 19:17:49.927181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:33.069 [2024-11-26 19:17:49.931536] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:33.069 [2024-11-26 19:17:49.931557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:2592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:33.069 [2024-11-26 19:17:49.931565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:33.069 [2024-11-26 19:17:49.936043] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:33.069 [2024-11-26 19:17:49.936064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:5376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:33.069 [2024-11-26 19:17:49.936072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:33.069 [2024-11-26 19:17:49.940457] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:33.069 [2024-11-26 19:17:49.940477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:33.069 [2024-11-26 19:17:49.940485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:33.069 [2024-11-26 19:17:49.944888] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:33.069 [2024-11-26 19:17:49.944909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:18176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:33.069 [2024-11-26 19:17:49.944917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:33.069 [2024-11-26 19:17:49.949353] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1767930) 00:31:33.069 [2024-11-26 19:17:49.949374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:1696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:33.069 [2024-11-26 19:17:49.949382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:33.069 00:31:33.069 Latency(us) 00:31:33.069 [2024-11-26T18:17:49.996Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:31:33.069 [2024-11-26T18:17:49.996Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:31:33.069 nvme0n1 : 2.00 5753.16 719.14 0.00 0.00 2778.62 612.62 9061.06 00:31:33.069 [2024-11-26T18:17:49.996Z] =================================================================================================================== 00:31:33.069 [2024-11-26T18:17:49.996Z] Total : 5753.16 719.14 0.00 0.00 2778.62 612.62 9061.06 00:31:33.069 0 00:31:33.069 19:17:49 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:31:33.069 19:17:49 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:31:33.069 19:17:49 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:31:33.069 | .driver_specific 00:31:33.069 | .nvme_error 00:31:33.069 | .status_code 00:31:33.069 | .command_transient_transport_error' 00:31:33.069 19:17:49 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:31:33.370 19:17:50 -- host/digest.sh@71 -- # (( 371 > 0 )) 00:31:33.370 19:17:50 -- host/digest.sh@73 -- # killprocess 3287832 00:31:33.370 19:17:50 -- common/autotest_common.sh@936 -- # '[' -z 3287832 ']' 00:31:33.370 19:17:50 -- common/autotest_common.sh@940 -- # kill -0 3287832 00:31:33.370 19:17:50 -- common/autotest_common.sh@941 -- # uname 00:31:33.370 19:17:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:31:33.370 19:17:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3287832 00:31:33.370 19:17:50 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:31:33.370 19:17:50 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:31:33.370 19:17:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3287832' 00:31:33.370 killing process with pid 3287832 00:31:33.370 19:17:50 -- common/autotest_common.sh@955 -- # kill 3287832 00:31:33.370 Received shutdown signal, test time was about 2.000000 seconds 00:31:33.370 00:31:33.370 Latency(us) 00:31:33.370 [2024-11-26T18:17:50.297Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:31:33.370 [2024-11-26T18:17:50.297Z] =================================================================================================================== 00:31:33.370 [2024-11-26T18:17:50.297Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:31:33.370 19:17:50 -- common/autotest_common.sh@960 -- # wait 3287832 00:31:33.646 19:17:50 -- host/digest.sh@113 -- # run_bperf_err randwrite 4096 128 00:31:33.646 19:17:50 -- host/digest.sh@54 -- # local rw bs qd 00:31:33.646 19:17:50 -- host/digest.sh@56 -- # rw=randwrite 00:31:33.646 19:17:50 -- host/digest.sh@56 -- # bs=4096 00:31:33.646 19:17:50 -- host/digest.sh@56 -- # qd=128 00:31:33.646 19:17:50 -- host/digest.sh@58 -- # bperfpid=3288383 00:31:33.646 19:17:50 -- host/digest.sh@60 -- # waitforlisten 3288383 /var/tmp/bperf.sock 00:31:33.646 19:17:50 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z 00:31:33.646 19:17:50 -- common/autotest_common.sh@829 -- # '[' -z 3288383 ']' 00:31:33.646 19:17:50 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:31:33.646 19:17:50 -- common/autotest_common.sh@834 -- # local max_retries=100 00:31:33.646 19:17:50 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:31:33.646 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:31:33.646 19:17:50 -- common/autotest_common.sh@838 -- # xtrace_disable 00:31:33.646 19:17:50 -- common/autotest_common.sh@10 -- # set +x 00:31:33.646 [2024-11-26 19:17:50.428312] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:31:33.646 [2024-11-26 19:17:50.428360] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3288383 ] 00:31:33.646 EAL: No free 2048 kB hugepages reported on node 1 00:31:33.646 [2024-11-26 19:17:50.483610] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:31:33.646 [2024-11-26 19:17:50.523612] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:31:34.582 19:17:51 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:31:34.582 19:17:51 -- common/autotest_common.sh@862 -- # return 0 00:31:34.582 19:17:51 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:31:34.582 19:17:51 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:31:34.582 19:17:51 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:31:34.582 19:17:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:34.582 19:17:51 -- common/autotest_common.sh@10 -- # set +x 00:31:34.582 19:17:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:34.582 19:17:51 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:31:34.582 19:17:51 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:31:35.150 nvme0n1 00:31:35.150 19:17:51 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:31:35.150 19:17:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:35.150 19:17:51 -- common/autotest_common.sh@10 -- # set +x 00:31:35.150 19:17:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:35.150 19:17:51 -- host/digest.sh@69 -- # bperf_py perform_tests 00:31:35.150 19:17:51 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:31:35.150 Running I/O for 2 seconds... 00:31:35.150 [2024-11-26 19:17:51.935293] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190ee5c8 00:31:35.150 [2024-11-26 19:17:51.936053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:7033 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.150 [2024-11-26 19:17:51.936082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:004b p:0 m:0 dnr:0 00:31:35.150 [2024-11-26 19:17:51.944847] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190ee5c8 00:31:35.150 [2024-11-26 19:17:51.945112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:1819 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.150 [2024-11-26 19:17:51.945135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:004b p:0 m:0 dnr:0 00:31:35.150 [2024-11-26 19:17:51.953865] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190ef6a8 00:31:35.150 [2024-11-26 19:17:51.954270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:1029 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.150 [2024-11-26 19:17:51.954291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:005b p:0 m:0 dnr:0 00:31:35.150 [2024-11-26 19:17:51.962707] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190ed920 00:31:35.150 [2024-11-26 19:17:51.963092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:23513 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.150 [2024-11-26 19:17:51.963112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:005a p:0 m:0 dnr:0 00:31:35.150 [2024-11-26 19:17:51.971526] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190e95a0 00:31:35.150 [2024-11-26 19:17:51.971877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:20114 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.150 [2024-11-26 19:17:51.971897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0059 p:0 m:0 dnr:0 00:31:35.150 [2024-11-26 19:17:51.980370] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190eaef0 00:31:35.150 [2024-11-26 19:17:51.980693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:1861 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.150 [2024-11-26 19:17:51.980712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:0058 p:0 m:0 dnr:0 00:31:35.150 [2024-11-26 19:17:51.989203] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f31b8 00:31:35.150 [2024-11-26 19:17:51.989502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:22965 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.150 [2024-11-26 19:17:51.989520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:0057 p:0 m:0 dnr:0 00:31:35.150 [2024-11-26 19:17:51.998119] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f3e60 00:31:35.150 [2024-11-26 19:17:51.998394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:22198 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.150 [2024-11-26 19:17:51.998413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0056 p:0 m:0 dnr:0 00:31:35.150 [2024-11-26 19:17:52.006942] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f31b8 00:31:35.150 [2024-11-26 19:17:52.007199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:18455 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.150 [2024-11-26 19:17:52.007218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0055 p:0 m:0 dnr:0 00:31:35.150 [2024-11-26 19:17:52.015750] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190eaef0 00:31:35.150 [2024-11-26 19:17:52.015972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:2069 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.150 [2024-11-26 19:17:52.016007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0054 p:0 m:0 dnr:0 00:31:35.150 [2024-11-26 19:17:52.024600] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190e95a0 00:31:35.150 [2024-11-26 19:17:52.024804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:1833 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.150 [2024-11-26 19:17:52.024831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0053 p:0 m:0 dnr:0 00:31:35.150 [2024-11-26 19:17:52.033415] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190ec408 00:31:35.150 [2024-11-26 19:17:52.033596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:1545 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.150 [2024-11-26 19:17:52.033615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0052 p:0 m:0 dnr:0 00:31:35.150 [2024-11-26 19:17:52.042213] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190e3060 00:31:35.150 [2024-11-26 19:17:52.042367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:12499 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.150 [2024-11-26 19:17:52.042385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0051 p:0 m:0 dnr:0 00:31:35.150 [2024-11-26 19:17:52.051029] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f1430 00:31:35.150 [2024-11-26 19:17:52.051184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:1831 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.150 [2024-11-26 19:17:52.051202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0050 p:0 m:0 dnr:0 00:31:35.150 [2024-11-26 19:17:52.059836] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190eaef0 00:31:35.150 [2024-11-26 19:17:52.060037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:18469 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.150 [2024-11-26 19:17:52.060055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:004f p:0 m:0 dnr:0 00:31:35.150 [2024-11-26 19:17:52.070501] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190e84c0 00:31:35.150 [2024-11-26 19:17:52.071170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:20515 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.150 [2024-11-26 19:17:52.071190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:35.409 [2024-11-26 19:17:52.078386] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190e01f8 00:31:35.409 [2024-11-26 19:17:52.079307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:13572 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.409 [2024-11-26 19:17:52.079326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:35.409 [2024-11-26 19:17:52.087193] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190e01f8 00:31:35.409 [2024-11-26 19:17:52.088191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:20740 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.409 [2024-11-26 19:17:52.088211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:35.409 [2024-11-26 19:17:52.095074] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190fa3a0 00:31:35.409 [2024-11-26 19:17:52.095544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:13023 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.409 [2024-11-26 19:17:52.095563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:001e p:0 m:0 dnr:0 00:31:35.409 [2024-11-26 19:17:52.104046] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190ed4e8 00:31:35.409 [2024-11-26 19:17:52.104686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:14664 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.409 [2024-11-26 19:17:52.104708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:31:35.409 [2024-11-26 19:17:52.112881] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f7da8 00:31:35.409 [2024-11-26 19:17:52.113526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:20058 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.409 [2024-11-26 19:17:52.113545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:31:35.409 [2024-11-26 19:17:52.121721] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190ec840 00:31:35.409 [2024-11-26 19:17:52.122307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:15139 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.410 [2024-11-26 19:17:52.122326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:31:35.410 [2024-11-26 19:17:52.130567] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f92c0 00:31:35.410 [2024-11-26 19:17:52.131236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:7679 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.410 [2024-11-26 19:17:52.131255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:002b p:0 m:0 dnr:0 00:31:35.410 [2024-11-26 19:17:52.139633] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f5be8 00:31:35.410 [2024-11-26 19:17:52.140042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:22951 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.410 [2024-11-26 19:17:52.140062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:003b p:0 m:0 dnr:0 00:31:35.410 [2024-11-26 19:17:52.148818] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190e0a68 00:31:35.410 [2024-11-26 19:17:52.149173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:7664 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.410 [2024-11-26 19:17:52.149193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:005c p:0 m:0 dnr:0 00:31:35.410 [2024-11-26 19:17:52.157825] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190e38d0 00:31:35.410 [2024-11-26 19:17:52.158168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:2546 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.410 [2024-11-26 19:17:52.158186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:005b p:0 m:0 dnr:0 00:31:35.410 [2024-11-26 19:17:52.166844] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f0350 00:31:35.410 [2024-11-26 19:17:52.167168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:20119 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.410 [2024-11-26 19:17:52.167187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:005a p:0 m:0 dnr:0 00:31:35.410 [2024-11-26 19:17:52.175617] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f57b0 00:31:35.410 [2024-11-26 19:17:52.175908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:21346 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.410 [2024-11-26 19:17:52.175927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0059 p:0 m:0 dnr:0 00:31:35.410 [2024-11-26 19:17:52.184393] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f4b08 00:31:35.410 [2024-11-26 19:17:52.184662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:22099 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.410 [2024-11-26 19:17:52.184680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:0058 p:0 m:0 dnr:0 00:31:35.410 [2024-11-26 19:17:52.193177] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190e6fa8 00:31:35.410 [2024-11-26 19:17:52.193419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:23239 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.410 [2024-11-26 19:17:52.193436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:0057 p:0 m:0 dnr:0 00:31:35.410 [2024-11-26 19:17:52.202213] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f31b8 00:31:35.410 [2024-11-26 19:17:52.202432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:6702 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.410 [2024-11-26 19:17:52.202450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:0056 p:0 m:0 dnr:0 00:31:35.410 [2024-11-26 19:17:52.211006] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f3e60 00:31:35.410 [2024-11-26 19:17:52.211193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:15499 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.410 [2024-11-26 19:17:52.211211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0055 p:0 m:0 dnr:0 00:31:35.410 [2024-11-26 19:17:52.219827] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f35f0 00:31:35.410 [2024-11-26 19:17:52.219995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:5507 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.410 [2024-11-26 19:17:52.220013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0054 p:0 m:0 dnr:0 00:31:35.410 [2024-11-26 19:17:52.228651] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190e6b70 00:31:35.410 [2024-11-26 19:17:52.228862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:7661 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.410 [2024-11-26 19:17:52.228881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:0053 p:0 m:0 dnr:0 00:31:35.410 [2024-11-26 19:17:52.239058] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f0788 00:31:35.410 [2024-11-26 19:17:52.240273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:21690 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.410 [2024-11-26 19:17:52.240293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:35.410 [2024-11-26 19:17:52.248055] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f35f0 00:31:35.410 [2024-11-26 19:17:52.248717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:1316 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.410 [2024-11-26 19:17:52.248736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:31:35.410 [2024-11-26 19:17:52.255617] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f1868 00:31:35.410 [2024-11-26 19:17:52.256676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:4845 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.410 [2024-11-26 19:17:52.256695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:31:35.410 [2024-11-26 19:17:52.264429] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190e5a90 00:31:35.410 [2024-11-26 19:17:52.265683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:11420 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.410 [2024-11-26 19:17:52.265702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:35.410 [2024-11-26 19:17:52.273541] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190e0630 00:31:35.410 [2024-11-26 19:17:52.274461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:4767 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.410 [2024-11-26 19:17:52.274481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:35.410 [2024-11-26 19:17:52.281981] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190ef6a8 00:31:35.410 [2024-11-26 19:17:52.282241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:21789 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.410 [2024-11-26 19:17:52.282260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:004b p:0 m:0 dnr:0 00:31:35.410 [2024-11-26 19:17:52.291042] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190fef90 00:31:35.410 [2024-11-26 19:17:52.291782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:14700 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.410 [2024-11-26 19:17:52.291801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:31:35.410 [2024-11-26 19:17:52.299799] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f7970 00:31:35.410 [2024-11-26 19:17:52.300967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:25344 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.410 [2024-11-26 19:17:52.300986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:31:35.410 [2024-11-26 19:17:52.309256] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f8618 00:31:35.410 [2024-11-26 19:17:52.310487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:17076 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.410 [2024-11-26 19:17:52.310506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:006d p:0 m:0 dnr:0 00:31:35.410 [2024-11-26 19:17:52.318253] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190ff3c8 00:31:35.410 [2024-11-26 19:17:52.319084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:9817 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.410 [2024-11-26 19:17:52.319103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:31:35.410 [2024-11-26 19:17:52.327058] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190e7818 00:31:35.410 [2024-11-26 19:17:52.327688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:23889 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.410 [2024-11-26 19:17:52.327707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:31:35.670 [2024-11-26 19:17:52.336086] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190ea680 00:31:35.670 [2024-11-26 19:17:52.336707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:9776 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.670 [2024-11-26 19:17:52.336731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:31:35.670 [2024-11-26 19:17:52.344931] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190fb8b8 00:31:35.670 [2024-11-26 19:17:52.345518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:19519 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.670 [2024-11-26 19:17:52.345537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:31:35.670 [2024-11-26 19:17:52.353807] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190ed920 00:31:35.670 [2024-11-26 19:17:52.354369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:20137 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.670 [2024-11-26 19:17:52.354388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0079 p:0 m:0 dnr:0 00:31:35.670 [2024-11-26 19:17:52.362572] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190e3060 00:31:35.670 [2024-11-26 19:17:52.363108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:22102 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.670 [2024-11-26 19:17:52.363127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:31:35.670 [2024-11-26 19:17:52.370770] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190e3d08 00:31:35.670 [2024-11-26 19:17:52.372100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:9784 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.670 [2024-11-26 19:17:52.372119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:0077 p:0 m:0 dnr:0 00:31:35.670 [2024-11-26 19:17:52.379359] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190eea00 00:31:35.670 [2024-11-26 19:17:52.380263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:14580 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.670 [2024-11-26 19:17:52.380281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:31:35.670 [2024-11-26 19:17:52.387769] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190fcdd0 00:31:35.670 [2024-11-26 19:17:52.388633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:8655 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.670 [2024-11-26 19:17:52.388652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:003c p:0 m:0 dnr:0 00:31:35.670 [2024-11-26 19:17:52.397335] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190e1710 00:31:35.670 [2024-11-26 19:17:52.397538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:3500 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.670 [2024-11-26 19:17:52.397557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:003b p:0 m:0 dnr:0 00:31:35.670 [2024-11-26 19:17:52.406426] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190e3d08 00:31:35.670 [2024-11-26 19:17:52.407100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:1039 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.670 [2024-11-26 19:17:52.407120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:005c p:0 m:0 dnr:0 00:31:35.670 [2024-11-26 19:17:52.415688] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190e4140 00:31:35.670 [2024-11-26 19:17:52.416180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:19193 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.670 [2024-11-26 19:17:52.416201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:006d p:0 m:0 dnr:0 00:31:35.670 [2024-11-26 19:17:52.424698] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f2510 00:31:35.670 [2024-11-26 19:17:52.425167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:11130 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.670 [2024-11-26 19:17:52.425186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:31:35.670 [2024-11-26 19:17:52.433468] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190fbcf0 00:31:35.670 [2024-11-26 19:17:52.433937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:1005 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.670 [2024-11-26 19:17:52.433962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:31:35.670 [2024-11-26 19:17:52.442375] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190e8d30 00:31:35.670 [2024-11-26 19:17:52.443002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:16288 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.670 [2024-11-26 19:17:52.443021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:31:35.670 [2024-11-26 19:17:52.451046] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f20d8 00:31:35.670 [2024-11-26 19:17:52.452117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:25314 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.670 [2024-11-26 19:17:52.452136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:31:35.670 [2024-11-26 19:17:52.460140] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f57b0 00:31:35.670 [2024-11-26 19:17:52.461240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:4430 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.670 [2024-11-26 19:17:52.461259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:31:35.670 [2024-11-26 19:17:52.468750] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190ed920 00:31:35.670 [2024-11-26 19:17:52.469592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:3881 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.670 [2024-11-26 19:17:52.469612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:004c p:0 m:0 dnr:0 00:31:35.670 [2024-11-26 19:17:52.477824] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190eff18 00:31:35.670 [2024-11-26 19:17:52.478755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:7619 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.670 [2024-11-26 19:17:52.478774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:006e p:0 m:0 dnr:0 00:31:35.670 [2024-11-26 19:17:52.486660] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190e88f8 00:31:35.670 [2024-11-26 19:17:52.487598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:10680 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.670 [2024-11-26 19:17:52.487617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:006f p:0 m:0 dnr:0 00:31:35.670 [2024-11-26 19:17:52.496045] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190fc998 00:31:35.670 [2024-11-26 19:17:52.496518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:16604 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.670 [2024-11-26 19:17:52.496537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:006f p:0 m:0 dnr:0 00:31:35.670 [2024-11-26 19:17:52.504973] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f5be8 00:31:35.670 [2024-11-26 19:17:52.505593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:221 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.671 [2024-11-26 19:17:52.505611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:31:35.671 [2024-11-26 19:17:52.513751] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190e0ea0 00:31:35.671 [2024-11-26 19:17:52.514366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:16964 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.671 [2024-11-26 19:17:52.514384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:31:35.671 [2024-11-26 19:17:52.522524] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f6cc8 00:31:35.671 [2024-11-26 19:17:52.523097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:750 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.671 [2024-11-26 19:17:52.523117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:31:35.671 [2024-11-26 19:17:52.531313] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190e6738 00:31:35.671 [2024-11-26 19:17:52.531866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:11686 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.671 [2024-11-26 19:17:52.531884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:31:35.671 [2024-11-26 19:17:52.540136] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190edd58 00:31:35.671 [2024-11-26 19:17:52.540698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:15350 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.671 [2024-11-26 19:17:52.540716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:31:35.671 [2024-11-26 19:17:52.549042] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f92c0 00:31:35.671 [2024-11-26 19:17:52.549555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:4571 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.671 [2024-11-26 19:17:52.549574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:31:35.671 [2024-11-26 19:17:52.557864] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190eea00 00:31:35.671 [2024-11-26 19:17:52.558396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:22120 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.671 [2024-11-26 19:17:52.558415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0079 p:0 m:0 dnr:0 00:31:35.671 [2024-11-26 19:17:52.566651] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190efae0 00:31:35.671 [2024-11-26 19:17:52.567206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:3868 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.671 [2024-11-26 19:17:52.567229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:31:35.671 [2024-11-26 19:17:52.575341] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190e3060 00:31:35.671 [2024-11-26 19:17:52.575863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:20178 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.671 [2024-11-26 19:17:52.575882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:0077 p:0 m:0 dnr:0 00:31:35.671 [2024-11-26 19:17:52.584261] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190eb328 00:31:35.671 [2024-11-26 19:17:52.584715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:12338 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.671 [2024-11-26 19:17:52.584734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0076 p:0 m:0 dnr:0 00:31:35.930 [2024-11-26 19:17:52.593230] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190fbcf0 00:31:35.930 [2024-11-26 19:17:52.593715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:22143 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.930 [2024-11-26 19:17:52.593734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:31:35.930 [2024-11-26 19:17:52.602251] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f0350 00:31:35.930 [2024-11-26 19:17:52.602836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:15009 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.930 [2024-11-26 19:17:52.602855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:37 cdw0:0 sqhd:0074 p:0 m:0 dnr:0 00:31:35.930 [2024-11-26 19:17:52.610937] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190e5220 00:31:35.930 [2024-11-26 19:17:52.612121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:7485 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.930 [2024-11-26 19:17:52.612141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:31:35.930 [2024-11-26 19:17:52.619760] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f57b0 00:31:35.930 [2024-11-26 19:17:52.620713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:25056 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.930 [2024-11-26 19:17:52.620732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:0076 p:0 m:0 dnr:0 00:31:35.930 [2024-11-26 19:17:52.628597] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f3e60 00:31:35.930 [2024-11-26 19:17:52.629561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:25080 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.930 [2024-11-26 19:17:52.629582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0077 p:0 m:0 dnr:0 00:31:35.930 [2024-11-26 19:17:52.638020] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f6020 00:31:35.930 [2024-11-26 19:17:52.639239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:21894 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.930 [2024-11-26 19:17:52.639259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:31:35.930 [2024-11-26 19:17:52.645877] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190eea00 00:31:35.930 [2024-11-26 19:17:52.646709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:12919 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.930 [2024-11-26 19:17:52.646729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0077 p:0 m:0 dnr:0 00:31:35.930 [2024-11-26 19:17:52.654637] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190eea00 00:31:35.930 [2024-11-26 19:17:52.655495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:20083 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.930 [2024-11-26 19:17:52.655514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:31:35.930 [2024-11-26 19:17:52.663464] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190eea00 00:31:35.930 [2024-11-26 19:17:52.664384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:24071 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.930 [2024-11-26 19:17:52.664403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0079 p:0 m:0 dnr:0 00:31:35.930 [2024-11-26 19:17:52.671864] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f8618 00:31:35.930 [2024-11-26 19:17:52.671930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:24331 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.930 [2024-11-26 19:17:52.671952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:003b p:0 m:0 dnr:0 00:31:35.930 [2024-11-26 19:17:52.680798] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f6020 00:31:35.930 [2024-11-26 19:17:52.681018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:15148 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.930 [2024-11-26 19:17:52.681036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:004b p:0 m:0 dnr:0 00:31:35.930 [2024-11-26 19:17:52.691088] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f2510 00:31:35.930 [2024-11-26 19:17:52.692344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:15969 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.930 [2024-11-26 19:17:52.692364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:35.930 [2024-11-26 19:17:52.699877] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190fa3a0 00:31:35.930 [2024-11-26 19:17:52.701160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:8274 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.930 [2024-11-26 19:17:52.701178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:31:35.930 [2024-11-26 19:17:52.708986] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190ec408 00:31:35.930 [2024-11-26 19:17:52.710271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:16996 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.930 [2024-11-26 19:17:52.710290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:31:35.930 [2024-11-26 19:17:52.716611] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f8618 00:31:35.930 [2024-11-26 19:17:52.716881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:14201 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.930 [2024-11-26 19:17:52.716900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0055 p:0 m:0 dnr:0 00:31:35.930 [2024-11-26 19:17:52.725530] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f7538 00:31:35.930 [2024-11-26 19:17:52.725774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:18708 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.930 [2024-11-26 19:17:52.725793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0054 p:0 m:0 dnr:0 00:31:35.930 [2024-11-26 19:17:52.734165] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f9f68 00:31:35.930 [2024-11-26 19:17:52.734387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:23789 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.930 [2024-11-26 19:17:52.734406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0053 p:0 m:0 dnr:0 00:31:35.930 [2024-11-26 19:17:52.743079] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190fbcf0 00:31:35.930 [2024-11-26 19:17:52.743275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:2226 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.930 [2024-11-26 19:17:52.743294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0052 p:0 m:0 dnr:0 00:31:35.930 [2024-11-26 19:17:52.753179] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f7da8 00:31:35.930 [2024-11-26 19:17:52.753908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:11501 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.930 [2024-11-26 19:17:52.753926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:0051 p:0 m:0 dnr:0 00:31:35.930 [2024-11-26 19:17:52.761220] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190e95a0 00:31:35.930 [2024-11-26 19:17:52.761845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:7911 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.930 [2024-11-26 19:17:52.761863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:31:35.930 [2024-11-26 19:17:52.769986] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190e12d8 00:31:35.930 [2024-11-26 19:17:52.771051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:3168 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.930 [2024-11-26 19:17:52.771069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:31:35.930 [2024-11-26 19:17:52.778809] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190eaef0 00:31:35.930 [2024-11-26 19:17:52.779713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:17157 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.930 [2024-11-26 19:17:52.779731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:31:35.931 [2024-11-26 19:17:52.787662] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190eaef0 00:31:35.931 [2024-11-26 19:17:52.788568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:13444 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.931 [2024-11-26 19:17:52.788587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:0064 p:0 m:0 dnr:0 00:31:35.931 [2024-11-26 19:17:52.796480] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190eaef0 00:31:35.931 [2024-11-26 19:17:52.797395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:20259 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.931 [2024-11-26 19:17:52.797417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:31:35.931 [2024-11-26 19:17:52.805299] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190eaef0 00:31:35.931 [2024-11-26 19:17:52.806218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:16800 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.931 [2024-11-26 19:17:52.806236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:31:35.931 [2024-11-26 19:17:52.814136] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190eaef0 00:31:35.931 [2024-11-26 19:17:52.815061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23646 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.931 [2024-11-26 19:17:52.815080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:31:35.931 [2024-11-26 19:17:52.823013] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190eaef0 00:31:35.931 [2024-11-26 19:17:52.823958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:1198 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.931 [2024-11-26 19:17:52.823977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:31:35.931 [2024-11-26 19:17:52.831871] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190eaef0 00:31:35.931 [2024-11-26 19:17:52.832818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:22017 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.931 [2024-11-26 19:17:52.832836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0069 p:0 m:0 dnr:0 00:31:35.931 [2024-11-26 19:17:52.840723] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f8e88 00:31:35.931 [2024-11-26 19:17:52.841704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:13329 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.931 [2024-11-26 19:17:52.841723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:31:35.931 [2024-11-26 19:17:52.849638] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190ff3c8 00:31:35.931 [2024-11-26 19:17:52.850538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:19378 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:35.931 [2024-11-26 19:17:52.850557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:31:36.190 [2024-11-26 19:17:52.858764] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190ed4e8 00:31:36.190 [2024-11-26 19:17:52.859721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:13125 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.190 [2024-11-26 19:17:52.859739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:31:36.190 [2024-11-26 19:17:52.867591] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190e49b0 00:31:36.190 [2024-11-26 19:17:52.868573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:8874 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.190 [2024-11-26 19:17:52.868592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:006d p:0 m:0 dnr:0 00:31:36.190 [2024-11-26 19:17:52.876420] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190e49b0 00:31:36.190 [2024-11-26 19:17:52.877428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:23946 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.190 [2024-11-26 19:17:52.877450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:006e p:0 m:0 dnr:0 00:31:36.190 [2024-11-26 19:17:52.885281] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190ed4e8 00:31:36.190 [2024-11-26 19:17:52.886179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:18911 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.190 [2024-11-26 19:17:52.886198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:006f p:0 m:0 dnr:0 00:31:36.190 [2024-11-26 19:17:52.894277] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f4298 00:31:36.190 [2024-11-26 19:17:52.894805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:22424 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.190 [2024-11-26 19:17:52.894825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:006f p:0 m:0 dnr:0 00:31:36.190 [2024-11-26 19:17:52.902854] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f7100 00:31:36.190 [2024-11-26 19:17:52.904056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:10552 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.190 [2024-11-26 19:17:52.904075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:006f p:0 m:0 dnr:0 00:31:36.190 [2024-11-26 19:17:52.911704] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f7da8 00:31:36.190 [2024-11-26 19:17:52.912314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:13392 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.190 [2024-11-26 19:17:52.912333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0070 p:0 m:0 dnr:0 00:31:36.190 [2024-11-26 19:17:52.920013] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190eaab8 00:31:36.190 [2024-11-26 19:17:52.920820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:19385 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.190 [2024-11-26 19:17:52.920838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:003d p:0 m:0 dnr:0 00:31:36.190 [2024-11-26 19:17:52.928969] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190e9168 00:31:36.190 [2024-11-26 19:17:52.929503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:1126 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.190 [2024-11-26 19:17:52.929522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:004d p:0 m:0 dnr:0 00:31:36.190 [2024-11-26 19:17:52.937788] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190fdeb0 00:31:36.190 [2024-11-26 19:17:52.938039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:9397 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.190 [2024-11-26 19:17:52.938057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:004c p:0 m:0 dnr:0 00:31:36.190 [2024-11-26 19:17:52.946591] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f3a28 00:31:36.190 [2024-11-26 19:17:52.946816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:13593 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.190 [2024-11-26 19:17:52.946834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:004b p:0 m:0 dnr:0 00:31:36.190 [2024-11-26 19:17:52.955473] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f8618 00:31:36.190 [2024-11-26 19:17:52.955671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:2048 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.190 [2024-11-26 19:17:52.955688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:004a p:0 m:0 dnr:0 00:31:36.190 [2024-11-26 19:17:52.965944] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190ebfd0 00:31:36.191 [2024-11-26 19:17:52.967222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:9691 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.191 [2024-11-26 19:17:52.967241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:36.191 [2024-11-26 19:17:52.974779] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190ea680 00:31:36.191 [2024-11-26 19:17:52.976056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:4378 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.191 [2024-11-26 19:17:52.976074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:31:36.191 [2024-11-26 19:17:52.983614] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190ef6a8 00:31:36.191 [2024-11-26 19:17:52.984907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:265 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.191 [2024-11-26 19:17:52.984925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:31:36.191 [2024-11-26 19:17:52.992601] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f3a28 00:31:36.191 [2024-11-26 19:17:52.993805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:8550 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.191 [2024-11-26 19:17:52.993823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:31:36.191 [2024-11-26 19:17:53.001004] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190ed920 00:31:36.191 [2024-11-26 19:17:53.001740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:16277 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.191 [2024-11-26 19:17:53.001758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0052 p:0 m:0 dnr:0 00:31:36.191 [2024-11-26 19:17:53.009937] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190ef270 00:31:36.191 [2024-11-26 19:17:53.011024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:23889 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.191 [2024-11-26 19:17:53.011042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:31:36.191 [2024-11-26 19:17:53.018755] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190e7c50 00:31:36.191 [2024-11-26 19:17:53.019870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:951 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.191 [2024-11-26 19:17:53.019889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:36.191 [2024-11-26 19:17:53.027496] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190de038 00:31:36.191 [2024-11-26 19:17:53.028067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:4235 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.191 [2024-11-26 19:17:53.028086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:0071 p:0 m:0 dnr:0 00:31:36.191 [2024-11-26 19:17:53.036135] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f8618 00:31:36.191 [2024-11-26 19:17:53.037304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:12960 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.191 [2024-11-26 19:17:53.037322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0071 p:0 m:0 dnr:0 00:31:36.191 [2024-11-26 19:17:53.044954] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190e4578 00:31:36.191 [2024-11-26 19:17:53.045960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:4402 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.191 [2024-11-26 19:17:53.045980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0072 p:0 m:0 dnr:0 00:31:36.191 [2024-11-26 19:17:53.053795] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190e23b8 00:31:36.191 [2024-11-26 19:17:53.054810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:10536 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.191 [2024-11-26 19:17:53.054830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:0073 p:0 m:0 dnr:0 00:31:36.191 [2024-11-26 19:17:53.062643] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190ebfd0 00:31:36.191 [2024-11-26 19:17:53.063663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:16899 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.191 [2024-11-26 19:17:53.063681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:0074 p:0 m:0 dnr:0 00:31:36.191 [2024-11-26 19:17:53.071478] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f3a28 00:31:36.191 [2024-11-26 19:17:53.072514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:892 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.191 [2024-11-26 19:17:53.072532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:31:36.191 [2024-11-26 19:17:53.080321] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190e4578 00:31:36.191 [2024-11-26 19:17:53.081358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:22410 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.191 [2024-11-26 19:17:53.081377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0076 p:0 m:0 dnr:0 00:31:36.191 [2024-11-26 19:17:53.089165] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f6020 00:31:36.191 [2024-11-26 19:17:53.090211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:2001 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.191 [2024-11-26 19:17:53.090230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:0077 p:0 m:0 dnr:0 00:31:36.191 [2024-11-26 19:17:53.098017] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f96f8 00:31:36.191 [2024-11-26 19:17:53.099082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:6223 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.191 [2024-11-26 19:17:53.099100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:31:36.191 [2024-11-26 19:17:53.106850] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190ee190 00:31:36.191 [2024-11-26 19:17:53.107928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:11285 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.191 [2024-11-26 19:17:53.107954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:0079 p:0 m:0 dnr:0 00:31:36.451 [2024-11-26 19:17:53.115892] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190e7c50 00:31:36.451 [2024-11-26 19:17:53.116998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:16398 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.452 [2024-11-26 19:17:53.117017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:31:36.452 [2024-11-26 19:17:53.124841] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f2948 00:31:36.452 [2024-11-26 19:17:53.125937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:22169 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.452 [2024-11-26 19:17:53.125960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:31:36.452 [2024-11-26 19:17:53.133693] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f4b08 00:31:36.452 [2024-11-26 19:17:53.134819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:14815 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.452 [2024-11-26 19:17:53.134838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:31:36.452 [2024-11-26 19:17:53.142597] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f4b08 00:31:36.452 [2024-11-26 19:17:53.143734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:3527 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.452 [2024-11-26 19:17:53.143753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:31:36.452 [2024-11-26 19:17:53.151454] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f2948 00:31:36.452 [2024-11-26 19:17:53.152265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:24938 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.452 [2024-11-26 19:17:53.152284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:31:36.452 [2024-11-26 19:17:53.160450] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190e7818 00:31:36.452 [2024-11-26 19:17:53.161083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:19155 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.452 [2024-11-26 19:17:53.161102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:31:36.452 [2024-11-26 19:17:53.169183] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f7da8 00:31:36.452 [2024-11-26 19:17:53.170289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:15125 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.452 [2024-11-26 19:17:53.170309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:31:36.452 [2024-11-26 19:17:53.177999] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f9f68 00:31:36.452 [2024-11-26 19:17:53.178874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:4964 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.452 [2024-11-26 19:17:53.178893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:31:36.452 [2024-11-26 19:17:53.186452] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190e1710 00:31:36.452 [2024-11-26 19:17:53.186681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:20279 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.452 [2024-11-26 19:17:53.186700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:004b p:0 m:0 dnr:0 00:31:36.452 [2024-11-26 19:17:53.195384] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f1868 00:31:36.452 [2024-11-26 19:17:53.195752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:5703 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.452 [2024-11-26 19:17:53.195771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:005b p:0 m:0 dnr:0 00:31:36.452 [2024-11-26 19:17:53.204241] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190ec840 00:31:36.452 [2024-11-26 19:17:53.204594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:22595 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.452 [2024-11-26 19:17:53.204612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:005a p:0 m:0 dnr:0 00:31:36.452 [2024-11-26 19:17:53.213339] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190fac10 00:31:36.452 [2024-11-26 19:17:53.213673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:8996 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.452 [2024-11-26 19:17:53.213692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0059 p:0 m:0 dnr:0 00:31:36.452 [2024-11-26 19:17:53.222543] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f7da8 00:31:36.452 [2024-11-26 19:17:53.222845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:25598 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.452 [2024-11-26 19:17:53.222864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0058 p:0 m:0 dnr:0 00:31:36.452 [2024-11-26 19:17:53.231343] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190edd58 00:31:36.452 [2024-11-26 19:17:53.231621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:15657 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.452 [2024-11-26 19:17:53.231640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0057 p:0 m:0 dnr:0 00:31:36.452 [2024-11-26 19:17:53.240162] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f20d8 00:31:36.452 [2024-11-26 19:17:53.240412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:6059 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.452 [2024-11-26 19:17:53.240431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0056 p:0 m:0 dnr:0 00:31:36.452 [2024-11-26 19:17:53.248963] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190df118 00:31:36.452 [2024-11-26 19:17:53.249185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:13498 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.452 [2024-11-26 19:17:53.249205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:0055 p:0 m:0 dnr:0 00:31:36.452 [2024-11-26 19:17:53.257779] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f2510 00:31:36.452 [2024-11-26 19:17:53.257983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:2875 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.452 [2024-11-26 19:17:53.258001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:0054 p:0 m:0 dnr:0 00:31:36.452 [2024-11-26 19:17:53.266644] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190e6fa8 00:31:36.452 [2024-11-26 19:17:53.266820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:8223 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.452 [2024-11-26 19:17:53.266838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0053 p:0 m:0 dnr:0 00:31:36.452 [2024-11-26 19:17:53.275456] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190ec840 00:31:36.452 [2024-11-26 19:17:53.275601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:23422 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.452 [2024-11-26 19:17:53.275618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0052 p:0 m:0 dnr:0 00:31:36.452 [2024-11-26 19:17:53.284259] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190fcdd0 00:31:36.452 [2024-11-26 19:17:53.284432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:22334 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.452 [2024-11-26 19:17:53.284450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:0051 p:0 m:0 dnr:0 00:31:36.452 [2024-11-26 19:17:53.294697] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190e9168 00:31:36.452 [2024-11-26 19:17:53.295936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:23380 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.452 [2024-11-26 19:17:53.295961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:36.452 [2024-11-26 19:17:53.302495] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190fc560 00:31:36.452 [2024-11-26 19:17:53.303511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:19008 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.452 [2024-11-26 19:17:53.303530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:31:36.452 [2024-11-26 19:17:53.310880] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190eff18 00:31:36.452 [2024-11-26 19:17:53.311710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:6108 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.452 [2024-11-26 19:17:53.311729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:004e p:0 m:0 dnr:0 00:31:36.452 [2024-11-26 19:17:53.319737] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190fa7d8 00:31:36.452 [2024-11-26 19:17:53.320566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:8002 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.452 [2024-11-26 19:17:53.320585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:004d p:0 m:0 dnr:0 00:31:36.452 [2024-11-26 19:17:53.328603] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f9f68 00:31:36.452 [2024-11-26 19:17:53.329443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:2981 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.452 [2024-11-26 19:17:53.329462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:004c p:0 m:0 dnr:0 00:31:36.452 [2024-11-26 19:17:53.337437] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190ecc78 00:31:36.452 [2024-11-26 19:17:53.338286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:25359 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.452 [2024-11-26 19:17:53.338309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:004b p:0 m:0 dnr:0 00:31:36.452 [2024-11-26 19:17:53.346339] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f6020 00:31:36.452 [2024-11-26 19:17:53.347202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:20697 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.452 [2024-11-26 19:17:53.347222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:004a p:0 m:0 dnr:0 00:31:36.453 [2024-11-26 19:17:53.355188] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190eaef0 00:31:36.453 [2024-11-26 19:17:53.356020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:17602 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.453 [2024-11-26 19:17:53.356039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0049 p:0 m:0 dnr:0 00:31:36.453 [2024-11-26 19:17:53.364207] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190ddc00 00:31:36.453 [2024-11-26 19:17:53.364406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:10870 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.453 [2024-11-26 19:17:53.364424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0048 p:0 m:0 dnr:0 00:31:36.453 [2024-11-26 19:17:53.373295] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190e4578 00:31:36.453 [2024-11-26 19:17:53.373664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:20609 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.453 [2024-11-26 19:17:53.373683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0058 p:0 m:0 dnr:0 00:31:36.713 [2024-11-26 19:17:53.382282] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190fcdd0 00:31:36.713 [2024-11-26 19:17:53.382610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:10358 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.713 [2024-11-26 19:17:53.382629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0057 p:0 m:0 dnr:0 00:31:36.713 [2024-11-26 19:17:53.391106] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190fb480 00:31:36.713 [2024-11-26 19:17:53.391408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:18730 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.713 [2024-11-26 19:17:53.391426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0056 p:0 m:0 dnr:0 00:31:36.713 [2024-11-26 19:17:53.400256] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190e9e10 00:31:36.713 [2024-11-26 19:17:53.400935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:19201 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.713 [2024-11-26 19:17:53.400958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:31:36.713 [2024-11-26 19:17:53.409128] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190e88f8 00:31:36.713 [2024-11-26 19:17:53.409785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:24831 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.713 [2024-11-26 19:17:53.409805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:31:36.713 [2024-11-26 19:17:53.418029] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190fd208 00:31:36.713 [2024-11-26 19:17:53.419117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:3234 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.713 [2024-11-26 19:17:53.419136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:31:36.713 [2024-11-26 19:17:53.426864] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190fd208 00:31:36.713 [2024-11-26 19:17:53.427716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:5466 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.713 [2024-11-26 19:17:53.427736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:31:36.713 [2024-11-26 19:17:53.435773] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190fd208 00:31:36.713 [2024-11-26 19:17:53.436641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:881 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.713 [2024-11-26 19:17:53.436660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0069 p:0 m:0 dnr:0 00:31:36.713 [2024-11-26 19:17:53.445284] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190fc998 00:31:36.713 [2024-11-26 19:17:53.445720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:5467 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.713 [2024-11-26 19:17:53.445739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0069 p:0 m:0 dnr:0 00:31:36.713 [2024-11-26 19:17:53.454207] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190ed920 00:31:36.713 [2024-11-26 19:17:53.454794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:3394 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.713 [2024-11-26 19:17:53.454814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0079 p:0 m:0 dnr:0 00:31:36.713 [2024-11-26 19:17:53.463023] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f5378 00:31:36.713 [2024-11-26 19:17:53.463608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:15261 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.713 [2024-11-26 19:17:53.463627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:31:36.713 [2024-11-26 19:17:53.472122] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190de8a8 00:31:36.713 [2024-11-26 19:17:53.472686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:17116 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.713 [2024-11-26 19:17:53.472704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:0077 p:0 m:0 dnr:0 00:31:36.713 [2024-11-26 19:17:53.480991] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190dfdc0 00:31:36.713 [2024-11-26 19:17:53.481498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:5854 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.713 [2024-11-26 19:17:53.481517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:0076 p:0 m:0 dnr:0 00:31:36.713 [2024-11-26 19:17:53.489906] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190ebb98 00:31:36.713 [2024-11-26 19:17:53.490401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:4644 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.713 [2024-11-26 19:17:53.490420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:31:36.713 [2024-11-26 19:17:53.498719] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190e88f8 00:31:36.713 [2024-11-26 19:17:53.499186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:16818 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.713 [2024-11-26 19:17:53.499205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0074 p:0 m:0 dnr:0 00:31:36.713 [2024-11-26 19:17:53.507516] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190fac10 00:31:36.713 [2024-11-26 19:17:53.507963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:10063 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.713 [2024-11-26 19:17:53.507983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:0073 p:0 m:0 dnr:0 00:31:36.713 [2024-11-26 19:17:53.516332] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190e0630 00:31:36.713 [2024-11-26 19:17:53.516744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:8505 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.713 [2024-11-26 19:17:53.516762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0072 p:0 m:0 dnr:0 00:31:36.713 [2024-11-26 19:17:53.525142] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190fe720 00:31:36.713 [2024-11-26 19:17:53.525532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:18702 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.713 [2024-11-26 19:17:53.525552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0071 p:0 m:0 dnr:0 00:31:36.713 [2024-11-26 19:17:53.533943] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f0788 00:31:36.713 [2024-11-26 19:17:53.534444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:11974 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.713 [2024-11-26 19:17:53.534464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0070 p:0 m:0 dnr:0 00:31:36.714 [2024-11-26 19:17:53.542791] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190e6738 00:31:36.714 [2024-11-26 19:17:53.543310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:11202 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.714 [2024-11-26 19:17:53.543329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:006f p:0 m:0 dnr:0 00:31:36.714 [2024-11-26 19:17:53.551533] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190fb480 00:31:36.714 [2024-11-26 19:17:53.552679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:14486 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.714 [2024-11-26 19:17:53.552698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0070 p:0 m:0 dnr:0 00:31:36.714 [2024-11-26 19:17:53.560347] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190efae0 00:31:36.714 [2024-11-26 19:17:53.561261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:14253 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.714 [2024-11-26 19:17:53.561282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0071 p:0 m:0 dnr:0 00:31:36.714 [2024-11-26 19:17:53.569236] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f7da8 00:31:36.714 [2024-11-26 19:17:53.570162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18808 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.714 [2024-11-26 19:17:53.570193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0072 p:0 m:0 dnr:0 00:31:36.714 [2024-11-26 19:17:53.578151] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190fbcf0 00:31:36.714 [2024-11-26 19:17:53.579110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:21022 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.714 [2024-11-26 19:17:53.579129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0073 p:0 m:0 dnr:0 00:31:36.714 [2024-11-26 19:17:53.587604] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190fc560 00:31:36.714 [2024-11-26 19:17:53.588641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:11143 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.714 [2024-11-26 19:17:53.588660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:0073 p:0 m:0 dnr:0 00:31:36.714 [2024-11-26 19:17:53.595065] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f35f0 00:31:36.714 [2024-11-26 19:17:53.595277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:15781 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.714 [2024-11-26 19:17:53.595295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:004c p:0 m:0 dnr:0 00:31:36.714 [2024-11-26 19:17:53.605358] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190e2c28 00:31:36.714 [2024-11-26 19:17:53.606629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:19923 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.714 [2024-11-26 19:17:53.606649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:36.714 [2024-11-26 19:17:53.614203] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f0788 00:31:36.714 [2024-11-26 19:17:53.615493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:10557 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.714 [2024-11-26 19:17:53.615511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:36.714 [2024-11-26 19:17:53.623278] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190fbcf0 00:31:36.714 [2024-11-26 19:17:53.624525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:4372 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.714 [2024-11-26 19:17:53.624544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:36.714 [2024-11-26 19:17:53.631712] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190e3060 00:31:36.714 [2024-11-26 19:17:53.632486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:6790 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.714 [2024-11-26 19:17:53.632505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0056 p:0 m:0 dnr:0 00:31:36.973 [2024-11-26 19:17:53.641245] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f4f40 00:31:36.973 [2024-11-26 19:17:53.642182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:3926 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.973 [2024-11-26 19:17:53.642201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:0077 p:0 m:0 dnr:0 00:31:36.973 [2024-11-26 19:17:53.648762] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190e7818 00:31:36.973 [2024-11-26 19:17:53.649468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:21226 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.973 [2024-11-26 19:17:53.649490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:31:36.973 [2024-11-26 19:17:53.657637] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f0350 00:31:36.973 [2024-11-26 19:17:53.658306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:4785 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.973 [2024-11-26 19:17:53.658325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:31:36.973 [2024-11-26 19:17:53.666487] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190e7818 00:31:36.973 [2024-11-26 19:17:53.667190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:11219 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.973 [2024-11-26 19:17:53.667211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:31:36.973 [2024-11-26 19:17:53.675312] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f2510 00:31:36.973 [2024-11-26 19:17:53.676135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:10991 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.973 [2024-11-26 19:17:53.676153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0046 p:0 m:0 dnr:0 00:31:36.973 [2024-11-26 19:17:53.684321] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190e0630 00:31:36.974 [2024-11-26 19:17:53.684878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:6620 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.974 [2024-11-26 19:17:53.684897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:0056 p:0 m:0 dnr:0 00:31:36.974 [2024-11-26 19:17:53.693364] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190fc560 00:31:36.974 [2024-11-26 19:17:53.693889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:580 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.974 [2024-11-26 19:17:53.693908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:31:36.974 [2024-11-26 19:17:53.702079] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190ea680 00:31:36.974 [2024-11-26 19:17:53.703071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:15101 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.974 [2024-11-26 19:17:53.703091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:31:36.974 [2024-11-26 19:17:53.711514] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190ea680 00:31:36.974 [2024-11-26 19:17:53.712688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:21754 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.974 [2024-11-26 19:17:53.712707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:31:36.974 [2024-11-26 19:17:53.720515] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f0350 00:31:36.974 [2024-11-26 19:17:53.721302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:14269 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.974 [2024-11-26 19:17:53.721321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:31:36.974 [2024-11-26 19:17:53.729630] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190de470 00:31:36.974 [2024-11-26 19:17:53.730226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:20515 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.974 [2024-11-26 19:17:53.730246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0077 p:0 m:0 dnr:0 00:31:36.974 [2024-11-26 19:17:53.738402] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190fbcf0 00:31:36.974 [2024-11-26 19:17:53.738971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:3941 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.974 [2024-11-26 19:17:53.738991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0076 p:0 m:0 dnr:0 00:31:36.974 [2024-11-26 19:17:53.747193] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190ee190 00:31:36.974 [2024-11-26 19:17:53.747733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:17222 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.974 [2024-11-26 19:17:53.747752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:31:36.974 [2024-11-26 19:17:53.755981] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190fcdd0 00:31:36.974 [2024-11-26 19:17:53.756551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:11049 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.974 [2024-11-26 19:17:53.756569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0074 p:0 m:0 dnr:0 00:31:36.974 [2024-11-26 19:17:53.764785] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190de470 00:31:36.974 [2024-11-26 19:17:53.765373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:1298 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.974 [2024-11-26 19:17:53.765392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0073 p:0 m:0 dnr:0 00:31:36.974 [2024-11-26 19:17:53.773571] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f5378 00:31:36.974 [2024-11-26 19:17:53.774076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:8285 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.974 [2024-11-26 19:17:53.774095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:0072 p:0 m:0 dnr:0 00:31:36.974 [2024-11-26 19:17:53.782399] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f4f40 00:31:36.974 [2024-11-26 19:17:53.782935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:9999 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.974 [2024-11-26 19:17:53.782958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:0071 p:0 m:0 dnr:0 00:31:36.974 [2024-11-26 19:17:53.791308] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190e0630 00:31:36.974 [2024-11-26 19:17:53.791769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:13734 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.974 [2024-11-26 19:17:53.791788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0070 p:0 m:0 dnr:0 00:31:36.974 [2024-11-26 19:17:53.800113] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190fdeb0 00:31:36.974 [2024-11-26 19:17:53.800593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:16457 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.974 [2024-11-26 19:17:53.800611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:006f p:0 m:0 dnr:0 00:31:36.974 [2024-11-26 19:17:53.808927] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190ebb98 00:31:36.974 [2024-11-26 19:17:53.809349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:20262 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.974 [2024-11-26 19:17:53.809367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:006e p:0 m:0 dnr:0 00:31:36.974 [2024-11-26 19:17:53.817765] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190ecc78 00:31:36.974 [2024-11-26 19:17:53.818212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:7939 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.974 [2024-11-26 19:17:53.818230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:006d p:0 m:0 dnr:0 00:31:36.974 [2024-11-26 19:17:53.826572] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f2948 00:31:36.974 [2024-11-26 19:17:53.827069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:14768 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.974 [2024-11-26 19:17:53.827088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:31:36.974 [2024-11-26 19:17:53.835270] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f0bc0 00:31:36.974 [2024-11-26 19:17:53.836437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:7530 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.974 [2024-11-26 19:17:53.836456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:31:36.974 [2024-11-26 19:17:53.844689] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190fb8b8 00:31:36.974 [2024-11-26 19:17:53.845900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:17651 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.974 [2024-11-26 19:17:53.845919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:006d p:0 m:0 dnr:0 00:31:36.974 [2024-11-26 19:17:53.853690] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190e6738 00:31:36.974 [2024-11-26 19:17:53.854528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:15681 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.974 [2024-11-26 19:17:53.854547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:31:36.974 [2024-11-26 19:17:53.862509] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190eff18 00:31:36.974 [2024-11-26 19:17:53.863148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:18607 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.974 [2024-11-26 19:17:53.863167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:31:36.974 [2024-11-26 19:17:53.871295] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190ecc78 00:31:36.974 [2024-11-26 19:17:53.871905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:12942 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.974 [2024-11-26 19:17:53.871924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:31:36.974 [2024-11-26 19:17:53.880087] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f6458 00:31:36.974 [2024-11-26 19:17:53.880674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:227 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.974 [2024-11-26 19:17:53.880696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:31:36.974 [2024-11-26 19:17:53.888875] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190f4b08 00:31:36.974 [2024-11-26 19:17:53.889441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:18772 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:36.974 [2024-11-26 19:17:53.889460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0079 p:0 m:0 dnr:0 00:31:37.233 [2024-11-26 19:17:53.897880] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190ef270 00:31:37.233 [2024-11-26 19:17:53.898520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:7422 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:37.234 [2024-11-26 19:17:53.898540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:31:37.234 [2024-11-26 19:17:53.906801] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190e6738 00:31:37.234 [2024-11-26 19:17:53.907436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:3640 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:37.234 [2024-11-26 19:17:53.907455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0077 p:0 m:0 dnr:0 00:31:37.234 [2024-11-26 19:17:53.915737] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190ea248 00:31:37.234 [2024-11-26 19:17:53.916394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:22026 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:37.234 [2024-11-26 19:17:53.916413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:0076 p:0 m:0 dnr:0 00:31:37.234 [2024-11-26 19:17:53.924409] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53a60) with pdu=0x2000190fbcf0 00:31:37.234 [2024-11-26 19:17:53.925585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:5691 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:37.234 [2024-11-26 19:17:53.925604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0077 p:0 m:0 dnr:0 00:31:37.234 00:31:37.234 Latency(us) 00:31:37.234 [2024-11-26T18:17:54.161Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:31:37.234 [2024-11-26T18:17:54.161Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:31:37.234 nvme0n1 : 2.00 28734.27 112.24 0.00 0.00 4450.47 2222.53 10314.80 00:31:37.234 [2024-11-26T18:17:54.161Z] =================================================================================================================== 00:31:37.234 [2024-11-26T18:17:54.161Z] Total : 28734.27 112.24 0.00 0.00 4450.47 2222.53 10314.80 00:31:37.234 0 00:31:37.234 19:17:53 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:31:37.234 19:17:53 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:31:37.234 19:17:53 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:31:37.234 | .driver_specific 00:31:37.234 | .nvme_error 00:31:37.234 | .status_code 00:31:37.234 | .command_transient_transport_error' 00:31:37.234 19:17:53 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:31:37.234 19:17:54 -- host/digest.sh@71 -- # (( 225 > 0 )) 00:31:37.234 19:17:54 -- host/digest.sh@73 -- # killprocess 3288383 00:31:37.234 19:17:54 -- common/autotest_common.sh@936 -- # '[' -z 3288383 ']' 00:31:37.234 19:17:54 -- common/autotest_common.sh@940 -- # kill -0 3288383 00:31:37.234 19:17:54 -- common/autotest_common.sh@941 -- # uname 00:31:37.234 19:17:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:31:37.234 19:17:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3288383 00:31:37.492 19:17:54 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:31:37.492 19:17:54 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:31:37.492 19:17:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3288383' 00:31:37.492 killing process with pid 3288383 00:31:37.492 19:17:54 -- common/autotest_common.sh@955 -- # kill 3288383 00:31:37.492 Received shutdown signal, test time was about 2.000000 seconds 00:31:37.492 00:31:37.493 Latency(us) 00:31:37.493 [2024-11-26T18:17:54.420Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:31:37.493 [2024-11-26T18:17:54.420Z] =================================================================================================================== 00:31:37.493 [2024-11-26T18:17:54.420Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:31:37.493 19:17:54 -- common/autotest_common.sh@960 -- # wait 3288383 00:31:37.493 19:17:54 -- host/digest.sh@114 -- # run_bperf_err randwrite 131072 16 00:31:37.493 19:17:54 -- host/digest.sh@54 -- # local rw bs qd 00:31:37.493 19:17:54 -- host/digest.sh@56 -- # rw=randwrite 00:31:37.493 19:17:54 -- host/digest.sh@56 -- # bs=131072 00:31:37.493 19:17:54 -- host/digest.sh@56 -- # qd=16 00:31:37.493 19:17:54 -- host/digest.sh@58 -- # bperfpid=3289039 00:31:37.493 19:17:54 -- host/digest.sh@60 -- # waitforlisten 3289039 /var/tmp/bperf.sock 00:31:37.493 19:17:54 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z 00:31:37.493 19:17:54 -- common/autotest_common.sh@829 -- # '[' -z 3289039 ']' 00:31:37.493 19:17:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:31:37.493 19:17:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:31:37.493 19:17:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:31:37.493 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:31:37.493 19:17:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:31:37.493 19:17:54 -- common/autotest_common.sh@10 -- # set +x 00:31:37.493 [2024-11-26 19:17:54.403926] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:31:37.493 [2024-11-26 19:17:54.403982] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3289039 ] 00:31:37.493 I/O size of 131072 is greater than zero copy threshold (65536). 00:31:37.493 Zero copy mechanism will not be used. 00:31:37.751 EAL: No free 2048 kB hugepages reported on node 1 00:31:37.751 [2024-11-26 19:17:54.459817] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:31:37.751 [2024-11-26 19:17:54.498914] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:31:38.317 19:17:55 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:31:38.317 19:17:55 -- common/autotest_common.sh@862 -- # return 0 00:31:38.317 19:17:55 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:31:38.317 19:17:55 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:31:38.576 19:17:55 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:31:38.576 19:17:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:38.576 19:17:55 -- common/autotest_common.sh@10 -- # set +x 00:31:38.576 19:17:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:38.576 19:17:55 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:31:38.576 19:17:55 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:31:39.142 nvme0n1 00:31:39.142 19:17:55 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:31:39.142 19:17:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:39.142 19:17:55 -- common/autotest_common.sh@10 -- # set +x 00:31:39.142 19:17:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:39.142 19:17:55 -- host/digest.sh@69 -- # bperf_py perform_tests 00:31:39.142 19:17:55 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:31:39.142 I/O size of 131072 is greater than zero copy threshold (65536). 00:31:39.142 Zero copy mechanism will not be used. 00:31:39.142 Running I/O for 2 seconds... 00:31:39.142 [2024-11-26 19:17:55.938224] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.142 [2024-11-26 19:17:55.938592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.142 [2024-11-26 19:17:55.938620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:39.142 [2024-11-26 19:17:55.944079] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.142 [2024-11-26 19:17:55.944309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.142 [2024-11-26 19:17:55.944332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:39.142 [2024-11-26 19:17:55.949671] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.142 [2024-11-26 19:17:55.949855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.142 [2024-11-26 19:17:55.949876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:39.142 [2024-11-26 19:17:55.955592] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.142 [2024-11-26 19:17:55.955724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.142 [2024-11-26 19:17:55.955745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:39.142 [2024-11-26 19:17:55.961278] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.142 [2024-11-26 19:17:55.961410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.142 [2024-11-26 19:17:55.961429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:39.142 [2024-11-26 19:17:55.966828] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.142 [2024-11-26 19:17:55.967000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.142 [2024-11-26 19:17:55.967019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:39.142 [2024-11-26 19:17:55.972415] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.142 [2024-11-26 19:17:55.972742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.142 [2024-11-26 19:17:55.972762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:39.142 [2024-11-26 19:17:55.978216] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.142 [2024-11-26 19:17:55.978445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.142 [2024-11-26 19:17:55.978466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:39.142 [2024-11-26 19:17:55.984391] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.142 [2024-11-26 19:17:55.984550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.143 [2024-11-26 19:17:55.984569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:39.143 [2024-11-26 19:17:55.990091] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.143 [2024-11-26 19:17:55.990262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.143 [2024-11-26 19:17:55.990280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:39.143 [2024-11-26 19:17:55.995537] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.143 [2024-11-26 19:17:55.995716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.143 [2024-11-26 19:17:55.995735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:39.143 [2024-11-26 19:17:56.001380] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.143 [2024-11-26 19:17:56.001564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.143 [2024-11-26 19:17:56.001583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:39.143 [2024-11-26 19:17:56.006964] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.143 [2024-11-26 19:17:56.007138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.143 [2024-11-26 19:17:56.007156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:39.143 [2024-11-26 19:17:56.012491] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.143 [2024-11-26 19:17:56.012655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.143 [2024-11-26 19:17:56.012673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:39.143 [2024-11-26 19:17:56.018092] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.143 [2024-11-26 19:17:56.018291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.143 [2024-11-26 19:17:56.018309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:39.143 [2024-11-26 19:17:56.024207] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.143 [2024-11-26 19:17:56.024475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.143 [2024-11-26 19:17:56.024495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:39.143 [2024-11-26 19:17:56.030018] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.143 [2024-11-26 19:17:56.030126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.143 [2024-11-26 19:17:56.030148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:39.143 [2024-11-26 19:17:56.034514] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.143 [2024-11-26 19:17:56.034600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.143 [2024-11-26 19:17:56.034620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:39.143 [2024-11-26 19:17:56.039345] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.143 [2024-11-26 19:17:56.039451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.143 [2024-11-26 19:17:56.039469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:39.143 [2024-11-26 19:17:56.044008] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.143 [2024-11-26 19:17:56.044122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.143 [2024-11-26 19:17:56.044141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:39.143 [2024-11-26 19:17:56.048224] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.143 [2024-11-26 19:17:56.048357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.143 [2024-11-26 19:17:56.048375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:39.143 [2024-11-26 19:17:56.052099] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.143 [2024-11-26 19:17:56.052235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.143 [2024-11-26 19:17:56.052254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:39.143 [2024-11-26 19:17:56.056691] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.143 [2024-11-26 19:17:56.056924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.143 [2024-11-26 19:17:56.056944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:39.143 [2024-11-26 19:17:56.062044] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.143 [2024-11-26 19:17:56.062237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.143 [2024-11-26 19:17:56.062257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:39.404 [2024-11-26 19:17:56.068238] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.404 [2024-11-26 19:17:56.068408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.404 [2024-11-26 19:17:56.068427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:39.404 [2024-11-26 19:17:56.074780] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.404 [2024-11-26 19:17:56.074883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.404 [2024-11-26 19:17:56.074902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:39.404 [2024-11-26 19:17:56.081305] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.404 [2024-11-26 19:17:56.081474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.404 [2024-11-26 19:17:56.081492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:39.404 [2024-11-26 19:17:56.087975] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.404 [2024-11-26 19:17:56.088106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.404 [2024-11-26 19:17:56.088124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:39.404 [2024-11-26 19:17:56.093338] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.404 [2024-11-26 19:17:56.093414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.404 [2024-11-26 19:17:56.093433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:39.404 [2024-11-26 19:17:56.098211] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.404 [2024-11-26 19:17:56.098276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.404 [2024-11-26 19:17:56.098294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:39.404 [2024-11-26 19:17:56.102768] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.404 [2024-11-26 19:17:56.102904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.404 [2024-11-26 19:17:56.102922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:39.404 [2024-11-26 19:17:56.107388] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.404 [2024-11-26 19:17:56.107458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.404 [2024-11-26 19:17:56.107476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:39.404 [2024-11-26 19:17:56.112109] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.404 [2024-11-26 19:17:56.112274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.404 [2024-11-26 19:17:56.112294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:39.404 [2024-11-26 19:17:56.117588] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.404 [2024-11-26 19:17:56.117876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.404 [2024-11-26 19:17:56.117895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:39.404 [2024-11-26 19:17:56.122248] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.404 [2024-11-26 19:17:56.122329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.404 [2024-11-26 19:17:56.122346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:39.404 [2024-11-26 19:17:56.127144] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.404 [2024-11-26 19:17:56.127204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.404 [2024-11-26 19:17:56.127222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:39.404 [2024-11-26 19:17:56.131796] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.404 [2024-11-26 19:17:56.131893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.404 [2024-11-26 19:17:56.131911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:39.404 [2024-11-26 19:17:56.136605] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.404 [2024-11-26 19:17:56.136677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.404 [2024-11-26 19:17:56.136696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:39.405 [2024-11-26 19:17:56.142018] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.405 [2024-11-26 19:17:56.142097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.405 [2024-11-26 19:17:56.142116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:39.405 [2024-11-26 19:17:56.146646] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.405 [2024-11-26 19:17:56.146729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.405 [2024-11-26 19:17:56.146748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:39.405 [2024-11-26 19:17:56.151421] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.405 [2024-11-26 19:17:56.151655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.405 [2024-11-26 19:17:56.151675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:39.405 [2024-11-26 19:17:56.156048] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.405 [2024-11-26 19:17:56.156287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.405 [2024-11-26 19:17:56.156307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:39.405 [2024-11-26 19:17:56.160252] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.405 [2024-11-26 19:17:56.160416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.405 [2024-11-26 19:17:56.160438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:39.405 [2024-11-26 19:17:56.164278] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.405 [2024-11-26 19:17:56.164409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.405 [2024-11-26 19:17:56.164427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:39.405 [2024-11-26 19:17:56.168110] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.405 [2024-11-26 19:17:56.168182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.405 [2024-11-26 19:17:56.168200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:39.405 [2024-11-26 19:17:56.172107] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.405 [2024-11-26 19:17:56.172223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.405 [2024-11-26 19:17:56.172241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:39.405 [2024-11-26 19:17:56.176156] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.405 [2024-11-26 19:17:56.176328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.405 [2024-11-26 19:17:56.176347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:39.405 [2024-11-26 19:17:56.180492] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.405 [2024-11-26 19:17:56.180658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.405 [2024-11-26 19:17:56.180676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:39.405 [2024-11-26 19:17:56.184739] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.405 [2024-11-26 19:17:56.185000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.405 [2024-11-26 19:17:56.185020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:39.405 [2024-11-26 19:17:56.188509] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.405 [2024-11-26 19:17:56.188723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.405 [2024-11-26 19:17:56.188743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:39.405 [2024-11-26 19:17:56.192398] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.405 [2024-11-26 19:17:56.192566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.405 [2024-11-26 19:17:56.192584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:39.405 [2024-11-26 19:17:56.196329] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.405 [2024-11-26 19:17:56.196433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.405 [2024-11-26 19:17:56.196452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:39.405 [2024-11-26 19:17:56.200398] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.405 [2024-11-26 19:17:56.200588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.405 [2024-11-26 19:17:56.200608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:39.405 [2024-11-26 19:17:56.204664] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.405 [2024-11-26 19:17:56.204724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.405 [2024-11-26 19:17:56.204742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:39.405 [2024-11-26 19:17:56.209726] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.405 [2024-11-26 19:17:56.209876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.405 [2024-11-26 19:17:56.209896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:39.405 [2024-11-26 19:17:56.214762] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.405 [2024-11-26 19:17:56.214890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.405 [2024-11-26 19:17:56.214909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:39.405 [2024-11-26 19:17:56.219030] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.405 [2024-11-26 19:17:56.219271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.405 [2024-11-26 19:17:56.219290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:39.405 [2024-11-26 19:17:56.223103] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.405 [2024-11-26 19:17:56.223305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.405 [2024-11-26 19:17:56.223324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:39.405 [2024-11-26 19:17:56.227100] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.405 [2024-11-26 19:17:56.227260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.405 [2024-11-26 19:17:56.227280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:39.405 [2024-11-26 19:17:56.230898] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.405 [2024-11-26 19:17:56.230991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.405 [2024-11-26 19:17:56.231010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:39.405 [2024-11-26 19:17:56.234695] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.405 [2024-11-26 19:17:56.234771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.405 [2024-11-26 19:17:56.234790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:39.405 [2024-11-26 19:17:56.238478] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.405 [2024-11-26 19:17:56.238554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.405 [2024-11-26 19:17:56.238573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:39.405 [2024-11-26 19:17:56.242271] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.405 [2024-11-26 19:17:56.242390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.405 [2024-11-26 19:17:56.242408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:39.405 [2024-11-26 19:17:56.246074] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.405 [2024-11-26 19:17:56.246266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.405 [2024-11-26 19:17:56.246287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:39.405 [2024-11-26 19:17:56.249896] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.405 [2024-11-26 19:17:56.250109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.405 [2024-11-26 19:17:56.250129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:39.405 [2024-11-26 19:17:56.253978] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.406 [2024-11-26 19:17:56.254122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.406 [2024-11-26 19:17:56.254141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:39.406 [2024-11-26 19:17:56.259015] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.406 [2024-11-26 19:17:56.259090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.406 [2024-11-26 19:17:56.259110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:39.406 [2024-11-26 19:17:56.263410] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.406 [2024-11-26 19:17:56.263505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.406 [2024-11-26 19:17:56.263525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:39.406 [2024-11-26 19:17:56.267325] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.406 [2024-11-26 19:17:56.267399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.406 [2024-11-26 19:17:56.267421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:39.406 [2024-11-26 19:17:56.271375] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.406 [2024-11-26 19:17:56.271486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.406 [2024-11-26 19:17:56.271505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:39.406 [2024-11-26 19:17:56.275575] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.406 [2024-11-26 19:17:56.275707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.406 [2024-11-26 19:17:56.275725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:39.406 [2024-11-26 19:17:56.279528] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.406 [2024-11-26 19:17:56.279666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.406 [2024-11-26 19:17:56.279686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:39.406 [2024-11-26 19:17:56.284257] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.406 [2024-11-26 19:17:56.284427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.406 [2024-11-26 19:17:56.284446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:39.406 [2024-11-26 19:17:56.288357] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.406 [2024-11-26 19:17:56.288571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.406 [2024-11-26 19:17:56.288590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:39.406 [2024-11-26 19:17:56.293023] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.406 [2024-11-26 19:17:56.293248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.406 [2024-11-26 19:17:56.293269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:39.406 [2024-11-26 19:17:56.298270] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.406 [2024-11-26 19:17:56.298419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.406 [2024-11-26 19:17:56.298438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:39.406 [2024-11-26 19:17:56.303578] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.406 [2024-11-26 19:17:56.303741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.406 [2024-11-26 19:17:56.303759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:39.406 [2024-11-26 19:17:56.309204] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.406 [2024-11-26 19:17:56.309352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.406 [2024-11-26 19:17:56.309372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:39.406 [2024-11-26 19:17:56.314854] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.406 [2024-11-26 19:17:56.315023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.406 [2024-11-26 19:17:56.315042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:39.406 [2024-11-26 19:17:56.322018] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.406 [2024-11-26 19:17:56.322177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.406 [2024-11-26 19:17:56.322196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:39.666 [2024-11-26 19:17:56.328832] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.666 [2024-11-26 19:17:56.329002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.666 [2024-11-26 19:17:56.329021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:39.666 [2024-11-26 19:17:56.335611] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.666 [2024-11-26 19:17:56.335907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.666 [2024-11-26 19:17:56.335927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:39.666 [2024-11-26 19:17:56.341843] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.666 [2024-11-26 19:17:56.341965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.666 [2024-11-26 19:17:56.341984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:39.666 [2024-11-26 19:17:56.347784] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.666 [2024-11-26 19:17:56.347993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.666 [2024-11-26 19:17:56.348012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:39.666 [2024-11-26 19:17:56.353850] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.666 [2024-11-26 19:17:56.354053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.666 [2024-11-26 19:17:56.354072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:39.666 [2024-11-26 19:17:56.359505] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.666 [2024-11-26 19:17:56.359712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.667 [2024-11-26 19:17:56.359732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:39.667 [2024-11-26 19:17:56.365147] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.667 [2024-11-26 19:17:56.365295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.667 [2024-11-26 19:17:56.365313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:39.667 [2024-11-26 19:17:56.370625] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.667 [2024-11-26 19:17:56.370876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.667 [2024-11-26 19:17:56.370896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:39.667 [2024-11-26 19:17:56.376339] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.667 [2024-11-26 19:17:56.376501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.667 [2024-11-26 19:17:56.376520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:39.667 [2024-11-26 19:17:56.382294] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.667 [2024-11-26 19:17:56.382415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.667 [2024-11-26 19:17:56.382433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:39.667 [2024-11-26 19:17:56.386912] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.667 [2024-11-26 19:17:56.386986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.667 [2024-11-26 19:17:56.387006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:39.667 [2024-11-26 19:17:56.391488] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.667 [2024-11-26 19:17:56.391626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.667 [2024-11-26 19:17:56.391646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:39.667 [2024-11-26 19:17:56.396860] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.667 [2024-11-26 19:17:56.396936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.667 [2024-11-26 19:17:56.396961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:39.667 [2024-11-26 19:17:56.401785] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.667 [2024-11-26 19:17:56.401889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.667 [2024-11-26 19:17:56.401906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:39.667 [2024-11-26 19:17:56.406056] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.667 [2024-11-26 19:17:56.406245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.667 [2024-11-26 19:17:56.406267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:39.667 [2024-11-26 19:17:56.410148] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.667 [2024-11-26 19:17:56.410317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.667 [2024-11-26 19:17:56.410336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:39.667 [2024-11-26 19:17:56.414566] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.667 [2024-11-26 19:17:56.414716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.667 [2024-11-26 19:17:56.414735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:39.667 [2024-11-26 19:17:56.418601] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.667 [2024-11-26 19:17:56.418709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.667 [2024-11-26 19:17:56.418727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:39.667 [2024-11-26 19:17:56.422549] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.667 [2024-11-26 19:17:56.422628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.667 [2024-11-26 19:17:56.422647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:39.667 [2024-11-26 19:17:56.427469] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.667 [2024-11-26 19:17:56.427567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:64 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.667 [2024-11-26 19:17:56.427585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:39.667 [2024-11-26 19:17:56.431942] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.667 [2024-11-26 19:17:56.432090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.667 [2024-11-26 19:17:56.432110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:39.667 [2024-11-26 19:17:56.436051] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.667 [2024-11-26 19:17:56.436165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.667 [2024-11-26 19:17:56.436184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:39.667 [2024-11-26 19:17:56.440836] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.667 [2024-11-26 19:17:56.441039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.667 [2024-11-26 19:17:56.441059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:39.667 [2024-11-26 19:17:56.445032] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.667 [2024-11-26 19:17:56.445264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.667 [2024-11-26 19:17:56.445284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:39.667 [2024-11-26 19:17:56.449147] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.667 [2024-11-26 19:17:56.449317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.667 [2024-11-26 19:17:56.449338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:39.667 [2024-11-26 19:17:56.452992] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.667 [2024-11-26 19:17:56.453095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.667 [2024-11-26 19:17:56.453114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:39.667 [2024-11-26 19:17:56.456799] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.667 [2024-11-26 19:17:56.456885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.667 [2024-11-26 19:17:56.456914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:39.667 [2024-11-26 19:17:56.460385] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.667 [2024-11-26 19:17:56.460469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.667 [2024-11-26 19:17:56.460487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:39.667 [2024-11-26 19:17:56.464017] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.667 [2024-11-26 19:17:56.464098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.667 [2024-11-26 19:17:56.464116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:39.667 [2024-11-26 19:17:56.467614] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.667 [2024-11-26 19:17:56.467733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.667 [2024-11-26 19:17:56.467751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:39.667 [2024-11-26 19:17:56.471272] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.667 [2024-11-26 19:17:56.471472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.667 [2024-11-26 19:17:56.471493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:39.667 [2024-11-26 19:17:56.474871] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.667 [2024-11-26 19:17:56.475089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.667 [2024-11-26 19:17:56.475109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:39.667 [2024-11-26 19:17:56.478837] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.667 [2024-11-26 19:17:56.478906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.668 [2024-11-26 19:17:56.478924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:39.668 [2024-11-26 19:17:56.484221] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.668 [2024-11-26 19:17:56.484281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.668 [2024-11-26 19:17:56.484300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:39.668 [2024-11-26 19:17:56.489360] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.668 [2024-11-26 19:17:56.489467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.668 [2024-11-26 19:17:56.489485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:39.668 [2024-11-26 19:17:56.494406] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.668 [2024-11-26 19:17:56.494474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.668 [2024-11-26 19:17:56.494493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:39.668 [2024-11-26 19:17:56.499660] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.668 [2024-11-26 19:17:56.499778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.668 [2024-11-26 19:17:56.499797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:39.668 [2024-11-26 19:17:56.504024] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.668 [2024-11-26 19:17:56.504143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.668 [2024-11-26 19:17:56.504163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:39.668 [2024-11-26 19:17:56.508809] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.668 [2024-11-26 19:17:56.509066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.668 [2024-11-26 19:17:56.509087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:39.668 [2024-11-26 19:17:56.513474] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.668 [2024-11-26 19:17:56.513714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.668 [2024-11-26 19:17:56.513733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:39.668 [2024-11-26 19:17:56.519237] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.668 [2024-11-26 19:17:56.519377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.668 [2024-11-26 19:17:56.519399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:39.668 [2024-11-26 19:17:56.524587] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.668 [2024-11-26 19:17:56.524725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.668 [2024-11-26 19:17:56.524744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:39.668 [2024-11-26 19:17:56.531590] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.668 [2024-11-26 19:17:56.531757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.668 [2024-11-26 19:17:56.531776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:39.668 [2024-11-26 19:17:56.538009] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.668 [2024-11-26 19:17:56.538124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.668 [2024-11-26 19:17:56.538143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:39.668 [2024-11-26 19:17:56.544374] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.668 [2024-11-26 19:17:56.544561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.668 [2024-11-26 19:17:56.544579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:39.668 [2024-11-26 19:17:56.550351] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.668 [2024-11-26 19:17:56.550470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.668 [2024-11-26 19:17:56.550489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:39.668 [2024-11-26 19:17:56.556868] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.668 [2024-11-26 19:17:56.557165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.668 [2024-11-26 19:17:56.557185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:39.668 [2024-11-26 19:17:56.563114] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.668 [2024-11-26 19:17:56.563218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.668 [2024-11-26 19:17:56.563236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:39.668 [2024-11-26 19:17:56.568706] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.668 [2024-11-26 19:17:56.568807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.668 [2024-11-26 19:17:56.568825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:39.668 [2024-11-26 19:17:56.573727] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.668 [2024-11-26 19:17:56.573830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.668 [2024-11-26 19:17:56.573849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:39.668 [2024-11-26 19:17:56.577537] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.668 [2024-11-26 19:17:56.577638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.668 [2024-11-26 19:17:56.577656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:39.668 [2024-11-26 19:17:56.581264] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.668 [2024-11-26 19:17:56.581343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.668 [2024-11-26 19:17:56.581362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:39.668 [2024-11-26 19:17:56.585008] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.668 [2024-11-26 19:17:56.585173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.668 [2024-11-26 19:17:56.585194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:39.668 [2024-11-26 19:17:56.588747] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.668 [2024-11-26 19:17:56.588911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.668 [2024-11-26 19:17:56.588930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:39.928 [2024-11-26 19:17:56.592545] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.928 [2024-11-26 19:17:56.592793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.928 [2024-11-26 19:17:56.592813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:39.928 [2024-11-26 19:17:56.596306] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.928 [2024-11-26 19:17:56.596514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.929 [2024-11-26 19:17:56.596534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:39.929 [2024-11-26 19:17:56.600018] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.929 [2024-11-26 19:17:56.600136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.929 [2024-11-26 19:17:56.600155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:39.929 [2024-11-26 19:17:56.603645] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.929 [2024-11-26 19:17:56.603768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.929 [2024-11-26 19:17:56.603786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:39.929 [2024-11-26 19:17:56.607268] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.929 [2024-11-26 19:17:56.607337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.929 [2024-11-26 19:17:56.607356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:39.929 [2024-11-26 19:17:56.610904] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.929 [2024-11-26 19:17:56.611004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.929 [2024-11-26 19:17:56.611023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:39.929 [2024-11-26 19:17:56.614589] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.929 [2024-11-26 19:17:56.614744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.929 [2024-11-26 19:17:56.614762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:39.929 [2024-11-26 19:17:56.618225] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.929 [2024-11-26 19:17:56.618402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.929 [2024-11-26 19:17:56.618422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:39.929 [2024-11-26 19:17:56.621967] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.929 [2024-11-26 19:17:56.622214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.929 [2024-11-26 19:17:56.622234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:39.929 [2024-11-26 19:17:56.625603] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.929 [2024-11-26 19:17:56.625830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.929 [2024-11-26 19:17:56.625850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:39.929 [2024-11-26 19:17:56.629221] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.929 [2024-11-26 19:17:56.629321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.929 [2024-11-26 19:17:56.629340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:39.929 [2024-11-26 19:17:56.633027] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.929 [2024-11-26 19:17:56.633104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.929 [2024-11-26 19:17:56.633123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:39.929 [2024-11-26 19:17:56.637487] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.929 [2024-11-26 19:17:56.637544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.929 [2024-11-26 19:17:56.637566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:39.929 [2024-11-26 19:17:56.642532] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.929 [2024-11-26 19:17:56.642589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.929 [2024-11-26 19:17:56.642608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:39.929 [2024-11-26 19:17:56.647358] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.929 [2024-11-26 19:17:56.647496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.929 [2024-11-26 19:17:56.647515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:39.929 [2024-11-26 19:17:56.652343] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.929 [2024-11-26 19:17:56.652438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.929 [2024-11-26 19:17:56.652457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:39.929 [2024-11-26 19:17:56.657643] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.929 [2024-11-26 19:17:56.657880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.929 [2024-11-26 19:17:56.657901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:39.929 [2024-11-26 19:17:56.662539] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.929 [2024-11-26 19:17:56.662759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.929 [2024-11-26 19:17:56.662779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:39.929 [2024-11-26 19:17:56.667170] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.929 [2024-11-26 19:17:56.667317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.929 [2024-11-26 19:17:56.667335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:39.929 [2024-11-26 19:17:56.671719] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.929 [2024-11-26 19:17:56.671791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.929 [2024-11-26 19:17:56.671810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:39.929 [2024-11-26 19:17:56.677035] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.929 [2024-11-26 19:17:56.677114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.929 [2024-11-26 19:17:56.677133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:39.929 [2024-11-26 19:17:56.681856] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.929 [2024-11-26 19:17:56.681927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.929 [2024-11-26 19:17:56.681952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:39.929 [2024-11-26 19:17:56.686413] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.929 [2024-11-26 19:17:56.686565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.929 [2024-11-26 19:17:56.686583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:39.929 [2024-11-26 19:17:56.691069] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.929 [2024-11-26 19:17:56.691188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.929 [2024-11-26 19:17:56.691206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:39.929 [2024-11-26 19:17:56.696378] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.929 [2024-11-26 19:17:56.696613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.929 [2024-11-26 19:17:56.696634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:39.929 [2024-11-26 19:17:56.701355] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.929 [2024-11-26 19:17:56.701566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.929 [2024-11-26 19:17:56.701587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:39.929 [2024-11-26 19:17:56.706223] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.929 [2024-11-26 19:17:56.706370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.929 [2024-11-26 19:17:56.706389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:39.929 [2024-11-26 19:17:56.711698] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.929 [2024-11-26 19:17:56.711780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.929 [2024-11-26 19:17:56.711800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:39.930 [2024-11-26 19:17:56.716608] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.930 [2024-11-26 19:17:56.716670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.930 [2024-11-26 19:17:56.716689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:39.930 [2024-11-26 19:17:56.721282] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.930 [2024-11-26 19:17:56.721354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.930 [2024-11-26 19:17:56.721374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:39.930 [2024-11-26 19:17:56.726183] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.930 [2024-11-26 19:17:56.726336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.930 [2024-11-26 19:17:56.726355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:39.930 [2024-11-26 19:17:56.731061] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.930 [2024-11-26 19:17:56.731132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.930 [2024-11-26 19:17:56.731151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:39.930 [2024-11-26 19:17:56.735540] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.930 [2024-11-26 19:17:56.735692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.930 [2024-11-26 19:17:56.735711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:39.930 [2024-11-26 19:17:56.739653] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.930 [2024-11-26 19:17:56.739921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.930 [2024-11-26 19:17:56.739941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:39.930 [2024-11-26 19:17:56.743552] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.930 [2024-11-26 19:17:56.743630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.930 [2024-11-26 19:17:56.743649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:39.930 [2024-11-26 19:17:56.747642] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.930 [2024-11-26 19:17:56.747761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.930 [2024-11-26 19:17:56.747779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:39.930 [2024-11-26 19:17:56.751683] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.930 [2024-11-26 19:17:56.751815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.930 [2024-11-26 19:17:56.751832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:39.930 [2024-11-26 19:17:56.755710] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.930 [2024-11-26 19:17:56.755775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.930 [2024-11-26 19:17:56.755794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:39.930 [2024-11-26 19:17:56.759824] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.930 [2024-11-26 19:17:56.759995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.930 [2024-11-26 19:17:56.760018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:39.930 [2024-11-26 19:17:56.763784] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.930 [2024-11-26 19:17:56.763912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.930 [2024-11-26 19:17:56.763930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:39.930 [2024-11-26 19:17:56.768052] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.930 [2024-11-26 19:17:56.768293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.930 [2024-11-26 19:17:56.768313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:39.930 [2024-11-26 19:17:56.772989] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.930 [2024-11-26 19:17:56.773206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.930 [2024-11-26 19:17:56.773226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:39.930 [2024-11-26 19:17:56.777426] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.930 [2024-11-26 19:17:56.777572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.930 [2024-11-26 19:17:56.777589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:39.930 [2024-11-26 19:17:56.781461] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.930 [2024-11-26 19:17:56.781577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.930 [2024-11-26 19:17:56.781596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:39.930 [2024-11-26 19:17:56.785817] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.930 [2024-11-26 19:17:56.785875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.930 [2024-11-26 19:17:56.785894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:39.930 [2024-11-26 19:17:56.789900] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.930 [2024-11-26 19:17:56.789973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.930 [2024-11-26 19:17:56.789992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:39.930 [2024-11-26 19:17:56.793997] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.930 [2024-11-26 19:17:56.794149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.930 [2024-11-26 19:17:56.794168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:39.930 [2024-11-26 19:17:56.798053] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.930 [2024-11-26 19:17:56.798193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.930 [2024-11-26 19:17:56.798211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:39.930 [2024-11-26 19:17:56.802153] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.930 [2024-11-26 19:17:56.802377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.930 [2024-11-26 19:17:56.802398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:39.930 [2024-11-26 19:17:56.806140] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.930 [2024-11-26 19:17:56.806287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.930 [2024-11-26 19:17:56.806306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:39.930 [2024-11-26 19:17:56.810236] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.930 [2024-11-26 19:17:56.810393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.930 [2024-11-26 19:17:56.810412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:39.930 [2024-11-26 19:17:56.814223] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.930 [2024-11-26 19:17:56.814322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.930 [2024-11-26 19:17:56.814341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:39.930 [2024-11-26 19:17:56.818087] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.930 [2024-11-26 19:17:56.818147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.930 [2024-11-26 19:17:56.818166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:39.930 [2024-11-26 19:17:56.822202] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.930 [2024-11-26 19:17:56.822261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.930 [2024-11-26 19:17:56.822279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:39.930 [2024-11-26 19:17:56.827499] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.930 [2024-11-26 19:17:56.827650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.930 [2024-11-26 19:17:56.827668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:39.930 [2024-11-26 19:17:56.831645] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.931 [2024-11-26 19:17:56.831761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.931 [2024-11-26 19:17:56.831779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:39.931 [2024-11-26 19:17:56.835859] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.931 [2024-11-26 19:17:56.836089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.931 [2024-11-26 19:17:56.836109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:39.931 [2024-11-26 19:17:56.840113] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.931 [2024-11-26 19:17:56.840367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.931 [2024-11-26 19:17:56.840388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:39.931 [2024-11-26 19:17:56.843979] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.931 [2024-11-26 19:17:56.844058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.931 [2024-11-26 19:17:56.844077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:39.931 [2024-11-26 19:17:56.848141] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:39.931 [2024-11-26 19:17:56.848262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:39.931 [2024-11-26 19:17:56.848282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:40.191 [2024-11-26 19:17:56.853170] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.191 [2024-11-26 19:17:56.853237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.191 [2024-11-26 19:17:56.853261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:40.191 [2024-11-26 19:17:56.857934] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.191 [2024-11-26 19:17:56.858002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.191 [2024-11-26 19:17:56.858021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:40.191 [2024-11-26 19:17:56.862066] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.191 [2024-11-26 19:17:56.862232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.191 [2024-11-26 19:17:56.862250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:40.191 [2024-11-26 19:17:56.866054] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.191 [2024-11-26 19:17:56.866168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.191 [2024-11-26 19:17:56.866186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:40.191 [2024-11-26 19:17:56.869990] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.191 [2024-11-26 19:17:56.870239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.191 [2024-11-26 19:17:56.870265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:40.191 [2024-11-26 19:17:56.873964] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.191 [2024-11-26 19:17:56.874203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.191 [2024-11-26 19:17:56.874223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:40.191 [2024-11-26 19:17:56.878352] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.191 [2024-11-26 19:17:56.878515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.191 [2024-11-26 19:17:56.878534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:40.191 [2024-11-26 19:17:56.883421] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.191 [2024-11-26 19:17:56.883537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:32 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.191 [2024-11-26 19:17:56.883555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:40.191 [2024-11-26 19:17:56.887662] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.191 [2024-11-26 19:17:56.887758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.191 [2024-11-26 19:17:56.887776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:40.191 [2024-11-26 19:17:56.891630] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.191 [2024-11-26 19:17:56.891740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.191 [2024-11-26 19:17:56.891759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:40.191 [2024-11-26 19:17:56.895551] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.191 [2024-11-26 19:17:56.895710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.191 [2024-11-26 19:17:56.895728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:40.191 [2024-11-26 19:17:56.899196] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.191 [2024-11-26 19:17:56.899362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.191 [2024-11-26 19:17:56.899382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:40.191 [2024-11-26 19:17:56.902892] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.191 [2024-11-26 19:17:56.903149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.191 [2024-11-26 19:17:56.903169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:40.191 [2024-11-26 19:17:56.906557] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.191 [2024-11-26 19:17:56.906765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.191 [2024-11-26 19:17:56.906785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:40.191 [2024-11-26 19:17:56.910235] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.191 [2024-11-26 19:17:56.910378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.191 [2024-11-26 19:17:56.910396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:40.191 [2024-11-26 19:17:56.913983] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.191 [2024-11-26 19:17:56.914050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.191 [2024-11-26 19:17:56.914069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:40.191 [2024-11-26 19:17:56.917968] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.191 [2024-11-26 19:17:56.918039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.191 [2024-11-26 19:17:56.918057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:40.191 [2024-11-26 19:17:56.921596] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.191 [2024-11-26 19:17:56.921677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.191 [2024-11-26 19:17:56.921695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:40.191 [2024-11-26 19:17:56.925240] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.191 [2024-11-26 19:17:56.925402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.191 [2024-11-26 19:17:56.925420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:40.191 [2024-11-26 19:17:56.928901] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.191 [2024-11-26 19:17:56.929042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.191 [2024-11-26 19:17:56.929061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:40.191 [2024-11-26 19:17:56.933159] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.191 [2024-11-26 19:17:56.933404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.191 [2024-11-26 19:17:56.933423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:40.191 [2024-11-26 19:17:56.936834] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.191 [2024-11-26 19:17:56.937089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.191 [2024-11-26 19:17:56.937108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:40.191 [2024-11-26 19:17:56.940558] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.191 [2024-11-26 19:17:56.940698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.191 [2024-11-26 19:17:56.940717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:40.191 [2024-11-26 19:17:56.944341] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.191 [2024-11-26 19:17:56.944484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.191 [2024-11-26 19:17:56.944506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:40.191 [2024-11-26 19:17:56.948349] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.191 [2024-11-26 19:17:56.948412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.191 [2024-11-26 19:17:56.948431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:40.191 [2024-11-26 19:17:56.953299] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.192 [2024-11-26 19:17:56.953361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.192 [2024-11-26 19:17:56.953381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:40.192 [2024-11-26 19:17:56.958515] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.192 [2024-11-26 19:17:56.958706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.192 [2024-11-26 19:17:56.958724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:40.192 [2024-11-26 19:17:56.964329] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.192 [2024-11-26 19:17:56.964534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.192 [2024-11-26 19:17:56.964554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:40.192 [2024-11-26 19:17:56.970323] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.192 [2024-11-26 19:17:56.970486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.192 [2024-11-26 19:17:56.970505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:40.192 [2024-11-26 19:17:56.975342] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.192 [2024-11-26 19:17:56.975505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.192 [2024-11-26 19:17:56.975523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:40.192 [2024-11-26 19:17:56.979400] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.192 [2024-11-26 19:17:56.979495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.192 [2024-11-26 19:17:56.979518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:40.192 [2024-11-26 19:17:56.984226] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.192 [2024-11-26 19:17:56.984443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.192 [2024-11-26 19:17:56.984463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:40.192 [2024-11-26 19:17:56.989537] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.192 [2024-11-26 19:17:56.989829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.192 [2024-11-26 19:17:56.989848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:40.192 [2024-11-26 19:17:56.994056] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.192 [2024-11-26 19:17:56.994207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.192 [2024-11-26 19:17:56.994227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:40.192 [2024-11-26 19:17:56.998487] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.192 [2024-11-26 19:17:56.998762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.192 [2024-11-26 19:17:56.998782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:40.192 [2024-11-26 19:17:57.002885] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.192 [2024-11-26 19:17:57.003141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.192 [2024-11-26 19:17:57.003161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:40.192 [2024-11-26 19:17:57.007260] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.192 [2024-11-26 19:17:57.007351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.192 [2024-11-26 19:17:57.007369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:40.192 [2024-11-26 19:17:57.011714] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.192 [2024-11-26 19:17:57.011850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.192 [2024-11-26 19:17:57.011869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:40.192 [2024-11-26 19:17:57.015968] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.192 [2024-11-26 19:17:57.016081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.192 [2024-11-26 19:17:57.016101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:40.192 [2024-11-26 19:17:57.019962] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.192 [2024-11-26 19:17:57.020037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.192 [2024-11-26 19:17:57.020055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:40.192 [2024-11-26 19:17:57.024115] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.192 [2024-11-26 19:17:57.024323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.192 [2024-11-26 19:17:57.024343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:40.192 [2024-11-26 19:17:57.028970] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.192 [2024-11-26 19:17:57.029203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.192 [2024-11-26 19:17:57.029223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:40.192 [2024-11-26 19:17:57.034357] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.192 [2024-11-26 19:17:57.034690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.192 [2024-11-26 19:17:57.034710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:40.192 [2024-11-26 19:17:57.039660] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.192 [2024-11-26 19:17:57.039818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.192 [2024-11-26 19:17:57.039837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:40.192 [2024-11-26 19:17:57.046032] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.192 [2024-11-26 19:17:57.046214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.192 [2024-11-26 19:17:57.046232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:40.192 [2024-11-26 19:17:57.052620] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.192 [2024-11-26 19:17:57.052708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.192 [2024-11-26 19:17:57.052726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:40.192 [2024-11-26 19:17:57.058712] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.192 [2024-11-26 19:17:57.058886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.192 [2024-11-26 19:17:57.058905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:40.192 [2024-11-26 19:17:57.065305] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.192 [2024-11-26 19:17:57.065474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.192 [2024-11-26 19:17:57.065493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:40.192 [2024-11-26 19:17:57.071761] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.192 [2024-11-26 19:17:57.071998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.192 [2024-11-26 19:17:57.072018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:40.192 [2024-11-26 19:17:57.078171] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.192 [2024-11-26 19:17:57.078342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.192 [2024-11-26 19:17:57.078360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:40.192 [2024-11-26 19:17:57.084292] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.192 [2024-11-26 19:17:57.084438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.192 [2024-11-26 19:17:57.084457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:40.192 [2024-11-26 19:17:57.091309] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.192 [2024-11-26 19:17:57.091464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.192 [2024-11-26 19:17:57.091482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:40.193 [2024-11-26 19:17:57.095864] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.193 [2024-11-26 19:17:57.095940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.193 [2024-11-26 19:17:57.095964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:40.193 [2024-11-26 19:17:57.100136] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.193 [2024-11-26 19:17:57.100203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.193 [2024-11-26 19:17:57.100222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:40.193 [2024-11-26 19:17:57.104317] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.193 [2024-11-26 19:17:57.104411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.193 [2024-11-26 19:17:57.104431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:40.193 [2024-11-26 19:17:57.108285] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.193 [2024-11-26 19:17:57.108393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.193 [2024-11-26 19:17:57.108412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:40.193 [2024-11-26 19:17:57.112268] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.193 [2024-11-26 19:17:57.112366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.193 [2024-11-26 19:17:57.112389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:40.452 [2024-11-26 19:17:57.116346] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.452 [2024-11-26 19:17:57.116565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.452 [2024-11-26 19:17:57.116585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:40.452 [2024-11-26 19:17:57.120309] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.452 [2024-11-26 19:17:57.120473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.452 [2024-11-26 19:17:57.120493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:40.452 [2024-11-26 19:17:57.124159] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.452 [2024-11-26 19:17:57.124288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.452 [2024-11-26 19:17:57.124306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:40.452 [2024-11-26 19:17:57.127982] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.452 [2024-11-26 19:17:57.128082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.452 [2024-11-26 19:17:57.128100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:40.452 [2024-11-26 19:17:57.131798] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.452 [2024-11-26 19:17:57.131881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.453 [2024-11-26 19:17:57.131900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:40.453 [2024-11-26 19:17:57.136258] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.453 [2024-11-26 19:17:57.136417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.453 [2024-11-26 19:17:57.136435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:40.453 [2024-11-26 19:17:57.140985] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.453 [2024-11-26 19:17:57.141114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.453 [2024-11-26 19:17:57.141132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:40.453 [2024-11-26 19:17:57.145392] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.453 [2024-11-26 19:17:57.145651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.453 [2024-11-26 19:17:57.145671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:40.453 [2024-11-26 19:17:57.149529] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.453 [2024-11-26 19:17:57.149764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.453 [2024-11-26 19:17:57.149784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:40.453 [2024-11-26 19:17:57.153843] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.453 [2024-11-26 19:17:57.154005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.453 [2024-11-26 19:17:57.154024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:40.453 [2024-11-26 19:17:57.157908] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.453 [2024-11-26 19:17:57.157991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.453 [2024-11-26 19:17:57.158009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:40.453 [2024-11-26 19:17:57.161983] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.453 [2024-11-26 19:17:57.162049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.453 [2024-11-26 19:17:57.162067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:40.453 [2024-11-26 19:17:57.166056] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.453 [2024-11-26 19:17:57.166173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.453 [2024-11-26 19:17:57.166192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:40.453 [2024-11-26 19:17:57.170116] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.453 [2024-11-26 19:17:57.170269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.453 [2024-11-26 19:17:57.170287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:40.453 [2024-11-26 19:17:57.174677] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.453 [2024-11-26 19:17:57.174823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.453 [2024-11-26 19:17:57.174841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:40.453 [2024-11-26 19:17:57.178828] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.453 [2024-11-26 19:17:57.179064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.453 [2024-11-26 19:17:57.179083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:40.453 [2024-11-26 19:17:57.183080] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.453 [2024-11-26 19:17:57.183350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.453 [2024-11-26 19:17:57.183369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:40.453 [2024-11-26 19:17:57.187066] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.453 [2024-11-26 19:17:57.187175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.453 [2024-11-26 19:17:57.187194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:40.453 [2024-11-26 19:17:57.191269] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.453 [2024-11-26 19:17:57.191357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.453 [2024-11-26 19:17:57.191376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:40.453 [2024-11-26 19:17:57.195417] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.453 [2024-11-26 19:17:57.195509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.453 [2024-11-26 19:17:57.195528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:40.453 [2024-11-26 19:17:57.199428] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.453 [2024-11-26 19:17:57.199507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.453 [2024-11-26 19:17:57.199526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:40.453 [2024-11-26 19:17:57.203462] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.453 [2024-11-26 19:17:57.203623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.453 [2024-11-26 19:17:57.203642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:40.453 [2024-11-26 19:17:57.207432] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.453 [2024-11-26 19:17:57.207594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.453 [2024-11-26 19:17:57.207614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:40.453 [2024-11-26 19:17:57.211302] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.453 [2024-11-26 19:17:57.211557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.453 [2024-11-26 19:17:57.211578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:40.453 [2024-11-26 19:17:57.215018] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.453 [2024-11-26 19:17:57.215250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.453 [2024-11-26 19:17:57.215270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:40.453 [2024-11-26 19:17:57.218651] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.453 [2024-11-26 19:17:57.218753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.453 [2024-11-26 19:17:57.218775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:40.453 [2024-11-26 19:17:57.222350] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.453 [2024-11-26 19:17:57.222479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.453 [2024-11-26 19:17:57.222496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:40.453 [2024-11-26 19:17:57.226018] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.453 [2024-11-26 19:17:57.226094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.453 [2024-11-26 19:17:57.226112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:40.453 [2024-11-26 19:17:57.229709] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.453 [2024-11-26 19:17:57.229789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.453 [2024-11-26 19:17:57.229808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:40.453 [2024-11-26 19:17:57.233415] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.453 [2024-11-26 19:17:57.233578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.453 [2024-11-26 19:17:57.233597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:40.453 [2024-11-26 19:17:57.237034] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.453 [2024-11-26 19:17:57.237209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.453 [2024-11-26 19:17:57.237227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:40.453 [2024-11-26 19:17:57.240790] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.454 [2024-11-26 19:17:57.241044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.454 [2024-11-26 19:17:57.241063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:40.454 [2024-11-26 19:17:57.244871] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.454 [2024-11-26 19:17:57.245168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.454 [2024-11-26 19:17:57.245188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:40.454 [2024-11-26 19:17:57.249878] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.454 [2024-11-26 19:17:57.250070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.454 [2024-11-26 19:17:57.250088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:40.454 [2024-11-26 19:17:57.255039] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.454 [2024-11-26 19:17:57.255207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.454 [2024-11-26 19:17:57.255225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:40.454 [2024-11-26 19:17:57.260110] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.454 [2024-11-26 19:17:57.260268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.454 [2024-11-26 19:17:57.260287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:40.454 [2024-11-26 19:17:57.266064] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.454 [2024-11-26 19:17:57.266185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.454 [2024-11-26 19:17:57.266205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:40.454 [2024-11-26 19:17:57.272432] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.454 [2024-11-26 19:17:57.272605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:32 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.454 [2024-11-26 19:17:57.272624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:40.454 [2024-11-26 19:17:57.278904] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.454 [2024-11-26 19:17:57.279151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.454 [2024-11-26 19:17:57.279172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:40.454 [2024-11-26 19:17:57.285209] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.454 [2024-11-26 19:17:57.285450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.454 [2024-11-26 19:17:57.285470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:40.454 [2024-11-26 19:17:57.291187] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.454 [2024-11-26 19:17:57.291364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.454 [2024-11-26 19:17:57.291382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:40.454 [2024-11-26 19:17:57.297954] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.454 [2024-11-26 19:17:57.298094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.454 [2024-11-26 19:17:57.298112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:40.454 [2024-11-26 19:17:57.303894] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.454 [2024-11-26 19:17:57.304059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.454 [2024-11-26 19:17:57.304078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:40.454 [2024-11-26 19:17:57.310590] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.454 [2024-11-26 19:17:57.310769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.454 [2024-11-26 19:17:57.310787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:40.454 [2024-11-26 19:17:57.316760] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.454 [2024-11-26 19:17:57.316909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.454 [2024-11-26 19:17:57.316928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:40.454 [2024-11-26 19:17:57.323018] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.454 [2024-11-26 19:17:57.323155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.454 [2024-11-26 19:17:57.323173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:40.454 [2024-11-26 19:17:57.329139] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.454 [2024-11-26 19:17:57.329256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.454 [2024-11-26 19:17:57.329275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:40.454 [2024-11-26 19:17:57.336351] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.454 [2024-11-26 19:17:57.336515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.454 [2024-11-26 19:17:57.336534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:40.454 [2024-11-26 19:17:57.342336] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.454 [2024-11-26 19:17:57.342569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.454 [2024-11-26 19:17:57.342589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:40.454 [2024-11-26 19:17:57.346918] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.454 [2024-11-26 19:17:57.347115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.454 [2024-11-26 19:17:57.347142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:40.454 [2024-11-26 19:17:57.351549] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.454 [2024-11-26 19:17:57.351712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.454 [2024-11-26 19:17:57.351730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:40.454 [2024-11-26 19:17:57.355616] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.454 [2024-11-26 19:17:57.355720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.454 [2024-11-26 19:17:57.355742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:40.454 [2024-11-26 19:17:57.359517] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.454 [2024-11-26 19:17:57.359590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.454 [2024-11-26 19:17:57.359608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:40.454 [2024-11-26 19:17:57.363439] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.454 [2024-11-26 19:17:57.363530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.454 [2024-11-26 19:17:57.363548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:40.454 [2024-11-26 19:17:57.367554] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.454 [2024-11-26 19:17:57.367727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.454 [2024-11-26 19:17:57.367746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:40.454 [2024-11-26 19:17:57.371781] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.454 [2024-11-26 19:17:57.371937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.454 [2024-11-26 19:17:57.371961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:40.714 [2024-11-26 19:17:57.376004] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.714 [2024-11-26 19:17:57.376235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.714 [2024-11-26 19:17:57.376255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:40.714 [2024-11-26 19:17:57.379936] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.714 [2024-11-26 19:17:57.380154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.714 [2024-11-26 19:17:57.380172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:40.714 [2024-11-26 19:17:57.383763] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.714 [2024-11-26 19:17:57.383851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.714 [2024-11-26 19:17:57.383870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:40.714 [2024-11-26 19:17:57.387602] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.714 [2024-11-26 19:17:57.387704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.714 [2024-11-26 19:17:57.387722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:40.714 [2024-11-26 19:17:57.391590] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.714 [2024-11-26 19:17:57.391695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.714 [2024-11-26 19:17:57.391715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:40.714 [2024-11-26 19:17:57.396862] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.714 [2024-11-26 19:17:57.396985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:64 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.714 [2024-11-26 19:17:57.397003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:40.714 [2024-11-26 19:17:57.402898] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.714 [2024-11-26 19:17:57.403104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.714 [2024-11-26 19:17:57.403124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:40.714 [2024-11-26 19:17:57.408527] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.714 [2024-11-26 19:17:57.408699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.714 [2024-11-26 19:17:57.408718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:40.714 [2024-11-26 19:17:57.415044] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.714 [2024-11-26 19:17:57.415321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.714 [2024-11-26 19:17:57.415342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:40.714 [2024-11-26 19:17:57.419689] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.714 [2024-11-26 19:17:57.419944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.714 [2024-11-26 19:17:57.419971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:40.714 [2024-11-26 19:17:57.423864] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.714 [2024-11-26 19:17:57.424015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.714 [2024-11-26 19:17:57.424034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:40.714 [2024-11-26 19:17:57.427874] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.714 [2024-11-26 19:17:57.427976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.715 [2024-11-26 19:17:57.427994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:40.715 [2024-11-26 19:17:57.431868] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.715 [2024-11-26 19:17:57.431938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.715 [2024-11-26 19:17:57.431962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:40.715 [2024-11-26 19:17:57.435918] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.715 [2024-11-26 19:17:57.435993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.715 [2024-11-26 19:17:57.436012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:40.715 [2024-11-26 19:17:57.440025] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.715 [2024-11-26 19:17:57.440173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.715 [2024-11-26 19:17:57.440200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:40.715 [2024-11-26 19:17:57.444046] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.715 [2024-11-26 19:17:57.444151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.715 [2024-11-26 19:17:57.444170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:40.715 [2024-11-26 19:17:57.448454] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.715 [2024-11-26 19:17:57.448699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.715 [2024-11-26 19:17:57.448719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:40.715 [2024-11-26 19:17:57.453459] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.715 [2024-11-26 19:17:57.453733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.715 [2024-11-26 19:17:57.453753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:40.715 [2024-11-26 19:17:57.457827] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.715 [2024-11-26 19:17:57.457991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.715 [2024-11-26 19:17:57.458010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:40.715 [2024-11-26 19:17:57.461917] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.715 [2024-11-26 19:17:57.462055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.715 [2024-11-26 19:17:57.462073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:40.715 [2024-11-26 19:17:57.466255] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.715 [2024-11-26 19:17:57.466333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.715 [2024-11-26 19:17:57.466352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:40.715 [2024-11-26 19:17:57.470079] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.715 [2024-11-26 19:17:57.470203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.715 [2024-11-26 19:17:57.470226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:40.715 [2024-11-26 19:17:57.473926] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.715 [2024-11-26 19:17:57.474105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.715 [2024-11-26 19:17:57.474124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:40.715 [2024-11-26 19:17:57.478148] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.715 [2024-11-26 19:17:57.478318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.715 [2024-11-26 19:17:57.478339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:40.715 [2024-11-26 19:17:57.483244] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.715 [2024-11-26 19:17:57.483575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.715 [2024-11-26 19:17:57.483594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:40.715 [2024-11-26 19:17:57.488511] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.715 [2024-11-26 19:17:57.488629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.715 [2024-11-26 19:17:57.488648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:40.715 [2024-11-26 19:17:57.495072] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.715 [2024-11-26 19:17:57.495305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.715 [2024-11-26 19:17:57.495325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:40.715 [2024-11-26 19:17:57.500823] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.715 [2024-11-26 19:17:57.500990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.715 [2024-11-26 19:17:57.501009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:40.715 [2024-11-26 19:17:57.507285] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.715 [2024-11-26 19:17:57.507446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.715 [2024-11-26 19:17:57.507465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:40.715 [2024-11-26 19:17:57.513805] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.715 [2024-11-26 19:17:57.513962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.715 [2024-11-26 19:17:57.513983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:40.715 [2024-11-26 19:17:57.520238] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.715 [2024-11-26 19:17:57.520434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.715 [2024-11-26 19:17:57.520453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:40.715 [2024-11-26 19:17:57.527453] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.715 [2024-11-26 19:17:57.527627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.715 [2024-11-26 19:17:57.527646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:40.715 [2024-11-26 19:17:57.534354] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.715 [2024-11-26 19:17:57.534483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.715 [2024-11-26 19:17:57.534502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:40.715 [2024-11-26 19:17:57.541408] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.715 [2024-11-26 19:17:57.541594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.715 [2024-11-26 19:17:57.541614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:40.715 [2024-11-26 19:17:57.548330] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.715 [2024-11-26 19:17:57.548551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.715 [2024-11-26 19:17:57.548571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:40.715 [2024-11-26 19:17:57.555783] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.715 [2024-11-26 19:17:57.555930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.715 [2024-11-26 19:17:57.555956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:40.715 [2024-11-26 19:17:57.563012] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.715 [2024-11-26 19:17:57.563135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.715 [2024-11-26 19:17:57.563154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:40.715 [2024-11-26 19:17:57.570357] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.715 [2024-11-26 19:17:57.570482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.715 [2024-11-26 19:17:57.570501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:40.715 [2024-11-26 19:17:57.577616] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.715 [2024-11-26 19:17:57.577776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.716 [2024-11-26 19:17:57.577795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:40.716 [2024-11-26 19:17:57.584412] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.716 [2024-11-26 19:17:57.584492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.716 [2024-11-26 19:17:57.584511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:40.716 [2024-11-26 19:17:57.589536] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.716 [2024-11-26 19:17:57.589735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.716 [2024-11-26 19:17:57.589754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:40.716 [2024-11-26 19:17:57.593559] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.716 [2024-11-26 19:17:57.593740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.716 [2024-11-26 19:17:57.593760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:40.716 [2024-11-26 19:17:57.597591] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.716 [2024-11-26 19:17:57.597750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.716 [2024-11-26 19:17:57.597769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:40.716 [2024-11-26 19:17:57.602567] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.716 [2024-11-26 19:17:57.602629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.716 [2024-11-26 19:17:57.602647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:40.716 [2024-11-26 19:17:57.607296] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.716 [2024-11-26 19:17:57.607496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.716 [2024-11-26 19:17:57.607515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:40.716 [2024-11-26 19:17:57.613297] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.716 [2024-11-26 19:17:57.613529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.716 [2024-11-26 19:17:57.613549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:40.716 [2024-11-26 19:17:57.619141] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.716 [2024-11-26 19:17:57.619303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.716 [2024-11-26 19:17:57.619322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:40.716 [2024-11-26 19:17:57.626339] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.716 [2024-11-26 19:17:57.626439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.716 [2024-11-26 19:17:57.626462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:40.716 [2024-11-26 19:17:57.632518] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.716 [2024-11-26 19:17:57.632772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.716 [2024-11-26 19:17:57.632793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:40.976 [2024-11-26 19:17:57.638945] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.976 [2024-11-26 19:17:57.639114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.976 [2024-11-26 19:17:57.639133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:40.976 [2024-11-26 19:17:57.645939] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.976 [2024-11-26 19:17:57.646162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.976 [2024-11-26 19:17:57.646181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:40.976 [2024-11-26 19:17:57.651911] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.976 [2024-11-26 19:17:57.652059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.976 [2024-11-26 19:17:57.652078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:40.976 [2024-11-26 19:17:57.658108] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.976 [2024-11-26 19:17:57.658278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.976 [2024-11-26 19:17:57.658298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:40.976 [2024-11-26 19:17:57.664746] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.976 [2024-11-26 19:17:57.664906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.976 [2024-11-26 19:17:57.664924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:40.976 [2024-11-26 19:17:57.671244] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.976 [2024-11-26 19:17:57.671430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.976 [2024-11-26 19:17:57.671449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:40.976 [2024-11-26 19:17:57.677734] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.976 [2024-11-26 19:17:57.677803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.976 [2024-11-26 19:17:57.677822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:40.976 [2024-11-26 19:17:57.684185] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.976 [2024-11-26 19:17:57.684522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.976 [2024-11-26 19:17:57.684543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:40.976 [2024-11-26 19:17:57.690333] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.976 [2024-11-26 19:17:57.690637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.976 [2024-11-26 19:17:57.690658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:40.976 [2024-11-26 19:17:57.697304] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.977 [2024-11-26 19:17:57.697499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.977 [2024-11-26 19:17:57.697519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:40.977 [2024-11-26 19:17:57.703857] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.977 [2024-11-26 19:17:57.703946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.977 [2024-11-26 19:17:57.703975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:40.977 [2024-11-26 19:17:57.708494] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.977 [2024-11-26 19:17:57.708576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.977 [2024-11-26 19:17:57.708594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:40.977 [2024-11-26 19:17:57.712610] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.977 [2024-11-26 19:17:57.712701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.977 [2024-11-26 19:17:57.712721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:40.977 [2024-11-26 19:17:57.716466] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.977 [2024-11-26 19:17:57.716636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.977 [2024-11-26 19:17:57.716655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:40.977 [2024-11-26 19:17:57.720325] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.977 [2024-11-26 19:17:57.720466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.977 [2024-11-26 19:17:57.720485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:40.977 [2024-11-26 19:17:57.724852] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.977 [2024-11-26 19:17:57.725212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.977 [2024-11-26 19:17:57.725232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:40.977 [2024-11-26 19:17:57.730102] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.977 [2024-11-26 19:17:57.730418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.977 [2024-11-26 19:17:57.730438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:40.977 [2024-11-26 19:17:57.735361] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.977 [2024-11-26 19:17:57.735560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.977 [2024-11-26 19:17:57.735579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:40.977 [2024-11-26 19:17:57.740375] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.977 [2024-11-26 19:17:57.740565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.977 [2024-11-26 19:17:57.740584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:40.977 [2024-11-26 19:17:57.745776] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.977 [2024-11-26 19:17:57.745961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.977 [2024-11-26 19:17:57.745980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:40.977 [2024-11-26 19:17:57.750878] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.977 [2024-11-26 19:17:57.751042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.977 [2024-11-26 19:17:57.751062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:40.977 [2024-11-26 19:17:57.757014] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.977 [2024-11-26 19:17:57.757162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.977 [2024-11-26 19:17:57.757181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:40.977 [2024-11-26 19:17:57.763904] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.977 [2024-11-26 19:17:57.764099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.977 [2024-11-26 19:17:57.764118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:40.977 [2024-11-26 19:17:57.770459] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.977 [2024-11-26 19:17:57.770796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.977 [2024-11-26 19:17:57.770816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:40.977 [2024-11-26 19:17:57.777162] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.977 [2024-11-26 19:17:57.777446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.977 [2024-11-26 19:17:57.777470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:40.977 [2024-11-26 19:17:57.783452] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.977 [2024-11-26 19:17:57.783620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.977 [2024-11-26 19:17:57.783639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:40.977 [2024-11-26 19:17:57.790433] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.977 [2024-11-26 19:17:57.790617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.977 [2024-11-26 19:17:57.790636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:40.977 [2024-11-26 19:17:57.796371] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.977 [2024-11-26 19:17:57.796473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.977 [2024-11-26 19:17:57.796492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:40.978 [2024-11-26 19:17:57.802762] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.978 [2024-11-26 19:17:57.802901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.978 [2024-11-26 19:17:57.802919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:40.978 [2024-11-26 19:17:57.809488] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.978 [2024-11-26 19:17:57.809608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.978 [2024-11-26 19:17:57.809626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:40.978 [2024-11-26 19:17:57.815691] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.978 [2024-11-26 19:17:57.815851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.978 [2024-11-26 19:17:57.815869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:40.978 [2024-11-26 19:17:57.820415] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.978 [2024-11-26 19:17:57.820490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.978 [2024-11-26 19:17:57.820508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:40.978 [2024-11-26 19:17:57.824595] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.978 [2024-11-26 19:17:57.824747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.978 [2024-11-26 19:17:57.824766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:40.978 [2024-11-26 19:17:57.828548] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.978 [2024-11-26 19:17:57.828627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.978 [2024-11-26 19:17:57.828645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:40.978 [2024-11-26 19:17:57.832513] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.978 [2024-11-26 19:17:57.832676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.978 [2024-11-26 19:17:57.832695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:40.978 [2024-11-26 19:17:57.836437] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.978 [2024-11-26 19:17:57.836528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.978 [2024-11-26 19:17:57.836546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:40.978 [2024-11-26 19:17:57.840331] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.978 [2024-11-26 19:17:57.840412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.978 [2024-11-26 19:17:57.840431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:40.978 [2024-11-26 19:17:57.844276] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.978 [2024-11-26 19:17:57.844485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.978 [2024-11-26 19:17:57.844505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:40.978 [2024-11-26 19:17:57.848127] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.978 [2024-11-26 19:17:57.848329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.978 [2024-11-26 19:17:57.848350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:40.978 [2024-11-26 19:17:57.852058] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.978 [2024-11-26 19:17:57.852289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.978 [2024-11-26 19:17:57.852310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:40.978 [2024-11-26 19:17:57.855923] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.978 [2024-11-26 19:17:57.856101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.978 [2024-11-26 19:17:57.856120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:40.978 [2024-11-26 19:17:57.859751] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.978 [2024-11-26 19:17:57.859839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.978 [2024-11-26 19:17:57.859858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:40.978 [2024-11-26 19:17:57.863630] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.978 [2024-11-26 19:17:57.863805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.978 [2024-11-26 19:17:57.863824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:40.978 [2024-11-26 19:17:57.867474] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.978 [2024-11-26 19:17:57.867581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.978 [2024-11-26 19:17:57.867599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:40.978 [2024-11-26 19:17:57.871338] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.978 [2024-11-26 19:17:57.871457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.978 [2024-11-26 19:17:57.871475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:40.978 [2024-11-26 19:17:57.875679] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.978 [2024-11-26 19:17:57.875964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.978 [2024-11-26 19:17:57.875984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:40.978 [2024-11-26 19:17:57.880758] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.979 [2024-11-26 19:17:57.881013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.979 [2024-11-26 19:17:57.881033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:40.979 [2024-11-26 19:17:57.885528] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.979 [2024-11-26 19:17:57.885755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.979 [2024-11-26 19:17:57.885774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:40.979 [2024-11-26 19:17:57.889870] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.979 [2024-11-26 19:17:57.890061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.979 [2024-11-26 19:17:57.890082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:40.979 [2024-11-26 19:17:57.893942] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.979 [2024-11-26 19:17:57.894104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.979 [2024-11-26 19:17:57.894123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:40.979 [2024-11-26 19:17:57.898226] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:40.979 [2024-11-26 19:17:57.898431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:40.979 [2024-11-26 19:17:57.898455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:41.238 [2024-11-26 19:17:57.902423] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:41.238 [2024-11-26 19:17:57.902569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:41.238 [2024-11-26 19:17:57.902589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:41.238 [2024-11-26 19:17:57.906758] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:41.238 [2024-11-26 19:17:57.906887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:41.238 [2024-11-26 19:17:57.906905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:41.238 [2024-11-26 19:17:57.911023] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:41.238 [2024-11-26 19:17:57.911250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:41.238 [2024-11-26 19:17:57.911270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:41.238 [2024-11-26 19:17:57.915114] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:41.238 [2024-11-26 19:17:57.915342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:32 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:41.238 [2024-11-26 19:17:57.915361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:31:41.238 [2024-11-26 19:17:57.919475] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:41.238 [2024-11-26 19:17:57.919694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:41.238 [2024-11-26 19:17:57.919713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:31:41.238 [2024-11-26 19:17:57.923427] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:41.238 [2024-11-26 19:17:57.923622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:41.238 [2024-11-26 19:17:57.923641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:31:41.238 [2024-11-26 19:17:57.927446] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xf53da0) with pdu=0x2000190fef90 00:31:41.238 [2024-11-26 19:17:57.927576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:41.238 [2024-11-26 19:17:57.927595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:31:41.238 00:31:41.238 Latency(us) 00:31:41.238 [2024-11-26T18:17:58.165Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:31:41.238 [2024-11-26T18:17:58.165Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:31:41.238 nvme0n1 : 2.00 6423.09 802.89 0.00 0.00 2487.21 1581.41 12081.42 00:31:41.238 [2024-11-26T18:17:58.165Z] =================================================================================================================== 00:31:41.238 [2024-11-26T18:17:58.165Z] Total : 6423.09 802.89 0.00 0.00 2487.21 1581.41 12081.42 00:31:41.238 0 00:31:41.238 19:17:57 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:31:41.238 19:17:57 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:31:41.238 19:17:57 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:31:41.238 | .driver_specific 00:31:41.238 | .nvme_error 00:31:41.238 | .status_code 00:31:41.238 | .command_transient_transport_error' 00:31:41.238 19:17:57 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:31:41.238 19:17:58 -- host/digest.sh@71 -- # (( 414 > 0 )) 00:31:41.238 19:17:58 -- host/digest.sh@73 -- # killprocess 3289039 00:31:41.238 19:17:58 -- common/autotest_common.sh@936 -- # '[' -z 3289039 ']' 00:31:41.238 19:17:58 -- common/autotest_common.sh@940 -- # kill -0 3289039 00:31:41.238 19:17:58 -- common/autotest_common.sh@941 -- # uname 00:31:41.238 19:17:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:31:41.238 19:17:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3289039 00:31:41.496 19:17:58 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:31:41.496 19:17:58 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:31:41.496 19:17:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3289039' 00:31:41.496 killing process with pid 3289039 00:31:41.496 19:17:58 -- common/autotest_common.sh@955 -- # kill 3289039 00:31:41.496 Received shutdown signal, test time was about 2.000000 seconds 00:31:41.496 00:31:41.496 Latency(us) 00:31:41.496 [2024-11-26T18:17:58.424Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:31:41.497 [2024-11-26T18:17:58.424Z] =================================================================================================================== 00:31:41.497 [2024-11-26T18:17:58.424Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:31:41.497 19:17:58 -- common/autotest_common.sh@960 -- # wait 3289039 00:31:41.497 19:17:58 -- host/digest.sh@115 -- # killprocess 3287101 00:31:41.497 19:17:58 -- common/autotest_common.sh@936 -- # '[' -z 3287101 ']' 00:31:41.497 19:17:58 -- common/autotest_common.sh@940 -- # kill -0 3287101 00:31:41.497 19:17:58 -- common/autotest_common.sh@941 -- # uname 00:31:41.497 19:17:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:31:41.497 19:17:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3287101 00:31:41.497 19:17:58 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:31:41.497 19:17:58 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:31:41.497 19:17:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3287101' 00:31:41.497 killing process with pid 3287101 00:31:41.497 19:17:58 -- common/autotest_common.sh@955 -- # kill 3287101 00:31:41.497 19:17:58 -- common/autotest_common.sh@960 -- # wait 3287101 00:31:41.755 00:31:41.755 real 0m16.493s 00:31:41.755 user 0m31.734s 00:31:41.755 sys 0m4.915s 00:31:41.755 19:17:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:31:41.755 19:17:58 -- common/autotest_common.sh@10 -- # set +x 00:31:41.755 ************************************ 00:31:41.755 END TEST nvmf_digest_error 00:31:41.755 ************************************ 00:31:41.755 19:17:58 -- host/digest.sh@138 -- # trap - SIGINT SIGTERM EXIT 00:31:41.755 19:17:58 -- host/digest.sh@139 -- # nvmftestfini 00:31:41.755 19:17:58 -- nvmf/common.sh@476 -- # nvmfcleanup 00:31:41.755 19:17:58 -- nvmf/common.sh@116 -- # sync 00:31:41.755 19:17:58 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:31:41.755 19:17:58 -- nvmf/common.sh@119 -- # set +e 00:31:41.755 19:17:58 -- nvmf/common.sh@120 -- # for i in {1..20} 00:31:41.755 19:17:58 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:31:41.755 rmmod nvme_tcp 00:31:41.755 rmmod nvme_fabrics 00:31:41.755 rmmod nvme_keyring 00:31:42.013 19:17:58 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:31:42.013 19:17:58 -- nvmf/common.sh@123 -- # set -e 00:31:42.013 19:17:58 -- nvmf/common.sh@124 -- # return 0 00:31:42.013 19:17:58 -- nvmf/common.sh@477 -- # '[' -n 3287101 ']' 00:31:42.013 19:17:58 -- nvmf/common.sh@478 -- # killprocess 3287101 00:31:42.013 19:17:58 -- common/autotest_common.sh@936 -- # '[' -z 3287101 ']' 00:31:42.013 19:17:58 -- common/autotest_common.sh@940 -- # kill -0 3287101 00:31:42.013 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3287101) - No such process 00:31:42.013 19:17:58 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3287101 is not found' 00:31:42.013 Process with pid 3287101 is not found 00:31:42.013 19:17:58 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:31:42.013 19:17:58 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:31:42.013 19:17:58 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:31:42.013 19:17:58 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:31:42.013 19:17:58 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:31:42.013 19:17:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:42.013 19:17:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:31:42.013 19:17:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:43.917 19:18:00 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:31:43.917 00:31:43.917 real 0m38.000s 00:31:43.917 user 0m58.981s 00:31:43.917 sys 0m13.832s 00:31:43.917 19:18:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:31:43.917 19:18:00 -- common/autotest_common.sh@10 -- # set +x 00:31:43.917 ************************************ 00:31:43.917 END TEST nvmf_digest 00:31:43.917 ************************************ 00:31:43.917 19:18:00 -- nvmf/nvmf.sh@110 -- # [[ 0 -eq 1 ]] 00:31:43.917 19:18:00 -- nvmf/nvmf.sh@115 -- # [[ 0 -eq 1 ]] 00:31:43.917 19:18:00 -- nvmf/nvmf.sh@120 -- # [[ phy == phy ]] 00:31:43.917 19:18:00 -- nvmf/nvmf.sh@122 -- # run_test nvmf_bdevperf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:31:43.917 19:18:00 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:31:43.917 19:18:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:43.917 19:18:00 -- common/autotest_common.sh@10 -- # set +x 00:31:43.917 ************************************ 00:31:43.917 START TEST nvmf_bdevperf 00:31:43.917 ************************************ 00:31:43.917 19:18:00 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:31:44.175 * Looking for test storage... 00:31:44.175 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:31:44.175 19:18:00 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:31:44.175 19:18:00 -- common/autotest_common.sh@1690 -- # lcov --version 00:31:44.175 19:18:00 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:31:44.175 19:18:00 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:31:44.175 19:18:00 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:31:44.175 19:18:00 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:31:44.175 19:18:00 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:31:44.176 19:18:00 -- scripts/common.sh@335 -- # IFS=.-: 00:31:44.176 19:18:00 -- scripts/common.sh@335 -- # read -ra ver1 00:31:44.176 19:18:00 -- scripts/common.sh@336 -- # IFS=.-: 00:31:44.176 19:18:00 -- scripts/common.sh@336 -- # read -ra ver2 00:31:44.176 19:18:00 -- scripts/common.sh@337 -- # local 'op=<' 00:31:44.176 19:18:00 -- scripts/common.sh@339 -- # ver1_l=2 00:31:44.176 19:18:00 -- scripts/common.sh@340 -- # ver2_l=1 00:31:44.176 19:18:00 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:31:44.176 19:18:00 -- scripts/common.sh@343 -- # case "$op" in 00:31:44.176 19:18:00 -- scripts/common.sh@344 -- # : 1 00:31:44.176 19:18:00 -- scripts/common.sh@363 -- # (( v = 0 )) 00:31:44.176 19:18:00 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:31:44.176 19:18:00 -- scripts/common.sh@364 -- # decimal 1 00:31:44.176 19:18:00 -- scripts/common.sh@352 -- # local d=1 00:31:44.176 19:18:00 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:31:44.176 19:18:00 -- scripts/common.sh@354 -- # echo 1 00:31:44.176 19:18:00 -- scripts/common.sh@364 -- # ver1[v]=1 00:31:44.176 19:18:00 -- scripts/common.sh@365 -- # decimal 2 00:31:44.176 19:18:00 -- scripts/common.sh@352 -- # local d=2 00:31:44.176 19:18:00 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:31:44.176 19:18:00 -- scripts/common.sh@354 -- # echo 2 00:31:44.176 19:18:00 -- scripts/common.sh@365 -- # ver2[v]=2 00:31:44.176 19:18:00 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:31:44.176 19:18:00 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:31:44.176 19:18:00 -- scripts/common.sh@367 -- # return 0 00:31:44.176 19:18:00 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:31:44.176 19:18:00 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:31:44.176 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:44.176 --rc genhtml_branch_coverage=1 00:31:44.176 --rc genhtml_function_coverage=1 00:31:44.176 --rc genhtml_legend=1 00:31:44.176 --rc geninfo_all_blocks=1 00:31:44.176 --rc geninfo_unexecuted_blocks=1 00:31:44.176 00:31:44.176 ' 00:31:44.176 19:18:00 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:31:44.176 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:44.176 --rc genhtml_branch_coverage=1 00:31:44.176 --rc genhtml_function_coverage=1 00:31:44.176 --rc genhtml_legend=1 00:31:44.176 --rc geninfo_all_blocks=1 00:31:44.176 --rc geninfo_unexecuted_blocks=1 00:31:44.176 00:31:44.176 ' 00:31:44.176 19:18:00 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:31:44.176 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:44.176 --rc genhtml_branch_coverage=1 00:31:44.176 --rc genhtml_function_coverage=1 00:31:44.176 --rc genhtml_legend=1 00:31:44.176 --rc geninfo_all_blocks=1 00:31:44.176 --rc geninfo_unexecuted_blocks=1 00:31:44.176 00:31:44.176 ' 00:31:44.176 19:18:00 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:31:44.176 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:44.176 --rc genhtml_branch_coverage=1 00:31:44.176 --rc genhtml_function_coverage=1 00:31:44.176 --rc genhtml_legend=1 00:31:44.176 --rc geninfo_all_blocks=1 00:31:44.176 --rc geninfo_unexecuted_blocks=1 00:31:44.176 00:31:44.176 ' 00:31:44.176 19:18:00 -- host/bdevperf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:31:44.176 19:18:00 -- nvmf/common.sh@7 -- # uname -s 00:31:44.176 19:18:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:31:44.176 19:18:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:31:44.176 19:18:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:31:44.176 19:18:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:31:44.176 19:18:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:31:44.176 19:18:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:31:44.176 19:18:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:31:44.176 19:18:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:31:44.176 19:18:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:31:44.176 19:18:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:31:44.176 19:18:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:31:44.176 19:18:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:31:44.176 19:18:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:31:44.176 19:18:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:31:44.176 19:18:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:31:44.176 19:18:00 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:31:44.176 19:18:00 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:31:44.176 19:18:00 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:44.176 19:18:00 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:44.176 19:18:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:44.176 19:18:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:44.176 19:18:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:44.176 19:18:00 -- paths/export.sh@5 -- # export PATH 00:31:44.176 19:18:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:44.176 19:18:00 -- nvmf/common.sh@46 -- # : 0 00:31:44.176 19:18:00 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:31:44.176 19:18:00 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:31:44.176 19:18:00 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:31:44.176 19:18:00 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:31:44.176 19:18:00 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:31:44.176 19:18:00 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:31:44.176 19:18:00 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:31:44.176 19:18:00 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:31:44.176 19:18:00 -- host/bdevperf.sh@11 -- # MALLOC_BDEV_SIZE=64 00:31:44.176 19:18:00 -- host/bdevperf.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:31:44.176 19:18:00 -- host/bdevperf.sh@24 -- # nvmftestinit 00:31:44.176 19:18:00 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:31:44.176 19:18:00 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:31:44.176 19:18:00 -- nvmf/common.sh@436 -- # prepare_net_devs 00:31:44.176 19:18:00 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:31:44.176 19:18:00 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:31:44.176 19:18:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:44.176 19:18:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:31:44.176 19:18:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:44.176 19:18:00 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:31:44.176 19:18:00 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:31:44.176 19:18:00 -- nvmf/common.sh@284 -- # xtrace_disable 00:31:44.176 19:18:00 -- common/autotest_common.sh@10 -- # set +x 00:31:49.445 19:18:05 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:31:49.445 19:18:05 -- nvmf/common.sh@290 -- # pci_devs=() 00:31:49.445 19:18:05 -- nvmf/common.sh@290 -- # local -a pci_devs 00:31:49.445 19:18:05 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:31:49.445 19:18:05 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:31:49.445 19:18:05 -- nvmf/common.sh@292 -- # pci_drivers=() 00:31:49.445 19:18:05 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:31:49.445 19:18:05 -- nvmf/common.sh@294 -- # net_devs=() 00:31:49.445 19:18:05 -- nvmf/common.sh@294 -- # local -ga net_devs 00:31:49.445 19:18:05 -- nvmf/common.sh@295 -- # e810=() 00:31:49.445 19:18:05 -- nvmf/common.sh@295 -- # local -ga e810 00:31:49.445 19:18:05 -- nvmf/common.sh@296 -- # x722=() 00:31:49.445 19:18:05 -- nvmf/common.sh@296 -- # local -ga x722 00:31:49.445 19:18:05 -- nvmf/common.sh@297 -- # mlx=() 00:31:49.445 19:18:05 -- nvmf/common.sh@297 -- # local -ga mlx 00:31:49.445 19:18:05 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:31:49.445 19:18:05 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:31:49.445 19:18:05 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:31:49.445 19:18:05 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:31:49.445 19:18:05 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:31:49.445 19:18:05 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:31:49.445 19:18:05 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:31:49.445 19:18:05 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:31:49.445 19:18:05 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:31:49.445 19:18:05 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:31:49.445 19:18:05 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:31:49.445 19:18:05 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:31:49.445 19:18:05 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:31:49.445 19:18:05 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:31:49.445 19:18:05 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:31:49.445 19:18:05 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:31:49.445 19:18:05 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:31:49.445 19:18:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:31:49.445 19:18:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:31:49.445 Found 0000:86:00.0 (0x8086 - 0x159b) 00:31:49.445 19:18:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:31:49.445 19:18:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:31:49.445 19:18:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:31:49.445 19:18:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:31:49.445 19:18:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:31:49.445 19:18:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:31:49.445 19:18:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:31:49.445 Found 0000:86:00.1 (0x8086 - 0x159b) 00:31:49.445 19:18:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:31:49.445 19:18:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:31:49.445 19:18:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:31:49.445 19:18:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:31:49.445 19:18:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:31:49.445 19:18:05 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:31:49.445 19:18:05 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:31:49.445 19:18:05 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:31:49.445 19:18:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:31:49.445 19:18:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:49.445 19:18:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:31:49.445 19:18:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:49.445 19:18:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:31:49.445 Found net devices under 0000:86:00.0: cvl_0_0 00:31:49.445 19:18:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:31:49.445 19:18:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:31:49.445 19:18:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:49.445 19:18:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:31:49.445 19:18:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:49.445 19:18:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:31:49.445 Found net devices under 0000:86:00.1: cvl_0_1 00:31:49.445 19:18:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:31:49.445 19:18:05 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:31:49.445 19:18:05 -- nvmf/common.sh@402 -- # is_hw=yes 00:31:49.445 19:18:05 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:31:49.445 19:18:05 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:31:49.445 19:18:05 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:31:49.445 19:18:05 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:31:49.445 19:18:05 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:31:49.445 19:18:05 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:31:49.445 19:18:05 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:31:49.445 19:18:05 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:31:49.445 19:18:05 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:31:49.445 19:18:05 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:31:49.445 19:18:05 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:31:49.445 19:18:05 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:31:49.445 19:18:05 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:31:49.445 19:18:05 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:31:49.445 19:18:05 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:31:49.445 19:18:05 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:31:49.445 19:18:05 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:31:49.445 19:18:05 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:31:49.445 19:18:05 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:31:49.445 19:18:05 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:31:49.445 19:18:05 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:31:49.445 19:18:05 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:31:49.445 19:18:05 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:31:49.445 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:31:49.445 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.485 ms 00:31:49.445 00:31:49.445 --- 10.0.0.2 ping statistics --- 00:31:49.445 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:31:49.445 rtt min/avg/max/mdev = 0.485/0.485/0.485/0.000 ms 00:31:49.445 19:18:05 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:31:49.445 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:31:49.445 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.134 ms 00:31:49.445 00:31:49.445 --- 10.0.0.1 ping statistics --- 00:31:49.445 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:31:49.445 rtt min/avg/max/mdev = 0.134/0.134/0.134/0.000 ms 00:31:49.445 19:18:06 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:31:49.445 19:18:06 -- nvmf/common.sh@410 -- # return 0 00:31:49.445 19:18:06 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:31:49.445 19:18:06 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:31:49.445 19:18:06 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:31:49.445 19:18:06 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:31:49.445 19:18:06 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:31:49.445 19:18:06 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:31:49.445 19:18:06 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:31:49.445 19:18:06 -- host/bdevperf.sh@25 -- # tgt_init 00:31:49.445 19:18:06 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:31:49.445 19:18:06 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:31:49.445 19:18:06 -- common/autotest_common.sh@722 -- # xtrace_disable 00:31:49.445 19:18:06 -- common/autotest_common.sh@10 -- # set +x 00:31:49.445 19:18:06 -- nvmf/common.sh@469 -- # nvmfpid=3293380 00:31:49.445 19:18:06 -- nvmf/common.sh@470 -- # waitforlisten 3293380 00:31:49.445 19:18:06 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:31:49.445 19:18:06 -- common/autotest_common.sh@829 -- # '[' -z 3293380 ']' 00:31:49.445 19:18:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:31:49.445 19:18:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:31:49.445 19:18:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:31:49.445 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:31:49.445 19:18:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:31:49.445 19:18:06 -- common/autotest_common.sh@10 -- # set +x 00:31:49.445 [2024-11-26 19:18:06.103079] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:31:49.445 [2024-11-26 19:18:06.103132] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:31:49.445 EAL: No free 2048 kB hugepages reported on node 1 00:31:49.445 [2024-11-26 19:18:06.163666] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:31:49.445 [2024-11-26 19:18:06.207217] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:31:49.445 [2024-11-26 19:18:06.207325] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:31:49.446 [2024-11-26 19:18:06.207334] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:31:49.446 [2024-11-26 19:18:06.207341] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:31:49.446 [2024-11-26 19:18:06.207444] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:31:49.446 [2024-11-26 19:18:06.207532] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:31:49.446 [2024-11-26 19:18:06.207534] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:31:50.382 19:18:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:31:50.382 19:18:06 -- common/autotest_common.sh@862 -- # return 0 00:31:50.382 19:18:06 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:31:50.382 19:18:06 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:50.382 19:18:06 -- common/autotest_common.sh@10 -- # set +x 00:31:50.382 19:18:06 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:31:50.382 19:18:06 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:31:50.382 19:18:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:50.382 19:18:06 -- common/autotest_common.sh@10 -- # set +x 00:31:50.382 [2024-11-26 19:18:06.979894] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:31:50.382 19:18:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:50.382 19:18:06 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:31:50.382 19:18:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:50.382 19:18:06 -- common/autotest_common.sh@10 -- # set +x 00:31:50.382 Malloc0 00:31:50.382 19:18:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:50.382 19:18:07 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:31:50.382 19:18:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:50.382 19:18:07 -- common/autotest_common.sh@10 -- # set +x 00:31:50.382 19:18:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:50.382 19:18:07 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:31:50.382 19:18:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:50.382 19:18:07 -- common/autotest_common.sh@10 -- # set +x 00:31:50.382 19:18:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:50.382 19:18:07 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:31:50.382 19:18:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:50.382 19:18:07 -- common/autotest_common.sh@10 -- # set +x 00:31:50.382 [2024-11-26 19:18:07.046774] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:50.382 19:18:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:50.382 19:18:07 -- host/bdevperf.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 128 -o 4096 -w verify -t 1 00:31:50.382 19:18:07 -- host/bdevperf.sh@27 -- # gen_nvmf_target_json 00:31:50.382 19:18:07 -- nvmf/common.sh@520 -- # config=() 00:31:50.382 19:18:07 -- nvmf/common.sh@520 -- # local subsystem config 00:31:50.382 19:18:07 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:50.382 19:18:07 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:50.382 { 00:31:50.382 "params": { 00:31:50.382 "name": "Nvme$subsystem", 00:31:50.382 "trtype": "$TEST_TRANSPORT", 00:31:50.382 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:50.382 "adrfam": "ipv4", 00:31:50.382 "trsvcid": "$NVMF_PORT", 00:31:50.382 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:50.382 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:50.382 "hdgst": ${hdgst:-false}, 00:31:50.382 "ddgst": ${ddgst:-false} 00:31:50.382 }, 00:31:50.382 "method": "bdev_nvme_attach_controller" 00:31:50.382 } 00:31:50.382 EOF 00:31:50.382 )") 00:31:50.382 19:18:07 -- nvmf/common.sh@542 -- # cat 00:31:50.382 19:18:07 -- nvmf/common.sh@544 -- # jq . 00:31:50.382 19:18:07 -- nvmf/common.sh@545 -- # IFS=, 00:31:50.382 19:18:07 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:50.382 "params": { 00:31:50.382 "name": "Nvme1", 00:31:50.382 "trtype": "tcp", 00:31:50.382 "traddr": "10.0.0.2", 00:31:50.382 "adrfam": "ipv4", 00:31:50.382 "trsvcid": "4420", 00:31:50.382 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:31:50.382 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:31:50.382 "hdgst": false, 00:31:50.382 "ddgst": false 00:31:50.382 }, 00:31:50.382 "method": "bdev_nvme_attach_controller" 00:31:50.382 }' 00:31:50.382 [2024-11-26 19:18:07.092233] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:31:50.382 [2024-11-26 19:18:07.092277] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3293666 ] 00:31:50.382 EAL: No free 2048 kB hugepages reported on node 1 00:31:50.382 [2024-11-26 19:18:07.148383] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:31:50.382 [2024-11-26 19:18:07.186519] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:31:50.641 Running I/O for 1 seconds... 00:31:51.578 00:31:51.578 Latency(us) 00:31:51.578 [2024-11-26T18:18:08.505Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:31:51.578 [2024-11-26T18:18:08.505Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:31:51.578 Verification LBA range: start 0x0 length 0x4000 00:31:51.578 Nvme1n1 : 1.00 16926.29 66.12 0.00 0.00 7533.40 804.95 12480.33 00:31:51.578 [2024-11-26T18:18:08.505Z] =================================================================================================================== 00:31:51.578 [2024-11-26T18:18:08.505Z] Total : 16926.29 66.12 0.00 0.00 7533.40 804.95 12480.33 00:31:51.837 19:18:08 -- host/bdevperf.sh@30 -- # bdevperfpid=3294184 00:31:51.837 19:18:08 -- host/bdevperf.sh@32 -- # sleep 3 00:31:51.837 19:18:08 -- host/bdevperf.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -q 128 -o 4096 -w verify -t 15 -f 00:31:51.837 19:18:08 -- host/bdevperf.sh@29 -- # gen_nvmf_target_json 00:31:51.837 19:18:08 -- nvmf/common.sh@520 -- # config=() 00:31:51.837 19:18:08 -- nvmf/common.sh@520 -- # local subsystem config 00:31:51.837 19:18:08 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:51.837 19:18:08 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:51.837 { 00:31:51.837 "params": { 00:31:51.837 "name": "Nvme$subsystem", 00:31:51.837 "trtype": "$TEST_TRANSPORT", 00:31:51.837 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:51.838 "adrfam": "ipv4", 00:31:51.838 "trsvcid": "$NVMF_PORT", 00:31:51.838 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:51.838 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:51.838 "hdgst": ${hdgst:-false}, 00:31:51.838 "ddgst": ${ddgst:-false} 00:31:51.838 }, 00:31:51.838 "method": "bdev_nvme_attach_controller" 00:31:51.838 } 00:31:51.838 EOF 00:31:51.838 )") 00:31:51.838 19:18:08 -- nvmf/common.sh@542 -- # cat 00:31:51.838 19:18:08 -- nvmf/common.sh@544 -- # jq . 00:31:51.838 19:18:08 -- nvmf/common.sh@545 -- # IFS=, 00:31:51.838 19:18:08 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:51.838 "params": { 00:31:51.838 "name": "Nvme1", 00:31:51.838 "trtype": "tcp", 00:31:51.838 "traddr": "10.0.0.2", 00:31:51.838 "adrfam": "ipv4", 00:31:51.838 "trsvcid": "4420", 00:31:51.838 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:31:51.838 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:31:51.838 "hdgst": false, 00:31:51.838 "ddgst": false 00:31:51.838 }, 00:31:51.838 "method": "bdev_nvme_attach_controller" 00:31:51.838 }' 00:31:51.838 [2024-11-26 19:18:08.559733] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:31:51.838 [2024-11-26 19:18:08.559782] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3294184 ] 00:31:51.838 EAL: No free 2048 kB hugepages reported on node 1 00:31:51.838 [2024-11-26 19:18:08.617365] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:31:51.838 [2024-11-26 19:18:08.653303] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:31:52.097 Running I/O for 15 seconds... 00:31:54.634 19:18:11 -- host/bdevperf.sh@33 -- # kill -9 3293380 00:31:54.634 19:18:11 -- host/bdevperf.sh@35 -- # sleep 3 00:31:54.634 [2024-11-26 19:18:11.531314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:85216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.634 [2024-11-26 19:18:11.531352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.634 [2024-11-26 19:18:11.531373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:84632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.634 [2024-11-26 19:18:11.531382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.634 [2024-11-26 19:18:11.531392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:84648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.634 [2024-11-26 19:18:11.531400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.634 [2024-11-26 19:18:11.531409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:84656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.634 [2024-11-26 19:18:11.531417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.634 [2024-11-26 19:18:11.531425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:84672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.634 [2024-11-26 19:18:11.531433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.634 [2024-11-26 19:18:11.531442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:84680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.634 [2024-11-26 19:18:11.531450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.634 [2024-11-26 19:18:11.531461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:84696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.634 [2024-11-26 19:18:11.531468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.634 [2024-11-26 19:18:11.531476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:84720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.634 [2024-11-26 19:18:11.531488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.634 [2024-11-26 19:18:11.531498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:84728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.634 [2024-11-26 19:18:11.531505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.634 [2024-11-26 19:18:11.531514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:85256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.634 [2024-11-26 19:18:11.531522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.634 [2024-11-26 19:18:11.531532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:85264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.634 [2024-11-26 19:18:11.531539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.635 [2024-11-26 19:18:11.531549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:85312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.635 [2024-11-26 19:18:11.531556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.635 [2024-11-26 19:18:11.531565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:85328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.635 [2024-11-26 19:18:11.531573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.635 [2024-11-26 19:18:11.531583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:85344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.635 [2024-11-26 19:18:11.531590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.635 [2024-11-26 19:18:11.531600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:85368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.635 [2024-11-26 19:18:11.531607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.635 [2024-11-26 19:18:11.531617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:85376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.635 [2024-11-26 19:18:11.531625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.635 [2024-11-26 19:18:11.531635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:85392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.635 [2024-11-26 19:18:11.531643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.635 [2024-11-26 19:18:11.531655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:84736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.635 [2024-11-26 19:18:11.531665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.635 [2024-11-26 19:18:11.531675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:84752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.635 [2024-11-26 19:18:11.531683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.635 [2024-11-26 19:18:11.531694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:84760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.635 [2024-11-26 19:18:11.531702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.635 [2024-11-26 19:18:11.531716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:84768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.635 [2024-11-26 19:18:11.531727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.635 [2024-11-26 19:18:11.531736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:84776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.635 [2024-11-26 19:18:11.531744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.635 [2024-11-26 19:18:11.531754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:84800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.635 [2024-11-26 19:18:11.531762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.635 [2024-11-26 19:18:11.531771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:84840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.635 [2024-11-26 19:18:11.531777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.635 [2024-11-26 19:18:11.531786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:84880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.635 [2024-11-26 19:18:11.531792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.635 [2024-11-26 19:18:11.531801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:85400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.635 [2024-11-26 19:18:11.531807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.635 [2024-11-26 19:18:11.531816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:85408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:54.635 [2024-11-26 19:18:11.531823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.635 [2024-11-26 19:18:11.531831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:85416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.635 [2024-11-26 19:18:11.531837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.635 [2024-11-26 19:18:11.531846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:85424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.635 [2024-11-26 19:18:11.531852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.635 [2024-11-26 19:18:11.531860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:85432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:54.635 [2024-11-26 19:18:11.531867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.635 [2024-11-26 19:18:11.531875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:85440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.635 [2024-11-26 19:18:11.531882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.635 [2024-11-26 19:18:11.531891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:85448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:54.635 [2024-11-26 19:18:11.531897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.635 [2024-11-26 19:18:11.531905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:85456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:54.635 [2024-11-26 19:18:11.531911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.635 [2024-11-26 19:18:11.531922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:85464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:54.635 [2024-11-26 19:18:11.531929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.635 [2024-11-26 19:18:11.531937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:85472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.635 [2024-11-26 19:18:11.531943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.635 [2024-11-26 19:18:11.531956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:85480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:54.635 [2024-11-26 19:18:11.531964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.635 [2024-11-26 19:18:11.531972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:85488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.635 [2024-11-26 19:18:11.531979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.635 [2024-11-26 19:18:11.531987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:85496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.635 [2024-11-26 19:18:11.531993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.635 [2024-11-26 19:18:11.532001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:84896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.635 [2024-11-26 19:18:11.532008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.635 [2024-11-26 19:18:11.532017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:84912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.635 [2024-11-26 19:18:11.532024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.635 [2024-11-26 19:18:11.532032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:84944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.635 [2024-11-26 19:18:11.532039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.635 [2024-11-26 19:18:11.532047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:84952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.635 [2024-11-26 19:18:11.532054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.635 [2024-11-26 19:18:11.532062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:84960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.635 [2024-11-26 19:18:11.532069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.635 [2024-11-26 19:18:11.532077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:84968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.635 [2024-11-26 19:18:11.532083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.635 [2024-11-26 19:18:11.532091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:84976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.635 [2024-11-26 19:18:11.532098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.635 [2024-11-26 19:18:11.532106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:84984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.635 [2024-11-26 19:18:11.532115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.635 [2024-11-26 19:18:11.532123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:85504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.635 [2024-11-26 19:18:11.532130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.635 [2024-11-26 19:18:11.532138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:85512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:54.635 [2024-11-26 19:18:11.532144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.635 [2024-11-26 19:18:11.532152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:85520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.635 [2024-11-26 19:18:11.532158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.635 [2024-11-26 19:18:11.532168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:85528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.635 [2024-11-26 19:18:11.532176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.635 [2024-11-26 19:18:11.532184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:85536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.636 [2024-11-26 19:18:11.532191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.636 [2024-11-26 19:18:11.532199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:85544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.636 [2024-11-26 19:18:11.532205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.636 [2024-11-26 19:18:11.532213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:85552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.636 [2024-11-26 19:18:11.532220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.636 [2024-11-26 19:18:11.532228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:85560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:54.636 [2024-11-26 19:18:11.532235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.636 [2024-11-26 19:18:11.532243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:85568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.636 [2024-11-26 19:18:11.532250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.636 [2024-11-26 19:18:11.532258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:85576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.636 [2024-11-26 19:18:11.532264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.636 [2024-11-26 19:18:11.532272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:85584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.636 [2024-11-26 19:18:11.532279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.636 [2024-11-26 19:18:11.532289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:85592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.636 [2024-11-26 19:18:11.532296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.636 [2024-11-26 19:18:11.532306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:85600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:54.636 [2024-11-26 19:18:11.532313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.636 [2024-11-26 19:18:11.532321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:85608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.636 [2024-11-26 19:18:11.532328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.636 [2024-11-26 19:18:11.532336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:85616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.636 [2024-11-26 19:18:11.532343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.636 [2024-11-26 19:18:11.532352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:85624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:54.636 [2024-11-26 19:18:11.532358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.636 [2024-11-26 19:18:11.532366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:85632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.636 [2024-11-26 19:18:11.532373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.636 [2024-11-26 19:18:11.532381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:85640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:54.636 [2024-11-26 19:18:11.532387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.636 [2024-11-26 19:18:11.532395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:85648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:54.636 [2024-11-26 19:18:11.532401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.636 [2024-11-26 19:18:11.532411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:85656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.636 [2024-11-26 19:18:11.532418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.636 [2024-11-26 19:18:11.532426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:85664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:54.636 [2024-11-26 19:18:11.532432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.636 [2024-11-26 19:18:11.532440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:85672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:54.636 [2024-11-26 19:18:11.532446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.636 [2024-11-26 19:18:11.532456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:85680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:54.636 [2024-11-26 19:18:11.532463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.636 [2024-11-26 19:18:11.532471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:85688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.636 [2024-11-26 19:18:11.532479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.636 [2024-11-26 19:18:11.532487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:85696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:54.636 [2024-11-26 19:18:11.532495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.636 [2024-11-26 19:18:11.532503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:85704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:54.636 [2024-11-26 19:18:11.532510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.636 [2024-11-26 19:18:11.532519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:85712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.636 [2024-11-26 19:18:11.532525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.636 [2024-11-26 19:18:11.532534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:85720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:54.636 [2024-11-26 19:18:11.532540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.636 [2024-11-26 19:18:11.532548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:85728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:54.636 [2024-11-26 19:18:11.532554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.636 [2024-11-26 19:18:11.532562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:85736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.636 [2024-11-26 19:18:11.532569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.636 [2024-11-26 19:18:11.532578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:85744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.636 [2024-11-26 19:18:11.532585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.636 [2024-11-26 19:18:11.532593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:85752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.636 [2024-11-26 19:18:11.532600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.636 [2024-11-26 19:18:11.532608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:85760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.636 [2024-11-26 19:18:11.532615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.636 [2024-11-26 19:18:11.532623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:85000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.636 [2024-11-26 19:18:11.532630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.636 [2024-11-26 19:18:11.532638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:85008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.636 [2024-11-26 19:18:11.532645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.636 [2024-11-26 19:18:11.532653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:85040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.636 [2024-11-26 19:18:11.532660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.636 [2024-11-26 19:18:11.532668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:85056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.636 [2024-11-26 19:18:11.532675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.636 [2024-11-26 19:18:11.532683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:85064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.636 [2024-11-26 19:18:11.532695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.636 [2024-11-26 19:18:11.532704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:85072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.636 [2024-11-26 19:18:11.532711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.636 [2024-11-26 19:18:11.532719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:85088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.636 [2024-11-26 19:18:11.532726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.637 [2024-11-26 19:18:11.532734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:85096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.637 [2024-11-26 19:18:11.532741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.637 [2024-11-26 19:18:11.532750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:85120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.637 [2024-11-26 19:18:11.532757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.637 [2024-11-26 19:18:11.532768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:85136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.637 [2024-11-26 19:18:11.532775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.637 [2024-11-26 19:18:11.532783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:85144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.637 [2024-11-26 19:18:11.532790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.637 [2024-11-26 19:18:11.532798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:85152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.637 [2024-11-26 19:18:11.532805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.637 [2024-11-26 19:18:11.532814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:85160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.637 [2024-11-26 19:18:11.532820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.637 [2024-11-26 19:18:11.532828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:85168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.637 [2024-11-26 19:18:11.532835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.637 [2024-11-26 19:18:11.532843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:85184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.637 [2024-11-26 19:18:11.532850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.637 [2024-11-26 19:18:11.532859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:85192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.637 [2024-11-26 19:18:11.532866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.637 [2024-11-26 19:18:11.532874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:85768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.637 [2024-11-26 19:18:11.532881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.637 [2024-11-26 19:18:11.532890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:85776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.637 [2024-11-26 19:18:11.532897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.637 [2024-11-26 19:18:11.532906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:85784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.637 [2024-11-26 19:18:11.532912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.637 [2024-11-26 19:18:11.532921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:85792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:54.637 [2024-11-26 19:18:11.532927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.637 [2024-11-26 19:18:11.532935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:85800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:54.637 [2024-11-26 19:18:11.532942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.637 [2024-11-26 19:18:11.532953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:85808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:54.637 [2024-11-26 19:18:11.532961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.637 [2024-11-26 19:18:11.532969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:85816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.637 [2024-11-26 19:18:11.532976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.637 [2024-11-26 19:18:11.532985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:85824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.637 [2024-11-26 19:18:11.532992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.637 [2024-11-26 19:18:11.533001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:85832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:54.637 [2024-11-26 19:18:11.533007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.637 [2024-11-26 19:18:11.533017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:85840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:54.637 [2024-11-26 19:18:11.533024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.637 [2024-11-26 19:18:11.533032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:85848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:54.637 [2024-11-26 19:18:11.533039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.637 [2024-11-26 19:18:11.533047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:85856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:54.637 [2024-11-26 19:18:11.533054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.637 [2024-11-26 19:18:11.533062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:85864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:54.637 [2024-11-26 19:18:11.533069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.637 [2024-11-26 19:18:11.533077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:85872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:54.637 [2024-11-26 19:18:11.533085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.637 [2024-11-26 19:18:11.533093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:85880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:54.637 [2024-11-26 19:18:11.533100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.637 [2024-11-26 19:18:11.533109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:85200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.637 [2024-11-26 19:18:11.533115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.637 [2024-11-26 19:18:11.533123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:85208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.637 [2024-11-26 19:18:11.533129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.637 [2024-11-26 19:18:11.533138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:85224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.637 [2024-11-26 19:18:11.533144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.637 [2024-11-26 19:18:11.533153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:85232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.637 [2024-11-26 19:18:11.533161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.637 [2024-11-26 19:18:11.533169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:85240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.637 [2024-11-26 19:18:11.533175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.637 [2024-11-26 19:18:11.533184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:85248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.637 [2024-11-26 19:18:11.533190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.637 [2024-11-26 19:18:11.533198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:85272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.637 [2024-11-26 19:18:11.533205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.637 [2024-11-26 19:18:11.533213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:85280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.637 [2024-11-26 19:18:11.533220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.637 [2024-11-26 19:18:11.533228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:85888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:54.637 [2024-11-26 19:18:11.533235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.637 [2024-11-26 19:18:11.533242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:85896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:54.637 [2024-11-26 19:18:11.533249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.637 [2024-11-26 19:18:11.533258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:85288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.637 [2024-11-26 19:18:11.533265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.637 [2024-11-26 19:18:11.533275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:85296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.637 [2024-11-26 19:18:11.533282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.637 [2024-11-26 19:18:11.533290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:85304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.637 [2024-11-26 19:18:11.533297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.637 [2024-11-26 19:18:11.533306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:85320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.637 [2024-11-26 19:18:11.533313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.637 [2024-11-26 19:18:11.533322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:85336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.637 [2024-11-26 19:18:11.533328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.637 [2024-11-26 19:18:11.533336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:85352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.638 [2024-11-26 19:18:11.533343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.638 [2024-11-26 19:18:11.533351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:85360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:54.638 [2024-11-26 19:18:11.533357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.638 [2024-11-26 19:18:11.533365] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c48ca0 is same with the state(5) to be set 00:31:54.638 [2024-11-26 19:18:11.533374] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:31:54.638 [2024-11-26 19:18:11.533379] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:31:54.638 [2024-11-26 19:18:11.533386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:85384 len:8 PRP1 0x0 PRP2 0x0 00:31:54.638 [2024-11-26 19:18:11.533394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:54.638 [2024-11-26 19:18:11.533436] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1c48ca0 was disconnected and freed. reset controller. 00:31:54.638 [2024-11-26 19:18:11.535483] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:54.638 [2024-11-26 19:18:11.535539] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:54.638 [2024-11-26 19:18:11.536035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:54.638 [2024-11-26 19:18:11.536328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:54.638 [2024-11-26 19:18:11.536360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:54.638 [2024-11-26 19:18:11.536384] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:54.638 [2024-11-26 19:18:11.536586] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:54.638 [2024-11-26 19:18:11.536734] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:54.638 [2024-11-26 19:18:11.536743] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:54.638 [2024-11-26 19:18:11.536752] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:54.638 [2024-11-26 19:18:11.538700] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:54.638 [2024-11-26 19:18:11.547839] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:54.638 [2024-11-26 19:18:11.548230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:54.638 [2024-11-26 19:18:11.548310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:54.638 [2024-11-26 19:18:11.548323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:54.638 [2024-11-26 19:18:11.548332] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:54.638 [2024-11-26 19:18:11.548447] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:54.638 [2024-11-26 19:18:11.548563] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:54.638 [2024-11-26 19:18:11.548573] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:54.638 [2024-11-26 19:18:11.548580] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:54.638 [2024-11-26 19:18:11.550355] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:54.898 [2024-11-26 19:18:11.559823] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:54.898 [2024-11-26 19:18:11.560223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:54.898 [2024-11-26 19:18:11.560509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:54.898 [2024-11-26 19:18:11.560543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:54.898 [2024-11-26 19:18:11.560567] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:54.898 [2024-11-26 19:18:11.560832] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:54.898 [2024-11-26 19:18:11.560926] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:54.898 [2024-11-26 19:18:11.560935] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:54.898 [2024-11-26 19:18:11.560941] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:54.898 [2024-11-26 19:18:11.562820] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:54.898 [2024-11-26 19:18:11.571660] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:54.898 [2024-11-26 19:18:11.572010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:54.898 [2024-11-26 19:18:11.572239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:54.898 [2024-11-26 19:18:11.572251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:54.899 [2024-11-26 19:18:11.572259] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:54.899 [2024-11-26 19:18:11.572340] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:54.899 [2024-11-26 19:18:11.572420] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:54.899 [2024-11-26 19:18:11.572429] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:54.899 [2024-11-26 19:18:11.572436] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:54.899 [2024-11-26 19:18:11.574227] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:54.899 [2024-11-26 19:18:11.583686] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:54.899 [2024-11-26 19:18:11.584074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:54.899 [2024-11-26 19:18:11.584359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:54.899 [2024-11-26 19:18:11.584393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:54.899 [2024-11-26 19:18:11.584417] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:54.899 [2024-11-26 19:18:11.584525] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:54.899 [2024-11-26 19:18:11.584619] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:54.899 [2024-11-26 19:18:11.584628] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:54.899 [2024-11-26 19:18:11.584635] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:54.899 [2024-11-26 19:18:11.586328] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:54.899 [2024-11-26 19:18:11.595444] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:54.899 [2024-11-26 19:18:11.595707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:54.899 [2024-11-26 19:18:11.595878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:54.899 [2024-11-26 19:18:11.595911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:54.899 [2024-11-26 19:18:11.595935] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:54.899 [2024-11-26 19:18:11.596332] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:54.899 [2024-11-26 19:18:11.596766] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:54.899 [2024-11-26 19:18:11.596791] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:54.899 [2024-11-26 19:18:11.596813] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:54.899 [2024-11-26 19:18:11.598542] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:54.899 [2024-11-26 19:18:11.607345] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:54.899 [2024-11-26 19:18:11.607711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:54.899 [2024-11-26 19:18:11.607930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:54.899 [2024-11-26 19:18:11.607979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:54.899 [2024-11-26 19:18:11.608005] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:54.899 [2024-11-26 19:18:11.608385] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:54.899 [2024-11-26 19:18:11.608782] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:54.899 [2024-11-26 19:18:11.608792] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:54.899 [2024-11-26 19:18:11.608800] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:54.899 [2024-11-26 19:18:11.610388] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:54.899 [2024-11-26 19:18:11.619257] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:54.899 [2024-11-26 19:18:11.619527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:54.899 [2024-11-26 19:18:11.619760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:54.899 [2024-11-26 19:18:11.619793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:54.899 [2024-11-26 19:18:11.619817] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:54.899 [2024-11-26 19:18:11.620315] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:54.899 [2024-11-26 19:18:11.620601] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:54.899 [2024-11-26 19:18:11.620626] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:54.899 [2024-11-26 19:18:11.620649] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:54.899 [2024-11-26 19:18:11.622700] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:54.899 [2024-11-26 19:18:11.631145] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:54.899 [2024-11-26 19:18:11.631518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:54.899 [2024-11-26 19:18:11.631735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:54.899 [2024-11-26 19:18:11.631768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:54.899 [2024-11-26 19:18:11.631792] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:54.899 [2024-11-26 19:18:11.632038] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:54.899 [2024-11-26 19:18:11.632375] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:54.899 [2024-11-26 19:18:11.632400] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:54.899 [2024-11-26 19:18:11.632422] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:54.899 [2024-11-26 19:18:11.634497] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:54.899 [2024-11-26 19:18:11.642902] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:54.899 [2024-11-26 19:18:11.643267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:54.899 [2024-11-26 19:18:11.643473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:54.899 [2024-11-26 19:18:11.643506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:54.899 [2024-11-26 19:18:11.643529] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:54.899 [2024-11-26 19:18:11.643812] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:54.899 [2024-11-26 19:18:11.643968] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:54.899 [2024-11-26 19:18:11.643978] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:54.899 [2024-11-26 19:18:11.643985] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:54.899 [2024-11-26 19:18:11.645737] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:54.899 [2024-11-26 19:18:11.654568] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:54.899 [2024-11-26 19:18:11.654847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:54.899 [2024-11-26 19:18:11.655104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:54.899 [2024-11-26 19:18:11.655120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:54.899 [2024-11-26 19:18:11.655128] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:54.899 [2024-11-26 19:18:11.655252] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:54.899 [2024-11-26 19:18:11.655375] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:54.899 [2024-11-26 19:18:11.655384] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:54.899 [2024-11-26 19:18:11.655391] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:54.899 [2024-11-26 19:18:11.657126] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:54.899 [2024-11-26 19:18:11.666454] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:54.899 [2024-11-26 19:18:11.666825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:54.899 [2024-11-26 19:18:11.667057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:54.899 [2024-11-26 19:18:11.667070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:54.899 [2024-11-26 19:18:11.667078] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:54.899 [2024-11-26 19:18:11.667207] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:54.899 [2024-11-26 19:18:11.667307] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:54.899 [2024-11-26 19:18:11.667317] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:54.899 [2024-11-26 19:18:11.667324] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:54.899 [2024-11-26 19:18:11.668995] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:54.899 [2024-11-26 19:18:11.678222] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:54.899 [2024-11-26 19:18:11.678564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:54.899 [2024-11-26 19:18:11.678809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:54.899 [2024-11-26 19:18:11.678842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:54.899 [2024-11-26 19:18:11.678866] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:54.899 [2024-11-26 19:18:11.679361] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:54.900 [2024-11-26 19:18:11.679696] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:54.900 [2024-11-26 19:18:11.679722] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:54.900 [2024-11-26 19:18:11.679744] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:54.900 [2024-11-26 19:18:11.681646] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:54.900 [2024-11-26 19:18:11.690117] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:54.900 [2024-11-26 19:18:11.690432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:54.900 [2024-11-26 19:18:11.690643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:54.900 [2024-11-26 19:18:11.690677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:54.900 [2024-11-26 19:18:11.690708] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:54.900 [2024-11-26 19:18:11.691161] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:54.900 [2024-11-26 19:18:11.691278] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:54.900 [2024-11-26 19:18:11.691287] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:54.900 [2024-11-26 19:18:11.691294] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:54.900 [2024-11-26 19:18:11.693021] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:54.900 [2024-11-26 19:18:11.702042] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:54.900 [2024-11-26 19:18:11.702415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:54.900 [2024-11-26 19:18:11.702649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:54.900 [2024-11-26 19:18:11.702683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:54.900 [2024-11-26 19:18:11.702707] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:54.900 [2024-11-26 19:18:11.703003] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:54.900 [2024-11-26 19:18:11.703162] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:54.900 [2024-11-26 19:18:11.703172] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:54.900 [2024-11-26 19:18:11.703178] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:54.900 [2024-11-26 19:18:11.704895] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:54.900 [2024-11-26 19:18:11.713997] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:54.900 [2024-11-26 19:18:11.714328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:54.900 [2024-11-26 19:18:11.714572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:54.900 [2024-11-26 19:18:11.714607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:54.900 [2024-11-26 19:18:11.714630] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:54.900 [2024-11-26 19:18:11.715026] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:54.900 [2024-11-26 19:18:11.715242] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:54.900 [2024-11-26 19:18:11.715251] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:54.900 [2024-11-26 19:18:11.715258] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:54.900 [2024-11-26 19:18:11.716986] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:54.900 [2024-11-26 19:18:11.725880] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:54.900 [2024-11-26 19:18:11.726169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:54.900 [2024-11-26 19:18:11.726411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:54.900 [2024-11-26 19:18:11.726445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:54.900 [2024-11-26 19:18:11.726469] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:54.900 [2024-11-26 19:18:11.726906] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:54.900 [2024-11-26 19:18:11.727133] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:54.900 [2024-11-26 19:18:11.727143] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:54.900 [2024-11-26 19:18:11.727150] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:54.900 [2024-11-26 19:18:11.729405] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:54.900 [2024-11-26 19:18:11.738223] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:54.900 [2024-11-26 19:18:11.738489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:54.900 [2024-11-26 19:18:11.738723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:54.900 [2024-11-26 19:18:11.738759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:54.900 [2024-11-26 19:18:11.738783] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:54.900 [2024-11-26 19:18:11.739227] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:54.900 [2024-11-26 19:18:11.739340] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:54.900 [2024-11-26 19:18:11.739349] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:54.900 [2024-11-26 19:18:11.739355] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:54.900 [2024-11-26 19:18:11.741208] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:54.900 [2024-11-26 19:18:11.749993] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:54.900 [2024-11-26 19:18:11.750333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:54.900 [2024-11-26 19:18:11.750540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:54.900 [2024-11-26 19:18:11.750552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:54.900 [2024-11-26 19:18:11.750559] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:54.900 [2024-11-26 19:18:11.750640] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:54.900 [2024-11-26 19:18:11.750762] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:54.900 [2024-11-26 19:18:11.750770] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:54.900 [2024-11-26 19:18:11.750777] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:54.900 [2024-11-26 19:18:11.752633] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:54.900 [2024-11-26 19:18:11.761905] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:54.900 [2024-11-26 19:18:11.762312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:54.900 [2024-11-26 19:18:11.762587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:54.900 [2024-11-26 19:18:11.762622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:54.900 [2024-11-26 19:18:11.762646] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:54.900 [2024-11-26 19:18:11.763041] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:54.900 [2024-11-26 19:18:11.763334] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:54.900 [2024-11-26 19:18:11.763343] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:54.900 [2024-11-26 19:18:11.763350] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:54.900 [2024-11-26 19:18:11.765121] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:54.900 [2024-11-26 19:18:11.773519] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:54.900 [2024-11-26 19:18:11.773761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:54.900 [2024-11-26 19:18:11.773954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:54.900 [2024-11-26 19:18:11.773966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:54.900 [2024-11-26 19:18:11.773989] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:54.900 [2024-11-26 19:18:11.774134] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:54.900 [2024-11-26 19:18:11.774263] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:54.900 [2024-11-26 19:18:11.774273] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:54.900 [2024-11-26 19:18:11.774280] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:54.900 [2024-11-26 19:18:11.775921] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:54.900 [2024-11-26 19:18:11.785311] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:54.900 [2024-11-26 19:18:11.785698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:54.900 [2024-11-26 19:18:11.785967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:54.900 [2024-11-26 19:18:11.786002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:54.900 [2024-11-26 19:18:11.786027] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:54.900 [2024-11-26 19:18:11.786326] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:54.900 [2024-11-26 19:18:11.786458] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:54.900 [2024-11-26 19:18:11.786468] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:54.900 [2024-11-26 19:18:11.786477] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:54.901 [2024-11-26 19:18:11.788351] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:54.901 [2024-11-26 19:18:11.797298] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:54.901 [2024-11-26 19:18:11.797575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:54.901 [2024-11-26 19:18:11.797800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:54.901 [2024-11-26 19:18:11.797812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:54.901 [2024-11-26 19:18:11.797820] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:54.901 [2024-11-26 19:18:11.797935] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:54.901 [2024-11-26 19:18:11.798089] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:54.901 [2024-11-26 19:18:11.798102] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:54.901 [2024-11-26 19:18:11.798109] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:54.901 [2024-11-26 19:18:11.799918] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:54.901 [2024-11-26 19:18:11.809438] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:54.901 [2024-11-26 19:18:11.809781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:54.901 [2024-11-26 19:18:11.809963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:54.901 [2024-11-26 19:18:11.809992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:54.901 [2024-11-26 19:18:11.810001] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:54.901 [2024-11-26 19:18:11.810150] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:54.901 [2024-11-26 19:18:11.810298] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:54.901 [2024-11-26 19:18:11.810307] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:54.901 [2024-11-26 19:18:11.810314] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:54.901 [2024-11-26 19:18:11.812159] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.161 [2024-11-26 19:18:11.821416] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.161 [2024-11-26 19:18:11.822019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.161 [2024-11-26 19:18:11.822202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.161 [2024-11-26 19:18:11.822219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.161 [2024-11-26 19:18:11.822228] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.161 [2024-11-26 19:18:11.822400] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.161 [2024-11-26 19:18:11.822536] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.161 [2024-11-26 19:18:11.822548] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.161 [2024-11-26 19:18:11.822557] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.161 [2024-11-26 19:18:11.824399] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.161 [2024-11-26 19:18:11.833457] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.161 [2024-11-26 19:18:11.833742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.161 [2024-11-26 19:18:11.833881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.161 [2024-11-26 19:18:11.833894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.161 [2024-11-26 19:18:11.833902] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.161 [2024-11-26 19:18:11.833996] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.161 [2024-11-26 19:18:11.834115] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.161 [2024-11-26 19:18:11.834124] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.161 [2024-11-26 19:18:11.834134] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.161 [2024-11-26 19:18:11.835779] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.161 [2024-11-26 19:18:11.845438] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.161 [2024-11-26 19:18:11.845757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.161 [2024-11-26 19:18:11.845922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.161 [2024-11-26 19:18:11.845971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.161 [2024-11-26 19:18:11.845997] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.161 [2024-11-26 19:18:11.846279] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.161 [2024-11-26 19:18:11.846582] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.161 [2024-11-26 19:18:11.846592] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.161 [2024-11-26 19:18:11.846598] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.161 [2024-11-26 19:18:11.848318] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.161 [2024-11-26 19:18:11.857417] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.161 [2024-11-26 19:18:11.857729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.161 [2024-11-26 19:18:11.857883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.161 [2024-11-26 19:18:11.857895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.161 [2024-11-26 19:18:11.857928] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.161 [2024-11-26 19:18:11.858324] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.161 [2024-11-26 19:18:11.858551] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.161 [2024-11-26 19:18:11.858561] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.161 [2024-11-26 19:18:11.858568] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.161 [2024-11-26 19:18:11.860858] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.161 [2024-11-26 19:18:11.869890] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.161 [2024-11-26 19:18:11.870268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.161 [2024-11-26 19:18:11.870470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.161 [2024-11-26 19:18:11.870503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.161 [2024-11-26 19:18:11.870527] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.161 [2024-11-26 19:18:11.870806] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.161 [2024-11-26 19:18:11.870940] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.161 [2024-11-26 19:18:11.870955] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.161 [2024-11-26 19:18:11.870964] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.161 [2024-11-26 19:18:11.872977] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.161 [2024-11-26 19:18:11.881785] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.161 [2024-11-26 19:18:11.882085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.161 [2024-11-26 19:18:11.882283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.161 [2024-11-26 19:18:11.882317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.161 [2024-11-26 19:18:11.882340] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.161 [2024-11-26 19:18:11.882721] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.161 [2024-11-26 19:18:11.882897] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.161 [2024-11-26 19:18:11.882908] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.161 [2024-11-26 19:18:11.882914] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.161 [2024-11-26 19:18:11.884607] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.161 [2024-11-26 19:18:11.893678] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.161 [2024-11-26 19:18:11.893981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.161 [2024-11-26 19:18:11.894088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.161 [2024-11-26 19:18:11.894099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.161 [2024-11-26 19:18:11.894107] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.161 [2024-11-26 19:18:11.894242] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.161 [2024-11-26 19:18:11.894337] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.161 [2024-11-26 19:18:11.894346] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.161 [2024-11-26 19:18:11.894353] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.161 [2024-11-26 19:18:11.896005] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.161 [2024-11-26 19:18:11.905513] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.161 [2024-11-26 19:18:11.905767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.161 [2024-11-26 19:18:11.905874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.161 [2024-11-26 19:18:11.905886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.161 [2024-11-26 19:18:11.905894] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.161 [2024-11-26 19:18:11.906023] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.161 [2024-11-26 19:18:11.906147] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.161 [2024-11-26 19:18:11.906155] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.161 [2024-11-26 19:18:11.906162] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.161 [2024-11-26 19:18:11.907832] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.161 [2024-11-26 19:18:11.917307] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.161 [2024-11-26 19:18:11.917663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.161 [2024-11-26 19:18:11.917806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.161 [2024-11-26 19:18:11.917818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.161 [2024-11-26 19:18:11.917826] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.161 [2024-11-26 19:18:11.917941] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.161 [2024-11-26 19:18:11.918078] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.161 [2024-11-26 19:18:11.918088] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.161 [2024-11-26 19:18:11.918094] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.161 [2024-11-26 19:18:11.919858] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.161 [2024-11-26 19:18:11.929239] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.161 [2024-11-26 19:18:11.929554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.161 [2024-11-26 19:18:11.929666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.162 [2024-11-26 19:18:11.929700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.162 [2024-11-26 19:18:11.929724] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.162 [2024-11-26 19:18:11.930218] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.162 [2024-11-26 19:18:11.930455] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.162 [2024-11-26 19:18:11.930480] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.162 [2024-11-26 19:18:11.930501] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.162 [2024-11-26 19:18:11.932248] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.162 [2024-11-26 19:18:11.941214] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.162 [2024-11-26 19:18:11.941573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.162 [2024-11-26 19:18:11.941736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.162 [2024-11-26 19:18:11.941770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.162 [2024-11-26 19:18:11.941793] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.162 [2024-11-26 19:18:11.942239] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.162 [2024-11-26 19:18:11.942456] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.162 [2024-11-26 19:18:11.942465] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.162 [2024-11-26 19:18:11.942471] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.162 [2024-11-26 19:18:11.944240] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.162 [2024-11-26 19:18:11.952838] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.162 [2024-11-26 19:18:11.953100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.162 [2024-11-26 19:18:11.953325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.162 [2024-11-26 19:18:11.953358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.162 [2024-11-26 19:18:11.953381] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.162 [2024-11-26 19:18:11.953529] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.162 [2024-11-26 19:18:11.953623] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.162 [2024-11-26 19:18:11.953632] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.162 [2024-11-26 19:18:11.953638] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.162 [2024-11-26 19:18:11.955197] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.162 [2024-11-26 19:18:11.964741] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.162 [2024-11-26 19:18:11.965020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.162 [2024-11-26 19:18:11.965181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.162 [2024-11-26 19:18:11.965193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.162 [2024-11-26 19:18:11.965201] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.162 [2024-11-26 19:18:11.965302] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.162 [2024-11-26 19:18:11.965402] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.162 [2024-11-26 19:18:11.965410] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.162 [2024-11-26 19:18:11.965417] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.162 [2024-11-26 19:18:11.967266] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.162 [2024-11-26 19:18:11.976571] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.162 [2024-11-26 19:18:11.976778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.162 [2024-11-26 19:18:11.976886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.162 [2024-11-26 19:18:11.976897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.162 [2024-11-26 19:18:11.976906] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.162 [2024-11-26 19:18:11.977018] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.162 [2024-11-26 19:18:11.977142] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.162 [2024-11-26 19:18:11.977150] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.162 [2024-11-26 19:18:11.977156] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.162 [2024-11-26 19:18:11.978861] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.162 [2024-11-26 19:18:11.988450] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.162 [2024-11-26 19:18:11.988730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.162 [2024-11-26 19:18:11.988859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.162 [2024-11-26 19:18:11.988892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.162 [2024-11-26 19:18:11.988916] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.162 [2024-11-26 19:18:11.989161] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.162 [2024-11-26 19:18:11.989546] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.162 [2024-11-26 19:18:11.989572] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.162 [2024-11-26 19:18:11.989592] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.162 [2024-11-26 19:18:11.992132] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.162 [2024-11-26 19:18:12.001014] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.162 [2024-11-26 19:18:12.001276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.162 [2024-11-26 19:18:12.001481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.162 [2024-11-26 19:18:12.001493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.162 [2024-11-26 19:18:12.001501] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.162 [2024-11-26 19:18:12.001583] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.162 [2024-11-26 19:18:12.001666] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.162 [2024-11-26 19:18:12.001675] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.162 [2024-11-26 19:18:12.001682] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.162 [2024-11-26 19:18:12.003341] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.162 [2024-11-26 19:18:12.012859] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.162 [2024-11-26 19:18:12.013149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.162 [2024-11-26 19:18:12.013324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.162 [2024-11-26 19:18:12.013357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.162 [2024-11-26 19:18:12.013380] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.162 [2024-11-26 19:18:12.013760] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.162 [2024-11-26 19:18:12.013926] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.162 [2024-11-26 19:18:12.013935] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.162 [2024-11-26 19:18:12.013941] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.162 [2024-11-26 19:18:12.015732] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.162 [2024-11-26 19:18:12.024831] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.162 [2024-11-26 19:18:12.025114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.162 [2024-11-26 19:18:12.025274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.162 [2024-11-26 19:18:12.025309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.162 [2024-11-26 19:18:12.025340] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.162 [2024-11-26 19:18:12.025708] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.162 [2024-11-26 19:18:12.025803] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.162 [2024-11-26 19:18:12.025812] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.162 [2024-11-26 19:18:12.025818] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.162 [2024-11-26 19:18:12.027503] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.162 [2024-11-26 19:18:12.036588] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.162 [2024-11-26 19:18:12.036936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.162 [2024-11-26 19:18:12.037107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.162 [2024-11-26 19:18:12.037142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.162 [2024-11-26 19:18:12.037166] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.162 [2024-11-26 19:18:12.037646] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.162 [2024-11-26 19:18:12.037811] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.162 [2024-11-26 19:18:12.037820] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.162 [2024-11-26 19:18:12.037827] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.162 [2024-11-26 19:18:12.039554] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.162 [2024-11-26 19:18:12.048664] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.162 [2024-11-26 19:18:12.048929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.162 [2024-11-26 19:18:12.049094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.162 [2024-11-26 19:18:12.049107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.162 [2024-11-26 19:18:12.049115] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.162 [2024-11-26 19:18:12.049218] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.162 [2024-11-26 19:18:12.049366] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.162 [2024-11-26 19:18:12.049376] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.162 [2024-11-26 19:18:12.049384] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.162 [2024-11-26 19:18:12.051188] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.162 [2024-11-26 19:18:12.060638] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.162 [2024-11-26 19:18:12.061024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.162 [2024-11-26 19:18:12.061210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.162 [2024-11-26 19:18:12.061223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.162 [2024-11-26 19:18:12.061231] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.162 [2024-11-26 19:18:12.061337] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.162 [2024-11-26 19:18:12.061441] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.162 [2024-11-26 19:18:12.061449] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.162 [2024-11-26 19:18:12.061456] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.162 [2024-11-26 19:18:12.063183] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.162 [2024-11-26 19:18:12.072851] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.162 [2024-11-26 19:18:12.073164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.162 [2024-11-26 19:18:12.073328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.162 [2024-11-26 19:18:12.073341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.162 [2024-11-26 19:18:12.073349] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.162 [2024-11-26 19:18:12.073483] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.162 [2024-11-26 19:18:12.073571] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.162 [2024-11-26 19:18:12.073580] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.162 [2024-11-26 19:18:12.073589] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.162 [2024-11-26 19:18:12.075297] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.422 [2024-11-26 19:18:12.084900] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.422 [2024-11-26 19:18:12.085299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.422 [2024-11-26 19:18:12.085581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.422 [2024-11-26 19:18:12.085614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.422 [2024-11-26 19:18:12.085637] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.422 [2024-11-26 19:18:12.085963] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.422 [2024-11-26 19:18:12.086099] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.422 [2024-11-26 19:18:12.086109] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.422 [2024-11-26 19:18:12.086116] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.422 [2024-11-26 19:18:12.087983] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.422 [2024-11-26 19:18:12.096766] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.422 [2024-11-26 19:18:12.096966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.422 [2024-11-26 19:18:12.097056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.422 [2024-11-26 19:18:12.097067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.422 [2024-11-26 19:18:12.097075] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.422 [2024-11-26 19:18:12.097162] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.422 [2024-11-26 19:18:12.097299] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.422 [2024-11-26 19:18:12.097309] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.422 [2024-11-26 19:18:12.097316] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.422 [2024-11-26 19:18:12.099046] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.422 [2024-11-26 19:18:12.108714] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.422 [2024-11-26 19:18:12.109053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.422 [2024-11-26 19:18:12.109183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.422 [2024-11-26 19:18:12.109216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.422 [2024-11-26 19:18:12.109240] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.422 [2024-11-26 19:18:12.109669] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.422 [2024-11-26 19:18:12.110115] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.422 [2024-11-26 19:18:12.110142] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.422 [2024-11-26 19:18:12.110163] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.422 [2024-11-26 19:18:12.111978] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.422 [2024-11-26 19:18:12.120742] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.422 [2024-11-26 19:18:12.120953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.422 [2024-11-26 19:18:12.121062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.422 [2024-11-26 19:18:12.121072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.422 [2024-11-26 19:18:12.121079] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.422 [2024-11-26 19:18:12.121201] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.422 [2024-11-26 19:18:12.121310] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.422 [2024-11-26 19:18:12.121318] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.422 [2024-11-26 19:18:12.121324] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.422 [2024-11-26 19:18:12.123025] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.422 [2024-11-26 19:18:12.132546] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.422 [2024-11-26 19:18:12.132851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.422 [2024-11-26 19:18:12.133062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.422 [2024-11-26 19:18:12.133074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.422 [2024-11-26 19:18:12.133082] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.422 [2024-11-26 19:18:12.133176] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.422 [2024-11-26 19:18:12.133243] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.422 [2024-11-26 19:18:12.133254] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.423 [2024-11-26 19:18:12.133261] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.423 [2024-11-26 19:18:12.135000] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.423 [2024-11-26 19:18:12.144433] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.423 [2024-11-26 19:18:12.144690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.423 [2024-11-26 19:18:12.144803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.423 [2024-11-26 19:18:12.144818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.423 [2024-11-26 19:18:12.144827] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.423 [2024-11-26 19:18:12.144915] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.423 [2024-11-26 19:18:12.145090] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.423 [2024-11-26 19:18:12.145108] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.423 [2024-11-26 19:18:12.145118] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.423 [2024-11-26 19:18:12.146881] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.423 [2024-11-26 19:18:12.156569] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.423 [2024-11-26 19:18:12.156908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.423 [2024-11-26 19:18:12.157127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.423 [2024-11-26 19:18:12.157141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.423 [2024-11-26 19:18:12.157150] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.423 [2024-11-26 19:18:12.157268] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.423 [2024-11-26 19:18:12.157400] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.423 [2024-11-26 19:18:12.157412] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.423 [2024-11-26 19:18:12.157420] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.423 [2024-11-26 19:18:12.159179] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.423 [2024-11-26 19:18:12.168573] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.423 [2024-11-26 19:18:12.168829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.423 [2024-11-26 19:18:12.169064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.423 [2024-11-26 19:18:12.169078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.423 [2024-11-26 19:18:12.169087] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.423 [2024-11-26 19:18:12.169206] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.423 [2024-11-26 19:18:12.169339] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.423 [2024-11-26 19:18:12.169349] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.423 [2024-11-26 19:18:12.169360] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.423 [2024-11-26 19:18:12.171227] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.423 [2024-11-26 19:18:12.180876] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.423 [2024-11-26 19:18:12.181173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.423 [2024-11-26 19:18:12.181339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.423 [2024-11-26 19:18:12.181353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.423 [2024-11-26 19:18:12.181362] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.423 [2024-11-26 19:18:12.181492] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.423 [2024-11-26 19:18:12.181621] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.423 [2024-11-26 19:18:12.181632] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.423 [2024-11-26 19:18:12.181641] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.423 [2024-11-26 19:18:12.183477] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.423 [2024-11-26 19:18:12.192962] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.423 [2024-11-26 19:18:12.193279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.423 [2024-11-26 19:18:12.193509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.423 [2024-11-26 19:18:12.193523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.423 [2024-11-26 19:18:12.193532] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.423 [2024-11-26 19:18:12.193713] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.423 [2024-11-26 19:18:12.193844] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.423 [2024-11-26 19:18:12.193855] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.423 [2024-11-26 19:18:12.193863] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.423 [2024-11-26 19:18:12.195800] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.423 [2024-11-26 19:18:12.205020] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.423 [2024-11-26 19:18:12.205363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.423 [2024-11-26 19:18:12.205587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.423 [2024-11-26 19:18:12.205599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.423 [2024-11-26 19:18:12.205608] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.423 [2024-11-26 19:18:12.205760] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.423 [2024-11-26 19:18:12.205897] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.423 [2024-11-26 19:18:12.205907] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.423 [2024-11-26 19:18:12.205914] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.423 [2024-11-26 19:18:12.207692] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.423 [2024-11-26 19:18:12.217076] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.423 [2024-11-26 19:18:12.217411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.423 [2024-11-26 19:18:12.217691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.423 [2024-11-26 19:18:12.217725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.423 [2024-11-26 19:18:12.217748] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.423 [2024-11-26 19:18:12.218194] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.423 [2024-11-26 19:18:12.218581] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.423 [2024-11-26 19:18:12.218606] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.423 [2024-11-26 19:18:12.218629] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.423 [2024-11-26 19:18:12.220512] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.423 [2024-11-26 19:18:12.229008] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.423 [2024-11-26 19:18:12.229273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.423 [2024-11-26 19:18:12.229508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.423 [2024-11-26 19:18:12.229541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.423 [2024-11-26 19:18:12.229565] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.423 [2024-11-26 19:18:12.229946] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.423 [2024-11-26 19:18:12.230346] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.423 [2024-11-26 19:18:12.230371] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.423 [2024-11-26 19:18:12.230393] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.423 [2024-11-26 19:18:12.232149] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.423 [2024-11-26 19:18:12.241067] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.423 [2024-11-26 19:18:12.241331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.423 [2024-11-26 19:18:12.241544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.423 [2024-11-26 19:18:12.241577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.423 [2024-11-26 19:18:12.241602] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.423 [2024-11-26 19:18:12.241932] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.423 [2024-11-26 19:18:12.242235] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.423 [2024-11-26 19:18:12.242244] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.423 [2024-11-26 19:18:12.242251] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.423 [2024-11-26 19:18:12.243936] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.423 [2024-11-26 19:18:12.252793] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.424 [2024-11-26 19:18:12.253082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.424 [2024-11-26 19:18:12.253284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.424 [2024-11-26 19:18:12.253296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.424 [2024-11-26 19:18:12.253303] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.424 [2024-11-26 19:18:12.253440] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.424 [2024-11-26 19:18:12.253534] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.424 [2024-11-26 19:18:12.253543] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.424 [2024-11-26 19:18:12.253550] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.424 [2024-11-26 19:18:12.255133] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.424 [2024-11-26 19:18:12.264681] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.424 [2024-11-26 19:18:12.265049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.424 [2024-11-26 19:18:12.265246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.424 [2024-11-26 19:18:12.265280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.424 [2024-11-26 19:18:12.265304] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.424 [2024-11-26 19:18:12.265782] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.424 [2024-11-26 19:18:12.266184] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.424 [2024-11-26 19:18:12.266211] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.424 [2024-11-26 19:18:12.266233] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.424 [2024-11-26 19:18:12.268149] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.424 [2024-11-26 19:18:12.276536] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.424 [2024-11-26 19:18:12.276799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.424 [2024-11-26 19:18:12.277015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.424 [2024-11-26 19:18:12.277050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.424 [2024-11-26 19:18:12.277075] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.424 [2024-11-26 19:18:12.277406] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.424 [2024-11-26 19:18:12.277594] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.424 [2024-11-26 19:18:12.277603] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.424 [2024-11-26 19:18:12.277609] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.424 [2024-11-26 19:18:12.279255] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.424 [2024-11-26 19:18:12.288323] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.424 [2024-11-26 19:18:12.288693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.424 [2024-11-26 19:18:12.288989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.424 [2024-11-26 19:18:12.289025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.424 [2024-11-26 19:18:12.289050] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.424 [2024-11-26 19:18:12.289321] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.424 [2024-11-26 19:18:12.289431] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.424 [2024-11-26 19:18:12.289440] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.424 [2024-11-26 19:18:12.289448] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.424 [2024-11-26 19:18:12.291076] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.424 [2024-11-26 19:18:12.300331] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.424 [2024-11-26 19:18:12.300690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.424 [2024-11-26 19:18:12.300896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.424 [2024-11-26 19:18:12.300908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.424 [2024-11-26 19:18:12.300916] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.424 [2024-11-26 19:18:12.301037] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.424 [2024-11-26 19:18:12.301168] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.424 [2024-11-26 19:18:12.301177] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.424 [2024-11-26 19:18:12.301184] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.424 [2024-11-26 19:18:12.303091] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.424 [2024-11-26 19:18:12.312225] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.424 [2024-11-26 19:18:12.312586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.424 [2024-11-26 19:18:12.312821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.424 [2024-11-26 19:18:12.312853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.424 [2024-11-26 19:18:12.312877] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.424 [2024-11-26 19:18:12.313221] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.424 [2024-11-26 19:18:12.313513] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.424 [2024-11-26 19:18:12.313522] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.424 [2024-11-26 19:18:12.313528] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.424 [2024-11-26 19:18:12.315286] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.424 [2024-11-26 19:18:12.324230] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.424 [2024-11-26 19:18:12.324588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.424 [2024-11-26 19:18:12.324799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.424 [2024-11-26 19:18:12.324811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.424 [2024-11-26 19:18:12.324819] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.424 [2024-11-26 19:18:12.324913] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.424 [2024-11-26 19:18:12.325042] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.424 [2024-11-26 19:18:12.325051] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.424 [2024-11-26 19:18:12.325057] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.424 [2024-11-26 19:18:12.326788] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.424 [2024-11-26 19:18:12.335954] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.424 [2024-11-26 19:18:12.336366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.424 [2024-11-26 19:18:12.336591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.424 [2024-11-26 19:18:12.336602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.424 [2024-11-26 19:18:12.336610] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.424 [2024-11-26 19:18:12.336705] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.424 [2024-11-26 19:18:12.336813] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.424 [2024-11-26 19:18:12.336821] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.424 [2024-11-26 19:18:12.336827] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.424 [2024-11-26 19:18:12.338398] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.685 [2024-11-26 19:18:12.347781] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.685 [2024-11-26 19:18:12.348143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.685 [2024-11-26 19:18:12.348345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.685 [2024-11-26 19:18:12.348357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.685 [2024-11-26 19:18:12.348365] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.685 [2024-11-26 19:18:12.348488] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.685 [2024-11-26 19:18:12.348596] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.685 [2024-11-26 19:18:12.348606] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.685 [2024-11-26 19:18:12.348612] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.685 [2024-11-26 19:18:12.350313] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.685 [2024-11-26 19:18:12.359493] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.685 [2024-11-26 19:18:12.359817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.685 [2024-11-26 19:18:12.360063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.685 [2024-11-26 19:18:12.360076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.685 [2024-11-26 19:18:12.360086] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.685 [2024-11-26 19:18:12.360182] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.685 [2024-11-26 19:18:12.360276] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.685 [2024-11-26 19:18:12.360284] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.685 [2024-11-26 19:18:12.360291] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.685 [2024-11-26 19:18:12.361884] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.685 [2024-11-26 19:18:12.371206] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.685 [2024-11-26 19:18:12.371586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.685 [2024-11-26 19:18:12.371791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.685 [2024-11-26 19:18:12.371824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.685 [2024-11-26 19:18:12.371848] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.685 [2024-11-26 19:18:12.372097] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.685 [2024-11-26 19:18:12.372533] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.685 [2024-11-26 19:18:12.372568] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.685 [2024-11-26 19:18:12.372575] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.685 [2024-11-26 19:18:12.374404] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.685 [2024-11-26 19:18:12.383183] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.685 [2024-11-26 19:18:12.383548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.685 [2024-11-26 19:18:12.383694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.685 [2024-11-26 19:18:12.383727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.685 [2024-11-26 19:18:12.383750] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.685 [2024-11-26 19:18:12.384147] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.685 [2024-11-26 19:18:12.384484] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.685 [2024-11-26 19:18:12.384509] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.685 [2024-11-26 19:18:12.384531] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.685 [2024-11-26 19:18:12.386925] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.685 [2024-11-26 19:18:12.395823] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.685 [2024-11-26 19:18:12.396064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.685 [2024-11-26 19:18:12.396302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.685 [2024-11-26 19:18:12.396334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.685 [2024-11-26 19:18:12.396358] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.685 [2024-11-26 19:18:12.396796] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.685 [2024-11-26 19:18:12.396943] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.685 [2024-11-26 19:18:12.396958] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.685 [2024-11-26 19:18:12.396965] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.685 [2024-11-26 19:18:12.398817] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.685 [2024-11-26 19:18:12.407528] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.685 [2024-11-26 19:18:12.407795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.685 [2024-11-26 19:18:12.408041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.685 [2024-11-26 19:18:12.408075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.685 [2024-11-26 19:18:12.408099] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.685 [2024-11-26 19:18:12.408529] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.685 [2024-11-26 19:18:12.408834] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.685 [2024-11-26 19:18:12.408844] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.685 [2024-11-26 19:18:12.408851] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.685 [2024-11-26 19:18:12.410592] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.685 [2024-11-26 19:18:12.419354] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.685 [2024-11-26 19:18:12.419707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.685 [2024-11-26 19:18:12.419912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.685 [2024-11-26 19:18:12.419924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.685 [2024-11-26 19:18:12.419932] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.685 [2024-11-26 19:18:12.419991] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.685 [2024-11-26 19:18:12.420086] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.685 [2024-11-26 19:18:12.420095] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.685 [2024-11-26 19:18:12.420101] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.685 [2024-11-26 19:18:12.421846] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.685 [2024-11-26 19:18:12.431122] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.685 [2024-11-26 19:18:12.431378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.685 [2024-11-26 19:18:12.431590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.685 [2024-11-26 19:18:12.431602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.685 [2024-11-26 19:18:12.431609] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.685 [2024-11-26 19:18:12.431704] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.685 [2024-11-26 19:18:12.431802] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.686 [2024-11-26 19:18:12.431810] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.686 [2024-11-26 19:18:12.431816] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.686 [2024-11-26 19:18:12.433659] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.686 [2024-11-26 19:18:12.442965] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.686 [2024-11-26 19:18:12.443250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.686 [2024-11-26 19:18:12.443466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.686 [2024-11-26 19:18:12.443500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.686 [2024-11-26 19:18:12.443525] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.686 [2024-11-26 19:18:12.443905] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.686 [2024-11-26 19:18:12.444066] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.686 [2024-11-26 19:18:12.444076] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.686 [2024-11-26 19:18:12.444083] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.686 [2024-11-26 19:18:12.445841] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.686 [2024-11-26 19:18:12.455003] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.686 [2024-11-26 19:18:12.455399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.686 [2024-11-26 19:18:12.455651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.686 [2024-11-26 19:18:12.455683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.686 [2024-11-26 19:18:12.455707] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.686 [2024-11-26 19:18:12.456008] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.686 [2024-11-26 19:18:12.456138] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.686 [2024-11-26 19:18:12.456148] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.686 [2024-11-26 19:18:12.456154] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.686 [2024-11-26 19:18:12.458499] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.686 [2024-11-26 19:18:12.467393] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.686 [2024-11-26 19:18:12.467767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.686 [2024-11-26 19:18:12.467972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.686 [2024-11-26 19:18:12.468007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.686 [2024-11-26 19:18:12.468031] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.686 [2024-11-26 19:18:12.468362] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.686 [2024-11-26 19:18:12.468755] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.686 [2024-11-26 19:18:12.468767] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.686 [2024-11-26 19:18:12.468774] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.686 [2024-11-26 19:18:12.470610] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.686 [2024-11-26 19:18:12.479273] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.686 [2024-11-26 19:18:12.479661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.686 [2024-11-26 19:18:12.479927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.686 [2024-11-26 19:18:12.479974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.686 [2024-11-26 19:18:12.479999] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.686 [2024-11-26 19:18:12.480480] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.686 [2024-11-26 19:18:12.480842] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.686 [2024-11-26 19:18:12.480851] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.686 [2024-11-26 19:18:12.480858] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.686 [2024-11-26 19:18:12.482637] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.686 [2024-11-26 19:18:12.491165] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.686 [2024-11-26 19:18:12.491561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.686 [2024-11-26 19:18:12.491721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.686 [2024-11-26 19:18:12.491753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.686 [2024-11-26 19:18:12.491776] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.686 [2024-11-26 19:18:12.492072] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.686 [2024-11-26 19:18:12.492168] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.686 [2024-11-26 19:18:12.492177] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.686 [2024-11-26 19:18:12.492185] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.686 [2024-11-26 19:18:12.493861] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.686 [2024-11-26 19:18:12.502991] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.686 [2024-11-26 19:18:12.503326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.686 [2024-11-26 19:18:12.503565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.686 [2024-11-26 19:18:12.503598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.686 [2024-11-26 19:18:12.503622] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.686 [2024-11-26 19:18:12.504067] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.686 [2024-11-26 19:18:12.504256] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.686 [2024-11-26 19:18:12.504265] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.686 [2024-11-26 19:18:12.504277] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.686 [2024-11-26 19:18:12.506060] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.686 [2024-11-26 19:18:12.514738] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.686 [2024-11-26 19:18:12.515040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.686 [2024-11-26 19:18:12.515124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.686 [2024-11-26 19:18:12.515134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.686 [2024-11-26 19:18:12.515141] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.686 [2024-11-26 19:18:12.515235] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.686 [2024-11-26 19:18:12.515344] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.686 [2024-11-26 19:18:12.515352] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.686 [2024-11-26 19:18:12.515358] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.686 [2024-11-26 19:18:12.516929] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.686 [2024-11-26 19:18:12.526610] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.686 [2024-11-26 19:18:12.526853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.686 [2024-11-26 19:18:12.527081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.686 [2024-11-26 19:18:12.527095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.686 [2024-11-26 19:18:12.527103] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.686 [2024-11-26 19:18:12.527198] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.686 [2024-11-26 19:18:12.527334] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.686 [2024-11-26 19:18:12.527344] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.686 [2024-11-26 19:18:12.527350] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.686 [2024-11-26 19:18:12.528945] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.686 [2024-11-26 19:18:12.538499] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.686 [2024-11-26 19:18:12.538794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.686 [2024-11-26 19:18:12.538991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.686 [2024-11-26 19:18:12.539003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.686 [2024-11-26 19:18:12.539011] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.686 [2024-11-26 19:18:12.539136] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.686 [2024-11-26 19:18:12.539246] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.686 [2024-11-26 19:18:12.539254] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.686 [2024-11-26 19:18:12.539266] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.686 [2024-11-26 19:18:12.540955] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.686 [2024-11-26 19:18:12.550594] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.687 [2024-11-26 19:18:12.550856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.687 [2024-11-26 19:18:12.551062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.687 [2024-11-26 19:18:12.551076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.687 [2024-11-26 19:18:12.551084] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.687 [2024-11-26 19:18:12.551202] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.687 [2024-11-26 19:18:12.551320] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.687 [2024-11-26 19:18:12.551341] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.687 [2024-11-26 19:18:12.551348] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.687 [2024-11-26 19:18:12.553180] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.687 [2024-11-26 19:18:12.562534] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.687 [2024-11-26 19:18:12.562901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.687 [2024-11-26 19:18:12.563105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.687 [2024-11-26 19:18:12.563118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.687 [2024-11-26 19:18:12.563125] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.687 [2024-11-26 19:18:12.563233] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.687 [2024-11-26 19:18:12.563342] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.687 [2024-11-26 19:18:12.563350] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.687 [2024-11-26 19:18:12.563357] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.687 [2024-11-26 19:18:12.565087] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.687 [2024-11-26 19:18:12.574174] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.687 [2024-11-26 19:18:12.574435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.687 [2024-11-26 19:18:12.574584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.687 [2024-11-26 19:18:12.574595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.687 [2024-11-26 19:18:12.574628] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.687 [2024-11-26 19:18:12.575127] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.687 [2024-11-26 19:18:12.575270] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.687 [2024-11-26 19:18:12.575279] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.687 [2024-11-26 19:18:12.575286] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.687 [2024-11-26 19:18:12.576919] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.687 [2024-11-26 19:18:12.585955] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.687 [2024-11-26 19:18:12.586316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.687 [2024-11-26 19:18:12.586493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.687 [2024-11-26 19:18:12.586505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.687 [2024-11-26 19:18:12.586512] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.687 [2024-11-26 19:18:12.586635] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.687 [2024-11-26 19:18:12.586730] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.687 [2024-11-26 19:18:12.586739] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.687 [2024-11-26 19:18:12.586746] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.687 [2024-11-26 19:18:12.588415] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.687 [2024-11-26 19:18:12.597803] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.687 [2024-11-26 19:18:12.598227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.687 [2024-11-26 19:18:12.598487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.687 [2024-11-26 19:18:12.598521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.687 [2024-11-26 19:18:12.598545] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.687 [2024-11-26 19:18:12.598876] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.687 [2024-11-26 19:18:12.599273] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.687 [2024-11-26 19:18:12.599301] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.687 [2024-11-26 19:18:12.599323] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.687 [2024-11-26 19:18:12.601041] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.948 [2024-11-26 19:18:12.609766] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.948 [2024-11-26 19:18:12.610027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.948 [2024-11-26 19:18:12.610307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.948 [2024-11-26 19:18:12.610340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.948 [2024-11-26 19:18:12.610364] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.948 [2024-11-26 19:18:12.610583] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.948 [2024-11-26 19:18:12.610692] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.948 [2024-11-26 19:18:12.610701] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.948 [2024-11-26 19:18:12.610708] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.948 [2024-11-26 19:18:12.612533] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.948 [2024-11-26 19:18:12.621615] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.948 [2024-11-26 19:18:12.621987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.948 [2024-11-26 19:18:12.622140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.948 [2024-11-26 19:18:12.622174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.948 [2024-11-26 19:18:12.622197] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.948 [2024-11-26 19:18:12.622628] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.948 [2024-11-26 19:18:12.622862] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.948 [2024-11-26 19:18:12.622887] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.948 [2024-11-26 19:18:12.622910] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.948 [2024-11-26 19:18:12.624986] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.948 [2024-11-26 19:18:12.633413] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.948 [2024-11-26 19:18:12.633803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.948 [2024-11-26 19:18:12.634099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.948 [2024-11-26 19:18:12.634135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.948 [2024-11-26 19:18:12.634159] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.948 [2024-11-26 19:18:12.634429] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.948 [2024-11-26 19:18:12.634497] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.948 [2024-11-26 19:18:12.634506] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.948 [2024-11-26 19:18:12.634513] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.948 [2024-11-26 19:18:12.636129] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.948 [2024-11-26 19:18:12.645208] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.948 [2024-11-26 19:18:12.645570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.948 [2024-11-26 19:18:12.645785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.948 [2024-11-26 19:18:12.645818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.948 [2024-11-26 19:18:12.645841] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.948 [2024-11-26 19:18:12.646285] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.948 [2024-11-26 19:18:12.646596] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.948 [2024-11-26 19:18:12.646605] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.948 [2024-11-26 19:18:12.646612] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.948 [2024-11-26 19:18:12.648402] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.948 [2024-11-26 19:18:12.657125] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.948 [2024-11-26 19:18:12.657476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.948 [2024-11-26 19:18:12.657737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.948 [2024-11-26 19:18:12.657771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.948 [2024-11-26 19:18:12.657794] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.948 [2024-11-26 19:18:12.658140] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.948 [2024-11-26 19:18:12.658402] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.948 [2024-11-26 19:18:12.658412] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.948 [2024-11-26 19:18:12.658419] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.948 [2024-11-26 19:18:12.660322] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.948 [2024-11-26 19:18:12.669447] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.948 [2024-11-26 19:18:12.669725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.949 [2024-11-26 19:18:12.669960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.949 [2024-11-26 19:18:12.669973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.949 [2024-11-26 19:18:12.669981] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.949 [2024-11-26 19:18:12.670079] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.949 [2024-11-26 19:18:12.670220] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.949 [2024-11-26 19:18:12.670229] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.949 [2024-11-26 19:18:12.670236] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.949 [2024-11-26 19:18:12.672008] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.949 [2024-11-26 19:18:12.681308] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.949 [2024-11-26 19:18:12.681673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.949 [2024-11-26 19:18:12.681852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.949 [2024-11-26 19:18:12.681864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.949 [2024-11-26 19:18:12.681872] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.949 [2024-11-26 19:18:12.682031] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.949 [2024-11-26 19:18:12.682154] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.949 [2024-11-26 19:18:12.682163] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.949 [2024-11-26 19:18:12.682169] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.949 [2024-11-26 19:18:12.683803] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.949 [2024-11-26 19:18:12.693146] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.949 [2024-11-26 19:18:12.693481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.949 [2024-11-26 19:18:12.693682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.949 [2024-11-26 19:18:12.693694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.949 [2024-11-26 19:18:12.693704] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.949 [2024-11-26 19:18:12.693812] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.949 [2024-11-26 19:18:12.693907] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.949 [2024-11-26 19:18:12.693915] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.949 [2024-11-26 19:18:12.693922] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.949 [2024-11-26 19:18:12.695455] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.949 [2024-11-26 19:18:12.704986] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.949 [2024-11-26 19:18:12.705344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.949 [2024-11-26 19:18:12.705547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.949 [2024-11-26 19:18:12.705559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.949 [2024-11-26 19:18:12.705589] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.949 [2024-11-26 19:18:12.706136] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.949 [2024-11-26 19:18:12.706408] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.949 [2024-11-26 19:18:12.706417] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.949 [2024-11-26 19:18:12.706424] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.949 [2024-11-26 19:18:12.707994] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.949 [2024-11-26 19:18:12.716581] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.949 [2024-11-26 19:18:12.716946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.949 [2024-11-26 19:18:12.717156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.949 [2024-11-26 19:18:12.717189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.949 [2024-11-26 19:18:12.717213] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.949 [2024-11-26 19:18:12.717501] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.949 [2024-11-26 19:18:12.717555] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.949 [2024-11-26 19:18:12.717563] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.949 [2024-11-26 19:18:12.717570] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.949 [2024-11-26 19:18:12.719117] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.949 [2024-11-26 19:18:12.728415] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.949 [2024-11-26 19:18:12.728715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.949 [2024-11-26 19:18:12.728967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.949 [2024-11-26 19:18:12.729003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.949 [2024-11-26 19:18:12.729027] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.949 [2024-11-26 19:18:12.729526] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.949 [2024-11-26 19:18:12.729621] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.949 [2024-11-26 19:18:12.729629] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.949 [2024-11-26 19:18:12.729636] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.949 [2024-11-26 19:18:12.731358] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.949 [2024-11-26 19:18:12.740246] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.949 [2024-11-26 19:18:12.740610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.949 [2024-11-26 19:18:12.740814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.949 [2024-11-26 19:18:12.740847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.949 [2024-11-26 19:18:12.740871] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.949 [2024-11-26 19:18:12.741167] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.949 [2024-11-26 19:18:12.741604] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.949 [2024-11-26 19:18:12.741628] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.949 [2024-11-26 19:18:12.741649] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.949 [2024-11-26 19:18:12.743328] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.949 [2024-11-26 19:18:12.752091] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.949 [2024-11-26 19:18:12.752445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.949 [2024-11-26 19:18:12.752666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.949 [2024-11-26 19:18:12.752700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.949 [2024-11-26 19:18:12.752723] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.949 [2024-11-26 19:18:12.753068] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.949 [2024-11-26 19:18:12.753496] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.949 [2024-11-26 19:18:12.753505] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.949 [2024-11-26 19:18:12.753511] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.949 [2024-11-26 19:18:12.755233] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.949 [2024-11-26 19:18:12.764035] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.949 [2024-11-26 19:18:12.764433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.949 [2024-11-26 19:18:12.764634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.949 [2024-11-26 19:18:12.764666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.949 [2024-11-26 19:18:12.764690] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.949 [2024-11-26 19:18:12.764930] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.949 [2024-11-26 19:18:12.765067] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.949 [2024-11-26 19:18:12.765077] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.949 [2024-11-26 19:18:12.765084] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.949 [2024-11-26 19:18:12.766812] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.949 [2024-11-26 19:18:12.775790] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.949 [2024-11-26 19:18:12.776137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.949 [2024-11-26 19:18:12.776315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.949 [2024-11-26 19:18:12.776327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.949 [2024-11-26 19:18:12.776334] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.949 [2024-11-26 19:18:12.776457] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.950 [2024-11-26 19:18:12.776524] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.950 [2024-11-26 19:18:12.776532] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.950 [2024-11-26 19:18:12.776538] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.950 [2024-11-26 19:18:12.778209] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.950 [2024-11-26 19:18:12.787691] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.950 [2024-11-26 19:18:12.788024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.950 [2024-11-26 19:18:12.788251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.950 [2024-11-26 19:18:12.788263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.950 [2024-11-26 19:18:12.788271] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.950 [2024-11-26 19:18:12.788380] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.950 [2024-11-26 19:18:12.788489] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.950 [2024-11-26 19:18:12.788498] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.950 [2024-11-26 19:18:12.788505] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.950 [2024-11-26 19:18:12.790036] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.950 [2024-11-26 19:18:12.799639] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.950 [2024-11-26 19:18:12.800032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.950 [2024-11-26 19:18:12.800281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.950 [2024-11-26 19:18:12.800314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.950 [2024-11-26 19:18:12.800338] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.950 [2024-11-26 19:18:12.800571] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.950 [2024-11-26 19:18:12.800811] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.950 [2024-11-26 19:18:12.800838] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.950 [2024-11-26 19:18:12.800859] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.950 [2024-11-26 19:18:12.802758] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.950 [2024-11-26 19:18:12.811527] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.950 [2024-11-26 19:18:12.811876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.950 [2024-11-26 19:18:12.812091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.950 [2024-11-26 19:18:12.812126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.950 [2024-11-26 19:18:12.812149] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.950 [2024-11-26 19:18:12.812480] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.950 [2024-11-26 19:18:12.812762] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.950 [2024-11-26 19:18:12.812788] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.950 [2024-11-26 19:18:12.812811] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.950 [2024-11-26 19:18:12.814489] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.950 [2024-11-26 19:18:12.823472] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.950 [2024-11-26 19:18:12.823849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.950 [2024-11-26 19:18:12.824005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.950 [2024-11-26 19:18:12.824040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.950 [2024-11-26 19:18:12.824065] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.950 [2024-11-26 19:18:12.824495] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.950 [2024-11-26 19:18:12.824778] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.950 [2024-11-26 19:18:12.824803] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.950 [2024-11-26 19:18:12.824824] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.950 [2024-11-26 19:18:12.826762] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.950 [2024-11-26 19:18:12.835376] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.950 [2024-11-26 19:18:12.835737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.950 [2024-11-26 19:18:12.835892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.950 [2024-11-26 19:18:12.835903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.950 [2024-11-26 19:18:12.835911] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.950 [2024-11-26 19:18:12.836000] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.950 [2024-11-26 19:18:12.836096] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.950 [2024-11-26 19:18:12.836107] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.950 [2024-11-26 19:18:12.836114] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.950 [2024-11-26 19:18:12.837597] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.950 [2024-11-26 19:18:12.847323] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.950 [2024-11-26 19:18:12.847708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.950 [2024-11-26 19:18:12.847981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.950 [2024-11-26 19:18:12.848016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.950 [2024-11-26 19:18:12.848041] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.950 [2024-11-26 19:18:12.848163] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.950 [2024-11-26 19:18:12.848285] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.950 [2024-11-26 19:18:12.848295] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.950 [2024-11-26 19:18:12.848301] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.950 [2024-11-26 19:18:12.849869] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:55.950 [2024-11-26 19:18:12.859232] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:55.950 [2024-11-26 19:18:12.859579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.950 [2024-11-26 19:18:12.859843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:55.950 [2024-11-26 19:18:12.859876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:55.950 [2024-11-26 19:18:12.859900] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:55.950 [2024-11-26 19:18:12.860297] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:55.950 [2024-11-26 19:18:12.860573] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:55.950 [2024-11-26 19:18:12.860586] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:55.950 [2024-11-26 19:18:12.860596] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:55.950 [2024-11-26 19:18:12.863179] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:56.212 [2024-11-26 19:18:12.871382] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:56.212 [2024-11-26 19:18:12.871749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.212 [2024-11-26 19:18:12.871976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.212 [2024-11-26 19:18:12.872011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:56.212 [2024-11-26 19:18:12.872034] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:56.212 [2024-11-26 19:18:12.872415] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:56.212 [2024-11-26 19:18:12.872897] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:56.212 [2024-11-26 19:18:12.872922] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:56.212 [2024-11-26 19:18:12.872963] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:56.213 [2024-11-26 19:18:12.874649] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:56.213 [2024-11-26 19:18:12.883193] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:56.213 [2024-11-26 19:18:12.883607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.213 [2024-11-26 19:18:12.883814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.213 [2024-11-26 19:18:12.883848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:56.213 [2024-11-26 19:18:12.883871] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:56.213 [2024-11-26 19:18:12.884145] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:56.213 [2024-11-26 19:18:12.884227] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:56.213 [2024-11-26 19:18:12.884237] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:56.213 [2024-11-26 19:18:12.884244] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:56.213 [2024-11-26 19:18:12.885905] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:56.213 [2024-11-26 19:18:12.895103] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:56.213 [2024-11-26 19:18:12.895447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.213 [2024-11-26 19:18:12.895671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.213 [2024-11-26 19:18:12.895682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:56.213 [2024-11-26 19:18:12.895708] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:56.213 [2024-11-26 19:18:12.896205] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:56.213 [2024-11-26 19:18:12.896588] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:56.213 [2024-11-26 19:18:12.896613] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:56.213 [2024-11-26 19:18:12.896633] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:56.213 [2024-11-26 19:18:12.898675] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:56.213 [2024-11-26 19:18:12.906948] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:56.213 [2024-11-26 19:18:12.907340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.213 [2024-11-26 19:18:12.907613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.213 [2024-11-26 19:18:12.907647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:56.213 [2024-11-26 19:18:12.907670] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:56.213 [2024-11-26 19:18:12.907973] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:56.213 [2024-11-26 19:18:12.908083] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:56.213 [2024-11-26 19:18:12.908093] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:56.213 [2024-11-26 19:18:12.908100] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:56.213 [2024-11-26 19:18:12.909842] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:56.213 [2024-11-26 19:18:12.918827] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:56.213 [2024-11-26 19:18:12.919247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.213 [2024-11-26 19:18:12.919533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.213 [2024-11-26 19:18:12.919567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:56.213 [2024-11-26 19:18:12.919591] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:56.213 [2024-11-26 19:18:12.919986] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:56.213 [2024-11-26 19:18:12.920218] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:56.213 [2024-11-26 19:18:12.920227] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:56.213 [2024-11-26 19:18:12.920234] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:56.213 [2024-11-26 19:18:12.921873] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:56.213 [2024-11-26 19:18:12.930608] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:56.213 [2024-11-26 19:18:12.930982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.213 [2024-11-26 19:18:12.931239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.213 [2024-11-26 19:18:12.931272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:56.213 [2024-11-26 19:18:12.931295] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:56.213 [2024-11-26 19:18:12.931676] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:56.213 [2024-11-26 19:18:12.931946] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:56.213 [2024-11-26 19:18:12.931962] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:56.213 [2024-11-26 19:18:12.931968] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:56.213 [2024-11-26 19:18:12.933659] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:56.213 [2024-11-26 19:18:12.942343] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:56.213 [2024-11-26 19:18:12.942723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.213 [2024-11-26 19:18:12.942982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.213 [2024-11-26 19:18:12.943018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:56.213 [2024-11-26 19:18:12.943042] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:56.213 [2024-11-26 19:18:12.943317] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:56.213 [2024-11-26 19:18:12.943456] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:56.213 [2024-11-26 19:18:12.943465] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:56.213 [2024-11-26 19:18:12.943472] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:56.213 [2024-11-26 19:18:12.945276] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:56.213 [2024-11-26 19:18:12.954105] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:56.213 [2024-11-26 19:18:12.954482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.213 [2024-11-26 19:18:12.954645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.213 [2024-11-26 19:18:12.954679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:56.213 [2024-11-26 19:18:12.954702] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:56.213 [2024-11-26 19:18:12.954934] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:56.213 [2024-11-26 19:18:12.955252] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:56.213 [2024-11-26 19:18:12.955261] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:56.213 [2024-11-26 19:18:12.955267] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:56.213 [2024-11-26 19:18:12.956958] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:56.213 [2024-11-26 19:18:12.965983] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:56.213 [2024-11-26 19:18:12.966261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.213 [2024-11-26 19:18:12.966489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.213 [2024-11-26 19:18:12.966523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:56.213 [2024-11-26 19:18:12.966547] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:56.213 [2024-11-26 19:18:12.966829] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:56.213 [2024-11-26 19:18:12.967229] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:56.213 [2024-11-26 19:18:12.967257] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:56.213 [2024-11-26 19:18:12.967263] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:56.213 [2024-11-26 19:18:12.968912] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:56.213 [2024-11-26 19:18:12.977751] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:56.213 [2024-11-26 19:18:12.978116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.213 [2024-11-26 19:18:12.978379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.213 [2024-11-26 19:18:12.978414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:56.213 [2024-11-26 19:18:12.978438] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:56.213 [2024-11-26 19:18:12.978868] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:56.213 [2024-11-26 19:18:12.978985] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:56.213 [2024-11-26 19:18:12.978995] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:56.213 [2024-11-26 19:18:12.979001] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:56.213 [2024-11-26 19:18:12.980692] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:56.213 [2024-11-26 19:18:12.989464] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:56.213 [2024-11-26 19:18:12.989708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.213 [2024-11-26 19:18:12.989945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.213 [2024-11-26 19:18:12.989994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:56.213 [2024-11-26 19:18:12.990017] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:56.214 [2024-11-26 19:18:12.990351] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:56.214 [2024-11-26 19:18:12.990447] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:56.214 [2024-11-26 19:18:12.990456] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:56.214 [2024-11-26 19:18:12.990463] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:56.214 [2024-11-26 19:18:12.992249] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:56.214 [2024-11-26 19:18:13.001274] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:56.214 [2024-11-26 19:18:13.001631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.214 [2024-11-26 19:18:13.001835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.214 [2024-11-26 19:18:13.001847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:56.214 [2024-11-26 19:18:13.001855] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:56.214 [2024-11-26 19:18:13.001956] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:56.214 [2024-11-26 19:18:13.002080] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:56.214 [2024-11-26 19:18:13.002088] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:56.214 [2024-11-26 19:18:13.002095] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:56.214 [2024-11-26 19:18:13.003799] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:56.214 [2024-11-26 19:18:13.013113] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:56.214 [2024-11-26 19:18:13.013465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.214 [2024-11-26 19:18:13.013664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.214 [2024-11-26 19:18:13.013677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:56.214 [2024-11-26 19:18:13.013684] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:56.214 [2024-11-26 19:18:13.013793] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:56.214 [2024-11-26 19:18:13.013888] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:56.214 [2024-11-26 19:18:13.013896] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:56.214 [2024-11-26 19:18:13.013903] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:56.214 [2024-11-26 19:18:13.015549] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:56.214 [2024-11-26 19:18:13.025173] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:56.214 [2024-11-26 19:18:13.025561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.214 [2024-11-26 19:18:13.025805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.214 [2024-11-26 19:18:13.025838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:56.214 [2024-11-26 19:18:13.025869] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:56.214 [2024-11-26 19:18:13.026158] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:56.214 [2024-11-26 19:18:13.026268] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:56.214 [2024-11-26 19:18:13.026278] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:56.214 [2024-11-26 19:18:13.026284] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:56.214 [2024-11-26 19:18:13.028006] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:56.214 [2024-11-26 19:18:13.037023] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:56.214 [2024-11-26 19:18:13.037323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.214 [2024-11-26 19:18:13.037572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.214 [2024-11-26 19:18:13.037584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:56.214 [2024-11-26 19:18:13.037592] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:56.214 [2024-11-26 19:18:13.038098] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:56.214 [2024-11-26 19:18:13.038220] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:56.214 [2024-11-26 19:18:13.038229] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:56.214 [2024-11-26 19:18:13.038235] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:56.214 [2024-11-26 19:18:13.039845] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:56.214 [2024-11-26 19:18:13.048944] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:56.214 [2024-11-26 19:18:13.049311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.214 [2024-11-26 19:18:13.049544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.214 [2024-11-26 19:18:13.049578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:56.214 [2024-11-26 19:18:13.049602] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:56.214 [2024-11-26 19:18:13.049835] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:56.214 [2024-11-26 19:18:13.050162] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:56.214 [2024-11-26 19:18:13.050171] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:56.214 [2024-11-26 19:18:13.050178] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:56.214 [2024-11-26 19:18:13.051993] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:56.214 [2024-11-26 19:18:13.060977] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:56.214 [2024-11-26 19:18:13.061303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.214 [2024-11-26 19:18:13.061526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.214 [2024-11-26 19:18:13.061560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:56.214 [2024-11-26 19:18:13.061597] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:56.214 [2024-11-26 19:18:13.061992] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:56.214 [2024-11-26 19:18:13.062280] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:56.214 [2024-11-26 19:18:13.062317] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:56.214 [2024-11-26 19:18:13.062325] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:56.214 [2024-11-26 19:18:13.063978] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:56.214 [2024-11-26 19:18:13.072877] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:56.214 [2024-11-26 19:18:13.073249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.214 [2024-11-26 19:18:13.073516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.214 [2024-11-26 19:18:13.073549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:56.214 [2024-11-26 19:18:13.073572] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:56.214 [2024-11-26 19:18:13.073727] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:56.214 [2024-11-26 19:18:13.073868] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:56.214 [2024-11-26 19:18:13.073878] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:56.214 [2024-11-26 19:18:13.073884] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:56.214 [2024-11-26 19:18:13.075636] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:56.214 [2024-11-26 19:18:13.084644] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:56.214 [2024-11-26 19:18:13.084996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.214 [2024-11-26 19:18:13.085144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.214 [2024-11-26 19:18:13.085156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:56.214 [2024-11-26 19:18:13.085164] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:56.214 [2024-11-26 19:18:13.085273] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:56.214 [2024-11-26 19:18:13.085437] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:56.214 [2024-11-26 19:18:13.085447] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:56.214 [2024-11-26 19:18:13.085453] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:56.214 [2024-11-26 19:18:13.087093] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:56.214 [2024-11-26 19:18:13.096601] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:56.214 [2024-11-26 19:18:13.096945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.214 [2024-11-26 19:18:13.097207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.214 [2024-11-26 19:18:13.097241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:56.214 [2024-11-26 19:18:13.097265] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:56.214 [2024-11-26 19:18:13.097588] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:56.214 [2024-11-26 19:18:13.097698] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:56.214 [2024-11-26 19:18:13.097707] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:56.214 [2024-11-26 19:18:13.097713] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:56.214 [2024-11-26 19:18:13.099516] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:56.214 [2024-11-26 19:18:13.108488] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:56.214 [2024-11-26 19:18:13.108807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.214 [2024-11-26 19:18:13.109022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.215 [2024-11-26 19:18:13.109035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:56.215 [2024-11-26 19:18:13.109043] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:56.215 [2024-11-26 19:18:13.109180] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:56.215 [2024-11-26 19:18:13.109316] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:56.215 [2024-11-26 19:18:13.109325] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:56.215 [2024-11-26 19:18:13.109331] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:56.215 [2024-11-26 19:18:13.111024] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:56.215 [2024-11-26 19:18:13.120353] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:56.215 [2024-11-26 19:18:13.120737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.215 [2024-11-26 19:18:13.120895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.215 [2024-11-26 19:18:13.120908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:56.215 [2024-11-26 19:18:13.120917] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:56.215 [2024-11-26 19:18:13.121069] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:56.215 [2024-11-26 19:18:13.121193] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:56.215 [2024-11-26 19:18:13.121202] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:56.215 [2024-11-26 19:18:13.121208] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:56.215 [2024-11-26 19:18:13.122999] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:56.215 [2024-11-26 19:18:13.132320] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:56.215 [2024-11-26 19:18:13.132675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.215 [2024-11-26 19:18:13.132879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.215 [2024-11-26 19:18:13.132911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:56.215 [2024-11-26 19:18:13.132935] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:56.215 [2024-11-26 19:18:13.133284] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:56.215 [2024-11-26 19:18:13.133575] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:56.215 [2024-11-26 19:18:13.133606] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:56.215 [2024-11-26 19:18:13.133613] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:56.479 [2024-11-26 19:18:13.136125] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:56.479 [2024-11-26 19:18:13.144884] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:56.479 [2024-11-26 19:18:13.145279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.479 [2024-11-26 19:18:13.145547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.479 [2024-11-26 19:18:13.145579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:56.479 [2024-11-26 19:18:13.145603] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:56.479 [2024-11-26 19:18:13.145742] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:56.479 [2024-11-26 19:18:13.145872] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:56.479 [2024-11-26 19:18:13.145882] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:56.479 [2024-11-26 19:18:13.145889] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:56.479 [2024-11-26 19:18:13.147542] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:56.479 [2024-11-26 19:18:13.156679] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:56.479 [2024-11-26 19:18:13.157076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.479 [2024-11-26 19:18:13.157351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.479 [2024-11-26 19:18:13.157384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:56.479 [2024-11-26 19:18:13.157408] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:56.479 [2024-11-26 19:18:13.157719] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:56.479 [2024-11-26 19:18:13.157842] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:56.479 [2024-11-26 19:18:13.157852] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:56.479 [2024-11-26 19:18:13.157860] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:56.479 [2024-11-26 19:18:13.159738] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:56.479 [2024-11-26 19:18:13.168622] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:56.479 [2024-11-26 19:18:13.168967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.479 [2024-11-26 19:18:13.169267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.479 [2024-11-26 19:18:13.169299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:56.479 [2024-11-26 19:18:13.169323] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:56.479 [2024-11-26 19:18:13.169524] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:56.479 [2024-11-26 19:18:13.169634] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:56.479 [2024-11-26 19:18:13.169646] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:56.479 [2024-11-26 19:18:13.169653] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:56.479 [2024-11-26 19:18:13.171256] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:56.479 [2024-11-26 19:18:13.180506] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:56.479 [2024-11-26 19:18:13.180842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.479 [2024-11-26 19:18:13.181122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.479 [2024-11-26 19:18:13.181158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:56.479 [2024-11-26 19:18:13.181181] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:56.479 [2024-11-26 19:18:13.181463] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:56.479 [2024-11-26 19:18:13.181846] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:56.479 [2024-11-26 19:18:13.181871] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:56.479 [2024-11-26 19:18:13.181902] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:56.479 [2024-11-26 19:18:13.183682] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:56.479 [2024-11-26 19:18:13.192271] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:56.479 [2024-11-26 19:18:13.192580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.479 [2024-11-26 19:18:13.192812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.479 [2024-11-26 19:18:13.192845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:56.479 [2024-11-26 19:18:13.192869] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:56.479 [2024-11-26 19:18:13.193264] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:56.479 [2024-11-26 19:18:13.193549] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:56.479 [2024-11-26 19:18:13.193574] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:56.479 [2024-11-26 19:18:13.193596] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:56.479 [2024-11-26 19:18:13.195865] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:56.479 [2024-11-26 19:18:13.204917] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:56.479 [2024-11-26 19:18:13.205281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.479 [2024-11-26 19:18:13.205542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.479 [2024-11-26 19:18:13.205576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:56.479 [2024-11-26 19:18:13.205600] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:56.479 [2024-11-26 19:18:13.205963] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:56.479 [2024-11-26 19:18:13.206091] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:56.479 [2024-11-26 19:18:13.206100] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:56.479 [2024-11-26 19:18:13.206111] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:56.479 [2024-11-26 19:18:13.207890] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:56.479 [2024-11-26 19:18:13.216870] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:56.479 [2024-11-26 19:18:13.217230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.479 [2024-11-26 19:18:13.217457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.479 [2024-11-26 19:18:13.217470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:56.479 [2024-11-26 19:18:13.217479] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:56.479 [2024-11-26 19:18:13.217597] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:56.479 [2024-11-26 19:18:13.217731] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:56.479 [2024-11-26 19:18:13.217741] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:56.479 [2024-11-26 19:18:13.217747] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:56.479 [2024-11-26 19:18:13.219641] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:56.479 [2024-11-26 19:18:13.228882] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:56.479 [2024-11-26 19:18:13.229252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.479 [2024-11-26 19:18:13.229435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.479 [2024-11-26 19:18:13.229447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:56.479 [2024-11-26 19:18:13.229455] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:56.479 [2024-11-26 19:18:13.229573] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:56.479 [2024-11-26 19:18:13.229693] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:56.479 [2024-11-26 19:18:13.229703] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:56.479 [2024-11-26 19:18:13.229710] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:56.479 [2024-11-26 19:18:13.231364] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:56.479 [2024-11-26 19:18:13.240837] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:56.480 [2024-11-26 19:18:13.241145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.480 [2024-11-26 19:18:13.241377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.480 [2024-11-26 19:18:13.241389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:56.480 [2024-11-26 19:18:13.241398] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:56.480 [2024-11-26 19:18:13.241547] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:56.480 [2024-11-26 19:18:13.241635] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:56.480 [2024-11-26 19:18:13.241645] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:56.480 [2024-11-26 19:18:13.241652] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:56.480 [2024-11-26 19:18:13.243395] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:56.480 [2024-11-26 19:18:13.252783] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:56.480 [2024-11-26 19:18:13.253106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.480 [2024-11-26 19:18:13.253311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.480 [2024-11-26 19:18:13.253324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:56.480 [2024-11-26 19:18:13.253333] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:56.480 [2024-11-26 19:18:13.253466] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:56.480 [2024-11-26 19:18:13.253585] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:56.480 [2024-11-26 19:18:13.253595] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:56.480 [2024-11-26 19:18:13.253601] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:56.480 [2024-11-26 19:18:13.255239] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:56.480 [2024-11-26 19:18:13.264996] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:56.480 [2024-11-26 19:18:13.265294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.480 [2024-11-26 19:18:13.265506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.480 [2024-11-26 19:18:13.265518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:56.480 [2024-11-26 19:18:13.265527] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:56.480 [2024-11-26 19:18:13.265645] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:56.480 [2024-11-26 19:18:13.265718] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:56.480 [2024-11-26 19:18:13.265727] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:56.480 [2024-11-26 19:18:13.265734] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:56.480 [2024-11-26 19:18:13.267573] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:56.480 [2024-11-26 19:18:13.276916] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:56.480 [2024-11-26 19:18:13.277221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.480 [2024-11-26 19:18:13.277451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.480 [2024-11-26 19:18:13.277463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:56.480 [2024-11-26 19:18:13.277472] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:56.480 [2024-11-26 19:18:13.277560] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:56.480 [2024-11-26 19:18:13.277633] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:56.480 [2024-11-26 19:18:13.277642] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:56.480 [2024-11-26 19:18:13.277650] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:56.480 [2024-11-26 19:18:13.279347] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:56.480 [2024-11-26 19:18:13.288938] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:56.480 [2024-11-26 19:18:13.289329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.480 [2024-11-26 19:18:13.289564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.480 [2024-11-26 19:18:13.289577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:56.480 [2024-11-26 19:18:13.289585] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:56.480 [2024-11-26 19:18:13.289703] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:56.480 [2024-11-26 19:18:13.289822] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:56.480 [2024-11-26 19:18:13.289832] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:56.480 [2024-11-26 19:18:13.289839] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:56.480 [2024-11-26 19:18:13.291734] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:56.480 [2024-11-26 19:18:13.300905] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:56.480 [2024-11-26 19:18:13.301222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.480 [2024-11-26 19:18:13.301334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.480 [2024-11-26 19:18:13.301347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:56.480 [2024-11-26 19:18:13.301355] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:56.480 [2024-11-26 19:18:13.301474] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:56.480 [2024-11-26 19:18:13.301577] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:56.480 [2024-11-26 19:18:13.301587] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:56.480 [2024-11-26 19:18:13.301595] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:56.480 [2024-11-26 19:18:13.303464] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:56.480 [2024-11-26 19:18:13.312977] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:56.480 [2024-11-26 19:18:13.313273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.480 [2024-11-26 19:18:13.313510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.480 [2024-11-26 19:18:13.313543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:56.480 [2024-11-26 19:18:13.313567] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:56.480 [2024-11-26 19:18:13.313842] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:56.480 [2024-11-26 19:18:13.313955] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:56.480 [2024-11-26 19:18:13.313966] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:56.480 [2024-11-26 19:18:13.313973] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:56.480 [2024-11-26 19:18:13.315548] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:56.480 [2024-11-26 19:18:13.324684] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:56.480 [2024-11-26 19:18:13.325068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.480 [2024-11-26 19:18:13.325288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.480 [2024-11-26 19:18:13.325322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:56.480 [2024-11-26 19:18:13.325347] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:56.480 [2024-11-26 19:18:13.325728] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:56.480 [2024-11-26 19:18:13.326035] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:56.480 [2024-11-26 19:18:13.326048] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:56.480 [2024-11-26 19:18:13.326058] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:56.480 [2024-11-26 19:18:13.328617] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:56.480 [2024-11-26 19:18:13.337095] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:56.480 [2024-11-26 19:18:13.337372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.480 [2024-11-26 19:18:13.337522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.480 [2024-11-26 19:18:13.337554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:56.480 [2024-11-26 19:18:13.337578] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:56.481 [2024-11-26 19:18:13.337810] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:56.481 [2024-11-26 19:18:13.337974] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:56.481 [2024-11-26 19:18:13.337984] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:56.481 [2024-11-26 19:18:13.337991] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:56.481 [2024-11-26 19:18:13.339803] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:56.481 [2024-11-26 19:18:13.348894] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:56.481 [2024-11-26 19:18:13.349148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.481 [2024-11-26 19:18:13.349283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.481 [2024-11-26 19:18:13.349295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:56.481 [2024-11-26 19:18:13.349303] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:56.481 [2024-11-26 19:18:13.349382] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:56.481 [2024-11-26 19:18:13.349477] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:56.481 [2024-11-26 19:18:13.349486] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:56.481 [2024-11-26 19:18:13.349493] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:56.481 [2024-11-26 19:18:13.351332] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:56.481 [2024-11-26 19:18:13.360719] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:56.481 [2024-11-26 19:18:13.361072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.481 [2024-11-26 19:18:13.361256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.481 [2024-11-26 19:18:13.361298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:56.481 [2024-11-26 19:18:13.361322] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:56.481 [2024-11-26 19:18:13.361703] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:56.481 [2024-11-26 19:18:13.362008] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:56.481 [2024-11-26 19:18:13.362018] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:56.481 [2024-11-26 19:18:13.362025] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:56.481 [2024-11-26 19:18:13.363633] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:56.481 [2024-11-26 19:18:13.372668] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:56.481 [2024-11-26 19:18:13.372966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.481 [2024-11-26 19:18:13.373176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.481 [2024-11-26 19:18:13.373211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:56.481 [2024-11-26 19:18:13.373235] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:56.481 [2024-11-26 19:18:13.373716] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:56.481 [2024-11-26 19:18:13.374120] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:56.481 [2024-11-26 19:18:13.374151] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:56.481 [2024-11-26 19:18:13.374173] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:56.481 [2024-11-26 19:18:13.375977] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:56.481 [2024-11-26 19:18:13.384408] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:56.481 [2024-11-26 19:18:13.384786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.481 [2024-11-26 19:18:13.385001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.481 [2024-11-26 19:18:13.385036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:56.481 [2024-11-26 19:18:13.385060] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:56.481 [2024-11-26 19:18:13.385531] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:56.481 [2024-11-26 19:18:13.385655] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:56.481 [2024-11-26 19:18:13.385664] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:56.481 [2024-11-26 19:18:13.385670] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:56.481 [2024-11-26 19:18:13.387191] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:56.481 [2024-11-26 19:18:13.396272] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:56.481 [2024-11-26 19:18:13.396623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.481 [2024-11-26 19:18:13.396835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.481 [2024-11-26 19:18:13.396848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:56.481 [2024-11-26 19:18:13.396860] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:56.481 [2024-11-26 19:18:13.396969] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:56.481 [2024-11-26 19:18:13.397088] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:56.481 [2024-11-26 19:18:13.397097] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:56.481 [2024-11-26 19:18:13.397104] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:56.481 [2024-11-26 19:18:13.398996] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:56.741 [2024-11-26 19:18:13.408271] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:56.741 [2024-11-26 19:18:13.408608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.741 [2024-11-26 19:18:13.408837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.741 [2024-11-26 19:18:13.408850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:56.741 [2024-11-26 19:18:13.408858] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:56.741 [2024-11-26 19:18:13.408980] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:56.741 [2024-11-26 19:18:13.409082] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:56.741 [2024-11-26 19:18:13.409090] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:56.741 [2024-11-26 19:18:13.409097] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:56.741 [2024-11-26 19:18:13.411074] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:56.741 [2024-11-26 19:18:13.420164] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:56.741 [2024-11-26 19:18:13.420508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.741 [2024-11-26 19:18:13.420770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.741 [2024-11-26 19:18:13.420803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:56.741 [2024-11-26 19:18:13.420828] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:56.741 [2024-11-26 19:18:13.421129] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:56.742 [2024-11-26 19:18:13.421239] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:56.742 [2024-11-26 19:18:13.421249] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:56.742 [2024-11-26 19:18:13.421256] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:56.742 [2024-11-26 19:18:13.422825] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:56.742 [2024-11-26 19:18:13.431933] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:56.742 [2024-11-26 19:18:13.432267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.742 [2024-11-26 19:18:13.432437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.742 [2024-11-26 19:18:13.432471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:56.742 [2024-11-26 19:18:13.432494] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:56.742 [2024-11-26 19:18:13.432785] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:56.742 [2024-11-26 19:18:13.433235] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:56.742 [2024-11-26 19:18:13.433263] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:56.742 [2024-11-26 19:18:13.433286] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:56.742 [2024-11-26 19:18:13.435231] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:56.742 [2024-11-26 19:18:13.443761] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:56.742 [2024-11-26 19:18:13.444052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.742 [2024-11-26 19:18:13.444211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.742 [2024-11-26 19:18:13.444244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:56.742 [2024-11-26 19:18:13.444269] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:56.742 [2024-11-26 19:18:13.444601] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:56.742 [2024-11-26 19:18:13.445096] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:56.742 [2024-11-26 19:18:13.445123] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:56.742 [2024-11-26 19:18:13.445146] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:56.742 [2024-11-26 19:18:13.446884] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:56.742 [2024-11-26 19:18:13.455602] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:56.742 [2024-11-26 19:18:13.455975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.742 [2024-11-26 19:18:13.456217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.742 [2024-11-26 19:18:13.456253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:56.742 [2024-11-26 19:18:13.456277] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:56.742 [2024-11-26 19:18:13.456558] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:56.742 [2024-11-26 19:18:13.456892] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:56.742 [2024-11-26 19:18:13.456918] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:56.742 [2024-11-26 19:18:13.456940] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:56.742 [2024-11-26 19:18:13.459763] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:56.742 [2024-11-26 19:18:13.468111] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:56.742 [2024-11-26 19:18:13.468342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.742 [2024-11-26 19:18:13.468513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.742 [2024-11-26 19:18:13.468547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:56.742 [2024-11-26 19:18:13.468571] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:56.742 [2024-11-26 19:18:13.468852] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:56.742 [2024-11-26 19:18:13.469152] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:56.742 [2024-11-26 19:18:13.469162] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:56.742 [2024-11-26 19:18:13.469168] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:56.742 [2024-11-26 19:18:13.470935] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:56.742 [2024-11-26 19:18:13.480057] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:56.742 [2024-11-26 19:18:13.480335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.742 [2024-11-26 19:18:13.480512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.742 [2024-11-26 19:18:13.480545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:56.742 [2024-11-26 19:18:13.480570] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:56.742 [2024-11-26 19:18:13.480898] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:56.742 [2024-11-26 19:18:13.481146] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:56.742 [2024-11-26 19:18:13.481173] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:56.742 [2024-11-26 19:18:13.481194] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:56.742 [2024-11-26 19:18:13.482918] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:56.742 [2024-11-26 19:18:13.491802] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:56.742 [2024-11-26 19:18:13.492096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.742 [2024-11-26 19:18:13.492202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.742 [2024-11-26 19:18:13.492213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:56.742 [2024-11-26 19:18:13.492220] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:56.742 [2024-11-26 19:18:13.492315] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:56.742 [2024-11-26 19:18:13.492409] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:56.742 [2024-11-26 19:18:13.492418] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:56.742 [2024-11-26 19:18:13.492424] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:56.742 [2024-11-26 19:18:13.494057] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:56.742 [2024-11-26 19:18:13.503622] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:56.742 [2024-11-26 19:18:13.503958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.742 [2024-11-26 19:18:13.504154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.742 [2024-11-26 19:18:13.504166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:56.742 [2024-11-26 19:18:13.504174] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:56.742 [2024-11-26 19:18:13.504269] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:56.742 [2024-11-26 19:18:13.504378] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:56.742 [2024-11-26 19:18:13.504389] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:56.742 [2024-11-26 19:18:13.504396] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:56.742 [2024-11-26 19:18:13.506136] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:56.742 [2024-11-26 19:18:13.515280] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:56.742 [2024-11-26 19:18:13.515503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.742 [2024-11-26 19:18:13.515706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.742 [2024-11-26 19:18:13.515739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:56.742 [2024-11-26 19:18:13.515762] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:56.742 [2024-11-26 19:18:13.516055] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:56.742 [2024-11-26 19:18:13.516305] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:56.742 [2024-11-26 19:18:13.516314] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:56.742 [2024-11-26 19:18:13.516320] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:56.742 [2024-11-26 19:18:13.517849] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:56.742 [2024-11-26 19:18:13.527260] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:56.742 [2024-11-26 19:18:13.527526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.742 [2024-11-26 19:18:13.527736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.742 [2024-11-26 19:18:13.527769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:56.742 [2024-11-26 19:18:13.527792] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:56.742 [2024-11-26 19:18:13.528186] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:56.742 [2024-11-26 19:18:13.528452] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:56.742 [2024-11-26 19:18:13.528462] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:56.742 [2024-11-26 19:18:13.528468] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:56.742 [2024-11-26 19:18:13.530138] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:56.743 [2024-11-26 19:18:13.538974] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:56.743 [2024-11-26 19:18:13.539261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.743 [2024-11-26 19:18:13.539471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.743 [2024-11-26 19:18:13.539503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:56.743 [2024-11-26 19:18:13.539527] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:56.743 [2024-11-26 19:18:13.539834] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:56.743 [2024-11-26 19:18:13.539965] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:56.743 [2024-11-26 19:18:13.539975] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:56.743 [2024-11-26 19:18:13.539985] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:56.743 [2024-11-26 19:18:13.541607] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:56.743 [2024-11-26 19:18:13.550816] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:56.743 [2024-11-26 19:18:13.551152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.743 [2024-11-26 19:18:13.551267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.743 [2024-11-26 19:18:13.551278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:56.743 [2024-11-26 19:18:13.551285] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:56.743 [2024-11-26 19:18:13.551366] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:56.743 [2024-11-26 19:18:13.551475] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:56.743 [2024-11-26 19:18:13.551484] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:56.743 [2024-11-26 19:18:13.551490] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:56.743 [2024-11-26 19:18:13.553211] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:56.743 [2024-11-26 19:18:13.562758] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:56.743 [2024-11-26 19:18:13.563041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.743 [2024-11-26 19:18:13.563192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.743 [2024-11-26 19:18:13.563204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:56.743 [2024-11-26 19:18:13.563212] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:56.743 [2024-11-26 19:18:13.563328] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:56.743 [2024-11-26 19:18:13.563458] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:56.743 [2024-11-26 19:18:13.563468] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:56.743 [2024-11-26 19:18:13.563477] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:56.743 [2024-11-26 19:18:13.565163] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:56.743 [2024-11-26 19:18:13.574546] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:56.743 [2024-11-26 19:18:13.574912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.743 [2024-11-26 19:18:13.575090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.743 [2024-11-26 19:18:13.575103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:56.743 [2024-11-26 19:18:13.575112] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:56.743 [2024-11-26 19:18:13.575207] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:56.743 [2024-11-26 19:18:13.575302] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:56.743 [2024-11-26 19:18:13.575310] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:56.743 [2024-11-26 19:18:13.575316] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:56.743 [2024-11-26 19:18:13.577041] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:56.743 [2024-11-26 19:18:13.586363] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:56.743 [2024-11-26 19:18:13.586545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.743 [2024-11-26 19:18:13.586658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.743 [2024-11-26 19:18:13.586670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:56.743 [2024-11-26 19:18:13.586677] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:56.743 [2024-11-26 19:18:13.586784] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:56.743 [2024-11-26 19:18:13.586907] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:56.743 [2024-11-26 19:18:13.586917] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:56.743 [2024-11-26 19:18:13.586923] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:56.743 [2024-11-26 19:18:13.588764] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:56.743 [2024-11-26 19:18:13.598315] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:56.743 [2024-11-26 19:18:13.598553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.743 [2024-11-26 19:18:13.598759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.743 [2024-11-26 19:18:13.598772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:56.743 [2024-11-26 19:18:13.598779] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:56.743 [2024-11-26 19:18:13.598887] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:56.743 [2024-11-26 19:18:13.599030] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:56.743 [2024-11-26 19:18:13.599040] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:56.743 [2024-11-26 19:18:13.599047] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:56.743 [2024-11-26 19:18:13.600668] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:56.743 [2024-11-26 19:18:13.610249] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:56.743 [2024-11-26 19:18:13.610508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.743 [2024-11-26 19:18:13.610670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.743 [2024-11-26 19:18:13.610704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:56.743 [2024-11-26 19:18:13.610727] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:56.743 [2024-11-26 19:18:13.611219] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:56.743 [2024-11-26 19:18:13.611554] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:56.743 [2024-11-26 19:18:13.611580] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:56.743 [2024-11-26 19:18:13.611602] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:56.743 [2024-11-26 19:18:13.613323] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:56.743 [2024-11-26 19:18:13.622230] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:56.743 [2024-11-26 19:18:13.622464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.743 [2024-11-26 19:18:13.622648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.743 [2024-11-26 19:18:13.622660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:56.743 [2024-11-26 19:18:13.622668] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:56.743 [2024-11-26 19:18:13.622776] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:56.743 [2024-11-26 19:18:13.622885] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:56.743 [2024-11-26 19:18:13.622893] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:56.743 [2024-11-26 19:18:13.622900] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:56.743 [2024-11-26 19:18:13.624683] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:56.743 [2024-11-26 19:18:13.634092] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:56.743 [2024-11-26 19:18:13.634302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.743 [2024-11-26 19:18:13.635044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.743 [2024-11-26 19:18:13.635068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:56.743 [2024-11-26 19:18:13.635077] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:56.743 [2024-11-26 19:18:13.635219] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:56.743 [2024-11-26 19:18:13.635286] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:56.743 [2024-11-26 19:18:13.635294] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:56.743 [2024-11-26 19:18:13.635301] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:56.743 [2024-11-26 19:18:13.637077] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:56.743 [2024-11-26 19:18:13.645880] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:56.743 [2024-11-26 19:18:13.646183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.743 [2024-11-26 19:18:13.646372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.743 [2024-11-26 19:18:13.646407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:56.743 [2024-11-26 19:18:13.646431] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:56.744 [2024-11-26 19:18:13.646763] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:56.744 [2024-11-26 19:18:13.646877] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:56.744 [2024-11-26 19:18:13.646886] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:56.744 [2024-11-26 19:18:13.646893] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:56.744 [2024-11-26 19:18:13.648493] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:56.744 [2024-11-26 19:18:13.657792] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:56.744 [2024-11-26 19:18:13.658118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.744 [2024-11-26 19:18:13.658242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:56.744 [2024-11-26 19:18:13.658276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:56.744 [2024-11-26 19:18:13.658301] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:56.744 [2024-11-26 19:18:13.658682] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:56.744 [2024-11-26 19:18:13.658935] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:56.744 [2024-11-26 19:18:13.658945] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:56.744 [2024-11-26 19:18:13.658959] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:56.744 [2024-11-26 19:18:13.661698] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.004 [2024-11-26 19:18:13.670018] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.004 [2024-11-26 19:18:13.670295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.004 [2024-11-26 19:18:13.670436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.004 [2024-11-26 19:18:13.670449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.004 [2024-11-26 19:18:13.670457] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.004 [2024-11-26 19:18:13.670560] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.004 [2024-11-26 19:18:13.670709] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.004 [2024-11-26 19:18:13.670719] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.004 [2024-11-26 19:18:13.670725] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.004 [2024-11-26 19:18:13.672546] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.004 [2024-11-26 19:18:13.681994] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.004 [2024-11-26 19:18:13.682223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.004 [2024-11-26 19:18:13.682377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.004 [2024-11-26 19:18:13.682389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.004 [2024-11-26 19:18:13.682398] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.004 [2024-11-26 19:18:13.682542] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.004 [2024-11-26 19:18:13.682657] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.004 [2024-11-26 19:18:13.682666] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.004 [2024-11-26 19:18:13.682674] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.004 [2024-11-26 19:18:13.684355] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.004 [2024-11-26 19:18:13.693879] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.004 [2024-11-26 19:18:13.694232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.004 [2024-11-26 19:18:13.694463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.004 [2024-11-26 19:18:13.694478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.004 [2024-11-26 19:18:13.694487] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.004 [2024-11-26 19:18:13.694572] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.004 [2024-11-26 19:18:13.694672] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.004 [2024-11-26 19:18:13.694680] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.004 [2024-11-26 19:18:13.694686] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.004 [2024-11-26 19:18:13.696534] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.004 [2024-11-26 19:18:13.705622] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.004 [2024-11-26 19:18:13.705837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.004 [2024-11-26 19:18:13.706080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.004 [2024-11-26 19:18:13.706117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.004 [2024-11-26 19:18:13.706140] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.004 [2024-11-26 19:18:13.706471] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.005 [2024-11-26 19:18:13.706755] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.005 [2024-11-26 19:18:13.706779] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.005 [2024-11-26 19:18:13.706801] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.005 [2024-11-26 19:18:13.708799] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.005 [2024-11-26 19:18:13.717551] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.005 [2024-11-26 19:18:13.717926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.005 [2024-11-26 19:18:13.718219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.005 [2024-11-26 19:18:13.718253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.005 [2024-11-26 19:18:13.718278] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.005 [2024-11-26 19:18:13.718757] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.005 [2024-11-26 19:18:13.719085] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.005 [2024-11-26 19:18:13.719095] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.005 [2024-11-26 19:18:13.719102] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.005 [2024-11-26 19:18:13.720849] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.005 [2024-11-26 19:18:13.729507] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.005 [2024-11-26 19:18:13.729815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.005 [2024-11-26 19:18:13.730032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.005 [2024-11-26 19:18:13.730044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.005 [2024-11-26 19:18:13.730054] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.005 [2024-11-26 19:18:13.730164] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.005 [2024-11-26 19:18:13.730286] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.005 [2024-11-26 19:18:13.730296] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.005 [2024-11-26 19:18:13.730302] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.005 [2024-11-26 19:18:13.731998] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.005 [2024-11-26 19:18:13.741192] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.005 [2024-11-26 19:18:13.741467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.005 [2024-11-26 19:18:13.741695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.005 [2024-11-26 19:18:13.741707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.005 [2024-11-26 19:18:13.741714] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.005 [2024-11-26 19:18:13.741850] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.005 [2024-11-26 19:18:13.741917] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.005 [2024-11-26 19:18:13.741925] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.005 [2024-11-26 19:18:13.741932] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.005 [2024-11-26 19:18:13.743912] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.005 [2024-11-26 19:18:13.752897] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.005 [2024-11-26 19:18:13.753224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.005 [2024-11-26 19:18:13.753409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.005 [2024-11-26 19:18:13.753443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.005 [2024-11-26 19:18:13.753467] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.005 [2024-11-26 19:18:13.753855] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.005 [2024-11-26 19:18:13.753937] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.005 [2024-11-26 19:18:13.753946] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.005 [2024-11-26 19:18:13.753961] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.005 [2024-11-26 19:18:13.755653] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.005 [2024-11-26 19:18:13.764745] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.005 [2024-11-26 19:18:13.765118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.005 [2024-11-26 19:18:13.765323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.005 [2024-11-26 19:18:13.765335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.005 [2024-11-26 19:18:13.765344] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.005 [2024-11-26 19:18:13.765461] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.005 [2024-11-26 19:18:13.765576] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.005 [2024-11-26 19:18:13.765585] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.005 [2024-11-26 19:18:13.765592] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.005 [2024-11-26 19:18:13.767523] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.005 [2024-11-26 19:18:13.776572] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.005 [2024-11-26 19:18:13.776915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.005 [2024-11-26 19:18:13.777204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.005 [2024-11-26 19:18:13.777238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.005 [2024-11-26 19:18:13.777262] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.005 [2024-11-26 19:18:13.777450] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.005 [2024-11-26 19:18:13.777546] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.005 [2024-11-26 19:18:13.777555] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.005 [2024-11-26 19:18:13.777561] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.005 [2024-11-26 19:18:13.779229] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.005 [2024-11-26 19:18:13.788385] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.005 [2024-11-26 19:18:13.788695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.005 [2024-11-26 19:18:13.788985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.005 [2024-11-26 19:18:13.789020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.005 [2024-11-26 19:18:13.789044] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.005 [2024-11-26 19:18:13.789307] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.005 [2024-11-26 19:18:13.789403] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.005 [2024-11-26 19:18:13.789412] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.005 [2024-11-26 19:18:13.789418] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.005 [2024-11-26 19:18:13.791154] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.005 [2024-11-26 19:18:13.800246] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.005 [2024-11-26 19:18:13.800554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.005 [2024-11-26 19:18:13.800779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.005 [2024-11-26 19:18:13.800790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.005 [2024-11-26 19:18:13.800798] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.005 [2024-11-26 19:18:13.800954] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.005 [2024-11-26 19:18:13.801095] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.005 [2024-11-26 19:18:13.801105] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.005 [2024-11-26 19:18:13.801111] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.005 [2024-11-26 19:18:13.802843] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.005 [2024-11-26 19:18:13.812355] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.005 [2024-11-26 19:18:13.812684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.005 [2024-11-26 19:18:13.812927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.005 [2024-11-26 19:18:13.812939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.005 [2024-11-26 19:18:13.812953] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.005 [2024-11-26 19:18:13.813068] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.005 [2024-11-26 19:18:13.813232] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.005 [2024-11-26 19:18:13.813242] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.005 [2024-11-26 19:18:13.813248] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.005 [2024-11-26 19:18:13.815100] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.006 [2024-11-26 19:18:13.824252] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.006 [2024-11-26 19:18:13.824625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.006 [2024-11-26 19:18:13.824784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.006 [2024-11-26 19:18:13.824795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.006 [2024-11-26 19:18:13.824803] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.006 [2024-11-26 19:18:13.824912] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.006 [2024-11-26 19:18:13.825049] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.006 [2024-11-26 19:18:13.825060] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.006 [2024-11-26 19:18:13.825066] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.006 [2024-11-26 19:18:13.826730] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.006 [2024-11-26 19:18:13.836196] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.006 [2024-11-26 19:18:13.836537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.006 [2024-11-26 19:18:13.836791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.006 [2024-11-26 19:18:13.836823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.006 [2024-11-26 19:18:13.836846] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.006 [2024-11-26 19:18:13.837390] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.006 [2024-11-26 19:18:13.837632] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.006 [2024-11-26 19:18:13.837644] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.006 [2024-11-26 19:18:13.837651] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.006 [2024-11-26 19:18:13.839422] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.006 [2024-11-26 19:18:13.848051] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.006 [2024-11-26 19:18:13.848386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.006 [2024-11-26 19:18:13.848595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.006 [2024-11-26 19:18:13.848630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.006 [2024-11-26 19:18:13.848653] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.006 [2024-11-26 19:18:13.849151] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.006 [2024-11-26 19:18:13.849375] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.006 [2024-11-26 19:18:13.849384] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.006 [2024-11-26 19:18:13.849390] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.006 [2024-11-26 19:18:13.851216] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.006 [2024-11-26 19:18:13.859831] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.006 [2024-11-26 19:18:13.860196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.006 [2024-11-26 19:18:13.860469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.006 [2024-11-26 19:18:13.860503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.006 [2024-11-26 19:18:13.860526] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.006 [2024-11-26 19:18:13.860694] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.006 [2024-11-26 19:18:13.860790] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.006 [2024-11-26 19:18:13.860799] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.006 [2024-11-26 19:18:13.860806] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.006 [2024-11-26 19:18:13.862392] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.006 [2024-11-26 19:18:13.871672] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.006 [2024-11-26 19:18:13.872014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.006 [2024-11-26 19:18:13.872238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.006 [2024-11-26 19:18:13.872271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.006 [2024-11-26 19:18:13.872296] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.006 [2024-11-26 19:18:13.872625] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.006 [2024-11-26 19:18:13.872860] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.006 [2024-11-26 19:18:13.872885] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.006 [2024-11-26 19:18:13.872914] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.006 [2024-11-26 19:18:13.874953] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.006 [2024-11-26 19:18:13.883411] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.006 [2024-11-26 19:18:13.883770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.006 [2024-11-26 19:18:13.883976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.006 [2024-11-26 19:18:13.883989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.006 [2024-11-26 19:18:13.883998] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.006 [2024-11-26 19:18:13.884093] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.006 [2024-11-26 19:18:13.884215] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.006 [2024-11-26 19:18:13.884225] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.006 [2024-11-26 19:18:13.884231] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.006 [2024-11-26 19:18:13.885827] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.006 [2024-11-26 19:18:13.895234] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.006 [2024-11-26 19:18:13.895497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.006 [2024-11-26 19:18:13.895679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.006 [2024-11-26 19:18:13.895712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.006 [2024-11-26 19:18:13.895736] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.006 [2024-11-26 19:18:13.896132] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.006 [2024-11-26 19:18:13.896319] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.006 [2024-11-26 19:18:13.896328] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.006 [2024-11-26 19:18:13.896337] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.006 [2024-11-26 19:18:13.897915] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.006 [2024-11-26 19:18:13.907182] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.006 [2024-11-26 19:18:13.907536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.006 [2024-11-26 19:18:13.907768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.006 [2024-11-26 19:18:13.907801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.006 [2024-11-26 19:18:13.907825] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.006 [2024-11-26 19:18:13.908069] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.006 [2024-11-26 19:18:13.908330] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.006 [2024-11-26 19:18:13.908340] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.006 [2024-11-26 19:18:13.908346] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.006 [2024-11-26 19:18:13.910231] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.006 [2024-11-26 19:18:13.918926] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.006 [2024-11-26 19:18:13.919188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.006 [2024-11-26 19:18:13.919394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.006 [2024-11-26 19:18:13.919427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.006 [2024-11-26 19:18:13.919450] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.006 [2024-11-26 19:18:13.919740] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.006 [2024-11-26 19:18:13.919864] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.006 [2024-11-26 19:18:13.919873] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.006 [2024-11-26 19:18:13.919879] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.006 [2024-11-26 19:18:13.921725] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.266 [2024-11-26 19:18:13.930981] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.266 [2024-11-26 19:18:13.931301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.266 [2024-11-26 19:18:13.931527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.266 [2024-11-26 19:18:13.931539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.266 [2024-11-26 19:18:13.931547] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.266 [2024-11-26 19:18:13.931679] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.266 [2024-11-26 19:18:13.931797] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.266 [2024-11-26 19:18:13.931807] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.266 [2024-11-26 19:18:13.931814] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.266 [2024-11-26 19:18:13.933587] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.267 [2024-11-26 19:18:13.942940] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.267 [2024-11-26 19:18:13.943287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.267 [2024-11-26 19:18:13.943512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.267 [2024-11-26 19:18:13.943524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.267 [2024-11-26 19:18:13.943532] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.267 [2024-11-26 19:18:13.943632] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.267 [2024-11-26 19:18:13.943732] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.267 [2024-11-26 19:18:13.943740] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.267 [2024-11-26 19:18:13.943747] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.267 [2024-11-26 19:18:13.945556] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.267 [2024-11-26 19:18:13.954745] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.267 [2024-11-26 19:18:13.955151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.267 [2024-11-26 19:18:13.955405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.267 [2024-11-26 19:18:13.955439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.267 [2024-11-26 19:18:13.955462] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.267 [2024-11-26 19:18:13.955677] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.267 [2024-11-26 19:18:13.955815] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.267 [2024-11-26 19:18:13.955824] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.267 [2024-11-26 19:18:13.955830] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.267 [2024-11-26 19:18:13.957487] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.267 [2024-11-26 19:18:13.966563] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.267 [2024-11-26 19:18:13.966935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.267 [2024-11-26 19:18:13.967166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.267 [2024-11-26 19:18:13.967201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.267 [2024-11-26 19:18:13.967224] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.267 [2024-11-26 19:18:13.967605] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.267 [2024-11-26 19:18:13.967757] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.267 [2024-11-26 19:18:13.967766] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.267 [2024-11-26 19:18:13.967772] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.267 [2024-11-26 19:18:13.969469] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.267 [2024-11-26 19:18:13.978506] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.267 [2024-11-26 19:18:13.978884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.267 [2024-11-26 19:18:13.979091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.267 [2024-11-26 19:18:13.979104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.267 [2024-11-26 19:18:13.979112] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.267 [2024-11-26 19:18:13.979234] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.267 [2024-11-26 19:18:13.979343] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.267 [2024-11-26 19:18:13.979351] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.267 [2024-11-26 19:18:13.979358] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.267 [2024-11-26 19:18:13.980984] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.267 [2024-11-26 19:18:13.990343] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.267 [2024-11-26 19:18:13.990677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.267 [2024-11-26 19:18:13.990892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.267 [2024-11-26 19:18:13.990925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.267 [2024-11-26 19:18:13.990963] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.267 [2024-11-26 19:18:13.991396] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.267 [2024-11-26 19:18:13.991670] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.267 [2024-11-26 19:18:13.991680] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.267 [2024-11-26 19:18:13.991686] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.267 [2024-11-26 19:18:13.993846] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.267 [2024-11-26 19:18:14.002847] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.267 [2024-11-26 19:18:14.003204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.267 [2024-11-26 19:18:14.003443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.267 [2024-11-26 19:18:14.003476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.267 [2024-11-26 19:18:14.003501] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.267 [2024-11-26 19:18:14.003881] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.267 [2024-11-26 19:18:14.004028] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.267 [2024-11-26 19:18:14.004038] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.267 [2024-11-26 19:18:14.004044] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.267 [2024-11-26 19:18:14.005740] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.267 [2024-11-26 19:18:14.014723] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.267 [2024-11-26 19:18:14.015062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.267 [2024-11-26 19:18:14.015294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.267 [2024-11-26 19:18:14.015332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.267 [2024-11-26 19:18:14.015356] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.267 [2024-11-26 19:18:14.015640] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.267 [2024-11-26 19:18:14.015810] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.267 [2024-11-26 19:18:14.015819] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.267 [2024-11-26 19:18:14.015825] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.267 [2024-11-26 19:18:14.017508] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.267 [2024-11-26 19:18:14.026685] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.267 [2024-11-26 19:18:14.026998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.267 [2024-11-26 19:18:14.027275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.267 [2024-11-26 19:18:14.027316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.267 [2024-11-26 19:18:14.027341] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.267 [2024-11-26 19:18:14.027673] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.267 [2024-11-26 19:18:14.028031] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.267 [2024-11-26 19:18:14.028042] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.267 [2024-11-26 19:18:14.028048] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.267 [2024-11-26 19:18:14.029639] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.267 [2024-11-26 19:18:14.038492] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.267 [2024-11-26 19:18:14.038855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.267 [2024-11-26 19:18:14.039079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.267 [2024-11-26 19:18:14.039115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.267 [2024-11-26 19:18:14.039139] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.267 [2024-11-26 19:18:14.039570] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.267 [2024-11-26 19:18:14.039966] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.267 [2024-11-26 19:18:14.039994] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.267 [2024-11-26 19:18:14.040027] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.267 [2024-11-26 19:18:14.041675] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.268 [2024-11-26 19:18:14.050305] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.268 [2024-11-26 19:18:14.050678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.268 [2024-11-26 19:18:14.050887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.268 [2024-11-26 19:18:14.050921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.268 [2024-11-26 19:18:14.050944] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.268 [2024-11-26 19:18:14.051296] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.268 [2024-11-26 19:18:14.051579] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.268 [2024-11-26 19:18:14.051604] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.268 [2024-11-26 19:18:14.051627] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.268 [2024-11-26 19:18:14.053639] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.268 [2024-11-26 19:18:14.062468] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.268 [2024-11-26 19:18:14.062778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.268 [2024-11-26 19:18:14.062930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.268 [2024-11-26 19:18:14.062942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.268 [2024-11-26 19:18:14.062984] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.268 [2024-11-26 19:18:14.063100] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.268 [2024-11-26 19:18:14.063215] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.268 [2024-11-26 19:18:14.063226] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.268 [2024-11-26 19:18:14.063233] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.268 [2024-11-26 19:18:14.065049] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.268 [2024-11-26 19:18:14.074183] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.268 [2024-11-26 19:18:14.074562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.268 [2024-11-26 19:18:14.074839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.268 [2024-11-26 19:18:14.074873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.268 [2024-11-26 19:18:14.074896] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.268 [2024-11-26 19:18:14.075152] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.268 [2024-11-26 19:18:14.075277] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.268 [2024-11-26 19:18:14.075286] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.268 [2024-11-26 19:18:14.075292] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.268 [2024-11-26 19:18:14.076957] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.268 [2024-11-26 19:18:14.085979] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.268 [2024-11-26 19:18:14.086197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.268 [2024-11-26 19:18:14.086348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.268 [2024-11-26 19:18:14.086359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.268 [2024-11-26 19:18:14.086367] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.268 [2024-11-26 19:18:14.086489] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.268 [2024-11-26 19:18:14.086625] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.268 [2024-11-26 19:18:14.086634] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.268 [2024-11-26 19:18:14.086641] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.268 [2024-11-26 19:18:14.088434] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.268 [2024-11-26 19:18:14.097771] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.268 [2024-11-26 19:18:14.098079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.268 [2024-11-26 19:18:14.098257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.268 [2024-11-26 19:18:14.098269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.268 [2024-11-26 19:18:14.098277] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.268 [2024-11-26 19:18:14.098402] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.268 [2024-11-26 19:18:14.098497] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.268 [2024-11-26 19:18:14.098506] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.268 [2024-11-26 19:18:14.098512] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.268 [2024-11-26 19:18:14.100224] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.268 [2024-11-26 19:18:14.109741] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.268 [2024-11-26 19:18:14.110001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.268 [2024-11-26 19:18:14.110233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.268 [2024-11-26 19:18:14.110244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.268 [2024-11-26 19:18:14.110252] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.268 [2024-11-26 19:18:14.110381] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.268 [2024-11-26 19:18:14.110526] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.268 [2024-11-26 19:18:14.110536] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.268 [2024-11-26 19:18:14.110542] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.268 [2024-11-26 19:18:14.112366] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.268 [2024-11-26 19:18:14.121649] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.268 [2024-11-26 19:18:14.121848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.268 [2024-11-26 19:18:14.121951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.268 [2024-11-26 19:18:14.121965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.268 [2024-11-26 19:18:14.121973] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.268 [2024-11-26 19:18:14.122073] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.268 [2024-11-26 19:18:14.122187] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.268 [2024-11-26 19:18:14.122196] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.268 [2024-11-26 19:18:14.122203] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.268 [2024-11-26 19:18:14.123914] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.268 [2024-11-26 19:18:14.133581] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.268 [2024-11-26 19:18:14.133785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.268 [2024-11-26 19:18:14.133882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.268 [2024-11-26 19:18:14.133894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.268 [2024-11-26 19:18:14.133901] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.268 [2024-11-26 19:18:14.134028] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.268 [2024-11-26 19:18:14.134155] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.268 [2024-11-26 19:18:14.134165] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.268 [2024-11-26 19:18:14.134171] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.268 [2024-11-26 19:18:14.135834] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.268 [2024-11-26 19:18:14.145395] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.268 [2024-11-26 19:18:14.145647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.268 [2024-11-26 19:18:14.145744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.268 [2024-11-26 19:18:14.145756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.268 [2024-11-26 19:18:14.145764] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.268 [2024-11-26 19:18:14.145858] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.268 [2024-11-26 19:18:14.145986] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.268 [2024-11-26 19:18:14.145995] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.268 [2024-11-26 19:18:14.146003] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.268 [2024-11-26 19:18:14.147623] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.268 [2024-11-26 19:18:14.157300] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.268 [2024-11-26 19:18:14.157649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.269 [2024-11-26 19:18:14.157808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.269 [2024-11-26 19:18:14.157841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.269 [2024-11-26 19:18:14.157864] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.269 [2024-11-26 19:18:14.158337] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.269 [2024-11-26 19:18:14.158462] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.269 [2024-11-26 19:18:14.158471] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.269 [2024-11-26 19:18:14.158477] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.269 [2024-11-26 19:18:14.160055] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.269 [2024-11-26 19:18:14.169110] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.269 [2024-11-26 19:18:14.169438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.269 [2024-11-26 19:18:14.169631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.269 [2024-11-26 19:18:14.169663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.269 [2024-11-26 19:18:14.169687] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.269 [2024-11-26 19:18:14.169984] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.269 [2024-11-26 19:18:14.170214] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.269 [2024-11-26 19:18:14.170228] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.269 [2024-11-26 19:18:14.170235] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.269 [2024-11-26 19:18:14.171761] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.269 [2024-11-26 19:18:14.180853] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.269 [2024-11-26 19:18:14.181232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.269 [2024-11-26 19:18:14.181486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.269 [2024-11-26 19:18:14.181519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.269 [2024-11-26 19:18:14.181543] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.269 [2024-11-26 19:18:14.181923] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.269 [2024-11-26 19:18:14.182313] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.269 [2024-11-26 19:18:14.182322] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.269 [2024-11-26 19:18:14.182329] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.269 [2024-11-26 19:18:14.184040] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.529 [2024-11-26 19:18:14.192757] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.529 [2024-11-26 19:18:14.193115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.529 [2024-11-26 19:18:14.193370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.529 [2024-11-26 19:18:14.193403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.529 [2024-11-26 19:18:14.193428] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.529 [2024-11-26 19:18:14.193807] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.529 [2024-11-26 19:18:14.194114] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.529 [2024-11-26 19:18:14.194127] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.529 [2024-11-26 19:18:14.194138] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.529 [2024-11-26 19:18:14.196627] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.529 [2024-11-26 19:18:14.205042] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.529 [2024-11-26 19:18:14.205409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.529 [2024-11-26 19:18:14.205609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.529 [2024-11-26 19:18:14.205640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.529 [2024-11-26 19:18:14.205663] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.529 [2024-11-26 19:18:14.205937] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.529 [2024-11-26 19:18:14.206056] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.529 [2024-11-26 19:18:14.206066] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.529 [2024-11-26 19:18:14.206076] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.529 [2024-11-26 19:18:14.207817] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.529 [2024-11-26 19:18:14.216882] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.529 [2024-11-26 19:18:14.217234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.529 [2024-11-26 19:18:14.217477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.529 [2024-11-26 19:18:14.217511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.529 [2024-11-26 19:18:14.217534] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.529 [2024-11-26 19:18:14.217983] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.529 [2024-11-26 19:18:14.218088] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.529 [2024-11-26 19:18:14.218096] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.529 [2024-11-26 19:18:14.218104] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.529 [2024-11-26 19:18:14.219763] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.529 [2024-11-26 19:18:14.228834] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.529 [2024-11-26 19:18:14.229209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.529 [2024-11-26 19:18:14.229439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.529 [2024-11-26 19:18:14.229472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.529 [2024-11-26 19:18:14.229495] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.529 [2024-11-26 19:18:14.229991] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.529 [2024-11-26 19:18:14.230276] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.529 [2024-11-26 19:18:14.230301] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.529 [2024-11-26 19:18:14.230323] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.529 [2024-11-26 19:18:14.232050] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.529 [2024-11-26 19:18:14.240817] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.529 [2024-11-26 19:18:14.241131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.529 [2024-11-26 19:18:14.241356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.529 [2024-11-26 19:18:14.241367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.529 [2024-11-26 19:18:14.241376] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.529 [2024-11-26 19:18:14.241499] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.529 [2024-11-26 19:18:14.241593] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.530 [2024-11-26 19:18:14.241602] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.530 [2024-11-26 19:18:14.241609] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.530 [2024-11-26 19:18:14.243380] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.530 [2024-11-26 19:18:14.252793] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.530 [2024-11-26 19:18:14.253123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.530 [2024-11-26 19:18:14.253264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.530 [2024-11-26 19:18:14.253298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.530 [2024-11-26 19:18:14.253322] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.530 [2024-11-26 19:18:14.253754] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.530 [2024-11-26 19:18:14.254202] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.530 [2024-11-26 19:18:14.254249] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.530 [2024-11-26 19:18:14.254273] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.530 [2024-11-26 19:18:14.257039] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.530 [2024-11-26 19:18:14.265349] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.530 [2024-11-26 19:18:14.265758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.530 [2024-11-26 19:18:14.265939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.530 [2024-11-26 19:18:14.266001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.530 [2024-11-26 19:18:14.266026] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.530 [2024-11-26 19:18:14.266452] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.530 [2024-11-26 19:18:14.266580] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.530 [2024-11-26 19:18:14.266589] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.530 [2024-11-26 19:18:14.266595] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.530 [2024-11-26 19:18:14.268322] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.530 [2024-11-26 19:18:14.277179] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.530 [2024-11-26 19:18:14.277493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.530 [2024-11-26 19:18:14.277706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.530 [2024-11-26 19:18:14.277739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.530 [2024-11-26 19:18:14.277762] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.530 [2024-11-26 19:18:14.278158] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.530 [2024-11-26 19:18:14.278306] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.530 [2024-11-26 19:18:14.278316] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.530 [2024-11-26 19:18:14.278322] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.530 [2024-11-26 19:18:14.279999] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.530 [2024-11-26 19:18:14.289104] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.530 [2024-11-26 19:18:14.289442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.530 [2024-11-26 19:18:14.289623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.530 [2024-11-26 19:18:14.289656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.530 [2024-11-26 19:18:14.289680] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.530 [2024-11-26 19:18:14.290075] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.530 [2024-11-26 19:18:14.290279] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.530 [2024-11-26 19:18:14.290288] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.530 [2024-11-26 19:18:14.290294] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.530 [2024-11-26 19:18:14.291872] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.530 [2024-11-26 19:18:14.301021] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.530 [2024-11-26 19:18:14.301276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.530 [2024-11-26 19:18:14.301489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.530 [2024-11-26 19:18:14.301522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.530 [2024-11-26 19:18:14.301545] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.530 [2024-11-26 19:18:14.301991] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.530 [2024-11-26 19:18:14.302233] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.530 [2024-11-26 19:18:14.302243] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.530 [2024-11-26 19:18:14.302251] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.530 [2024-11-26 19:18:14.303876] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.530 [2024-11-26 19:18:14.313116] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.530 [2024-11-26 19:18:14.313491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.530 [2024-11-26 19:18:14.313640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.530 [2024-11-26 19:18:14.313652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.530 [2024-11-26 19:18:14.313660] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.530 [2024-11-26 19:18:14.313823] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.530 [2024-11-26 19:18:14.313898] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.530 [2024-11-26 19:18:14.313909] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.530 [2024-11-26 19:18:14.313917] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.530 [2024-11-26 19:18:14.315734] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.530 [2024-11-26 19:18:14.324889] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.530 [2024-11-26 19:18:14.325294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.530 [2024-11-26 19:18:14.325525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.530 [2024-11-26 19:18:14.325537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.530 [2024-11-26 19:18:14.325546] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.530 [2024-11-26 19:18:14.325692] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.530 [2024-11-26 19:18:14.325810] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.530 [2024-11-26 19:18:14.325819] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.530 [2024-11-26 19:18:14.325826] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.530 [2024-11-26 19:18:14.327631] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.530 [2024-11-26 19:18:14.336666] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.530 [2024-11-26 19:18:14.336927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.530 [2024-11-26 19:18:14.337097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.530 [2024-11-26 19:18:14.337110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.530 [2024-11-26 19:18:14.337117] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.530 [2024-11-26 19:18:14.337233] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.530 [2024-11-26 19:18:14.337363] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.530 [2024-11-26 19:18:14.337373] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.530 [2024-11-26 19:18:14.337379] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.530 [2024-11-26 19:18:14.339161] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.530 [2024-11-26 19:18:14.348513] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.530 [2024-11-26 19:18:14.348783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.530 [2024-11-26 19:18:14.349014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.530 [2024-11-26 19:18:14.349027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.530 [2024-11-26 19:18:14.349036] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.530 [2024-11-26 19:18:14.349150] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.530 [2024-11-26 19:18:14.349265] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.530 [2024-11-26 19:18:14.349275] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.530 [2024-11-26 19:18:14.349282] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.530 [2024-11-26 19:18:14.350939] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.530 [2024-11-26 19:18:14.360308] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.531 [2024-11-26 19:18:14.360637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.531 [2024-11-26 19:18:14.360835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.531 [2024-11-26 19:18:14.360876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.531 [2024-11-26 19:18:14.360900] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.531 [2024-11-26 19:18:14.361347] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.531 [2024-11-26 19:18:14.361477] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.531 [2024-11-26 19:18:14.361487] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.531 [2024-11-26 19:18:14.361493] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.531 [2024-11-26 19:18:14.363586] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.531 [2024-11-26 19:18:14.372113] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.531 [2024-11-26 19:18:14.372454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.531 [2024-11-26 19:18:14.372657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.531 [2024-11-26 19:18:14.372668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.531 [2024-11-26 19:18:14.372676] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.531 [2024-11-26 19:18:14.372771] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.531 [2024-11-26 19:18:14.372837] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.531 [2024-11-26 19:18:14.372846] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.531 [2024-11-26 19:18:14.372852] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.531 [2024-11-26 19:18:14.374686] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.531 [2024-11-26 19:18:14.384219] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.531 [2024-11-26 19:18:14.384593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.531 [2024-11-26 19:18:14.384717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.531 [2024-11-26 19:18:14.384750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.531 [2024-11-26 19:18:14.384774] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.531 [2024-11-26 19:18:14.385169] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.531 [2024-11-26 19:18:14.385653] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.531 [2024-11-26 19:18:14.385678] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.531 [2024-11-26 19:18:14.385699] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.531 [2024-11-26 19:18:14.388317] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.531 [2024-11-26 19:18:14.396583] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.531 [2024-11-26 19:18:14.396927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.531 [2024-11-26 19:18:14.397212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.531 [2024-11-26 19:18:14.397245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.531 [2024-11-26 19:18:14.397278] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.531 [2024-11-26 19:18:14.397567] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.531 [2024-11-26 19:18:14.397655] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.531 [2024-11-26 19:18:14.397665] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.531 [2024-11-26 19:18:14.397671] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.531 [2024-11-26 19:18:14.399458] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.531 [2024-11-26 19:18:14.408625] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.531 [2024-11-26 19:18:14.408967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.531 [2024-11-26 19:18:14.409101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.531 [2024-11-26 19:18:14.409113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.531 [2024-11-26 19:18:14.409121] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.531 [2024-11-26 19:18:14.409281] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.531 [2024-11-26 19:18:14.409380] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.531 [2024-11-26 19:18:14.409390] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.531 [2024-11-26 19:18:14.409397] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.531 [2024-11-26 19:18:14.411119] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.531 [2024-11-26 19:18:14.420497] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.531 [2024-11-26 19:18:14.420863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.531 [2024-11-26 19:18:14.421071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.531 [2024-11-26 19:18:14.421109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.531 [2024-11-26 19:18:14.421133] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.531 [2024-11-26 19:18:14.421516] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.531 [2024-11-26 19:18:14.421763] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.531 [2024-11-26 19:18:14.421772] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.531 [2024-11-26 19:18:14.421779] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.531 [2024-11-26 19:18:14.423483] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.531 [2024-11-26 19:18:14.432255] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.531 [2024-11-26 19:18:14.432637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.531 [2024-11-26 19:18:14.432878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.531 [2024-11-26 19:18:14.432911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.531 [2024-11-26 19:18:14.432935] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.531 [2024-11-26 19:18:14.433394] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.531 [2024-11-26 19:18:14.433783] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.531 [2024-11-26 19:18:14.433792] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.531 [2024-11-26 19:18:14.433798] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.531 [2024-11-26 19:18:14.435440] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.531 [2024-11-26 19:18:14.444045] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.531 [2024-11-26 19:18:14.444435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.531 [2024-11-26 19:18:14.444714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.531 [2024-11-26 19:18:14.444747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.531 [2024-11-26 19:18:14.444771] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.531 [2024-11-26 19:18:14.444971] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.531 [2024-11-26 19:18:14.445068] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.531 [2024-11-26 19:18:14.445078] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.531 [2024-11-26 19:18:14.445084] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.531 [2024-11-26 19:18:14.446876] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.792 [2024-11-26 19:18:14.455965] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.792 [2024-11-26 19:18:14.456296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.792 [2024-11-26 19:18:14.456523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.792 [2024-11-26 19:18:14.456535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.792 [2024-11-26 19:18:14.456544] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.792 [2024-11-26 19:18:14.456688] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.792 [2024-11-26 19:18:14.456803] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.792 [2024-11-26 19:18:14.456812] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.792 [2024-11-26 19:18:14.456819] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.792 [2024-11-26 19:18:14.458573] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.792 [2024-11-26 19:18:14.467640] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.792 [2024-11-26 19:18:14.467978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.792 [2024-11-26 19:18:14.468171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.792 [2024-11-26 19:18:14.468205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.792 [2024-11-26 19:18:14.468229] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.792 [2024-11-26 19:18:14.468583] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.792 [2024-11-26 19:18:14.468683] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.792 [2024-11-26 19:18:14.468692] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.792 [2024-11-26 19:18:14.468699] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.792 [2024-11-26 19:18:14.470190] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.792 [2024-11-26 19:18:14.479526] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.792 [2024-11-26 19:18:14.479789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.792 [2024-11-26 19:18:14.479994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.792 [2024-11-26 19:18:14.480007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.792 [2024-11-26 19:18:14.480015] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.792 [2024-11-26 19:18:14.480124] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.792 [2024-11-26 19:18:14.480191] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.792 [2024-11-26 19:18:14.480199] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.792 [2024-11-26 19:18:14.480206] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.792 [2024-11-26 19:18:14.481856] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.792 [2024-11-26 19:18:14.491425] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.792 [2024-11-26 19:18:14.491741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.792 [2024-11-26 19:18:14.491902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.792 [2024-11-26 19:18:14.491914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.792 [2024-11-26 19:18:14.491921] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.792 [2024-11-26 19:18:14.492049] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.792 [2024-11-26 19:18:14.492146] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.792 [2024-11-26 19:18:14.492154] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.792 [2024-11-26 19:18:14.492160] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.792 [2024-11-26 19:18:14.493837] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.792 [2024-11-26 19:18:14.503384] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.792 [2024-11-26 19:18:14.503759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.792 [2024-11-26 19:18:14.503989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.792 [2024-11-26 19:18:14.504002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.792 [2024-11-26 19:18:14.504010] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.792 [2024-11-26 19:18:14.504105] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.792 [2024-11-26 19:18:14.504227] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.792 [2024-11-26 19:18:14.504239] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.792 [2024-11-26 19:18:14.504246] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.792 [2024-11-26 19:18:14.505840] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.792 [2024-11-26 19:18:14.515260] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.792 [2024-11-26 19:18:14.515534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.792 [2024-11-26 19:18:14.515769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.792 [2024-11-26 19:18:14.515802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.792 [2024-11-26 19:18:14.515827] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.792 [2024-11-26 19:18:14.516272] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.792 [2024-11-26 19:18:14.516807] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.792 [2024-11-26 19:18:14.516833] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.792 [2024-11-26 19:18:14.516855] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.792 [2024-11-26 19:18:14.519795] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.792 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh: line 35: 3293380 Killed "${NVMF_APP[@]}" "$@" 00:31:57.792 19:18:14 -- host/bdevperf.sh@36 -- # tgt_init 00:31:57.792 19:18:14 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:31:57.792 19:18:14 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:31:57.792 [2024-11-26 19:18:14.528003] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.792 19:18:14 -- common/autotest_common.sh@722 -- # xtrace_disable 00:31:57.792 [2024-11-26 19:18:14.528332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.792 19:18:14 -- common/autotest_common.sh@10 -- # set +x 00:31:57.792 [2024-11-26 19:18:14.528558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.792 [2024-11-26 19:18:14.528571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.792 [2024-11-26 19:18:14.528580] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.792 [2024-11-26 19:18:14.528709] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.792 [2024-11-26 19:18:14.528838] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.792 [2024-11-26 19:18:14.528849] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.792 [2024-11-26 19:18:14.528855] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.792 [2024-11-26 19:18:14.530794] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.792 19:18:14 -- nvmf/common.sh@469 -- # nvmfpid=3295273 00:31:57.792 19:18:14 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:31:57.792 19:18:14 -- nvmf/common.sh@470 -- # waitforlisten 3295273 00:31:57.792 19:18:14 -- common/autotest_common.sh@829 -- # '[' -z 3295273 ']' 00:31:57.792 19:18:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:31:57.792 19:18:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:31:57.792 19:18:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:31:57.792 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:31:57.792 19:18:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:31:57.792 19:18:14 -- common/autotest_common.sh@10 -- # set +x 00:31:57.792 [2024-11-26 19:18:14.539816] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.792 [2024-11-26 19:18:14.540204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.792 [2024-11-26 19:18:14.540383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.792 [2024-11-26 19:18:14.540394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.792 [2024-11-26 19:18:14.540404] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.792 [2024-11-26 19:18:14.540511] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.792 [2024-11-26 19:18:14.540569] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.792 [2024-11-26 19:18:14.540578] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.793 [2024-11-26 19:18:14.540585] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.793 [2024-11-26 19:18:14.542496] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.793 [2024-11-26 19:18:14.551639] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.793 [2024-11-26 19:18:14.551990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.793 [2024-11-26 19:18:14.552105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.793 [2024-11-26 19:18:14.552117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.793 [2024-11-26 19:18:14.552125] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.793 [2024-11-26 19:18:14.552228] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.793 [2024-11-26 19:18:14.552364] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.793 [2024-11-26 19:18:14.552373] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.793 [2024-11-26 19:18:14.552380] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.793 [2024-11-26 19:18:14.554227] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.793 [2024-11-26 19:18:14.563621] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.793 [2024-11-26 19:18:14.563966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.793 [2024-11-26 19:18:14.564153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.793 [2024-11-26 19:18:14.564166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.793 [2024-11-26 19:18:14.564174] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.793 [2024-11-26 19:18:14.564308] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.793 [2024-11-26 19:18:14.564426] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.793 [2024-11-26 19:18:14.564436] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.793 [2024-11-26 19:18:14.564443] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.793 [2024-11-26 19:18:14.566342] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.793 [2024-11-26 19:18:14.575831] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.793 [2024-11-26 19:18:14.576230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.793 [2024-11-26 19:18:14.576458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.793 [2024-11-26 19:18:14.576471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.793 [2024-11-26 19:18:14.576479] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.793 [2024-11-26 19:18:14.576628] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.793 [2024-11-26 19:18:14.576761] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.793 [2024-11-26 19:18:14.576771] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.793 [2024-11-26 19:18:14.576778] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.793 [2024-11-26 19:18:14.578673] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.793 [2024-11-26 19:18:14.579282] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:31:57.793 [2024-11-26 19:18:14.579323] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:31:57.793 [2024-11-26 19:18:14.587974] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.793 [2024-11-26 19:18:14.588245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.793 [2024-11-26 19:18:14.588400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.793 [2024-11-26 19:18:14.588411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.793 [2024-11-26 19:18:14.588420] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.793 [2024-11-26 19:18:14.588493] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.793 [2024-11-26 19:18:14.588596] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.793 [2024-11-26 19:18:14.588604] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.793 [2024-11-26 19:18:14.588612] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.793 [2024-11-26 19:18:14.590356] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.793 [2024-11-26 19:18:14.600002] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.793 [2024-11-26 19:18:14.600365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.793 [2024-11-26 19:18:14.600521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.793 [2024-11-26 19:18:14.600533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.793 [2024-11-26 19:18:14.600542] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.793 [2024-11-26 19:18:14.600657] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.793 [2024-11-26 19:18:14.600741] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.793 [2024-11-26 19:18:14.600750] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.793 [2024-11-26 19:18:14.600760] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.793 [2024-11-26 19:18:14.602427] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.793 EAL: No free 2048 kB hugepages reported on node 1 00:31:57.793 [2024-11-26 19:18:14.612153] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.793 [2024-11-26 19:18:14.612566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.793 [2024-11-26 19:18:14.612775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.793 [2024-11-26 19:18:14.612788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.793 [2024-11-26 19:18:14.612796] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.793 [2024-11-26 19:18:14.612941] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.793 [2024-11-26 19:18:14.613081] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.793 [2024-11-26 19:18:14.613091] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.793 [2024-11-26 19:18:14.613098] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.793 [2024-11-26 19:18:14.614836] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.793 [2024-11-26 19:18:14.624122] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.793 [2024-11-26 19:18:14.624524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.793 [2024-11-26 19:18:14.624744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.793 [2024-11-26 19:18:14.624756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.793 [2024-11-26 19:18:14.624764] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.793 [2024-11-26 19:18:14.624899] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.793 [2024-11-26 19:18:14.625025] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.793 [2024-11-26 19:18:14.625036] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.793 [2024-11-26 19:18:14.625044] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.793 [2024-11-26 19:18:14.626813] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.793 [2024-11-26 19:18:14.636035] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.793 [2024-11-26 19:18:14.636432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.793 [2024-11-26 19:18:14.636656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.793 [2024-11-26 19:18:14.636668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.793 [2024-11-26 19:18:14.636677] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.793 [2024-11-26 19:18:14.636779] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.793 [2024-11-26 19:18:14.636913] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.793 [2024-11-26 19:18:14.636923] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.793 [2024-11-26 19:18:14.636929] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.793 [2024-11-26 19:18:14.638767] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.793 [2024-11-26 19:18:14.639937] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:31:57.793 [2024-11-26 19:18:14.647986] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.793 [2024-11-26 19:18:14.648297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.793 [2024-11-26 19:18:14.648527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.793 [2024-11-26 19:18:14.648539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.793 [2024-11-26 19:18:14.648549] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.793 [2024-11-26 19:18:14.648654] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.793 [2024-11-26 19:18:14.648773] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.794 [2024-11-26 19:18:14.648782] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.794 [2024-11-26 19:18:14.648790] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.794 [2024-11-26 19:18:14.650464] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.794 [2024-11-26 19:18:14.659966] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.794 [2024-11-26 19:18:14.660236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.794 [2024-11-26 19:18:14.660482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.794 [2024-11-26 19:18:14.660495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.794 [2024-11-26 19:18:14.660504] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.794 [2024-11-26 19:18:14.660609] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.794 [2024-11-26 19:18:14.660697] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.794 [2024-11-26 19:18:14.660706] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.794 [2024-11-26 19:18:14.660714] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.794 [2024-11-26 19:18:14.662538] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.794 [2024-11-26 19:18:14.671895] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.794 [2024-11-26 19:18:14.672181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.794 [2024-11-26 19:18:14.672295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.794 [2024-11-26 19:18:14.672308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.794 [2024-11-26 19:18:14.672316] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.794 [2024-11-26 19:18:14.672388] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.794 [2024-11-26 19:18:14.672475] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.794 [2024-11-26 19:18:14.672484] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.794 [2024-11-26 19:18:14.672493] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.794 [2024-11-26 19:18:14.674195] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.794 [2024-11-26 19:18:14.679086] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:31:57.794 [2024-11-26 19:18:14.679190] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:31:57.794 [2024-11-26 19:18:14.679198] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:31:57.794 [2024-11-26 19:18:14.679206] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:31:57.794 [2024-11-26 19:18:14.679245] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:31:57.794 [2024-11-26 19:18:14.679336] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:31:57.794 [2024-11-26 19:18:14.679337] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:31:57.794 [2024-11-26 19:18:14.683829] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.794 [2024-11-26 19:18:14.684145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.794 [2024-11-26 19:18:14.684383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.794 [2024-11-26 19:18:14.684395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.794 [2024-11-26 19:18:14.684405] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.794 [2024-11-26 19:18:14.684496] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.794 [2024-11-26 19:18:14.684648] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.794 [2024-11-26 19:18:14.684659] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.794 [2024-11-26 19:18:14.684666] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.794 [2024-11-26 19:18:14.686548] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.794 [2024-11-26 19:18:14.695843] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.794 [2024-11-26 19:18:14.696230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.794 [2024-11-26 19:18:14.696374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.794 [2024-11-26 19:18:14.696387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.794 [2024-11-26 19:18:14.696396] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.794 [2024-11-26 19:18:14.696578] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.794 [2024-11-26 19:18:14.696715] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.794 [2024-11-26 19:18:14.696725] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.794 [2024-11-26 19:18:14.696732] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.794 [2024-11-26 19:18:14.698754] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:57.794 [2024-11-26 19:18:14.707829] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:57.794 [2024-11-26 19:18:14.708224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.794 [2024-11-26 19:18:14.708389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:57.794 [2024-11-26 19:18:14.708402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:57.794 [2024-11-26 19:18:14.708412] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:57.794 [2024-11-26 19:18:14.708569] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:57.794 [2024-11-26 19:18:14.708688] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:57.794 [2024-11-26 19:18:14.708699] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:57.794 [2024-11-26 19:18:14.708709] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:57.794 [2024-11-26 19:18:14.710577] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:58.054 [2024-11-26 19:18:14.719670] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:58.054 [2024-11-26 19:18:14.720051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.054 [2024-11-26 19:18:14.720264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.054 [2024-11-26 19:18:14.720277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:58.054 [2024-11-26 19:18:14.720287] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:58.054 [2024-11-26 19:18:14.720422] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:58.054 [2024-11-26 19:18:14.720510] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:58.054 [2024-11-26 19:18:14.720521] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:58.054 [2024-11-26 19:18:14.720529] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:58.054 [2024-11-26 19:18:14.722287] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:58.054 [2024-11-26 19:18:14.731728] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:58.054 [2024-11-26 19:18:14.732028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.054 [2024-11-26 19:18:14.732257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.054 [2024-11-26 19:18:14.732270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:58.054 [2024-11-26 19:18:14.732279] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:58.054 [2024-11-26 19:18:14.732370] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:58.054 [2024-11-26 19:18:14.732504] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:58.054 [2024-11-26 19:18:14.732514] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:58.054 [2024-11-26 19:18:14.732521] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:58.054 [2024-11-26 19:18:14.734255] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:58.054 [2024-11-26 19:18:14.743736] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:58.054 [2024-11-26 19:18:14.744054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.054 [2024-11-26 19:18:14.744168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.054 [2024-11-26 19:18:14.744179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:58.054 [2024-11-26 19:18:14.744187] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:58.054 [2024-11-26 19:18:14.744305] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:58.054 [2024-11-26 19:18:14.744403] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:58.054 [2024-11-26 19:18:14.744413] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:58.054 [2024-11-26 19:18:14.744420] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:58.054 [2024-11-26 19:18:14.746180] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:58.054 [2024-11-26 19:18:14.755779] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:58.054 [2024-11-26 19:18:14.756026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.054 [2024-11-26 19:18:14.756221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.054 [2024-11-26 19:18:14.756234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:58.054 [2024-11-26 19:18:14.756242] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:58.054 [2024-11-26 19:18:14.756361] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:58.054 [2024-11-26 19:18:14.756449] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:58.054 [2024-11-26 19:18:14.756458] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:58.054 [2024-11-26 19:18:14.756465] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:58.054 [2024-11-26 19:18:14.758339] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:58.054 [2024-11-26 19:18:14.767921] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:58.054 [2024-11-26 19:18:14.768167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.054 [2024-11-26 19:18:14.768301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.054 [2024-11-26 19:18:14.768314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:58.054 [2024-11-26 19:18:14.768323] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:58.054 [2024-11-26 19:18:14.768472] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:58.054 [2024-11-26 19:18:14.768591] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:58.055 [2024-11-26 19:18:14.768600] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:58.055 [2024-11-26 19:18:14.768608] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:58.055 [2024-11-26 19:18:14.770222] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:58.055 [2024-11-26 19:18:14.780072] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:58.055 [2024-11-26 19:18:14.780325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.055 [2024-11-26 19:18:14.780430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.055 [2024-11-26 19:18:14.780442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:58.055 [2024-11-26 19:18:14.780451] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:58.055 [2024-11-26 19:18:14.780569] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:58.055 [2024-11-26 19:18:14.780688] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:58.055 [2024-11-26 19:18:14.780702] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:58.055 [2024-11-26 19:18:14.780709] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:58.055 [2024-11-26 19:18:14.782503] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:58.055 [2024-11-26 19:18:14.792151] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:58.055 [2024-11-26 19:18:14.792431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.055 [2024-11-26 19:18:14.792673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.055 [2024-11-26 19:18:14.792686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:58.055 [2024-11-26 19:18:14.792694] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:58.055 [2024-11-26 19:18:14.792797] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:58.055 [2024-11-26 19:18:14.792915] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:58.055 [2024-11-26 19:18:14.792926] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:58.055 [2024-11-26 19:18:14.792933] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:58.055 [2024-11-26 19:18:14.794753] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:58.055 [2024-11-26 19:18:14.804120] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:58.055 [2024-11-26 19:18:14.804377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.055 [2024-11-26 19:18:14.804489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.055 [2024-11-26 19:18:14.804502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:58.055 [2024-11-26 19:18:14.804510] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:58.055 [2024-11-26 19:18:14.804613] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:58.055 [2024-11-26 19:18:14.804746] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:58.055 [2024-11-26 19:18:14.804757] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:58.055 [2024-11-26 19:18:14.804765] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:58.055 [2024-11-26 19:18:14.806512] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:58.055 [2024-11-26 19:18:14.816118] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:58.055 [2024-11-26 19:18:14.816349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.055 [2024-11-26 19:18:14.816450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.055 [2024-11-26 19:18:14.816464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:58.055 [2024-11-26 19:18:14.816472] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:58.055 [2024-11-26 19:18:14.816590] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:58.055 [2024-11-26 19:18:14.816724] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:58.055 [2024-11-26 19:18:14.816733] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:58.055 [2024-11-26 19:18:14.816744] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:58.055 [2024-11-26 19:18:14.818661] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:58.055 [2024-11-26 19:18:14.828121] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:58.055 [2024-11-26 19:18:14.828390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.055 [2024-11-26 19:18:14.828549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.055 [2024-11-26 19:18:14.828561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:58.055 [2024-11-26 19:18:14.828570] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:58.055 [2024-11-26 19:18:14.828689] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:58.055 [2024-11-26 19:18:14.828777] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:58.055 [2024-11-26 19:18:14.828786] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:58.055 [2024-11-26 19:18:14.828794] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:58.055 [2024-11-26 19:18:14.830658] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:58.055 [2024-11-26 19:18:14.840212] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:58.055 [2024-11-26 19:18:14.840450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.055 [2024-11-26 19:18:14.840613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.055 [2024-11-26 19:18:14.840626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:58.055 [2024-11-26 19:18:14.840634] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:58.055 [2024-11-26 19:18:14.840769] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:58.055 [2024-11-26 19:18:14.840856] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:58.055 [2024-11-26 19:18:14.840865] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:58.055 [2024-11-26 19:18:14.840872] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:58.055 [2024-11-26 19:18:14.842665] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:58.055 [2024-11-26 19:18:14.852308] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:58.055 [2024-11-26 19:18:14.852649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.055 [2024-11-26 19:18:14.852880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.055 [2024-11-26 19:18:14.852893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:58.055 [2024-11-26 19:18:14.852902] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:58.055 [2024-11-26 19:18:14.852981] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:58.055 [2024-11-26 19:18:14.853099] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:58.055 [2024-11-26 19:18:14.853108] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:58.055 [2024-11-26 19:18:14.853115] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:58.055 [2024-11-26 19:18:14.855135] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:58.055 [2024-11-26 19:18:14.864364] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:58.055 [2024-11-26 19:18:14.864685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.055 [2024-11-26 19:18:14.864893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.055 [2024-11-26 19:18:14.864905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:58.055 [2024-11-26 19:18:14.864915] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:58.055 [2024-11-26 19:18:14.865039] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:58.055 [2024-11-26 19:18:14.865159] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:58.055 [2024-11-26 19:18:14.865169] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:58.055 [2024-11-26 19:18:14.865176] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:58.055 [2024-11-26 19:18:14.866987] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:58.055 [2024-11-26 19:18:14.876411] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:58.055 [2024-11-26 19:18:14.876778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.055 [2024-11-26 19:18:14.877012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.055 [2024-11-26 19:18:14.877025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:58.055 [2024-11-26 19:18:14.877034] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:58.055 [2024-11-26 19:18:14.877184] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:58.055 [2024-11-26 19:18:14.877347] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:58.055 [2024-11-26 19:18:14.877357] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:58.055 [2024-11-26 19:18:14.877364] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:58.055 [2024-11-26 19:18:14.879217] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:58.056 [2024-11-26 19:18:14.888290] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:58.056 [2024-11-26 19:18:14.888608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.056 [2024-11-26 19:18:14.888835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.056 [2024-11-26 19:18:14.888848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:58.056 [2024-11-26 19:18:14.888856] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:58.056 [2024-11-26 19:18:14.888995] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:58.056 [2024-11-26 19:18:14.889128] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:58.056 [2024-11-26 19:18:14.889138] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:58.056 [2024-11-26 19:18:14.889145] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:58.056 [2024-11-26 19:18:14.890867] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:58.056 [2024-11-26 19:18:14.900344] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:58.056 [2024-11-26 19:18:14.900759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.056 [2024-11-26 19:18:14.900967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.056 [2024-11-26 19:18:14.900980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:58.056 [2024-11-26 19:18:14.900989] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:58.056 [2024-11-26 19:18:14.901138] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:58.056 [2024-11-26 19:18:14.901225] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:58.056 [2024-11-26 19:18:14.901235] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:58.056 [2024-11-26 19:18:14.901242] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:58.056 [2024-11-26 19:18:14.903044] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:58.056 [2024-11-26 19:18:14.912488] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:58.056 [2024-11-26 19:18:14.912705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.056 [2024-11-26 19:18:14.912920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.056 [2024-11-26 19:18:14.912933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:58.056 [2024-11-26 19:18:14.912941] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:58.056 [2024-11-26 19:18:14.913049] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:58.056 [2024-11-26 19:18:14.913122] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:58.056 [2024-11-26 19:18:14.913131] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:58.056 [2024-11-26 19:18:14.913139] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:58.056 [2024-11-26 19:18:14.914876] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:58.056 [2024-11-26 19:18:14.924512] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:58.056 [2024-11-26 19:18:14.924801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.056 [2024-11-26 19:18:14.925035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.056 [2024-11-26 19:18:14.925048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:58.056 [2024-11-26 19:18:14.925056] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:58.056 [2024-11-26 19:18:14.925190] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:58.056 [2024-11-26 19:18:14.925278] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:58.056 [2024-11-26 19:18:14.925287] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:58.056 [2024-11-26 19:18:14.925295] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:58.056 [2024-11-26 19:18:14.927097] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:58.056 [2024-11-26 19:18:14.936719] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:58.056 [2024-11-26 19:18:14.937125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.056 [2024-11-26 19:18:14.937233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.056 [2024-11-26 19:18:14.937246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:58.056 [2024-11-26 19:18:14.937255] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:58.056 [2024-11-26 19:18:14.937404] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:58.056 [2024-11-26 19:18:14.937538] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:58.056 [2024-11-26 19:18:14.937547] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:58.056 [2024-11-26 19:18:14.937554] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:58.056 [2024-11-26 19:18:14.939220] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:58.056 [2024-11-26 19:18:14.948668] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:58.056 [2024-11-26 19:18:14.948976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.056 [2024-11-26 19:18:14.949147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.056 [2024-11-26 19:18:14.949161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:58.056 [2024-11-26 19:18:14.949169] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:58.056 [2024-11-26 19:18:14.949288] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:58.056 [2024-11-26 19:18:14.949391] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:58.056 [2024-11-26 19:18:14.949401] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:58.056 [2024-11-26 19:18:14.949408] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:58.056 [2024-11-26 19:18:14.951045] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:58.056 [2024-11-26 19:18:14.960626] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:58.056 [2024-11-26 19:18:14.960983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.056 [2024-11-26 19:18:14.961168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.056 [2024-11-26 19:18:14.961181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:58.056 [2024-11-26 19:18:14.961189] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:58.056 [2024-11-26 19:18:14.961290] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:58.056 [2024-11-26 19:18:14.961450] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:58.056 [2024-11-26 19:18:14.961459] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:58.056 [2024-11-26 19:18:14.961466] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:58.056 [2024-11-26 19:18:14.963360] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:58.056 [2024-11-26 19:18:14.972406] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:58.056 [2024-11-26 19:18:14.972819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.056 [2024-11-26 19:18:14.972986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.056 [2024-11-26 19:18:14.973000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:58.056 [2024-11-26 19:18:14.973008] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:58.056 [2024-11-26 19:18:14.973082] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:58.056 [2024-11-26 19:18:14.973201] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:58.056 [2024-11-26 19:18:14.973209] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:58.056 [2024-11-26 19:18:14.973216] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:58.056 [2024-11-26 19:18:14.975004] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:58.316 [2024-11-26 19:18:14.984403] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:58.316 [2024-11-26 19:18:14.984768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.316 [2024-11-26 19:18:14.985002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.316 [2024-11-26 19:18:14.985015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:58.316 [2024-11-26 19:18:14.985024] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:58.316 [2024-11-26 19:18:14.985143] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:58.316 [2024-11-26 19:18:14.985230] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:58.316 [2024-11-26 19:18:14.985240] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:58.316 [2024-11-26 19:18:14.985247] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:58.316 [2024-11-26 19:18:14.987120] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:58.316 [2024-11-26 19:18:14.996475] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:58.316 [2024-11-26 19:18:14.996802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.316 [2024-11-26 19:18:14.996972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.316 [2024-11-26 19:18:14.996986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:58.316 [2024-11-26 19:18:14.996994] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:58.316 [2024-11-26 19:18:14.997143] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:58.316 [2024-11-26 19:18:14.997276] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:58.316 [2024-11-26 19:18:14.997285] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:58.316 [2024-11-26 19:18:14.997292] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:58.316 [2024-11-26 19:18:14.999201] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:58.316 [2024-11-26 19:18:15.008449] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:58.316 [2024-11-26 19:18:15.008762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.316 [2024-11-26 19:18:15.008996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.316 [2024-11-26 19:18:15.009010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:58.316 [2024-11-26 19:18:15.009022] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:58.316 [2024-11-26 19:18:15.009156] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:58.316 [2024-11-26 19:18:15.009289] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:58.316 [2024-11-26 19:18:15.009299] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:58.316 [2024-11-26 19:18:15.009305] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:58.316 [2024-11-26 19:18:15.011109] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:58.316 [2024-11-26 19:18:15.020367] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:58.316 [2024-11-26 19:18:15.020722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.316 [2024-11-26 19:18:15.020958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.316 [2024-11-26 19:18:15.020972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:58.316 [2024-11-26 19:18:15.020981] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:58.316 [2024-11-26 19:18:15.021114] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:58.316 [2024-11-26 19:18:15.021263] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:58.316 [2024-11-26 19:18:15.021273] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:58.316 [2024-11-26 19:18:15.021280] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:58.316 [2024-11-26 19:18:15.023111] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:58.316 [2024-11-26 19:18:15.032324] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:58.316 [2024-11-26 19:18:15.032648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.316 [2024-11-26 19:18:15.032860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.316 [2024-11-26 19:18:15.032873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:58.316 [2024-11-26 19:18:15.032880] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:58.316 [2024-11-26 19:18:15.033000] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:58.316 [2024-11-26 19:18:15.033135] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:58.316 [2024-11-26 19:18:15.033145] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:58.316 [2024-11-26 19:18:15.033152] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:58.316 [2024-11-26 19:18:15.034976] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:58.316 [2024-11-26 19:18:15.044312] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:58.316 [2024-11-26 19:18:15.044583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.316 [2024-11-26 19:18:15.044698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.316 [2024-11-26 19:18:15.044709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:58.316 [2024-11-26 19:18:15.044716] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:58.316 [2024-11-26 19:18:15.044868] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:58.316 [2024-11-26 19:18:15.044992] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:58.316 [2024-11-26 19:18:15.045003] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:58.316 [2024-11-26 19:18:15.045010] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:58.316 [2024-11-26 19:18:15.046867] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:58.316 [2024-11-26 19:18:15.056398] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:58.316 [2024-11-26 19:18:15.056770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.316 [2024-11-26 19:18:15.057006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.316 [2024-11-26 19:18:15.057020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:58.316 [2024-11-26 19:18:15.057030] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:58.316 [2024-11-26 19:18:15.057134] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:58.316 [2024-11-26 19:18:15.057283] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:58.316 [2024-11-26 19:18:15.057294] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:58.316 [2024-11-26 19:18:15.057302] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:58.316 [2024-11-26 19:18:15.059074] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:58.316 [2024-11-26 19:18:15.068296] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:58.316 [2024-11-26 19:18:15.068710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.316 [2024-11-26 19:18:15.068840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.316 [2024-11-26 19:18:15.068852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:58.317 [2024-11-26 19:18:15.068860] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:58.317 [2024-11-26 19:18:15.068984] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:58.317 [2024-11-26 19:18:15.069057] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:58.317 [2024-11-26 19:18:15.069067] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:58.317 [2024-11-26 19:18:15.069075] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:58.317 [2024-11-26 19:18:15.071042] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:58.317 [2024-11-26 19:18:15.080336] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:58.317 [2024-11-26 19:18:15.080662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.317 [2024-11-26 19:18:15.080872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.317 [2024-11-26 19:18:15.080885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:58.317 [2024-11-26 19:18:15.080894] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:58.317 [2024-11-26 19:18:15.081033] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:58.317 [2024-11-26 19:18:15.081141] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:58.317 [2024-11-26 19:18:15.081151] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:58.317 [2024-11-26 19:18:15.081157] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:58.317 [2024-11-26 19:18:15.082976] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:58.317 [2024-11-26 19:18:15.092513] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:58.317 [2024-11-26 19:18:15.092897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.317 [2024-11-26 19:18:15.093005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.317 [2024-11-26 19:18:15.093017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:58.317 [2024-11-26 19:18:15.093026] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:58.317 [2024-11-26 19:18:15.093083] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:58.317 [2024-11-26 19:18:15.093215] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:58.317 [2024-11-26 19:18:15.093224] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:58.317 [2024-11-26 19:18:15.093231] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:58.317 [2024-11-26 19:18:15.094971] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:58.317 [2024-11-26 19:18:15.104522] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:58.317 [2024-11-26 19:18:15.104750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.317 [2024-11-26 19:18:15.104958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.317 [2024-11-26 19:18:15.104972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:58.317 [2024-11-26 19:18:15.104980] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:58.317 [2024-11-26 19:18:15.105129] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:58.317 [2024-11-26 19:18:15.105232] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:58.317 [2024-11-26 19:18:15.105241] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:58.317 [2024-11-26 19:18:15.105249] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:58.317 [2024-11-26 19:18:15.107103] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:58.317 [2024-11-26 19:18:15.116416] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:58.317 [2024-11-26 19:18:15.116803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.317 [2024-11-26 19:18:15.117011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.317 [2024-11-26 19:18:15.117025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:58.317 [2024-11-26 19:18:15.117034] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:58.317 [2024-11-26 19:18:15.117167] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:58.317 [2024-11-26 19:18:15.117331] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:58.317 [2024-11-26 19:18:15.117344] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:58.317 [2024-11-26 19:18:15.117351] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:58.317 [2024-11-26 19:18:15.119031] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:58.317 [2024-11-26 19:18:15.128509] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:58.317 [2024-11-26 19:18:15.128887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.317 [2024-11-26 19:18:15.129123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.317 [2024-11-26 19:18:15.129137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:58.317 [2024-11-26 19:18:15.129145] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:58.317 [2024-11-26 19:18:15.129248] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:58.317 [2024-11-26 19:18:15.129321] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:58.317 [2024-11-26 19:18:15.129330] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:58.317 [2024-11-26 19:18:15.129338] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:58.317 [2024-11-26 19:18:15.131123] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:58.317 [2024-11-26 19:18:15.140418] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:58.317 [2024-11-26 19:18:15.140764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.317 [2024-11-26 19:18:15.140996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.317 [2024-11-26 19:18:15.141011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:58.317 [2024-11-26 19:18:15.141020] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:58.317 [2024-11-26 19:18:15.141140] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:58.317 [2024-11-26 19:18:15.141244] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:58.317 [2024-11-26 19:18:15.141253] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:58.317 [2024-11-26 19:18:15.141260] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:58.317 [2024-11-26 19:18:15.143141] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:58.317 [2024-11-26 19:18:15.152294] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:58.317 [2024-11-26 19:18:15.152706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.317 [2024-11-26 19:18:15.152931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.317 [2024-11-26 19:18:15.152944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:58.317 [2024-11-26 19:18:15.152956] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:58.317 [2024-11-26 19:18:15.153106] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:58.317 [2024-11-26 19:18:15.153209] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:58.317 [2024-11-26 19:18:15.153219] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:58.317 [2024-11-26 19:18:15.153230] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:58.317 [2024-11-26 19:18:15.155229] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:58.317 [2024-11-26 19:18:15.164326] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:58.317 [2024-11-26 19:18:15.164698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.317 [2024-11-26 19:18:15.164808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.317 [2024-11-26 19:18:15.164821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:58.317 [2024-11-26 19:18:15.164829] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:58.317 [2024-11-26 19:18:15.164953] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:58.317 [2024-11-26 19:18:15.165071] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:58.317 [2024-11-26 19:18:15.165081] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:58.317 [2024-11-26 19:18:15.165088] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:58.317 [2024-11-26 19:18:15.166875] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:58.317 [2024-11-26 19:18:15.176365] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:58.317 [2024-11-26 19:18:15.176744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.317 [2024-11-26 19:18:15.176977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.317 [2024-11-26 19:18:15.176991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:58.317 [2024-11-26 19:18:15.176999] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:58.317 [2024-11-26 19:18:15.177103] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:58.318 [2024-11-26 19:18:15.177206] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:58.318 [2024-11-26 19:18:15.177215] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:58.318 [2024-11-26 19:18:15.177222] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:58.318 [2024-11-26 19:18:15.178869] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:58.318 [2024-11-26 19:18:15.188388] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:58.318 [2024-11-26 19:18:15.188750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.318 [2024-11-26 19:18:15.188913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.318 [2024-11-26 19:18:15.188925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:58.318 [2024-11-26 19:18:15.188933] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:58.318 [2024-11-26 19:18:15.189056] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:58.318 [2024-11-26 19:18:15.189159] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:58.318 [2024-11-26 19:18:15.189167] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:58.318 [2024-11-26 19:18:15.189174] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:58.318 [2024-11-26 19:18:15.190882] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:58.318 [2024-11-26 19:18:15.200508] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:58.318 [2024-11-26 19:18:15.200870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.318 [2024-11-26 19:18:15.201019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.318 [2024-11-26 19:18:15.201032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:58.318 [2024-11-26 19:18:15.201041] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:58.318 [2024-11-26 19:18:15.201160] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:58.318 [2024-11-26 19:18:15.201308] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:58.318 [2024-11-26 19:18:15.201319] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:58.318 [2024-11-26 19:18:15.201326] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:58.318 [2024-11-26 19:18:15.202941] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:58.318 [2024-11-26 19:18:15.212519] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:58.318 [2024-11-26 19:18:15.212846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.318 [2024-11-26 19:18:15.213081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.318 [2024-11-26 19:18:15.213095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:58.318 [2024-11-26 19:18:15.213103] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:58.318 [2024-11-26 19:18:15.213192] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:58.318 [2024-11-26 19:18:15.213279] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:58.318 [2024-11-26 19:18:15.213288] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:58.318 [2024-11-26 19:18:15.213295] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:58.318 [2024-11-26 19:18:15.215063] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:58.318 [2024-11-26 19:18:15.224602] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:58.318 [2024-11-26 19:18:15.224919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.318 [2024-11-26 19:18:15.225152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.318 [2024-11-26 19:18:15.225165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:58.318 [2024-11-26 19:18:15.225173] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:58.318 [2024-11-26 19:18:15.225292] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:58.318 [2024-11-26 19:18:15.225410] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:58.318 [2024-11-26 19:18:15.225420] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:58.318 [2024-11-26 19:18:15.225426] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:58.318 [2024-11-26 19:18:15.227063] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:58.318 [2024-11-26 19:18:15.236664] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:58.318 [2024-11-26 19:18:15.237033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.318 [2024-11-26 19:18:15.237183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.318 [2024-11-26 19:18:15.237195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:58.318 [2024-11-26 19:18:15.237204] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:58.318 [2024-11-26 19:18:15.237292] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:58.318 [2024-11-26 19:18:15.237411] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:58.318 [2024-11-26 19:18:15.237420] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:58.318 [2024-11-26 19:18:15.237427] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:58.578 [2024-11-26 19:18:15.239219] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:58.578 [2024-11-26 19:18:15.248794] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:58.578 [2024-11-26 19:18:15.249028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.578 [2024-11-26 19:18:15.249118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.578 [2024-11-26 19:18:15.249130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:58.578 [2024-11-26 19:18:15.249138] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:58.578 [2024-11-26 19:18:15.249272] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:58.578 [2024-11-26 19:18:15.249406] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:58.578 [2024-11-26 19:18:15.249417] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:58.578 [2024-11-26 19:18:15.249425] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:58.578 [2024-11-26 19:18:15.251303] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:58.578 [2024-11-26 19:18:15.260708] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:58.578 [2024-11-26 19:18:15.260962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.578 [2024-11-26 19:18:15.261169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.578 [2024-11-26 19:18:15.261180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:58.579 [2024-11-26 19:18:15.261189] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:58.579 [2024-11-26 19:18:15.261307] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:58.579 [2024-11-26 19:18:15.261396] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:58.579 [2024-11-26 19:18:15.261404] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:58.579 [2024-11-26 19:18:15.261413] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:58.579 [2024-11-26 19:18:15.263245] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:58.579 [2024-11-26 19:18:15.272628] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:58.579 [2024-11-26 19:18:15.272867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.579 [2024-11-26 19:18:15.272961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.579 [2024-11-26 19:18:15.272973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:58.579 [2024-11-26 19:18:15.272982] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:58.579 [2024-11-26 19:18:15.273099] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:58.579 [2024-11-26 19:18:15.273202] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:58.579 [2024-11-26 19:18:15.273212] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:58.579 [2024-11-26 19:18:15.273219] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:58.579 [2024-11-26 19:18:15.274944] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:58.579 [2024-11-26 19:18:15.284766] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:58.579 [2024-11-26 19:18:15.285015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.579 [2024-11-26 19:18:15.285177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.579 [2024-11-26 19:18:15.285189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:58.579 [2024-11-26 19:18:15.285198] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:58.579 [2024-11-26 19:18:15.285300] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:58.579 [2024-11-26 19:18:15.285419] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:58.579 [2024-11-26 19:18:15.285429] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:58.579 [2024-11-26 19:18:15.285437] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:58.579 [2024-11-26 19:18:15.287258] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:58.579 [2024-11-26 19:18:15.296829] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:58.579 [2024-11-26 19:18:15.297084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.579 [2024-11-26 19:18:15.297232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.579 [2024-11-26 19:18:15.297244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:58.579 [2024-11-26 19:18:15.297253] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:58.579 [2024-11-26 19:18:15.297418] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:58.579 [2024-11-26 19:18:15.297537] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:58.579 [2024-11-26 19:18:15.297546] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:58.579 [2024-11-26 19:18:15.297553] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:58.579 [2024-11-26 19:18:15.299402] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:58.579 [2024-11-26 19:18:15.308839] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:58.579 [2024-11-26 19:18:15.309132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.579 [2024-11-26 19:18:15.309394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.579 [2024-11-26 19:18:15.309407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:58.579 [2024-11-26 19:18:15.309415] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:58.579 [2024-11-26 19:18:15.309534] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:58.579 [2024-11-26 19:18:15.309667] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:58.579 [2024-11-26 19:18:15.309678] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:58.579 [2024-11-26 19:18:15.309687] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:58.579 [2024-11-26 19:18:15.311536] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:58.579 [2024-11-26 19:18:15.320766] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:58.579 [2024-11-26 19:18:15.321024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.579 [2024-11-26 19:18:15.321206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.579 [2024-11-26 19:18:15.321219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:58.579 [2024-11-26 19:18:15.321228] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:58.579 [2024-11-26 19:18:15.321362] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:58.579 [2024-11-26 19:18:15.321480] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:58.579 [2024-11-26 19:18:15.321490] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:58.579 [2024-11-26 19:18:15.321498] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:58.579 [2024-11-26 19:18:15.323224] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:58.579 [2024-11-26 19:18:15.332763] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:58.579 [2024-11-26 19:18:15.333030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.579 [2024-11-26 19:18:15.333197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.579 [2024-11-26 19:18:15.333210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:58.579 [2024-11-26 19:18:15.333219] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:58.579 [2024-11-26 19:18:15.333352] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:58.579 [2024-11-26 19:18:15.333470] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:58.579 [2024-11-26 19:18:15.333481] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:58.579 [2024-11-26 19:18:15.333489] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:58.579 [2024-11-26 19:18:15.335274] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:58.579 [2024-11-26 19:18:15.344862] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:58.579 [2024-11-26 19:18:15.345221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.579 [2024-11-26 19:18:15.345376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.579 [2024-11-26 19:18:15.345389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:58.579 [2024-11-26 19:18:15.345402] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:58.579 [2024-11-26 19:18:15.345521] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:58.579 [2024-11-26 19:18:15.345639] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:58.579 [2024-11-26 19:18:15.345649] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:58.579 [2024-11-26 19:18:15.345657] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:58.579 [2024-11-26 19:18:15.347385] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:58.579 [2024-11-26 19:18:15.356935] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:58.579 [2024-11-26 19:18:15.357168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.579 [2024-11-26 19:18:15.357328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.579 [2024-11-26 19:18:15.357341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:58.579 [2024-11-26 19:18:15.357349] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:58.579 [2024-11-26 19:18:15.357483] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:58.579 [2024-11-26 19:18:15.357602] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:58.579 [2024-11-26 19:18:15.357612] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:58.579 [2024-11-26 19:18:15.357621] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:58.579 [2024-11-26 19:18:15.359546] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:58.579 [2024-11-26 19:18:15.369078] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:58.579 [2024-11-26 19:18:15.369392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.579 [2024-11-26 19:18:15.369556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.579 [2024-11-26 19:18:15.369569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:58.579 [2024-11-26 19:18:15.369577] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:58.579 [2024-11-26 19:18:15.369695] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:58.579 [2024-11-26 19:18:15.369783] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:58.579 [2024-11-26 19:18:15.369792] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:58.580 [2024-11-26 19:18:15.369800] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:58.580 [2024-11-26 19:18:15.371514] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:58.580 [2024-11-26 19:18:15.381177] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:58.580 [2024-11-26 19:18:15.381428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.580 [2024-11-26 19:18:15.381661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.580 [2024-11-26 19:18:15.381674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:58.580 [2024-11-26 19:18:15.381683] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:58.580 [2024-11-26 19:18:15.381835] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:58.580 [2024-11-26 19:18:15.381974] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:58.580 [2024-11-26 19:18:15.381985] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:58.580 [2024-11-26 19:18:15.381993] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:58.580 [2024-11-26 19:18:15.383659] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:58.580 [2024-11-26 19:18:15.393095] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:58.580 [2024-11-26 19:18:15.393374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.580 [2024-11-26 19:18:15.393468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.580 [2024-11-26 19:18:15.393481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:58.580 [2024-11-26 19:18:15.393489] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:58.580 [2024-11-26 19:18:15.393562] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:58.580 [2024-11-26 19:18:15.393665] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:58.580 [2024-11-26 19:18:15.393674] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:58.580 [2024-11-26 19:18:15.393681] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:58.580 [2024-11-26 19:18:15.395602] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:58.580 [2024-11-26 19:18:15.405125] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:58.580 [2024-11-26 19:18:15.405418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.580 [2024-11-26 19:18:15.405576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.580 [2024-11-26 19:18:15.405589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:58.580 [2024-11-26 19:18:15.405599] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:58.580 [2024-11-26 19:18:15.405763] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:58.580 [2024-11-26 19:18:15.405851] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:58.580 [2024-11-26 19:18:15.405862] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:58.580 [2024-11-26 19:18:15.405870] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:58.580 [2024-11-26 19:18:15.407569] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:58.580 [2024-11-26 19:18:15.417286] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:58.580 [2024-11-26 19:18:15.417616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.580 [2024-11-26 19:18:15.417764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.580 [2024-11-26 19:18:15.417778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:58.580 [2024-11-26 19:18:15.417787] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:58.580 [2024-11-26 19:18:15.417910] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:58.580 [2024-11-26 19:18:15.418018] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:58.580 [2024-11-26 19:18:15.418028] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:58.580 [2024-11-26 19:18:15.418035] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:58.580 19:18:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:31:58.580 19:18:15 -- common/autotest_common.sh@862 -- # return 0 00:31:58.580 19:18:15 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:31:58.580 19:18:15 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:58.580 19:18:15 -- common/autotest_common.sh@10 -- # set +x 00:31:58.580 [2024-11-26 19:18:15.419832] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:58.580 [2024-11-26 19:18:15.429394] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:58.580 [2024-11-26 19:18:15.429799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.580 [2024-11-26 19:18:15.430009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.580 [2024-11-26 19:18:15.430022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:58.580 [2024-11-26 19:18:15.430031] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:58.580 [2024-11-26 19:18:15.430195] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:58.580 [2024-11-26 19:18:15.430284] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:58.580 [2024-11-26 19:18:15.430295] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:58.580 [2024-11-26 19:18:15.430304] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:58.580 [2024-11-26 19:18:15.432139] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:58.580 [2024-11-26 19:18:15.441409] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:58.580 [2024-11-26 19:18:15.441686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.580 [2024-11-26 19:18:15.441844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.580 [2024-11-26 19:18:15.441857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:58.580 [2024-11-26 19:18:15.441866] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:58.580 [2024-11-26 19:18:15.442021] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:58.580 [2024-11-26 19:18:15.442155] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:58.580 [2024-11-26 19:18:15.442165] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:58.580 [2024-11-26 19:18:15.442173] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:58.580 [2024-11-26 19:18:15.443925] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:58.580 [2024-11-26 19:18:15.453416] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:58.580 [2024-11-26 19:18:15.453808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.580 [2024-11-26 19:18:15.453978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.580 [2024-11-26 19:18:15.453991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:58.580 [2024-11-26 19:18:15.454000] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:58.580 [2024-11-26 19:18:15.454123] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:58.580 19:18:15 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:31:58.580 [2024-11-26 19:18:15.454242] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:58.580 [2024-11-26 19:18:15.454253] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:58.580 [2024-11-26 19:18:15.454260] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:58.580 19:18:15 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:31:58.580 19:18:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:58.580 19:18:15 -- common/autotest_common.sh@10 -- # set +x 00:31:58.580 [2024-11-26 19:18:15.456122] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:58.580 [2024-11-26 19:18:15.458591] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:31:58.580 19:18:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:58.580 19:18:15 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:31:58.580 19:18:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:58.580 19:18:15 -- common/autotest_common.sh@10 -- # set +x 00:31:58.580 [2024-11-26 19:18:15.465364] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:58.580 [2024-11-26 19:18:15.465667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.580 [2024-11-26 19:18:15.465826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.580 [2024-11-26 19:18:15.465838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:58.580 [2024-11-26 19:18:15.465846] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:58.580 [2024-11-26 19:18:15.465978] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:58.580 [2024-11-26 19:18:15.466083] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:58.580 [2024-11-26 19:18:15.466093] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:58.580 [2024-11-26 19:18:15.466101] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:58.580 [2024-11-26 19:18:15.467943] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:58.580 [2024-11-26 19:18:15.477189] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:58.581 [2024-11-26 19:18:15.477480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.581 [2024-11-26 19:18:15.477710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.581 [2024-11-26 19:18:15.477722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:58.581 [2024-11-26 19:18:15.477731] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:58.581 [2024-11-26 19:18:15.477849] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:58.581 [2024-11-26 19:18:15.477972] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:58.581 [2024-11-26 19:18:15.477981] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:58.581 [2024-11-26 19:18:15.477988] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:58.581 [2024-11-26 19:18:15.479725] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:58.581 [2024-11-26 19:18:15.489179] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:58.581 [2024-11-26 19:18:15.489543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.581 [2024-11-26 19:18:15.489750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.581 [2024-11-26 19:18:15.489762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:58.581 [2024-11-26 19:18:15.489771] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:58.581 [2024-11-26 19:18:15.489904] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:58.581 [2024-11-26 19:18:15.490042] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:58.581 [2024-11-26 19:18:15.490053] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:58.581 [2024-11-26 19:18:15.490060] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:58.581 [2024-11-26 19:18:15.492060] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:58.581 Malloc0 00:31:58.581 19:18:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:58.581 19:18:15 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:31:58.581 19:18:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:58.581 19:18:15 -- common/autotest_common.sh@10 -- # set +x 00:31:58.839 [2024-11-26 19:18:15.500987] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:58.839 [2024-11-26 19:18:15.501375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.839 [2024-11-26 19:18:15.501532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.839 [2024-11-26 19:18:15.501544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:58.839 [2024-11-26 19:18:15.501553] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:58.839 [2024-11-26 19:18:15.501671] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:58.839 [2024-11-26 19:18:15.501774] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:58.839 [2024-11-26 19:18:15.501783] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:58.839 [2024-11-26 19:18:15.501790] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:58.839 [2024-11-26 19:18:15.503597] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:58.839 19:18:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:58.840 19:18:15 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:31:58.840 19:18:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:58.840 19:18:15 -- common/autotest_common.sh@10 -- # set +x 00:31:58.840 [2024-11-26 19:18:15.512934] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:58.840 [2024-11-26 19:18:15.513252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.840 [2024-11-26 19:18:15.513483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:58.840 [2024-11-26 19:18:15.513495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c234e0 with addr=10.0.0.2, port=4420 00:31:58.840 [2024-11-26 19:18:15.513504] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c234e0 is same with the state(5) to be set 00:31:58.840 [2024-11-26 19:18:15.513622] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c234e0 (9): Bad file descriptor 00:31:58.840 [2024-11-26 19:18:15.513709] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:58.840 [2024-11-26 19:18:15.513722] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:58.840 [2024-11-26 19:18:15.513729] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:58.840 [2024-11-26 19:18:15.515440] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:58.840 19:18:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:58.840 19:18:15 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:31:58.840 19:18:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:58.840 19:18:15 -- common/autotest_common.sh@10 -- # set +x 00:31:58.840 [2024-11-26 19:18:15.521318] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:58.840 [2024-11-26 19:18:15.524993] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:58.840 19:18:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:58.840 19:18:15 -- host/bdevperf.sh@38 -- # wait 3294184 00:31:58.840 [2024-11-26 19:18:15.541560] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:32:08.817 00:32:08.817 Latency(us) 00:32:08.817 [2024-11-26T18:18:25.744Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:32:08.817 [2024-11-26T18:18:25.744Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:32:08.817 Verification LBA range: start 0x0 length 0x4000 00:32:08.817 Nvme1n1 : 15.01 12489.82 48.79 19382.55 0.00 4004.23 601.93 15614.66 00:32:08.817 [2024-11-26T18:18:25.744Z] =================================================================================================================== 00:32:08.817 [2024-11-26T18:18:25.744Z] Total : 12489.82 48.79 19382.55 0.00 4004.23 601.93 15614.66 00:32:08.817 19:18:24 -- host/bdevperf.sh@39 -- # sync 00:32:08.817 19:18:24 -- host/bdevperf.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:32:08.817 19:18:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:08.817 19:18:24 -- common/autotest_common.sh@10 -- # set +x 00:32:08.817 19:18:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:08.817 19:18:24 -- host/bdevperf.sh@42 -- # trap - SIGINT SIGTERM EXIT 00:32:08.817 19:18:24 -- host/bdevperf.sh@44 -- # nvmftestfini 00:32:08.817 19:18:24 -- nvmf/common.sh@476 -- # nvmfcleanup 00:32:08.817 19:18:24 -- nvmf/common.sh@116 -- # sync 00:32:08.817 19:18:24 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:32:08.817 19:18:24 -- nvmf/common.sh@119 -- # set +e 00:32:08.817 19:18:24 -- nvmf/common.sh@120 -- # for i in {1..20} 00:32:08.817 19:18:24 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:32:08.817 rmmod nvme_tcp 00:32:08.817 rmmod nvme_fabrics 00:32:08.817 rmmod nvme_keyring 00:32:08.817 19:18:24 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:32:08.817 19:18:24 -- nvmf/common.sh@123 -- # set -e 00:32:08.817 19:18:24 -- nvmf/common.sh@124 -- # return 0 00:32:08.817 19:18:24 -- nvmf/common.sh@477 -- # '[' -n 3295273 ']' 00:32:08.817 19:18:24 -- nvmf/common.sh@478 -- # killprocess 3295273 00:32:08.817 19:18:24 -- common/autotest_common.sh@936 -- # '[' -z 3295273 ']' 00:32:08.817 19:18:24 -- common/autotest_common.sh@940 -- # kill -0 3295273 00:32:08.817 19:18:24 -- common/autotest_common.sh@941 -- # uname 00:32:08.817 19:18:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:32:08.817 19:18:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3295273 00:32:08.817 19:18:24 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:32:08.817 19:18:24 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:32:08.817 19:18:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3295273' 00:32:08.817 killing process with pid 3295273 00:32:08.817 19:18:24 -- common/autotest_common.sh@955 -- # kill 3295273 00:32:08.817 19:18:24 -- common/autotest_common.sh@960 -- # wait 3295273 00:32:08.817 19:18:24 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:32:08.817 19:18:24 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:32:08.817 19:18:24 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:32:08.817 19:18:24 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:32:08.817 19:18:24 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:32:08.817 19:18:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:32:08.817 19:18:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:32:08.817 19:18:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:32:09.753 19:18:26 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:32:09.753 00:32:09.753 real 0m25.778s 00:32:09.753 user 1m2.392s 00:32:09.753 sys 0m6.171s 00:32:09.753 19:18:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:09.753 19:18:26 -- common/autotest_common.sh@10 -- # set +x 00:32:09.753 ************************************ 00:32:09.753 END TEST nvmf_bdevperf 00:32:09.753 ************************************ 00:32:09.753 19:18:26 -- nvmf/nvmf.sh@124 -- # run_test nvmf_target_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:32:09.753 19:18:26 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:32:09.753 19:18:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:09.753 19:18:26 -- common/autotest_common.sh@10 -- # set +x 00:32:09.753 ************************************ 00:32:09.753 START TEST nvmf_target_disconnect 00:32:09.753 ************************************ 00:32:09.753 19:18:26 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:32:10.013 * Looking for test storage... 00:32:10.013 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:32:10.013 19:18:26 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:32:10.013 19:18:26 -- common/autotest_common.sh@1690 -- # lcov --version 00:32:10.013 19:18:26 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:32:10.013 19:18:26 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:32:10.014 19:18:26 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:32:10.014 19:18:26 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:32:10.014 19:18:26 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:32:10.014 19:18:26 -- scripts/common.sh@335 -- # IFS=.-: 00:32:10.014 19:18:26 -- scripts/common.sh@335 -- # read -ra ver1 00:32:10.014 19:18:26 -- scripts/common.sh@336 -- # IFS=.-: 00:32:10.014 19:18:26 -- scripts/common.sh@336 -- # read -ra ver2 00:32:10.014 19:18:26 -- scripts/common.sh@337 -- # local 'op=<' 00:32:10.014 19:18:26 -- scripts/common.sh@339 -- # ver1_l=2 00:32:10.014 19:18:26 -- scripts/common.sh@340 -- # ver2_l=1 00:32:10.014 19:18:26 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:32:10.014 19:18:26 -- scripts/common.sh@343 -- # case "$op" in 00:32:10.014 19:18:26 -- scripts/common.sh@344 -- # : 1 00:32:10.014 19:18:26 -- scripts/common.sh@363 -- # (( v = 0 )) 00:32:10.014 19:18:26 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:32:10.014 19:18:26 -- scripts/common.sh@364 -- # decimal 1 00:32:10.014 19:18:26 -- scripts/common.sh@352 -- # local d=1 00:32:10.014 19:18:26 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:32:10.014 19:18:26 -- scripts/common.sh@354 -- # echo 1 00:32:10.014 19:18:26 -- scripts/common.sh@364 -- # ver1[v]=1 00:32:10.014 19:18:26 -- scripts/common.sh@365 -- # decimal 2 00:32:10.014 19:18:26 -- scripts/common.sh@352 -- # local d=2 00:32:10.014 19:18:26 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:32:10.014 19:18:26 -- scripts/common.sh@354 -- # echo 2 00:32:10.014 19:18:26 -- scripts/common.sh@365 -- # ver2[v]=2 00:32:10.014 19:18:26 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:32:10.014 19:18:26 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:32:10.014 19:18:26 -- scripts/common.sh@367 -- # return 0 00:32:10.014 19:18:26 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:32:10.014 19:18:26 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:32:10.014 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:10.014 --rc genhtml_branch_coverage=1 00:32:10.014 --rc genhtml_function_coverage=1 00:32:10.014 --rc genhtml_legend=1 00:32:10.014 --rc geninfo_all_blocks=1 00:32:10.014 --rc geninfo_unexecuted_blocks=1 00:32:10.014 00:32:10.014 ' 00:32:10.014 19:18:26 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:32:10.014 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:10.014 --rc genhtml_branch_coverage=1 00:32:10.014 --rc genhtml_function_coverage=1 00:32:10.014 --rc genhtml_legend=1 00:32:10.014 --rc geninfo_all_blocks=1 00:32:10.014 --rc geninfo_unexecuted_blocks=1 00:32:10.014 00:32:10.014 ' 00:32:10.014 19:18:26 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:32:10.014 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:10.014 --rc genhtml_branch_coverage=1 00:32:10.014 --rc genhtml_function_coverage=1 00:32:10.014 --rc genhtml_legend=1 00:32:10.014 --rc geninfo_all_blocks=1 00:32:10.014 --rc geninfo_unexecuted_blocks=1 00:32:10.014 00:32:10.014 ' 00:32:10.014 19:18:26 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:32:10.014 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:10.014 --rc genhtml_branch_coverage=1 00:32:10.014 --rc genhtml_function_coverage=1 00:32:10.014 --rc genhtml_legend=1 00:32:10.014 --rc geninfo_all_blocks=1 00:32:10.014 --rc geninfo_unexecuted_blocks=1 00:32:10.014 00:32:10.014 ' 00:32:10.014 19:18:26 -- host/target_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:32:10.014 19:18:26 -- nvmf/common.sh@7 -- # uname -s 00:32:10.014 19:18:26 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:32:10.014 19:18:26 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:32:10.014 19:18:26 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:32:10.014 19:18:26 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:32:10.014 19:18:26 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:32:10.014 19:18:26 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:32:10.014 19:18:26 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:32:10.014 19:18:26 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:32:10.014 19:18:26 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:32:10.014 19:18:26 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:32:10.014 19:18:26 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:32:10.014 19:18:26 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:32:10.014 19:18:26 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:32:10.014 19:18:26 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:32:10.014 19:18:26 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:32:10.014 19:18:26 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:32:10.014 19:18:26 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:32:10.014 19:18:26 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:32:10.014 19:18:26 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:32:10.014 19:18:26 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:10.014 19:18:26 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:10.014 19:18:26 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:10.014 19:18:26 -- paths/export.sh@5 -- # export PATH 00:32:10.014 19:18:26 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:10.014 19:18:26 -- nvmf/common.sh@46 -- # : 0 00:32:10.014 19:18:26 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:32:10.014 19:18:26 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:32:10.014 19:18:26 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:32:10.014 19:18:26 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:32:10.014 19:18:26 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:32:10.014 19:18:26 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:32:10.014 19:18:26 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:32:10.014 19:18:26 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:32:10.014 19:18:26 -- host/target_disconnect.sh@11 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:32:10.014 19:18:26 -- host/target_disconnect.sh@13 -- # MALLOC_BDEV_SIZE=64 00:32:10.014 19:18:26 -- host/target_disconnect.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:32:10.014 19:18:26 -- host/target_disconnect.sh@77 -- # nvmftestinit 00:32:10.014 19:18:26 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:32:10.014 19:18:26 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:32:10.014 19:18:26 -- nvmf/common.sh@436 -- # prepare_net_devs 00:32:10.014 19:18:26 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:32:10.014 19:18:26 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:32:10.014 19:18:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:32:10.014 19:18:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:32:10.014 19:18:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:32:10.014 19:18:26 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:32:10.014 19:18:26 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:32:10.014 19:18:26 -- nvmf/common.sh@284 -- # xtrace_disable 00:32:10.014 19:18:26 -- common/autotest_common.sh@10 -- # set +x 00:32:15.365 19:18:32 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:32:15.365 19:18:32 -- nvmf/common.sh@290 -- # pci_devs=() 00:32:15.365 19:18:32 -- nvmf/common.sh@290 -- # local -a pci_devs 00:32:15.365 19:18:32 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:32:15.365 19:18:32 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:32:15.365 19:18:32 -- nvmf/common.sh@292 -- # pci_drivers=() 00:32:15.366 19:18:32 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:32:15.366 19:18:32 -- nvmf/common.sh@294 -- # net_devs=() 00:32:15.366 19:18:32 -- nvmf/common.sh@294 -- # local -ga net_devs 00:32:15.366 19:18:32 -- nvmf/common.sh@295 -- # e810=() 00:32:15.366 19:18:32 -- nvmf/common.sh@295 -- # local -ga e810 00:32:15.366 19:18:32 -- nvmf/common.sh@296 -- # x722=() 00:32:15.366 19:18:32 -- nvmf/common.sh@296 -- # local -ga x722 00:32:15.366 19:18:32 -- nvmf/common.sh@297 -- # mlx=() 00:32:15.366 19:18:32 -- nvmf/common.sh@297 -- # local -ga mlx 00:32:15.366 19:18:32 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:32:15.366 19:18:32 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:32:15.366 19:18:32 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:32:15.366 19:18:32 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:32:15.366 19:18:32 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:32:15.366 19:18:32 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:32:15.366 19:18:32 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:32:15.366 19:18:32 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:32:15.366 19:18:32 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:32:15.366 19:18:32 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:32:15.366 19:18:32 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:32:15.366 19:18:32 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:32:15.366 19:18:32 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:32:15.366 19:18:32 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:32:15.366 19:18:32 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:32:15.366 19:18:32 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:32:15.366 19:18:32 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:32:15.366 19:18:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:32:15.366 19:18:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:32:15.366 Found 0000:86:00.0 (0x8086 - 0x159b) 00:32:15.366 19:18:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:32:15.366 19:18:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:32:15.366 19:18:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:32:15.366 19:18:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:32:15.366 19:18:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:32:15.366 19:18:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:32:15.366 19:18:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:32:15.366 Found 0000:86:00.1 (0x8086 - 0x159b) 00:32:15.366 19:18:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:32:15.366 19:18:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:32:15.366 19:18:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:32:15.366 19:18:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:32:15.366 19:18:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:32:15.366 19:18:32 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:32:15.366 19:18:32 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:32:15.366 19:18:32 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:32:15.366 19:18:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:32:15.366 19:18:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:32:15.366 19:18:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:32:15.366 19:18:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:32:15.366 19:18:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:32:15.366 Found net devices under 0000:86:00.0: cvl_0_0 00:32:15.366 19:18:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:32:15.366 19:18:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:32:15.366 19:18:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:32:15.366 19:18:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:32:15.366 19:18:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:32:15.366 19:18:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:32:15.366 Found net devices under 0000:86:00.1: cvl_0_1 00:32:15.366 19:18:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:32:15.366 19:18:32 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:32:15.366 19:18:32 -- nvmf/common.sh@402 -- # is_hw=yes 00:32:15.366 19:18:32 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:32:15.366 19:18:32 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:32:15.366 19:18:32 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:32:15.366 19:18:32 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:32:15.366 19:18:32 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:32:15.366 19:18:32 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:32:15.366 19:18:32 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:32:15.366 19:18:32 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:32:15.366 19:18:32 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:32:15.366 19:18:32 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:32:15.366 19:18:32 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:32:15.366 19:18:32 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:32:15.366 19:18:32 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:32:15.366 19:18:32 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:32:15.366 19:18:32 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:32:15.366 19:18:32 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:32:15.625 19:18:32 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:32:15.625 19:18:32 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:32:15.625 19:18:32 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:32:15.625 19:18:32 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:32:15.625 19:18:32 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:32:15.625 19:18:32 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:32:15.625 19:18:32 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:32:15.625 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:32:15.625 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.409 ms 00:32:15.625 00:32:15.625 --- 10.0.0.2 ping statistics --- 00:32:15.625 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:32:15.625 rtt min/avg/max/mdev = 0.409/0.409/0.409/0.000 ms 00:32:15.625 19:18:32 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:32:15.625 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:32:15.625 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.207 ms 00:32:15.625 00:32:15.625 --- 10.0.0.1 ping statistics --- 00:32:15.625 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:32:15.625 rtt min/avg/max/mdev = 0.207/0.207/0.207/0.000 ms 00:32:15.625 19:18:32 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:32:15.625 19:18:32 -- nvmf/common.sh@410 -- # return 0 00:32:15.625 19:18:32 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:32:15.625 19:18:32 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:32:15.625 19:18:32 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:32:15.625 19:18:32 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:32:15.625 19:18:32 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:32:15.625 19:18:32 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:32:15.625 19:18:32 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:32:15.625 19:18:32 -- host/target_disconnect.sh@78 -- # run_test nvmf_target_disconnect_tc1 nvmf_target_disconnect_tc1 00:32:15.625 19:18:32 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:32:15.625 19:18:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:15.625 19:18:32 -- common/autotest_common.sh@10 -- # set +x 00:32:15.625 ************************************ 00:32:15.625 START TEST nvmf_target_disconnect_tc1 00:32:15.625 ************************************ 00:32:15.625 19:18:32 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc1 00:32:15.625 19:18:32 -- host/target_disconnect.sh@32 -- # set +e 00:32:15.625 19:18:32 -- host/target_disconnect.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:32:15.885 EAL: No free 2048 kB hugepages reported on node 1 00:32:15.885 [2024-11-26 19:18:32.626486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:15.885 [2024-11-26 19:18:32.626816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:15.885 [2024-11-26 19:18:32.626857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf1c9d0 with addr=10.0.0.2, port=4420 00:32:15.885 [2024-11-26 19:18:32.626908] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:32:15.885 [2024-11-26 19:18:32.626942] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:32:15.885 [2024-11-26 19:18:32.626982] nvme.c: 898:spdk_nvme_probe: *ERROR*: Create probe context failed 00:32:15.885 spdk_nvme_probe() failed for transport address '10.0.0.2' 00:32:15.885 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect: errors occurred 00:32:15.885 Initializing NVMe Controllers 00:32:15.885 19:18:32 -- host/target_disconnect.sh@33 -- # trap - ERR 00:32:15.885 19:18:32 -- host/target_disconnect.sh@33 -- # print_backtrace 00:32:15.885 19:18:32 -- common/autotest_common.sh@1142 -- # [[ hxBET =~ e ]] 00:32:15.885 19:18:32 -- common/autotest_common.sh@1142 -- # return 0 00:32:15.885 19:18:32 -- host/target_disconnect.sh@37 -- # '[' 1 '!=' 1 ']' 00:32:15.885 19:18:32 -- host/target_disconnect.sh@41 -- # set -e 00:32:15.885 00:32:15.885 real 0m0.092s 00:32:15.885 user 0m0.035s 00:32:15.885 sys 0m0.055s 00:32:15.885 19:18:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:15.885 19:18:32 -- common/autotest_common.sh@10 -- # set +x 00:32:15.885 ************************************ 00:32:15.885 END TEST nvmf_target_disconnect_tc1 00:32:15.885 ************************************ 00:32:15.885 19:18:32 -- host/target_disconnect.sh@79 -- # run_test nvmf_target_disconnect_tc2 nvmf_target_disconnect_tc2 00:32:15.885 19:18:32 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:32:15.885 19:18:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:15.885 19:18:32 -- common/autotest_common.sh@10 -- # set +x 00:32:15.885 ************************************ 00:32:15.885 START TEST nvmf_target_disconnect_tc2 00:32:15.885 ************************************ 00:32:15.885 19:18:32 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc2 00:32:15.885 19:18:32 -- host/target_disconnect.sh@45 -- # disconnect_init 10.0.0.2 00:32:15.885 19:18:32 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:32:15.885 19:18:32 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:32:15.885 19:18:32 -- common/autotest_common.sh@722 -- # xtrace_disable 00:32:15.885 19:18:32 -- common/autotest_common.sh@10 -- # set +x 00:32:15.885 19:18:32 -- nvmf/common.sh@469 -- # nvmfpid=3300994 00:32:15.885 19:18:32 -- nvmf/common.sh@470 -- # waitforlisten 3300994 00:32:15.885 19:18:32 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:32:15.885 19:18:32 -- common/autotest_common.sh@829 -- # '[' -z 3300994 ']' 00:32:15.885 19:18:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:32:15.885 19:18:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:32:15.885 19:18:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:32:15.885 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:32:15.885 19:18:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:32:15.885 19:18:32 -- common/autotest_common.sh@10 -- # set +x 00:32:15.885 [2024-11-26 19:18:32.728017] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:32:15.885 [2024-11-26 19:18:32.728062] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:32:15.885 EAL: No free 2048 kB hugepages reported on node 1 00:32:15.885 [2024-11-26 19:18:32.803618] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:32:16.144 [2024-11-26 19:18:32.843097] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:32:16.144 [2024-11-26 19:18:32.843207] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:32:16.144 [2024-11-26 19:18:32.843215] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:32:16.144 [2024-11-26 19:18:32.843221] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:32:16.144 [2024-11-26 19:18:32.843332] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:32:16.144 [2024-11-26 19:18:32.843352] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:32:16.144 [2024-11-26 19:18:32.843447] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:32:16.144 [2024-11-26 19:18:32.843448] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:32:16.711 19:18:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:32:16.711 19:18:33 -- common/autotest_common.sh@862 -- # return 0 00:32:16.711 19:18:33 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:32:16.711 19:18:33 -- common/autotest_common.sh@728 -- # xtrace_disable 00:32:16.711 19:18:33 -- common/autotest_common.sh@10 -- # set +x 00:32:16.711 19:18:33 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:32:16.711 19:18:33 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:32:16.711 19:18:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:16.711 19:18:33 -- common/autotest_common.sh@10 -- # set +x 00:32:16.711 Malloc0 00:32:16.711 19:18:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:16.711 19:18:33 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:32:16.711 19:18:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:16.711 19:18:33 -- common/autotest_common.sh@10 -- # set +x 00:32:16.711 [2024-11-26 19:18:33.621668] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:32:16.711 19:18:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:16.711 19:18:33 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:32:16.711 19:18:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:16.711 19:18:33 -- common/autotest_common.sh@10 -- # set +x 00:32:16.970 19:18:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:16.970 19:18:33 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:32:16.970 19:18:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:16.970 19:18:33 -- common/autotest_common.sh@10 -- # set +x 00:32:16.970 19:18:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:16.970 19:18:33 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:32:16.970 19:18:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:16.970 19:18:33 -- common/autotest_common.sh@10 -- # set +x 00:32:16.970 [2024-11-26 19:18:33.657988] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:16.970 19:18:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:16.970 19:18:33 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:32:16.970 19:18:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:16.970 19:18:33 -- common/autotest_common.sh@10 -- # set +x 00:32:16.970 19:18:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:16.970 19:18:33 -- host/target_disconnect.sh@50 -- # reconnectpid=3301133 00:32:16.970 19:18:33 -- host/target_disconnect.sh@52 -- # sleep 2 00:32:16.970 19:18:33 -- host/target_disconnect.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:32:16.970 EAL: No free 2048 kB hugepages reported on node 1 00:32:18.875 19:18:35 -- host/target_disconnect.sh@53 -- # kill -9 3300994 00:32:18.875 19:18:35 -- host/target_disconnect.sh@55 -- # sleep 2 00:32:18.875 Read completed with error (sct=0, sc=8) 00:32:18.875 starting I/O failed 00:32:18.875 Read completed with error (sct=0, sc=8) 00:32:18.875 starting I/O failed 00:32:18.875 Read completed with error (sct=0, sc=8) 00:32:18.875 starting I/O failed 00:32:18.875 Read completed with error (sct=0, sc=8) 00:32:18.875 starting I/O failed 00:32:18.875 Read completed with error (sct=0, sc=8) 00:32:18.875 starting I/O failed 00:32:18.875 Read completed with error (sct=0, sc=8) 00:32:18.875 starting I/O failed 00:32:18.875 Read completed with error (sct=0, sc=8) 00:32:18.875 starting I/O failed 00:32:18.875 Read completed with error (sct=0, sc=8) 00:32:18.875 starting I/O failed 00:32:18.875 Read completed with error (sct=0, sc=8) 00:32:18.875 starting I/O failed 00:32:18.875 Read completed with error (sct=0, sc=8) 00:32:18.875 starting I/O failed 00:32:18.875 Read completed with error (sct=0, sc=8) 00:32:18.875 starting I/O failed 00:32:18.875 Read completed with error (sct=0, sc=8) 00:32:18.875 starting I/O failed 00:32:18.875 Write completed with error (sct=0, sc=8) 00:32:18.875 starting I/O failed 00:32:18.875 Read completed with error (sct=0, sc=8) 00:32:18.875 starting I/O failed 00:32:18.875 Read completed with error (sct=0, sc=8) 00:32:18.875 starting I/O failed 00:32:18.875 Write completed with error (sct=0, sc=8) 00:32:18.875 starting I/O failed 00:32:18.875 Write completed with error (sct=0, sc=8) 00:32:18.875 starting I/O failed 00:32:18.875 Read completed with error (sct=0, sc=8) 00:32:18.875 starting I/O failed 00:32:18.875 Write completed with error (sct=0, sc=8) 00:32:18.875 starting I/O failed 00:32:18.875 Read completed with error (sct=0, sc=8) 00:32:18.875 starting I/O failed 00:32:18.875 Write completed with error (sct=0, sc=8) 00:32:18.875 starting I/O failed 00:32:18.875 Read completed with error (sct=0, sc=8) 00:32:18.875 starting I/O failed 00:32:18.875 Write completed with error (sct=0, sc=8) 00:32:18.875 starting I/O failed 00:32:18.875 Write completed with error (sct=0, sc=8) 00:32:18.875 starting I/O failed 00:32:18.875 Write completed with error (sct=0, sc=8) 00:32:18.875 starting I/O failed 00:32:18.875 Write completed with error (sct=0, sc=8) 00:32:18.875 starting I/O failed 00:32:18.875 Write completed with error (sct=0, sc=8) 00:32:18.875 starting I/O failed 00:32:18.875 Write completed with error (sct=0, sc=8) 00:32:18.875 starting I/O failed 00:32:18.875 Write completed with error (sct=0, sc=8) 00:32:18.875 starting I/O failed 00:32:18.875 Read completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Read completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Write completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Read completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Read completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Read completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 [2024-11-26 19:18:35.685626] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:32:18.876 Read completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Read completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Read completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Read completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Read completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Read completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Read completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Read completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Write completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Read completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Write completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Read completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Write completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Write completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Write completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Read completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Read completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Write completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Read completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Write completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Write completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Read completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Read completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Read completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Read completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Read completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Read completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Read completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Write completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 [2024-11-26 19:18:35.685828] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:18.876 Read completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Read completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Read completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Read completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Read completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Read completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Read completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Read completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Read completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Read completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Read completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Read completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Read completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Read completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Read completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Write completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Read completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Write completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Write completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Read completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Read completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Read completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Write completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Read completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Read completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Read completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Read completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Read completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Write completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Write completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Write completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Read completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 [2024-11-26 19:18:35.686036] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:18.876 Read completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Read completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Read completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Read completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Read completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Read completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.876 Read completed with error (sct=0, sc=8) 00:32:18.876 starting I/O failed 00:32:18.877 Read completed with error (sct=0, sc=8) 00:32:18.877 starting I/O failed 00:32:18.877 Read completed with error (sct=0, sc=8) 00:32:18.877 starting I/O failed 00:32:18.877 Read completed with error (sct=0, sc=8) 00:32:18.877 starting I/O failed 00:32:18.877 Read completed with error (sct=0, sc=8) 00:32:18.877 starting I/O failed 00:32:18.877 Read completed with error (sct=0, sc=8) 00:32:18.877 starting I/O failed 00:32:18.877 Read completed with error (sct=0, sc=8) 00:32:18.877 starting I/O failed 00:32:18.877 Write completed with error (sct=0, sc=8) 00:32:18.877 starting I/O failed 00:32:18.877 Read completed with error (sct=0, sc=8) 00:32:18.877 starting I/O failed 00:32:18.877 Write completed with error (sct=0, sc=8) 00:32:18.877 starting I/O failed 00:32:18.877 Read completed with error (sct=0, sc=8) 00:32:18.877 starting I/O failed 00:32:18.877 Read completed with error (sct=0, sc=8) 00:32:18.877 starting I/O failed 00:32:18.877 Read completed with error (sct=0, sc=8) 00:32:18.877 starting I/O failed 00:32:18.877 Write completed with error (sct=0, sc=8) 00:32:18.877 starting I/O failed 00:32:18.877 Read completed with error (sct=0, sc=8) 00:32:18.877 starting I/O failed 00:32:18.877 Write completed with error (sct=0, sc=8) 00:32:18.877 starting I/O failed 00:32:18.877 Write completed with error (sct=0, sc=8) 00:32:18.877 starting I/O failed 00:32:18.877 Write completed with error (sct=0, sc=8) 00:32:18.877 starting I/O failed 00:32:18.877 Write completed with error (sct=0, sc=8) 00:32:18.877 starting I/O failed 00:32:18.877 Write completed with error (sct=0, sc=8) 00:32:18.877 starting I/O failed 00:32:18.877 Write completed with error (sct=0, sc=8) 00:32:18.877 starting I/O failed 00:32:18.877 Read completed with error (sct=0, sc=8) 00:32:18.877 starting I/O failed 00:32:18.877 Read completed with error (sct=0, sc=8) 00:32:18.877 starting I/O failed 00:32:18.877 Read completed with error (sct=0, sc=8) 00:32:18.877 starting I/O failed 00:32:18.877 Read completed with error (sct=0, sc=8) 00:32:18.877 starting I/O failed 00:32:18.877 Write completed with error (sct=0, sc=8) 00:32:18.877 starting I/O failed 00:32:18.877 [2024-11-26 19:18:35.686229] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:32:18.877 [2024-11-26 19:18:35.686503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.877 [2024-11-26 19:18:35.686707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.877 [2024-11-26 19:18:35.686743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.877 qpair failed and we were unable to recover it. 00:32:18.877 [2024-11-26 19:18:35.686942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.877 [2024-11-26 19:18:35.687088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.877 [2024-11-26 19:18:35.687121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.877 qpair failed and we were unable to recover it. 00:32:18.877 [2024-11-26 19:18:35.687368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.877 [2024-11-26 19:18:35.687630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.877 [2024-11-26 19:18:35.687661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.877 qpair failed and we were unable to recover it. 00:32:18.877 [2024-11-26 19:18:35.687798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.877 [2024-11-26 19:18:35.688106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.877 [2024-11-26 19:18:35.688140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.877 qpair failed and we were unable to recover it. 00:32:18.877 [2024-11-26 19:18:35.688331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.877 [2024-11-26 19:18:35.688545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.877 [2024-11-26 19:18:35.688576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.877 qpair failed and we were unable to recover it. 00:32:18.877 [2024-11-26 19:18:35.688832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.877 [2024-11-26 19:18:35.689025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.877 [2024-11-26 19:18:35.689058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.877 qpair failed and we were unable to recover it. 00:32:18.877 [2024-11-26 19:18:35.689248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.877 [2024-11-26 19:18:35.689490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.877 [2024-11-26 19:18:35.689521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.877 qpair failed and we were unable to recover it. 00:32:18.877 [2024-11-26 19:18:35.689707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.877 [2024-11-26 19:18:35.689968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.877 [2024-11-26 19:18:35.690002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.877 qpair failed and we were unable to recover it. 00:32:18.877 [2024-11-26 19:18:35.690192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.877 [2024-11-26 19:18:35.690381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.877 [2024-11-26 19:18:35.690412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.877 qpair failed and we were unable to recover it. 00:32:18.877 [2024-11-26 19:18:35.690702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.877 [2024-11-26 19:18:35.690839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.877 [2024-11-26 19:18:35.690870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.877 qpair failed and we were unable to recover it. 00:32:18.877 [2024-11-26 19:18:35.691115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.877 [2024-11-26 19:18:35.691344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.877 [2024-11-26 19:18:35.691359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.877 qpair failed and we were unable to recover it. 00:32:18.877 [2024-11-26 19:18:35.691451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.877 [2024-11-26 19:18:35.691634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.877 [2024-11-26 19:18:35.691649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.877 qpair failed and we were unable to recover it. 00:32:18.877 [2024-11-26 19:18:35.691828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.877 [2024-11-26 19:18:35.692060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.877 [2024-11-26 19:18:35.692075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.877 qpair failed and we were unable to recover it. 00:32:18.878 [2024-11-26 19:18:35.692340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.878 [2024-11-26 19:18:35.692572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.878 [2024-11-26 19:18:35.692604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.878 qpair failed and we were unable to recover it. 00:32:18.878 [2024-11-26 19:18:35.692787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.878 [2024-11-26 19:18:35.692963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.878 [2024-11-26 19:18:35.692980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.878 qpair failed and we were unable to recover it. 00:32:18.878 [2024-11-26 19:18:35.693087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.878 [2024-11-26 19:18:35.693282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.878 [2024-11-26 19:18:35.693314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.878 qpair failed and we were unable to recover it. 00:32:18.878 [2024-11-26 19:18:35.693507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.878 [2024-11-26 19:18:35.693761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.878 [2024-11-26 19:18:35.693777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.878 qpair failed and we were unable to recover it. 00:32:18.878 [2024-11-26 19:18:35.693923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.878 [2024-11-26 19:18:35.694128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.878 [2024-11-26 19:18:35.694161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.878 qpair failed and we were unable to recover it. 00:32:18.878 [2024-11-26 19:18:35.694434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.878 [2024-11-26 19:18:35.694698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.878 [2024-11-26 19:18:35.694730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.878 qpair failed and we were unable to recover it. 00:32:18.878 [2024-11-26 19:18:35.695005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.878 [2024-11-26 19:18:35.695269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.878 [2024-11-26 19:18:35.695300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.878 qpair failed and we were unable to recover it. 00:32:18.878 [2024-11-26 19:18:35.695564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.878 [2024-11-26 19:18:35.695767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.878 [2024-11-26 19:18:35.695799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.878 qpair failed and we were unable to recover it. 00:32:18.878 [2024-11-26 19:18:35.695987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.878 [2024-11-26 19:18:35.696277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.878 [2024-11-26 19:18:35.696308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.878 qpair failed and we were unable to recover it. 00:32:18.878 [2024-11-26 19:18:35.696483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.878 [2024-11-26 19:18:35.696730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.878 [2024-11-26 19:18:35.696762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.878 qpair failed and we were unable to recover it. 00:32:18.878 [2024-11-26 19:18:35.696978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.878 [2024-11-26 19:18:35.697166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.878 [2024-11-26 19:18:35.697198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.878 qpair failed and we were unable to recover it. 00:32:18.878 [2024-11-26 19:18:35.697439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.878 [2024-11-26 19:18:35.697712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.878 [2024-11-26 19:18:35.697743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.878 qpair failed and we were unable to recover it. 00:32:18.878 [2024-11-26 19:18:35.697991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.878 [2024-11-26 19:18:35.698169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.878 [2024-11-26 19:18:35.698199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.878 qpair failed and we were unable to recover it. 00:32:18.878 [2024-11-26 19:18:35.698463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.878 [2024-11-26 19:18:35.698702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.878 [2024-11-26 19:18:35.698733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.878 qpair failed and we were unable to recover it. 00:32:18.878 [2024-11-26 19:18:35.698976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.878 [2024-11-26 19:18:35.699160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.878 [2024-11-26 19:18:35.699192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.878 qpair failed and we were unable to recover it. 00:32:18.878 [2024-11-26 19:18:35.699456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.878 [2024-11-26 19:18:35.699697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.878 [2024-11-26 19:18:35.699729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.878 qpair failed and we were unable to recover it. 00:32:18.878 [2024-11-26 19:18:35.699961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.878 [2024-11-26 19:18:35.700220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.878 [2024-11-26 19:18:35.700236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.878 qpair failed and we were unable to recover it. 00:32:18.878 [2024-11-26 19:18:35.700337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.878 [2024-11-26 19:18:35.700484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.878 [2024-11-26 19:18:35.700498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.878 qpair failed and we were unable to recover it. 00:32:18.878 [2024-11-26 19:18:35.700734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.878 [2024-11-26 19:18:35.700938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.878 [2024-11-26 19:18:35.700966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.878 qpair failed and we were unable to recover it. 00:32:18.878 [2024-11-26 19:18:35.701193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.878 [2024-11-26 19:18:35.701419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.878 [2024-11-26 19:18:35.701435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.878 qpair failed and we were unable to recover it. 00:32:18.878 [2024-11-26 19:18:35.701589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.878 [2024-11-26 19:18:35.701820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.879 [2024-11-26 19:18:35.701835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.879 qpair failed and we were unable to recover it. 00:32:18.879 [2024-11-26 19:18:35.701992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.879 [2024-11-26 19:18:35.702220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.879 [2024-11-26 19:18:35.702252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.879 qpair failed and we were unable to recover it. 00:32:18.879 [2024-11-26 19:18:35.702449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.879 [2024-11-26 19:18:35.702640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.879 [2024-11-26 19:18:35.702680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.879 qpair failed and we were unable to recover it. 00:32:18.879 [2024-11-26 19:18:35.702827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.879 [2024-11-26 19:18:35.702987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.879 [2024-11-26 19:18:35.703020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.879 qpair failed and we were unable to recover it. 00:32:18.879 [2024-11-26 19:18:35.703213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.879 [2024-11-26 19:18:35.703452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.879 [2024-11-26 19:18:35.703483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.879 qpair failed and we were unable to recover it. 00:32:18.879 [2024-11-26 19:18:35.703674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.879 [2024-11-26 19:18:35.703884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.879 [2024-11-26 19:18:35.703915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.879 qpair failed and we were unable to recover it. 00:32:18.879 [2024-11-26 19:18:35.704050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.879 [2024-11-26 19:18:35.704303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.879 [2024-11-26 19:18:35.704333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.879 qpair failed and we were unable to recover it. 00:32:18.879 [2024-11-26 19:18:35.704517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.879 [2024-11-26 19:18:35.704775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.879 [2024-11-26 19:18:35.704790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.879 qpair failed and we were unable to recover it. 00:32:18.879 [2024-11-26 19:18:35.705012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.879 [2024-11-26 19:18:35.705223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.879 [2024-11-26 19:18:35.705239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.879 qpair failed and we were unable to recover it. 00:32:18.879 [2024-11-26 19:18:35.705397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.879 [2024-11-26 19:18:35.705558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.879 [2024-11-26 19:18:35.705589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.879 qpair failed and we were unable to recover it. 00:32:18.879 [2024-11-26 19:18:35.705874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.879 [2024-11-26 19:18:35.706157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.879 [2024-11-26 19:18:35.706190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.879 qpair failed and we were unable to recover it. 00:32:18.879 [2024-11-26 19:18:35.706384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.879 [2024-11-26 19:18:35.706561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.879 [2024-11-26 19:18:35.706593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.879 qpair failed and we were unable to recover it. 00:32:18.879 [2024-11-26 19:18:35.706783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.879 [2024-11-26 19:18:35.707016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.879 [2024-11-26 19:18:35.707049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.879 qpair failed and we were unable to recover it. 00:32:18.879 [2024-11-26 19:18:35.707166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.879 [2024-11-26 19:18:35.707436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.879 [2024-11-26 19:18:35.707467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.879 qpair failed and we were unable to recover it. 00:32:18.879 [2024-11-26 19:18:35.707723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.879 [2024-11-26 19:18:35.707966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.879 [2024-11-26 19:18:35.707998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.879 qpair failed and we were unable to recover it. 00:32:18.879 [2024-11-26 19:18:35.708139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.879 [2024-11-26 19:18:35.708399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.879 [2024-11-26 19:18:35.708430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.879 qpair failed and we were unable to recover it. 00:32:18.879 [2024-11-26 19:18:35.708723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.879 [2024-11-26 19:18:35.708852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.879 [2024-11-26 19:18:35.708893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.879 qpair failed and we were unable to recover it. 00:32:18.879 [2024-11-26 19:18:35.709124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.879 [2024-11-26 19:18:35.709305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.879 [2024-11-26 19:18:35.709336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.879 qpair failed and we were unable to recover it. 00:32:18.879 [2024-11-26 19:18:35.709512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.879 [2024-11-26 19:18:35.709703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.879 [2024-11-26 19:18:35.709734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.879 qpair failed and we were unable to recover it. 00:32:18.879 [2024-11-26 19:18:35.709838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.879 [2024-11-26 19:18:35.709990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.879 [2024-11-26 19:18:35.710006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.879 qpair failed and we were unable to recover it. 00:32:18.879 [2024-11-26 19:18:35.710118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.879 [2024-11-26 19:18:35.710271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.879 [2024-11-26 19:18:35.710318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.879 qpair failed and we were unable to recover it. 00:32:18.879 [2024-11-26 19:18:35.710506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.879 [2024-11-26 19:18:35.710697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.880 [2024-11-26 19:18:35.710727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.880 qpair failed and we were unable to recover it. 00:32:18.880 [2024-11-26 19:18:35.711001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.880 [2024-11-26 19:18:35.711201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.880 [2024-11-26 19:18:35.711233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.880 qpair failed and we were unable to recover it. 00:32:18.880 [2024-11-26 19:18:35.711419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.880 [2024-11-26 19:18:35.711601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.880 [2024-11-26 19:18:35.711632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.880 qpair failed and we were unable to recover it. 00:32:18.880 [2024-11-26 19:18:35.711819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.880 [2024-11-26 19:18:35.712081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.880 [2024-11-26 19:18:35.712113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.880 qpair failed and we were unable to recover it. 00:32:18.880 [2024-11-26 19:18:35.712297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.880 [2024-11-26 19:18:35.712580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.880 [2024-11-26 19:18:35.712613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.880 qpair failed and we were unable to recover it. 00:32:18.880 [2024-11-26 19:18:35.712790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.880 [2024-11-26 19:18:35.712928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.880 [2024-11-26 19:18:35.712969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.880 qpair failed and we were unable to recover it. 00:32:18.880 [2024-11-26 19:18:35.713214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.880 [2024-11-26 19:18:35.713391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.880 [2024-11-26 19:18:35.713406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.880 qpair failed and we were unable to recover it. 00:32:18.880 [2024-11-26 19:18:35.713570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.880 [2024-11-26 19:18:35.713784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.880 [2024-11-26 19:18:35.713799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.880 qpair failed and we were unable to recover it. 00:32:18.880 [2024-11-26 19:18:35.714017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.880 [2024-11-26 19:18:35.714244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.880 [2024-11-26 19:18:35.714259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.880 qpair failed and we were unable to recover it. 00:32:18.880 [2024-11-26 19:18:35.714352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.880 [2024-11-26 19:18:35.714613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.880 [2024-11-26 19:18:35.714643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.880 qpair failed and we were unable to recover it. 00:32:18.880 [2024-11-26 19:18:35.714929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.880 [2024-11-26 19:18:35.715235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.880 [2024-11-26 19:18:35.715268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.880 qpair failed and we were unable to recover it. 00:32:18.880 [2024-11-26 19:18:35.715486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.880 [2024-11-26 19:18:35.715721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.880 [2024-11-26 19:18:35.715752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.880 qpair failed and we were unable to recover it. 00:32:18.880 [2024-11-26 19:18:35.716035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.880 [2024-11-26 19:18:35.716323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.880 [2024-11-26 19:18:35.716355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.880 qpair failed and we were unable to recover it. 00:32:18.880 [2024-11-26 19:18:35.716607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.880 [2024-11-26 19:18:35.716788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.880 [2024-11-26 19:18:35.716821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.880 qpair failed and we were unable to recover it. 00:32:18.880 [2024-11-26 19:18:35.717072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.880 [2024-11-26 19:18:35.717251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.880 [2024-11-26 19:18:35.717267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.880 qpair failed and we were unable to recover it. 00:32:18.880 [2024-11-26 19:18:35.717538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.880 [2024-11-26 19:18:35.717662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.880 [2024-11-26 19:18:35.717700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.880 qpair failed and we were unable to recover it. 00:32:18.880 [2024-11-26 19:18:35.717877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.880 [2024-11-26 19:18:35.718053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.880 [2024-11-26 19:18:35.718086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.880 qpair failed and we were unable to recover it. 00:32:18.880 [2024-11-26 19:18:35.718350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.880 [2024-11-26 19:18:35.718557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.880 [2024-11-26 19:18:35.718589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.880 qpair failed and we were unable to recover it. 00:32:18.880 [2024-11-26 19:18:35.718734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.880 [2024-11-26 19:18:35.718988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.880 [2024-11-26 19:18:35.719022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.880 qpair failed and we were unable to recover it. 00:32:18.880 [2024-11-26 19:18:35.719231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.880 [2024-11-26 19:18:35.719359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.880 [2024-11-26 19:18:35.719391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.880 qpair failed and we were unable to recover it. 00:32:18.880 [2024-11-26 19:18:35.719657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.880 [2024-11-26 19:18:35.719855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.880 [2024-11-26 19:18:35.719886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.880 qpair failed and we were unable to recover it. 00:32:18.880 [2024-11-26 19:18:35.720081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.880 [2024-11-26 19:18:35.720366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.881 [2024-11-26 19:18:35.720398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.881 qpair failed and we were unable to recover it. 00:32:18.881 [2024-11-26 19:18:35.720572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.881 [2024-11-26 19:18:35.720823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.881 [2024-11-26 19:18:35.720855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.881 qpair failed and we were unable to recover it. 00:32:18.881 [2024-11-26 19:18:35.721099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.881 [2024-11-26 19:18:35.721337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.881 [2024-11-26 19:18:35.721369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.881 qpair failed and we were unable to recover it. 00:32:18.881 [2024-11-26 19:18:35.721634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.881 [2024-11-26 19:18:35.721881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.881 [2024-11-26 19:18:35.721897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.881 qpair failed and we were unable to recover it. 00:32:18.881 [2024-11-26 19:18:35.722125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.881 [2024-11-26 19:18:35.722344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.881 [2024-11-26 19:18:35.722362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.881 qpair failed and we were unable to recover it. 00:32:18.881 [2024-11-26 19:18:35.722546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.881 [2024-11-26 19:18:35.722817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.881 [2024-11-26 19:18:35.722848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.881 qpair failed and we were unable to recover it. 00:32:18.881 [2024-11-26 19:18:35.723094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.881 [2024-11-26 19:18:35.723283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.881 [2024-11-26 19:18:35.723314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.881 qpair failed and we were unable to recover it. 00:32:18.881 [2024-11-26 19:18:35.723554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.881 [2024-11-26 19:18:35.723685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.881 [2024-11-26 19:18:35.723717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.881 qpair failed and we were unable to recover it. 00:32:18.881 [2024-11-26 19:18:35.723982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.881 [2024-11-26 19:18:35.724181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.881 [2024-11-26 19:18:35.724212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.881 qpair failed and we were unable to recover it. 00:32:18.881 [2024-11-26 19:18:35.724385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.881 [2024-11-26 19:18:35.724644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.881 [2024-11-26 19:18:35.724676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.881 qpair failed and we were unable to recover it. 00:32:18.881 [2024-11-26 19:18:35.724858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.881 [2024-11-26 19:18:35.725121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.881 [2024-11-26 19:18:35.725152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.881 qpair failed and we were unable to recover it. 00:32:18.881 [2024-11-26 19:18:35.725419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.881 [2024-11-26 19:18:35.725607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.881 [2024-11-26 19:18:35.725638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.881 qpair failed and we were unable to recover it. 00:32:18.881 [2024-11-26 19:18:35.725860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.881 [2024-11-26 19:18:35.725994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.881 [2024-11-26 19:18:35.726010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.881 qpair failed and we were unable to recover it. 00:32:18.881 [2024-11-26 19:18:35.726249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.881 [2024-11-26 19:18:35.726367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.881 [2024-11-26 19:18:35.726398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.881 qpair failed and we were unable to recover it. 00:32:18.881 [2024-11-26 19:18:35.726642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.881 [2024-11-26 19:18:35.726845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.881 [2024-11-26 19:18:35.726882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.881 qpair failed and we were unable to recover it. 00:32:18.881 [2024-11-26 19:18:35.727074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.881 [2024-11-26 19:18:35.727310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.881 [2024-11-26 19:18:35.727341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.881 qpair failed and we were unable to recover it. 00:32:18.881 [2024-11-26 19:18:35.727533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.881 [2024-11-26 19:18:35.727715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.881 [2024-11-26 19:18:35.727746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.881 qpair failed and we were unable to recover it. 00:32:18.881 [2024-11-26 19:18:35.728003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.881 [2024-11-26 19:18:35.728233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.881 [2024-11-26 19:18:35.728264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.881 qpair failed and we were unable to recover it. 00:32:18.881 [2024-11-26 19:18:35.728405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.881 [2024-11-26 19:18:35.728670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.881 [2024-11-26 19:18:35.728707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.881 qpair failed and we were unable to recover it. 00:32:18.881 [2024-11-26 19:18:35.728888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.881 [2024-11-26 19:18:35.729038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.881 [2024-11-26 19:18:35.729071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.881 qpair failed and we were unable to recover it. 00:32:18.881 [2024-11-26 19:18:35.729284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.881 [2024-11-26 19:18:35.729461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.881 [2024-11-26 19:18:35.729492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.881 qpair failed and we were unable to recover it. 00:32:18.881 [2024-11-26 19:18:35.729714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.881 [2024-11-26 19:18:35.729888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.881 [2024-11-26 19:18:35.729919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.881 qpair failed and we were unable to recover it. 00:32:18.881 [2024-11-26 19:18:35.730139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.882 [2024-11-26 19:18:35.730376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.882 [2024-11-26 19:18:35.730408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.882 qpair failed and we were unable to recover it. 00:32:18.882 [2024-11-26 19:18:35.730613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.882 [2024-11-26 19:18:35.730794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.882 [2024-11-26 19:18:35.730824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.882 qpair failed and we were unable to recover it. 00:32:18.882 [2024-11-26 19:18:35.731052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.882 [2024-11-26 19:18:35.731310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.882 [2024-11-26 19:18:35.731347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.882 qpair failed and we were unable to recover it. 00:32:18.882 [2024-11-26 19:18:35.731590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.882 [2024-11-26 19:18:35.731710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.882 [2024-11-26 19:18:35.731726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.882 qpair failed and we were unable to recover it. 00:32:18.882 [2024-11-26 19:18:35.731969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.882 [2024-11-26 19:18:35.732091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.882 [2024-11-26 19:18:35.732122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.882 qpair failed and we were unable to recover it. 00:32:18.882 [2024-11-26 19:18:35.732312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.882 [2024-11-26 19:18:35.732561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.882 [2024-11-26 19:18:35.732593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.882 qpair failed and we were unable to recover it. 00:32:18.882 [2024-11-26 19:18:35.732883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.882 [2024-11-26 19:18:35.733097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.882 [2024-11-26 19:18:35.733113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.882 qpair failed and we were unable to recover it. 00:32:18.882 [2024-11-26 19:18:35.733367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.882 [2024-11-26 19:18:35.733638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.882 [2024-11-26 19:18:35.733669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.882 qpair failed and we were unable to recover it. 00:32:18.882 [2024-11-26 19:18:35.733923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.882 [2024-11-26 19:18:35.734168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.882 [2024-11-26 19:18:35.734200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.882 qpair failed and we were unable to recover it. 00:32:18.882 [2024-11-26 19:18:35.734336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.882 [2024-11-26 19:18:35.734576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.882 [2024-11-26 19:18:35.734607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.882 qpair failed and we were unable to recover it. 00:32:18.882 [2024-11-26 19:18:35.734876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.882 [2024-11-26 19:18:35.735057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.882 [2024-11-26 19:18:35.735091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.882 qpair failed and we were unable to recover it. 00:32:18.882 [2024-11-26 19:18:35.735335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.882 [2024-11-26 19:18:35.735467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.882 [2024-11-26 19:18:35.735497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.882 qpair failed and we were unable to recover it. 00:32:18.882 [2024-11-26 19:18:35.735786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.882 [2024-11-26 19:18:35.735975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.882 [2024-11-26 19:18:35.736008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.882 qpair failed and we were unable to recover it. 00:32:18.882 [2024-11-26 19:18:35.736154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.882 [2024-11-26 19:18:35.736355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.882 [2024-11-26 19:18:35.736386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.882 qpair failed and we were unable to recover it. 00:32:18.882 [2024-11-26 19:18:35.736589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.882 [2024-11-26 19:18:35.736906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.882 [2024-11-26 19:18:35.736937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.882 qpair failed and we were unable to recover it. 00:32:18.882 [2024-11-26 19:18:35.737140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.882 [2024-11-26 19:18:35.737312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.882 [2024-11-26 19:18:35.737344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.882 qpair failed and we were unable to recover it. 00:32:18.882 [2024-11-26 19:18:35.737608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.882 [2024-11-26 19:18:35.737844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.882 [2024-11-26 19:18:35.737886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.883 qpair failed and we were unable to recover it. 00:32:18.883 [2024-11-26 19:18:35.737976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.883 [2024-11-26 19:18:35.738193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.883 [2024-11-26 19:18:35.738224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.883 qpair failed and we were unable to recover it. 00:32:18.883 [2024-11-26 19:18:35.738411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.883 [2024-11-26 19:18:35.738524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.883 [2024-11-26 19:18:35.738556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.883 qpair failed and we were unable to recover it. 00:32:18.883 [2024-11-26 19:18:35.738810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.883 [2024-11-26 19:18:35.739070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.883 [2024-11-26 19:18:35.739104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.883 qpair failed and we were unable to recover it. 00:32:18.883 [2024-11-26 19:18:35.739357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.883 [2024-11-26 19:18:35.739532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.883 [2024-11-26 19:18:35.739563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.883 qpair failed and we were unable to recover it. 00:32:18.883 [2024-11-26 19:18:35.739763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.883 [2024-11-26 19:18:35.740028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.883 [2024-11-26 19:18:35.740069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.883 qpair failed and we were unable to recover it. 00:32:18.883 [2024-11-26 19:18:35.740279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.883 [2024-11-26 19:18:35.740521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.883 [2024-11-26 19:18:35.740550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.883 qpair failed and we were unable to recover it. 00:32:18.883 [2024-11-26 19:18:35.740826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.883 [2024-11-26 19:18:35.741018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.883 [2024-11-26 19:18:35.741051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.883 qpair failed and we were unable to recover it. 00:32:18.883 [2024-11-26 19:18:35.741310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.883 [2024-11-26 19:18:35.741476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.883 [2024-11-26 19:18:35.741508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.883 qpair failed and we were unable to recover it. 00:32:18.883 [2024-11-26 19:18:35.741637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.883 [2024-11-26 19:18:35.741884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.883 [2024-11-26 19:18:35.741915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.883 qpair failed and we were unable to recover it. 00:32:18.883 [2024-11-26 19:18:35.742180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.883 [2024-11-26 19:18:35.742412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.883 [2024-11-26 19:18:35.742428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.883 qpair failed and we were unable to recover it. 00:32:18.883 [2024-11-26 19:18:35.742687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.883 [2024-11-26 19:18:35.742893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.883 [2024-11-26 19:18:35.742908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.883 qpair failed and we were unable to recover it. 00:32:18.883 [2024-11-26 19:18:35.743122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.883 [2024-11-26 19:18:35.743281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.883 [2024-11-26 19:18:35.743312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.883 qpair failed and we were unable to recover it. 00:32:18.883 [2024-11-26 19:18:35.743555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.883 [2024-11-26 19:18:35.743821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.883 [2024-11-26 19:18:35.743851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.883 qpair failed and we were unable to recover it. 00:32:18.883 [2024-11-26 19:18:35.744023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.883 [2024-11-26 19:18:35.744265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.883 [2024-11-26 19:18:35.744295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.883 qpair failed and we were unable to recover it. 00:32:18.883 [2024-11-26 19:18:35.744480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.883 [2024-11-26 19:18:35.744757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.883 [2024-11-26 19:18:35.744788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.883 qpair failed and we were unable to recover it. 00:32:18.883 [2024-11-26 19:18:35.744968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.883 [2024-11-26 19:18:35.745256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.883 [2024-11-26 19:18:35.745287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.883 qpair failed and we were unable to recover it. 00:32:18.883 [2024-11-26 19:18:35.745485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.883 [2024-11-26 19:18:35.745696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.883 [2024-11-26 19:18:35.745743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.883 qpair failed and we were unable to recover it. 00:32:18.883 [2024-11-26 19:18:35.746002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.883 [2024-11-26 19:18:35.746274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.883 [2024-11-26 19:18:35.746305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.883 qpair failed and we were unable to recover it. 00:32:18.883 [2024-11-26 19:18:35.746565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.883 [2024-11-26 19:18:35.746688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.883 [2024-11-26 19:18:35.746720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.883 qpair failed and we were unable to recover it. 00:32:18.883 [2024-11-26 19:18:35.746907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.883 [2024-11-26 19:18:35.747085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.883 [2024-11-26 19:18:35.747102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.883 qpair failed and we were unable to recover it. 00:32:18.883 [2024-11-26 19:18:35.747340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.883 [2024-11-26 19:18:35.747514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.884 [2024-11-26 19:18:35.747545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.884 qpair failed and we were unable to recover it. 00:32:18.884 [2024-11-26 19:18:35.747804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.884 [2024-11-26 19:18:35.747998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.884 [2024-11-26 19:18:35.748030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.884 qpair failed and we were unable to recover it. 00:32:18.884 [2024-11-26 19:18:35.748245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.884 [2024-11-26 19:18:35.748429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.884 [2024-11-26 19:18:35.748460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.884 qpair failed and we were unable to recover it. 00:32:18.884 [2024-11-26 19:18:35.748660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.884 [2024-11-26 19:18:35.748839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.884 [2024-11-26 19:18:35.748870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.884 qpair failed and we were unable to recover it. 00:32:18.884 [2024-11-26 19:18:35.749108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.884 [2024-11-26 19:18:35.749190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.884 [2024-11-26 19:18:35.749204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.884 qpair failed and we were unable to recover it. 00:32:18.884 [2024-11-26 19:18:35.749370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.884 [2024-11-26 19:18:35.749540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.884 [2024-11-26 19:18:35.749571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.884 qpair failed and we were unable to recover it. 00:32:18.884 [2024-11-26 19:18:35.749827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.884 [2024-11-26 19:18:35.750040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.884 [2024-11-26 19:18:35.750072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.884 qpair failed and we were unable to recover it. 00:32:18.884 [2024-11-26 19:18:35.750318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.884 [2024-11-26 19:18:35.750557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.884 [2024-11-26 19:18:35.750590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.884 qpair failed and we were unable to recover it. 00:32:18.884 [2024-11-26 19:18:35.750855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.884 [2024-11-26 19:18:35.751110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.884 [2024-11-26 19:18:35.751127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.884 qpair failed and we were unable to recover it. 00:32:18.884 [2024-11-26 19:18:35.751338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.884 [2024-11-26 19:18:35.751518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.884 [2024-11-26 19:18:35.751548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.884 qpair failed and we were unable to recover it. 00:32:18.884 [2024-11-26 19:18:35.751746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.884 [2024-11-26 19:18:35.751962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.884 [2024-11-26 19:18:35.751978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.884 qpair failed and we were unable to recover it. 00:32:18.884 [2024-11-26 19:18:35.752194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.884 [2024-11-26 19:18:35.752387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.884 [2024-11-26 19:18:35.752419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.884 qpair failed and we were unable to recover it. 00:32:18.884 [2024-11-26 19:18:35.752613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.884 [2024-11-26 19:18:35.752793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.884 [2024-11-26 19:18:35.752823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.884 qpair failed and we were unable to recover it. 00:32:18.884 [2024-11-26 19:18:35.753081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.884 [2024-11-26 19:18:35.753322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.884 [2024-11-26 19:18:35.753338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.884 qpair failed and we were unable to recover it. 00:32:18.884 [2024-11-26 19:18:35.753500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.884 [2024-11-26 19:18:35.753713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.884 [2024-11-26 19:18:35.753745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.884 qpair failed and we were unable to recover it. 00:32:18.884 [2024-11-26 19:18:35.753985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.884 [2024-11-26 19:18:35.754158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.884 [2024-11-26 19:18:35.754189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.884 qpair failed and we were unable to recover it. 00:32:18.884 [2024-11-26 19:18:35.754327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.884 [2024-11-26 19:18:35.754573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.884 [2024-11-26 19:18:35.754604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.884 qpair failed and we were unable to recover it. 00:32:18.884 [2024-11-26 19:18:35.754899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.884 [2024-11-26 19:18:35.755207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.884 [2024-11-26 19:18:35.755240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.884 qpair failed and we were unable to recover it. 00:32:18.884 [2024-11-26 19:18:35.755428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.884 [2024-11-26 19:18:35.755667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.884 [2024-11-26 19:18:35.755698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.884 qpair failed and we were unable to recover it. 00:32:18.884 [2024-11-26 19:18:35.755878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.884 [2024-11-26 19:18:35.756021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.884 [2024-11-26 19:18:35.756037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.884 qpair failed and we were unable to recover it. 00:32:18.884 [2024-11-26 19:18:35.756261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.884 [2024-11-26 19:18:35.756409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.884 [2024-11-26 19:18:35.756424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.884 qpair failed and we were unable to recover it. 00:32:18.884 [2024-11-26 19:18:35.756652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.884 [2024-11-26 19:18:35.756908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.885 [2024-11-26 19:18:35.756939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.885 qpair failed and we were unable to recover it. 00:32:18.885 [2024-11-26 19:18:35.757128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.885 [2024-11-26 19:18:35.757381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.885 [2024-11-26 19:18:35.757413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.885 qpair failed and we were unable to recover it. 00:32:18.885 [2024-11-26 19:18:35.757657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.885 [2024-11-26 19:18:35.757902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.885 [2024-11-26 19:18:35.757918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.885 qpair failed and we were unable to recover it. 00:32:18.885 [2024-11-26 19:18:35.758131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.885 [2024-11-26 19:18:35.758364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.885 [2024-11-26 19:18:35.758381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.885 qpair failed and we were unable to recover it. 00:32:18.885 [2024-11-26 19:18:35.758482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.885 [2024-11-26 19:18:35.758621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.885 [2024-11-26 19:18:35.758637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.885 qpair failed and we were unable to recover it. 00:32:18.885 [2024-11-26 19:18:35.758874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.885 [2024-11-26 19:18:35.759115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.885 [2024-11-26 19:18:35.759133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.885 qpair failed and we were unable to recover it. 00:32:18.885 [2024-11-26 19:18:35.759281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.885 [2024-11-26 19:18:35.759456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.885 [2024-11-26 19:18:35.759487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.885 qpair failed and we were unable to recover it. 00:32:18.885 [2024-11-26 19:18:35.759757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.885 [2024-11-26 19:18:35.759888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.885 [2024-11-26 19:18:35.759919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.885 qpair failed and we were unable to recover it. 00:32:18.885 [2024-11-26 19:18:35.760213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.885 [2024-11-26 19:18:35.760446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.885 [2024-11-26 19:18:35.760461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.885 qpair failed and we were unable to recover it. 00:32:18.885 [2024-11-26 19:18:35.760669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.885 [2024-11-26 19:18:35.760875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.885 [2024-11-26 19:18:35.760891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.885 qpair failed and we were unable to recover it. 00:32:18.885 [2024-11-26 19:18:35.761098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.885 [2024-11-26 19:18:35.761312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.885 [2024-11-26 19:18:35.761343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.885 qpair failed and we were unable to recover it. 00:32:18.885 [2024-11-26 19:18:35.761618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.885 [2024-11-26 19:18:35.761858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.885 [2024-11-26 19:18:35.761891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.885 qpair failed and we were unable to recover it. 00:32:18.885 [2024-11-26 19:18:35.762191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.885 [2024-11-26 19:18:35.762299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.885 [2024-11-26 19:18:35.762329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.885 qpair failed and we were unable to recover it. 00:32:18.885 [2024-11-26 19:18:35.762595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.885 [2024-11-26 19:18:35.762838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.885 [2024-11-26 19:18:35.762855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.885 qpair failed and we were unable to recover it. 00:32:18.885 [2024-11-26 19:18:35.763011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.885 [2024-11-26 19:18:35.763226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.885 [2024-11-26 19:18:35.763258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:18.885 qpair failed and we were unable to recover it. 00:32:18.885 [2024-11-26 19:18:35.763638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.885 [2024-11-26 19:18:35.763975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.885 [2024-11-26 19:18:35.764020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.885 qpair failed and we were unable to recover it. 00:32:18.885 [2024-11-26 19:18:35.764240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.885 [2024-11-26 19:18:35.764409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.885 [2024-11-26 19:18:35.764442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.885 qpair failed and we were unable to recover it. 00:32:18.885 [2024-11-26 19:18:35.764625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.885 [2024-11-26 19:18:35.764805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.885 [2024-11-26 19:18:35.764837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.885 qpair failed and we were unable to recover it. 00:32:18.885 [2024-11-26 19:18:35.765025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.885 [2024-11-26 19:18:35.765288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.885 [2024-11-26 19:18:35.765304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.885 qpair failed and we were unable to recover it. 00:32:18.885 [2024-11-26 19:18:35.765514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.885 [2024-11-26 19:18:35.765745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.885 [2024-11-26 19:18:35.765762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.885 qpair failed and we were unable to recover it. 00:32:18.885 [2024-11-26 19:18:35.765993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.885 [2024-11-26 19:18:35.766079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.885 [2024-11-26 19:18:35.766095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.885 qpair failed and we were unable to recover it. 00:32:18.885 [2024-11-26 19:18:35.766346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.885 [2024-11-26 19:18:35.766587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.885 [2024-11-26 19:18:35.766619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.885 qpair failed and we were unable to recover it. 00:32:18.886 [2024-11-26 19:18:35.766890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.886 [2024-11-26 19:18:35.767150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.886 [2024-11-26 19:18:35.767183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.886 qpair failed and we were unable to recover it. 00:32:18.886 [2024-11-26 19:18:35.767431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.886 [2024-11-26 19:18:35.767616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.886 [2024-11-26 19:18:35.767649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.886 qpair failed and we were unable to recover it. 00:32:18.886 [2024-11-26 19:18:35.767835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.886 [2024-11-26 19:18:35.768015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.886 [2024-11-26 19:18:35.768049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.886 qpair failed and we were unable to recover it. 00:32:18.886 [2024-11-26 19:18:35.768262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.886 [2024-11-26 19:18:35.768536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.886 [2024-11-26 19:18:35.768569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.886 qpair failed and we were unable to recover it. 00:32:18.886 [2024-11-26 19:18:35.768779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.886 [2024-11-26 19:18:35.769045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.886 [2024-11-26 19:18:35.769079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.886 qpair failed and we were unable to recover it. 00:32:18.886 [2024-11-26 19:18:35.769213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.886 [2024-11-26 19:18:35.769405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.886 [2024-11-26 19:18:35.769437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.886 qpair failed and we were unable to recover it. 00:32:18.886 [2024-11-26 19:18:35.769703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.886 [2024-11-26 19:18:35.769956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.886 [2024-11-26 19:18:35.769989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.886 qpair failed and we were unable to recover it. 00:32:18.886 [2024-11-26 19:18:35.770238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.886 [2024-11-26 19:18:35.770450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.886 [2024-11-26 19:18:35.770483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.886 qpair failed and we were unable to recover it. 00:32:18.886 [2024-11-26 19:18:35.770700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.886 [2024-11-26 19:18:35.770984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.886 [2024-11-26 19:18:35.771017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.886 qpair failed and we were unable to recover it. 00:32:18.886 [2024-11-26 19:18:35.771212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.886 [2024-11-26 19:18:35.771389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.886 [2024-11-26 19:18:35.771420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.886 qpair failed and we were unable to recover it. 00:32:18.886 [2024-11-26 19:18:35.771687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.886 [2024-11-26 19:18:35.771939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.886 [2024-11-26 19:18:35.771977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.886 qpair failed and we were unable to recover it. 00:32:18.886 [2024-11-26 19:18:35.772251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.886 [2024-11-26 19:18:35.772463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.886 [2024-11-26 19:18:35.772480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.886 qpair failed and we were unable to recover it. 00:32:18.886 [2024-11-26 19:18:35.772690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.886 [2024-11-26 19:18:35.772844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.886 [2024-11-26 19:18:35.772860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.886 qpair failed and we were unable to recover it. 00:32:18.886 [2024-11-26 19:18:35.773027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.886 [2024-11-26 19:18:35.773326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.886 [2024-11-26 19:18:35.773366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.886 qpair failed and we were unable to recover it. 00:32:18.886 [2024-11-26 19:18:35.773559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.886 [2024-11-26 19:18:35.773734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.886 [2024-11-26 19:18:35.773766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.886 qpair failed and we were unable to recover it. 00:32:18.886 [2024-11-26 19:18:35.773959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.886 [2024-11-26 19:18:35.774155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.886 [2024-11-26 19:18:35.774186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.886 qpair failed and we were unable to recover it. 00:32:18.886 [2024-11-26 19:18:35.774400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.886 [2024-11-26 19:18:35.774683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.886 [2024-11-26 19:18:35.774715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.886 qpair failed and we were unable to recover it. 00:32:18.886 [2024-11-26 19:18:35.774911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.886 [2024-11-26 19:18:35.775194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.886 [2024-11-26 19:18:35.775228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.886 qpair failed and we were unable to recover it. 00:32:18.886 [2024-11-26 19:18:35.775450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.886 [2024-11-26 19:18:35.775709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.886 [2024-11-26 19:18:35.775740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.886 qpair failed and we were unable to recover it. 00:32:18.886 [2024-11-26 19:18:35.775879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.886 [2024-11-26 19:18:35.776032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.886 [2024-11-26 19:18:35.776047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.886 qpair failed and we were unable to recover it. 00:32:18.886 [2024-11-26 19:18:35.776257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.886 [2024-11-26 19:18:35.776492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.886 [2024-11-26 19:18:35.776507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.886 qpair failed and we were unable to recover it. 00:32:18.886 [2024-11-26 19:18:35.776747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.887 [2024-11-26 19:18:35.776970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.887 [2024-11-26 19:18:35.776986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.887 qpair failed and we were unable to recover it. 00:32:18.887 [2024-11-26 19:18:35.777138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.887 [2024-11-26 19:18:35.777380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.887 [2024-11-26 19:18:35.777412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.887 qpair failed and we were unable to recover it. 00:32:18.887 [2024-11-26 19:18:35.777610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.887 [2024-11-26 19:18:35.777874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.887 [2024-11-26 19:18:35.777913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.887 qpair failed and we were unable to recover it. 00:32:18.887 [2024-11-26 19:18:35.778119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.887 [2024-11-26 19:18:35.778390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.887 [2024-11-26 19:18:35.778421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.887 qpair failed and we were unable to recover it. 00:32:18.887 [2024-11-26 19:18:35.778686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.887 [2024-11-26 19:18:35.778866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.887 [2024-11-26 19:18:35.778882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.887 qpair failed and we were unable to recover it. 00:32:18.887 [2024-11-26 19:18:35.779122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.887 [2024-11-26 19:18:35.779395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.887 [2024-11-26 19:18:35.779426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.887 qpair failed and we were unable to recover it. 00:32:18.887 [2024-11-26 19:18:35.779639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.887 [2024-11-26 19:18:35.779822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.887 [2024-11-26 19:18:35.779855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.887 qpair failed and we were unable to recover it. 00:32:18.887 [2024-11-26 19:18:35.780050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.887 [2024-11-26 19:18:35.780287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.887 [2024-11-26 19:18:35.780319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.887 qpair failed and we were unable to recover it. 00:32:18.887 [2024-11-26 19:18:35.780612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.887 [2024-11-26 19:18:35.780794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.887 [2024-11-26 19:18:35.780825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.887 qpair failed and we were unable to recover it. 00:32:18.887 [2024-11-26 19:18:35.781107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.887 [2024-11-26 19:18:35.781401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.887 [2024-11-26 19:18:35.781434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.887 qpair failed and we were unable to recover it. 00:32:18.887 [2024-11-26 19:18:35.781698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.887 [2024-11-26 19:18:35.781955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.887 [2024-11-26 19:18:35.781988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.887 qpair failed and we were unable to recover it. 00:32:18.887 [2024-11-26 19:18:35.782266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.887 [2024-11-26 19:18:35.782394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.887 [2024-11-26 19:18:35.782426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.887 qpair failed and we were unable to recover it. 00:32:18.887 [2024-11-26 19:18:35.782608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.887 [2024-11-26 19:18:35.782787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.887 [2024-11-26 19:18:35.782818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.887 qpair failed and we were unable to recover it. 00:32:18.887 [2024-11-26 19:18:35.783092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.887 [2024-11-26 19:18:35.783291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.887 [2024-11-26 19:18:35.783307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.887 qpair failed and we were unable to recover it. 00:32:18.887 [2024-11-26 19:18:35.783532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.887 [2024-11-26 19:18:35.783720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.887 [2024-11-26 19:18:35.783753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.887 qpair failed and we were unable to recover it. 00:32:18.887 [2024-11-26 19:18:35.784006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.887 [2024-11-26 19:18:35.784258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.887 [2024-11-26 19:18:35.784290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.887 qpair failed and we were unable to recover it. 00:32:18.887 [2024-11-26 19:18:35.784566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.887 [2024-11-26 19:18:35.784805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.887 [2024-11-26 19:18:35.784838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.887 qpair failed and we were unable to recover it. 00:32:18.887 [2024-11-26 19:18:35.785102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.887 [2024-11-26 19:18:35.785260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.887 [2024-11-26 19:18:35.785291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.887 qpair failed and we were unable to recover it. 00:32:18.887 [2024-11-26 19:18:35.785559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.887 [2024-11-26 19:18:35.785819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.887 [2024-11-26 19:18:35.785851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.887 qpair failed and we were unable to recover it. 00:32:18.887 [2024-11-26 19:18:35.786070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.887 [2024-11-26 19:18:35.786364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.887 [2024-11-26 19:18:35.786397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.887 qpair failed and we were unable to recover it. 00:32:18.887 [2024-11-26 19:18:35.786537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.887 [2024-11-26 19:18:35.786746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.887 [2024-11-26 19:18:35.786779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.887 qpair failed and we were unable to recover it. 00:32:18.887 [2024-11-26 19:18:35.786987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.887 [2024-11-26 19:18:35.787178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.887 [2024-11-26 19:18:35.787208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.888 qpair failed and we were unable to recover it. 00:32:18.888 [2024-11-26 19:18:35.787414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.888 [2024-11-26 19:18:35.787676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.888 [2024-11-26 19:18:35.787709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.888 qpair failed and we were unable to recover it. 00:32:18.888 [2024-11-26 19:18:35.787985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.888 [2024-11-26 19:18:35.788096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.888 [2024-11-26 19:18:35.788113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.888 qpair failed and we were unable to recover it. 00:32:18.888 [2024-11-26 19:18:35.788298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.888 [2024-11-26 19:18:35.788478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.888 [2024-11-26 19:18:35.788511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.888 qpair failed and we were unable to recover it. 00:32:18.888 [2024-11-26 19:18:35.788706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.888 [2024-11-26 19:18:35.788923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.888 [2024-11-26 19:18:35.788965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.888 qpair failed and we were unable to recover it. 00:32:18.888 [2024-11-26 19:18:35.789159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.888 [2024-11-26 19:18:35.789429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.888 [2024-11-26 19:18:35.789461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.888 qpair failed and we were unable to recover it. 00:32:18.888 [2024-11-26 19:18:35.789708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.888 [2024-11-26 19:18:35.789890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.888 [2024-11-26 19:18:35.789922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.888 qpair failed and we were unable to recover it. 00:32:18.888 [2024-11-26 19:18:35.790196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.888 [2024-11-26 19:18:35.790350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.888 [2024-11-26 19:18:35.790365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.888 qpair failed and we were unable to recover it. 00:32:18.888 [2024-11-26 19:18:35.790544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.888 [2024-11-26 19:18:35.790767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.888 [2024-11-26 19:18:35.790782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.888 qpair failed and we were unable to recover it. 00:32:18.888 [2024-11-26 19:18:35.790937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.888 [2024-11-26 19:18:35.791106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.888 [2024-11-26 19:18:35.791123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.888 qpair failed and we were unable to recover it. 00:32:18.888 [2024-11-26 19:18:35.791360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.888 [2024-11-26 19:18:35.791515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.888 [2024-11-26 19:18:35.791548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.888 qpair failed and we were unable to recover it. 00:32:18.888 [2024-11-26 19:18:35.791669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.888 [2024-11-26 19:18:35.791906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.888 [2024-11-26 19:18:35.791940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.888 qpair failed and we were unable to recover it. 00:32:18.888 [2024-11-26 19:18:35.792251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.888 [2024-11-26 19:18:35.792515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.888 [2024-11-26 19:18:35.792532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.888 qpair failed and we were unable to recover it. 00:32:18.888 [2024-11-26 19:18:35.792688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.888 [2024-11-26 19:18:35.792897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.888 [2024-11-26 19:18:35.792912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.888 qpair failed and we were unable to recover it. 00:32:18.888 [2024-11-26 19:18:35.793094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.888 [2024-11-26 19:18:35.793344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.888 [2024-11-26 19:18:35.793376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.888 qpair failed and we were unable to recover it. 00:32:18.888 [2024-11-26 19:18:35.793619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.888 [2024-11-26 19:18:35.793875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.888 [2024-11-26 19:18:35.793907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.888 qpair failed and we were unable to recover it. 00:32:18.888 [2024-11-26 19:18:35.794015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.888 [2024-11-26 19:18:35.794246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.888 [2024-11-26 19:18:35.794263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.888 qpair failed and we were unable to recover it. 00:32:18.888 [2024-11-26 19:18:35.794422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.888 [2024-11-26 19:18:35.794662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.889 [2024-11-26 19:18:35.794678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.889 qpair failed and we were unable to recover it. 00:32:18.889 [2024-11-26 19:18:35.794864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.889 [2024-11-26 19:18:35.795129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.889 [2024-11-26 19:18:35.795163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.889 qpair failed and we were unable to recover it. 00:32:18.889 [2024-11-26 19:18:35.795412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.889 [2024-11-26 19:18:35.795632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:18.889 [2024-11-26 19:18:35.795664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:18.889 qpair failed and we were unable to recover it. 00:32:18.889 [2024-11-26 19:18:35.795883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.160 [2024-11-26 19:18:35.796158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.160 [2024-11-26 19:18:35.796175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.160 qpair failed and we were unable to recover it. 00:32:19.160 [2024-11-26 19:18:35.796325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.160 [2024-11-26 19:18:35.796503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.160 [2024-11-26 19:18:35.796519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.160 qpair failed and we were unable to recover it. 00:32:19.160 [2024-11-26 19:18:35.796761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.160 [2024-11-26 19:18:35.797015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.160 [2024-11-26 19:18:35.797031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.160 qpair failed and we were unable to recover it. 00:32:19.160 [2024-11-26 19:18:35.797239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.160 [2024-11-26 19:18:35.797468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.160 [2024-11-26 19:18:35.797484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.160 qpair failed and we were unable to recover it. 00:32:19.160 [2024-11-26 19:18:35.797714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.160 [2024-11-26 19:18:35.797929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.160 [2024-11-26 19:18:35.797970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.160 qpair failed and we were unable to recover it. 00:32:19.160 [2024-11-26 19:18:35.798239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.160 [2024-11-26 19:18:35.798421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.160 [2024-11-26 19:18:35.798453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.160 qpair failed and we were unable to recover it. 00:32:19.160 [2024-11-26 19:18:35.798653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.160 [2024-11-26 19:18:35.798918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.160 [2024-11-26 19:18:35.798983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.160 qpair failed and we were unable to recover it. 00:32:19.160 [2024-11-26 19:18:35.799182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.160 [2024-11-26 19:18:35.799435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.160 [2024-11-26 19:18:35.799468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.160 qpair failed and we were unable to recover it. 00:32:19.160 [2024-11-26 19:18:35.799607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.160 [2024-11-26 19:18:35.799781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.160 [2024-11-26 19:18:35.799811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.160 qpair failed and we were unable to recover it. 00:32:19.160 [2024-11-26 19:18:35.799997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.160 [2024-11-26 19:18:35.800268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.160 [2024-11-26 19:18:35.800302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.160 qpair failed and we were unable to recover it. 00:32:19.160 [2024-11-26 19:18:35.800496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.160 [2024-11-26 19:18:35.800779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.160 [2024-11-26 19:18:35.800812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.160 qpair failed and we were unable to recover it. 00:32:19.160 [2024-11-26 19:18:35.801039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.160 [2024-11-26 19:18:35.801293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.160 [2024-11-26 19:18:35.801326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.160 qpair failed and we were unable to recover it. 00:32:19.160 [2024-11-26 19:18:35.801570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.160 [2024-11-26 19:18:35.801743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.160 [2024-11-26 19:18:35.801782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.160 qpair failed and we were unable to recover it. 00:32:19.160 [2024-11-26 19:18:35.801984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.160 [2024-11-26 19:18:35.802160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.160 [2024-11-26 19:18:35.802176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.160 qpair failed and we were unable to recover it. 00:32:19.160 [2024-11-26 19:18:35.802415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.160 [2024-11-26 19:18:35.802606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.160 [2024-11-26 19:18:35.802623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.160 qpair failed and we were unable to recover it. 00:32:19.160 [2024-11-26 19:18:35.802781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.160 [2024-11-26 19:18:35.802876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.160 [2024-11-26 19:18:35.802915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.160 qpair failed and we were unable to recover it. 00:32:19.160 [2024-11-26 19:18:35.803202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.160 [2024-11-26 19:18:35.803492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.160 [2024-11-26 19:18:35.803525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.160 qpair failed and we were unable to recover it. 00:32:19.160 [2024-11-26 19:18:35.803771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.160 [2024-11-26 19:18:35.804036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.160 [2024-11-26 19:18:35.804070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.160 qpair failed and we were unable to recover it. 00:32:19.160 [2024-11-26 19:18:35.804203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.160 [2024-11-26 19:18:35.804468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.160 [2024-11-26 19:18:35.804501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.160 qpair failed and we were unable to recover it. 00:32:19.161 [2024-11-26 19:18:35.804624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.161 [2024-11-26 19:18:35.804864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.161 [2024-11-26 19:18:35.804896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.161 qpair failed and we were unable to recover it. 00:32:19.161 [2024-11-26 19:18:35.805223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.161 [2024-11-26 19:18:35.805487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.161 [2024-11-26 19:18:35.805503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.161 qpair failed and we were unable to recover it. 00:32:19.161 [2024-11-26 19:18:35.805764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.161 [2024-11-26 19:18:35.805941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.161 [2024-11-26 19:18:35.805964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.161 qpair failed and we were unable to recover it. 00:32:19.161 [2024-11-26 19:18:35.806201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.161 [2024-11-26 19:18:35.806459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.161 [2024-11-26 19:18:35.806490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.161 qpair failed and we were unable to recover it. 00:32:19.161 [2024-11-26 19:18:35.806808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.161 [2024-11-26 19:18:35.807025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.161 [2024-11-26 19:18:35.807058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.161 qpair failed and we were unable to recover it. 00:32:19.161 [2024-11-26 19:18:35.807335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.161 [2024-11-26 19:18:35.807598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.161 [2024-11-26 19:18:35.807630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.161 qpair failed and we were unable to recover it. 00:32:19.161 [2024-11-26 19:18:35.807825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.161 [2024-11-26 19:18:35.808012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.161 [2024-11-26 19:18:35.808029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.161 qpair failed and we were unable to recover it. 00:32:19.161 [2024-11-26 19:18:35.808267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.161 [2024-11-26 19:18:35.808375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.161 [2024-11-26 19:18:35.808406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.161 qpair failed and we were unable to recover it. 00:32:19.161 [2024-11-26 19:18:35.808678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.161 [2024-11-26 19:18:35.808969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.161 [2024-11-26 19:18:35.809004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.161 qpair failed and we were unable to recover it. 00:32:19.161 [2024-11-26 19:18:35.809291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.161 [2024-11-26 19:18:35.809596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.161 [2024-11-26 19:18:35.809628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.161 qpair failed and we were unable to recover it. 00:32:19.161 [2024-11-26 19:18:35.809918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.161 [2024-11-26 19:18:35.810178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.161 [2024-11-26 19:18:35.810212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.161 qpair failed and we were unable to recover it. 00:32:19.161 [2024-11-26 19:18:35.810504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.161 [2024-11-26 19:18:35.810681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.161 [2024-11-26 19:18:35.810713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.161 qpair failed and we were unable to recover it. 00:32:19.161 [2024-11-26 19:18:35.810983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.161 [2024-11-26 19:18:35.811132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.161 [2024-11-26 19:18:35.811164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.161 qpair failed and we were unable to recover it. 00:32:19.161 [2024-11-26 19:18:35.811449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.161 [2024-11-26 19:18:35.811662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.161 [2024-11-26 19:18:35.811693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.161 qpair failed and we were unable to recover it. 00:32:19.161 [2024-11-26 19:18:35.811822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.161 [2024-11-26 19:18:35.812089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.161 [2024-11-26 19:18:35.812122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.161 qpair failed and we were unable to recover it. 00:32:19.161 [2024-11-26 19:18:35.812329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.161 [2024-11-26 19:18:35.812492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.161 [2024-11-26 19:18:35.812524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.161 qpair failed and we were unable to recover it. 00:32:19.161 [2024-11-26 19:18:35.812705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.161 [2024-11-26 19:18:35.812966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.161 [2024-11-26 19:18:35.813000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.161 qpair failed and we were unable to recover it. 00:32:19.161 [2024-11-26 19:18:35.813183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.161 [2024-11-26 19:18:35.813355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.161 [2024-11-26 19:18:35.813387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.161 qpair failed and we were unable to recover it. 00:32:19.161 [2024-11-26 19:18:35.813578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.161 [2024-11-26 19:18:35.813775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.161 [2024-11-26 19:18:35.813809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.161 qpair failed and we were unable to recover it. 00:32:19.161 [2024-11-26 19:18:35.814087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.161 [2024-11-26 19:18:35.814344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.161 [2024-11-26 19:18:35.814361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.161 qpair failed and we were unable to recover it. 00:32:19.161 [2024-11-26 19:18:35.814507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.161 [2024-11-26 19:18:35.814737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.161 [2024-11-26 19:18:35.814753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.161 qpair failed and we were unable to recover it. 00:32:19.161 [2024-11-26 19:18:35.815005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.161 [2024-11-26 19:18:35.815262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.161 [2024-11-26 19:18:35.815295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.162 qpair failed and we were unable to recover it. 00:32:19.162 [2024-11-26 19:18:35.815471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.162 [2024-11-26 19:18:35.815663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.162 [2024-11-26 19:18:35.815695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.162 qpair failed and we were unable to recover it. 00:32:19.162 [2024-11-26 19:18:35.815971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.162 [2024-11-26 19:18:35.816213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.162 [2024-11-26 19:18:35.816245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.162 qpair failed and we were unable to recover it. 00:32:19.162 [2024-11-26 19:18:35.816434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.162 [2024-11-26 19:18:35.816667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.162 [2024-11-26 19:18:35.816684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.162 qpair failed and we were unable to recover it. 00:32:19.162 [2024-11-26 19:18:35.816854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.162 [2024-11-26 19:18:35.817038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.162 [2024-11-26 19:18:35.817054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.162 qpair failed and we were unable to recover it. 00:32:19.162 [2024-11-26 19:18:35.817215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.162 [2024-11-26 19:18:35.817410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.162 [2024-11-26 19:18:35.817442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.162 qpair failed and we were unable to recover it. 00:32:19.162 [2024-11-26 19:18:35.817571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.162 [2024-11-26 19:18:35.817751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.162 [2024-11-26 19:18:35.817782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.162 qpair failed and we were unable to recover it. 00:32:19.162 [2024-11-26 19:18:35.817958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.162 [2024-11-26 19:18:35.818101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.162 [2024-11-26 19:18:35.818116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.162 qpair failed and we were unable to recover it. 00:32:19.162 [2024-11-26 19:18:35.818274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.162 [2024-11-26 19:18:35.818435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.162 [2024-11-26 19:18:35.818451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.162 qpair failed and we were unable to recover it. 00:32:19.162 [2024-11-26 19:18:35.818710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.162 [2024-11-26 19:18:35.818891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.162 [2024-11-26 19:18:35.818907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.162 qpair failed and we were unable to recover it. 00:32:19.162 [2024-11-26 19:18:35.819085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.162 [2024-11-26 19:18:35.819301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.162 [2024-11-26 19:18:35.819333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.162 qpair failed and we were unable to recover it. 00:32:19.162 [2024-11-26 19:18:35.819530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.162 [2024-11-26 19:18:35.819770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.162 [2024-11-26 19:18:35.819802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.162 qpair failed and we were unable to recover it. 00:32:19.162 [2024-11-26 19:18:35.820066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.162 [2024-11-26 19:18:35.820268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.162 [2024-11-26 19:18:35.820301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.162 qpair failed and we were unable to recover it. 00:32:19.162 [2024-11-26 19:18:35.820478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.162 [2024-11-26 19:18:35.820668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.162 [2024-11-26 19:18:35.820700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.162 qpair failed and we were unable to recover it. 00:32:19.162 [2024-11-26 19:18:35.820999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.162 [2024-11-26 19:18:35.821297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.162 [2024-11-26 19:18:35.821344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.162 qpair failed and we were unable to recover it. 00:32:19.162 [2024-11-26 19:18:35.821535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.162 [2024-11-26 19:18:35.821684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.162 [2024-11-26 19:18:35.821716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.162 qpair failed and we were unable to recover it. 00:32:19.162 [2024-11-26 19:18:35.821894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.162 [2024-11-26 19:18:35.822086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.162 [2024-11-26 19:18:35.822120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.162 qpair failed and we were unable to recover it. 00:32:19.162 [2024-11-26 19:18:35.822336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.162 [2024-11-26 19:18:35.822573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.162 [2024-11-26 19:18:35.822606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.162 qpair failed and we were unable to recover it. 00:32:19.162 [2024-11-26 19:18:35.822791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.162 [2024-11-26 19:18:35.823086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.162 [2024-11-26 19:18:35.823120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.162 qpair failed and we were unable to recover it. 00:32:19.162 [2024-11-26 19:18:35.823376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.162 [2024-11-26 19:18:35.823617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.162 [2024-11-26 19:18:35.823649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.162 qpair failed and we were unable to recover it. 00:32:19.162 [2024-11-26 19:18:35.823857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.162 [2024-11-26 19:18:35.823981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.162 [2024-11-26 19:18:35.824015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.162 qpair failed and we were unable to recover it. 00:32:19.162 [2024-11-26 19:18:35.824287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.162 [2024-11-26 19:18:35.824566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.162 [2024-11-26 19:18:35.824586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.162 qpair failed and we were unable to recover it. 00:32:19.162 [2024-11-26 19:18:35.824810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.162 [2024-11-26 19:18:35.824960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.162 [2024-11-26 19:18:35.824977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.162 qpair failed and we were unable to recover it. 00:32:19.162 [2024-11-26 19:18:35.825152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.162 [2024-11-26 19:18:35.825298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.162 [2024-11-26 19:18:35.825319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.162 qpair failed and we were unable to recover it. 00:32:19.162 [2024-11-26 19:18:35.825538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.162 [2024-11-26 19:18:35.825701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.163 [2024-11-26 19:18:35.825716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.163 qpair failed and we were unable to recover it. 00:32:19.163 [2024-11-26 19:18:35.825884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.163 [2024-11-26 19:18:35.826127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.163 [2024-11-26 19:18:35.826161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.163 qpair failed and we were unable to recover it. 00:32:19.163 [2024-11-26 19:18:35.826446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.163 [2024-11-26 19:18:35.826716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.163 [2024-11-26 19:18:35.826747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.163 qpair failed and we were unable to recover it. 00:32:19.163 [2024-11-26 19:18:35.827000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.163 [2024-11-26 19:18:35.827270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.163 [2024-11-26 19:18:35.827303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.163 qpair failed and we were unable to recover it. 00:32:19.163 [2024-11-26 19:18:35.827484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.163 [2024-11-26 19:18:35.827753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.163 [2024-11-26 19:18:35.827785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.163 qpair failed and we were unable to recover it. 00:32:19.163 [2024-11-26 19:18:35.828100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.163 [2024-11-26 19:18:35.828381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.163 [2024-11-26 19:18:35.828414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.163 qpair failed and we were unable to recover it. 00:32:19.163 [2024-11-26 19:18:35.828645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.163 [2024-11-26 19:18:35.828839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.163 [2024-11-26 19:18:35.828870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.163 qpair failed and we were unable to recover it. 00:32:19.163 [2024-11-26 19:18:35.829097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.163 [2024-11-26 19:18:35.829305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.163 [2024-11-26 19:18:35.829337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.163 qpair failed and we were unable to recover it. 00:32:19.163 [2024-11-26 19:18:35.829612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.163 [2024-11-26 19:18:35.829881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.163 [2024-11-26 19:18:35.829913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.163 qpair failed and we were unable to recover it. 00:32:19.163 [2024-11-26 19:18:35.830147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.163 [2024-11-26 19:18:35.830293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.163 [2024-11-26 19:18:35.830310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.163 qpair failed and we were unable to recover it. 00:32:19.163 [2024-11-26 19:18:35.830480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.163 [2024-11-26 19:18:35.830707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.163 [2024-11-26 19:18:35.830740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.163 qpair failed and we were unable to recover it. 00:32:19.163 [2024-11-26 19:18:35.830945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.163 [2024-11-26 19:18:35.831246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.163 [2024-11-26 19:18:35.831278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.163 qpair failed and we were unable to recover it. 00:32:19.163 [2024-11-26 19:18:35.831552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.163 [2024-11-26 19:18:35.831689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.163 [2024-11-26 19:18:35.831722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.163 qpair failed and we were unable to recover it. 00:32:19.163 [2024-11-26 19:18:35.831856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.163 [2024-11-26 19:18:35.832069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.163 [2024-11-26 19:18:35.832103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.163 qpair failed and we were unable to recover it. 00:32:19.163 [2024-11-26 19:18:35.832381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.163 [2024-11-26 19:18:35.832582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.163 [2024-11-26 19:18:35.832623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.163 qpair failed and we were unable to recover it. 00:32:19.163 [2024-11-26 19:18:35.832789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.163 [2024-11-26 19:18:35.833014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.163 [2024-11-26 19:18:35.833048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.163 qpair failed and we were unable to recover it. 00:32:19.163 [2024-11-26 19:18:35.833179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.163 [2024-11-26 19:18:35.833445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.163 [2024-11-26 19:18:35.833476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.163 qpair failed and we were unable to recover it. 00:32:19.163 [2024-11-26 19:18:35.833731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.163 [2024-11-26 19:18:35.834004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.163 [2024-11-26 19:18:35.834037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.163 qpair failed and we were unable to recover it. 00:32:19.163 [2024-11-26 19:18:35.834310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.163 [2024-11-26 19:18:35.834499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.163 [2024-11-26 19:18:35.834529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.163 qpair failed and we were unable to recover it. 00:32:19.163 [2024-11-26 19:18:35.834781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.163 [2024-11-26 19:18:35.835051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.163 [2024-11-26 19:18:35.835086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.163 qpair failed and we were unable to recover it. 00:32:19.163 [2024-11-26 19:18:35.835350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.163 [2024-11-26 19:18:35.835596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.163 [2024-11-26 19:18:35.835627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.163 qpair failed and we were unable to recover it. 00:32:19.163 [2024-11-26 19:18:35.835827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.163 [2024-11-26 19:18:35.836124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.164 [2024-11-26 19:18:35.836158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.164 qpair failed and we were unable to recover it. 00:32:19.164 [2024-11-26 19:18:35.836448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.164 [2024-11-26 19:18:35.836748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.164 [2024-11-26 19:18:35.836779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.164 qpair failed and we were unable to recover it. 00:32:19.164 [2024-11-26 19:18:35.837104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.164 [2024-11-26 19:18:35.837377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.164 [2024-11-26 19:18:35.837409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.164 qpair failed and we were unable to recover it. 00:32:19.164 [2024-11-26 19:18:35.837594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.164 [2024-11-26 19:18:35.837845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.164 [2024-11-26 19:18:35.837878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.164 qpair failed and we were unable to recover it. 00:32:19.164 [2024-11-26 19:18:35.838157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.164 [2024-11-26 19:18:35.838431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.164 [2024-11-26 19:18:35.838448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.164 qpair failed and we were unable to recover it. 00:32:19.164 [2024-11-26 19:18:35.838626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.164 [2024-11-26 19:18:35.838794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.164 [2024-11-26 19:18:35.838827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.164 qpair failed and we were unable to recover it. 00:32:19.164 [2024-11-26 19:18:35.838971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.164 [2024-11-26 19:18:35.839224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.164 [2024-11-26 19:18:35.839256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.164 qpair failed and we were unable to recover it. 00:32:19.164 [2024-11-26 19:18:35.839457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.164 [2024-11-26 19:18:35.839637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.164 [2024-11-26 19:18:35.839670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.164 qpair failed and we were unable to recover it. 00:32:19.164 [2024-11-26 19:18:35.839801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.164 [2024-11-26 19:18:35.839982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.164 [2024-11-26 19:18:35.840016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.164 qpair failed and we were unable to recover it. 00:32:19.164 [2024-11-26 19:18:35.840242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.164 [2024-11-26 19:18:35.840519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.164 [2024-11-26 19:18:35.840552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.164 qpair failed and we were unable to recover it. 00:32:19.164 [2024-11-26 19:18:35.840855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.164 [2024-11-26 19:18:35.841120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.164 [2024-11-26 19:18:35.841153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.164 qpair failed and we were unable to recover it. 00:32:19.164 [2024-11-26 19:18:35.841431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.164 [2024-11-26 19:18:35.841705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.164 [2024-11-26 19:18:35.841738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.164 qpair failed and we were unable to recover it. 00:32:19.164 [2024-11-26 19:18:35.842015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.164 [2024-11-26 19:18:35.842216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.164 [2024-11-26 19:18:35.842250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.164 qpair failed and we were unable to recover it. 00:32:19.164 [2024-11-26 19:18:35.842384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.164 [2024-11-26 19:18:35.842533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.164 [2024-11-26 19:18:35.842550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.164 qpair failed and we were unable to recover it. 00:32:19.164 [2024-11-26 19:18:35.842812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.164 [2024-11-26 19:18:35.843062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.164 [2024-11-26 19:18:35.843097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.164 qpair failed and we were unable to recover it. 00:32:19.164 [2024-11-26 19:18:35.843232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.164 [2024-11-26 19:18:35.843431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.164 [2024-11-26 19:18:35.843464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.164 qpair failed and we were unable to recover it. 00:32:19.164 [2024-11-26 19:18:35.843601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.164 [2024-11-26 19:18:35.843785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.164 [2024-11-26 19:18:35.843819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.164 qpair failed and we were unable to recover it. 00:32:19.164 [2024-11-26 19:18:35.844116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.164 [2024-11-26 19:18:35.844231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.164 [2024-11-26 19:18:35.844263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.164 qpair failed and we were unable to recover it. 00:32:19.164 [2024-11-26 19:18:35.844542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.164 [2024-11-26 19:18:35.844728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.164 [2024-11-26 19:18:35.844744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.164 qpair failed and we were unable to recover it. 00:32:19.164 [2024-11-26 19:18:35.844990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.164 [2024-11-26 19:18:35.845311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.164 [2024-11-26 19:18:35.845344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.164 qpair failed and we were unable to recover it. 00:32:19.164 [2024-11-26 19:18:35.845620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.164 [2024-11-26 19:18:35.845888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.164 [2024-11-26 19:18:35.845920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.164 qpair failed and we were unable to recover it. 00:32:19.164 [2024-11-26 19:18:35.846157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.164 [2024-11-26 19:18:35.846326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.164 [2024-11-26 19:18:35.846358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.164 qpair failed and we were unable to recover it. 00:32:19.165 [2024-11-26 19:18:35.846538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.165 [2024-11-26 19:18:35.846812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.165 [2024-11-26 19:18:35.846846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.165 qpair failed and we were unable to recover it. 00:32:19.165 [2024-11-26 19:18:35.847135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.165 [2024-11-26 19:18:35.847348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.165 [2024-11-26 19:18:35.847380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.165 qpair failed and we were unable to recover it. 00:32:19.165 [2024-11-26 19:18:35.847646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.165 [2024-11-26 19:18:35.847784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.165 [2024-11-26 19:18:35.847815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.165 qpair failed and we were unable to recover it. 00:32:19.165 [2024-11-26 19:18:35.848088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.165 [2024-11-26 19:18:35.848310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.165 [2024-11-26 19:18:35.848340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.165 qpair failed and we were unable to recover it. 00:32:19.165 [2024-11-26 19:18:35.848612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.165 [2024-11-26 19:18:35.848855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.165 [2024-11-26 19:18:35.848888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.165 qpair failed and we were unable to recover it. 00:32:19.165 [2024-11-26 19:18:35.849083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.165 [2024-11-26 19:18:35.849343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.165 [2024-11-26 19:18:35.849375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.165 qpair failed and we were unable to recover it. 00:32:19.165 [2024-11-26 19:18:35.849529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.165 [2024-11-26 19:18:35.849655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.165 [2024-11-26 19:18:35.849686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.165 qpair failed and we were unable to recover it. 00:32:19.165 [2024-11-26 19:18:35.849896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.165 [2024-11-26 19:18:35.850141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.165 [2024-11-26 19:18:35.850162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.165 qpair failed and we were unable to recover it. 00:32:19.165 [2024-11-26 19:18:35.850332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.165 [2024-11-26 19:18:35.850566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.165 [2024-11-26 19:18:35.850598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.165 qpair failed and we were unable to recover it. 00:32:19.165 [2024-11-26 19:18:35.850886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.165 [2024-11-26 19:18:35.851080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.165 [2024-11-26 19:18:35.851098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.165 qpair failed and we were unable to recover it. 00:32:19.165 [2024-11-26 19:18:35.851330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.165 [2024-11-26 19:18:35.851542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.165 [2024-11-26 19:18:35.851576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.165 qpair failed and we were unable to recover it. 00:32:19.165 [2024-11-26 19:18:35.851832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.165 [2024-11-26 19:18:35.852051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.165 [2024-11-26 19:18:35.852068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.165 qpair failed and we were unable to recover it. 00:32:19.165 [2024-11-26 19:18:35.852286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.165 [2024-11-26 19:18:35.852526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.165 [2024-11-26 19:18:35.852542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.165 qpair failed and we were unable to recover it. 00:32:19.165 [2024-11-26 19:18:35.852833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.165 [2024-11-26 19:18:35.853031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.165 [2024-11-26 19:18:35.853067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.165 qpair failed and we were unable to recover it. 00:32:19.165 [2024-11-26 19:18:35.853372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.165 [2024-11-26 19:18:35.853554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.165 [2024-11-26 19:18:35.853588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.165 qpair failed and we were unable to recover it. 00:32:19.165 [2024-11-26 19:18:35.853845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.165 [2024-11-26 19:18:35.854173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.165 [2024-11-26 19:18:35.854206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.165 qpair failed and we were unable to recover it. 00:32:19.165 [2024-11-26 19:18:35.854390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.165 [2024-11-26 19:18:35.854664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.165 [2024-11-26 19:18:35.854696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.165 qpair failed and we were unable to recover it. 00:32:19.165 [2024-11-26 19:18:35.854977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.165 [2024-11-26 19:18:35.855167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.165 [2024-11-26 19:18:35.855188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.165 qpair failed and we were unable to recover it. 00:32:19.165 [2024-11-26 19:18:35.855359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.165 [2024-11-26 19:18:35.855634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.165 [2024-11-26 19:18:35.855667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.165 qpair failed and we were unable to recover it. 00:32:19.165 [2024-11-26 19:18:35.855959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.165 [2024-11-26 19:18:35.856269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.165 [2024-11-26 19:18:35.856306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.165 qpair failed and we were unable to recover it. 00:32:19.165 [2024-11-26 19:18:35.856583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.165 [2024-11-26 19:18:35.856771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.165 [2024-11-26 19:18:35.856804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.165 qpair failed and we were unable to recover it. 00:32:19.165 [2024-11-26 19:18:35.856929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.165 [2024-11-26 19:18:35.857218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.165 [2024-11-26 19:18:35.857253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.166 qpair failed and we were unable to recover it. 00:32:19.166 [2024-11-26 19:18:35.857544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.166 [2024-11-26 19:18:35.857708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.166 [2024-11-26 19:18:35.857725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.166 qpair failed and we were unable to recover it. 00:32:19.166 [2024-11-26 19:18:35.857879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.166 [2024-11-26 19:18:35.858040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.166 [2024-11-26 19:18:35.858058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.166 qpair failed and we were unable to recover it. 00:32:19.166 [2024-11-26 19:18:35.858204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.166 [2024-11-26 19:18:35.858428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.166 [2024-11-26 19:18:35.858461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.166 qpair failed and we were unable to recover it. 00:32:19.166 [2024-11-26 19:18:35.858598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.166 [2024-11-26 19:18:35.858793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.166 [2024-11-26 19:18:35.858826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.166 qpair failed and we were unable to recover it. 00:32:19.166 [2024-11-26 19:18:35.859105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.166 [2024-11-26 19:18:35.859383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.166 [2024-11-26 19:18:35.859417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.166 qpair failed and we were unable to recover it. 00:32:19.166 [2024-11-26 19:18:35.859622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.166 [2024-11-26 19:18:35.859748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.166 [2024-11-26 19:18:35.859781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.166 qpair failed and we were unable to recover it. 00:32:19.166 [2024-11-26 19:18:35.860018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.166 [2024-11-26 19:18:35.860201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.166 [2024-11-26 19:18:35.860234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.166 qpair failed and we were unable to recover it. 00:32:19.166 [2024-11-26 19:18:35.860459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.166 [2024-11-26 19:18:35.860683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.166 [2024-11-26 19:18:35.860717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.166 qpair failed and we were unable to recover it. 00:32:19.166 [2024-11-26 19:18:35.860913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.166 [2024-11-26 19:18:35.861211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.166 [2024-11-26 19:18:35.861246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.166 qpair failed and we were unable to recover it. 00:32:19.166 [2024-11-26 19:18:35.861540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.166 [2024-11-26 19:18:35.861729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.166 [2024-11-26 19:18:35.861761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.166 qpair failed and we were unable to recover it. 00:32:19.166 [2024-11-26 19:18:35.862022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.166 [2024-11-26 19:18:35.862210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.166 [2024-11-26 19:18:35.862243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.166 qpair failed and we were unable to recover it. 00:32:19.166 [2024-11-26 19:18:35.862498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.166 [2024-11-26 19:18:35.862681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.166 [2024-11-26 19:18:35.862698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.166 qpair failed and we were unable to recover it. 00:32:19.166 [2024-11-26 19:18:35.862943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.166 [2024-11-26 19:18:35.863227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.166 [2024-11-26 19:18:35.863260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.166 qpair failed and we were unable to recover it. 00:32:19.166 [2024-11-26 19:18:35.863536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.166 [2024-11-26 19:18:35.863797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.166 [2024-11-26 19:18:35.863831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.166 qpair failed and we were unable to recover it. 00:32:19.166 [2024-11-26 19:18:35.864140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.166 [2024-11-26 19:18:35.864434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.166 [2024-11-26 19:18:35.864468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.166 qpair failed and we were unable to recover it. 00:32:19.166 [2024-11-26 19:18:35.864775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.166 [2024-11-26 19:18:35.864993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.166 [2024-11-26 19:18:35.865011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.166 qpair failed and we were unable to recover it. 00:32:19.166 [2024-11-26 19:18:35.865289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.166 [2024-11-26 19:18:35.865477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.166 [2024-11-26 19:18:35.865510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.166 qpair failed and we were unable to recover it. 00:32:19.166 [2024-11-26 19:18:35.865701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.166 [2024-11-26 19:18:35.865888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.166 [2024-11-26 19:18:35.865920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.166 qpair failed and we were unable to recover it. 00:32:19.166 [2024-11-26 19:18:35.866200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.166 [2024-11-26 19:18:35.866412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.166 [2024-11-26 19:18:35.866445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.166 qpair failed and we were unable to recover it. 00:32:19.166 [2024-11-26 19:18:35.866723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.166 [2024-11-26 19:18:35.866908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.166 [2024-11-26 19:18:35.866942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.167 qpair failed and we were unable to recover it. 00:32:19.167 [2024-11-26 19:18:35.867119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.167 [2024-11-26 19:18:35.867304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.167 [2024-11-26 19:18:35.867336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.167 qpair failed and we were unable to recover it. 00:32:19.167 [2024-11-26 19:18:35.867544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.167 [2024-11-26 19:18:35.867825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.167 [2024-11-26 19:18:35.867858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.167 qpair failed and we were unable to recover it. 00:32:19.167 [2024-11-26 19:18:35.868058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.167 [2024-11-26 19:18:35.868263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.167 [2024-11-26 19:18:35.868296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.167 qpair failed and we were unable to recover it. 00:32:19.167 [2024-11-26 19:18:35.868568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.167 [2024-11-26 19:18:35.868797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.167 [2024-11-26 19:18:35.868814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.167 qpair failed and we were unable to recover it. 00:32:19.167 [2024-11-26 19:18:35.868918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.167 [2024-11-26 19:18:35.869154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.167 [2024-11-26 19:18:35.869173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.167 qpair failed and we were unable to recover it. 00:32:19.167 [2024-11-26 19:18:35.869379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.167 [2024-11-26 19:18:35.869692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.167 [2024-11-26 19:18:35.869724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.167 qpair failed and we were unable to recover it. 00:32:19.167 [2024-11-26 19:18:35.869983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.167 [2024-11-26 19:18:35.870186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.167 [2024-11-26 19:18:35.870219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.167 qpair failed and we were unable to recover it. 00:32:19.167 [2024-11-26 19:18:35.870499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.167 [2024-11-26 19:18:35.870726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.167 [2024-11-26 19:18:35.870759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.167 qpair failed and we were unable to recover it. 00:32:19.167 [2024-11-26 19:18:35.871067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.167 [2024-11-26 19:18:35.871356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.167 [2024-11-26 19:18:35.871390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.167 qpair failed and we were unable to recover it. 00:32:19.167 [2024-11-26 19:18:35.871670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.167 [2024-11-26 19:18:35.871931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.167 [2024-11-26 19:18:35.871977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.167 qpair failed and we were unable to recover it. 00:32:19.167 [2024-11-26 19:18:35.872258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.167 [2024-11-26 19:18:35.872481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.167 [2024-11-26 19:18:35.872515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.167 qpair failed and we were unable to recover it. 00:32:19.167 [2024-11-26 19:18:35.872723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.167 [2024-11-26 19:18:35.873001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.167 [2024-11-26 19:18:35.873040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.167 qpair failed and we were unable to recover it. 00:32:19.167 [2024-11-26 19:18:35.873318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.167 [2024-11-26 19:18:35.873621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.167 [2024-11-26 19:18:35.873654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.167 qpair failed and we were unable to recover it. 00:32:19.167 [2024-11-26 19:18:35.873906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.167 [2024-11-26 19:18:35.874117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.167 [2024-11-26 19:18:35.874159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.167 qpair failed and we were unable to recover it. 00:32:19.167 [2024-11-26 19:18:35.874322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.167 [2024-11-26 19:18:35.874484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.167 [2024-11-26 19:18:35.874518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.167 qpair failed and we were unable to recover it. 00:32:19.167 [2024-11-26 19:18:35.874797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.167 [2024-11-26 19:18:35.874915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.167 [2024-11-26 19:18:35.874956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.167 qpair failed and we were unable to recover it. 00:32:19.167 [2024-11-26 19:18:35.875235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.167 [2024-11-26 19:18:35.875487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.167 [2024-11-26 19:18:35.875521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.167 qpair failed and we were unable to recover it. 00:32:19.167 [2024-11-26 19:18:35.875677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.167 [2024-11-26 19:18:35.875923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.167 [2024-11-26 19:18:35.875967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.167 qpair failed and we were unable to recover it. 00:32:19.167 [2024-11-26 19:18:35.876094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.167 [2024-11-26 19:18:35.876412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.167 [2024-11-26 19:18:35.876446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.167 qpair failed and we were unable to recover it. 00:32:19.167 [2024-11-26 19:18:35.876727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.167 [2024-11-26 19:18:35.877003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.167 [2024-11-26 19:18:35.877038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.167 qpair failed and we were unable to recover it. 00:32:19.167 [2024-11-26 19:18:35.877298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.167 [2024-11-26 19:18:35.877480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.167 [2024-11-26 19:18:35.877512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.167 qpair failed and we were unable to recover it. 00:32:19.167 [2024-11-26 19:18:35.877715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.167 [2024-11-26 19:18:35.877966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.168 [2024-11-26 19:18:35.878001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.168 qpair failed and we were unable to recover it. 00:32:19.168 [2024-11-26 19:18:35.878198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.168 [2024-11-26 19:18:35.878390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.168 [2024-11-26 19:18:35.878423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.168 qpair failed and we were unable to recover it. 00:32:19.168 [2024-11-26 19:18:35.878710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.168 [2024-11-26 19:18:35.878845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.168 [2024-11-26 19:18:35.878877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.168 qpair failed and we were unable to recover it. 00:32:19.168 [2024-11-26 19:18:35.879157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.168 [2024-11-26 19:18:35.879412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.168 [2024-11-26 19:18:35.879445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.168 qpair failed and we were unable to recover it. 00:32:19.168 [2024-11-26 19:18:35.879674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.168 [2024-11-26 19:18:35.879964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.168 [2024-11-26 19:18:35.879998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.168 qpair failed and we were unable to recover it. 00:32:19.168 [2024-11-26 19:18:35.880269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.168 [2024-11-26 19:18:35.880459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.168 [2024-11-26 19:18:35.880500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.168 qpair failed and we were unable to recover it. 00:32:19.168 [2024-11-26 19:18:35.880705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.168 [2024-11-26 19:18:35.880983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.168 [2024-11-26 19:18:35.881018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.168 qpair failed and we were unable to recover it. 00:32:19.168 [2024-11-26 19:18:35.881245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.168 [2024-11-26 19:18:35.881486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.168 [2024-11-26 19:18:35.881504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.168 qpair failed and we were unable to recover it. 00:32:19.168 [2024-11-26 19:18:35.881699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.168 [2024-11-26 19:18:35.881819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.168 [2024-11-26 19:18:35.881853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.168 qpair failed and we were unable to recover it. 00:32:19.168 [2024-11-26 19:18:35.882156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.168 [2024-11-26 19:18:35.882438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.168 [2024-11-26 19:18:35.882471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.168 qpair failed and we were unable to recover it. 00:32:19.168 [2024-11-26 19:18:35.882785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.168 [2024-11-26 19:18:35.883043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.168 [2024-11-26 19:18:35.883077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.168 qpair failed and we were unable to recover it. 00:32:19.168 [2024-11-26 19:18:35.883361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.168 [2024-11-26 19:18:35.883611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.168 [2024-11-26 19:18:35.883643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.168 qpair failed and we were unable to recover it. 00:32:19.168 [2024-11-26 19:18:35.883931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.168 [2024-11-26 19:18:35.884133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.168 [2024-11-26 19:18:35.884166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.168 qpair failed and we were unable to recover it. 00:32:19.168 [2024-11-26 19:18:35.884363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.168 [2024-11-26 19:18:35.884614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.168 [2024-11-26 19:18:35.884647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.168 qpair failed and we were unable to recover it. 00:32:19.168 [2024-11-26 19:18:35.884895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.168 [2024-11-26 19:18:35.885115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.168 [2024-11-26 19:18:35.885151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.168 qpair failed and we were unable to recover it. 00:32:19.168 [2024-11-26 19:18:35.885335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.168 [2024-11-26 19:18:35.885506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.168 [2024-11-26 19:18:35.885523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.168 qpair failed and we were unable to recover it. 00:32:19.168 [2024-11-26 19:18:35.885723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.168 [2024-11-26 19:18:35.885876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.168 [2024-11-26 19:18:35.885893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.168 qpair failed and we were unable to recover it. 00:32:19.168 [2024-11-26 19:18:35.886136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.168 [2024-11-26 19:18:35.886384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.168 [2024-11-26 19:18:35.886417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.168 qpair failed and we were unable to recover it. 00:32:19.168 [2024-11-26 19:18:35.886611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.168 [2024-11-26 19:18:35.886893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.168 [2024-11-26 19:18:35.886927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.168 qpair failed and we were unable to recover it. 00:32:19.168 [2024-11-26 19:18:35.887215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.168 [2024-11-26 19:18:35.887486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.168 [2024-11-26 19:18:35.887518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.168 qpair failed and we were unable to recover it. 00:32:19.168 [2024-11-26 19:18:35.887778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.168 [2024-11-26 19:18:35.887971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.168 [2024-11-26 19:18:35.888005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.168 qpair failed and we were unable to recover it. 00:32:19.168 [2024-11-26 19:18:35.888150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.168 [2024-11-26 19:18:35.888351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.168 [2024-11-26 19:18:35.888382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.168 qpair failed and we were unable to recover it. 00:32:19.168 [2024-11-26 19:18:35.888586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.168 [2024-11-26 19:18:35.888815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.168 [2024-11-26 19:18:35.888847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.168 qpair failed and we were unable to recover it. 00:32:19.168 [2024-11-26 19:18:35.889125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.168 [2024-11-26 19:18:35.889402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.168 [2024-11-26 19:18:35.889434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.168 qpair failed and we were unable to recover it. 00:32:19.168 [2024-11-26 19:18:35.889704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.168 [2024-11-26 19:18:35.889829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.168 [2024-11-26 19:18:35.889862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.168 qpair failed and we were unable to recover it. 00:32:19.169 [2024-11-26 19:18:35.890152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.169 [2024-11-26 19:18:35.890348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.169 [2024-11-26 19:18:35.890380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.169 qpair failed and we were unable to recover it. 00:32:19.169 [2024-11-26 19:18:35.890586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.169 [2024-11-26 19:18:35.890778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.169 [2024-11-26 19:18:35.890812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.169 qpair failed and we were unable to recover it. 00:32:19.169 [2024-11-26 19:18:35.891093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.169 [2024-11-26 19:18:35.891289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.169 [2024-11-26 19:18:35.891322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.169 qpair failed and we were unable to recover it. 00:32:19.169 [2024-11-26 19:18:35.891579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.169 [2024-11-26 19:18:35.891798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.169 [2024-11-26 19:18:35.891839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.169 qpair failed and we were unable to recover it. 00:32:19.169 [2024-11-26 19:18:35.892118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.169 [2024-11-26 19:18:35.892401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.169 [2024-11-26 19:18:35.892431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.169 qpair failed and we were unable to recover it. 00:32:19.169 [2024-11-26 19:18:35.892627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.169 [2024-11-26 19:18:35.892808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.169 [2024-11-26 19:18:35.892840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.169 qpair failed and we were unable to recover it. 00:32:19.169 [2024-11-26 19:18:35.893039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.169 [2024-11-26 19:18:35.893316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.169 [2024-11-26 19:18:35.893347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.169 qpair failed and we were unable to recover it. 00:32:19.169 [2024-11-26 19:18:35.893618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.169 [2024-11-26 19:18:35.893787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.169 [2024-11-26 19:18:35.893804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.169 qpair failed and we were unable to recover it. 00:32:19.169 [2024-11-26 19:18:35.894058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.169 [2024-11-26 19:18:35.894277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.169 [2024-11-26 19:18:35.894294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.169 qpair failed and we were unable to recover it. 00:32:19.169 [2024-11-26 19:18:35.894569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.169 [2024-11-26 19:18:35.894868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.169 [2024-11-26 19:18:35.894900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.169 qpair failed and we were unable to recover it. 00:32:19.169 [2024-11-26 19:18:35.895103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.169 [2024-11-26 19:18:35.895373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.169 [2024-11-26 19:18:35.895405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.169 qpair failed and we were unable to recover it. 00:32:19.169 [2024-11-26 19:18:35.895604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.169 [2024-11-26 19:18:35.895827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.169 [2024-11-26 19:18:35.895859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.169 qpair failed and we were unable to recover it. 00:32:19.169 [2024-11-26 19:18:35.896005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.169 [2024-11-26 19:18:35.896255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.169 [2024-11-26 19:18:35.896287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.169 qpair failed and we were unable to recover it. 00:32:19.169 [2024-11-26 19:18:35.896431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.169 [2024-11-26 19:18:35.896705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.169 [2024-11-26 19:18:35.896736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.169 qpair failed and we were unable to recover it. 00:32:19.169 [2024-11-26 19:18:35.896883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.169 [2024-11-26 19:18:35.897067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.169 [2024-11-26 19:18:35.897085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.169 qpair failed and we were unable to recover it. 00:32:19.169 [2024-11-26 19:18:35.897334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.169 [2024-11-26 19:18:35.897624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.169 [2024-11-26 19:18:35.897656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.169 qpair failed and we were unable to recover it. 00:32:19.169 [2024-11-26 19:18:35.897913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.169 [2024-11-26 19:18:35.898179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.169 [2024-11-26 19:18:35.898213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.169 qpair failed and we were unable to recover it. 00:32:19.169 [2024-11-26 19:18:35.898516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.169 [2024-11-26 19:18:35.898816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.169 [2024-11-26 19:18:35.898849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.169 qpair failed and we were unable to recover it. 00:32:19.169 [2024-11-26 19:18:35.899072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.169 [2024-11-26 19:18:35.899199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.169 [2024-11-26 19:18:35.899231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.169 qpair failed and we were unable to recover it. 00:32:19.169 [2024-11-26 19:18:35.899380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.169 [2024-11-26 19:18:35.899531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.169 [2024-11-26 19:18:35.899548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.169 qpair failed and we were unable to recover it. 00:32:19.169 [2024-11-26 19:18:35.899735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.169 [2024-11-26 19:18:35.899980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.169 [2024-11-26 19:18:35.900000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.169 qpair failed and we were unable to recover it. 00:32:19.169 [2024-11-26 19:18:35.900250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.169 [2024-11-26 19:18:35.900399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.169 [2024-11-26 19:18:35.900432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.169 qpair failed and we were unable to recover it. 00:32:19.170 [2024-11-26 19:18:35.900638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.170 [2024-11-26 19:18:35.900934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.170 [2024-11-26 19:18:35.900978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.170 qpair failed and we were unable to recover it. 00:32:19.170 [2024-11-26 19:18:35.901265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.170 [2024-11-26 19:18:35.901450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.170 [2024-11-26 19:18:35.901483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.170 qpair failed and we were unable to recover it. 00:32:19.170 [2024-11-26 19:18:35.901652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.170 [2024-11-26 19:18:35.901899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.170 [2024-11-26 19:18:35.901932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.170 qpair failed and we were unable to recover it. 00:32:19.170 [2024-11-26 19:18:35.902223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.170 [2024-11-26 19:18:35.902482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.170 [2024-11-26 19:18:35.902498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.170 qpair failed and we were unable to recover it. 00:32:19.170 [2024-11-26 19:18:35.902656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.170 [2024-11-26 19:18:35.902919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.170 [2024-11-26 19:18:35.902974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.170 qpair failed and we were unable to recover it. 00:32:19.170 [2024-11-26 19:18:35.903202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.170 [2024-11-26 19:18:35.903328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.170 [2024-11-26 19:18:35.903359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.170 qpair failed and we were unable to recover it. 00:32:19.170 [2024-11-26 19:18:35.903635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.170 [2024-11-26 19:18:35.903907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.170 [2024-11-26 19:18:35.903941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.170 qpair failed and we were unable to recover it. 00:32:19.170 [2024-11-26 19:18:35.904220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.170 [2024-11-26 19:18:35.904471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.170 [2024-11-26 19:18:35.904504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.170 qpair failed and we were unable to recover it. 00:32:19.170 [2024-11-26 19:18:35.904699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.170 [2024-11-26 19:18:35.904971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.170 [2024-11-26 19:18:35.905005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.170 qpair failed and we were unable to recover it. 00:32:19.170 [2024-11-26 19:18:35.905185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.170 [2024-11-26 19:18:35.905433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.170 [2024-11-26 19:18:35.905473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.170 qpair failed and we were unable to recover it. 00:32:19.170 [2024-11-26 19:18:35.905672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.170 [2024-11-26 19:18:35.905863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.170 [2024-11-26 19:18:35.905895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.170 qpair failed and we were unable to recover it. 00:32:19.170 [2024-11-26 19:18:35.906162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.170 [2024-11-26 19:18:35.906459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.170 [2024-11-26 19:18:35.906491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.170 qpair failed and we were unable to recover it. 00:32:19.170 [2024-11-26 19:18:35.906747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.170 [2024-11-26 19:18:35.907027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.170 [2024-11-26 19:18:35.907066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.170 qpair failed and we were unable to recover it. 00:32:19.170 [2024-11-26 19:18:35.907148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.170 [2024-11-26 19:18:35.907394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.170 [2024-11-26 19:18:35.907427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.170 qpair failed and we were unable to recover it. 00:32:19.170 [2024-11-26 19:18:35.907635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.170 [2024-11-26 19:18:35.907884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.170 [2024-11-26 19:18:35.907917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.170 qpair failed and we were unable to recover it. 00:32:19.170 [2024-11-26 19:18:35.908115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.170 [2024-11-26 19:18:35.908315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.170 [2024-11-26 19:18:35.908346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.170 qpair failed and we were unable to recover it. 00:32:19.170 [2024-11-26 19:18:35.908622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.170 [2024-11-26 19:18:35.908866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.170 [2024-11-26 19:18:35.908902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.170 qpair failed and we were unable to recover it. 00:32:19.170 [2024-11-26 19:18:35.909201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.170 [2024-11-26 19:18:35.909506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.170 [2024-11-26 19:18:35.909541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.170 qpair failed and we were unable to recover it. 00:32:19.170 [2024-11-26 19:18:35.909797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.170 [2024-11-26 19:18:35.910020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.170 [2024-11-26 19:18:35.910054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.170 qpair failed and we were unable to recover it. 00:32:19.170 [2024-11-26 19:18:35.910253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.170 [2024-11-26 19:18:35.910448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.170 [2024-11-26 19:18:35.910481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.170 qpair failed and we were unable to recover it. 00:32:19.170 [2024-11-26 19:18:35.910680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.170 [2024-11-26 19:18:35.910862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.170 [2024-11-26 19:18:35.910894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.170 qpair failed and we were unable to recover it. 00:32:19.170 [2024-11-26 19:18:35.911131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.170 [2024-11-26 19:18:35.911342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.170 [2024-11-26 19:18:35.911375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.171 qpair failed and we were unable to recover it. 00:32:19.171 [2024-11-26 19:18:35.911566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.171 [2024-11-26 19:18:35.911848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.171 [2024-11-26 19:18:35.911880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.171 qpair failed and we were unable to recover it. 00:32:19.171 [2024-11-26 19:18:35.912009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.171 [2024-11-26 19:18:35.912256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.171 [2024-11-26 19:18:35.912289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.171 qpair failed and we were unable to recover it. 00:32:19.171 [2024-11-26 19:18:35.912566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.171 [2024-11-26 19:18:35.912790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.171 [2024-11-26 19:18:35.912809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.171 qpair failed and we were unable to recover it. 00:32:19.171 [2024-11-26 19:18:35.912971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.171 [2024-11-26 19:18:35.913204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.171 [2024-11-26 19:18:35.913220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.171 qpair failed and we were unable to recover it. 00:32:19.171 [2024-11-26 19:18:35.913417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.171 [2024-11-26 19:18:35.913689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.171 [2024-11-26 19:18:35.913723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.171 qpair failed and we were unable to recover it. 00:32:19.171 [2024-11-26 19:18:35.913927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.171 [2024-11-26 19:18:35.914217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.171 [2024-11-26 19:18:35.914250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.171 qpair failed and we were unable to recover it. 00:32:19.171 [2024-11-26 19:18:35.914448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.171 [2024-11-26 19:18:35.914639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.171 [2024-11-26 19:18:35.914672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.171 qpair failed and we were unable to recover it. 00:32:19.171 [2024-11-26 19:18:35.914995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.171 [2024-11-26 19:18:35.915216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.171 [2024-11-26 19:18:35.915250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.171 qpair failed and we were unable to recover it. 00:32:19.171 [2024-11-26 19:18:35.915497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.171 [2024-11-26 19:18:35.915761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.171 [2024-11-26 19:18:35.915794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.171 qpair failed and we were unable to recover it. 00:32:19.171 [2024-11-26 19:18:35.915926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.171 [2024-11-26 19:18:35.916215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.171 [2024-11-26 19:18:35.916247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.171 qpair failed and we were unable to recover it. 00:32:19.171 [2024-11-26 19:18:35.916430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.171 [2024-11-26 19:18:35.916608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.171 [2024-11-26 19:18:35.916641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.171 qpair failed and we were unable to recover it. 00:32:19.171 [2024-11-26 19:18:35.916851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.171 [2024-11-26 19:18:35.917051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.171 [2024-11-26 19:18:35.917087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.171 qpair failed and we were unable to recover it. 00:32:19.171 [2024-11-26 19:18:35.917313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.171 [2024-11-26 19:18:35.917508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.171 [2024-11-26 19:18:35.917539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.171 qpair failed and we were unable to recover it. 00:32:19.171 [2024-11-26 19:18:35.917822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.171 [2024-11-26 19:18:35.918026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.171 [2024-11-26 19:18:35.918059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.171 qpair failed and we were unable to recover it. 00:32:19.171 [2024-11-26 19:18:35.918258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.171 [2024-11-26 19:18:35.918509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.171 [2024-11-26 19:18:35.918542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.171 qpair failed and we were unable to recover it. 00:32:19.171 [2024-11-26 19:18:35.918760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.171 [2024-11-26 19:18:35.919040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.171 [2024-11-26 19:18:35.919083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.171 qpair failed and we were unable to recover it. 00:32:19.171 [2024-11-26 19:18:35.919247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.171 [2024-11-26 19:18:35.919468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.171 [2024-11-26 19:18:35.919501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.171 qpair failed and we were unable to recover it. 00:32:19.171 [2024-11-26 19:18:35.919699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.171 [2024-11-26 19:18:35.919923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.171 [2024-11-26 19:18:35.919966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.171 qpair failed and we were unable to recover it. 00:32:19.171 [2024-11-26 19:18:35.920233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.172 [2024-11-26 19:18:35.920499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.172 [2024-11-26 19:18:35.920532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.172 qpair failed and we were unable to recover it. 00:32:19.172 [2024-11-26 19:18:35.920787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.172 [2024-11-26 19:18:35.921056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.172 [2024-11-26 19:18:35.921091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.172 qpair failed and we were unable to recover it. 00:32:19.172 [2024-11-26 19:18:35.921298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.172 [2024-11-26 19:18:35.921477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.172 [2024-11-26 19:18:35.921509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.172 qpair failed and we were unable to recover it. 00:32:19.172 [2024-11-26 19:18:35.921719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.172 [2024-11-26 19:18:35.922011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.172 [2024-11-26 19:18:35.922045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.172 qpair failed and we were unable to recover it. 00:32:19.172 [2024-11-26 19:18:35.922298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.172 [2024-11-26 19:18:35.922519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.172 [2024-11-26 19:18:35.922536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.172 qpair failed and we were unable to recover it. 00:32:19.172 [2024-11-26 19:18:35.922645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.172 [2024-11-26 19:18:35.922724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.172 [2024-11-26 19:18:35.922739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.172 qpair failed and we were unable to recover it. 00:32:19.172 [2024-11-26 19:18:35.922908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.172 [2024-11-26 19:18:35.923080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.172 [2024-11-26 19:18:35.923097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.172 qpair failed and we were unable to recover it. 00:32:19.172 [2024-11-26 19:18:35.923353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.172 [2024-11-26 19:18:35.923575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.172 [2024-11-26 19:18:35.923608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.172 qpair failed and we were unable to recover it. 00:32:19.172 [2024-11-26 19:18:35.923833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.172 [2024-11-26 19:18:35.924042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.172 [2024-11-26 19:18:35.924076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.172 qpair failed and we were unable to recover it. 00:32:19.172 [2024-11-26 19:18:35.924339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.172 [2024-11-26 19:18:35.924612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.172 [2024-11-26 19:18:35.924645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.172 qpair failed and we were unable to recover it. 00:32:19.172 [2024-11-26 19:18:35.924905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.172 [2024-11-26 19:18:35.925242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.172 [2024-11-26 19:18:35.925276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.172 qpair failed and we were unable to recover it. 00:32:19.172 [2024-11-26 19:18:35.925482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.172 [2024-11-26 19:18:35.925738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.172 [2024-11-26 19:18:35.925771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.172 qpair failed and we were unable to recover it. 00:32:19.172 [2024-11-26 19:18:35.926057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.172 [2024-11-26 19:18:35.926318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.172 [2024-11-26 19:18:35.926336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.172 qpair failed and we were unable to recover it. 00:32:19.172 [2024-11-26 19:18:35.926503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.172 [2024-11-26 19:18:35.926744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.172 [2024-11-26 19:18:35.926776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.172 qpair failed and we were unable to recover it. 00:32:19.172 [2024-11-26 19:18:35.926980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.172 [2024-11-26 19:18:35.927170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.172 [2024-11-26 19:18:35.927204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.172 qpair failed and we were unable to recover it. 00:32:19.172 [2024-11-26 19:18:35.927483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.172 [2024-11-26 19:18:35.927628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.172 [2024-11-26 19:18:35.927660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.172 qpair failed and we were unable to recover it. 00:32:19.172 [2024-11-26 19:18:35.927914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.172 [2024-11-26 19:18:35.928205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.172 [2024-11-26 19:18:35.928239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.172 qpair failed and we were unable to recover it. 00:32:19.172 [2024-11-26 19:18:35.928536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.172 [2024-11-26 19:18:35.928834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.172 [2024-11-26 19:18:35.928866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.172 qpair failed and we were unable to recover it. 00:32:19.172 [2024-11-26 19:18:35.929167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.172 [2024-11-26 19:18:35.929305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.172 [2024-11-26 19:18:35.929322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.172 qpair failed and we were unable to recover it. 00:32:19.172 [2024-11-26 19:18:35.929578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.172 [2024-11-26 19:18:35.929774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.172 [2024-11-26 19:18:35.929807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.172 qpair failed and we were unable to recover it. 00:32:19.172 [2024-11-26 19:18:35.930064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.172 [2024-11-26 19:18:35.930366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.172 [2024-11-26 19:18:35.930405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.172 qpair failed and we were unable to recover it. 00:32:19.172 [2024-11-26 19:18:35.930611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.172 [2024-11-26 19:18:35.930859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.172 [2024-11-26 19:18:35.930890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.172 qpair failed and we were unable to recover it. 00:32:19.172 [2024-11-26 19:18:35.931099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.172 [2024-11-26 19:18:35.931291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.173 [2024-11-26 19:18:35.931322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.173 qpair failed and we were unable to recover it. 00:32:19.173 [2024-11-26 19:18:35.931514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.173 [2024-11-26 19:18:35.931765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.173 [2024-11-26 19:18:35.931797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.173 qpair failed and we were unable to recover it. 00:32:19.173 [2024-11-26 19:18:35.931999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.173 [2024-11-26 19:18:35.932178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.173 [2024-11-26 19:18:35.932210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.173 qpair failed and we were unable to recover it. 00:32:19.173 [2024-11-26 19:18:35.932490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.173 [2024-11-26 19:18:35.932703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.173 [2024-11-26 19:18:35.932736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.173 qpair failed and we were unable to recover it. 00:32:19.173 [2024-11-26 19:18:35.933013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.173 [2024-11-26 19:18:35.933214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.173 [2024-11-26 19:18:35.933246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.173 qpair failed and we were unable to recover it. 00:32:19.173 [2024-11-26 19:18:35.933427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.173 [2024-11-26 19:18:35.933597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.173 [2024-11-26 19:18:35.933629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.173 qpair failed and we were unable to recover it. 00:32:19.173 [2024-11-26 19:18:35.933883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.173 [2024-11-26 19:18:35.934134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.173 [2024-11-26 19:18:35.934168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.173 qpair failed and we were unable to recover it. 00:32:19.173 [2024-11-26 19:18:35.934415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.173 [2024-11-26 19:18:35.934600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.173 [2024-11-26 19:18:35.934617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.173 qpair failed and we were unable to recover it. 00:32:19.173 [2024-11-26 19:18:35.934790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.173 [2024-11-26 19:18:35.934973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.173 [2024-11-26 19:18:35.935007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.173 qpair failed and we were unable to recover it. 00:32:19.173 [2024-11-26 19:18:35.935237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.173 [2024-11-26 19:18:35.935506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.173 [2024-11-26 19:18:35.935539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.173 qpair failed and we were unable to recover it. 00:32:19.173 [2024-11-26 19:18:35.935794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.173 [2024-11-26 19:18:35.935985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.173 [2024-11-26 19:18:35.936018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.173 qpair failed and we were unable to recover it. 00:32:19.173 [2024-11-26 19:18:35.936245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.173 [2024-11-26 19:18:35.936468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.173 [2024-11-26 19:18:35.936504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.173 qpair failed and we were unable to recover it. 00:32:19.173 [2024-11-26 19:18:35.936695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.173 [2024-11-26 19:18:35.936904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.173 [2024-11-26 19:18:35.936937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.173 qpair failed and we were unable to recover it. 00:32:19.173 [2024-11-26 19:18:35.937229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.173 [2024-11-26 19:18:35.937452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.173 [2024-11-26 19:18:35.937486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.173 qpair failed and we were unable to recover it. 00:32:19.173 [2024-11-26 19:18:35.937749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.173 [2024-11-26 19:18:35.937969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.173 [2024-11-26 19:18:35.938003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.173 qpair failed and we were unable to recover it. 00:32:19.173 [2024-11-26 19:18:35.938230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.173 [2024-11-26 19:18:35.938429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.173 [2024-11-26 19:18:35.938462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.173 qpair failed and we were unable to recover it. 00:32:19.173 [2024-11-26 19:18:35.938785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.173 [2024-11-26 19:18:35.939004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.173 [2024-11-26 19:18:35.939043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.173 qpair failed and we were unable to recover it. 00:32:19.173 [2024-11-26 19:18:35.939149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.173 [2024-11-26 19:18:35.939414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.173 [2024-11-26 19:18:35.939431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.173 qpair failed and we were unable to recover it. 00:32:19.173 [2024-11-26 19:18:35.939628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.173 [2024-11-26 19:18:35.939855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.173 [2024-11-26 19:18:35.939874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.173 qpair failed and we were unable to recover it. 00:32:19.173 [2024-11-26 19:18:35.940124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.173 [2024-11-26 19:18:35.940297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.173 [2024-11-26 19:18:35.940315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.173 qpair failed and we were unable to recover it. 00:32:19.173 [2024-11-26 19:18:35.940519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.173 [2024-11-26 19:18:35.940770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.173 [2024-11-26 19:18:35.940802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.173 qpair failed and we were unable to recover it. 00:32:19.173 [2024-11-26 19:18:35.941006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.173 [2024-11-26 19:18:35.941260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.173 [2024-11-26 19:18:35.941294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.173 qpair failed and we were unable to recover it. 00:32:19.173 [2024-11-26 19:18:35.941479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.173 [2024-11-26 19:18:35.941753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.174 [2024-11-26 19:18:35.941784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.174 qpair failed and we were unable to recover it. 00:32:19.174 [2024-11-26 19:18:35.942002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.174 [2024-11-26 19:18:35.942200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.174 [2024-11-26 19:18:35.942217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.174 qpair failed and we were unable to recover it. 00:32:19.174 [2024-11-26 19:18:35.942377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.174 [2024-11-26 19:18:35.942634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.174 [2024-11-26 19:18:35.942666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.174 qpair failed and we were unable to recover it. 00:32:19.174 [2024-11-26 19:18:35.942933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.174 [2024-11-26 19:18:35.943297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.174 [2024-11-26 19:18:35.943334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.174 qpair failed and we were unable to recover it. 00:32:19.174 [2024-11-26 19:18:35.943542] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2430580 is same with the state(5) to be set 00:32:19.174 [2024-11-26 19:18:35.943882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.174 [2024-11-26 19:18:35.944178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.174 [2024-11-26 19:18:35.944204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.174 qpair failed and we were unable to recover it. 00:32:19.174 [2024-11-26 19:18:35.944329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.174 [2024-11-26 19:18:35.944564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.174 [2024-11-26 19:18:35.944601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.174 qpair failed and we were unable to recover it. 00:32:19.174 [2024-11-26 19:18:35.944816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.174 [2024-11-26 19:18:35.945098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.174 [2024-11-26 19:18:35.945143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.174 qpair failed and we were unable to recover it. 00:32:19.174 [2024-11-26 19:18:35.945313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.174 [2024-11-26 19:18:35.945493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.174 [2024-11-26 19:18:35.945526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.174 qpair failed and we were unable to recover it. 00:32:19.174 [2024-11-26 19:18:35.945783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.174 [2024-11-26 19:18:35.946044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.174 [2024-11-26 19:18:35.946078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.174 qpair failed and we were unable to recover it. 00:32:19.174 [2024-11-26 19:18:35.946276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.174 [2024-11-26 19:18:35.946525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.174 [2024-11-26 19:18:35.946558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.174 qpair failed and we were unable to recover it. 00:32:19.174 [2024-11-26 19:18:35.946706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.174 [2024-11-26 19:18:35.946991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.174 [2024-11-26 19:18:35.947028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.174 qpair failed and we were unable to recover it. 00:32:19.174 [2024-11-26 19:18:35.947234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.174 [2024-11-26 19:18:35.947430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.174 [2024-11-26 19:18:35.947448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.174 qpair failed and we were unable to recover it. 00:32:19.174 [2024-11-26 19:18:35.947671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.174 [2024-11-26 19:18:35.947869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.174 [2024-11-26 19:18:35.947904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.174 qpair failed and we were unable to recover it. 00:32:19.174 [2024-11-26 19:18:35.948156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.174 [2024-11-26 19:18:35.948356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.174 [2024-11-26 19:18:35.948374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.174 qpair failed and we were unable to recover it. 00:32:19.174 [2024-11-26 19:18:35.948607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.174 [2024-11-26 19:18:35.948801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.174 [2024-11-26 19:18:35.948819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.174 qpair failed and we were unable to recover it. 00:32:19.174 [2024-11-26 19:18:35.948982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.174 [2024-11-26 19:18:35.949175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.174 [2024-11-26 19:18:35.949194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.174 qpair failed and we were unable to recover it. 00:32:19.174 [2024-11-26 19:18:35.949360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.174 [2024-11-26 19:18:35.949618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.174 [2024-11-26 19:18:35.949652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.174 qpair failed and we were unable to recover it. 00:32:19.174 [2024-11-26 19:18:35.949883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.174 [2024-11-26 19:18:35.950090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.174 [2024-11-26 19:18:35.950127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.174 qpair failed and we were unable to recover it. 00:32:19.174 [2024-11-26 19:18:35.950282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.174 [2024-11-26 19:18:35.950521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.174 [2024-11-26 19:18:35.950554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.174 qpair failed and we were unable to recover it. 00:32:19.174 [2024-11-26 19:18:35.950864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.174 [2024-11-26 19:18:35.951145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.174 [2024-11-26 19:18:35.951180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.174 qpair failed and we were unable to recover it. 00:32:19.174 [2024-11-26 19:18:35.951444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.174 [2024-11-26 19:18:35.951665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.174 [2024-11-26 19:18:35.951701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.174 qpair failed and we were unable to recover it. 00:32:19.174 [2024-11-26 19:18:35.951990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.174 [2024-11-26 19:18:35.952184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.174 [2024-11-26 19:18:35.952217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.174 qpair failed and we were unable to recover it. 00:32:19.174 [2024-11-26 19:18:35.952402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.174 [2024-11-26 19:18:35.952608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.174 [2024-11-26 19:18:35.952640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.174 qpair failed and we were unable to recover it. 00:32:19.174 [2024-11-26 19:18:35.953868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.174 [2024-11-26 19:18:35.954168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.175 [2024-11-26 19:18:35.954192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.175 qpair failed and we were unable to recover it. 00:32:19.175 [2024-11-26 19:18:35.954385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.175 [2024-11-26 19:18:35.954611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.175 [2024-11-26 19:18:35.954660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.175 qpair failed and we were unable to recover it. 00:32:19.175 [2024-11-26 19:18:35.954820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.175 [2024-11-26 19:18:35.955156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.175 [2024-11-26 19:18:35.955192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.175 qpair failed and we were unable to recover it. 00:32:19.175 [2024-11-26 19:18:35.955398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.175 [2024-11-26 19:18:35.955601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.175 [2024-11-26 19:18:35.955634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.175 qpair failed and we were unable to recover it. 00:32:19.175 [2024-11-26 19:18:35.955871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.175 [2024-11-26 19:18:35.956066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.175 [2024-11-26 19:18:35.956105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.175 qpair failed and we were unable to recover it. 00:32:19.175 [2024-11-26 19:18:35.956319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.175 [2024-11-26 19:18:35.956562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.175 [2024-11-26 19:18:35.956596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.175 qpair failed and we were unable to recover it. 00:32:19.175 [2024-11-26 19:18:35.956896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.175 [2024-11-26 19:18:35.957125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.175 [2024-11-26 19:18:35.957159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.175 qpair failed and we were unable to recover it. 00:32:19.175 [2024-11-26 19:18:35.957363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.175 [2024-11-26 19:18:35.957613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.175 [2024-11-26 19:18:35.957646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.175 qpair failed and we were unable to recover it. 00:32:19.175 [2024-11-26 19:18:35.957854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.175 [2024-11-26 19:18:35.958038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.175 [2024-11-26 19:18:35.958072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.175 qpair failed and we were unable to recover it. 00:32:19.175 [2024-11-26 19:18:35.958228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.175 [2024-11-26 19:18:35.958490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.175 [2024-11-26 19:18:35.958523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.175 qpair failed and we were unable to recover it. 00:32:19.175 [2024-11-26 19:18:35.958778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.175 [2024-11-26 19:18:35.958884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.175 [2024-11-26 19:18:35.958900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.175 qpair failed and we were unable to recover it. 00:32:19.175 [2024-11-26 19:18:35.959125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.175 [2024-11-26 19:18:35.959236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.175 [2024-11-26 19:18:35.959255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.175 qpair failed and we were unable to recover it. 00:32:19.175 [2024-11-26 19:18:35.959466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.175 [2024-11-26 19:18:35.959713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.175 [2024-11-26 19:18:35.959745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.175 qpair failed and we were unable to recover it. 00:32:19.175 [2024-11-26 19:18:35.960004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.175 [2024-11-26 19:18:35.960297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.175 [2024-11-26 19:18:35.960315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.175 qpair failed and we were unable to recover it. 00:32:19.175 [2024-11-26 19:18:35.960485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.175 [2024-11-26 19:18:35.960609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.175 [2024-11-26 19:18:35.960647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.175 qpair failed and we were unable to recover it. 00:32:19.175 [2024-11-26 19:18:35.960933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.175 [2024-11-26 19:18:35.961106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.175 [2024-11-26 19:18:35.961145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.175 qpair failed and we were unable to recover it. 00:32:19.175 [2024-11-26 19:18:35.961352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.175 [2024-11-26 19:18:35.961558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.175 [2024-11-26 19:18:35.961593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.175 qpair failed and we were unable to recover it. 00:32:19.175 [2024-11-26 19:18:35.961851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.175 [2024-11-26 19:18:35.962072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.175 [2024-11-26 19:18:35.962110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.175 qpair failed and we were unable to recover it. 00:32:19.175 [2024-11-26 19:18:35.962340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.175 [2024-11-26 19:18:35.962540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.175 [2024-11-26 19:18:35.962585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.175 qpair failed and we were unable to recover it. 00:32:19.175 [2024-11-26 19:18:35.962809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.175 [2024-11-26 19:18:35.962980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.175 [2024-11-26 19:18:35.963018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.175 qpair failed and we were unable to recover it. 00:32:19.175 [2024-11-26 19:18:35.963167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.175 [2024-11-26 19:18:35.963308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.175 [2024-11-26 19:18:35.963343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.175 qpair failed and we were unable to recover it. 00:32:19.175 [2024-11-26 19:18:35.963495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.175 [2024-11-26 19:18:35.963752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.175 [2024-11-26 19:18:35.963800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.175 qpair failed and we were unable to recover it. 00:32:19.175 [2024-11-26 19:18:35.964011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.175 [2024-11-26 19:18:35.964202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.175 [2024-11-26 19:18:35.964235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.175 qpair failed and we were unable to recover it. 00:32:19.175 [2024-11-26 19:18:35.964494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.176 [2024-11-26 19:18:35.964669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.176 [2024-11-26 19:18:35.964689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.176 qpair failed and we were unable to recover it. 00:32:19.176 [2024-11-26 19:18:35.964917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.176 [2024-11-26 19:18:35.965088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.176 [2024-11-26 19:18:35.965105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.176 qpair failed and we were unable to recover it. 00:32:19.176 [2024-11-26 19:18:35.965280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.176 [2024-11-26 19:18:35.965417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.176 [2024-11-26 19:18:35.965449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.176 qpair failed and we were unable to recover it. 00:32:19.176 [2024-11-26 19:18:35.965673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.176 [2024-11-26 19:18:35.965924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.176 [2024-11-26 19:18:35.965968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.176 qpair failed and we were unable to recover it. 00:32:19.176 [2024-11-26 19:18:35.966112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.176 [2024-11-26 19:18:35.966387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.176 [2024-11-26 19:18:35.966419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.176 qpair failed and we were unable to recover it. 00:32:19.176 [2024-11-26 19:18:35.966752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.176 [2024-11-26 19:18:35.966975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.176 [2024-11-26 19:18:35.966995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.176 qpair failed and we were unable to recover it. 00:32:19.176 [2024-11-26 19:18:35.967165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.176 [2024-11-26 19:18:35.967359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.176 [2024-11-26 19:18:35.967392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.176 qpair failed and we were unable to recover it. 00:32:19.176 [2024-11-26 19:18:35.967664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.176 [2024-11-26 19:18:35.967935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.176 [2024-11-26 19:18:35.967981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.176 qpair failed and we were unable to recover it. 00:32:19.176 [2024-11-26 19:18:35.968189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.176 [2024-11-26 19:18:35.968414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.176 [2024-11-26 19:18:35.968447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.176 qpair failed and we were unable to recover it. 00:32:19.176 [2024-11-26 19:18:35.968630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.176 [2024-11-26 19:18:35.968855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.176 [2024-11-26 19:18:35.968889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.176 qpair failed and we were unable to recover it. 00:32:19.176 [2024-11-26 19:18:35.969159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.176 [2024-11-26 19:18:35.969347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.176 [2024-11-26 19:18:35.969381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.176 qpair failed and we were unable to recover it. 00:32:19.176 [2024-11-26 19:18:35.969500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.176 [2024-11-26 19:18:35.969659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.176 [2024-11-26 19:18:35.969676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.176 qpair failed and we were unable to recover it. 00:32:19.176 [2024-11-26 19:18:35.969808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.176 [2024-11-26 19:18:35.969989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.176 [2024-11-26 19:18:35.970007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.176 qpair failed and we were unable to recover it. 00:32:19.176 [2024-11-26 19:18:35.970179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.176 [2024-11-26 19:18:35.970401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.176 [2024-11-26 19:18:35.970419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.176 qpair failed and we were unable to recover it. 00:32:19.176 [2024-11-26 19:18:35.970656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.176 [2024-11-26 19:18:35.970866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.176 [2024-11-26 19:18:35.970883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.176 qpair failed and we were unable to recover it. 00:32:19.176 [2024-11-26 19:18:35.970997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.176 [2024-11-26 19:18:35.971185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.176 [2024-11-26 19:18:35.971203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.176 qpair failed and we were unable to recover it. 00:32:19.176 [2024-11-26 19:18:35.971366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.176 [2024-11-26 19:18:35.971479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.176 [2024-11-26 19:18:35.971496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.176 qpair failed and we were unable to recover it. 00:32:19.176 [2024-11-26 19:18:35.971694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.176 [2024-11-26 19:18:35.971912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.176 [2024-11-26 19:18:35.971930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.176 qpair failed and we were unable to recover it. 00:32:19.176 [2024-11-26 19:18:35.972112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.176 [2024-11-26 19:18:35.972298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.176 [2024-11-26 19:18:35.972315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.176 qpair failed and we were unable to recover it. 00:32:19.176 [2024-11-26 19:18:35.972497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.176 [2024-11-26 19:18:35.972694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.176 [2024-11-26 19:18:35.972712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.176 qpair failed and we were unable to recover it. 00:32:19.176 [2024-11-26 19:18:35.972903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.176 [2024-11-26 19:18:35.973071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.176 [2024-11-26 19:18:35.973089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.176 qpair failed and we were unable to recover it. 00:32:19.176 [2024-11-26 19:18:35.973243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.176 [2024-11-26 19:18:35.973328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.176 [2024-11-26 19:18:35.973347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.177 qpair failed and we were unable to recover it. 00:32:19.177 [2024-11-26 19:18:35.973447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.177 [2024-11-26 19:18:35.973631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.177 [2024-11-26 19:18:35.973649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.177 qpair failed and we were unable to recover it. 00:32:19.177 [2024-11-26 19:18:35.973750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.177 [2024-11-26 19:18:35.973902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.177 [2024-11-26 19:18:35.973941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.177 qpair failed and we were unable to recover it. 00:32:19.177 [2024-11-26 19:18:35.974164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.177 [2024-11-26 19:18:35.974295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.177 [2024-11-26 19:18:35.974330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.177 qpair failed and we were unable to recover it. 00:32:19.177 [2024-11-26 19:18:35.974522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.177 [2024-11-26 19:18:35.974783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.177 [2024-11-26 19:18:35.974817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.177 qpair failed and we were unable to recover it. 00:32:19.177 [2024-11-26 19:18:35.975016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.177 [2024-11-26 19:18:35.975216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.177 [2024-11-26 19:18:35.975249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.177 qpair failed and we were unable to recover it. 00:32:19.177 [2024-11-26 19:18:35.975443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.177 [2024-11-26 19:18:35.975665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.177 [2024-11-26 19:18:35.975701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.177 qpair failed and we were unable to recover it. 00:32:19.177 [2024-11-26 19:18:35.975913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.177 [2024-11-26 19:18:35.976154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.177 [2024-11-26 19:18:35.976189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.177 qpair failed and we were unable to recover it. 00:32:19.177 [2024-11-26 19:18:35.976406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.177 [2024-11-26 19:18:35.976523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.177 [2024-11-26 19:18:35.976553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.177 qpair failed and we were unable to recover it. 00:32:19.177 [2024-11-26 19:18:35.976818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.177 [2024-11-26 19:18:35.977102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.177 [2024-11-26 19:18:35.977142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.177 qpair failed and we were unable to recover it. 00:32:19.177 [2024-11-26 19:18:35.977422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.177 [2024-11-26 19:18:35.977580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.177 [2024-11-26 19:18:35.977603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:19.177 qpair failed and we were unable to recover it. 00:32:19.177 [2024-11-26 19:18:35.977811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.177 [2024-11-26 19:18:35.977973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.177 [2024-11-26 19:18:35.977991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:19.177 qpair failed and we were unable to recover it. 00:32:19.177 [2024-11-26 19:18:35.978099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.177 [2024-11-26 19:18:35.978269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.177 [2024-11-26 19:18:35.978287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:19.177 qpair failed and we were unable to recover it. 00:32:19.177 [2024-11-26 19:18:35.978454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.177 [2024-11-26 19:18:35.978675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.177 [2024-11-26 19:18:35.978708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:19.177 qpair failed and we were unable to recover it. 00:32:19.177 [2024-11-26 19:18:35.978933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.177 [2024-11-26 19:18:35.979204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.177 [2024-11-26 19:18:35.979238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:19.177 qpair failed and we were unable to recover it. 00:32:19.177 [2024-11-26 19:18:35.979453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.177 [2024-11-26 19:18:35.979649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.177 [2024-11-26 19:18:35.979665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:19.177 qpair failed and we were unable to recover it. 00:32:19.177 [2024-11-26 19:18:35.979834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.177 [2024-11-26 19:18:35.980036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.177 [2024-11-26 19:18:35.980072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:19.177 qpair failed and we were unable to recover it. 00:32:19.177 [2024-11-26 19:18:35.980205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.177 [2024-11-26 19:18:35.980412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.177 [2024-11-26 19:18:35.980445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:19.177 qpair failed and we were unable to recover it. 00:32:19.177 [2024-11-26 19:18:35.980715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.177 [2024-11-26 19:18:35.980945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.177 [2024-11-26 19:18:35.980988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:19.177 qpair failed and we were unable to recover it. 00:32:19.178 [2024-11-26 19:18:35.981269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.178 [2024-11-26 19:18:35.981484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.178 [2024-11-26 19:18:35.981502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:19.178 qpair failed and we were unable to recover it. 00:32:19.178 [2024-11-26 19:18:35.981803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.178 [2024-11-26 19:18:35.982144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.178 [2024-11-26 19:18:35.982192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.178 qpair failed and we were unable to recover it. 00:32:19.178 [2024-11-26 19:18:35.982418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.178 [2024-11-26 19:18:35.982588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.178 [2024-11-26 19:18:35.982621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.178 qpair failed and we were unable to recover it. 00:32:19.178 [2024-11-26 19:18:35.982815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.178 [2024-11-26 19:18:35.983052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.178 [2024-11-26 19:18:35.983090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.178 qpair failed and we were unable to recover it. 00:32:19.178 [2024-11-26 19:18:35.983369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.178 [2024-11-26 19:18:35.983619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.178 [2024-11-26 19:18:35.983637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.178 qpair failed and we were unable to recover it. 00:32:19.178 [2024-11-26 19:18:35.983820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.178 [2024-11-26 19:18:35.984030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.178 [2024-11-26 19:18:35.984065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.178 qpair failed and we were unable to recover it. 00:32:19.178 [2024-11-26 19:18:35.984196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.178 [2024-11-26 19:18:35.984346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.178 [2024-11-26 19:18:35.984367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.178 qpair failed and we were unable to recover it. 00:32:19.178 [2024-11-26 19:18:35.984472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.178 [2024-11-26 19:18:35.984643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.178 [2024-11-26 19:18:35.984677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.178 qpair failed and we were unable to recover it. 00:32:19.178 [2024-11-26 19:18:35.984789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.178 [2024-11-26 19:18:35.984968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.178 [2024-11-26 19:18:35.985003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.178 qpair failed and we were unable to recover it. 00:32:19.178 [2024-11-26 19:18:35.985208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.178 [2024-11-26 19:18:35.985387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.178 [2024-11-26 19:18:35.985420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.178 qpair failed and we were unable to recover it. 00:32:19.178 [2024-11-26 19:18:35.985716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.178 [2024-11-26 19:18:35.985823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.178 [2024-11-26 19:18:35.985839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.178 qpair failed and we were unable to recover it. 00:32:19.178 [2024-11-26 19:18:35.985964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.178 [2024-11-26 19:18:35.986160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.178 [2024-11-26 19:18:35.986179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.178 qpair failed and we were unable to recover it. 00:32:19.178 [2024-11-26 19:18:35.986348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.178 [2024-11-26 19:18:35.986446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.178 [2024-11-26 19:18:35.986463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.178 qpair failed and we were unable to recover it. 00:32:19.178 [2024-11-26 19:18:35.986637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.178 [2024-11-26 19:18:35.986765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.178 [2024-11-26 19:18:35.986797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.178 qpair failed and we were unable to recover it. 00:32:19.178 [2024-11-26 19:18:35.986924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.178 [2024-11-26 19:18:35.987066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.178 [2024-11-26 19:18:35.987102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.178 qpair failed and we were unable to recover it. 00:32:19.178 [2024-11-26 19:18:35.987225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.178 [2024-11-26 19:18:35.987412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.178 [2024-11-26 19:18:35.987448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.178 qpair failed and we were unable to recover it. 00:32:19.178 [2024-11-26 19:18:35.987581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.178 [2024-11-26 19:18:35.987810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.178 [2024-11-26 19:18:35.987843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.178 qpair failed and we were unable to recover it. 00:32:19.178 [2024-11-26 19:18:35.988051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.178 [2024-11-26 19:18:35.988276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.178 [2024-11-26 19:18:35.988310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.178 qpair failed and we were unable to recover it. 00:32:19.178 [2024-11-26 19:18:35.988500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.178 [2024-11-26 19:18:35.988605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.178 [2024-11-26 19:18:35.988622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.178 qpair failed and we were unable to recover it. 00:32:19.178 [2024-11-26 19:18:35.988843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.178 [2024-11-26 19:18:35.988961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.178 [2024-11-26 19:18:35.988979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.178 qpair failed and we were unable to recover it. 00:32:19.178 [2024-11-26 19:18:35.989076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.178 [2024-11-26 19:18:35.989357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.178 [2024-11-26 19:18:35.989392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.178 qpair failed and we were unable to recover it. 00:32:19.178 [2024-11-26 19:18:35.989536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.178 [2024-11-26 19:18:35.989675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.178 [2024-11-26 19:18:35.989715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.178 qpair failed and we were unable to recover it. 00:32:19.178 [2024-11-26 19:18:35.989936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.178 [2024-11-26 19:18:35.990153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.178 [2024-11-26 19:18:35.990190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.179 qpair failed and we were unable to recover it. 00:32:19.179 [2024-11-26 19:18:35.990391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.179 [2024-11-26 19:18:35.990667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.179 [2024-11-26 19:18:35.990701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.179 qpair failed and we were unable to recover it. 00:32:19.179 [2024-11-26 19:18:35.990906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.179 [2024-11-26 19:18:35.991027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.179 [2024-11-26 19:18:35.991062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.179 qpair failed and we were unable to recover it. 00:32:19.179 [2024-11-26 19:18:35.991175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.179 [2024-11-26 19:18:35.991311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.179 [2024-11-26 19:18:35.991344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.179 qpair failed and we were unable to recover it. 00:32:19.179 [2024-11-26 19:18:35.991489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.179 [2024-11-26 19:18:35.991696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.179 [2024-11-26 19:18:35.991712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.179 qpair failed and we were unable to recover it. 00:32:19.179 [2024-11-26 19:18:35.991857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.179 [2024-11-26 19:18:35.992053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.179 [2024-11-26 19:18:35.992075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.179 qpair failed and we were unable to recover it. 00:32:19.179 [2024-11-26 19:18:35.992240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.179 [2024-11-26 19:18:35.992344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.179 [2024-11-26 19:18:35.992362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.179 qpair failed and we were unable to recover it. 00:32:19.179 [2024-11-26 19:18:35.992464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.179 [2024-11-26 19:18:35.992567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.179 [2024-11-26 19:18:35.992586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.179 qpair failed and we were unable to recover it. 00:32:19.179 [2024-11-26 19:18:35.992755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.179 [2024-11-26 19:18:35.992843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.179 [2024-11-26 19:18:35.992862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.179 qpair failed and we were unable to recover it. 00:32:19.179 [2024-11-26 19:18:35.993020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.179 [2024-11-26 19:18:35.993119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.179 [2024-11-26 19:18:35.993137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.179 qpair failed and we were unable to recover it. 00:32:19.179 [2024-11-26 19:18:35.993220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.179 [2024-11-26 19:18:35.993325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.179 [2024-11-26 19:18:35.993342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.179 qpair failed and we were unable to recover it. 00:32:19.179 [2024-11-26 19:18:35.993457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.179 [2024-11-26 19:18:35.993716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.179 [2024-11-26 19:18:35.993759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.179 qpair failed and we were unable to recover it. 00:32:19.179 [2024-11-26 19:18:35.993944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.179 [2024-11-26 19:18:35.994073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.179 [2024-11-26 19:18:35.994105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.179 qpair failed and we were unable to recover it. 00:32:19.179 [2024-11-26 19:18:35.994255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.179 [2024-11-26 19:18:35.994371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.179 [2024-11-26 19:18:35.994403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.179 qpair failed and we were unable to recover it. 00:32:19.179 [2024-11-26 19:18:35.994509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.179 [2024-11-26 19:18:35.994723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.179 [2024-11-26 19:18:35.994757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.179 qpair failed and we were unable to recover it. 00:32:19.179 [2024-11-26 19:18:35.995016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.179 [2024-11-26 19:18:35.995275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.179 [2024-11-26 19:18:35.995310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.179 qpair failed and we were unable to recover it. 00:32:19.179 [2024-11-26 19:18:35.995573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.179 [2024-11-26 19:18:35.995799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.179 [2024-11-26 19:18:35.995815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.179 qpair failed and we were unable to recover it. 00:32:19.179 [2024-11-26 19:18:35.996046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.179 [2024-11-26 19:18:35.996172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.179 [2024-11-26 19:18:35.996206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.179 qpair failed and we were unable to recover it. 00:32:19.179 [2024-11-26 19:18:35.996351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.179 [2024-11-26 19:18:35.996546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.179 [2024-11-26 19:18:35.996581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.179 qpair failed and we were unable to recover it. 00:32:19.179 [2024-11-26 19:18:35.996841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.179 [2024-11-26 19:18:35.997029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.179 [2024-11-26 19:18:35.997064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.179 qpair failed and we were unable to recover it. 00:32:19.179 [2024-11-26 19:18:35.997315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.179 [2024-11-26 19:18:35.997443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.179 [2024-11-26 19:18:35.997476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.179 qpair failed and we were unable to recover it. 00:32:19.179 [2024-11-26 19:18:35.997673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.179 [2024-11-26 19:18:35.997808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.179 [2024-11-26 19:18:35.997841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.179 qpair failed and we were unable to recover it. 00:32:19.179 [2024-11-26 19:18:35.998032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.179 [2024-11-26 19:18:35.998230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.179 [2024-11-26 19:18:35.998247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.179 qpair failed and we were unable to recover it. 00:32:19.179 [2024-11-26 19:18:35.998351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.179 [2024-11-26 19:18:35.998520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.179 [2024-11-26 19:18:35.998554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.180 qpair failed and we were unable to recover it. 00:32:19.180 [2024-11-26 19:18:35.998684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.180 [2024-11-26 19:18:35.998811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.180 [2024-11-26 19:18:35.998845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.180 qpair failed and we were unable to recover it. 00:32:19.180 [2024-11-26 19:18:35.999039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.180 [2024-11-26 19:18:35.999166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.180 [2024-11-26 19:18:35.999199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.180 qpair failed and we were unable to recover it. 00:32:19.180 [2024-11-26 19:18:35.999389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.180 [2024-11-26 19:18:35.999581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.180 [2024-11-26 19:18:35.999626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.180 qpair failed and we were unable to recover it. 00:32:19.180 [2024-11-26 19:18:35.999733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.180 [2024-11-26 19:18:35.999967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.180 [2024-11-26 19:18:36.000001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.180 qpair failed and we were unable to recover it. 00:32:19.180 [2024-11-26 19:18:36.000212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.180 [2024-11-26 19:18:36.000408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.180 [2024-11-26 19:18:36.000443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.180 qpair failed and we were unable to recover it. 00:32:19.180 [2024-11-26 19:18:36.000570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.180 [2024-11-26 19:18:36.000654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.180 [2024-11-26 19:18:36.000672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.180 qpair failed and we were unable to recover it. 00:32:19.180 [2024-11-26 19:18:36.000836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.180 [2024-11-26 19:18:36.001068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.180 [2024-11-26 19:18:36.001105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.180 qpair failed and we were unable to recover it. 00:32:19.180 [2024-11-26 19:18:36.001224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.180 [2024-11-26 19:18:36.001316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.180 [2024-11-26 19:18:36.001333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.180 qpair failed and we were unable to recover it. 00:32:19.180 [2024-11-26 19:18:36.001511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.180 [2024-11-26 19:18:36.001716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.180 [2024-11-26 19:18:36.001748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.180 qpair failed and we were unable to recover it. 00:32:19.180 [2024-11-26 19:18:36.001866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.180 [2024-11-26 19:18:36.002073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.180 [2024-11-26 19:18:36.002107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.180 qpair failed and we were unable to recover it. 00:32:19.180 [2024-11-26 19:18:36.002299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.180 [2024-11-26 19:18:36.002581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.180 [2024-11-26 19:18:36.002617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.180 qpair failed and we were unable to recover it. 00:32:19.180 [2024-11-26 19:18:36.002852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.180 [2024-11-26 19:18:36.002962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.180 [2024-11-26 19:18:36.002999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.180 qpair failed and we were unable to recover it. 00:32:19.180 [2024-11-26 19:18:36.003156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.180 [2024-11-26 19:18:36.003375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.180 [2024-11-26 19:18:36.003407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.180 qpair failed and we were unable to recover it. 00:32:19.180 [2024-11-26 19:18:36.003547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.180 [2024-11-26 19:18:36.003676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.180 [2024-11-26 19:18:36.003711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.180 qpair failed and we were unable to recover it. 00:32:19.180 [2024-11-26 19:18:36.003895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.180 [2024-11-26 19:18:36.004052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.180 [2024-11-26 19:18:36.004086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.180 qpair failed and we were unable to recover it. 00:32:19.180 [2024-11-26 19:18:36.004232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.180 [2024-11-26 19:18:36.004505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.180 [2024-11-26 19:18:36.004522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.180 qpair failed and we were unable to recover it. 00:32:19.180 [2024-11-26 19:18:36.004624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.180 [2024-11-26 19:18:36.004786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.180 [2024-11-26 19:18:36.004804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.180 qpair failed and we were unable to recover it. 00:32:19.180 [2024-11-26 19:18:36.004889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.180 [2024-11-26 19:18:36.005135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.180 [2024-11-26 19:18:36.005173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.180 qpair failed and we were unable to recover it. 00:32:19.180 [2024-11-26 19:18:36.005319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.180 [2024-11-26 19:18:36.005532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.180 [2024-11-26 19:18:36.005565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.180 qpair failed and we were unable to recover it. 00:32:19.180 [2024-11-26 19:18:36.005777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.180 [2024-11-26 19:18:36.006005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.180 [2024-11-26 19:18:36.006039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.180 qpair failed and we were unable to recover it. 00:32:19.180 [2024-11-26 19:18:36.006187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.180 [2024-11-26 19:18:36.006310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.180 [2024-11-26 19:18:36.006343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.180 qpair failed and we were unable to recover it. 00:32:19.180 [2024-11-26 19:18:36.006480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.180 [2024-11-26 19:18:36.006726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.180 [2024-11-26 19:18:36.006761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.180 qpair failed and we were unable to recover it. 00:32:19.180 [2024-11-26 19:18:36.007016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.180 [2024-11-26 19:18:36.007203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.180 [2024-11-26 19:18:36.007236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.180 qpair failed and we were unable to recover it. 00:32:19.180 [2024-11-26 19:18:36.007542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.180 [2024-11-26 19:18:36.007749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.181 [2024-11-26 19:18:36.007781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.181 qpair failed and we were unable to recover it. 00:32:19.181 [2024-11-26 19:18:36.008081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.181 [2024-11-26 19:18:36.008205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.181 [2024-11-26 19:18:36.008240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.181 qpair failed and we were unable to recover it. 00:32:19.181 [2024-11-26 19:18:36.008533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.181 [2024-11-26 19:18:36.008622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.181 [2024-11-26 19:18:36.008639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.181 qpair failed and we were unable to recover it. 00:32:19.181 [2024-11-26 19:18:36.008731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.181 [2024-11-26 19:18:36.008907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.181 [2024-11-26 19:18:36.008962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.181 qpair failed and we were unable to recover it. 00:32:19.181 [2024-11-26 19:18:36.009217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.181 [2024-11-26 19:18:36.009351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.181 [2024-11-26 19:18:36.009385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.181 qpair failed and we were unable to recover it. 00:32:19.181 [2024-11-26 19:18:36.009576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.181 [2024-11-26 19:18:36.009700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.181 [2024-11-26 19:18:36.009734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.181 qpair failed and we were unable to recover it. 00:32:19.181 [2024-11-26 19:18:36.009921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.181 [2024-11-26 19:18:36.010040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.181 [2024-11-26 19:18:36.010075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.181 qpair failed and we were unable to recover it. 00:32:19.181 [2024-11-26 19:18:36.010327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.181 [2024-11-26 19:18:36.010550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.181 [2024-11-26 19:18:36.010586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.181 qpair failed and we were unable to recover it. 00:32:19.181 [2024-11-26 19:18:36.010809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.181 [2024-11-26 19:18:36.010942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.181 [2024-11-26 19:18:36.010986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.181 qpair failed and we were unable to recover it. 00:32:19.181 [2024-11-26 19:18:36.011124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.181 [2024-11-26 19:18:36.011389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.181 [2024-11-26 19:18:36.011422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.181 qpair failed and we were unable to recover it. 00:32:19.181 [2024-11-26 19:18:36.011572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.181 [2024-11-26 19:18:36.011783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.181 [2024-11-26 19:18:36.011800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.181 qpair failed and we were unable to recover it. 00:32:19.181 [2024-11-26 19:18:36.011920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.181 [2024-11-26 19:18:36.012043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.181 [2024-11-26 19:18:36.012078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.181 qpair failed and we were unable to recover it. 00:32:19.181 [2024-11-26 19:18:36.012273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.181 [2024-11-26 19:18:36.012457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.181 [2024-11-26 19:18:36.012475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.181 qpair failed and we were unable to recover it. 00:32:19.181 [2024-11-26 19:18:36.012622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.181 [2024-11-26 19:18:36.012799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.181 [2024-11-26 19:18:36.012820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.181 qpair failed and we were unable to recover it. 00:32:19.181 [2024-11-26 19:18:36.012972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.181 [2024-11-26 19:18:36.013067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.181 [2024-11-26 19:18:36.013103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.181 qpair failed and we were unable to recover it. 00:32:19.181 [2024-11-26 19:18:36.013251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.181 [2024-11-26 19:18:36.013427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.181 [2024-11-26 19:18:36.013460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.181 qpair failed and we were unable to recover it. 00:32:19.181 [2024-11-26 19:18:36.013657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.181 [2024-11-26 19:18:36.013784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.181 [2024-11-26 19:18:36.013819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.181 qpair failed and we were unable to recover it. 00:32:19.181 [2024-11-26 19:18:36.013935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.181 [2024-11-26 19:18:36.014221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.181 [2024-11-26 19:18:36.014254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.181 qpair failed and we were unable to recover it. 00:32:19.181 [2024-11-26 19:18:36.014441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.181 [2024-11-26 19:18:36.014564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.181 [2024-11-26 19:18:36.014580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.181 qpair failed and we were unable to recover it. 00:32:19.181 [2024-11-26 19:18:36.014736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.181 [2024-11-26 19:18:36.014968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.181 [2024-11-26 19:18:36.015003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.181 qpair failed and we were unable to recover it. 00:32:19.181 [2024-11-26 19:18:36.015218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.181 [2024-11-26 19:18:36.015398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.181 [2024-11-26 19:18:36.015431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.181 qpair failed and we were unable to recover it. 00:32:19.181 [2024-11-26 19:18:36.015625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.181 [2024-11-26 19:18:36.015824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.181 [2024-11-26 19:18:36.015858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.181 qpair failed and we were unable to recover it. 00:32:19.181 [2024-11-26 19:18:36.016139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.181 [2024-11-26 19:18:36.016321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.182 [2024-11-26 19:18:36.016355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.182 qpair failed and we were unable to recover it. 00:32:19.182 [2024-11-26 19:18:36.016569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.182 [2024-11-26 19:18:36.016693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.182 [2024-11-26 19:18:36.016728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.182 qpair failed and we were unable to recover it. 00:32:19.182 [2024-11-26 19:18:36.016884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.182 [2024-11-26 19:18:36.017134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.182 [2024-11-26 19:18:36.017168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.182 qpair failed and we were unable to recover it. 00:32:19.182 [2024-11-26 19:18:36.017383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.182 [2024-11-26 19:18:36.017574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.182 [2024-11-26 19:18:36.017608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.182 qpair failed and we were unable to recover it. 00:32:19.182 [2024-11-26 19:18:36.017809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.182 [2024-11-26 19:18:36.017963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.182 [2024-11-26 19:18:36.017982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.182 qpair failed and we were unable to recover it. 00:32:19.182 [2024-11-26 19:18:36.018140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.182 [2024-11-26 19:18:36.018324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.182 [2024-11-26 19:18:36.018358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.182 qpair failed and we were unable to recover it. 00:32:19.182 [2024-11-26 19:18:36.018560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.182 [2024-11-26 19:18:36.018738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.182 [2024-11-26 19:18:36.018774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.182 qpair failed and we were unable to recover it. 00:32:19.182 [2024-11-26 19:18:36.018915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.182 [2024-11-26 19:18:36.019113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.182 [2024-11-26 19:18:36.019147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.182 qpair failed and we were unable to recover it. 00:32:19.182 [2024-11-26 19:18:36.019277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.182 [2024-11-26 19:18:36.019502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.182 [2024-11-26 19:18:36.019535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.182 qpair failed and we were unable to recover it. 00:32:19.182 [2024-11-26 19:18:36.019812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.182 [2024-11-26 19:18:36.019914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.182 [2024-11-26 19:18:36.019946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.182 qpair failed and we were unable to recover it. 00:32:19.182 [2024-11-26 19:18:36.020152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.182 [2024-11-26 19:18:36.020463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.182 [2024-11-26 19:18:36.020496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.182 qpair failed and we were unable to recover it. 00:32:19.182 [2024-11-26 19:18:36.020634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.182 [2024-11-26 19:18:36.020877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.182 [2024-11-26 19:18:36.020913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.182 qpair failed and we were unable to recover it. 00:32:19.182 [2024-11-26 19:18:36.021083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.182 [2024-11-26 19:18:36.021271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.182 [2024-11-26 19:18:36.021303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.182 qpair failed and we were unable to recover it. 00:32:19.182 [2024-11-26 19:18:36.021481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.182 [2024-11-26 19:18:36.021634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.182 [2024-11-26 19:18:36.021666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.182 qpair failed and we were unable to recover it. 00:32:19.182 [2024-11-26 19:18:36.021931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.182 [2024-11-26 19:18:36.022079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.182 [2024-11-26 19:18:36.022113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.182 qpair failed and we were unable to recover it. 00:32:19.182 [2024-11-26 19:18:36.022306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.182 [2024-11-26 19:18:36.022552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.182 [2024-11-26 19:18:36.022585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.182 qpair failed and we were unable to recover it. 00:32:19.182 [2024-11-26 19:18:36.022782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.182 [2024-11-26 19:18:36.023000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.182 [2024-11-26 19:18:36.023037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.182 qpair failed and we were unable to recover it. 00:32:19.182 [2024-11-26 19:18:36.023166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.182 [2024-11-26 19:18:36.023298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.182 [2024-11-26 19:18:36.023331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.182 qpair failed and we were unable to recover it. 00:32:19.182 [2024-11-26 19:18:36.023461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.182 [2024-11-26 19:18:36.023732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.182 [2024-11-26 19:18:36.023766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.182 qpair failed and we were unable to recover it. 00:32:19.182 [2024-11-26 19:18:36.023973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.182 [2024-11-26 19:18:36.024166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.182 [2024-11-26 19:18:36.024199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.182 qpair failed and we were unable to recover it. 00:32:19.182 [2024-11-26 19:18:36.024382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.182 [2024-11-26 19:18:36.024654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.182 [2024-11-26 19:18:36.024697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.182 qpair failed and we were unable to recover it. 00:32:19.182 [2024-11-26 19:18:36.024961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.182 [2024-11-26 19:18:36.025126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.182 [2024-11-26 19:18:36.025159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.182 qpair failed and we were unable to recover it. 00:32:19.182 [2024-11-26 19:18:36.025310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.182 [2024-11-26 19:18:36.025646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.182 [2024-11-26 19:18:36.025680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.182 qpair failed and we were unable to recover it. 00:32:19.183 [2024-11-26 19:18:36.025798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.183 [2024-11-26 19:18:36.026075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.183 [2024-11-26 19:18:36.026109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.183 qpair failed and we were unable to recover it. 00:32:19.183 [2024-11-26 19:18:36.026333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.183 [2024-11-26 19:18:36.026594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.183 [2024-11-26 19:18:36.026628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.183 qpair failed and we were unable to recover it. 00:32:19.183 [2024-11-26 19:18:36.026814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.183 [2024-11-26 19:18:36.026964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.183 [2024-11-26 19:18:36.027013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.183 qpair failed and we were unable to recover it. 00:32:19.183 [2024-11-26 19:18:36.027228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.183 [2024-11-26 19:18:36.027472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.183 [2024-11-26 19:18:36.027505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.183 qpair failed and we were unable to recover it. 00:32:19.183 [2024-11-26 19:18:36.027768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.183 [2024-11-26 19:18:36.028005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.183 [2024-11-26 19:18:36.028023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.183 qpair failed and we were unable to recover it. 00:32:19.183 [2024-11-26 19:18:36.028124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.183 [2024-11-26 19:18:36.028345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.183 [2024-11-26 19:18:36.028360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.183 qpair failed and we were unable to recover it. 00:32:19.183 [2024-11-26 19:18:36.028463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.183 [2024-11-26 19:18:36.028642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.183 [2024-11-26 19:18:36.028659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.183 qpair failed and we were unable to recover it. 00:32:19.183 [2024-11-26 19:18:36.028776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.183 [2024-11-26 19:18:36.029082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.183 [2024-11-26 19:18:36.029115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.183 qpair failed and we were unable to recover it. 00:32:19.183 [2024-11-26 19:18:36.029304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.183 [2024-11-26 19:18:36.029495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.183 [2024-11-26 19:18:36.029527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.183 qpair failed and we were unable to recover it. 00:32:19.183 [2024-11-26 19:18:36.029798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.183 [2024-11-26 19:18:36.029987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.183 [2024-11-26 19:18:36.030005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.183 qpair failed and we were unable to recover it. 00:32:19.183 [2024-11-26 19:18:36.030174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.183 [2024-11-26 19:18:36.030377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.183 [2024-11-26 19:18:36.030408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.183 qpair failed and we were unable to recover it. 00:32:19.183 [2024-11-26 19:18:36.030624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.183 [2024-11-26 19:18:36.030886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.183 [2024-11-26 19:18:36.030904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.183 qpair failed and we were unable to recover it. 00:32:19.183 [2024-11-26 19:18:36.031023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.183 [2024-11-26 19:18:36.031255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.183 [2024-11-26 19:18:36.031271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.183 qpair failed and we were unable to recover it. 00:32:19.183 [2024-11-26 19:18:36.031381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.183 [2024-11-26 19:18:36.031552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.183 [2024-11-26 19:18:36.031568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.183 qpair failed and we were unable to recover it. 00:32:19.183 [2024-11-26 19:18:36.031812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.183 [2024-11-26 19:18:36.031967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.183 [2024-11-26 19:18:36.032001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.183 qpair failed and we were unable to recover it. 00:32:19.183 [2024-11-26 19:18:36.032117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.183 [2024-11-26 19:18:36.032241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.183 [2024-11-26 19:18:36.032274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.183 qpair failed and we were unable to recover it. 00:32:19.183 [2024-11-26 19:18:36.032529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.183 [2024-11-26 19:18:36.032741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.183 [2024-11-26 19:18:36.032757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.183 qpair failed and we were unable to recover it. 00:32:19.183 [2024-11-26 19:18:36.033008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.183 [2024-11-26 19:18:36.033259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.183 [2024-11-26 19:18:36.033291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.183 qpair failed and we were unable to recover it. 00:32:19.184 [2024-11-26 19:18:36.033473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.184 [2024-11-26 19:18:36.033743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.184 [2024-11-26 19:18:36.033761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.184 qpair failed and we were unable to recover it. 00:32:19.184 [2024-11-26 19:18:36.033921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.184 [2024-11-26 19:18:36.034104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.184 [2024-11-26 19:18:36.034125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.184 qpair failed and we were unable to recover it. 00:32:19.184 [2024-11-26 19:18:36.034272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.184 [2024-11-26 19:18:36.034940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.184 [2024-11-26 19:18:36.034975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.184 qpair failed and we were unable to recover it. 00:32:19.184 [2024-11-26 19:18:36.035206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.184 [2024-11-26 19:18:36.035470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.184 [2024-11-26 19:18:36.035487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.184 qpair failed and we were unable to recover it. 00:32:19.184 [2024-11-26 19:18:36.035642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.184 [2024-11-26 19:18:36.035804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.184 [2024-11-26 19:18:36.035822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.184 qpair failed and we were unable to recover it. 00:32:19.184 [2024-11-26 19:18:36.035987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.184 [2024-11-26 19:18:36.036154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.184 [2024-11-26 19:18:36.036172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.184 qpair failed and we were unable to recover it. 00:32:19.184 [2024-11-26 19:18:36.036330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.184 [2024-11-26 19:18:36.036426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.184 [2024-11-26 19:18:36.036443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.184 qpair failed and we were unable to recover it. 00:32:19.184 [2024-11-26 19:18:36.036549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.184 [2024-11-26 19:18:36.036772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.184 [2024-11-26 19:18:36.036790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.184 qpair failed and we were unable to recover it. 00:32:19.184 [2024-11-26 19:18:36.037066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.184 [2024-11-26 19:18:36.037229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.184 [2024-11-26 19:18:36.037245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.184 qpair failed and we were unable to recover it. 00:32:19.184 [2024-11-26 19:18:36.037400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.184 [2024-11-26 19:18:36.037705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.184 [2024-11-26 19:18:36.037737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.184 qpair failed and we were unable to recover it. 00:32:19.184 [2024-11-26 19:18:36.038014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.184 [2024-11-26 19:18:36.038206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.184 [2024-11-26 19:18:36.038239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.184 qpair failed and we were unable to recover it. 00:32:19.184 [2024-11-26 19:18:36.038371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.184 [2024-11-26 19:18:36.038608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.184 [2024-11-26 19:18:36.038640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.184 qpair failed and we were unable to recover it. 00:32:19.184 [2024-11-26 19:18:36.038795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.184 [2024-11-26 19:18:36.039024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.184 [2024-11-26 19:18:36.039058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.184 qpair failed and we were unable to recover it. 00:32:19.184 [2024-11-26 19:18:36.039262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.184 [2024-11-26 19:18:36.039511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.184 [2024-11-26 19:18:36.039543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.184 qpair failed and we were unable to recover it. 00:32:19.184 [2024-11-26 19:18:36.039760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.184 [2024-11-26 19:18:36.039963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.184 [2024-11-26 19:18:36.039996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.184 qpair failed and we were unable to recover it. 00:32:19.184 [2024-11-26 19:18:36.040199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.184 [2024-11-26 19:18:36.040472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.184 [2024-11-26 19:18:36.040504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.184 qpair failed and we were unable to recover it. 00:32:19.184 [2024-11-26 19:18:36.040750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.184 [2024-11-26 19:18:36.041003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.184 [2024-11-26 19:18:36.041035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.184 qpair failed and we were unable to recover it. 00:32:19.184 [2024-11-26 19:18:36.041259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.184 [2024-11-26 19:18:36.041534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.184 [2024-11-26 19:18:36.041566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.184 qpair failed and we were unable to recover it. 00:32:19.184 [2024-11-26 19:18:36.041770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.184 [2024-11-26 19:18:36.041977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.184 [2024-11-26 19:18:36.042013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.184 qpair failed and we were unable to recover it. 00:32:19.184 [2024-11-26 19:18:36.042193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.184 [2024-11-26 19:18:36.042395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.184 [2024-11-26 19:18:36.042429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.184 qpair failed and we were unable to recover it. 00:32:19.184 [2024-11-26 19:18:36.042642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.184 [2024-11-26 19:18:36.042835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.184 [2024-11-26 19:18:36.042867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.184 qpair failed and we were unable to recover it. 00:32:19.184 [2024-11-26 19:18:36.043143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.184 [2024-11-26 19:18:36.043385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.184 [2024-11-26 19:18:36.043419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.184 qpair failed and we were unable to recover it. 00:32:19.184 [2024-11-26 19:18:36.043545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.184 [2024-11-26 19:18:36.043792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.184 [2024-11-26 19:18:36.043827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.184 qpair failed and we were unable to recover it. 00:32:19.184 [2024-11-26 19:18:36.044025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.185 [2024-11-26 19:18:36.044308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.185 [2024-11-26 19:18:36.044341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.185 qpair failed and we were unable to recover it. 00:32:19.185 [2024-11-26 19:18:36.044525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.185 [2024-11-26 19:18:36.044780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.185 [2024-11-26 19:18:36.044812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.185 qpair failed and we were unable to recover it. 00:32:19.185 [2024-11-26 19:18:36.045070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.185 [2024-11-26 19:18:36.045181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.185 [2024-11-26 19:18:36.045197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.185 qpair failed and we were unable to recover it. 00:32:19.185 [2024-11-26 19:18:36.045308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.185 [2024-11-26 19:18:36.045463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.185 [2024-11-26 19:18:36.045480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.185 qpair failed and we were unable to recover it. 00:32:19.185 [2024-11-26 19:18:36.045705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.185 [2024-11-26 19:18:36.045958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.185 [2024-11-26 19:18:36.045976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.185 qpair failed and we were unable to recover it. 00:32:19.185 [2024-11-26 19:18:36.046147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.185 [2024-11-26 19:18:36.046275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.185 [2024-11-26 19:18:36.046307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.185 qpair failed and we were unable to recover it. 00:32:19.185 [2024-11-26 19:18:36.046430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.185 [2024-11-26 19:18:36.046703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.185 [2024-11-26 19:18:36.046736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.185 qpair failed and we were unable to recover it. 00:32:19.185 [2024-11-26 19:18:36.046969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.185 [2024-11-26 19:18:36.047150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.185 [2024-11-26 19:18:36.047182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.185 qpair failed and we were unable to recover it. 00:32:19.185 [2024-11-26 19:18:36.047460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.185 [2024-11-26 19:18:36.047677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.185 [2024-11-26 19:18:36.047712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.185 qpair failed and we were unable to recover it. 00:32:19.185 [2024-11-26 19:18:36.047889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.185 [2024-11-26 19:18:36.048116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.185 [2024-11-26 19:18:36.048135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.185 qpair failed and we were unable to recover it. 00:32:19.185 [2024-11-26 19:18:36.048372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.185 [2024-11-26 19:18:36.048617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.185 [2024-11-26 19:18:36.048648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.185 qpair failed and we were unable to recover it. 00:32:19.185 [2024-11-26 19:18:36.048906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.185 [2024-11-26 19:18:36.049146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.185 [2024-11-26 19:18:36.049165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.185 qpair failed and we were unable to recover it. 00:32:19.185 [2024-11-26 19:18:36.049438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.185 [2024-11-26 19:18:36.049633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.185 [2024-11-26 19:18:36.049665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.185 qpair failed and we were unable to recover it. 00:32:19.185 [2024-11-26 19:18:36.049873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.185 [2024-11-26 19:18:36.050060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.185 [2024-11-26 19:18:36.050094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.185 qpair failed and we were unable to recover it. 00:32:19.185 [2024-11-26 19:18:36.050293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.185 [2024-11-26 19:18:36.050503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.185 [2024-11-26 19:18:36.050537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.185 qpair failed and we were unable to recover it. 00:32:19.185 [2024-11-26 19:18:36.050744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.185 [2024-11-26 19:18:36.050986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.185 [2024-11-26 19:18:36.051020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.185 qpair failed and we were unable to recover it. 00:32:19.185 [2024-11-26 19:18:36.051248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.185 [2024-11-26 19:18:36.051516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.185 [2024-11-26 19:18:36.051533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.185 qpair failed and we were unable to recover it. 00:32:19.185 [2024-11-26 19:18:36.051704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.185 [2024-11-26 19:18:36.051910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.185 [2024-11-26 19:18:36.051943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.185 qpair failed and we were unable to recover it. 00:32:19.185 [2024-11-26 19:18:36.052208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.185 [2024-11-26 19:18:36.052509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.185 [2024-11-26 19:18:36.052541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.185 qpair failed and we were unable to recover it. 00:32:19.185 [2024-11-26 19:18:36.052796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.185 [2024-11-26 19:18:36.053005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.185 [2024-11-26 19:18:36.053040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.185 qpair failed and we were unable to recover it. 00:32:19.185 [2024-11-26 19:18:36.053184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.185 [2024-11-26 19:18:36.053435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.185 [2024-11-26 19:18:36.053468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.185 qpair failed and we were unable to recover it. 00:32:19.185 [2024-11-26 19:18:36.053777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.185 [2024-11-26 19:18:36.054066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.185 [2024-11-26 19:18:36.054101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.185 qpair failed and we were unable to recover it. 00:32:19.185 [2024-11-26 19:18:36.054288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.185 [2024-11-26 19:18:36.054465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.185 [2024-11-26 19:18:36.054498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.186 qpair failed and we were unable to recover it. 00:32:19.186 [2024-11-26 19:18:36.054691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.186 [2024-11-26 19:18:36.054885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.186 [2024-11-26 19:18:36.054917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.186 qpair failed and we were unable to recover it. 00:32:19.186 [2024-11-26 19:18:36.055136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.186 [2024-11-26 19:18:36.055327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.186 [2024-11-26 19:18:36.055360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.186 qpair failed and we were unable to recover it. 00:32:19.186 [2024-11-26 19:18:36.055559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.186 [2024-11-26 19:18:36.055761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.186 [2024-11-26 19:18:36.055793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.186 qpair failed and we were unable to recover it. 00:32:19.186 [2024-11-26 19:18:36.056070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.186 [2024-11-26 19:18:36.056209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.186 [2024-11-26 19:18:36.056248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.186 qpair failed and we were unable to recover it. 00:32:19.186 [2024-11-26 19:18:36.056392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.186 [2024-11-26 19:18:36.056575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.186 [2024-11-26 19:18:36.056608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.186 qpair failed and we were unable to recover it. 00:32:19.186 [2024-11-26 19:18:36.056809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.186 [2024-11-26 19:18:36.057030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.186 [2024-11-26 19:18:36.057049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.186 qpair failed and we were unable to recover it. 00:32:19.186 [2024-11-26 19:18:36.057279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.186 [2024-11-26 19:18:36.057477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.186 [2024-11-26 19:18:36.057516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.186 qpair failed and we were unable to recover it. 00:32:19.186 [2024-11-26 19:18:36.057777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.186 [2024-11-26 19:18:36.058029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.186 [2024-11-26 19:18:36.058063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.186 qpair failed and we were unable to recover it. 00:32:19.186 [2024-11-26 19:18:36.058291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.186 [2024-11-26 19:18:36.058589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.186 [2024-11-26 19:18:36.058633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.186 qpair failed and we were unable to recover it. 00:32:19.186 [2024-11-26 19:18:36.058867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.186 [2024-11-26 19:18:36.059104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.186 [2024-11-26 19:18:36.059124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.186 qpair failed and we were unable to recover it. 00:32:19.186 [2024-11-26 19:18:36.059412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.186 [2024-11-26 19:18:36.059657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.186 [2024-11-26 19:18:36.059691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.186 qpair failed and we were unable to recover it. 00:32:19.186 [2024-11-26 19:18:36.059891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.186 [2024-11-26 19:18:36.060110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.186 [2024-11-26 19:18:36.060146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.186 qpair failed and we were unable to recover it. 00:32:19.186 [2024-11-26 19:18:36.060356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.186 [2024-11-26 19:18:36.060558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.186 [2024-11-26 19:18:36.060592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.186 qpair failed and we were unable to recover it. 00:32:19.186 [2024-11-26 19:18:36.060725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.186 [2024-11-26 19:18:36.060929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.186 [2024-11-26 19:18:36.060977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.186 qpair failed and we were unable to recover it. 00:32:19.186 [2024-11-26 19:18:36.061234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.186 [2024-11-26 19:18:36.061454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.186 [2024-11-26 19:18:36.061487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.186 qpair failed and we were unable to recover it. 00:32:19.186 [2024-11-26 19:18:36.061773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.186 [2024-11-26 19:18:36.061936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.186 [2024-11-26 19:18:36.061985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.186 qpair failed and we were unable to recover it. 00:32:19.186 [2024-11-26 19:18:36.062294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.186 [2024-11-26 19:18:36.062476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.186 [2024-11-26 19:18:36.062510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.186 qpair failed and we were unable to recover it. 00:32:19.186 [2024-11-26 19:18:36.062645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.186 [2024-11-26 19:18:36.062849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.186 [2024-11-26 19:18:36.062885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.186 qpair failed and we were unable to recover it. 00:32:19.186 [2024-11-26 19:18:36.063180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.186 [2024-11-26 19:18:36.063310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.186 [2024-11-26 19:18:36.063346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.186 qpair failed and we were unable to recover it. 00:32:19.186 [2024-11-26 19:18:36.063563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.186 [2024-11-26 19:18:36.063822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.186 [2024-11-26 19:18:36.063856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.186 qpair failed and we were unable to recover it. 00:32:19.186 [2024-11-26 19:18:36.064073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.186 [2024-11-26 19:18:36.064277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.186 [2024-11-26 19:18:36.064310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.186 qpair failed and we were unable to recover it. 00:32:19.186 [2024-11-26 19:18:36.064525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.187 [2024-11-26 19:18:36.064804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.187 [2024-11-26 19:18:36.064838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.187 qpair failed and we were unable to recover it. 00:32:19.187 [2024-11-26 19:18:36.065046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.187 [2024-11-26 19:18:36.065291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.187 [2024-11-26 19:18:36.065323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.187 qpair failed and we were unable to recover it. 00:32:19.187 [2024-11-26 19:18:36.065521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.187 [2024-11-26 19:18:36.065734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.187 [2024-11-26 19:18:36.065773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.187 qpair failed and we were unable to recover it. 00:32:19.187 [2024-11-26 19:18:36.066035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.187 [2024-11-26 19:18:36.066236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.187 [2024-11-26 19:18:36.066254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.187 qpair failed and we were unable to recover it. 00:32:19.187 [2024-11-26 19:18:36.066472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.187 [2024-11-26 19:18:36.066622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.187 [2024-11-26 19:18:36.066642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.187 qpair failed and we were unable to recover it. 00:32:19.187 [2024-11-26 19:18:36.066878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.187 [2024-11-26 19:18:36.067114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.187 [2024-11-26 19:18:36.067133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.187 qpair failed and we were unable to recover it. 00:32:19.187 [2024-11-26 19:18:36.067285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.187 [2024-11-26 19:18:36.067493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.187 [2024-11-26 19:18:36.067511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.187 qpair failed and we were unable to recover it. 00:32:19.187 [2024-11-26 19:18:36.067747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.187 [2024-11-26 19:18:36.067922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.187 [2024-11-26 19:18:36.067942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.187 qpair failed and we were unable to recover it. 00:32:19.187 [2024-11-26 19:18:36.068133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.187 [2024-11-26 19:18:36.068411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.187 [2024-11-26 19:18:36.068445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.187 qpair failed and we were unable to recover it. 00:32:19.187 [2024-11-26 19:18:36.068729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.187 [2024-11-26 19:18:36.068939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.187 [2024-11-26 19:18:36.068965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.187 qpair failed and we were unable to recover it. 00:32:19.187 [2024-11-26 19:18:36.069185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.187 [2024-11-26 19:18:36.069290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.187 [2024-11-26 19:18:36.069308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.187 qpair failed and we were unable to recover it. 00:32:19.187 [2024-11-26 19:18:36.069576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.187 [2024-11-26 19:18:36.069792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.187 [2024-11-26 19:18:36.069811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.187 qpair failed and we were unable to recover it. 00:32:19.187 [2024-11-26 19:18:36.069986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.187 [2024-11-26 19:18:36.070084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.187 [2024-11-26 19:18:36.070102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.187 qpair failed and we were unable to recover it. 00:32:19.187 [2024-11-26 19:18:36.070236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.187 [2024-11-26 19:18:36.070511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.187 [2024-11-26 19:18:36.070543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.187 qpair failed and we were unable to recover it. 00:32:19.187 [2024-11-26 19:18:36.070692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.187 [2024-11-26 19:18:36.070963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.187 [2024-11-26 19:18:36.070984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.187 qpair failed and we were unable to recover it. 00:32:19.187 [2024-11-26 19:18:36.071172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.460 [2024-11-26 19:18:36.071385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.460 [2024-11-26 19:18:36.071402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.460 qpair failed and we were unable to recover it. 00:32:19.460 [2024-11-26 19:18:36.071634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.460 [2024-11-26 19:18:36.071748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.460 [2024-11-26 19:18:36.071767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.460 qpair failed and we were unable to recover it. 00:32:19.460 [2024-11-26 19:18:36.071987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.460 [2024-11-26 19:18:36.072162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.460 [2024-11-26 19:18:36.072180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.460 qpair failed and we were unable to recover it. 00:32:19.460 [2024-11-26 19:18:36.072259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.460 [2024-11-26 19:18:36.072366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.460 [2024-11-26 19:18:36.072383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.460 qpair failed and we were unable to recover it. 00:32:19.460 [2024-11-26 19:18:36.072548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.460 [2024-11-26 19:18:36.072733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.460 [2024-11-26 19:18:36.072750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.460 qpair failed and we were unable to recover it. 00:32:19.460 [2024-11-26 19:18:36.072849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.460 [2024-11-26 19:18:36.072958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.460 [2024-11-26 19:18:36.072976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.460 qpair failed and we were unable to recover it. 00:32:19.460 [2024-11-26 19:18:36.073125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.460 [2024-11-26 19:18:36.073367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.460 [2024-11-26 19:18:36.073387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.460 qpair failed and we were unable to recover it. 00:32:19.460 [2024-11-26 19:18:36.073628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.460 [2024-11-26 19:18:36.073805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.460 [2024-11-26 19:18:36.073823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.460 qpair failed and we were unable to recover it. 00:32:19.460 [2024-11-26 19:18:36.073977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.460 [2024-11-26 19:18:36.074144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.460 [2024-11-26 19:18:36.074161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.460 qpair failed and we were unable to recover it. 00:32:19.460 [2024-11-26 19:18:36.074276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.460 [2024-11-26 19:18:36.074471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.460 [2024-11-26 19:18:36.074511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.460 qpair failed and we were unable to recover it. 00:32:19.460 [2024-11-26 19:18:36.074754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.460 [2024-11-26 19:18:36.074932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.460 [2024-11-26 19:18:36.074956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.460 qpair failed and we were unable to recover it. 00:32:19.460 [2024-11-26 19:18:36.075202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.460 [2024-11-26 19:18:36.075305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.460 [2024-11-26 19:18:36.075323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.460 qpair failed and we were unable to recover it. 00:32:19.460 [2024-11-26 19:18:36.075559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.460 [2024-11-26 19:18:36.075808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.460 [2024-11-26 19:18:36.075840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.460 qpair failed and we were unable to recover it. 00:32:19.460 [2024-11-26 19:18:36.076059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.460 [2024-11-26 19:18:36.076340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.460 [2024-11-26 19:18:36.076374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.460 qpair failed and we were unable to recover it. 00:32:19.460 [2024-11-26 19:18:36.076559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.460 [2024-11-26 19:18:36.076780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.460 [2024-11-26 19:18:36.076814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.460 qpair failed and we were unable to recover it. 00:32:19.460 [2024-11-26 19:18:36.077089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.460 [2024-11-26 19:18:36.077314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.460 [2024-11-26 19:18:36.077348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.460 qpair failed and we were unable to recover it. 00:32:19.460 [2024-11-26 19:18:36.077613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.460 [2024-11-26 19:18:36.077864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.460 [2024-11-26 19:18:36.077899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.460 qpair failed and we were unable to recover it. 00:32:19.460 [2024-11-26 19:18:36.078129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.460 [2024-11-26 19:18:36.078320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.460 [2024-11-26 19:18:36.078355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.460 qpair failed and we were unable to recover it. 00:32:19.460 [2024-11-26 19:18:36.078634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.460 [2024-11-26 19:18:36.078887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.460 [2024-11-26 19:18:36.078922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.460 qpair failed and we were unable to recover it. 00:32:19.460 [2024-11-26 19:18:36.079134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.460 [2024-11-26 19:18:36.079412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.460 [2024-11-26 19:18:36.079446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.460 qpair failed and we were unable to recover it. 00:32:19.460 [2024-11-26 19:18:36.079596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.460 [2024-11-26 19:18:36.079791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.461 [2024-11-26 19:18:36.079805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.461 qpair failed and we were unable to recover it. 00:32:19.461 [2024-11-26 19:18:36.080045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.461 [2024-11-26 19:18:36.080159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.461 [2024-11-26 19:18:36.080194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.461 qpair failed and we were unable to recover it. 00:32:19.461 [2024-11-26 19:18:36.080423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.461 [2024-11-26 19:18:36.080612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.461 [2024-11-26 19:18:36.080640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.461 qpair failed and we were unable to recover it. 00:32:19.461 [2024-11-26 19:18:36.080926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.461 [2024-11-26 19:18:36.081196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.461 [2024-11-26 19:18:36.081228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.461 qpair failed and we were unable to recover it. 00:32:19.461 [2024-11-26 19:18:36.081419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.461 [2024-11-26 19:18:36.081615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.461 [2024-11-26 19:18:36.081644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.461 qpair failed and we were unable to recover it. 00:32:19.461 [2024-11-26 19:18:36.081901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.461 [2024-11-26 19:18:36.082114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.461 [2024-11-26 19:18:36.082145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.461 qpair failed and we were unable to recover it. 00:32:19.461 [2024-11-26 19:18:36.082340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.461 [2024-11-26 19:18:36.082611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.461 [2024-11-26 19:18:36.082641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.461 qpair failed and we were unable to recover it. 00:32:19.461 [2024-11-26 19:18:36.082896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.461 [2024-11-26 19:18:36.083132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.461 [2024-11-26 19:18:36.083165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.461 qpair failed and we were unable to recover it. 00:32:19.461 [2024-11-26 19:18:36.083438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.461 [2024-11-26 19:18:36.083627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.461 [2024-11-26 19:18:36.083668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.461 qpair failed and we were unable to recover it. 00:32:19.461 [2024-11-26 19:18:36.083834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.461 [2024-11-26 19:18:36.084026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.461 [2024-11-26 19:18:36.084060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.461 qpair failed and we were unable to recover it. 00:32:19.461 [2024-11-26 19:18:36.084320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.461 [2024-11-26 19:18:36.084510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.461 [2024-11-26 19:18:36.084540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.461 qpair failed and we were unable to recover it. 00:32:19.461 [2024-11-26 19:18:36.084745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.461 [2024-11-26 19:18:36.085022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.461 [2024-11-26 19:18:36.085055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.461 qpair failed and we were unable to recover it. 00:32:19.461 [2024-11-26 19:18:36.085299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.461 [2024-11-26 19:18:36.085549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.461 [2024-11-26 19:18:36.085582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.461 qpair failed and we were unable to recover it. 00:32:19.461 [2024-11-26 19:18:36.085710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.461 [2024-11-26 19:18:36.085918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.461 [2024-11-26 19:18:36.085961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.461 qpair failed and we were unable to recover it. 00:32:19.461 [2024-11-26 19:18:36.086103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.461 [2024-11-26 19:18:36.086288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.461 [2024-11-26 19:18:36.086322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.461 qpair failed and we were unable to recover it. 00:32:19.461 [2024-11-26 19:18:36.086640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.461 [2024-11-26 19:18:36.086913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.461 [2024-11-26 19:18:36.086959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.461 qpair failed and we were unable to recover it. 00:32:19.461 [2024-11-26 19:18:36.087184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.461 [2024-11-26 19:18:36.087370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.461 [2024-11-26 19:18:36.087403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.461 qpair failed and we were unable to recover it. 00:32:19.461 [2024-11-26 19:18:36.087659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.461 [2024-11-26 19:18:36.087986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.461 [2024-11-26 19:18:36.088021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.461 qpair failed and we were unable to recover it. 00:32:19.461 [2024-11-26 19:18:36.088240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.461 [2024-11-26 19:18:36.088367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.461 [2024-11-26 19:18:36.088399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.461 qpair failed and we were unable to recover it. 00:32:19.461 [2024-11-26 19:18:36.088606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.461 [2024-11-26 19:18:36.088895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.461 [2024-11-26 19:18:36.088912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.461 qpair failed and we were unable to recover it. 00:32:19.461 [2024-11-26 19:18:36.089069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.461 [2024-11-26 19:18:36.089221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.461 [2024-11-26 19:18:36.089237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.461 qpair failed and we were unable to recover it. 00:32:19.461 [2024-11-26 19:18:36.089389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.461 [2024-11-26 19:18:36.089544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.461 [2024-11-26 19:18:36.089563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.461 qpair failed and we were unable to recover it. 00:32:19.461 [2024-11-26 19:18:36.089786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.461 [2024-11-26 19:18:36.089984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.461 [2024-11-26 19:18:36.090019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.462 qpair failed and we were unable to recover it. 00:32:19.462 [2024-11-26 19:18:36.090224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.462 [2024-11-26 19:18:36.090409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.462 [2024-11-26 19:18:36.090443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.462 qpair failed and we were unable to recover it. 00:32:19.462 [2024-11-26 19:18:36.090629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.462 [2024-11-26 19:18:36.090840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.462 [2024-11-26 19:18:36.090876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.462 qpair failed and we were unable to recover it. 00:32:19.462 [2024-11-26 19:18:36.091071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.462 [2024-11-26 19:18:36.091249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.462 [2024-11-26 19:18:36.091282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.462 qpair failed and we were unable to recover it. 00:32:19.462 [2024-11-26 19:18:36.091537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.462 [2024-11-26 19:18:36.091825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.462 [2024-11-26 19:18:36.091858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.462 qpair failed and we were unable to recover it. 00:32:19.462 [2024-11-26 19:18:36.092006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.462 [2024-11-26 19:18:36.092234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.462 [2024-11-26 19:18:36.092269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.462 qpair failed and we were unable to recover it. 00:32:19.462 [2024-11-26 19:18:36.092465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.462 [2024-11-26 19:18:36.092651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.462 [2024-11-26 19:18:36.092685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.462 qpair failed and we were unable to recover it. 00:32:19.462 [2024-11-26 19:18:36.092884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.462 [2024-11-26 19:18:36.092997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.462 [2024-11-26 19:18:36.093033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.462 qpair failed and we were unable to recover it. 00:32:19.462 [2024-11-26 19:18:36.093239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.462 [2024-11-26 19:18:36.093447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.462 [2024-11-26 19:18:36.093480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.462 qpair failed and we were unable to recover it. 00:32:19.462 [2024-11-26 19:18:36.093684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.462 [2024-11-26 19:18:36.093930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.462 [2024-11-26 19:18:36.093975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.462 qpair failed and we were unable to recover it. 00:32:19.462 [2024-11-26 19:18:36.094291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.462 [2024-11-26 19:18:36.094514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.462 [2024-11-26 19:18:36.094547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.462 qpair failed and we were unable to recover it. 00:32:19.462 [2024-11-26 19:18:36.094804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.462 [2024-11-26 19:18:36.095038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.462 [2024-11-26 19:18:36.095057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.462 qpair failed and we were unable to recover it. 00:32:19.462 [2024-11-26 19:18:36.095159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.462 [2024-11-26 19:18:36.095339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.462 [2024-11-26 19:18:36.095371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.462 qpair failed and we were unable to recover it. 00:32:19.462 [2024-11-26 19:18:36.095655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.462 [2024-11-26 19:18:36.095794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.462 [2024-11-26 19:18:36.095830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.462 qpair failed and we were unable to recover it. 00:32:19.462 [2024-11-26 19:18:36.095963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.462 [2024-11-26 19:18:36.096203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.462 [2024-11-26 19:18:36.096223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.462 qpair failed and we were unable to recover it. 00:32:19.462 [2024-11-26 19:18:36.096481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.462 [2024-11-26 19:18:36.096761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.462 [2024-11-26 19:18:36.096795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.462 qpair failed and we were unable to recover it. 00:32:19.462 [2024-11-26 19:18:36.097075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.462 [2024-11-26 19:18:36.097276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.462 [2024-11-26 19:18:36.097311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.462 qpair failed and we were unable to recover it. 00:32:19.462 [2024-11-26 19:18:36.097518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.462 [2024-11-26 19:18:36.097714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.462 [2024-11-26 19:18:36.097747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.462 qpair failed and we were unable to recover it. 00:32:19.462 [2024-11-26 19:18:36.097899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.462 [2024-11-26 19:18:36.098144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.462 [2024-11-26 19:18:36.098163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.462 qpair failed and we were unable to recover it. 00:32:19.462 [2024-11-26 19:18:36.098426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.462 [2024-11-26 19:18:36.098615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.462 [2024-11-26 19:18:36.098667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.462 qpair failed and we were unable to recover it. 00:32:19.462 [2024-11-26 19:18:36.098893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.462 [2024-11-26 19:18:36.099036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.462 [2024-11-26 19:18:36.099071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.462 qpair failed and we were unable to recover it. 00:32:19.462 [2024-11-26 19:18:36.099191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.462 [2024-11-26 19:18:36.099374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.462 [2024-11-26 19:18:36.099408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.462 qpair failed and we were unable to recover it. 00:32:19.462 [2024-11-26 19:18:36.099659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.462 [2024-11-26 19:18:36.099906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.462 [2024-11-26 19:18:36.099939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.462 qpair failed and we were unable to recover it. 00:32:19.462 [2024-11-26 19:18:36.100198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.462 [2024-11-26 19:18:36.100385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.462 [2024-11-26 19:18:36.100419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.462 qpair failed and we were unable to recover it. 00:32:19.462 [2024-11-26 19:18:36.100675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.462 [2024-11-26 19:18:36.100859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.463 [2024-11-26 19:18:36.100895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.463 qpair failed and we were unable to recover it. 00:32:19.463 [2024-11-26 19:18:36.101120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.463 [2024-11-26 19:18:36.101366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.463 [2024-11-26 19:18:36.101384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.463 qpair failed and we were unable to recover it. 00:32:19.463 [2024-11-26 19:18:36.101549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.463 [2024-11-26 19:18:36.101718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.463 [2024-11-26 19:18:36.101736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.463 qpair failed and we were unable to recover it. 00:32:19.463 [2024-11-26 19:18:36.101854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.463 [2024-11-26 19:18:36.102016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.463 [2024-11-26 19:18:36.102034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.463 qpair failed and we were unable to recover it. 00:32:19.463 [2024-11-26 19:18:36.102204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.463 [2024-11-26 19:18:36.102365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.463 [2024-11-26 19:18:36.102382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.463 qpair failed and we were unable to recover it. 00:32:19.463 [2024-11-26 19:18:36.102601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.463 [2024-11-26 19:18:36.102691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.463 [2024-11-26 19:18:36.102710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.463 qpair failed and we were unable to recover it. 00:32:19.463 [2024-11-26 19:18:36.102938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.463 [2024-11-26 19:18:36.103121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.463 [2024-11-26 19:18:36.103160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.463 qpair failed and we were unable to recover it. 00:32:19.463 [2024-11-26 19:18:36.103374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.463 [2024-11-26 19:18:36.103627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.463 [2024-11-26 19:18:36.103660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.463 qpair failed and we were unable to recover it. 00:32:19.463 [2024-11-26 19:18:36.103961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.463 [2024-11-26 19:18:36.104206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.463 [2024-11-26 19:18:36.104223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.463 qpair failed and we were unable to recover it. 00:32:19.463 [2024-11-26 19:18:36.104394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.463 [2024-11-26 19:18:36.104592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.463 [2024-11-26 19:18:36.104626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.463 qpair failed and we were unable to recover it. 00:32:19.463 [2024-11-26 19:18:36.104849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.463 [2024-11-26 19:18:36.105058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.463 [2024-11-26 19:18:36.105095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.463 qpair failed and we were unable to recover it. 00:32:19.463 [2024-11-26 19:18:36.105363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.463 [2024-11-26 19:18:36.105581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.463 [2024-11-26 19:18:36.105617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.463 qpair failed and we were unable to recover it. 00:32:19.463 [2024-11-26 19:18:36.105911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.463 [2024-11-26 19:18:36.106038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.463 [2024-11-26 19:18:36.106057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.463 qpair failed and we were unable to recover it. 00:32:19.463 [2024-11-26 19:18:36.106285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.463 [2024-11-26 19:18:36.106373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.463 [2024-11-26 19:18:36.106390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.463 qpair failed and we were unable to recover it. 00:32:19.463 [2024-11-26 19:18:36.106613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.463 [2024-11-26 19:18:36.106833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.463 [2024-11-26 19:18:36.106851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.463 qpair failed and we were unable to recover it. 00:32:19.463 [2024-11-26 19:18:36.107049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.463 [2024-11-26 19:18:36.107158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.463 [2024-11-26 19:18:36.107175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.463 qpair failed and we were unable to recover it. 00:32:19.463 [2024-11-26 19:18:36.107346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.463 [2024-11-26 19:18:36.107475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.463 [2024-11-26 19:18:36.107514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.463 qpair failed and we were unable to recover it. 00:32:19.463 [2024-11-26 19:18:36.107700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.463 [2024-11-26 19:18:36.107930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.463 [2024-11-26 19:18:36.107973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.463 qpair failed and we were unable to recover it. 00:32:19.463 [2024-11-26 19:18:36.108242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.463 [2024-11-26 19:18:36.108515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.463 [2024-11-26 19:18:36.108532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.463 qpair failed and we were unable to recover it. 00:32:19.463 [2024-11-26 19:18:36.108708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.463 [2024-11-26 19:18:36.108916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.463 [2024-11-26 19:18:36.108962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.463 qpair failed and we were unable to recover it. 00:32:19.463 [2024-11-26 19:18:36.109101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.463 [2024-11-26 19:18:36.109376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.463 [2024-11-26 19:18:36.109411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.463 qpair failed and we were unable to recover it. 00:32:19.463 [2024-11-26 19:18:36.109633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.463 [2024-11-26 19:18:36.109833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.464 [2024-11-26 19:18:36.109850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.464 qpair failed and we were unable to recover it. 00:32:19.464 [2024-11-26 19:18:36.110099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.464 [2024-11-26 19:18:36.110310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.464 [2024-11-26 19:18:36.110343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.464 qpair failed and we were unable to recover it. 00:32:19.464 [2024-11-26 19:18:36.110529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.464 [2024-11-26 19:18:36.110799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.464 [2024-11-26 19:18:36.110816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.464 qpair failed and we were unable to recover it. 00:32:19.464 [2024-11-26 19:18:36.110974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.464 [2024-11-26 19:18:36.111248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.464 [2024-11-26 19:18:36.111281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.464 qpair failed and we were unable to recover it. 00:32:19.464 [2024-11-26 19:18:36.111518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.464 [2024-11-26 19:18:36.111713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.464 [2024-11-26 19:18:36.111746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.464 qpair failed and we were unable to recover it. 00:32:19.464 [2024-11-26 19:18:36.111942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.464 [2024-11-26 19:18:36.112201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.464 [2024-11-26 19:18:36.112219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.464 qpair failed and we were unable to recover it. 00:32:19.464 [2024-11-26 19:18:36.112398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.464 [2024-11-26 19:18:36.112539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.464 [2024-11-26 19:18:36.112572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.464 qpair failed and we were unable to recover it. 00:32:19.464 [2024-11-26 19:18:36.112712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.464 [2024-11-26 19:18:36.112985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.464 [2024-11-26 19:18:36.113020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.464 qpair failed and we were unable to recover it. 00:32:19.464 [2024-11-26 19:18:36.113228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.464 [2024-11-26 19:18:36.113361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.464 [2024-11-26 19:18:36.113396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.464 qpair failed and we were unable to recover it. 00:32:19.464 [2024-11-26 19:18:36.113676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.464 [2024-11-26 19:18:36.113930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.464 [2024-11-26 19:18:36.113988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.464 qpair failed and we were unable to recover it. 00:32:19.464 [2024-11-26 19:18:36.114161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.464 [2024-11-26 19:18:36.114418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.464 [2024-11-26 19:18:36.114437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.464 qpair failed and we were unable to recover it. 00:32:19.464 [2024-11-26 19:18:36.114550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.464 [2024-11-26 19:18:36.114664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.464 [2024-11-26 19:18:36.114684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.464 qpair failed and we were unable to recover it. 00:32:19.464 [2024-11-26 19:18:36.114865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.464 [2024-11-26 19:18:36.115144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.464 [2024-11-26 19:18:36.115181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.464 qpair failed and we were unable to recover it. 00:32:19.464 [2024-11-26 19:18:36.115477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.464 [2024-11-26 19:18:36.115684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.464 [2024-11-26 19:18:36.115717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.464 qpair failed and we were unable to recover it. 00:32:19.464 [2024-11-26 19:18:36.115902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.464 [2024-11-26 19:18:36.116159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.464 [2024-11-26 19:18:36.116195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.464 qpair failed and we were unable to recover it. 00:32:19.464 [2024-11-26 19:18:36.116518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.464 [2024-11-26 19:18:36.116651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.464 [2024-11-26 19:18:36.116684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.464 qpair failed and we were unable to recover it. 00:32:19.464 [2024-11-26 19:18:36.116944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.464 [2024-11-26 19:18:36.117105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.464 [2024-11-26 19:18:36.117140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.464 qpair failed and we were unable to recover it. 00:32:19.464 [2024-11-26 19:18:36.117327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.464 [2024-11-26 19:18:36.117610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.464 [2024-11-26 19:18:36.117644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.464 qpair failed and we were unable to recover it. 00:32:19.464 [2024-11-26 19:18:36.117893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.464 [2024-11-26 19:18:36.117986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.464 [2024-11-26 19:18:36.118005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.464 qpair failed and we were unable to recover it. 00:32:19.464 [2024-11-26 19:18:36.118180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.464 [2024-11-26 19:18:36.118326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.464 [2024-11-26 19:18:36.118344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.464 qpair failed and we were unable to recover it. 00:32:19.464 [2024-11-26 19:18:36.118511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.464 [2024-11-26 19:18:36.118608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.464 [2024-11-26 19:18:36.118627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.464 qpair failed and we were unable to recover it. 00:32:19.464 [2024-11-26 19:18:36.118788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.464 [2024-11-26 19:18:36.118889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.464 [2024-11-26 19:18:36.118907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.464 qpair failed and we were unable to recover it. 00:32:19.464 [2024-11-26 19:18:36.119155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.464 [2024-11-26 19:18:36.119276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.464 [2024-11-26 19:18:36.119294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.464 qpair failed and we were unable to recover it. 00:32:19.464 [2024-11-26 19:18:36.119449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.464 [2024-11-26 19:18:36.119532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.464 [2024-11-26 19:18:36.119548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.464 qpair failed and we were unable to recover it. 00:32:19.465 [2024-11-26 19:18:36.119724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.465 [2024-11-26 19:18:36.119828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.465 [2024-11-26 19:18:36.119871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.465 qpair failed and we were unable to recover it. 00:32:19.465 [2024-11-26 19:18:36.120151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.465 [2024-11-26 19:18:36.120331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.465 [2024-11-26 19:18:36.120363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.465 qpair failed and we were unable to recover it. 00:32:19.465 [2024-11-26 19:18:36.120668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.465 [2024-11-26 19:18:36.120859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.465 [2024-11-26 19:18:36.120893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.465 qpair failed and we were unable to recover it. 00:32:19.465 [2024-11-26 19:18:36.121093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.465 [2024-11-26 19:18:36.121284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.465 [2024-11-26 19:18:36.121317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.465 qpair failed and we were unable to recover it. 00:32:19.465 [2024-11-26 19:18:36.121516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.465 [2024-11-26 19:18:36.121817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.465 [2024-11-26 19:18:36.121852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.465 qpair failed and we were unable to recover it. 00:32:19.465 [2024-11-26 19:18:36.122133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.465 [2024-11-26 19:18:36.122370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.465 [2024-11-26 19:18:36.122403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.465 qpair failed and we were unable to recover it. 00:32:19.465 [2024-11-26 19:18:36.122592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.465 [2024-11-26 19:18:36.122804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.465 [2024-11-26 19:18:36.122836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.465 qpair failed and we were unable to recover it. 00:32:19.465 [2024-11-26 19:18:36.123093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.465 [2024-11-26 19:18:36.123289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.465 [2024-11-26 19:18:36.123328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.465 qpair failed and we were unable to recover it. 00:32:19.465 [2024-11-26 19:18:36.123534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.465 [2024-11-26 19:18:36.123738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.465 [2024-11-26 19:18:36.123771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.465 qpair failed and we were unable to recover it. 00:32:19.465 [2024-11-26 19:18:36.124045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.465 [2024-11-26 19:18:36.124238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.465 [2024-11-26 19:18:36.124272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.465 qpair failed and we were unable to recover it. 00:32:19.465 [2024-11-26 19:18:36.124488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.465 [2024-11-26 19:18:36.124762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.465 [2024-11-26 19:18:36.124796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.465 qpair failed and we were unable to recover it. 00:32:19.465 [2024-11-26 19:18:36.124994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.465 [2024-11-26 19:18:36.125156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.465 [2024-11-26 19:18:36.125173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.465 qpair failed and we were unable to recover it. 00:32:19.465 [2024-11-26 19:18:36.125340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.465 [2024-11-26 19:18:36.125549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.465 [2024-11-26 19:18:36.125582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.465 qpair failed and we were unable to recover it. 00:32:19.465 [2024-11-26 19:18:36.125723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.465 [2024-11-26 19:18:36.125906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.465 [2024-11-26 19:18:36.125939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.465 qpair failed and we were unable to recover it. 00:32:19.465 [2024-11-26 19:18:36.126086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.465 [2024-11-26 19:18:36.126258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.465 [2024-11-26 19:18:36.126276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.465 qpair failed and we were unable to recover it. 00:32:19.465 [2024-11-26 19:18:36.126443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.465 [2024-11-26 19:18:36.126621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.465 [2024-11-26 19:18:36.126654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.465 qpair failed and we were unable to recover it. 00:32:19.465 [2024-11-26 19:18:36.126797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.465 [2024-11-26 19:18:36.127050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.465 [2024-11-26 19:18:36.127086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.465 qpair failed and we were unable to recover it. 00:32:19.465 [2024-11-26 19:18:36.127342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.465 [2024-11-26 19:18:36.127548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.465 [2024-11-26 19:18:36.127581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.465 qpair failed and we were unable to recover it. 00:32:19.465 [2024-11-26 19:18:36.127877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.465 [2024-11-26 19:18:36.128054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.465 [2024-11-26 19:18:36.128072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.465 qpair failed and we were unable to recover it. 00:32:19.465 [2024-11-26 19:18:36.128247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.465 [2024-11-26 19:18:36.128501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.465 [2024-11-26 19:18:36.128534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.465 qpair failed and we were unable to recover it. 00:32:19.466 [2024-11-26 19:18:36.128805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.466 [2024-11-26 19:18:36.128934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.466 [2024-11-26 19:18:36.128979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.466 qpair failed and we were unable to recover it. 00:32:19.466 [2024-11-26 19:18:36.129214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.466 [2024-11-26 19:18:36.129489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.466 [2024-11-26 19:18:36.129523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.466 qpair failed and we were unable to recover it. 00:32:19.466 [2024-11-26 19:18:36.129720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.466 [2024-11-26 19:18:36.129898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.466 [2024-11-26 19:18:36.129940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.466 qpair failed and we were unable to recover it. 00:32:19.466 [2024-11-26 19:18:36.130230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.466 [2024-11-26 19:18:36.130489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.466 [2024-11-26 19:18:36.130524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.466 qpair failed and we were unable to recover it. 00:32:19.466 [2024-11-26 19:18:36.130718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.466 [2024-11-26 19:18:36.130972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.466 [2024-11-26 19:18:36.131008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.466 qpair failed and we were unable to recover it. 00:32:19.466 [2024-11-26 19:18:36.131289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.466 [2024-11-26 19:18:36.131486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.466 [2024-11-26 19:18:36.131518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.466 qpair failed and we were unable to recover it. 00:32:19.466 [2024-11-26 19:18:36.131818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.466 [2024-11-26 19:18:36.132105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.466 [2024-11-26 19:18:36.132125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.466 qpair failed and we were unable to recover it. 00:32:19.466 [2024-11-26 19:18:36.132292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.466 [2024-11-26 19:18:36.132568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.466 [2024-11-26 19:18:36.132604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.466 qpair failed and we were unable to recover it. 00:32:19.466 [2024-11-26 19:18:36.132791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.466 [2024-11-26 19:18:36.132993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.466 [2024-11-26 19:18:36.133013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.466 qpair failed and we were unable to recover it. 00:32:19.466 [2024-11-26 19:18:36.133256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.466 [2024-11-26 19:18:36.133504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.466 [2024-11-26 19:18:36.133538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.466 qpair failed and we were unable to recover it. 00:32:19.466 [2024-11-26 19:18:36.133793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.466 [2024-11-26 19:18:36.134041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.466 [2024-11-26 19:18:36.134078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.466 qpair failed and we were unable to recover it. 00:32:19.466 [2024-11-26 19:18:36.134286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.466 [2024-11-26 19:18:36.134560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.466 [2024-11-26 19:18:36.134594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.466 qpair failed and we were unable to recover it. 00:32:19.466 [2024-11-26 19:18:36.134807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.466 [2024-11-26 19:18:36.135038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.466 [2024-11-26 19:18:36.135074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.466 qpair failed and we were unable to recover it. 00:32:19.466 [2024-11-26 19:18:36.135276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.466 [2024-11-26 19:18:36.135575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.466 [2024-11-26 19:18:36.135608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.466 qpair failed and we were unable to recover it. 00:32:19.466 [2024-11-26 19:18:36.135746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.466 [2024-11-26 19:18:36.135968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.466 [2024-11-26 19:18:36.136002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.466 qpair failed and we were unable to recover it. 00:32:19.466 [2024-11-26 19:18:36.136215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.466 [2024-11-26 19:18:36.136398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.466 [2024-11-26 19:18:36.136431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.466 qpair failed and we were unable to recover it. 00:32:19.466 [2024-11-26 19:18:36.136695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.466 [2024-11-26 19:18:36.136904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.466 [2024-11-26 19:18:36.136939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.466 qpair failed and we were unable to recover it. 00:32:19.466 [2024-11-26 19:18:36.137148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.466 [2024-11-26 19:18:36.137326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.466 [2024-11-26 19:18:36.137345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.466 qpair failed and we were unable to recover it. 00:32:19.466 [2024-11-26 19:18:36.137496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.466 [2024-11-26 19:18:36.137644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.466 [2024-11-26 19:18:36.137662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.466 qpair failed and we were unable to recover it. 00:32:19.466 [2024-11-26 19:18:36.137811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.466 [2024-11-26 19:18:36.138063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.466 [2024-11-26 19:18:36.138099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.466 qpair failed and we were unable to recover it. 00:32:19.466 [2024-11-26 19:18:36.138319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.466 [2024-11-26 19:18:36.138573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.466 [2024-11-26 19:18:36.138607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.466 qpair failed and we were unable to recover it. 00:32:19.466 [2024-11-26 19:18:36.138867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.466 [2024-11-26 19:18:36.139109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.466 [2024-11-26 19:18:36.139129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.466 qpair failed and we were unable to recover it. 00:32:19.466 [2024-11-26 19:18:36.139299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.466 [2024-11-26 19:18:36.139472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.466 [2024-11-26 19:18:36.139506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.466 qpair failed and we were unable to recover it. 00:32:19.466 [2024-11-26 19:18:36.139701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.466 [2024-11-26 19:18:36.140004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.466 [2024-11-26 19:18:36.140040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.466 qpair failed and we were unable to recover it. 00:32:19.466 [2024-11-26 19:18:36.140311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.467 [2024-11-26 19:18:36.140599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.467 [2024-11-26 19:18:36.140631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.467 qpair failed and we were unable to recover it. 00:32:19.467 [2024-11-26 19:18:36.140938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.467 [2024-11-26 19:18:36.141225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.467 [2024-11-26 19:18:36.141259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.467 qpair failed and we were unable to recover it. 00:32:19.467 [2024-11-26 19:18:36.141396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.467 [2024-11-26 19:18:36.141614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.467 [2024-11-26 19:18:36.141648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.467 qpair failed and we were unable to recover it. 00:32:19.467 [2024-11-26 19:18:36.141830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.467 [2024-11-26 19:18:36.142016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.467 [2024-11-26 19:18:36.142034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.467 qpair failed and we were unable to recover it. 00:32:19.467 [2024-11-26 19:18:36.142188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.467 [2024-11-26 19:18:36.142344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.467 [2024-11-26 19:18:36.142362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.467 qpair failed and we were unable to recover it. 00:32:19.467 [2024-11-26 19:18:36.142560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.467 [2024-11-26 19:18:36.142833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.467 [2024-11-26 19:18:36.142868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.467 qpair failed and we were unable to recover it. 00:32:19.467 [2024-11-26 19:18:36.143078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.467 [2024-11-26 19:18:36.143168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.467 [2024-11-26 19:18:36.143185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.467 qpair failed and we were unable to recover it. 00:32:19.467 [2024-11-26 19:18:36.143416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.467 [2024-11-26 19:18:36.143615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.467 [2024-11-26 19:18:36.143648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.467 qpair failed and we were unable to recover it. 00:32:19.467 [2024-11-26 19:18:36.143845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.467 [2024-11-26 19:18:36.144032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.467 [2024-11-26 19:18:36.144067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.467 qpair failed and we were unable to recover it. 00:32:19.467 [2024-11-26 19:18:36.144283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.467 [2024-11-26 19:18:36.144567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.467 [2024-11-26 19:18:36.144599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.467 qpair failed and we were unable to recover it. 00:32:19.467 [2024-11-26 19:18:36.144866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.467 [2024-11-26 19:18:36.144979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.467 [2024-11-26 19:18:36.145014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.467 qpair failed and we were unable to recover it. 00:32:19.467 [2024-11-26 19:18:36.145315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.467 [2024-11-26 19:18:36.145518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.467 [2024-11-26 19:18:36.145553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.467 qpair failed and we were unable to recover it. 00:32:19.467 [2024-11-26 19:18:36.145831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.467 [2024-11-26 19:18:36.145957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.467 [2024-11-26 19:18:36.145992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.467 qpair failed and we were unable to recover it. 00:32:19.467 [2024-11-26 19:18:36.146271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.467 [2024-11-26 19:18:36.146470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.467 [2024-11-26 19:18:36.146503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.467 qpair failed and we were unable to recover it. 00:32:19.467 [2024-11-26 19:18:36.146757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.467 [2024-11-26 19:18:36.146941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.467 [2024-11-26 19:18:36.146994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.467 qpair failed and we were unable to recover it. 00:32:19.467 [2024-11-26 19:18:36.147090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.467 [2024-11-26 19:18:36.147179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.467 [2024-11-26 19:18:36.147197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.467 qpair failed and we were unable to recover it. 00:32:19.467 [2024-11-26 19:18:36.147418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.467 [2024-11-26 19:18:36.147584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.467 [2024-11-26 19:18:36.147601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.467 qpair failed and we were unable to recover it. 00:32:19.467 [2024-11-26 19:18:36.147786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.467 [2024-11-26 19:18:36.148014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.467 [2024-11-26 19:18:36.148053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.467 qpair failed and we were unable to recover it. 00:32:19.467 [2024-11-26 19:18:36.148305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.467 [2024-11-26 19:18:36.148518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.467 [2024-11-26 19:18:36.148551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.467 qpair failed and we were unable to recover it. 00:32:19.467 [2024-11-26 19:18:36.148829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.467 [2024-11-26 19:18:36.149098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.467 [2024-11-26 19:18:36.149117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.467 qpair failed and we were unable to recover it. 00:32:19.467 [2024-11-26 19:18:36.149344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.467 [2024-11-26 19:18:36.149432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.467 [2024-11-26 19:18:36.149449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.467 qpair failed and we were unable to recover it. 00:32:19.467 [2024-11-26 19:18:36.149696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.467 [2024-11-26 19:18:36.149896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.468 [2024-11-26 19:18:36.149929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.468 qpair failed and we were unable to recover it. 00:32:19.468 [2024-11-26 19:18:36.150139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.468 [2024-11-26 19:18:36.150332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.468 [2024-11-26 19:18:36.150365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.468 qpair failed and we were unable to recover it. 00:32:19.468 [2024-11-26 19:18:36.150505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.468 [2024-11-26 19:18:36.150690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.468 [2024-11-26 19:18:36.150726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.468 qpair failed and we were unable to recover it. 00:32:19.468 [2024-11-26 19:18:36.150925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.468 [2024-11-26 19:18:36.151115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.468 [2024-11-26 19:18:36.151149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.468 qpair failed and we were unable to recover it. 00:32:19.468 [2024-11-26 19:18:36.151405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.468 [2024-11-26 19:18:36.151701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.468 [2024-11-26 19:18:36.151734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.468 qpair failed and we were unable to recover it. 00:32:19.468 [2024-11-26 19:18:36.151998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.468 [2024-11-26 19:18:36.152216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.468 [2024-11-26 19:18:36.152248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.468 qpair failed and we were unable to recover it. 00:32:19.468 [2024-11-26 19:18:36.152509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.468 [2024-11-26 19:18:36.152770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.468 [2024-11-26 19:18:36.152804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.468 qpair failed and we were unable to recover it. 00:32:19.468 [2024-11-26 19:18:36.152924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.468 [2024-11-26 19:18:36.153136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.468 [2024-11-26 19:18:36.153170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.468 qpair failed and we were unable to recover it. 00:32:19.468 [2024-11-26 19:18:36.153427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.468 [2024-11-26 19:18:36.153638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.468 [2024-11-26 19:18:36.153677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.468 qpair failed and we were unable to recover it. 00:32:19.468 [2024-11-26 19:18:36.153973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.468 [2024-11-26 19:18:36.154227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.468 [2024-11-26 19:18:36.154260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.468 qpair failed and we were unable to recover it. 00:32:19.468 [2024-11-26 19:18:36.154504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.468 [2024-11-26 19:18:36.154699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.468 [2024-11-26 19:18:36.154732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.468 qpair failed and we were unable to recover it. 00:32:19.468 [2024-11-26 19:18:36.154938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.468 [2024-11-26 19:18:36.155132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.468 [2024-11-26 19:18:36.155165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.468 qpair failed and we were unable to recover it. 00:32:19.468 [2024-11-26 19:18:36.155302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.468 [2024-11-26 19:18:36.155575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.468 [2024-11-26 19:18:36.155608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.468 qpair failed and we were unable to recover it. 00:32:19.468 [2024-11-26 19:18:36.155882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.468 [2024-11-26 19:18:36.156126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.468 [2024-11-26 19:18:36.156144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.468 qpair failed and we were unable to recover it. 00:32:19.468 [2024-11-26 19:18:36.156395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.468 [2024-11-26 19:18:36.156548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.468 [2024-11-26 19:18:36.156580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.468 qpair failed and we were unable to recover it. 00:32:19.468 [2024-11-26 19:18:36.156875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.468 [2024-11-26 19:18:36.157091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.468 [2024-11-26 19:18:36.157125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.468 qpair failed and we were unable to recover it. 00:32:19.468 [2024-11-26 19:18:36.157431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.468 [2024-11-26 19:18:36.157577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.468 [2024-11-26 19:18:36.157610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.468 qpair failed and we were unable to recover it. 00:32:19.468 [2024-11-26 19:18:36.157744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.468 [2024-11-26 19:18:36.157924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.468 [2024-11-26 19:18:36.157977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.468 qpair failed and we were unable to recover it. 00:32:19.468 [2024-11-26 19:18:36.158219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.468 [2024-11-26 19:18:36.158457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.468 [2024-11-26 19:18:36.158475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.468 qpair failed and we were unable to recover it. 00:32:19.468 [2024-11-26 19:18:36.158701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.468 [2024-11-26 19:18:36.158889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.468 [2024-11-26 19:18:36.158907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.468 qpair failed and we were unable to recover it. 00:32:19.468 [2024-11-26 19:18:36.159057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.468 [2024-11-26 19:18:36.159328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.468 [2024-11-26 19:18:36.159374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.468 qpair failed and we were unable to recover it. 00:32:19.468 [2024-11-26 19:18:36.159657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.468 [2024-11-26 19:18:36.159802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.468 [2024-11-26 19:18:36.159836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.468 qpair failed and we were unable to recover it. 00:32:19.468 [2024-11-26 19:18:36.160089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.468 [2024-11-26 19:18:36.160256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.468 [2024-11-26 19:18:36.160273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.468 qpair failed and we were unable to recover it. 00:32:19.468 [2024-11-26 19:18:36.160516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.468 [2024-11-26 19:18:36.160766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.468 [2024-11-26 19:18:36.160798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.468 qpair failed and we were unable to recover it. 00:32:19.468 [2024-11-26 19:18:36.160958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.468 [2024-11-26 19:18:36.161234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.469 [2024-11-26 19:18:36.161268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.469 qpair failed and we were unable to recover it. 00:32:19.469 [2024-11-26 19:18:36.161537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.469 [2024-11-26 19:18:36.161772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.469 [2024-11-26 19:18:36.161804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.469 qpair failed and we were unable to recover it. 00:32:19.469 [2024-11-26 19:18:36.162069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.469 [2024-11-26 19:18:36.162322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.469 [2024-11-26 19:18:36.162355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.469 qpair failed and we were unable to recover it. 00:32:19.469 [2024-11-26 19:18:36.162567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.469 [2024-11-26 19:18:36.162676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.469 [2024-11-26 19:18:36.162709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.469 qpair failed and we were unable to recover it. 00:32:19.469 [2024-11-26 19:18:36.162985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.469 [2024-11-26 19:18:36.163258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.469 [2024-11-26 19:18:36.163291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.469 qpair failed and we were unable to recover it. 00:32:19.469 [2024-11-26 19:18:36.163601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.469 [2024-11-26 19:18:36.163885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.469 [2024-11-26 19:18:36.163924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.469 qpair failed and we were unable to recover it. 00:32:19.469 [2024-11-26 19:18:36.164154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.469 [2024-11-26 19:18:36.164414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.469 [2024-11-26 19:18:36.164447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.469 qpair failed and we were unable to recover it. 00:32:19.469 [2024-11-26 19:18:36.164706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.469 [2024-11-26 19:18:36.164974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.469 [2024-11-26 19:18:36.165009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.469 qpair failed and we were unable to recover it. 00:32:19.469 [2024-11-26 19:18:36.165291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.469 [2024-11-26 19:18:36.165566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.469 [2024-11-26 19:18:36.165599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.469 qpair failed and we were unable to recover it. 00:32:19.469 [2024-11-26 19:18:36.165806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.469 [2024-11-26 19:18:36.166083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.469 [2024-11-26 19:18:36.166117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.469 qpair failed and we were unable to recover it. 00:32:19.469 [2024-11-26 19:18:36.166301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.469 [2024-11-26 19:18:36.166549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.469 [2024-11-26 19:18:36.166583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.469 qpair failed and we were unable to recover it. 00:32:19.469 [2024-11-26 19:18:36.166861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.469 [2024-11-26 19:18:36.167110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.469 [2024-11-26 19:18:36.167127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.469 qpair failed and we were unable to recover it. 00:32:19.469 [2024-11-26 19:18:36.167228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.469 [2024-11-26 19:18:36.167464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.469 [2024-11-26 19:18:36.167481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.469 qpair failed and we were unable to recover it. 00:32:19.469 [2024-11-26 19:18:36.167657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.469 [2024-11-26 19:18:36.167809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.469 [2024-11-26 19:18:36.167842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.469 qpair failed and we were unable to recover it. 00:32:19.469 [2024-11-26 19:18:36.168129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.469 [2024-11-26 19:18:36.168323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.469 [2024-11-26 19:18:36.168355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.469 qpair failed and we were unable to recover it. 00:32:19.469 [2024-11-26 19:18:36.168554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.469 [2024-11-26 19:18:36.168824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.469 [2024-11-26 19:18:36.168856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.469 qpair failed and we were unable to recover it. 00:32:19.469 [2024-11-26 19:18:36.169157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.469 [2024-11-26 19:18:36.169460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.469 [2024-11-26 19:18:36.169494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.469 qpair failed and we were unable to recover it. 00:32:19.469 [2024-11-26 19:18:36.169698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.469 [2024-11-26 19:18:36.169901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.469 [2024-11-26 19:18:36.169941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.469 qpair failed and we were unable to recover it. 00:32:19.469 [2024-11-26 19:18:36.170176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.469 [2024-11-26 19:18:36.170391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.469 [2024-11-26 19:18:36.170409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.469 qpair failed and we were unable to recover it. 00:32:19.469 [2024-11-26 19:18:36.170656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.469 [2024-11-26 19:18:36.170842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.469 [2024-11-26 19:18:36.170860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.469 qpair failed and we were unable to recover it. 00:32:19.469 [2024-11-26 19:18:36.171033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.469 [2024-11-26 19:18:36.171265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.469 [2024-11-26 19:18:36.171298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.469 qpair failed and we were unable to recover it. 00:32:19.469 [2024-11-26 19:18:36.171569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.469 [2024-11-26 19:18:36.171841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.469 [2024-11-26 19:18:36.171874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.469 qpair failed and we were unable to recover it. 00:32:19.469 [2024-11-26 19:18:36.172139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.469 [2024-11-26 19:18:36.172345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.469 [2024-11-26 19:18:36.172379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.469 qpair failed and we were unable to recover it. 00:32:19.469 [2024-11-26 19:18:36.172585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.469 [2024-11-26 19:18:36.172719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.469 [2024-11-26 19:18:36.172737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.469 qpair failed and we were unable to recover it. 00:32:19.469 [2024-11-26 19:18:36.172969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.470 [2024-11-26 19:18:36.173088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.470 [2024-11-26 19:18:36.173121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.470 qpair failed and we were unable to recover it. 00:32:19.470 [2024-11-26 19:18:36.173349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.470 [2024-11-26 19:18:36.173576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.470 [2024-11-26 19:18:36.173610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.470 qpair failed and we were unable to recover it. 00:32:19.470 [2024-11-26 19:18:36.173839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.470 [2024-11-26 19:18:36.174099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.470 [2024-11-26 19:18:36.174135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.470 qpair failed and we were unable to recover it. 00:32:19.470 [2024-11-26 19:18:36.174467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.470 [2024-11-26 19:18:36.174609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.470 [2024-11-26 19:18:36.174642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.470 qpair failed and we were unable to recover it. 00:32:19.470 [2024-11-26 19:18:36.174858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.470 [2024-11-26 19:18:36.174979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.470 [2024-11-26 19:18:36.175013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.470 qpair failed and we were unable to recover it. 00:32:19.470 [2024-11-26 19:18:36.175208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.470 [2024-11-26 19:18:36.175391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.470 [2024-11-26 19:18:36.175423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.470 qpair failed and we were unable to recover it. 00:32:19.470 [2024-11-26 19:18:36.175699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.470 [2024-11-26 19:18:36.175886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.470 [2024-11-26 19:18:36.175920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.470 qpair failed and we were unable to recover it. 00:32:19.470 [2024-11-26 19:18:36.176219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.470 [2024-11-26 19:18:36.176498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.470 [2024-11-26 19:18:36.176533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.470 qpair failed and we were unable to recover it. 00:32:19.470 [2024-11-26 19:18:36.176787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.470 [2024-11-26 19:18:36.176912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.470 [2024-11-26 19:18:36.176946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.470 qpair failed and we were unable to recover it. 00:32:19.470 [2024-11-26 19:18:36.177221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.470 [2024-11-26 19:18:36.177389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.470 [2024-11-26 19:18:36.177407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.470 qpair failed and we were unable to recover it. 00:32:19.470 [2024-11-26 19:18:36.177681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.470 [2024-11-26 19:18:36.177925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.470 [2024-11-26 19:18:36.177970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.470 qpair failed and we were unable to recover it. 00:32:19.470 [2024-11-26 19:18:36.178258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.470 [2024-11-26 19:18:36.178482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.470 [2024-11-26 19:18:36.178522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.470 qpair failed and we were unable to recover it. 00:32:19.470 [2024-11-26 19:18:36.178672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.470 [2024-11-26 19:18:36.178925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.470 [2024-11-26 19:18:36.178969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.470 qpair failed and we were unable to recover it. 00:32:19.470 [2024-11-26 19:18:36.179153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.470 [2024-11-26 19:18:36.179388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.470 [2024-11-26 19:18:36.179421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.470 qpair failed and we were unable to recover it. 00:32:19.470 [2024-11-26 19:18:36.179631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.470 [2024-11-26 19:18:36.179828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.470 [2024-11-26 19:18:36.179861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.470 qpair failed and we were unable to recover it. 00:32:19.470 [2024-11-26 19:18:36.180135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.470 [2024-11-26 19:18:36.180408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.470 [2024-11-26 19:18:36.180441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.470 qpair failed and we were unable to recover it. 00:32:19.470 [2024-11-26 19:18:36.180727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.470 [2024-11-26 19:18:36.180926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.470 [2024-11-26 19:18:36.180969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.470 qpair failed and we were unable to recover it. 00:32:19.470 [2024-11-26 19:18:36.181231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.470 [2024-11-26 19:18:36.181514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.470 [2024-11-26 19:18:36.181547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.470 qpair failed and we were unable to recover it. 00:32:19.470 [2024-11-26 19:18:36.181805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.470 [2024-11-26 19:18:36.182012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.470 [2024-11-26 19:18:36.182045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.470 qpair failed and we were unable to recover it. 00:32:19.470 [2024-11-26 19:18:36.182341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.470 [2024-11-26 19:18:36.182589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.470 [2024-11-26 19:18:36.182607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.470 qpair failed and we were unable to recover it. 00:32:19.470 [2024-11-26 19:18:36.182837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.470 [2024-11-26 19:18:36.183068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.470 [2024-11-26 19:18:36.183103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.470 qpair failed and we were unable to recover it. 00:32:19.470 [2024-11-26 19:18:36.183308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.470 [2024-11-26 19:18:36.183567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.470 [2024-11-26 19:18:36.183607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.470 qpair failed and we were unable to recover it. 00:32:19.470 [2024-11-26 19:18:36.183892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.471 [2024-11-26 19:18:36.184106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.471 [2024-11-26 19:18:36.184126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.471 qpair failed and we were unable to recover it. 00:32:19.471 [2024-11-26 19:18:36.184397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.471 [2024-11-26 19:18:36.184598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.471 [2024-11-26 19:18:36.184629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.471 qpair failed and we were unable to recover it. 00:32:19.471 [2024-11-26 19:18:36.184839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.471 [2024-11-26 19:18:36.185033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.471 [2024-11-26 19:18:36.185069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.471 qpair failed and we were unable to recover it. 00:32:19.471 [2024-11-26 19:18:36.185368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.471 [2024-11-26 19:18:36.185662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.471 [2024-11-26 19:18:36.185696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.471 qpair failed and we were unable to recover it. 00:32:19.471 [2024-11-26 19:18:36.185917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.471 [2024-11-26 19:18:36.186151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.471 [2024-11-26 19:18:36.186185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.471 qpair failed and we were unable to recover it. 00:32:19.471 [2024-11-26 19:18:36.186394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.471 [2024-11-26 19:18:36.186666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.471 [2024-11-26 19:18:36.186708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.471 qpair failed and we were unable to recover it. 00:32:19.471 [2024-11-26 19:18:36.186814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.471 [2024-11-26 19:18:36.186997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.471 [2024-11-26 19:18:36.187033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.471 qpair failed and we were unable to recover it. 00:32:19.471 [2024-11-26 19:18:36.187227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.471 [2024-11-26 19:18:36.187428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.471 [2024-11-26 19:18:36.187462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.471 qpair failed and we were unable to recover it. 00:32:19.471 [2024-11-26 19:18:36.187720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.471 [2024-11-26 19:18:36.188004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.471 [2024-11-26 19:18:36.188040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.471 qpair failed and we were unable to recover it. 00:32:19.471 [2024-11-26 19:18:36.188222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.471 [2024-11-26 19:18:36.188386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.471 [2024-11-26 19:18:36.188405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.471 qpair failed and we were unable to recover it. 00:32:19.471 [2024-11-26 19:18:36.188562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.471 [2024-11-26 19:18:36.188708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.471 [2024-11-26 19:18:36.188725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.471 qpair failed and we were unable to recover it. 00:32:19.471 [2024-11-26 19:18:36.188956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.471 [2024-11-26 19:18:36.189176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.471 [2024-11-26 19:18:36.189193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.471 qpair failed and we were unable to recover it. 00:32:19.471 [2024-11-26 19:18:36.189429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.471 [2024-11-26 19:18:36.189606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.471 [2024-11-26 19:18:36.189623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.471 qpair failed and we were unable to recover it. 00:32:19.471 [2024-11-26 19:18:36.189843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.471 [2024-11-26 19:18:36.190069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.471 [2024-11-26 19:18:36.190105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.471 qpair failed and we were unable to recover it. 00:32:19.471 [2024-11-26 19:18:36.190380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.471 [2024-11-26 19:18:36.190646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.471 [2024-11-26 19:18:36.190679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.471 qpair failed and we were unable to recover it. 00:32:19.471 [2024-11-26 19:18:36.190945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.471 [2024-11-26 19:18:36.191225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.471 [2024-11-26 19:18:36.191259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.471 qpair failed and we were unable to recover it. 00:32:19.471 [2024-11-26 19:18:36.191456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.471 [2024-11-26 19:18:36.191732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.471 [2024-11-26 19:18:36.191767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.471 qpair failed and we were unable to recover it. 00:32:19.471 [2024-11-26 19:18:36.191987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.471 [2024-11-26 19:18:36.192247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.471 [2024-11-26 19:18:36.192282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.471 qpair failed and we were unable to recover it. 00:32:19.471 [2024-11-26 19:18:36.192565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.471 [2024-11-26 19:18:36.192819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.471 [2024-11-26 19:18:36.192852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.471 qpair failed and we were unable to recover it. 00:32:19.472 [2024-11-26 19:18:36.193088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.472 [2024-11-26 19:18:36.193358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.472 [2024-11-26 19:18:36.193391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.472 qpair failed and we were unable to recover it. 00:32:19.472 [2024-11-26 19:18:36.193601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.472 [2024-11-26 19:18:36.193806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.472 [2024-11-26 19:18:36.193826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.472 qpair failed and we were unable to recover it. 00:32:19.472 [2024-11-26 19:18:36.193994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.472 [2024-11-26 19:18:36.194189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.472 [2024-11-26 19:18:36.194225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.472 qpair failed and we were unable to recover it. 00:32:19.472 [2024-11-26 19:18:36.194412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.472 [2024-11-26 19:18:36.194633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.472 [2024-11-26 19:18:36.194665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.472 qpair failed and we were unable to recover it. 00:32:19.472 [2024-11-26 19:18:36.194932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.472 [2024-11-26 19:18:36.195120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.472 [2024-11-26 19:18:36.195154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.472 qpair failed and we were unable to recover it. 00:32:19.472 [2024-11-26 19:18:36.195381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.472 [2024-11-26 19:18:36.195573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.472 [2024-11-26 19:18:36.195606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.472 qpair failed and we were unable to recover it. 00:32:19.472 [2024-11-26 19:18:36.195835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.472 [2024-11-26 19:18:36.196114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.472 [2024-11-26 19:18:36.196151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.472 qpair failed and we were unable to recover it. 00:32:19.472 [2024-11-26 19:18:36.196283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.472 [2024-11-26 19:18:36.196527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.472 [2024-11-26 19:18:36.196560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.472 qpair failed and we were unable to recover it. 00:32:19.472 [2024-11-26 19:18:36.196826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.472 [2024-11-26 19:18:36.197078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.472 [2024-11-26 19:18:36.197112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.472 qpair failed and we were unable to recover it. 00:32:19.472 [2024-11-26 19:18:36.197373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.472 [2024-11-26 19:18:36.197567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.472 [2024-11-26 19:18:36.197602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.472 qpair failed and we were unable to recover it. 00:32:19.472 [2024-11-26 19:18:36.197858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.472 [2024-11-26 19:18:36.198137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.472 [2024-11-26 19:18:36.198173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.472 qpair failed and we were unable to recover it. 00:32:19.472 [2024-11-26 19:18:36.198417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.472 [2024-11-26 19:18:36.198681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.472 [2024-11-26 19:18:36.198714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.472 qpair failed and we were unable to recover it. 00:32:19.472 [2024-11-26 19:18:36.198872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.472 [2024-11-26 19:18:36.199013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.472 [2024-11-26 19:18:36.199031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.472 qpair failed and we were unable to recover it. 00:32:19.472 [2024-11-26 19:18:36.199261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.472 [2024-11-26 19:18:36.199539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.472 [2024-11-26 19:18:36.199572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.472 qpair failed and we were unable to recover it. 00:32:19.472 [2024-11-26 19:18:36.199802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.472 [2024-11-26 19:18:36.200060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.472 [2024-11-26 19:18:36.200095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.472 qpair failed and we were unable to recover it. 00:32:19.472 [2024-11-26 19:18:36.200240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.472 [2024-11-26 19:18:36.200351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.472 [2024-11-26 19:18:36.200386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.472 qpair failed and we were unable to recover it. 00:32:19.472 [2024-11-26 19:18:36.200665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.472 [2024-11-26 19:18:36.200797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.472 [2024-11-26 19:18:36.200828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.472 qpair failed and we were unable to recover it. 00:32:19.472 [2024-11-26 19:18:36.201021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.472 [2024-11-26 19:18:36.201300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.472 [2024-11-26 19:18:36.201332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.472 qpair failed and we were unable to recover it. 00:32:19.472 [2024-11-26 19:18:36.201613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.472 [2024-11-26 19:18:36.201891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.472 [2024-11-26 19:18:36.201923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.472 qpair failed and we were unable to recover it. 00:32:19.472 [2024-11-26 19:18:36.202191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.472 [2024-11-26 19:18:36.202478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.472 [2024-11-26 19:18:36.202514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.472 qpair failed and we were unable to recover it. 00:32:19.472 [2024-11-26 19:18:36.202658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.472 [2024-11-26 19:18:36.202944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.472 [2024-11-26 19:18:36.202993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.472 qpair failed and we were unable to recover it. 00:32:19.472 [2024-11-26 19:18:36.203124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.472 [2024-11-26 19:18:36.203283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.472 [2024-11-26 19:18:36.203300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.472 qpair failed and we were unable to recover it. 00:32:19.472 [2024-11-26 19:18:36.203542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.472 [2024-11-26 19:18:36.203686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.472 [2024-11-26 19:18:36.203702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.472 qpair failed and we were unable to recover it. 00:32:19.472 [2024-11-26 19:18:36.203956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.472 [2024-11-26 19:18:36.204180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.472 [2024-11-26 19:18:36.204212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.472 qpair failed and we were unable to recover it. 00:32:19.472 [2024-11-26 19:18:36.204418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.472 [2024-11-26 19:18:36.204614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.472 [2024-11-26 19:18:36.204649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.473 qpair failed and we were unable to recover it. 00:32:19.473 [2024-11-26 19:18:36.204795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.473 [2024-11-26 19:18:36.205054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.473 [2024-11-26 19:18:36.205088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.473 qpair failed and we were unable to recover it. 00:32:19.473 [2024-11-26 19:18:36.205210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.473 [2024-11-26 19:18:36.205380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.473 [2024-11-26 19:18:36.205399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.473 qpair failed and we were unable to recover it. 00:32:19.473 [2024-11-26 19:18:36.205584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.473 [2024-11-26 19:18:36.205828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.473 [2024-11-26 19:18:36.205862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.473 qpair failed and we were unable to recover it. 00:32:19.473 [2024-11-26 19:18:36.206050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.473 [2024-11-26 19:18:36.206255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.473 [2024-11-26 19:18:36.206289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.473 qpair failed and we were unable to recover it. 00:32:19.473 [2024-11-26 19:18:36.206507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.473 [2024-11-26 19:18:36.206782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.473 [2024-11-26 19:18:36.206814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.473 qpair failed and we were unable to recover it. 00:32:19.473 [2024-11-26 19:18:36.206975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.473 [2024-11-26 19:18:36.207134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.473 [2024-11-26 19:18:36.207152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.473 qpair failed and we were unable to recover it. 00:32:19.473 [2024-11-26 19:18:36.207340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.473 [2024-11-26 19:18:36.207575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.473 [2024-11-26 19:18:36.207615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.473 qpair failed and we were unable to recover it. 00:32:19.473 [2024-11-26 19:18:36.207868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.473 [2024-11-26 19:18:36.208131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.473 [2024-11-26 19:18:36.208165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.473 qpair failed and we were unable to recover it. 00:32:19.473 [2024-11-26 19:18:36.208396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.473 [2024-11-26 19:18:36.208621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.473 [2024-11-26 19:18:36.208654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.473 qpair failed and we were unable to recover it. 00:32:19.473 [2024-11-26 19:18:36.208843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.473 [2024-11-26 19:18:36.209091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.473 [2024-11-26 19:18:36.209129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.473 qpair failed and we were unable to recover it. 00:32:19.473 [2024-11-26 19:18:36.209385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.473 [2024-11-26 19:18:36.209577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.473 [2024-11-26 19:18:36.209612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.473 qpair failed and we were unable to recover it. 00:32:19.473 [2024-11-26 19:18:36.209915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.473 [2024-11-26 19:18:36.210087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.473 [2024-11-26 19:18:36.210107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.473 qpair failed and we were unable to recover it. 00:32:19.473 [2024-11-26 19:18:36.210281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.473 [2024-11-26 19:18:36.210536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.473 [2024-11-26 19:18:36.210570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.473 qpair failed and we were unable to recover it. 00:32:19.473 [2024-11-26 19:18:36.210752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.473 [2024-11-26 19:18:36.210973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.473 [2024-11-26 19:18:36.211009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.473 qpair failed and we were unable to recover it. 00:32:19.473 [2024-11-26 19:18:36.211269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.473 [2024-11-26 19:18:36.211448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.473 [2024-11-26 19:18:36.211482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.473 qpair failed and we were unable to recover it. 00:32:19.473 [2024-11-26 19:18:36.211759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.473 [2024-11-26 19:18:36.211975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.473 [2024-11-26 19:18:36.211993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.473 qpair failed and we were unable to recover it. 00:32:19.473 [2024-11-26 19:18:36.212173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.473 [2024-11-26 19:18:36.212336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.473 [2024-11-26 19:18:36.212367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.473 qpair failed and we were unable to recover it. 00:32:19.473 [2024-11-26 19:18:36.212574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.473 [2024-11-26 19:18:36.212776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.473 [2024-11-26 19:18:36.212810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.473 qpair failed and we were unable to recover it. 00:32:19.473 [2024-11-26 19:18:36.212997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.473 [2024-11-26 19:18:36.213190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.473 [2024-11-26 19:18:36.213223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.473 qpair failed and we were unable to recover it. 00:32:19.473 [2024-11-26 19:18:36.213433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.473 [2024-11-26 19:18:36.213723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.473 [2024-11-26 19:18:36.213757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.473 qpair failed and we were unable to recover it. 00:32:19.473 [2024-11-26 19:18:36.214026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.473 [2024-11-26 19:18:36.214225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.473 [2024-11-26 19:18:36.214242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.473 qpair failed and we were unable to recover it. 00:32:19.473 [2024-11-26 19:18:36.214462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.473 [2024-11-26 19:18:36.214687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.473 [2024-11-26 19:18:36.214722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.473 qpair failed and we were unable to recover it. 00:32:19.473 [2024-11-26 19:18:36.214906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.473 [2024-11-26 19:18:36.215167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.473 [2024-11-26 19:18:36.215213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.473 qpair failed and we were unable to recover it. 00:32:19.473 [2024-11-26 19:18:36.215328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.473 [2024-11-26 19:18:36.215577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.474 [2024-11-26 19:18:36.215610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.474 qpair failed and we were unable to recover it. 00:32:19.474 [2024-11-26 19:18:36.215836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.474 [2024-11-26 19:18:36.216097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.474 [2024-11-26 19:18:36.216130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.474 qpair failed and we were unable to recover it. 00:32:19.474 [2024-11-26 19:18:36.216336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.474 [2024-11-26 19:18:36.216539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.474 [2024-11-26 19:18:36.216573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.474 qpair failed and we were unable to recover it. 00:32:19.474 [2024-11-26 19:18:36.216768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.474 [2024-11-26 19:18:36.216970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.474 [2024-11-26 19:18:36.217005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.474 qpair failed and we were unable to recover it. 00:32:19.474 [2024-11-26 19:18:36.217123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.474 [2024-11-26 19:18:36.217396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.474 [2024-11-26 19:18:36.217429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.474 qpair failed and we were unable to recover it. 00:32:19.474 [2024-11-26 19:18:36.217706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.474 [2024-11-26 19:18:36.218036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.474 [2024-11-26 19:18:36.218053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.474 qpair failed and we were unable to recover it. 00:32:19.474 [2024-11-26 19:18:36.218310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.474 [2024-11-26 19:18:36.218498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.474 [2024-11-26 19:18:36.218532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.474 qpair failed and we were unable to recover it. 00:32:19.474 [2024-11-26 19:18:36.218657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.474 [2024-11-26 19:18:36.218862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.474 [2024-11-26 19:18:36.218896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.474 qpair failed and we were unable to recover it. 00:32:19.474 [2024-11-26 19:18:36.219113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.474 [2024-11-26 19:18:36.219245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.474 [2024-11-26 19:18:36.219278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.474 qpair failed and we were unable to recover it. 00:32:19.474 [2024-11-26 19:18:36.219575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.474 [2024-11-26 19:18:36.219785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.474 [2024-11-26 19:18:36.219819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.474 qpair failed and we were unable to recover it. 00:32:19.474 [2024-11-26 19:18:36.220017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.474 [2024-11-26 19:18:36.220293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.474 [2024-11-26 19:18:36.220327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.474 qpair failed and we were unable to recover it. 00:32:19.474 [2024-11-26 19:18:36.220516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.474 [2024-11-26 19:18:36.220699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.474 [2024-11-26 19:18:36.220734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.474 qpair failed and we were unable to recover it. 00:32:19.474 [2024-11-26 19:18:36.220974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.474 [2024-11-26 19:18:36.221183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.474 [2024-11-26 19:18:36.221200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.474 qpair failed and we were unable to recover it. 00:32:19.474 [2024-11-26 19:18:36.221391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.474 [2024-11-26 19:18:36.221645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.474 [2024-11-26 19:18:36.221677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.474 qpair failed and we were unable to recover it. 00:32:19.474 [2024-11-26 19:18:36.221884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.474 [2024-11-26 19:18:36.222155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.474 [2024-11-26 19:18:36.222189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.474 qpair failed and we were unable to recover it. 00:32:19.474 [2024-11-26 19:18:36.222469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.474 [2024-11-26 19:18:36.222592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.474 [2024-11-26 19:18:36.222624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.474 qpair failed and we were unable to recover it. 00:32:19.474 [2024-11-26 19:18:36.222900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.474 [2024-11-26 19:18:36.223155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.474 [2024-11-26 19:18:36.223172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.474 qpair failed and we were unable to recover it. 00:32:19.474 [2024-11-26 19:18:36.223370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.474 [2024-11-26 19:18:36.223621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.474 [2024-11-26 19:18:36.223655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.474 qpair failed and we were unable to recover it. 00:32:19.474 [2024-11-26 19:18:36.223885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.474 [2024-11-26 19:18:36.224089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.474 [2024-11-26 19:18:36.224125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.474 qpair failed and we were unable to recover it. 00:32:19.474 [2024-11-26 19:18:36.224293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.474 [2024-11-26 19:18:36.224448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.474 [2024-11-26 19:18:36.224481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.474 qpair failed and we were unable to recover it. 00:32:19.474 [2024-11-26 19:18:36.224769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.474 [2024-11-26 19:18:36.225062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.474 [2024-11-26 19:18:36.225098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.474 qpair failed and we were unable to recover it. 00:32:19.474 [2024-11-26 19:18:36.225399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.474 [2024-11-26 19:18:36.225602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.474 [2024-11-26 19:18:36.225635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.474 qpair failed and we were unable to recover it. 00:32:19.474 [2024-11-26 19:18:36.225892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.474 [2024-11-26 19:18:36.226109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.474 [2024-11-26 19:18:36.226126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.474 qpair failed and we were unable to recover it. 00:32:19.474 [2024-11-26 19:18:36.226301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.475 [2024-11-26 19:18:36.226501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.475 [2024-11-26 19:18:36.226534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.475 qpair failed and we were unable to recover it. 00:32:19.475 [2024-11-26 19:18:36.226737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.475 [2024-11-26 19:18:36.226962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.475 [2024-11-26 19:18:36.226998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.475 qpair failed and we were unable to recover it. 00:32:19.475 [2024-11-26 19:18:36.227177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.475 [2024-11-26 19:18:36.227288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.475 [2024-11-26 19:18:36.227305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.475 qpair failed and we were unable to recover it. 00:32:19.475 [2024-11-26 19:18:36.227470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.475 [2024-11-26 19:18:36.227589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.475 [2024-11-26 19:18:36.227622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.475 qpair failed and we were unable to recover it. 00:32:19.475 [2024-11-26 19:18:36.227748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.475 [2024-11-26 19:18:36.228028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.475 [2024-11-26 19:18:36.228063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.475 qpair failed and we were unable to recover it. 00:32:19.475 [2024-11-26 19:18:36.228255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.475 [2024-11-26 19:18:36.228484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.475 [2024-11-26 19:18:36.228517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.475 qpair failed and we were unable to recover it. 00:32:19.475 [2024-11-26 19:18:36.228799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.475 [2024-11-26 19:18:36.229078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.475 [2024-11-26 19:18:36.229112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.475 qpair failed and we were unable to recover it. 00:32:19.475 [2024-11-26 19:18:36.229313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.475 [2024-11-26 19:18:36.229520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.475 [2024-11-26 19:18:36.229552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.475 qpair failed and we were unable to recover it. 00:32:19.475 [2024-11-26 19:18:36.229747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.475 [2024-11-26 19:18:36.230008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.475 [2024-11-26 19:18:36.230042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.475 qpair failed and we were unable to recover it. 00:32:19.475 [2024-11-26 19:18:36.230273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.475 [2024-11-26 19:18:36.230471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.475 [2024-11-26 19:18:36.230504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.475 qpair failed and we were unable to recover it. 00:32:19.475 [2024-11-26 19:18:36.230759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.475 [2024-11-26 19:18:36.230976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.475 [2024-11-26 19:18:36.231009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.475 qpair failed and we were unable to recover it. 00:32:19.475 [2024-11-26 19:18:36.231261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.475 [2024-11-26 19:18:36.231488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.475 [2024-11-26 19:18:36.231528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.475 qpair failed and we were unable to recover it. 00:32:19.475 [2024-11-26 19:18:36.231755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.475 [2024-11-26 19:18:36.231894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.475 [2024-11-26 19:18:36.231927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.475 qpair failed and we were unable to recover it. 00:32:19.475 [2024-11-26 19:18:36.232137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.475 [2024-11-26 19:18:36.232296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.475 [2024-11-26 19:18:36.232329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.475 qpair failed and we were unable to recover it. 00:32:19.475 [2024-11-26 19:18:36.232583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.475 [2024-11-26 19:18:36.232776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.475 [2024-11-26 19:18:36.232809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.475 qpair failed and we were unable to recover it. 00:32:19.475 [2024-11-26 19:18:36.232920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.475 [2024-11-26 19:18:36.233167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.475 [2024-11-26 19:18:36.233185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.475 qpair failed and we were unable to recover it. 00:32:19.475 [2024-11-26 19:18:36.233285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.475 [2024-11-26 19:18:36.233473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.475 [2024-11-26 19:18:36.233505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.475 qpair failed and we were unable to recover it. 00:32:19.475 [2024-11-26 19:18:36.233802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.475 [2024-11-26 19:18:36.234009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.475 [2024-11-26 19:18:36.234059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.475 qpair failed and we were unable to recover it. 00:32:19.475 [2024-11-26 19:18:36.234293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.475 [2024-11-26 19:18:36.234534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.475 [2024-11-26 19:18:36.234552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.475 qpair failed and we were unable to recover it. 00:32:19.475 [2024-11-26 19:18:36.234717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.475 [2024-11-26 19:18:36.234883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.475 [2024-11-26 19:18:36.234901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.475 qpair failed and we were unable to recover it. 00:32:19.475 [2024-11-26 19:18:36.235007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.475 [2024-11-26 19:18:36.235178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.475 [2024-11-26 19:18:36.235210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.475 qpair failed and we were unable to recover it. 00:32:19.475 [2024-11-26 19:18:36.235480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.475 [2024-11-26 19:18:36.235662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.476 [2024-11-26 19:18:36.235694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.476 qpair failed and we were unable to recover it. 00:32:19.476 [2024-11-26 19:18:36.235967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.476 [2024-11-26 19:18:36.236271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.476 [2024-11-26 19:18:36.236303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.476 qpair failed and we were unable to recover it. 00:32:19.476 [2024-11-26 19:18:36.236586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.476 [2024-11-26 19:18:36.236799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.476 [2024-11-26 19:18:36.236833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.476 qpair failed and we were unable to recover it. 00:32:19.476 [2024-11-26 19:18:36.237058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.476 [2024-11-26 19:18:36.237244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.476 [2024-11-26 19:18:36.237289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.476 qpair failed and we were unable to recover it. 00:32:19.476 [2024-11-26 19:18:36.237578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.476 [2024-11-26 19:18:36.237852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.476 [2024-11-26 19:18:36.237885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.476 qpair failed and we were unable to recover it. 00:32:19.476 [2024-11-26 19:18:36.238104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.476 [2024-11-26 19:18:36.238366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.476 [2024-11-26 19:18:36.238384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.476 qpair failed and we were unable to recover it. 00:32:19.476 [2024-11-26 19:18:36.238629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.476 [2024-11-26 19:18:36.238873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.476 [2024-11-26 19:18:36.238891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.476 qpair failed and we were unable to recover it. 00:32:19.476 [2024-11-26 19:18:36.239041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.476 [2024-11-26 19:18:36.239207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.476 [2024-11-26 19:18:36.239249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.476 qpair failed and we were unable to recover it. 00:32:19.476 [2024-11-26 19:18:36.239454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.476 [2024-11-26 19:18:36.239702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.476 [2024-11-26 19:18:36.239735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.476 qpair failed and we were unable to recover it. 00:32:19.476 [2024-11-26 19:18:36.240040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.476 [2024-11-26 19:18:36.240243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.476 [2024-11-26 19:18:36.240275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.476 qpair failed and we were unable to recover it. 00:32:19.476 [2024-11-26 19:18:36.240551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.476 [2024-11-26 19:18:36.240832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.476 [2024-11-26 19:18:36.240864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.476 qpair failed and we were unable to recover it. 00:32:19.476 [2024-11-26 19:18:36.241077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.476 [2024-11-26 19:18:36.241284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.476 [2024-11-26 19:18:36.241317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.476 qpair failed and we were unable to recover it. 00:32:19.476 [2024-11-26 19:18:36.241595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.476 [2024-11-26 19:18:36.241796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.476 [2024-11-26 19:18:36.241828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.476 qpair failed and we were unable to recover it. 00:32:19.476 [2024-11-26 19:18:36.242014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.476 [2024-11-26 19:18:36.242194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.476 [2024-11-26 19:18:36.242226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.476 qpair failed and we were unable to recover it. 00:32:19.476 [2024-11-26 19:18:36.242500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.476 [2024-11-26 19:18:36.242797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.476 [2024-11-26 19:18:36.242831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.476 qpair failed and we were unable to recover it. 00:32:19.476 [2024-11-26 19:18:36.243107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.476 [2024-11-26 19:18:36.243320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.476 [2024-11-26 19:18:36.243353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.476 qpair failed and we were unable to recover it. 00:32:19.476 [2024-11-26 19:18:36.243576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.476 [2024-11-26 19:18:36.243791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.476 [2024-11-26 19:18:36.243833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.476 qpair failed and we were unable to recover it. 00:32:19.476 [2024-11-26 19:18:36.244011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.476 [2024-11-26 19:18:36.244246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.476 [2024-11-26 19:18:36.244280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.476 qpair failed and we were unable to recover it. 00:32:19.476 [2024-11-26 19:18:36.244532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.476 [2024-11-26 19:18:36.244790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.476 [2024-11-26 19:18:36.244822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.476 qpair failed and we were unable to recover it. 00:32:19.476 [2024-11-26 19:18:36.245011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.476 [2024-11-26 19:18:36.245311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.476 [2024-11-26 19:18:36.245343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.476 qpair failed and we were unable to recover it. 00:32:19.476 [2024-11-26 19:18:36.245620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.476 [2024-11-26 19:18:36.245824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.476 [2024-11-26 19:18:36.245856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.476 qpair failed and we were unable to recover it. 00:32:19.476 [2024-11-26 19:18:36.246136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.476 [2024-11-26 19:18:36.246244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.476 [2024-11-26 19:18:36.246260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.476 qpair failed and we were unable to recover it. 00:32:19.476 [2024-11-26 19:18:36.246408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.476 [2024-11-26 19:18:36.246500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.476 [2024-11-26 19:18:36.246516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.476 qpair failed and we were unable to recover it. 00:32:19.477 [2024-11-26 19:18:36.246614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.477 [2024-11-26 19:18:36.246777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.477 [2024-11-26 19:18:36.246794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.477 qpair failed and we were unable to recover it. 00:32:19.477 [2024-11-26 19:18:36.247015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.477 [2024-11-26 19:18:36.247230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.477 [2024-11-26 19:18:36.247247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.477 qpair failed and we were unable to recover it. 00:32:19.477 [2024-11-26 19:18:36.247418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.477 [2024-11-26 19:18:36.247646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.477 [2024-11-26 19:18:36.247680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.477 qpair failed and we were unable to recover it. 00:32:19.477 [2024-11-26 19:18:36.247911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.477 [2024-11-26 19:18:36.248190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.477 [2024-11-26 19:18:36.248225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.477 qpair failed and we were unable to recover it. 00:32:19.477 [2024-11-26 19:18:36.248525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.477 [2024-11-26 19:18:36.248796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.477 [2024-11-26 19:18:36.248830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.477 qpair failed and we were unable to recover it. 00:32:19.477 [2024-11-26 19:18:36.249090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.477 [2024-11-26 19:18:36.249348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.477 [2024-11-26 19:18:36.249380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.477 qpair failed and we were unable to recover it. 00:32:19.477 [2024-11-26 19:18:36.249657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.477 [2024-11-26 19:18:36.249938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.477 [2024-11-26 19:18:36.249982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.477 qpair failed and we were unable to recover it. 00:32:19.477 [2024-11-26 19:18:36.250190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.477 [2024-11-26 19:18:36.250375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.477 [2024-11-26 19:18:36.250409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.477 qpair failed and we were unable to recover it. 00:32:19.477 [2024-11-26 19:18:36.250608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.477 [2024-11-26 19:18:36.250848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.477 [2024-11-26 19:18:36.250881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.477 qpair failed and we were unable to recover it. 00:32:19.477 [2024-11-26 19:18:36.251157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.477 [2024-11-26 19:18:36.251344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.477 [2024-11-26 19:18:36.251378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.477 qpair failed and we were unable to recover it. 00:32:19.477 [2024-11-26 19:18:36.251679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.477 [2024-11-26 19:18:36.251876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.477 [2024-11-26 19:18:36.251909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.477 qpair failed and we were unable to recover it. 00:32:19.477 [2024-11-26 19:18:36.252196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.477 [2024-11-26 19:18:36.252470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.477 [2024-11-26 19:18:36.252503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.477 qpair failed and we were unable to recover it. 00:32:19.477 [2024-11-26 19:18:36.252685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.477 [2024-11-26 19:18:36.252881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.477 [2024-11-26 19:18:36.252915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.477 qpair failed and we were unable to recover it. 00:32:19.477 [2024-11-26 19:18:36.253143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.477 [2024-11-26 19:18:36.253425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.477 [2024-11-26 19:18:36.253458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.477 qpair failed and we were unable to recover it. 00:32:19.477 [2024-11-26 19:18:36.253580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.477 [2024-11-26 19:18:36.253851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.477 [2024-11-26 19:18:36.253884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.477 qpair failed and we were unable to recover it. 00:32:19.477 [2024-11-26 19:18:36.254021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.477 [2024-11-26 19:18:36.254277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.477 [2024-11-26 19:18:36.254310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.477 qpair failed and we were unable to recover it. 00:32:19.477 [2024-11-26 19:18:36.254512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.477 [2024-11-26 19:18:36.254692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.477 [2024-11-26 19:18:36.254725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.477 qpair failed and we were unable to recover it. 00:32:19.477 [2024-11-26 19:18:36.255003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.477 [2024-11-26 19:18:36.255261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.477 [2024-11-26 19:18:36.255294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.477 qpair failed and we were unable to recover it. 00:32:19.477 [2024-11-26 19:18:36.255549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.477 [2024-11-26 19:18:36.255810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.477 [2024-11-26 19:18:36.255849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.477 qpair failed and we were unable to recover it. 00:32:19.477 [2024-11-26 19:18:36.256105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.477 [2024-11-26 19:18:36.256340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.478 [2024-11-26 19:18:36.256373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.478 qpair failed and we were unable to recover it. 00:32:19.478 [2024-11-26 19:18:36.256653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.478 [2024-11-26 19:18:36.256928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.478 [2024-11-26 19:18:36.256970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.478 qpair failed and we were unable to recover it. 00:32:19.478 [2024-11-26 19:18:36.257279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.478 [2024-11-26 19:18:36.257555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.478 [2024-11-26 19:18:36.257588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.478 qpair failed and we were unable to recover it. 00:32:19.478 [2024-11-26 19:18:36.257810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.478 [2024-11-26 19:18:36.258060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.478 [2024-11-26 19:18:36.258094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.478 qpair failed and we were unable to recover it. 00:32:19.478 [2024-11-26 19:18:36.258406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.478 [2024-11-26 19:18:36.258684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.478 [2024-11-26 19:18:36.258716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.478 qpair failed and we were unable to recover it. 00:32:19.478 [2024-11-26 19:18:36.258928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.478 [2024-11-26 19:18:36.259076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.478 [2024-11-26 19:18:36.259094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.478 qpair failed and we were unable to recover it. 00:32:19.478 [2024-11-26 19:18:36.259256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.478 [2024-11-26 19:18:36.259460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.478 [2024-11-26 19:18:36.259491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.478 qpair failed and we were unable to recover it. 00:32:19.478 [2024-11-26 19:18:36.259771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.478 [2024-11-26 19:18:36.260031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.478 [2024-11-26 19:18:36.260050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.478 qpair failed and we were unable to recover it. 00:32:19.478 [2024-11-26 19:18:36.260284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.478 [2024-11-26 19:18:36.260452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.478 [2024-11-26 19:18:36.260470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.478 qpair failed and we were unable to recover it. 00:32:19.478 [2024-11-26 19:18:36.260698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.478 [2024-11-26 19:18:36.260891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.478 [2024-11-26 19:18:36.260925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.478 qpair failed and we were unable to recover it. 00:32:19.478 [2024-11-26 19:18:36.261170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.478 [2024-11-26 19:18:36.261371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.478 [2024-11-26 19:18:36.261404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.478 qpair failed and we were unable to recover it. 00:32:19.478 [2024-11-26 19:18:36.261683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.478 [2024-11-26 19:18:36.261864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.478 [2024-11-26 19:18:36.261911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.478 qpair failed and we were unable to recover it. 00:32:19.478 [2024-11-26 19:18:36.262064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.478 [2024-11-26 19:18:36.262269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.478 [2024-11-26 19:18:36.262302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.478 qpair failed and we were unable to recover it. 00:32:19.478 [2024-11-26 19:18:36.262509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.478 [2024-11-26 19:18:36.262784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.478 [2024-11-26 19:18:36.262818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.478 qpair failed and we were unable to recover it. 00:32:19.478 [2024-11-26 19:18:36.263029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.478 [2024-11-26 19:18:36.263299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.478 [2024-11-26 19:18:36.263331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.478 qpair failed and we were unable to recover it. 00:32:19.478 [2024-11-26 19:18:36.263601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.478 [2024-11-26 19:18:36.263784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.478 [2024-11-26 19:18:36.263817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.478 qpair failed and we were unable to recover it. 00:32:19.478 [2024-11-26 19:18:36.264114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.478 [2024-11-26 19:18:36.264399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.478 [2024-11-26 19:18:36.264432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.478 qpair failed and we were unable to recover it. 00:32:19.478 [2024-11-26 19:18:36.264673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.478 [2024-11-26 19:18:36.264852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.478 [2024-11-26 19:18:36.264887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.478 qpair failed and we were unable to recover it. 00:32:19.478 [2024-11-26 19:18:36.265155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.478 [2024-11-26 19:18:36.265310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.478 [2024-11-26 19:18:36.265342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.478 qpair failed and we were unable to recover it. 00:32:19.478 [2024-11-26 19:18:36.265604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.478 [2024-11-26 19:18:36.265882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.478 [2024-11-26 19:18:36.265915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.478 qpair failed and we were unable to recover it. 00:32:19.478 [2024-11-26 19:18:36.266234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.478 [2024-11-26 19:18:36.266521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.478 [2024-11-26 19:18:36.266554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.478 qpair failed and we were unable to recover it. 00:32:19.478 [2024-11-26 19:18:36.266768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.478 [2024-11-26 19:18:36.267044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.478 [2024-11-26 19:18:36.267079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.478 qpair failed and we were unable to recover it. 00:32:19.478 [2024-11-26 19:18:36.267270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.478 [2024-11-26 19:18:36.267461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.478 [2024-11-26 19:18:36.267494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.478 qpair failed and we were unable to recover it. 00:32:19.478 [2024-11-26 19:18:36.267629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.478 [2024-11-26 19:18:36.267872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.479 [2024-11-26 19:18:36.267890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.479 qpair failed and we were unable to recover it. 00:32:19.479 [2024-11-26 19:18:36.268123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.479 [2024-11-26 19:18:36.268378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.479 [2024-11-26 19:18:36.268410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.479 qpair failed and we were unable to recover it. 00:32:19.479 [2024-11-26 19:18:36.268619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.479 [2024-11-26 19:18:36.268891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.479 [2024-11-26 19:18:36.268924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.479 qpair failed and we were unable to recover it. 00:32:19.479 [2024-11-26 19:18:36.269149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.479 [2024-11-26 19:18:36.269365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.479 [2024-11-26 19:18:36.269398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.479 qpair failed and we were unable to recover it. 00:32:19.479 [2024-11-26 19:18:36.269651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.479 [2024-11-26 19:18:36.269828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.479 [2024-11-26 19:18:36.269863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.479 qpair failed and we were unable to recover it. 00:32:19.479 [2024-11-26 19:18:36.270060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.479 [2024-11-26 19:18:36.270240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.479 [2024-11-26 19:18:36.270274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.479 qpair failed and we were unable to recover it. 00:32:19.479 [2024-11-26 19:18:36.270482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.479 [2024-11-26 19:18:36.270684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.479 [2024-11-26 19:18:36.270715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.479 qpair failed and we were unable to recover it. 00:32:19.479 [2024-11-26 19:18:36.271003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.479 [2024-11-26 19:18:36.271301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.479 [2024-11-26 19:18:36.271342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.479 qpair failed and we were unable to recover it. 00:32:19.479 [2024-11-26 19:18:36.271573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.479 [2024-11-26 19:18:36.271661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.479 [2024-11-26 19:18:36.271679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.479 qpair failed and we were unable to recover it. 00:32:19.479 [2024-11-26 19:18:36.271778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.479 [2024-11-26 19:18:36.272055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.479 [2024-11-26 19:18:36.272091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.479 qpair failed and we were unable to recover it. 00:32:19.479 [2024-11-26 19:18:36.272292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.479 [2024-11-26 19:18:36.272418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.479 [2024-11-26 19:18:36.272452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.479 qpair failed and we were unable to recover it. 00:32:19.479 [2024-11-26 19:18:36.272665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.479 [2024-11-26 19:18:36.272808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.479 [2024-11-26 19:18:36.272841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.479 qpair failed and we were unable to recover it. 00:32:19.479 [2024-11-26 19:18:36.273044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.479 [2024-11-26 19:18:36.273234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.479 [2024-11-26 19:18:36.273250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.479 qpair failed and we were unable to recover it. 00:32:19.479 [2024-11-26 19:18:36.273516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.479 [2024-11-26 19:18:36.273728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.479 [2024-11-26 19:18:36.273763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.479 qpair failed and we were unable to recover it. 00:32:19.479 [2024-11-26 19:18:36.273977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.479 [2024-11-26 19:18:36.274199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.479 [2024-11-26 19:18:36.274231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.479 qpair failed and we were unable to recover it. 00:32:19.479 [2024-11-26 19:18:36.274428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.479 [2024-11-26 19:18:36.274700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.479 [2024-11-26 19:18:36.274732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.479 qpair failed and we were unable to recover it. 00:32:19.479 [2024-11-26 19:18:36.274932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.479 [2024-11-26 19:18:36.275121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.479 [2024-11-26 19:18:36.275139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.479 qpair failed and we were unable to recover it. 00:32:19.479 [2024-11-26 19:18:36.275292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.479 [2024-11-26 19:18:36.275441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.479 [2024-11-26 19:18:36.275459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.479 qpair failed and we were unable to recover it. 00:32:19.479 [2024-11-26 19:18:36.275605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.479 [2024-11-26 19:18:36.275827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.479 [2024-11-26 19:18:36.275860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.479 qpair failed and we were unable to recover it. 00:32:19.479 [2024-11-26 19:18:36.276060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.479 [2024-11-26 19:18:36.276190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.479 [2024-11-26 19:18:36.276222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.479 qpair failed and we were unable to recover it. 00:32:19.479 [2024-11-26 19:18:36.276500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.479 [2024-11-26 19:18:36.276783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.479 [2024-11-26 19:18:36.276816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.479 qpair failed and we were unable to recover it. 00:32:19.479 [2024-11-26 19:18:36.277021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.479 [2024-11-26 19:18:36.277224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.479 [2024-11-26 19:18:36.277256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.479 qpair failed and we were unable to recover it. 00:32:19.479 [2024-11-26 19:18:36.277526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.479 [2024-11-26 19:18:36.277685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.479 [2024-11-26 19:18:36.277718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.479 qpair failed and we were unable to recover it. 00:32:19.479 [2024-11-26 19:18:36.277998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.479 [2024-11-26 19:18:36.278192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.480 [2024-11-26 19:18:36.278223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.480 qpair failed and we were unable to recover it. 00:32:19.480 [2024-11-26 19:18:36.278474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.480 [2024-11-26 19:18:36.278657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.480 [2024-11-26 19:18:36.278689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.480 qpair failed and we were unable to recover it. 00:32:19.480 [2024-11-26 19:18:36.278945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.480 [2024-11-26 19:18:36.279257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.480 [2024-11-26 19:18:36.279289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.480 qpair failed and we were unable to recover it. 00:32:19.480 [2024-11-26 19:18:36.279563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.480 [2024-11-26 19:18:36.279883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.480 [2024-11-26 19:18:36.279915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.480 qpair failed and we were unable to recover it. 00:32:19.480 [2024-11-26 19:18:36.280119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.480 [2024-11-26 19:18:36.280394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.480 [2024-11-26 19:18:36.280433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.480 qpair failed and we were unable to recover it. 00:32:19.480 [2024-11-26 19:18:36.280689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.480 [2024-11-26 19:18:36.280894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.480 [2024-11-26 19:18:36.280927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.480 qpair failed and we were unable to recover it. 00:32:19.480 [2024-11-26 19:18:36.281144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.480 [2024-11-26 19:18:36.281333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.480 [2024-11-26 19:18:36.281366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.480 qpair failed and we were unable to recover it. 00:32:19.480 [2024-11-26 19:18:36.281553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.480 [2024-11-26 19:18:36.281816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.480 [2024-11-26 19:18:36.281849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.480 qpair failed and we were unable to recover it. 00:32:19.480 [2024-11-26 19:18:36.282105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.480 [2024-11-26 19:18:36.282324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.480 [2024-11-26 19:18:36.282341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.480 qpair failed and we were unable to recover it. 00:32:19.480 [2024-11-26 19:18:36.282523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.480 [2024-11-26 19:18:36.282715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.480 [2024-11-26 19:18:36.282747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.480 qpair failed and we were unable to recover it. 00:32:19.480 [2024-11-26 19:18:36.283026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.480 [2024-11-26 19:18:36.283229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.480 [2024-11-26 19:18:36.283263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.480 qpair failed and we were unable to recover it. 00:32:19.480 [2024-11-26 19:18:36.283473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.480 [2024-11-26 19:18:36.283670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.480 [2024-11-26 19:18:36.283703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.480 qpair failed and we were unable to recover it. 00:32:19.480 [2024-11-26 19:18:36.283903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.480 [2024-11-26 19:18:36.284094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.480 [2024-11-26 19:18:36.284127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.480 qpair failed and we were unable to recover it. 00:32:19.480 [2024-11-26 19:18:36.284324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.480 [2024-11-26 19:18:36.284594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.480 [2024-11-26 19:18:36.284626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.480 qpair failed and we were unable to recover it. 00:32:19.480 [2024-11-26 19:18:36.284816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.480 [2024-11-26 19:18:36.285069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.480 [2024-11-26 19:18:36.285108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.480 qpair failed and we were unable to recover it. 00:32:19.480 [2024-11-26 19:18:36.285363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.480 [2024-11-26 19:18:36.285455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.480 [2024-11-26 19:18:36.285473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.480 qpair failed and we were unable to recover it. 00:32:19.480 [2024-11-26 19:18:36.285652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.480 [2024-11-26 19:18:36.285855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.480 [2024-11-26 19:18:36.285889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.480 qpair failed and we were unable to recover it. 00:32:19.480 [2024-11-26 19:18:36.286095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.480 [2024-11-26 19:18:36.286434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.480 [2024-11-26 19:18:36.286467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.480 qpair failed and we were unable to recover it. 00:32:19.480 [2024-11-26 19:18:36.286657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.480 [2024-11-26 19:18:36.286912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.480 [2024-11-26 19:18:36.286970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.480 qpair failed and we were unable to recover it. 00:32:19.480 [2024-11-26 19:18:36.287169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.480 [2024-11-26 19:18:36.287414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.480 [2024-11-26 19:18:36.287446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.480 qpair failed and we were unable to recover it. 00:32:19.480 [2024-11-26 19:18:36.287747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.480 [2024-11-26 19:18:36.287962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.480 [2024-11-26 19:18:36.287997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.480 qpair failed and we were unable to recover it. 00:32:19.480 [2024-11-26 19:18:36.288225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.480 [2024-11-26 19:18:36.288364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.480 [2024-11-26 19:18:36.288380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.480 qpair failed and we were unable to recover it. 00:32:19.481 [2024-11-26 19:18:36.288604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.481 [2024-11-26 19:18:36.288873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.481 [2024-11-26 19:18:36.288905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.481 qpair failed and we were unable to recover it. 00:32:19.481 [2024-11-26 19:18:36.289118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.481 [2024-11-26 19:18:36.289370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.481 [2024-11-26 19:18:36.289402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.481 qpair failed and we were unable to recover it. 00:32:19.481 [2024-11-26 19:18:36.289680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.481 [2024-11-26 19:18:36.289934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.481 [2024-11-26 19:18:36.289990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.481 qpair failed and we were unable to recover it. 00:32:19.481 [2024-11-26 19:18:36.290159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.481 [2024-11-26 19:18:36.290455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.481 [2024-11-26 19:18:36.290494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.481 qpair failed and we were unable to recover it. 00:32:19.481 [2024-11-26 19:18:36.290751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.481 [2024-11-26 19:18:36.291017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.481 [2024-11-26 19:18:36.291053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.481 qpair failed and we were unable to recover it. 00:32:19.481 [2024-11-26 19:18:36.291316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.481 [2024-11-26 19:18:36.291424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.481 [2024-11-26 19:18:36.291456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.481 qpair failed and we were unable to recover it. 00:32:19.481 [2024-11-26 19:18:36.291641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.481 [2024-11-26 19:18:36.291840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.481 [2024-11-26 19:18:36.291873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.481 qpair failed and we were unable to recover it. 00:32:19.481 [2024-11-26 19:18:36.292156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.481 [2024-11-26 19:18:36.292264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.481 [2024-11-26 19:18:36.292283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.481 qpair failed and we were unable to recover it. 00:32:19.481 [2024-11-26 19:18:36.292518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.481 [2024-11-26 19:18:36.292702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.481 [2024-11-26 19:18:36.292737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.481 qpair failed and we were unable to recover it. 00:32:19.481 [2024-11-26 19:18:36.293045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.481 [2024-11-26 19:18:36.293252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.481 [2024-11-26 19:18:36.293269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.481 qpair failed and we were unable to recover it. 00:32:19.481 [2024-11-26 19:18:36.293439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.481 [2024-11-26 19:18:36.293679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.481 [2024-11-26 19:18:36.293712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.481 qpair failed and we were unable to recover it. 00:32:19.481 [2024-11-26 19:18:36.293911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.481 [2024-11-26 19:18:36.294121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.481 [2024-11-26 19:18:36.294154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.481 qpair failed and we were unable to recover it. 00:32:19.481 [2024-11-26 19:18:36.294268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.481 [2024-11-26 19:18:36.294418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.481 [2024-11-26 19:18:36.294435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.481 qpair failed and we were unable to recover it. 00:32:19.481 [2024-11-26 19:18:36.294552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.481 [2024-11-26 19:18:36.294800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.481 [2024-11-26 19:18:36.294834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.481 qpair failed and we were unable to recover it. 00:32:19.481 [2024-11-26 19:18:36.295172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.481 [2024-11-26 19:18:36.295430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.481 [2024-11-26 19:18:36.295447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.481 qpair failed and we were unable to recover it. 00:32:19.481 [2024-11-26 19:18:36.295612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.481 [2024-11-26 19:18:36.295804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.481 [2024-11-26 19:18:36.295837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.481 qpair failed and we were unable to recover it. 00:32:19.481 [2024-11-26 19:18:36.296095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.481 [2024-11-26 19:18:36.296348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.481 [2024-11-26 19:18:36.296381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.481 qpair failed and we were unable to recover it. 00:32:19.481 [2024-11-26 19:18:36.296641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.481 [2024-11-26 19:18:36.296834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.481 [2024-11-26 19:18:36.296867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.481 qpair failed and we were unable to recover it. 00:32:19.481 [2024-11-26 19:18:36.297119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.481 [2024-11-26 19:18:36.297377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.481 [2024-11-26 19:18:36.297410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.481 qpair failed and we were unable to recover it. 00:32:19.481 [2024-11-26 19:18:36.297669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.481 [2024-11-26 19:18:36.297849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.481 [2024-11-26 19:18:36.297881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.481 qpair failed and we were unable to recover it. 00:32:19.481 [2024-11-26 19:18:36.298159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.481 [2024-11-26 19:18:36.298457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.481 [2024-11-26 19:18:36.298489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.481 qpair failed and we were unable to recover it. 00:32:19.481 [2024-11-26 19:18:36.298798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.481 [2024-11-26 19:18:36.299095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.481 [2024-11-26 19:18:36.299115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.481 qpair failed and we were unable to recover it. 00:32:19.481 [2024-11-26 19:18:36.299282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.481 [2024-11-26 19:18:36.299530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.481 [2024-11-26 19:18:36.299561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.481 qpair failed and we were unable to recover it. 00:32:19.481 [2024-11-26 19:18:36.299702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.481 [2024-11-26 19:18:36.299993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.482 [2024-11-26 19:18:36.300028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.482 qpair failed and we were unable to recover it. 00:32:19.482 [2024-11-26 19:18:36.300286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.482 [2024-11-26 19:18:36.300512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.482 [2024-11-26 19:18:36.300546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.482 qpair failed and we were unable to recover it. 00:32:19.482 [2024-11-26 19:18:36.300689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.482 [2024-11-26 19:18:36.300871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.482 [2024-11-26 19:18:36.300904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.482 qpair failed and we were unable to recover it. 00:32:19.482 [2024-11-26 19:18:36.301118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.482 [2024-11-26 19:18:36.301346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.482 [2024-11-26 19:18:36.301379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.482 qpair failed and we were unable to recover it. 00:32:19.482 [2024-11-26 19:18:36.301631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.482 [2024-11-26 19:18:36.301854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.482 [2024-11-26 19:18:36.301887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.482 qpair failed and we were unable to recover it. 00:32:19.482 [2024-11-26 19:18:36.302100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.482 [2024-11-26 19:18:36.302285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.482 [2024-11-26 19:18:36.302316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.482 qpair failed and we were unable to recover it. 00:32:19.482 [2024-11-26 19:18:36.302526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.482 [2024-11-26 19:18:36.302777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.482 [2024-11-26 19:18:36.302809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.482 qpair failed and we were unable to recover it. 00:32:19.482 [2024-11-26 19:18:36.302942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.482 [2024-11-26 19:18:36.303130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.482 [2024-11-26 19:18:36.303161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.482 qpair failed and we were unable to recover it. 00:32:19.482 [2024-11-26 19:18:36.303354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.482 [2024-11-26 19:18:36.303473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.482 [2024-11-26 19:18:36.303490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.482 qpair failed and we were unable to recover it. 00:32:19.482 [2024-11-26 19:18:36.303670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.482 [2024-11-26 19:18:36.303919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.482 [2024-11-26 19:18:36.303962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.482 qpair failed and we were unable to recover it. 00:32:19.482 [2024-11-26 19:18:36.304171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.482 [2024-11-26 19:18:36.304423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.482 [2024-11-26 19:18:36.304440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.482 qpair failed and we were unable to recover it. 00:32:19.482 [2024-11-26 19:18:36.304673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.482 [2024-11-26 19:18:36.304852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.482 [2024-11-26 19:18:36.304869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.482 qpair failed and we were unable to recover it. 00:32:19.482 [2024-11-26 19:18:36.305024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.482 [2024-11-26 19:18:36.305225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.482 [2024-11-26 19:18:36.305257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.482 qpair failed and we were unable to recover it. 00:32:19.482 [2024-11-26 19:18:36.305457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.482 [2024-11-26 19:18:36.305646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.482 [2024-11-26 19:18:36.305662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.482 qpair failed and we were unable to recover it. 00:32:19.482 [2024-11-26 19:18:36.305777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.482 [2024-11-26 19:18:36.305924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.482 [2024-11-26 19:18:36.305982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.482 qpair failed and we were unable to recover it. 00:32:19.482 [2024-11-26 19:18:36.306192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.482 [2024-11-26 19:18:36.306458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.482 [2024-11-26 19:18:36.306490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.482 qpair failed and we were unable to recover it. 00:32:19.482 [2024-11-26 19:18:36.306745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.482 [2024-11-26 19:18:36.307002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.482 [2024-11-26 19:18:36.307037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.482 qpair failed and we were unable to recover it. 00:32:19.482 [2024-11-26 19:18:36.307259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.482 [2024-11-26 19:18:36.307455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.482 [2024-11-26 19:18:36.307489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.482 qpair failed and we were unable to recover it. 00:32:19.482 [2024-11-26 19:18:36.307671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.482 [2024-11-26 19:18:36.307957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.482 [2024-11-26 19:18:36.307993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.482 qpair failed and we were unable to recover it. 00:32:19.482 [2024-11-26 19:18:36.308283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.482 [2024-11-26 19:18:36.308553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.482 [2024-11-26 19:18:36.308586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.482 qpair failed and we were unable to recover it. 00:32:19.482 [2024-11-26 19:18:36.308793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.482 [2024-11-26 19:18:36.309063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.482 [2024-11-26 19:18:36.309105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.482 qpair failed and we were unable to recover it. 00:32:19.482 [2024-11-26 19:18:36.309318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.482 [2024-11-26 19:18:36.309490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.482 [2024-11-26 19:18:36.309522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.482 qpair failed and we were unable to recover it. 00:32:19.482 [2024-11-26 19:18:36.309730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.482 [2024-11-26 19:18:36.309956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.482 [2024-11-26 19:18:36.309992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.482 qpair failed and we were unable to recover it. 00:32:19.482 [2024-11-26 19:18:36.310237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.482 [2024-11-26 19:18:36.310482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.482 [2024-11-26 19:18:36.310514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.482 qpair failed and we were unable to recover it. 00:32:19.482 [2024-11-26 19:18:36.310786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.483 [2024-11-26 19:18:36.311087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.483 [2024-11-26 19:18:36.311121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.483 qpair failed and we were unable to recover it. 00:32:19.483 [2024-11-26 19:18:36.311331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.483 [2024-11-26 19:18:36.311528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.483 [2024-11-26 19:18:36.311561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.483 qpair failed and we were unable to recover it. 00:32:19.483 [2024-11-26 19:18:36.311838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.483 [2024-11-26 19:18:36.312095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.483 [2024-11-26 19:18:36.312130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.483 qpair failed and we were unable to recover it. 00:32:19.483 [2024-11-26 19:18:36.312325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.483 [2024-11-26 19:18:36.312498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.483 [2024-11-26 19:18:36.312515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.483 qpair failed and we were unable to recover it. 00:32:19.483 [2024-11-26 19:18:36.312639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.483 [2024-11-26 19:18:36.312850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.483 [2024-11-26 19:18:36.312883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.483 qpair failed and we were unable to recover it. 00:32:19.483 [2024-11-26 19:18:36.313164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.483 [2024-11-26 19:18:36.313417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.483 [2024-11-26 19:18:36.313448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.483 qpair failed and we were unable to recover it. 00:32:19.483 [2024-11-26 19:18:36.313709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.483 [2024-11-26 19:18:36.313895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.483 [2024-11-26 19:18:36.313929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.483 qpair failed and we were unable to recover it. 00:32:19.483 [2024-11-26 19:18:36.314273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.483 [2024-11-26 19:18:36.314496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.483 [2024-11-26 19:18:36.314513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.483 qpair failed and we were unable to recover it. 00:32:19.483 [2024-11-26 19:18:36.314755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.483 [2024-11-26 19:18:36.314960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.483 [2024-11-26 19:18:36.314978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.483 qpair failed and we were unable to recover it. 00:32:19.483 [2024-11-26 19:18:36.315223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.483 [2024-11-26 19:18:36.315389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.483 [2024-11-26 19:18:36.315406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.483 qpair failed and we were unable to recover it. 00:32:19.483 [2024-11-26 19:18:36.315582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.483 [2024-11-26 19:18:36.315739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.483 [2024-11-26 19:18:36.315756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.483 qpair failed and we were unable to recover it. 00:32:19.483 [2024-11-26 19:18:36.315844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.483 [2024-11-26 19:18:36.316123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.483 [2024-11-26 19:18:36.316156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.483 qpair failed and we were unable to recover it. 00:32:19.483 [2024-11-26 19:18:36.316434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.483 [2024-11-26 19:18:36.316614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.483 [2024-11-26 19:18:36.316648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.483 qpair failed and we were unable to recover it. 00:32:19.483 [2024-11-26 19:18:36.316801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.483 [2024-11-26 19:18:36.317074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.483 [2024-11-26 19:18:36.317109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.483 qpair failed and we were unable to recover it. 00:32:19.483 [2024-11-26 19:18:36.317320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.483 [2024-11-26 19:18:36.317422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.483 [2024-11-26 19:18:36.317439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.483 qpair failed and we were unable to recover it. 00:32:19.483 [2024-11-26 19:18:36.317604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.483 [2024-11-26 19:18:36.317778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.483 [2024-11-26 19:18:36.317810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.483 qpair failed and we were unable to recover it. 00:32:19.483 [2024-11-26 19:18:36.318030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.483 [2024-11-26 19:18:36.318343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.483 [2024-11-26 19:18:36.318375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.483 qpair failed and we were unable to recover it. 00:32:19.483 [2024-11-26 19:18:36.318667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.483 [2024-11-26 19:18:36.318925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.483 [2024-11-26 19:18:36.318966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.483 qpair failed and we were unable to recover it. 00:32:19.483 [2024-11-26 19:18:36.319150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.483 [2024-11-26 19:18:36.319367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.483 [2024-11-26 19:18:36.319400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.483 qpair failed and we were unable to recover it. 00:32:19.483 [2024-11-26 19:18:36.319589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.483 [2024-11-26 19:18:36.319791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.483 [2024-11-26 19:18:36.319823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.483 qpair failed and we were unable to recover it. 00:32:19.483 [2024-11-26 19:18:36.320080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.483 [2024-11-26 19:18:36.320366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.483 [2024-11-26 19:18:36.320400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.483 qpair failed and we were unable to recover it. 00:32:19.483 [2024-11-26 19:18:36.320620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.483 [2024-11-26 19:18:36.320890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.483 [2024-11-26 19:18:36.320924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.483 qpair failed and we were unable to recover it. 00:32:19.484 [2024-11-26 19:18:36.321245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.484 [2024-11-26 19:18:36.321495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.484 [2024-11-26 19:18:36.321528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.484 qpair failed and we were unable to recover it. 00:32:19.484 [2024-11-26 19:18:36.321814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.484 [2024-11-26 19:18:36.322119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.484 [2024-11-26 19:18:36.322154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.484 qpair failed and we were unable to recover it. 00:32:19.484 [2024-11-26 19:18:36.322344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.484 [2024-11-26 19:18:36.322546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.484 [2024-11-26 19:18:36.322580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.484 qpair failed and we were unable to recover it. 00:32:19.484 [2024-11-26 19:18:36.322862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.484 [2024-11-26 19:18:36.323125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.484 [2024-11-26 19:18:36.323161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.484 qpair failed and we were unable to recover it. 00:32:19.484 [2024-11-26 19:18:36.323350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.484 [2024-11-26 19:18:36.323539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.484 [2024-11-26 19:18:36.323556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.484 qpair failed and we were unable to recover it. 00:32:19.484 [2024-11-26 19:18:36.323717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.484 [2024-11-26 19:18:36.323905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.484 [2024-11-26 19:18:36.323938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.484 qpair failed and we were unable to recover it. 00:32:19.484 [2024-11-26 19:18:36.324247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.484 [2024-11-26 19:18:36.324454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.484 [2024-11-26 19:18:36.324487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.484 qpair failed and we were unable to recover it. 00:32:19.484 [2024-11-26 19:18:36.324792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.484 [2024-11-26 19:18:36.325027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.484 [2024-11-26 19:18:36.325046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.484 qpair failed and we were unable to recover it. 00:32:19.484 [2024-11-26 19:18:36.325213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.484 [2024-11-26 19:18:36.325503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.484 [2024-11-26 19:18:36.325536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.484 qpair failed and we were unable to recover it. 00:32:19.484 [2024-11-26 19:18:36.325836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.484 [2024-11-26 19:18:36.326117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.484 [2024-11-26 19:18:36.326152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.484 qpair failed and we were unable to recover it. 00:32:19.484 [2024-11-26 19:18:36.326423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.484 [2024-11-26 19:18:36.326641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.484 [2024-11-26 19:18:36.326672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.484 qpair failed and we were unable to recover it. 00:32:19.484 [2024-11-26 19:18:36.326878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.484 [2024-11-26 19:18:36.327198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.484 [2024-11-26 19:18:36.327234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.484 qpair failed and we were unable to recover it. 00:32:19.484 [2024-11-26 19:18:36.327382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.484 [2024-11-26 19:18:36.327593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.484 [2024-11-26 19:18:36.327627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.484 qpair failed and we were unable to recover it. 00:32:19.484 [2024-11-26 19:18:36.327907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.484 [2024-11-26 19:18:36.328180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.484 [2024-11-26 19:18:36.328215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.484 qpair failed and we were unable to recover it. 00:32:19.484 [2024-11-26 19:18:36.328405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.484 [2024-11-26 19:18:36.328570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.484 [2024-11-26 19:18:36.328607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.484 qpair failed and we were unable to recover it. 00:32:19.484 [2024-11-26 19:18:36.328887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.484 [2024-11-26 19:18:36.329028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.484 [2024-11-26 19:18:36.329063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.484 qpair failed and we were unable to recover it. 00:32:19.484 [2024-11-26 19:18:36.329323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.484 [2024-11-26 19:18:36.329584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.484 [2024-11-26 19:18:36.329617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.484 qpair failed and we were unable to recover it. 00:32:19.484 [2024-11-26 19:18:36.329810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.484 [2024-11-26 19:18:36.330067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.484 [2024-11-26 19:18:36.330101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.484 qpair failed and we were unable to recover it. 00:32:19.484 [2024-11-26 19:18:36.330359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.484 [2024-11-26 19:18:36.330576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.484 [2024-11-26 19:18:36.330609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.484 qpair failed and we were unable to recover it. 00:32:19.484 [2024-11-26 19:18:36.330869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.484 [2024-11-26 19:18:36.331070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.484 [2024-11-26 19:18:36.331105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.484 qpair failed and we were unable to recover it. 00:32:19.484 [2024-11-26 19:18:36.331403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.484 [2024-11-26 19:18:36.331572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.484 [2024-11-26 19:18:36.331589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.484 qpair failed and we were unable to recover it. 00:32:19.484 [2024-11-26 19:18:36.331834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.484 [2024-11-26 19:18:36.332055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.484 [2024-11-26 19:18:36.332091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.484 qpair failed and we were unable to recover it. 00:32:19.484 [2024-11-26 19:18:36.332361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.484 [2024-11-26 19:18:36.332502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.484 [2024-11-26 19:18:36.332536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.484 qpair failed and we were unable to recover it. 00:32:19.484 [2024-11-26 19:18:36.332743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.484 [2024-11-26 19:18:36.332999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.484 [2024-11-26 19:18:36.333034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.484 qpair failed and we were unable to recover it. 00:32:19.484 [2024-11-26 19:18:36.333340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.484 [2024-11-26 19:18:36.333537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.485 [2024-11-26 19:18:36.333570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.485 qpair failed and we were unable to recover it. 00:32:19.485 [2024-11-26 19:18:36.333832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.485 [2024-11-26 19:18:36.334032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.485 [2024-11-26 19:18:36.334073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.485 qpair failed and we were unable to recover it. 00:32:19.485 [2024-11-26 19:18:36.334254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.485 [2024-11-26 19:18:36.334409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.485 [2024-11-26 19:18:36.334441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.485 qpair failed and we were unable to recover it. 00:32:19.485 [2024-11-26 19:18:36.334714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.485 [2024-11-26 19:18:36.334918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.485 [2024-11-26 19:18:36.334964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.485 qpair failed and we were unable to recover it. 00:32:19.485 [2024-11-26 19:18:36.335164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.485 [2024-11-26 19:18:36.335461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.485 [2024-11-26 19:18:36.335494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.485 qpair failed and we were unable to recover it. 00:32:19.485 [2024-11-26 19:18:36.335747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.485 [2024-11-26 19:18:36.335935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.485 [2024-11-26 19:18:36.335978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.485 qpair failed and we were unable to recover it. 00:32:19.485 [2024-11-26 19:18:36.336106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.485 [2024-11-26 19:18:36.336275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.485 [2024-11-26 19:18:36.336293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.485 qpair failed and we were unable to recover it. 00:32:19.485 [2024-11-26 19:18:36.336459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.485 [2024-11-26 19:18:36.336714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.485 [2024-11-26 19:18:36.336747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.485 qpair failed and we were unable to recover it. 00:32:19.485 [2024-11-26 19:18:36.337059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.485 [2024-11-26 19:18:36.337333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.485 [2024-11-26 19:18:36.337365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.485 qpair failed and we were unable to recover it. 00:32:19.485 [2024-11-26 19:18:36.337569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.485 [2024-11-26 19:18:36.337821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.485 [2024-11-26 19:18:36.337854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.485 qpair failed and we were unable to recover it. 00:32:19.485 [2024-11-26 19:18:36.338049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.485 [2024-11-26 19:18:36.338229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.485 [2024-11-26 19:18:36.338261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.485 qpair failed and we were unable to recover it. 00:32:19.485 [2024-11-26 19:18:36.338539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.485 [2024-11-26 19:18:36.338788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.485 [2024-11-26 19:18:36.338821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.485 qpair failed and we were unable to recover it. 00:32:19.485 [2024-11-26 19:18:36.339113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.485 [2024-11-26 19:18:36.339404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.485 [2024-11-26 19:18:36.339440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.485 qpair failed and we were unable to recover it. 00:32:19.485 [2024-11-26 19:18:36.339640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.485 [2024-11-26 19:18:36.339907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.485 [2024-11-26 19:18:36.339940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.485 qpair failed and we were unable to recover it. 00:32:19.485 [2024-11-26 19:18:36.340091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.485 [2024-11-26 19:18:36.340367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.485 [2024-11-26 19:18:36.340401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.485 qpair failed and we were unable to recover it. 00:32:19.485 [2024-11-26 19:18:36.340595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.485 [2024-11-26 19:18:36.340779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.485 [2024-11-26 19:18:36.340812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.485 qpair failed and we were unable to recover it. 00:32:19.485 [2024-11-26 19:18:36.341012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.485 [2024-11-26 19:18:36.341308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.485 [2024-11-26 19:18:36.341341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.485 qpair failed and we were unable to recover it. 00:32:19.485 [2024-11-26 19:18:36.341468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.485 [2024-11-26 19:18:36.341755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.485 [2024-11-26 19:18:36.341789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.485 qpair failed and we were unable to recover it. 00:32:19.485 [2024-11-26 19:18:36.341989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.485 [2024-11-26 19:18:36.342242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.485 [2024-11-26 19:18:36.342275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.485 qpair failed and we were unable to recover it. 00:32:19.485 [2024-11-26 19:18:36.342579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.485 [2024-11-26 19:18:36.342783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.485 [2024-11-26 19:18:36.342816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.485 qpair failed and we were unable to recover it. 00:32:19.485 [2024-11-26 19:18:36.343076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.485 [2024-11-26 19:18:36.343375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.485 [2024-11-26 19:18:36.343406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.485 qpair failed and we were unable to recover it. 00:32:19.485 [2024-11-26 19:18:36.343639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.485 [2024-11-26 19:18:36.343862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.485 [2024-11-26 19:18:36.343896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.486 qpair failed and we were unable to recover it. 00:32:19.486 [2024-11-26 19:18:36.344194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.486 [2024-11-26 19:18:36.344489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.486 [2024-11-26 19:18:36.344505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.486 qpair failed and we were unable to recover it. 00:32:19.486 [2024-11-26 19:18:36.344717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.486 [2024-11-26 19:18:36.344898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.486 [2024-11-26 19:18:36.344931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.486 qpair failed and we were unable to recover it. 00:32:19.486 [2024-11-26 19:18:36.345094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.486 [2024-11-26 19:18:36.345314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.486 [2024-11-26 19:18:36.345346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.486 qpair failed and we were unable to recover it. 00:32:19.486 [2024-11-26 19:18:36.345554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.486 [2024-11-26 19:18:36.345685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.486 [2024-11-26 19:18:36.345716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.486 qpair failed and we were unable to recover it. 00:32:19.486 [2024-11-26 19:18:36.345831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.486 [2024-11-26 19:18:36.346030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.486 [2024-11-26 19:18:36.346064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.486 qpair failed and we were unable to recover it. 00:32:19.486 [2024-11-26 19:18:36.346341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.486 [2024-11-26 19:18:36.346460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.486 [2024-11-26 19:18:36.346493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.486 qpair failed and we were unable to recover it. 00:32:19.486 [2024-11-26 19:18:36.346745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.486 [2024-11-26 19:18:36.347037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.486 [2024-11-26 19:18:36.347072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.486 qpair failed and we were unable to recover it. 00:32:19.486 [2024-11-26 19:18:36.347378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.486 [2024-11-26 19:18:36.347643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.486 [2024-11-26 19:18:36.347676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.486 qpair failed and we were unable to recover it. 00:32:19.486 [2024-11-26 19:18:36.347878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.486 [2024-11-26 19:18:36.348177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.486 [2024-11-26 19:18:36.348213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.486 qpair failed and we were unable to recover it. 00:32:19.486 [2024-11-26 19:18:36.348435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.486 [2024-11-26 19:18:36.348677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.486 [2024-11-26 19:18:36.348694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.486 qpair failed and we were unable to recover it. 00:32:19.486 [2024-11-26 19:18:36.348935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.486 [2024-11-26 19:18:36.349189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.486 [2024-11-26 19:18:36.349208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.486 qpair failed and we were unable to recover it. 00:32:19.486 [2024-11-26 19:18:36.349484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.486 [2024-11-26 19:18:36.349696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.486 [2024-11-26 19:18:36.349714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.486 qpair failed and we were unable to recover it. 00:32:19.486 [2024-11-26 19:18:36.349809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.486 [2024-11-26 19:18:36.350006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.486 [2024-11-26 19:18:36.350024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.486 qpair failed and we were unable to recover it. 00:32:19.486 [2024-11-26 19:18:36.350275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.486 [2024-11-26 19:18:36.350469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.486 [2024-11-26 19:18:36.350500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.486 qpair failed and we were unable to recover it. 00:32:19.486 [2024-11-26 19:18:36.350756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.486 [2024-11-26 19:18:36.351021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.486 [2024-11-26 19:18:36.351066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.486 qpair failed and we were unable to recover it. 00:32:19.486 [2024-11-26 19:18:36.351319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.486 [2024-11-26 19:18:36.351545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.486 [2024-11-26 19:18:36.351578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.486 qpair failed and we were unable to recover it. 00:32:19.486 [2024-11-26 19:18:36.351857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.486 [2024-11-26 19:18:36.352110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.486 [2024-11-26 19:18:36.352145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.486 qpair failed and we were unable to recover it. 00:32:19.486 [2024-11-26 19:18:36.352431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.486 [2024-11-26 19:18:36.352607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.486 [2024-11-26 19:18:36.352641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.486 qpair failed and we were unable to recover it. 00:32:19.486 [2024-11-26 19:18:36.352917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.486 [2024-11-26 19:18:36.353143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.486 [2024-11-26 19:18:36.353177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.486 qpair failed and we were unable to recover it. 00:32:19.486 [2024-11-26 19:18:36.353483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.486 [2024-11-26 19:18:36.353774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.486 [2024-11-26 19:18:36.353815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.486 qpair failed and we were unable to recover it. 00:32:19.486 [2024-11-26 19:18:36.354015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.486 [2024-11-26 19:18:36.354289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.486 [2024-11-26 19:18:36.354321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.486 qpair failed and we were unable to recover it. 00:32:19.486 [2024-11-26 19:18:36.354597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.486 [2024-11-26 19:18:36.354824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.486 [2024-11-26 19:18:36.354841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.486 qpair failed and we were unable to recover it. 00:32:19.486 [2024-11-26 19:18:36.355031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.486 [2024-11-26 19:18:36.355119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.487 [2024-11-26 19:18:36.355133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.487 qpair failed and we were unable to recover it. 00:32:19.487 [2024-11-26 19:18:36.355346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.487 [2024-11-26 19:18:36.355555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.487 [2024-11-26 19:18:36.355588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.487 qpair failed and we were unable to recover it. 00:32:19.487 [2024-11-26 19:18:36.355868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.487 [2024-11-26 19:18:36.356146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.487 [2024-11-26 19:18:36.356181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.487 qpair failed and we were unable to recover it. 00:32:19.487 [2024-11-26 19:18:36.356436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.487 [2024-11-26 19:18:36.356649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.487 [2024-11-26 19:18:36.356668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.487 qpair failed and we were unable to recover it. 00:32:19.487 [2024-11-26 19:18:36.357631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.487 [2024-11-26 19:18:36.357930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.487 [2024-11-26 19:18:36.357960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.487 qpair failed and we were unable to recover it. 00:32:19.487 [2024-11-26 19:18:36.358084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.487 [2024-11-26 19:18:36.358232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.487 [2024-11-26 19:18:36.358249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.487 qpair failed and we were unable to recover it. 00:32:19.487 [2024-11-26 19:18:36.358496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.487 [2024-11-26 19:18:36.358651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.487 [2024-11-26 19:18:36.358670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.487 qpair failed and we were unable to recover it. 00:32:19.487 [2024-11-26 19:18:36.358839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.487 [2024-11-26 19:18:36.359024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.487 [2024-11-26 19:18:36.359059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.487 qpair failed and we were unable to recover it. 00:32:19.487 [2024-11-26 19:18:36.359207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.487 [2024-11-26 19:18:36.359471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.487 [2024-11-26 19:18:36.359513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.487 qpair failed and we were unable to recover it. 00:32:19.487 [2024-11-26 19:18:36.359740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.487 [2024-11-26 19:18:36.359991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.487 [2024-11-26 19:18:36.360029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.487 qpair failed and we were unable to recover it. 00:32:19.487 [2024-11-26 19:18:36.360285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.487 [2024-11-26 19:18:36.360630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.487 [2024-11-26 19:18:36.360664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.487 qpair failed and we were unable to recover it. 00:32:19.487 [2024-11-26 19:18:36.360972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.487 [2024-11-26 19:18:36.361180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.487 [2024-11-26 19:18:36.361213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.487 qpair failed and we were unable to recover it. 00:32:19.487 [2024-11-26 19:18:36.361448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.487 [2024-11-26 19:18:36.361661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.487 [2024-11-26 19:18:36.361695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.487 qpair failed and we were unable to recover it. 00:32:19.487 [2024-11-26 19:18:36.361911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.487 [2024-11-26 19:18:36.362095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.487 [2024-11-26 19:18:36.362129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.487 qpair failed and we were unable to recover it. 00:32:19.487 [2024-11-26 19:18:36.362336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.487 [2024-11-26 19:18:36.362531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.487 [2024-11-26 19:18:36.362564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.487 qpair failed and we were unable to recover it. 00:32:19.487 [2024-11-26 19:18:36.362813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.487 [2024-11-26 19:18:36.363016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.487 [2024-11-26 19:18:36.363052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.487 qpair failed and we were unable to recover it. 00:32:19.487 [2024-11-26 19:18:36.363360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.487 [2024-11-26 19:18:36.363638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.487 [2024-11-26 19:18:36.363671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.487 qpair failed and we were unable to recover it. 00:32:19.487 [2024-11-26 19:18:36.363937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.487 [2024-11-26 19:18:36.364143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.487 [2024-11-26 19:18:36.364175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.487 qpair failed and we were unable to recover it. 00:32:19.487 [2024-11-26 19:18:36.364430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.487 [2024-11-26 19:18:36.364651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.487 [2024-11-26 19:18:36.364691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.487 qpair failed and we were unable to recover it. 00:32:19.487 [2024-11-26 19:18:36.364900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.487 [2024-11-26 19:18:36.365154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.487 [2024-11-26 19:18:36.365188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.487 qpair failed and we were unable to recover it. 00:32:19.487 [2024-11-26 19:18:36.365444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.487 [2024-11-26 19:18:36.365695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.487 [2024-11-26 19:18:36.365728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.487 qpair failed and we were unable to recover it. 00:32:19.487 [2024-11-26 19:18:36.365978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.487 [2024-11-26 19:18:36.366182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.487 [2024-11-26 19:18:36.366215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.487 qpair failed and we were unable to recover it. 00:32:19.487 [2024-11-26 19:18:36.366472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.487 [2024-11-26 19:18:36.366706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.487 [2024-11-26 19:18:36.366723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.487 qpair failed and we were unable to recover it. 00:32:19.487 [2024-11-26 19:18:36.366913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.487 [2024-11-26 19:18:36.367080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.487 [2024-11-26 19:18:36.367099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.487 qpair failed and we were unable to recover it. 00:32:19.488 [2024-11-26 19:18:36.367333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.488 [2024-11-26 19:18:36.367531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.488 [2024-11-26 19:18:36.367563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.488 qpair failed and we were unable to recover it. 00:32:19.488 [2024-11-26 19:18:36.367749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.488 [2024-11-26 19:18:36.367937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.488 [2024-11-26 19:18:36.367996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.488 qpair failed and we were unable to recover it. 00:32:19.488 [2024-11-26 19:18:36.368263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.488 [2024-11-26 19:18:36.368509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.488 [2024-11-26 19:18:36.368525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.488 qpair failed and we were unable to recover it. 00:32:19.488 [2024-11-26 19:18:36.368743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.488 [2024-11-26 19:18:36.369004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.488 [2024-11-26 19:18:36.369022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.488 qpair failed and we were unable to recover it. 00:32:19.488 [2024-11-26 19:18:36.369247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.488 [2024-11-26 19:18:36.369466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.488 [2024-11-26 19:18:36.369499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.488 qpair failed and we were unable to recover it. 00:32:19.488 [2024-11-26 19:18:36.369747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.488 [2024-11-26 19:18:36.369932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.488 [2024-11-26 19:18:36.369978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.488 qpair failed and we were unable to recover it. 00:32:19.488 [2024-11-26 19:18:36.370138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.488 [2024-11-26 19:18:36.370262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.488 [2024-11-26 19:18:36.370296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.488 qpair failed and we were unable to recover it. 00:32:19.488 [2024-11-26 19:18:36.370479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.760 [2024-11-26 19:18:36.370723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.760 [2024-11-26 19:18:36.370741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.760 qpair failed and we were unable to recover it. 00:32:19.760 [2024-11-26 19:18:36.370851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.760 [2024-11-26 19:18:36.371038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.760 [2024-11-26 19:18:36.371055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.760 qpair failed and we were unable to recover it. 00:32:19.760 [2024-11-26 19:18:36.371223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.760 [2024-11-26 19:18:36.371396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.760 [2024-11-26 19:18:36.371413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.760 qpair failed and we were unable to recover it. 00:32:19.760 [2024-11-26 19:18:36.371700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.760 [2024-11-26 19:18:36.371944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.760 [2024-11-26 19:18:36.371970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.760 qpair failed and we were unable to recover it. 00:32:19.760 [2024-11-26 19:18:36.372210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.760 [2024-11-26 19:18:36.372375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.760 [2024-11-26 19:18:36.372392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.760 qpair failed and we were unable to recover it. 00:32:19.760 [2024-11-26 19:18:36.372487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.760 [2024-11-26 19:18:36.372731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.760 [2024-11-26 19:18:36.372748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.760 qpair failed and we were unable to recover it. 00:32:19.760 [2024-11-26 19:18:36.372930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.760 [2024-11-26 19:18:36.373096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.760 [2024-11-26 19:18:36.373113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.760 qpair failed and we were unable to recover it. 00:32:19.760 [2024-11-26 19:18:36.373377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.760 [2024-11-26 19:18:36.373528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.760 [2024-11-26 19:18:36.373546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.760 qpair failed and we were unable to recover it. 00:32:19.760 [2024-11-26 19:18:36.373717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.760 [2024-11-26 19:18:36.373906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.760 [2024-11-26 19:18:36.373938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.760 qpair failed and we were unable to recover it. 00:32:19.760 [2024-11-26 19:18:36.374174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.760 [2024-11-26 19:18:36.374361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.760 [2024-11-26 19:18:36.374393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.760 qpair failed and we were unable to recover it. 00:32:19.760 [2024-11-26 19:18:36.374604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.760 [2024-11-26 19:18:36.374818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.761 [2024-11-26 19:18:36.374850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.761 qpair failed and we were unable to recover it. 00:32:19.761 [2024-11-26 19:18:36.375087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.761 [2024-11-26 19:18:36.375300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.761 [2024-11-26 19:18:36.375342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.761 qpair failed and we were unable to recover it. 00:32:19.761 [2024-11-26 19:18:36.375617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.761 [2024-11-26 19:18:36.375741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.761 [2024-11-26 19:18:36.375758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.761 qpair failed and we were unable to recover it. 00:32:19.761 [2024-11-26 19:18:36.375924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.761 [2024-11-26 19:18:36.376173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.761 [2024-11-26 19:18:36.376208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.761 qpair failed and we were unable to recover it. 00:32:19.761 [2024-11-26 19:18:36.376401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.761 [2024-11-26 19:18:36.376655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.761 [2024-11-26 19:18:36.376687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.761 qpair failed and we were unable to recover it. 00:32:19.761 [2024-11-26 19:18:36.376992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.761 [2024-11-26 19:18:36.377187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.761 [2024-11-26 19:18:36.377221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.761 qpair failed and we were unable to recover it. 00:32:19.761 [2024-11-26 19:18:36.377363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.761 [2024-11-26 19:18:36.377679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.761 [2024-11-26 19:18:36.377712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.761 qpair failed and we were unable to recover it. 00:32:19.761 [2024-11-26 19:18:36.377935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.761 [2024-11-26 19:18:36.378158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.761 [2024-11-26 19:18:36.378190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.761 qpair failed and we were unable to recover it. 00:32:19.761 [2024-11-26 19:18:36.378386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.761 [2024-11-26 19:18:36.378576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.761 [2024-11-26 19:18:36.378608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.761 qpair failed and we were unable to recover it. 00:32:19.761 [2024-11-26 19:18:36.378812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.761 [2024-11-26 19:18:36.379029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.761 [2024-11-26 19:18:36.379063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.761 qpair failed and we were unable to recover it. 00:32:19.761 [2024-11-26 19:18:36.379243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.761 [2024-11-26 19:18:36.379450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.761 [2024-11-26 19:18:36.379483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.761 qpair failed and we were unable to recover it. 00:32:19.761 [2024-11-26 19:18:36.379687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.761 [2024-11-26 19:18:36.379967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.761 [2024-11-26 19:18:36.380002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.761 qpair failed and we were unable to recover it. 00:32:19.761 [2024-11-26 19:18:36.380191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.761 [2024-11-26 19:18:36.380408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.761 [2024-11-26 19:18:36.380440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.761 qpair failed and we were unable to recover it. 00:32:19.761 [2024-11-26 19:18:36.380716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.761 [2024-11-26 19:18:36.380924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.761 [2024-11-26 19:18:36.380968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.761 qpair failed and we were unable to recover it. 00:32:19.761 [2024-11-26 19:18:36.381157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.761 [2024-11-26 19:18:36.381410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.761 [2024-11-26 19:18:36.381442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.761 qpair failed and we were unable to recover it. 00:32:19.761 [2024-11-26 19:18:36.381697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.761 [2024-11-26 19:18:36.381957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.761 [2024-11-26 19:18:36.381991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.761 qpair failed and we were unable to recover it. 00:32:19.761 [2024-11-26 19:18:36.382214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.761 [2024-11-26 19:18:36.382392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.761 [2024-11-26 19:18:36.382424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.761 qpair failed and we were unable to recover it. 00:32:19.761 [2024-11-26 19:18:36.382682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.761 [2024-11-26 19:18:36.382885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.761 [2024-11-26 19:18:36.382918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.761 qpair failed and we were unable to recover it. 00:32:19.761 [2024-11-26 19:18:36.383144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.761 [2024-11-26 19:18:36.383374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.761 [2024-11-26 19:18:36.383406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.761 qpair failed and we were unable to recover it. 00:32:19.761 [2024-11-26 19:18:36.383555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.761 [2024-11-26 19:18:36.383675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.761 [2024-11-26 19:18:36.383690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.761 qpair failed and we were unable to recover it. 00:32:19.761 [2024-11-26 19:18:36.383891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.761 [2024-11-26 19:18:36.384128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.761 [2024-11-26 19:18:36.384165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.761 qpair failed and we were unable to recover it. 00:32:19.761 [2024-11-26 19:18:36.384437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.761 [2024-11-26 19:18:36.384700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.761 [2024-11-26 19:18:36.384717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.761 qpair failed and we were unable to recover it. 00:32:19.762 [2024-11-26 19:18:36.384903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.762 [2024-11-26 19:18:36.385014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.762 [2024-11-26 19:18:36.385032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.762 qpair failed and we were unable to recover it. 00:32:19.762 [2024-11-26 19:18:36.385269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.762 [2024-11-26 19:18:36.385401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.762 [2024-11-26 19:18:36.385433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.762 qpair failed and we were unable to recover it. 00:32:19.762 [2024-11-26 19:18:36.385546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.762 [2024-11-26 19:18:36.385838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.762 [2024-11-26 19:18:36.385871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.762 qpair failed and we were unable to recover it. 00:32:19.762 [2024-11-26 19:18:36.386161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.762 [2024-11-26 19:18:36.386437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.762 [2024-11-26 19:18:36.386473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.762 qpair failed and we were unable to recover it. 00:32:19.762 [2024-11-26 19:18:36.386752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.762 [2024-11-26 19:18:36.386958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.762 [2024-11-26 19:18:36.386976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.762 qpair failed and we were unable to recover it. 00:32:19.762 [2024-11-26 19:18:36.387145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.762 [2024-11-26 19:18:36.387256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.762 [2024-11-26 19:18:36.387287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.762 qpair failed and we were unable to recover it. 00:32:19.762 [2024-11-26 19:18:36.387419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.762 [2024-11-26 19:18:36.387561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.762 [2024-11-26 19:18:36.387601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.762 qpair failed and we were unable to recover it. 00:32:19.762 [2024-11-26 19:18:36.387743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.762 [2024-11-26 19:18:36.387939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.762 [2024-11-26 19:18:36.388005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.762 qpair failed and we were unable to recover it. 00:32:19.762 [2024-11-26 19:18:36.388138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.762 [2024-11-26 19:18:36.388324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.762 [2024-11-26 19:18:36.388358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.762 qpair failed and we were unable to recover it. 00:32:19.762 [2024-11-26 19:18:36.388645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.762 [2024-11-26 19:18:36.388842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.762 [2024-11-26 19:18:36.388875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.762 qpair failed and we were unable to recover it. 00:32:19.762 [2024-11-26 19:18:36.389161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.762 [2024-11-26 19:18:36.389342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.762 [2024-11-26 19:18:36.389359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.762 qpair failed and we were unable to recover it. 00:32:19.762 [2024-11-26 19:18:36.389554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.762 [2024-11-26 19:18:36.389858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.762 [2024-11-26 19:18:36.389892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.762 qpair failed and we were unable to recover it. 00:32:19.762 [2024-11-26 19:18:36.390191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.762 [2024-11-26 19:18:36.390386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.762 [2024-11-26 19:18:36.390418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.762 qpair failed and we were unable to recover it. 00:32:19.762 [2024-11-26 19:18:36.390560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.762 [2024-11-26 19:18:36.390828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.762 [2024-11-26 19:18:36.390862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.762 qpair failed and we were unable to recover it. 00:32:19.762 [2024-11-26 19:18:36.391112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.762 [2024-11-26 19:18:36.391309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.762 [2024-11-26 19:18:36.391341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.762 qpair failed and we were unable to recover it. 00:32:19.762 [2024-11-26 19:18:36.391618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.762 [2024-11-26 19:18:36.391846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.762 [2024-11-26 19:18:36.391880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.762 qpair failed and we were unable to recover it. 00:32:19.762 [2024-11-26 19:18:36.392085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.762 [2024-11-26 19:18:36.392229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.762 [2024-11-26 19:18:36.392266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.762 qpair failed and we were unable to recover it. 00:32:19.762 [2024-11-26 19:18:36.392432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.762 [2024-11-26 19:18:36.392558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.762 [2024-11-26 19:18:36.392594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.762 qpair failed and we were unable to recover it. 00:32:19.762 [2024-11-26 19:18:36.392794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.762 [2024-11-26 19:18:36.392995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.762 [2024-11-26 19:18:36.393029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.762 qpair failed and we were unable to recover it. 00:32:19.762 [2024-11-26 19:18:36.393255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.762 [2024-11-26 19:18:36.393506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.762 [2024-11-26 19:18:36.393538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.762 qpair failed and we were unable to recover it. 00:32:19.762 [2024-11-26 19:18:36.393733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.762 [2024-11-26 19:18:36.393916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.762 [2024-11-26 19:18:36.393960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.762 qpair failed and we were unable to recover it. 00:32:19.762 [2024-11-26 19:18:36.394169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.762 [2024-11-26 19:18:36.394372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.763 [2024-11-26 19:18:36.394405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.763 qpair failed and we were unable to recover it. 00:32:19.763 [2024-11-26 19:18:36.394698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.763 [2024-11-26 19:18:36.394858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.763 [2024-11-26 19:18:36.394875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.763 qpair failed and we were unable to recover it. 00:32:19.763 [2024-11-26 19:18:36.395035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.763 [2024-11-26 19:18:36.395275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.763 [2024-11-26 19:18:36.395307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.763 qpair failed and we were unable to recover it. 00:32:19.763 [2024-11-26 19:18:36.395498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.763 [2024-11-26 19:18:36.395797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.763 [2024-11-26 19:18:36.395831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.763 qpair failed and we were unable to recover it. 00:32:19.763 [2024-11-26 19:18:36.396034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.763 [2024-11-26 19:18:36.396281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.763 [2024-11-26 19:18:36.396315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.763 qpair failed and we were unable to recover it. 00:32:19.763 [2024-11-26 19:18:36.396513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.763 [2024-11-26 19:18:36.396770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.763 [2024-11-26 19:18:36.396805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.763 qpair failed and we were unable to recover it. 00:32:19.763 [2024-11-26 19:18:36.397084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.763 [2024-11-26 19:18:36.397268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.763 [2024-11-26 19:18:36.397284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.763 qpair failed and we were unable to recover it. 00:32:19.763 [2024-11-26 19:18:36.397454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.763 [2024-11-26 19:18:36.397685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.763 [2024-11-26 19:18:36.397719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.763 qpair failed and we were unable to recover it. 00:32:19.763 [2024-11-26 19:18:36.397989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.763 [2024-11-26 19:18:36.398254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.763 [2024-11-26 19:18:36.398286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.763 qpair failed and we were unable to recover it. 00:32:19.763 [2024-11-26 19:18:36.398483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.763 [2024-11-26 19:18:36.398673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.763 [2024-11-26 19:18:36.398708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.763 qpair failed and we were unable to recover it. 00:32:19.763 [2024-11-26 19:18:36.398931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.763 [2024-11-26 19:18:36.399107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.763 [2024-11-26 19:18:36.399141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.763 qpair failed and we were unable to recover it. 00:32:19.763 [2024-11-26 19:18:36.399349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.763 [2024-11-26 19:18:36.399547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.763 [2024-11-26 19:18:36.399582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.763 qpair failed and we were unable to recover it. 00:32:19.763 [2024-11-26 19:18:36.399841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.763 [2024-11-26 19:18:36.400091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.763 [2024-11-26 19:18:36.400127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.763 qpair failed and we were unable to recover it. 00:32:19.763 [2024-11-26 19:18:36.400288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.763 [2024-11-26 19:18:36.400535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.763 [2024-11-26 19:18:36.400568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.763 qpair failed and we were unable to recover it. 00:32:19.763 [2024-11-26 19:18:36.400696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.763 [2024-11-26 19:18:36.400895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.763 [2024-11-26 19:18:36.400928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.763 qpair failed and we were unable to recover it. 00:32:19.763 [2024-11-26 19:18:36.401145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.763 [2024-11-26 19:18:36.401422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.763 [2024-11-26 19:18:36.401455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.763 qpair failed and we were unable to recover it. 00:32:19.763 [2024-11-26 19:18:36.401673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.763 [2024-11-26 19:18:36.401911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.763 [2024-11-26 19:18:36.401944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.763 qpair failed and we were unable to recover it. 00:32:19.763 [2024-11-26 19:18:36.402115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.763 [2024-11-26 19:18:36.402344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.763 [2024-11-26 19:18:36.402377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.763 qpair failed and we were unable to recover it. 00:32:19.763 [2024-11-26 19:18:36.402598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.763 [2024-11-26 19:18:36.402863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.763 [2024-11-26 19:18:36.402896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.763 qpair failed and we were unable to recover it. 00:32:19.763 [2024-11-26 19:18:36.403119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.763 [2024-11-26 19:18:36.403316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.763 [2024-11-26 19:18:36.403348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.763 qpair failed and we were unable to recover it. 00:32:19.763 [2024-11-26 19:18:36.403503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.763 [2024-11-26 19:18:36.403707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.763 [2024-11-26 19:18:36.403742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.763 qpair failed and we were unable to recover it. 00:32:19.763 [2024-11-26 19:18:36.404043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.763 [2024-11-26 19:18:36.404271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.763 [2024-11-26 19:18:36.404303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.763 qpair failed and we were unable to recover it. 00:32:19.763 [2024-11-26 19:18:36.404605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.763 [2024-11-26 19:18:36.404717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.763 [2024-11-26 19:18:36.404735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.763 qpair failed and we were unable to recover it. 00:32:19.763 [2024-11-26 19:18:36.404910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.763 [2024-11-26 19:18:36.405160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.763 [2024-11-26 19:18:36.405194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.763 qpair failed and we were unable to recover it. 00:32:19.764 [2024-11-26 19:18:36.405398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.764 [2024-11-26 19:18:36.405640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.764 [2024-11-26 19:18:36.405658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.764 qpair failed and we were unable to recover it. 00:32:19.764 [2024-11-26 19:18:36.405838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.764 [2024-11-26 19:18:36.405968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.764 [2024-11-26 19:18:36.406027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.764 qpair failed and we were unable to recover it. 00:32:19.764 [2024-11-26 19:18:36.406243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.764 [2024-11-26 19:18:36.406468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.764 [2024-11-26 19:18:36.406501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.764 qpair failed and we were unable to recover it. 00:32:19.764 [2024-11-26 19:18:36.406708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.764 [2024-11-26 19:18:36.406925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.764 [2024-11-26 19:18:36.406969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.764 qpair failed and we were unable to recover it. 00:32:19.764 [2024-11-26 19:18:36.407173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.764 [2024-11-26 19:18:36.407376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.764 [2024-11-26 19:18:36.407408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.764 qpair failed and we were unable to recover it. 00:32:19.764 [2024-11-26 19:18:36.407693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.764 [2024-11-26 19:18:36.407959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.764 [2024-11-26 19:18:36.407995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.764 qpair failed and we were unable to recover it. 00:32:19.764 [2024-11-26 19:18:36.408152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.764 [2024-11-26 19:18:36.408353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.764 [2024-11-26 19:18:36.408386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.764 qpair failed and we were unable to recover it. 00:32:19.764 [2024-11-26 19:18:36.408531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.764 [2024-11-26 19:18:36.408839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.764 [2024-11-26 19:18:36.408855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.764 qpair failed and we were unable to recover it. 00:32:19.764 [2024-11-26 19:18:36.409024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.764 [2024-11-26 19:18:36.409225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.764 [2024-11-26 19:18:36.409256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.764 qpair failed and we were unable to recover it. 00:32:19.764 [2024-11-26 19:18:36.409478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.764 [2024-11-26 19:18:36.409789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.764 [2024-11-26 19:18:36.409823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.764 qpair failed and we were unable to recover it. 00:32:19.764 [2024-11-26 19:18:36.410028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.764 [2024-11-26 19:18:36.410180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.764 [2024-11-26 19:18:36.410213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.764 qpair failed and we were unable to recover it. 00:32:19.764 [2024-11-26 19:18:36.410372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.764 [2024-11-26 19:18:36.410475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.764 [2024-11-26 19:18:36.410492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.764 qpair failed and we were unable to recover it. 00:32:19.764 [2024-11-26 19:18:36.410602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.764 [2024-11-26 19:18:36.410791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.764 [2024-11-26 19:18:36.410830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.764 qpair failed and we were unable to recover it. 00:32:19.764 [2024-11-26 19:18:36.410962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.764 [2024-11-26 19:18:36.411191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.764 [2024-11-26 19:18:36.411224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.764 qpair failed and we were unable to recover it. 00:32:19.764 [2024-11-26 19:18:36.411383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.764 [2024-11-26 19:18:36.411492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.764 [2024-11-26 19:18:36.411509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.764 qpair failed and we were unable to recover it. 00:32:19.764 [2024-11-26 19:18:36.411609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.764 [2024-11-26 19:18:36.411708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.764 [2024-11-26 19:18:36.411725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.764 qpair failed and we were unable to recover it. 00:32:19.764 [2024-11-26 19:18:36.411887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.764 [2024-11-26 19:18:36.412132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.764 [2024-11-26 19:18:36.412149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.764 qpair failed and we were unable to recover it. 00:32:19.764 [2024-11-26 19:18:36.412329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.764 [2024-11-26 19:18:36.412478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.764 [2024-11-26 19:18:36.412511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.764 qpair failed and we were unable to recover it. 00:32:19.764 [2024-11-26 19:18:36.412840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.764 [2024-11-26 19:18:36.413285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.764 [2024-11-26 19:18:36.413325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.764 qpair failed and we were unable to recover it. 00:32:19.764 [2024-11-26 19:18:36.413613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.765 [2024-11-26 19:18:36.413894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.765 [2024-11-26 19:18:36.413912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.765 qpair failed and we were unable to recover it. 00:32:19.765 [2024-11-26 19:18:36.414128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.765 [2024-11-26 19:18:36.414229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.765 [2024-11-26 19:18:36.414246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.765 qpair failed and we were unable to recover it. 00:32:19.765 [2024-11-26 19:18:36.414415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.765 [2024-11-26 19:18:36.414524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.765 [2024-11-26 19:18:36.414542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.765 qpair failed and we were unable to recover it. 00:32:19.765 [2024-11-26 19:18:36.414742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.765 [2024-11-26 19:18:36.414982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.765 [2024-11-26 19:18:36.415001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.765 qpair failed and we were unable to recover it. 00:32:19.765 [2024-11-26 19:18:36.415282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.765 [2024-11-26 19:18:36.415454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.765 [2024-11-26 19:18:36.415488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.765 qpair failed and we were unable to recover it. 00:32:19.765 [2024-11-26 19:18:36.415782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.765 [2024-11-26 19:18:36.415985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.765 [2024-11-26 19:18:36.416003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.765 qpair failed and we were unable to recover it. 00:32:19.765 [2024-11-26 19:18:36.416117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.765 [2024-11-26 19:18:36.416271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.765 [2024-11-26 19:18:36.416288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.765 qpair failed and we were unable to recover it. 00:32:19.765 [2024-11-26 19:18:36.416535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.765 [2024-11-26 19:18:36.416766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.765 [2024-11-26 19:18:36.416800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.765 qpair failed and we were unable to recover it. 00:32:19.765 [2024-11-26 19:18:36.417008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.765 [2024-11-26 19:18:36.417289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.765 [2024-11-26 19:18:36.417328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.765 qpair failed and we were unable to recover it. 00:32:19.765 [2024-11-26 19:18:36.417556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.765 [2024-11-26 19:18:36.417850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.765 [2024-11-26 19:18:36.417867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.765 qpair failed and we were unable to recover it. 00:32:19.765 [2024-11-26 19:18:36.418058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.765 [2024-11-26 19:18:36.418276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.765 [2024-11-26 19:18:36.418293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.765 qpair failed and we were unable to recover it. 00:32:19.765 [2024-11-26 19:18:36.418462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.765 [2024-11-26 19:18:36.418660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.765 [2024-11-26 19:18:36.418692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.765 qpair failed and we were unable to recover it. 00:32:19.765 [2024-11-26 19:18:36.418972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.765 [2024-11-26 19:18:36.419126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.765 [2024-11-26 19:18:36.419158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.765 qpair failed and we were unable to recover it. 00:32:19.765 [2024-11-26 19:18:36.419391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.765 [2024-11-26 19:18:36.419546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.765 [2024-11-26 19:18:36.419578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.765 qpair failed and we were unable to recover it. 00:32:19.765 [2024-11-26 19:18:36.419842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.765 [2024-11-26 19:18:36.420036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.765 [2024-11-26 19:18:36.420054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.765 qpair failed and we were unable to recover it. 00:32:19.765 [2024-11-26 19:18:36.420287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.765 [2024-11-26 19:18:36.420532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.765 [2024-11-26 19:18:36.420549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.765 qpair failed and we were unable to recover it. 00:32:19.765 [2024-11-26 19:18:36.420655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.765 [2024-11-26 19:18:36.420829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.765 [2024-11-26 19:18:36.420846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.765 qpair failed and we were unable to recover it. 00:32:19.765 [2024-11-26 19:18:36.420958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.765 [2024-11-26 19:18:36.421078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.765 [2024-11-26 19:18:36.421095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.765 qpair failed and we were unable to recover it. 00:32:19.765 [2024-11-26 19:18:36.421289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.765 [2024-11-26 19:18:36.421510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.765 [2024-11-26 19:18:36.421527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.765 qpair failed and we were unable to recover it. 00:32:19.765 [2024-11-26 19:18:36.421798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.765 [2024-11-26 19:18:36.421981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.765 [2024-11-26 19:18:36.421999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.765 qpair failed and we were unable to recover it. 00:32:19.765 [2024-11-26 19:18:36.422105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.765 [2024-11-26 19:18:36.422299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.765 [2024-11-26 19:18:36.422316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.765 qpair failed and we were unable to recover it. 00:32:19.765 [2024-11-26 19:18:36.422477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.765 [2024-11-26 19:18:36.422629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.766 [2024-11-26 19:18:36.422645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.766 qpair failed and we were unable to recover it. 00:32:19.766 [2024-11-26 19:18:36.422809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.766 [2024-11-26 19:18:36.422961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.766 [2024-11-26 19:18:36.422978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.766 qpair failed and we were unable to recover it. 00:32:19.766 [2024-11-26 19:18:36.423129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.766 [2024-11-26 19:18:36.423228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.766 [2024-11-26 19:18:36.423245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.766 qpair failed and we were unable to recover it. 00:32:19.766 [2024-11-26 19:18:36.423493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.766 [2024-11-26 19:18:36.423751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.766 [2024-11-26 19:18:36.423768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.766 qpair failed and we were unable to recover it. 00:32:19.766 [2024-11-26 19:18:36.424077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.766 [2024-11-26 19:18:36.424252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.766 [2024-11-26 19:18:36.424269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.766 qpair failed and we were unable to recover it. 00:32:19.766 [2024-11-26 19:18:36.424425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.766 [2024-11-26 19:18:36.424522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.766 [2024-11-26 19:18:36.424538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.766 qpair failed and we were unable to recover it. 00:32:19.766 [2024-11-26 19:18:36.424652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.766 [2024-11-26 19:18:36.424890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.766 [2024-11-26 19:18:36.424909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.766 qpair failed and we were unable to recover it. 00:32:19.766 [2024-11-26 19:18:36.425021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.766 [2024-11-26 19:18:36.425133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.766 [2024-11-26 19:18:36.425150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.766 qpair failed and we were unable to recover it. 00:32:19.766 [2024-11-26 19:18:36.425314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.766 [2024-11-26 19:18:36.425542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.766 [2024-11-26 19:18:36.425559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.766 qpair failed and we were unable to recover it. 00:32:19.766 [2024-11-26 19:18:36.425800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.766 [2024-11-26 19:18:36.426057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.766 [2024-11-26 19:18:36.426075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.766 qpair failed and we were unable to recover it. 00:32:19.766 [2024-11-26 19:18:36.426231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.766 [2024-11-26 19:18:36.426319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.766 [2024-11-26 19:18:36.426336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.766 qpair failed and we were unable to recover it. 00:32:19.766 [2024-11-26 19:18:36.426556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.766 [2024-11-26 19:18:36.426792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.766 [2024-11-26 19:18:36.426809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.766 qpair failed and we were unable to recover it. 00:32:19.766 [2024-11-26 19:18:36.426915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.766 [2024-11-26 19:18:36.427163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.766 [2024-11-26 19:18:36.427183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.766 qpair failed and we were unable to recover it. 00:32:19.766 [2024-11-26 19:18:36.427267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.766 [2024-11-26 19:18:36.427492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.766 [2024-11-26 19:18:36.427508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.766 qpair failed and we were unable to recover it. 00:32:19.766 [2024-11-26 19:18:36.427736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.766 [2024-11-26 19:18:36.427982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.766 [2024-11-26 19:18:36.427999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.766 qpair failed and we were unable to recover it. 00:32:19.766 [2024-11-26 19:18:36.428152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.766 [2024-11-26 19:18:36.428327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.766 [2024-11-26 19:18:36.428359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.766 qpair failed and we were unable to recover it. 00:32:19.766 [2024-11-26 19:18:36.428618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.766 [2024-11-26 19:18:36.428764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.766 [2024-11-26 19:18:36.428796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.766 qpair failed and we were unable to recover it. 00:32:19.766 [2024-11-26 19:18:36.429002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.766 [2024-11-26 19:18:36.429276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.766 [2024-11-26 19:18:36.429308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.766 qpair failed and we were unable to recover it. 00:32:19.766 [2024-11-26 19:18:36.429456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.766 [2024-11-26 19:18:36.429683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.767 [2024-11-26 19:18:36.429726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.767 qpair failed and we were unable to recover it. 00:32:19.767 [2024-11-26 19:18:36.429995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.767 [2024-11-26 19:18:36.430241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.767 [2024-11-26 19:18:36.430274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.767 qpair failed and we were unable to recover it. 00:32:19.767 [2024-11-26 19:18:36.430460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.767 [2024-11-26 19:18:36.430670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.767 [2024-11-26 19:18:36.430703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.767 qpair failed and we were unable to recover it. 00:32:19.767 [2024-11-26 19:18:36.430994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.767 [2024-11-26 19:18:36.431215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.767 [2024-11-26 19:18:36.431233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.767 qpair failed and we were unable to recover it. 00:32:19.767 [2024-11-26 19:18:36.431451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.767 [2024-11-26 19:18:36.431719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.767 [2024-11-26 19:18:36.431751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.767 qpair failed and we were unable to recover it. 00:32:19.767 [2024-11-26 19:18:36.431943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.767 [2024-11-26 19:18:36.432112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.767 [2024-11-26 19:18:36.432151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.767 qpair failed and we were unable to recover it. 00:32:19.767 [2024-11-26 19:18:36.432360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.767 [2024-11-26 19:18:36.432548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.767 [2024-11-26 19:18:36.432580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.767 qpair failed and we were unable to recover it. 00:32:19.767 [2024-11-26 19:18:36.432741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.767 [2024-11-26 19:18:36.432976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.767 [2024-11-26 19:18:36.433012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.767 qpair failed and we were unable to recover it. 00:32:19.767 [2024-11-26 19:18:36.433229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.767 [2024-11-26 19:18:36.433493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.767 [2024-11-26 19:18:36.433526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.767 qpair failed and we were unable to recover it. 00:32:19.767 [2024-11-26 19:18:36.433679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.767 [2024-11-26 19:18:36.433887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.767 [2024-11-26 19:18:36.433919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.767 qpair failed and we were unable to recover it. 00:32:19.767 [2024-11-26 19:18:36.434118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.767 [2024-11-26 19:18:36.434265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.767 [2024-11-26 19:18:36.434297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.767 qpair failed and we were unable to recover it. 00:32:19.767 [2024-11-26 19:18:36.434501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.767 [2024-11-26 19:18:36.434698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.767 [2024-11-26 19:18:36.434729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.767 qpair failed and we were unable to recover it. 00:32:19.767 [2024-11-26 19:18:36.434872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.767 [2024-11-26 19:18:36.435031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.767 [2024-11-26 19:18:36.435066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.767 qpair failed and we were unable to recover it. 00:32:19.767 [2024-11-26 19:18:36.435299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.767 [2024-11-26 19:18:36.435496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.767 [2024-11-26 19:18:36.435528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.767 qpair failed and we were unable to recover it. 00:32:19.767 [2024-11-26 19:18:36.435781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.767 [2024-11-26 19:18:36.436011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.767 [2024-11-26 19:18:36.436028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.767 qpair failed and we were unable to recover it. 00:32:19.767 [2024-11-26 19:18:36.436146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.767 [2024-11-26 19:18:36.436311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.768 [2024-11-26 19:18:36.436329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.768 qpair failed and we were unable to recover it. 00:32:19.768 [2024-11-26 19:18:36.436465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.768 [2024-11-26 19:18:36.436689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.768 [2024-11-26 19:18:36.436721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.768 qpair failed and we were unable to recover it. 00:32:19.768 [2024-11-26 19:18:36.436922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.768 [2024-11-26 19:18:36.437146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.768 [2024-11-26 19:18:36.437180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.768 qpair failed and we were unable to recover it. 00:32:19.768 [2024-11-26 19:18:36.437334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.768 [2024-11-26 19:18:36.437563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.768 [2024-11-26 19:18:36.437597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.768 qpair failed and we were unable to recover it. 00:32:19.768 [2024-11-26 19:18:36.438938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.768 [2024-11-26 19:18:36.439097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.768 [2024-11-26 19:18:36.439116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.768 qpair failed and we were unable to recover it. 00:32:19.768 [2024-11-26 19:18:36.439301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.768 [2024-11-26 19:18:36.439465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.768 [2024-11-26 19:18:36.439481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.768 qpair failed and we were unable to recover it. 00:32:19.768 [2024-11-26 19:18:36.439610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.768 [2024-11-26 19:18:36.439857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.768 [2024-11-26 19:18:36.439892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.768 qpair failed and we were unable to recover it. 00:32:19.768 [2024-11-26 19:18:36.440091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.768 [2024-11-26 19:18:36.440295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.768 [2024-11-26 19:18:36.440327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.768 qpair failed and we were unable to recover it. 00:32:19.768 [2024-11-26 19:18:36.440520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.768 [2024-11-26 19:18:36.440781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.768 [2024-11-26 19:18:36.440814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.768 qpair failed and we were unable to recover it. 00:32:19.768 [2024-11-26 19:18:36.440972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.768 [2024-11-26 19:18:36.441183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.768 [2024-11-26 19:18:36.441217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.768 qpair failed and we were unable to recover it. 00:32:19.768 [2024-11-26 19:18:36.441425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.768 [2024-11-26 19:18:36.441703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.768 [2024-11-26 19:18:36.441735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.768 qpair failed and we were unable to recover it. 00:32:19.768 [2024-11-26 19:18:36.441942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.768 [2024-11-26 19:18:36.442153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.768 [2024-11-26 19:18:36.442185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.768 qpair failed and we were unable to recover it. 00:32:19.768 [2024-11-26 19:18:36.442308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.768 [2024-11-26 19:18:36.442445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.768 [2024-11-26 19:18:36.442477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.768 qpair failed and we were unable to recover it. 00:32:19.768 [2024-11-26 19:18:36.442779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.768 [2024-11-26 19:18:36.442968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.768 [2024-11-26 19:18:36.443004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.768 qpair failed and we were unable to recover it. 00:32:19.768 [2024-11-26 19:18:36.443206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.768 [2024-11-26 19:18:36.443351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.768 [2024-11-26 19:18:36.443382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.768 qpair failed and we were unable to recover it. 00:32:19.768 [2024-11-26 19:18:36.443539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.768 [2024-11-26 19:18:36.443729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.768 [2024-11-26 19:18:36.443761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.768 qpair failed and we were unable to recover it. 00:32:19.768 [2024-11-26 19:18:36.443898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.768 [2024-11-26 19:18:36.444119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.768 [2024-11-26 19:18:36.444155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.768 qpair failed and we were unable to recover it. 00:32:19.768 [2024-11-26 19:18:36.444359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.768 [2024-11-26 19:18:36.444606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.768 [2024-11-26 19:18:36.444624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.768 qpair failed and we were unable to recover it. 00:32:19.768 [2024-11-26 19:18:36.444788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.768 [2024-11-26 19:18:36.444894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.768 [2024-11-26 19:18:36.444910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.768 qpair failed and we were unable to recover it. 00:32:19.768 [2024-11-26 19:18:36.445281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.768 [2024-11-26 19:18:36.445511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.768 [2024-11-26 19:18:36.445543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.768 qpair failed and we were unable to recover it. 00:32:19.768 [2024-11-26 19:18:36.445821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.768 [2024-11-26 19:18:36.446061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.768 [2024-11-26 19:18:36.446096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.768 qpair failed and we were unable to recover it. 00:32:19.768 [2024-11-26 19:18:36.446247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.768 [2024-11-26 19:18:36.446358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.768 [2024-11-26 19:18:36.446391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.768 qpair failed and we were unable to recover it. 00:32:19.768 [2024-11-26 19:18:36.446531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.768 [2024-11-26 19:18:36.446764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.769 [2024-11-26 19:18:36.446797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.769 qpair failed and we were unable to recover it. 00:32:19.769 [2024-11-26 19:18:36.446999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.769 [2024-11-26 19:18:36.447141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.769 [2024-11-26 19:18:36.447174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.769 qpair failed and we were unable to recover it. 00:32:19.769 [2024-11-26 19:18:36.447371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.769 [2024-11-26 19:18:36.447576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.769 [2024-11-26 19:18:36.447608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.769 qpair failed and we were unable to recover it. 00:32:19.769 [2024-11-26 19:18:36.447802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.769 [2024-11-26 19:18:36.447999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.769 [2024-11-26 19:18:36.448017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.769 qpair failed and we were unable to recover it. 00:32:19.769 [2024-11-26 19:18:36.448197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.769 [2024-11-26 19:18:36.448401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.769 [2024-11-26 19:18:36.448433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.769 qpair failed and we were unable to recover it. 00:32:19.769 [2024-11-26 19:18:36.448726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.769 [2024-11-26 19:18:36.448981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.769 [2024-11-26 19:18:36.448999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.769 qpair failed and we were unable to recover it. 00:32:19.769 [2024-11-26 19:18:36.449105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.769 [2024-11-26 19:18:36.449273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.769 [2024-11-26 19:18:36.449290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.769 qpair failed and we were unable to recover it. 00:32:19.769 [2024-11-26 19:18:36.449391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.769 [2024-11-26 19:18:36.449535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.769 [2024-11-26 19:18:36.449552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.769 qpair failed and we were unable to recover it. 00:32:19.769 [2024-11-26 19:18:36.449724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.769 [2024-11-26 19:18:36.449945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.769 [2024-11-26 19:18:36.449973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.769 qpair failed and we were unable to recover it. 00:32:19.769 [2024-11-26 19:18:36.450065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.769 [2024-11-26 19:18:36.450307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.769 [2024-11-26 19:18:36.450341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.769 qpair failed and we were unable to recover it. 00:32:19.769 [2024-11-26 19:18:36.450490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.769 [2024-11-26 19:18:36.450612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.769 [2024-11-26 19:18:36.450644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.769 qpair failed and we were unable to recover it. 00:32:19.769 [2024-11-26 19:18:36.450895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.769 [2024-11-26 19:18:36.451159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.769 [2024-11-26 19:18:36.451179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.769 qpair failed and we were unable to recover it. 00:32:19.769 [2024-11-26 19:18:36.451357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.769 [2024-11-26 19:18:36.451568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.769 [2024-11-26 19:18:36.451600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.769 qpair failed and we were unable to recover it. 00:32:19.769 [2024-11-26 19:18:36.451855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.769 [2024-11-26 19:18:36.452002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.769 [2024-11-26 19:18:36.452036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.769 qpair failed and we were unable to recover it. 00:32:19.769 [2024-11-26 19:18:36.452197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.769 [2024-11-26 19:18:36.452398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.769 [2024-11-26 19:18:36.452431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.769 qpair failed and we were unable to recover it. 00:32:19.769 [2024-11-26 19:18:36.452665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.769 [2024-11-26 19:18:36.452934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.769 [2024-11-26 19:18:36.452982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.769 qpair failed and we were unable to recover it. 00:32:19.769 [2024-11-26 19:18:36.453121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.769 [2024-11-26 19:18:36.453324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.769 [2024-11-26 19:18:36.453358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.769 qpair failed and we were unable to recover it. 00:32:19.769 [2024-11-26 19:18:36.453620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.769 [2024-11-26 19:18:36.453827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.769 [2024-11-26 19:18:36.453860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.769 qpair failed and we were unable to recover it. 00:32:19.769 [2024-11-26 19:18:36.454125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.769 [2024-11-26 19:18:36.454269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.769 [2024-11-26 19:18:36.454300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.769 qpair failed and we were unable to recover it. 00:32:19.769 [2024-11-26 19:18:36.455536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.769 [2024-11-26 19:18:36.455817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.769 [2024-11-26 19:18:36.455864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.769 qpair failed and we were unable to recover it. 00:32:19.769 [2024-11-26 19:18:36.456115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.769 [2024-11-26 19:18:36.456318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.769 [2024-11-26 19:18:36.456353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.769 qpair failed and we were unable to recover it. 00:32:19.769 [2024-11-26 19:18:36.456494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.769 [2024-11-26 19:18:36.456792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.769 [2024-11-26 19:18:36.456830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.769 qpair failed and we were unable to recover it. 00:32:19.769 [2024-11-26 19:18:36.456987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.769 [2024-11-26 19:18:36.457192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.769 [2024-11-26 19:18:36.457226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.769 qpair failed and we were unable to recover it. 00:32:19.769 [2024-11-26 19:18:36.457373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.769 [2024-11-26 19:18:36.457486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.769 [2024-11-26 19:18:36.457503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.769 qpair failed and we were unable to recover it. 00:32:19.769 [2024-11-26 19:18:36.457599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.770 [2024-11-26 19:18:36.457745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.770 [2024-11-26 19:18:36.457763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.770 qpair failed and we were unable to recover it. 00:32:19.770 [2024-11-26 19:18:36.458025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.770 [2024-11-26 19:18:36.458158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.770 [2024-11-26 19:18:36.458190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.770 qpair failed and we were unable to recover it. 00:32:19.770 [2024-11-26 19:18:36.458400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.770 [2024-11-26 19:18:36.458684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.770 [2024-11-26 19:18:36.458718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.770 qpair failed and we were unable to recover it. 00:32:19.770 [2024-11-26 19:18:36.458915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.770 [2024-11-26 19:18:36.459181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.770 [2024-11-26 19:18:36.459216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.770 qpair failed and we were unable to recover it. 00:32:19.770 [2024-11-26 19:18:36.459498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.770 [2024-11-26 19:18:36.459713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.770 [2024-11-26 19:18:36.459748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.770 qpair failed and we were unable to recover it. 00:32:19.770 [2024-11-26 19:18:36.460011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.770 [2024-11-26 19:18:36.460250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.770 [2024-11-26 19:18:36.460273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.770 qpair failed and we were unable to recover it. 00:32:19.770 [2024-11-26 19:18:36.460496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.770 [2024-11-26 19:18:36.460603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.770 [2024-11-26 19:18:36.460620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.770 qpair failed and we were unable to recover it. 00:32:19.770 [2024-11-26 19:18:36.460723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.770 [2024-11-26 19:18:36.460886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.770 [2024-11-26 19:18:36.460919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.770 qpair failed and we were unable to recover it. 00:32:19.770 [2024-11-26 19:18:36.461067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.770 [2024-11-26 19:18:36.461260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.770 [2024-11-26 19:18:36.461296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.770 qpair failed and we were unable to recover it. 00:32:19.770 [2024-11-26 19:18:36.461496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.770 [2024-11-26 19:18:36.461849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.770 [2024-11-26 19:18:36.461883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.770 qpair failed and we were unable to recover it. 00:32:19.770 [2024-11-26 19:18:36.462113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.770 [2024-11-26 19:18:36.462365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.770 [2024-11-26 19:18:36.462399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.770 qpair failed and we were unable to recover it. 00:32:19.770 [2024-11-26 19:18:36.462547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.770 [2024-11-26 19:18:36.462823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.770 [2024-11-26 19:18:36.462856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.770 qpair failed and we were unable to recover it. 00:32:19.770 [2024-11-26 19:18:36.463050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.770 [2024-11-26 19:18:36.463262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.770 [2024-11-26 19:18:36.463297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.770 qpair failed and we were unable to recover it. 00:32:19.770 [2024-11-26 19:18:36.463520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.770 [2024-11-26 19:18:36.463771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.770 [2024-11-26 19:18:36.463805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.770 qpair failed and we were unable to recover it. 00:32:19.770 [2024-11-26 19:18:36.463964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.770 [2024-11-26 19:18:36.464220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.770 [2024-11-26 19:18:36.464253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.770 qpair failed and we were unable to recover it. 00:32:19.770 [2024-11-26 19:18:36.464372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.770 [2024-11-26 19:18:36.464570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.770 [2024-11-26 19:18:36.464603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.770 qpair failed and we were unable to recover it. 00:32:19.770 [2024-11-26 19:18:36.464755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.770 [2024-11-26 19:18:36.464860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.770 [2024-11-26 19:18:36.464878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.770 qpair failed and we were unable to recover it. 00:32:19.770 [2024-11-26 19:18:36.465126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.770 [2024-11-26 19:18:36.465300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.770 [2024-11-26 19:18:36.465333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.770 qpair failed and we were unable to recover it. 00:32:19.770 [2024-11-26 19:18:36.465519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.770 [2024-11-26 19:18:36.465768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.770 [2024-11-26 19:18:36.465803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.770 qpair failed and we were unable to recover it. 00:32:19.770 [2024-11-26 19:18:36.465920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.770 [2024-11-26 19:18:36.466133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.770 [2024-11-26 19:18:36.466166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.770 qpair failed and we were unable to recover it. 00:32:19.770 [2024-11-26 19:18:36.466383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.770 [2024-11-26 19:18:36.466586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.770 [2024-11-26 19:18:36.466618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.770 qpair failed and we were unable to recover it. 00:32:19.770 [2024-11-26 19:18:36.466796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.770 [2024-11-26 19:18:36.467051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.770 [2024-11-26 19:18:36.467087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.770 qpair failed and we were unable to recover it. 00:32:19.770 [2024-11-26 19:18:36.467317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.770 [2024-11-26 19:18:36.467444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.770 [2024-11-26 19:18:36.467461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.770 qpair failed and we were unable to recover it. 00:32:19.770 [2024-11-26 19:18:36.467627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.770 [2024-11-26 19:18:36.467799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.771 [2024-11-26 19:18:36.467815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.771 qpair failed and we were unable to recover it. 00:32:19.771 [2024-11-26 19:18:36.467978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.771 [2024-11-26 19:18:36.468162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.771 [2024-11-26 19:18:36.468195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.771 qpair failed and we were unable to recover it. 00:32:19.771 [2024-11-26 19:18:36.468401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.771 [2024-11-26 19:18:36.469521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.771 [2024-11-26 19:18:36.469559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.771 qpair failed and we were unable to recover it. 00:32:19.771 [2024-11-26 19:18:36.469854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.771 [2024-11-26 19:18:36.470133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.771 [2024-11-26 19:18:36.470168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.771 qpair failed and we were unable to recover it. 00:32:19.771 [2024-11-26 19:18:36.470505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.771 [2024-11-26 19:18:36.470682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.771 [2024-11-26 19:18:36.470714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.771 qpair failed and we were unable to recover it. 00:32:19.771 [2024-11-26 19:18:36.471017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.771 [2024-11-26 19:18:36.471234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.771 [2024-11-26 19:18:36.471267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.771 qpair failed and we were unable to recover it. 00:32:19.771 [2024-11-26 19:18:36.471428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.771 [2024-11-26 19:18:36.471547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.771 [2024-11-26 19:18:36.471579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.771 qpair failed and we were unable to recover it. 00:32:19.771 [2024-11-26 19:18:36.471739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.771 [2024-11-26 19:18:36.471995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.771 [2024-11-26 19:18:36.472014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.771 qpair failed and we were unable to recover it. 00:32:19.771 [2024-11-26 19:18:36.472141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.771 [2024-11-26 19:18:36.472314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.771 [2024-11-26 19:18:36.472331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.771 qpair failed and we were unable to recover it. 00:32:19.771 [2024-11-26 19:18:36.472486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.771 [2024-11-26 19:18:36.472663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.771 [2024-11-26 19:18:36.472682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.771 qpair failed and we were unable to recover it. 00:32:19.771 [2024-11-26 19:18:36.472863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.771 [2024-11-26 19:18:36.472974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.771 [2024-11-26 19:18:36.472993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.771 qpair failed and we were unable to recover it. 00:32:19.771 [2024-11-26 19:18:36.473154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.771 [2024-11-26 19:18:36.473328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.771 [2024-11-26 19:18:36.473360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.771 qpair failed and we were unable to recover it. 00:32:19.771 [2024-11-26 19:18:36.473605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.771 [2024-11-26 19:18:36.473792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.771 [2024-11-26 19:18:36.473824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.771 qpair failed and we were unable to recover it. 00:32:19.771 [2024-11-26 19:18:36.473989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.771 [2024-11-26 19:18:36.474265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.771 [2024-11-26 19:18:36.474300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.771 qpair failed and we were unable to recover it. 00:32:19.771 [2024-11-26 19:18:36.474451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.771 [2024-11-26 19:18:36.476001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.771 [2024-11-26 19:18:36.476041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.771 qpair failed and we were unable to recover it. 00:32:19.771 [2024-11-26 19:18:36.476243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.771 [2024-11-26 19:18:36.476349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.771 [2024-11-26 19:18:36.476366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.771 qpair failed and we were unable to recover it. 00:32:19.771 [2024-11-26 19:18:36.476488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.771 [2024-11-26 19:18:36.476741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.771 [2024-11-26 19:18:36.476773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.771 qpair failed and we were unable to recover it. 00:32:19.771 [2024-11-26 19:18:36.477039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.771 [2024-11-26 19:18:36.477166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.771 [2024-11-26 19:18:36.477200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.771 qpair failed and we were unable to recover it. 00:32:19.771 [2024-11-26 19:18:36.477417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.771 [2024-11-26 19:18:36.477638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.771 [2024-11-26 19:18:36.477672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.771 qpair failed and we were unable to recover it. 00:32:19.771 [2024-11-26 19:18:36.477959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.771 [2024-11-26 19:18:36.478099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.771 [2024-11-26 19:18:36.478133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.771 qpair failed and we were unable to recover it. 00:32:19.771 [2024-11-26 19:18:36.478326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.771 [2024-11-26 19:18:36.478590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.771 [2024-11-26 19:18:36.478606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.771 qpair failed and we were unable to recover it. 00:32:19.771 [2024-11-26 19:18:36.478788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.771 [2024-11-26 19:18:36.478989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.771 [2024-11-26 19:18:36.479023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.771 qpair failed and we were unable to recover it. 00:32:19.771 [2024-11-26 19:18:36.479237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.771 [2024-11-26 19:18:36.480636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.771 [2024-11-26 19:18:36.480675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.771 qpair failed and we were unable to recover it. 00:32:19.771 [2024-11-26 19:18:36.480928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.771 [2024-11-26 19:18:36.481169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.771 [2024-11-26 19:18:36.481189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.771 qpair failed and we were unable to recover it. 00:32:19.771 [2024-11-26 19:18:36.481369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.771 [2024-11-26 19:18:36.481561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.772 [2024-11-26 19:18:36.481593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.772 qpair failed and we were unable to recover it. 00:32:19.772 [2024-11-26 19:18:36.481805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.772 [2024-11-26 19:18:36.482099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.772 [2024-11-26 19:18:36.482136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.772 qpair failed and we were unable to recover it. 00:32:19.772 [2024-11-26 19:18:36.482294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.772 [2024-11-26 19:18:36.482495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.772 [2024-11-26 19:18:36.482523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.772 qpair failed and we were unable to recover it. 00:32:19.772 [2024-11-26 19:18:36.482716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.772 [2024-11-26 19:18:36.482964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.772 [2024-11-26 19:18:36.482980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.772 qpair failed and we were unable to recover it. 00:32:19.772 [2024-11-26 19:18:36.483161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.772 [2024-11-26 19:18:36.483273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.772 [2024-11-26 19:18:36.483307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.772 qpair failed and we were unable to recover it. 00:32:19.772 [2024-11-26 19:18:36.483494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.772 [2024-11-26 19:18:36.483634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.772 [2024-11-26 19:18:36.483663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.772 qpair failed and we were unable to recover it. 00:32:19.772 [2024-11-26 19:18:36.483869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.772 [2024-11-26 19:18:36.484058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.772 [2024-11-26 19:18:36.484089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.772 qpair failed and we were unable to recover it. 00:32:19.772 [2024-11-26 19:18:36.484281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.772 [2024-11-26 19:18:36.484494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.772 [2024-11-26 19:18:36.484523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.772 qpair failed and we were unable to recover it. 00:32:19.772 [2024-11-26 19:18:36.484770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.772 [2024-11-26 19:18:36.485018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.772 [2024-11-26 19:18:36.485049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.772 qpair failed and we were unable to recover it. 00:32:19.772 [2024-11-26 19:18:36.485236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.772 [2024-11-26 19:18:36.485370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.772 [2024-11-26 19:18:36.485406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.772 qpair failed and we were unable to recover it. 00:32:19.772 [2024-11-26 19:18:36.485640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.772 [2024-11-26 19:18:36.485759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.772 [2024-11-26 19:18:36.485772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.772 qpair failed and we were unable to recover it. 00:32:19.772 [2024-11-26 19:18:36.485935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.772 [2024-11-26 19:18:36.486941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.772 [2024-11-26 19:18:36.486997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.772 qpair failed and we were unable to recover it. 00:32:19.772 [2024-11-26 19:18:36.487312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.772 [2024-11-26 19:18:36.487591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.772 [2024-11-26 19:18:36.487626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.772 qpair failed and we were unable to recover it. 00:32:19.772 [2024-11-26 19:18:36.487849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.772 [2024-11-26 19:18:36.488062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.772 [2024-11-26 19:18:36.488097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.772 qpair failed and we were unable to recover it. 00:32:19.772 [2024-11-26 19:18:36.489506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.772 [2024-11-26 19:18:36.489734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.772 [2024-11-26 19:18:36.489756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.772 qpair failed and we were unable to recover it. 00:32:19.772 [2024-11-26 19:18:36.490010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.772 [2024-11-26 19:18:36.490186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.772 [2024-11-26 19:18:36.490205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.772 qpair failed and we were unable to recover it. 00:32:19.772 [2024-11-26 19:18:36.490371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.772 [2024-11-26 19:18:36.490536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.772 [2024-11-26 19:18:36.490555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.772 qpair failed and we were unable to recover it. 00:32:19.772 [2024-11-26 19:18:36.490729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.772 [2024-11-26 19:18:36.491686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.772 [2024-11-26 19:18:36.491724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.772 qpair failed and we were unable to recover it. 00:32:19.772 [2024-11-26 19:18:36.492045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.772 [2024-11-26 19:18:36.492308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.772 [2024-11-26 19:18:36.492348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.772 qpair failed and we were unable to recover it. 00:32:19.772 [2024-11-26 19:18:36.492662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.772 [2024-11-26 19:18:36.492981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.773 [2024-11-26 19:18:36.493029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.773 qpair failed and we were unable to recover it. 00:32:19.773 [2024-11-26 19:18:36.493300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.773 [2024-11-26 19:18:36.493501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.773 [2024-11-26 19:18:36.493535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.773 qpair failed and we were unable to recover it. 00:32:19.773 [2024-11-26 19:18:36.493749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.773 [2024-11-26 19:18:36.493871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.773 [2024-11-26 19:18:36.493905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.773 qpair failed and we were unable to recover it. 00:32:19.773 [2024-11-26 19:18:36.494182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.773 [2024-11-26 19:18:36.494319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.773 [2024-11-26 19:18:36.494355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.773 qpair failed and we were unable to recover it. 00:32:19.773 [2024-11-26 19:18:36.494502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.773 [2024-11-26 19:18:36.494697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.773 [2024-11-26 19:18:36.494715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.773 qpair failed and we were unable to recover it. 00:32:19.773 [2024-11-26 19:18:36.494871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.773 [2024-11-26 19:18:36.495029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.773 [2024-11-26 19:18:36.495047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.773 qpair failed and we were unable to recover it. 00:32:19.773 [2024-11-26 19:18:36.495162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.773 [2024-11-26 19:18:36.495239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.773 [2024-11-26 19:18:36.495257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.773 qpair failed and we were unable to recover it. 00:32:19.773 [2024-11-26 19:18:36.495456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.773 [2024-11-26 19:18:36.495719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.773 [2024-11-26 19:18:36.495751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.773 qpair failed and we were unable to recover it. 00:32:19.773 [2024-11-26 19:18:36.496061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.773 [2024-11-26 19:18:36.496330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.773 [2024-11-26 19:18:36.496363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.773 qpair failed and we were unable to recover it. 00:32:19.773 [2024-11-26 19:18:36.496594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.773 [2024-11-26 19:18:36.496891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.773 [2024-11-26 19:18:36.496927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.773 qpair failed and we were unable to recover it. 00:32:19.773 [2024-11-26 19:18:36.497221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.773 [2024-11-26 19:18:36.497375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.773 [2024-11-26 19:18:36.497407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.773 qpair failed and we were unable to recover it. 00:32:19.773 [2024-11-26 19:18:36.497671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.773 [2024-11-26 19:18:36.497858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.773 [2024-11-26 19:18:36.497891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.773 qpair failed and we were unable to recover it. 00:32:19.773 [2024-11-26 19:18:36.498087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.773 [2024-11-26 19:18:36.498289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.773 [2024-11-26 19:18:36.498324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.773 qpair failed and we were unable to recover it. 00:32:19.773 [2024-11-26 19:18:36.498473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.773 [2024-11-26 19:18:36.498750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.773 [2024-11-26 19:18:36.498783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.773 qpair failed and we were unable to recover it. 00:32:19.773 [2024-11-26 19:18:36.498979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.773 [2024-11-26 19:18:36.499204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.773 [2024-11-26 19:18:36.499240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.773 qpair failed and we were unable to recover it. 00:32:19.773 [2024-11-26 19:18:36.499354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.773 [2024-11-26 19:18:36.499463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.773 [2024-11-26 19:18:36.499497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.773 qpair failed and we were unable to recover it. 00:32:19.773 [2024-11-26 19:18:36.499832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.773 [2024-11-26 19:18:36.500018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.773 [2024-11-26 19:18:36.500055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.773 qpair failed and we were unable to recover it. 00:32:19.773 [2024-11-26 19:18:36.500266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.773 [2024-11-26 19:18:36.500423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.773 [2024-11-26 19:18:36.500456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.773 qpair failed and we were unable to recover it. 00:32:19.773 [2024-11-26 19:18:36.500587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.773 [2024-11-26 19:18:36.500802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.773 [2024-11-26 19:18:36.500835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.773 qpair failed and we were unable to recover it. 00:32:19.773 [2024-11-26 19:18:36.501008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.773 [2024-11-26 19:18:36.501114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.773 [2024-11-26 19:18:36.501157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.773 qpair failed and we were unable to recover it. 00:32:19.773 [2024-11-26 19:18:36.501353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.773 [2024-11-26 19:18:36.501571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.773 [2024-11-26 19:18:36.501605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.773 qpair failed and we were unable to recover it. 00:32:19.773 [2024-11-26 19:18:36.501833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.773 [2024-11-26 19:18:36.502009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.773 [2024-11-26 19:18:36.502029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.773 qpair failed and we were unable to recover it. 00:32:19.773 [2024-11-26 19:18:36.502269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.773 [2024-11-26 19:18:36.502432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.774 [2024-11-26 19:18:36.502450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.774 qpair failed and we were unable to recover it. 00:32:19.774 [2024-11-26 19:18:36.502785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.774 [2024-11-26 19:18:36.503007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.774 [2024-11-26 19:18:36.503043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.774 qpair failed and we were unable to recover it. 00:32:19.774 [2024-11-26 19:18:36.503260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.774 [2024-11-26 19:18:36.503467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.774 [2024-11-26 19:18:36.503500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.774 qpair failed and we were unable to recover it. 00:32:19.774 [2024-11-26 19:18:36.503714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.774 [2024-11-26 19:18:36.503945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.774 [2024-11-26 19:18:36.503997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.774 qpair failed and we were unable to recover it. 00:32:19.774 [2024-11-26 19:18:36.504229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.774 [2024-11-26 19:18:36.504381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.774 [2024-11-26 19:18:36.504417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.774 qpair failed and we were unable to recover it. 00:32:19.774 [2024-11-26 19:18:36.504743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.774 [2024-11-26 19:18:36.504941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.774 [2024-11-26 19:18:36.504989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.774 qpair failed and we were unable to recover it. 00:32:19.774 [2024-11-26 19:18:36.505187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.774 [2024-11-26 19:18:36.505322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.774 [2024-11-26 19:18:36.505357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.774 qpair failed and we were unable to recover it. 00:32:19.774 [2024-11-26 19:18:36.505511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.774 [2024-11-26 19:18:36.505697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.774 [2024-11-26 19:18:36.505714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.774 qpair failed and we were unable to recover it. 00:32:19.774 [2024-11-26 19:18:36.505945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.774 [2024-11-26 19:18:36.506173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.774 [2024-11-26 19:18:36.506208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.774 qpair failed and we were unable to recover it. 00:32:19.774 [2024-11-26 19:18:36.506429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.774 [2024-11-26 19:18:36.506722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.774 [2024-11-26 19:18:36.506756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.774 qpair failed and we were unable to recover it. 00:32:19.774 [2024-11-26 19:18:36.506990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.774 [2024-11-26 19:18:36.507139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.774 [2024-11-26 19:18:36.507173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.774 qpair failed and we were unable to recover it. 00:32:19.774 [2024-11-26 19:18:36.507384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.774 [2024-11-26 19:18:36.507587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.774 [2024-11-26 19:18:36.507622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.774 qpair failed and we were unable to recover it. 00:32:19.774 [2024-11-26 19:18:36.507828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.774 [2024-11-26 19:18:36.508030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.774 [2024-11-26 19:18:36.508048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.774 qpair failed and we were unable to recover it. 00:32:19.774 [2024-11-26 19:18:36.508174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.774 [2024-11-26 19:18:36.508326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.774 [2024-11-26 19:18:36.508362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.774 qpair failed and we were unable to recover it. 00:32:19.774 [2024-11-26 19:18:36.508496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.774 [2024-11-26 19:18:36.508819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.774 [2024-11-26 19:18:36.508851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.774 qpair failed and we were unable to recover it. 00:32:19.774 [2024-11-26 19:18:36.509051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.774 [2024-11-26 19:18:36.509145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.774 [2024-11-26 19:18:36.509162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.774 qpair failed and we were unable to recover it. 00:32:19.774 [2024-11-26 19:18:36.509282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.774 [2024-11-26 19:18:36.509430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.774 [2024-11-26 19:18:36.509464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.774 qpair failed and we were unable to recover it. 00:32:19.774 [2024-11-26 19:18:36.509701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.774 [2024-11-26 19:18:36.509810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.774 [2024-11-26 19:18:36.509843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.774 qpair failed and we were unable to recover it. 00:32:19.774 [2024-11-26 19:18:36.510031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.774 [2024-11-26 19:18:36.510288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.774 [2024-11-26 19:18:36.510323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.774 qpair failed and we were unable to recover it. 00:32:19.774 [2024-11-26 19:18:36.510513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.774 [2024-11-26 19:18:36.510666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.774 [2024-11-26 19:18:36.510706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.774 qpair failed and we were unable to recover it. 00:32:19.774 [2024-11-26 19:18:36.510926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.774 [2024-11-26 19:18:36.511172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.774 [2024-11-26 19:18:36.511208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.774 qpair failed and we were unable to recover it. 00:32:19.774 [2024-11-26 19:18:36.511436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.774 [2024-11-26 19:18:36.511637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.774 [2024-11-26 19:18:36.511672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.774 qpair failed and we were unable to recover it. 00:32:19.774 [2024-11-26 19:18:36.511900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.774 [2024-11-26 19:18:36.511983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.774 [2024-11-26 19:18:36.512002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.774 qpair failed and we were unable to recover it. 00:32:19.774 [2024-11-26 19:18:36.512201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.774 [2024-11-26 19:18:36.512361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.774 [2024-11-26 19:18:36.512394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.774 qpair failed and we were unable to recover it. 00:32:19.775 [2024-11-26 19:18:36.512663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.775 [2024-11-26 19:18:36.512861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.775 [2024-11-26 19:18:36.512906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.775 qpair failed and we were unable to recover it. 00:32:19.775 [2024-11-26 19:18:36.513183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.775 [2024-11-26 19:18:36.513298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.775 [2024-11-26 19:18:36.513315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.775 qpair failed and we were unable to recover it. 00:32:19.775 [2024-11-26 19:18:36.513584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.775 [2024-11-26 19:18:36.513679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.775 [2024-11-26 19:18:36.513697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.775 qpair failed and we were unable to recover it. 00:32:19.775 [2024-11-26 19:18:36.513847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.775 [2024-11-26 19:18:36.514040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.775 [2024-11-26 19:18:36.514076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.775 qpair failed and we were unable to recover it. 00:32:19.775 [2024-11-26 19:18:36.514281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.775 [2024-11-26 19:18:36.514508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.775 [2024-11-26 19:18:36.514541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.775 qpair failed and we were unable to recover it. 00:32:19.775 [2024-11-26 19:18:36.514824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.775 [2024-11-26 19:18:36.514991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.775 [2024-11-26 19:18:36.515009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.775 qpair failed and we were unable to recover it. 00:32:19.775 [2024-11-26 19:18:36.515262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.775 [2024-11-26 19:18:36.515608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.775 [2024-11-26 19:18:36.515642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.775 qpair failed and we were unable to recover it. 00:32:19.775 [2024-11-26 19:18:36.515847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.775 [2024-11-26 19:18:36.516080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.775 [2024-11-26 19:18:36.516098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.775 qpair failed and we were unable to recover it. 00:32:19.775 [2024-11-26 19:18:36.516194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.775 [2024-11-26 19:18:36.516365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.775 [2024-11-26 19:18:36.516382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.775 qpair failed and we were unable to recover it. 00:32:19.775 [2024-11-26 19:18:36.516658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.775 [2024-11-26 19:18:36.516895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.775 [2024-11-26 19:18:36.516929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.775 qpair failed and we were unable to recover it. 00:32:19.775 [2024-11-26 19:18:36.517288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.775 [2024-11-26 19:18:36.517556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.775 [2024-11-26 19:18:36.517588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.775 qpair failed and we were unable to recover it. 00:32:19.775 [2024-11-26 19:18:36.517795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.775 [2024-11-26 19:18:36.518021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.775 [2024-11-26 19:18:36.518055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.775 qpair failed and we were unable to recover it. 00:32:19.775 [2024-11-26 19:18:36.518229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.775 [2024-11-26 19:18:36.518382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.775 [2024-11-26 19:18:36.518418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.775 qpair failed and we were unable to recover it. 00:32:19.775 [2024-11-26 19:18:36.518557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.775 [2024-11-26 19:18:36.518820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.775 [2024-11-26 19:18:36.518854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.775 qpair failed and we were unable to recover it. 00:32:19.775 [2024-11-26 19:18:36.519116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.775 [2024-11-26 19:18:36.520464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.775 [2024-11-26 19:18:36.520503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.775 qpair failed and we were unable to recover it. 00:32:19.775 [2024-11-26 19:18:36.520822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.775 [2024-11-26 19:18:36.521032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.775 [2024-11-26 19:18:36.521067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.775 qpair failed and we were unable to recover it. 00:32:19.775 [2024-11-26 19:18:36.521335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.775 [2024-11-26 19:18:36.521625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.775 [2024-11-26 19:18:36.521659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.775 qpair failed and we were unable to recover it. 00:32:19.775 [2024-11-26 19:18:36.521916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.775 [2024-11-26 19:18:36.522093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.775 [2024-11-26 19:18:36.522127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.775 qpair failed and we were unable to recover it. 00:32:19.775 [2024-11-26 19:18:36.522257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.775 [2024-11-26 19:18:36.522469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.775 [2024-11-26 19:18:36.522500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.775 qpair failed and we were unable to recover it. 00:32:19.775 [2024-11-26 19:18:36.522756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.775 [2024-11-26 19:18:36.522957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.775 [2024-11-26 19:18:36.522975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.775 qpair failed and we were unable to recover it. 00:32:19.775 [2024-11-26 19:18:36.523171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.775 [2024-11-26 19:18:36.523340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.775 [2024-11-26 19:18:36.523373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.775 qpair failed and we were unable to recover it. 00:32:19.775 [2024-11-26 19:18:36.523521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.775 [2024-11-26 19:18:36.523710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.775 [2024-11-26 19:18:36.523745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.775 qpair failed and we were unable to recover it. 00:32:19.775 [2024-11-26 19:18:36.523924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.775 [2024-11-26 19:18:36.524170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.775 [2024-11-26 19:18:36.524204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.776 qpair failed and we were unable to recover it. 00:32:19.776 [2024-11-26 19:18:36.524414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.776 [2024-11-26 19:18:36.524707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.776 [2024-11-26 19:18:36.524739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.776 qpair failed and we were unable to recover it. 00:32:19.776 [2024-11-26 19:18:36.525023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.776 [2024-11-26 19:18:36.525173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.776 [2024-11-26 19:18:36.525206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.776 qpair failed and we were unable to recover it. 00:32:19.776 [2024-11-26 19:18:36.525487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.776 [2024-11-26 19:18:36.525705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.776 [2024-11-26 19:18:36.525722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.776 qpair failed and we were unable to recover it. 00:32:19.776 [2024-11-26 19:18:36.525953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.776 [2024-11-26 19:18:36.526054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.776 [2024-11-26 19:18:36.526073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.776 qpair failed and we were unable to recover it. 00:32:19.776 [2024-11-26 19:18:36.526254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.776 [2024-11-26 19:18:36.526362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.776 [2024-11-26 19:18:36.526394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.776 qpair failed and we were unable to recover it. 00:32:19.776 [2024-11-26 19:18:36.526605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.776 [2024-11-26 19:18:36.526746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.776 [2024-11-26 19:18:36.526778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.776 qpair failed and we were unable to recover it. 00:32:19.776 [2024-11-26 19:18:36.527020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.776 [2024-11-26 19:18:36.527319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.776 [2024-11-26 19:18:36.527354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.776 qpair failed and we were unable to recover it. 00:32:19.776 [2024-11-26 19:18:36.527636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.776 [2024-11-26 19:18:36.527760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.776 [2024-11-26 19:18:36.527794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.776 qpair failed and we were unable to recover it. 00:32:19.776 [2024-11-26 19:18:36.527945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.776 [2024-11-26 19:18:36.528162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.776 [2024-11-26 19:18:36.528197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.776 qpair failed and we were unable to recover it. 00:32:19.776 [2024-11-26 19:18:36.528434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.776 [2024-11-26 19:18:36.528634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.776 [2024-11-26 19:18:36.528668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.776 qpair failed and we were unable to recover it. 00:32:19.776 [2024-11-26 19:18:36.528868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.776 [2024-11-26 19:18:36.529003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.776 [2024-11-26 19:18:36.529038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.776 qpair failed and we were unable to recover it. 00:32:19.776 [2024-11-26 19:18:36.529237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.776 [2024-11-26 19:18:36.529415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.776 [2024-11-26 19:18:36.529449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.776 qpair failed and we were unable to recover it. 00:32:19.776 [2024-11-26 19:18:36.529759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.776 [2024-11-26 19:18:36.529974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.776 [2024-11-26 19:18:36.530010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.776 qpair failed and we were unable to recover it. 00:32:19.776 [2024-11-26 19:18:36.530164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.776 [2024-11-26 19:18:36.530399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.776 [2024-11-26 19:18:36.530434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.776 qpair failed and we were unable to recover it. 00:32:19.776 [2024-11-26 19:18:36.530648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.776 [2024-11-26 19:18:36.530997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.776 [2024-11-26 19:18:36.531015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.776 qpair failed and we were unable to recover it. 00:32:19.776 [2024-11-26 19:18:36.531172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.776 [2024-11-26 19:18:36.531355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.776 [2024-11-26 19:18:36.531372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.776 qpair failed and we were unable to recover it. 00:32:19.776 [2024-11-26 19:18:36.531465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.776 [2024-11-26 19:18:36.531704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.776 [2024-11-26 19:18:36.531737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.776 qpair failed and we were unable to recover it. 00:32:19.776 [2024-11-26 19:18:36.531935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.776 [2024-11-26 19:18:36.532139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.776 [2024-11-26 19:18:36.532173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.776 qpair failed and we were unable to recover it. 00:32:19.776 [2024-11-26 19:18:36.533647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.776 [2024-11-26 19:18:36.533840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.776 [2024-11-26 19:18:36.533861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.776 qpair failed and we were unable to recover it. 00:32:19.776 [2024-11-26 19:18:36.534067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.776 [2024-11-26 19:18:36.534254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.776 [2024-11-26 19:18:36.534288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.776 qpair failed and we were unable to recover it. 00:32:19.776 [2024-11-26 19:18:36.534504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.776 [2024-11-26 19:18:36.534824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.776 [2024-11-26 19:18:36.534842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.776 qpair failed and we were unable to recover it. 00:32:19.776 [2024-11-26 19:18:36.535068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.776 [2024-11-26 19:18:36.535181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.776 [2024-11-26 19:18:36.535198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.776 qpair failed and we were unable to recover it. 00:32:19.776 [2024-11-26 19:18:36.535308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.776 [2024-11-26 19:18:36.535616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.776 [2024-11-26 19:18:36.535649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.776 qpair failed and we were unable to recover it. 00:32:19.776 [2024-11-26 19:18:36.535959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.776 [2024-11-26 19:18:36.536215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.776 [2024-11-26 19:18:36.536257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.776 qpair failed and we were unable to recover it. 00:32:19.776 [2024-11-26 19:18:36.536464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.776 [2024-11-26 19:18:36.536674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.776 [2024-11-26 19:18:36.536707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.776 qpair failed and we were unable to recover it. 00:32:19.776 [2024-11-26 19:18:36.536921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.776 [2024-11-26 19:18:36.537118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.776 [2024-11-26 19:18:36.537152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.776 qpair failed and we were unable to recover it. 00:32:19.777 [2024-11-26 19:18:36.537359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.777 [2024-11-26 19:18:36.537567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.777 [2024-11-26 19:18:36.537600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.777 qpair failed and we were unable to recover it. 00:32:19.777 [2024-11-26 19:18:36.537844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.777 [2024-11-26 19:18:36.538002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.777 [2024-11-26 19:18:36.538039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.777 qpair failed and we were unable to recover it. 00:32:19.777 [2024-11-26 19:18:36.538263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.777 [2024-11-26 19:18:36.538414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.777 [2024-11-26 19:18:36.538447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.777 qpair failed and we were unable to recover it. 00:32:19.777 [2024-11-26 19:18:36.538668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.777 [2024-11-26 19:18:36.538864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.777 [2024-11-26 19:18:36.538897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.777 qpair failed and we were unable to recover it. 00:32:19.777 [2024-11-26 19:18:36.539195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.777 [2024-11-26 19:18:36.539370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.777 [2024-11-26 19:18:36.539403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.777 qpair failed and we were unable to recover it. 00:32:19.777 [2024-11-26 19:18:36.539560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.777 [2024-11-26 19:18:36.539758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.777 [2024-11-26 19:18:36.539790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.777 qpair failed and we were unable to recover it. 00:32:19.777 [2024-11-26 19:18:36.540003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.777 [2024-11-26 19:18:36.540226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.777 [2024-11-26 19:18:36.540260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.777 qpair failed and we were unable to recover it. 00:32:19.777 [2024-11-26 19:18:36.540483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.777 [2024-11-26 19:18:36.540712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.777 [2024-11-26 19:18:36.540759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.777 qpair failed and we were unable to recover it. 00:32:19.777 [2024-11-26 19:18:36.540878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.777 [2024-11-26 19:18:36.540978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.777 [2024-11-26 19:18:36.540995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.777 qpair failed and we were unable to recover it. 00:32:19.777 [2024-11-26 19:18:36.541182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.777 [2024-11-26 19:18:36.541378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.777 [2024-11-26 19:18:36.541412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.777 qpair failed and we were unable to recover it. 00:32:19.777 [2024-11-26 19:18:36.541642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.777 [2024-11-26 19:18:36.541775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.777 [2024-11-26 19:18:36.541809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.777 qpair failed and we were unable to recover it. 00:32:19.777 [2024-11-26 19:18:36.541965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.777 [2024-11-26 19:18:36.542065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.777 [2024-11-26 19:18:36.542083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.777 qpair failed and we were unable to recover it. 00:32:19.777 [2024-11-26 19:18:36.542185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.777 [2024-11-26 19:18:36.542335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.777 [2024-11-26 19:18:36.542354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.777 qpair failed and we were unable to recover it. 00:32:19.777 [2024-11-26 19:18:36.542476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.777 [2024-11-26 19:18:36.542788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.777 [2024-11-26 19:18:36.542825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.777 qpair failed and we were unable to recover it. 00:32:19.777 [2024-11-26 19:18:36.543028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.777 [2024-11-26 19:18:36.543258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.777 [2024-11-26 19:18:36.543292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.777 qpair failed and we were unable to recover it. 00:32:19.777 [2024-11-26 19:18:36.543480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.777 [2024-11-26 19:18:36.543682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.777 [2024-11-26 19:18:36.543715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.777 qpair failed and we were unable to recover it. 00:32:19.777 [2024-11-26 19:18:36.545123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.777 [2024-11-26 19:18:36.545409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.777 [2024-11-26 19:18:36.545430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.777 qpair failed and we were unable to recover it. 00:32:19.777 [2024-11-26 19:18:36.545551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.777 [2024-11-26 19:18:36.545796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.777 [2024-11-26 19:18:36.545828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.777 qpair failed and we were unable to recover it. 00:32:19.777 [2024-11-26 19:18:36.546069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.777 [2024-11-26 19:18:36.546212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.777 [2024-11-26 19:18:36.546230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.777 qpair failed and we were unable to recover it. 00:32:19.777 [2024-11-26 19:18:36.546380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.777 [2024-11-26 19:18:36.546592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.777 [2024-11-26 19:18:36.546624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.777 qpair failed and we were unable to recover it. 00:32:19.777 [2024-11-26 19:18:36.546847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.777 [2024-11-26 19:18:36.547042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.777 [2024-11-26 19:18:36.547061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.777 qpair failed and we were unable to recover it. 00:32:19.777 [2024-11-26 19:18:36.547302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.777 [2024-11-26 19:18:36.547493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.777 [2024-11-26 19:18:36.547528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.777 qpair failed and we were unable to recover it. 00:32:19.777 [2024-11-26 19:18:36.547757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.777 [2024-11-26 19:18:36.547847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.777 [2024-11-26 19:18:36.547885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.777 qpair failed and we were unable to recover it. 00:32:19.777 [2024-11-26 19:18:36.548112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.777 [2024-11-26 19:18:36.548323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.778 [2024-11-26 19:18:36.548354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.778 qpair failed and we were unable to recover it. 00:32:19.778 [2024-11-26 19:18:36.548501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.778 [2024-11-26 19:18:36.548712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.778 [2024-11-26 19:18:36.548745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.778 qpair failed and we were unable to recover it. 00:32:19.778 [2024-11-26 19:18:36.549039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.778 [2024-11-26 19:18:36.549239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.778 [2024-11-26 19:18:36.549287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.778 qpair failed and we were unable to recover it. 00:32:19.778 [2024-11-26 19:18:36.549462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.778 [2024-11-26 19:18:36.549661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.778 [2024-11-26 19:18:36.549692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.778 qpair failed and we were unable to recover it. 00:32:19.778 [2024-11-26 19:18:36.549987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.778 [2024-11-26 19:18:36.550179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.778 [2024-11-26 19:18:36.550196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.778 qpair failed and we were unable to recover it. 00:32:19.778 [2024-11-26 19:18:36.550332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.778 [2024-11-26 19:18:36.550695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.778 [2024-11-26 19:18:36.550727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.778 qpair failed and we were unable to recover it. 00:32:19.778 [2024-11-26 19:18:36.550996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.778 [2024-11-26 19:18:36.551135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.778 [2024-11-26 19:18:36.551168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.778 qpair failed and we were unable to recover it. 00:32:19.778 [2024-11-26 19:18:36.551388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.778 [2024-11-26 19:18:36.551622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.778 [2024-11-26 19:18:36.551655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.778 qpair failed and we were unable to recover it. 00:32:19.778 [2024-11-26 19:18:36.551877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.778 [2024-11-26 19:18:36.552055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.778 [2024-11-26 19:18:36.552074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.778 qpair failed and we were unable to recover it. 00:32:19.778 [2024-11-26 19:18:36.552196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.778 [2024-11-26 19:18:36.552357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.778 [2024-11-26 19:18:36.552374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.778 qpair failed and we were unable to recover it. 00:32:19.778 [2024-11-26 19:18:36.552478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.778 [2024-11-26 19:18:36.552647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.778 [2024-11-26 19:18:36.552666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.778 qpair failed and we were unable to recover it. 00:32:19.778 [2024-11-26 19:18:36.552780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.778 [2024-11-26 19:18:36.553000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.778 [2024-11-26 19:18:36.553018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.778 qpair failed and we were unable to recover it. 00:32:19.778 [2024-11-26 19:18:36.553193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.778 [2024-11-26 19:18:36.553299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.778 [2024-11-26 19:18:36.553315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.778 qpair failed and we were unable to recover it. 00:32:19.778 [2024-11-26 19:18:36.553471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.778 [2024-11-26 19:18:36.553732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.778 [2024-11-26 19:18:36.553765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.778 qpair failed and we were unable to recover it. 00:32:19.778 [2024-11-26 19:18:36.553888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.778 [2024-11-26 19:18:36.554110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.778 [2024-11-26 19:18:36.554129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.778 qpair failed and we were unable to recover it. 00:32:19.778 [2024-11-26 19:18:36.554314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.778 [2024-11-26 19:18:36.554459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.778 [2024-11-26 19:18:36.554491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.778 qpair failed and we were unable to recover it. 00:32:19.778 [2024-11-26 19:18:36.554692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.778 [2024-11-26 19:18:36.555012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.778 [2024-11-26 19:18:36.555049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.778 qpair failed and we were unable to recover it. 00:32:19.778 [2024-11-26 19:18:36.555179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.778 [2024-11-26 19:18:36.555321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.778 [2024-11-26 19:18:36.555355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.778 qpair failed and we were unable to recover it. 00:32:19.778 [2024-11-26 19:18:36.555588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.778 [2024-11-26 19:18:36.555796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.778 [2024-11-26 19:18:36.555829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.778 qpair failed and we were unable to recover it. 00:32:19.778 [2024-11-26 19:18:36.555979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.778 [2024-11-26 19:18:36.556130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.778 [2024-11-26 19:18:36.556148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.778 qpair failed and we were unable to recover it. 00:32:19.778 [2024-11-26 19:18:36.556290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.779 [2024-11-26 19:18:36.556483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.779 [2024-11-26 19:18:36.556517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.779 qpair failed and we were unable to recover it. 00:32:19.779 [2024-11-26 19:18:36.556738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.779 [2024-11-26 19:18:36.556930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.779 [2024-11-26 19:18:36.556958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.779 qpair failed and we were unable to recover it. 00:32:19.779 [2024-11-26 19:18:36.557147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.779 [2024-11-26 19:18:36.557256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.779 [2024-11-26 19:18:36.557274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.779 qpair failed and we were unable to recover it. 00:32:19.779 [2024-11-26 19:18:36.557496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.779 [2024-11-26 19:18:36.557664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.779 [2024-11-26 19:18:36.557682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.779 qpair failed and we were unable to recover it. 00:32:19.779 [2024-11-26 19:18:36.557908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.779 [2024-11-26 19:18:36.558050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.779 [2024-11-26 19:18:36.558084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.779 qpair failed and we were unable to recover it. 00:32:19.779 [2024-11-26 19:18:36.558292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.779 [2024-11-26 19:18:36.558441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.779 [2024-11-26 19:18:36.558475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.779 qpair failed and we were unable to recover it. 00:32:19.779 [2024-11-26 19:18:36.558780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.779 [2024-11-26 19:18:36.560051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.779 [2024-11-26 19:18:36.560090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.779 qpair failed and we were unable to recover it. 00:32:19.779 [2024-11-26 19:18:36.560336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.779 [2024-11-26 19:18:36.560510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.779 [2024-11-26 19:18:36.560527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.779 qpair failed and we were unable to recover it. 00:32:19.779 [2024-11-26 19:18:36.560699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.779 [2024-11-26 19:18:36.560896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.779 [2024-11-26 19:18:36.560930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.779 qpair failed and we were unable to recover it. 00:32:19.779 [2024-11-26 19:18:36.561159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.779 [2024-11-26 19:18:36.562395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.779 [2024-11-26 19:18:36.562433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.779 qpair failed and we were unable to recover it. 00:32:19.779 [2024-11-26 19:18:36.562729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.779 [2024-11-26 19:18:36.562943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.779 [2024-11-26 19:18:36.563052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.779 qpair failed and we were unable to recover it. 00:32:19.779 [2024-11-26 19:18:36.563271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.779 [2024-11-26 19:18:36.563470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.779 [2024-11-26 19:18:36.563503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.779 qpair failed and we were unable to recover it. 00:32:19.779 [2024-11-26 19:18:36.564596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.779 [2024-11-26 19:18:36.564881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.779 [2024-11-26 19:18:36.564902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.779 qpair failed and we were unable to recover it. 00:32:19.779 [2024-11-26 19:18:36.565136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.779 [2024-11-26 19:18:36.565342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.779 [2024-11-26 19:18:36.565376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.779 qpair failed and we were unable to recover it. 00:32:19.779 [2024-11-26 19:18:36.565503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.779 [2024-11-26 19:18:36.565793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.779 [2024-11-26 19:18:36.565826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.779 qpair failed and we were unable to recover it. 00:32:19.779 [2024-11-26 19:18:36.566011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.779 [2024-11-26 19:18:36.566269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.779 [2024-11-26 19:18:36.566311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.779 qpair failed and we were unable to recover it. 00:32:19.779 [2024-11-26 19:18:36.566500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.779 [2024-11-26 19:18:36.566725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.779 [2024-11-26 19:18:36.566758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.779 qpair failed and we were unable to recover it. 00:32:19.779 [2024-11-26 19:18:36.566965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.779 [2024-11-26 19:18:36.567259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.779 [2024-11-26 19:18:36.567291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.779 qpair failed and we were unable to recover it. 00:32:19.779 [2024-11-26 19:18:36.567431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.779 [2024-11-26 19:18:36.567627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.779 [2024-11-26 19:18:36.567659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.779 qpair failed and we were unable to recover it. 00:32:19.779 [2024-11-26 19:18:36.567809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.780 [2024-11-26 19:18:36.567999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.780 [2024-11-26 19:18:36.568017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.780 qpair failed and we were unable to recover it. 00:32:19.780 [2024-11-26 19:18:36.568185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.780 [2024-11-26 19:18:36.568348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.780 [2024-11-26 19:18:36.568382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.780 qpair failed and we were unable to recover it. 00:32:19.780 [2024-11-26 19:18:36.568737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.780 [2024-11-26 19:18:36.568930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.780 [2024-11-26 19:18:36.568977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.780 qpair failed and we were unable to recover it. 00:32:19.780 [2024-11-26 19:18:36.569236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.780 [2024-11-26 19:18:36.569395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.780 [2024-11-26 19:18:36.569428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.780 qpair failed and we were unable to recover it. 00:32:19.780 [2024-11-26 19:18:36.569697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.780 [2024-11-26 19:18:36.569799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.780 [2024-11-26 19:18:36.569843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.780 qpair failed and we were unable to recover it. 00:32:19.780 [2024-11-26 19:18:36.570086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.780 [2024-11-26 19:18:36.570283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.780 [2024-11-26 19:18:36.570315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.780 qpair failed and we were unable to recover it. 00:32:19.780 [2024-11-26 19:18:36.570576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.780 [2024-11-26 19:18:36.570829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.780 [2024-11-26 19:18:36.570862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.780 qpair failed and we were unable to recover it. 00:32:19.780 [2024-11-26 19:18:36.571067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.780 [2024-11-26 19:18:36.571233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.780 [2024-11-26 19:18:36.571250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.780 qpair failed and we were unable to recover it. 00:32:19.780 [2024-11-26 19:18:36.571406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.780 [2024-11-26 19:18:36.571522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.780 [2024-11-26 19:18:36.571540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.780 qpair failed and we were unable to recover it. 00:32:19.780 [2024-11-26 19:18:36.571808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.780 [2024-11-26 19:18:36.572011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.780 [2024-11-26 19:18:36.572046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.780 qpair failed and we were unable to recover it. 00:32:19.780 [2024-11-26 19:18:36.572309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.780 [2024-11-26 19:18:36.572493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.780 [2024-11-26 19:18:36.572528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.780 qpair failed and we were unable to recover it. 00:32:19.780 [2024-11-26 19:18:36.572809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.780 [2024-11-26 19:18:36.573001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.780 [2024-11-26 19:18:36.573019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.780 qpair failed and we were unable to recover it. 00:32:19.780 [2024-11-26 19:18:36.573189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.780 [2024-11-26 19:18:36.573293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.780 [2024-11-26 19:18:36.573310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.780 qpair failed and we were unable to recover it. 00:32:19.780 [2024-11-26 19:18:36.573427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.780 [2024-11-26 19:18:36.573548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.780 [2024-11-26 19:18:36.573582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.780 qpair failed and we were unable to recover it. 00:32:19.780 [2024-11-26 19:18:36.573724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.780 [2024-11-26 19:18:36.573910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.780 [2024-11-26 19:18:36.573944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.780 qpair failed and we were unable to recover it. 00:32:19.780 [2024-11-26 19:18:36.574212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.780 [2024-11-26 19:18:36.574448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.780 [2024-11-26 19:18:36.574482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.780 qpair failed and we were unable to recover it. 00:32:19.780 [2024-11-26 19:18:36.574684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.780 [2024-11-26 19:18:36.574937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.780 [2024-11-26 19:18:36.574986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.780 qpair failed and we were unable to recover it. 00:32:19.780 [2024-11-26 19:18:36.575146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.780 [2024-11-26 19:18:36.575359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.780 [2024-11-26 19:18:36.575392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.780 qpair failed and we were unable to recover it. 00:32:19.780 [2024-11-26 19:18:36.575599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.780 [2024-11-26 19:18:36.575750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.780 [2024-11-26 19:18:36.575785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.780 qpair failed and we were unable to recover it. 00:32:19.780 [2024-11-26 19:18:36.575905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.780 [2024-11-26 19:18:36.576179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.780 [2024-11-26 19:18:36.576200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.780 qpair failed and we were unable to recover it. 00:32:19.780 [2024-11-26 19:18:36.576305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.780 [2024-11-26 19:18:36.576418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.780 [2024-11-26 19:18:36.576436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.780 qpair failed and we were unable to recover it. 00:32:19.780 [2024-11-26 19:18:36.577863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.780 [2024-11-26 19:18:36.578161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.780 [2024-11-26 19:18:36.578184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.780 qpair failed and we were unable to recover it. 00:32:19.780 [2024-11-26 19:18:36.578373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.780 [2024-11-26 19:18:36.578588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.780 [2024-11-26 19:18:36.578621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.780 qpair failed and we were unable to recover it. 00:32:19.780 [2024-11-26 19:18:36.578879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.780 [2024-11-26 19:18:36.579045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.780 [2024-11-26 19:18:36.579063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.780 qpair failed and we were unable to recover it. 00:32:19.780 [2024-11-26 19:18:36.579334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.780 [2024-11-26 19:18:36.579469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.780 [2024-11-26 19:18:36.579503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.780 qpair failed and we were unable to recover it. 00:32:19.780 [2024-11-26 19:18:36.579785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.781 [2024-11-26 19:18:36.579980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.781 [2024-11-26 19:18:36.580016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.781 qpair failed and we were unable to recover it. 00:32:19.781 [2024-11-26 19:18:36.580244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.781 [2024-11-26 19:18:36.580447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.781 [2024-11-26 19:18:36.580481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.781 qpair failed and we were unable to recover it. 00:32:19.781 [2024-11-26 19:18:36.580788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.781 [2024-11-26 19:18:36.581020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.781 [2024-11-26 19:18:36.581038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.781 qpair failed and we were unable to recover it. 00:32:19.781 [2024-11-26 19:18:36.581226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.781 [2024-11-26 19:18:36.581386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.781 [2024-11-26 19:18:36.581403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.781 qpair failed and we were unable to recover it. 00:32:19.781 [2024-11-26 19:18:36.581582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.781 [2024-11-26 19:18:36.581768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.781 [2024-11-26 19:18:36.581800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.781 qpair failed and we were unable to recover it. 00:32:19.781 [2024-11-26 19:18:36.581962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.781 [2024-11-26 19:18:36.582098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.781 [2024-11-26 19:18:36.582131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.781 qpair failed and we were unable to recover it. 00:32:19.781 [2024-11-26 19:18:36.582353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.781 [2024-11-26 19:18:36.582551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.781 [2024-11-26 19:18:36.582583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.781 qpair failed and we were unable to recover it. 00:32:19.781 [2024-11-26 19:18:36.582708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.781 [2024-11-26 19:18:36.582873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.781 [2024-11-26 19:18:36.582892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.781 qpair failed and we were unable to recover it. 00:32:19.781 [2024-11-26 19:18:36.583066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.781 [2024-11-26 19:18:36.583341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.781 [2024-11-26 19:18:36.583373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.781 qpair failed and we were unable to recover it. 00:32:19.781 [2024-11-26 19:18:36.583561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.781 [2024-11-26 19:18:36.583841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.781 [2024-11-26 19:18:36.583876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.781 qpair failed and we were unable to recover it. 00:32:19.781 [2024-11-26 19:18:36.584055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.781 [2024-11-26 19:18:36.584172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.781 [2024-11-26 19:18:36.584192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.781 qpair failed and we were unable to recover it. 00:32:19.781 [2024-11-26 19:18:36.584303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.781 [2024-11-26 19:18:36.584503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.781 [2024-11-26 19:18:36.584536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.781 qpair failed and we were unable to recover it. 00:32:19.781 [2024-11-26 19:18:36.584696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.781 [2024-11-26 19:18:36.584967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.781 [2024-11-26 19:18:36.585005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.781 qpair failed and we were unable to recover it. 00:32:19.781 [2024-11-26 19:18:36.585205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.781 [2024-11-26 19:18:36.586682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.781 [2024-11-26 19:18:36.586722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.781 qpair failed and we were unable to recover it. 00:32:19.781 [2024-11-26 19:18:36.586992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.781 [2024-11-26 19:18:36.587170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.781 [2024-11-26 19:18:36.587190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.781 qpair failed and we were unable to recover it. 00:32:19.781 [2024-11-26 19:18:36.587307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.781 [2024-11-26 19:18:36.587459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.781 [2024-11-26 19:18:36.587476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.781 qpair failed and we were unable to recover it. 00:32:19.781 [2024-11-26 19:18:36.587605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.781 [2024-11-26 19:18:36.587800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.781 [2024-11-26 19:18:36.587834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.781 qpair failed and we were unable to recover it. 00:32:19.781 [2024-11-26 19:18:36.587993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.781 [2024-11-26 19:18:36.588136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.781 [2024-11-26 19:18:36.588170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.781 qpair failed and we were unable to recover it. 00:32:19.781 [2024-11-26 19:18:36.588318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.781 [2024-11-26 19:18:36.588588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.781 [2024-11-26 19:18:36.588621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.781 qpair failed and we were unable to recover it. 00:32:19.781 [2024-11-26 19:18:36.588903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.781 [2024-11-26 19:18:36.589222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.782 [2024-11-26 19:18:36.589258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.782 qpair failed and we were unable to recover it. 00:32:19.782 [2024-11-26 19:18:36.589515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.782 [2024-11-26 19:18:36.589652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.782 [2024-11-26 19:18:36.589685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.782 qpair failed and we were unable to recover it. 00:32:19.782 [2024-11-26 19:18:36.589829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.782 [2024-11-26 19:18:36.590014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.782 [2024-11-26 19:18:36.590049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.782 qpair failed and we were unable to recover it. 00:32:19.782 [2024-11-26 19:18:36.590194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.782 [2024-11-26 19:18:36.590401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.782 [2024-11-26 19:18:36.590443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.782 qpair failed and we were unable to recover it. 00:32:19.782 [2024-11-26 19:18:36.590656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.782 [2024-11-26 19:18:36.590925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.782 [2024-11-26 19:18:36.590974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.782 qpair failed and we were unable to recover it. 00:32:19.782 [2024-11-26 19:18:36.591130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.782 [2024-11-26 19:18:36.591335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.782 [2024-11-26 19:18:36.591371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.782 qpair failed and we were unable to recover it. 00:32:19.782 [2024-11-26 19:18:36.591504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.782 [2024-11-26 19:18:36.591749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.782 [2024-11-26 19:18:36.591782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.782 qpair failed and we were unable to recover it. 00:32:19.782 [2024-11-26 19:18:36.591986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.782 [2024-11-26 19:18:36.592235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.782 [2024-11-26 19:18:36.592252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.782 qpair failed and we were unable to recover it. 00:32:19.782 [2024-11-26 19:18:36.592367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.782 [2024-11-26 19:18:36.592471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.782 [2024-11-26 19:18:36.592492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.782 qpair failed and we were unable to recover it. 00:32:19.782 [2024-11-26 19:18:36.592739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.782 [2024-11-26 19:18:36.592913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.782 [2024-11-26 19:18:36.592931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.782 qpair failed and we were unable to recover it. 00:32:19.782 [2024-11-26 19:18:36.593134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.782 [2024-11-26 19:18:36.593368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.782 [2024-11-26 19:18:36.593386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.782 qpair failed and we were unable to recover it. 00:32:19.782 [2024-11-26 19:18:36.593501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.782 [2024-11-26 19:18:36.593613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.782 [2024-11-26 19:18:36.593636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.782 qpair failed and we were unable to recover it. 00:32:19.782 [2024-11-26 19:18:36.593819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.782 [2024-11-26 19:18:36.593984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.782 [2024-11-26 19:18:36.594002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.782 qpair failed and we were unable to recover it. 00:32:19.782 [2024-11-26 19:18:36.594229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.782 [2024-11-26 19:18:36.594374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.782 [2024-11-26 19:18:36.594407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.782 qpair failed and we were unable to recover it. 00:32:19.782 [2024-11-26 19:18:36.594622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.782 [2024-11-26 19:18:36.594876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.782 [2024-11-26 19:18:36.594921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.782 qpair failed and we were unable to recover it. 00:32:19.782 [2024-11-26 19:18:36.595083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.782 [2024-11-26 19:18:36.595319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.782 [2024-11-26 19:18:36.595337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.782 qpair failed and we were unable to recover it. 00:32:19.782 [2024-11-26 19:18:36.595504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.782 [2024-11-26 19:18:36.595692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.782 [2024-11-26 19:18:36.595709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.782 qpair failed and we were unable to recover it. 00:32:19.782 [2024-11-26 19:18:36.595996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.782 [2024-11-26 19:18:36.596163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.782 [2024-11-26 19:18:36.596181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.782 qpair failed and we were unable to recover it. 00:32:19.782 [2024-11-26 19:18:36.596300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.782 [2024-11-26 19:18:36.596406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.782 [2024-11-26 19:18:36.596424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.782 qpair failed and we were unable to recover it. 00:32:19.782 [2024-11-26 19:18:36.596582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.782 [2024-11-26 19:18:36.596779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.782 [2024-11-26 19:18:36.596813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.782 qpair failed and we were unable to recover it. 00:32:19.782 [2024-11-26 19:18:36.597050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.782 [2024-11-26 19:18:36.597182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.782 [2024-11-26 19:18:36.597217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.782 qpair failed and we were unable to recover it. 00:32:19.782 [2024-11-26 19:18:36.597425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.782 [2024-11-26 19:18:36.597623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.782 [2024-11-26 19:18:36.597656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.782 qpair failed and we were unable to recover it. 00:32:19.782 [2024-11-26 19:18:36.597790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.782 [2024-11-26 19:18:36.597912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.783 [2024-11-26 19:18:36.597929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.783 qpair failed and we were unable to recover it. 00:32:19.783 [2024-11-26 19:18:36.598127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.783 [2024-11-26 19:18:36.598311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.783 [2024-11-26 19:18:36.598346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.783 qpair failed and we were unable to recover it. 00:32:19.783 [2024-11-26 19:18:36.598583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.783 [2024-11-26 19:18:36.598763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.783 [2024-11-26 19:18:36.598780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.783 qpair failed and we were unable to recover it. 00:32:19.783 [2024-11-26 19:18:36.598887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.783 [2024-11-26 19:18:36.599105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.783 [2024-11-26 19:18:36.599123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.783 qpair failed and we were unable to recover it. 00:32:19.783 [2024-11-26 19:18:36.599283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.783 [2024-11-26 19:18:36.599408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.783 [2024-11-26 19:18:36.599426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.783 qpair failed and we were unable to recover it. 00:32:19.783 [2024-11-26 19:18:36.599539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.783 [2024-11-26 19:18:36.599704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.783 [2024-11-26 19:18:36.599720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.783 qpair failed and we were unable to recover it. 00:32:19.783 [2024-11-26 19:18:36.599956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.783 [2024-11-26 19:18:36.600136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.783 [2024-11-26 19:18:36.600174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.783 qpair failed and we were unable to recover it. 00:32:19.783 [2024-11-26 19:18:36.600370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.783 [2024-11-26 19:18:36.600501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.783 [2024-11-26 19:18:36.600536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.783 qpair failed and we were unable to recover it. 00:32:19.783 [2024-11-26 19:18:36.600801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.783 [2024-11-26 19:18:36.601033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.783 [2024-11-26 19:18:36.601074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.783 qpair failed and we were unable to recover it. 00:32:19.783 [2024-11-26 19:18:36.601332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.783 [2024-11-26 19:18:36.601509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.783 [2024-11-26 19:18:36.601527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.783 qpair failed and we were unable to recover it. 00:32:19.783 [2024-11-26 19:18:36.601696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.783 [2024-11-26 19:18:36.601883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.783 [2024-11-26 19:18:36.601900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.783 qpair failed and we were unable to recover it. 00:32:19.783 [2024-11-26 19:18:36.602148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.783 [2024-11-26 19:18:36.602330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.783 [2024-11-26 19:18:36.602362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.783 qpair failed and we were unable to recover it. 00:32:19.783 [2024-11-26 19:18:36.603589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.783 [2024-11-26 19:18:36.603864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.783 [2024-11-26 19:18:36.603900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.783 qpair failed and we were unable to recover it. 00:32:19.783 [2024-11-26 19:18:36.604028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.783 [2024-11-26 19:18:36.604141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.783 [2024-11-26 19:18:36.604155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.783 qpair failed and we were unable to recover it. 00:32:19.783 [2024-11-26 19:18:36.604312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.783 [2024-11-26 19:18:36.604414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.783 [2024-11-26 19:18:36.604427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.783 qpair failed and we were unable to recover it. 00:32:19.783 [2024-11-26 19:18:36.604605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.783 [2024-11-26 19:18:36.604807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.783 [2024-11-26 19:18:36.604839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.783 qpair failed and we were unable to recover it. 00:32:19.783 [2024-11-26 19:18:36.605024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.783 [2024-11-26 19:18:36.605149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.783 [2024-11-26 19:18:36.605183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.783 qpair failed and we were unable to recover it. 00:32:19.783 [2024-11-26 19:18:36.605398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.783 [2024-11-26 19:18:36.605533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.783 [2024-11-26 19:18:36.605568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.783 qpair failed and we were unable to recover it. 00:32:19.783 [2024-11-26 19:18:36.605808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.783 [2024-11-26 19:18:36.606021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.783 [2024-11-26 19:18:36.606056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.783 qpair failed and we were unable to recover it. 00:32:19.783 [2024-11-26 19:18:36.606208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.783 [2024-11-26 19:18:36.606461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.783 [2024-11-26 19:18:36.606495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.783 qpair failed and we were unable to recover it. 00:32:19.783 [2024-11-26 19:18:36.606706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.783 [2024-11-26 19:18:36.606897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.783 [2024-11-26 19:18:36.606930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.783 qpair failed and we were unable to recover it. 00:32:19.784 [2024-11-26 19:18:36.607132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.784 [2024-11-26 19:18:36.607326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.784 [2024-11-26 19:18:36.607358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.784 qpair failed and we were unable to recover it. 00:32:19.784 [2024-11-26 19:18:36.607623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.784 [2024-11-26 19:18:36.607876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.784 [2024-11-26 19:18:36.607923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:19.784 qpair failed and we were unable to recover it. 00:32:19.784 [2024-11-26 19:18:36.608103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.784 [2024-11-26 19:18:36.608329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.784 [2024-11-26 19:18:36.608352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:19.784 qpair failed and we were unable to recover it. 00:32:19.784 [2024-11-26 19:18:36.608651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.784 [2024-11-26 19:18:36.608783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.784 [2024-11-26 19:18:36.608816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.784 qpair failed and we were unable to recover it. 00:32:19.784 [2024-11-26 19:18:36.609563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.784 [2024-11-26 19:18:36.609836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.784 [2024-11-26 19:18:36.609856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.784 qpair failed and we were unable to recover it. 00:32:19.784 [2024-11-26 19:18:36.609974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.784 [2024-11-26 19:18:36.610142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.784 [2024-11-26 19:18:36.610160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.784 qpair failed and we were unable to recover it. 00:32:19.784 [2024-11-26 19:18:36.610365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.784 [2024-11-26 19:18:36.610531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.784 [2024-11-26 19:18:36.610549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.784 qpair failed and we were unable to recover it. 00:32:19.784 [2024-11-26 19:18:36.610720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.784 [2024-11-26 19:18:36.610933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.784 [2024-11-26 19:18:36.610958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.784 qpair failed and we were unable to recover it. 00:32:19.784 [2024-11-26 19:18:36.611131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.784 [2024-11-26 19:18:36.611358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.784 [2024-11-26 19:18:36.611375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.784 qpair failed and we were unable to recover it. 00:32:19.784 [2024-11-26 19:18:36.611598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.784 [2024-11-26 19:18:36.611820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.784 [2024-11-26 19:18:36.611839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.784 qpair failed and we were unable to recover it. 00:32:19.784 [2024-11-26 19:18:36.612022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.784 [2024-11-26 19:18:36.612124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.784 [2024-11-26 19:18:36.612141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.784 qpair failed and we were unable to recover it. 00:32:19.784 [2024-11-26 19:18:36.612305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.784 [2024-11-26 19:18:36.612451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.784 [2024-11-26 19:18:36.612486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.784 qpair failed and we were unable to recover it. 00:32:19.784 [2024-11-26 19:18:36.612689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.784 [2024-11-26 19:18:36.612899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.784 [2024-11-26 19:18:36.612934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.784 qpair failed and we were unable to recover it. 00:32:19.784 [2024-11-26 19:18:36.613158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.784 [2024-11-26 19:18:36.613313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.784 [2024-11-26 19:18:36.613330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.784 qpair failed and we were unable to recover it. 00:32:19.784 [2024-11-26 19:18:36.613494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.784 [2024-11-26 19:18:36.613698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.784 [2024-11-26 19:18:36.613715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.784 qpair failed and we were unable to recover it. 00:32:19.784 [2024-11-26 19:18:36.613885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.784 [2024-11-26 19:18:36.614007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.784 [2024-11-26 19:18:36.614036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.784 qpair failed and we were unable to recover it. 00:32:19.784 [2024-11-26 19:18:36.614202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.784 [2024-11-26 19:18:36.614443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.784 [2024-11-26 19:18:36.614461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.784 qpair failed and we were unable to recover it. 00:32:19.784 [2024-11-26 19:18:36.614694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.784 [2024-11-26 19:18:36.614909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.784 [2024-11-26 19:18:36.614943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.785 qpair failed and we were unable to recover it. 00:32:19.785 [2024-11-26 19:18:36.615117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.785 [2024-11-26 19:18:36.615378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.785 [2024-11-26 19:18:36.615413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.785 qpair failed and we were unable to recover it. 00:32:19.785 [2024-11-26 19:18:36.615539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.785 [2024-11-26 19:18:36.615816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.785 [2024-11-26 19:18:36.615849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.785 qpair failed and we were unable to recover it. 00:32:19.785 [2024-11-26 19:18:36.616013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.785 [2024-11-26 19:18:36.616210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.785 [2024-11-26 19:18:36.616243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.785 qpair failed and we were unable to recover it. 00:32:19.785 [2024-11-26 19:18:36.616461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.785 [2024-11-26 19:18:36.617582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.785 [2024-11-26 19:18:36.617623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.785 qpair failed and we were unable to recover it. 00:32:19.785 [2024-11-26 19:18:36.617830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.785 [2024-11-26 19:18:36.617991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.785 [2024-11-26 19:18:36.618010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.785 qpair failed and we were unable to recover it. 00:32:19.785 [2024-11-26 19:18:36.618137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.785 [2024-11-26 19:18:36.618258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.785 [2024-11-26 19:18:36.618275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.785 qpair failed and we were unable to recover it. 00:32:19.785 [2024-11-26 19:18:36.618489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.785 [2024-11-26 19:18:36.618740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.785 [2024-11-26 19:18:36.618774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.785 qpair failed and we were unable to recover it. 00:32:19.785 [2024-11-26 19:18:36.618979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.785 [2024-11-26 19:18:36.619178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.785 [2024-11-26 19:18:36.619196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.785 qpair failed and we were unable to recover it. 00:32:19.785 [2024-11-26 19:18:36.619375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.785 [2024-11-26 19:18:36.619590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.785 [2024-11-26 19:18:36.619623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.785 qpair failed and we were unable to recover it. 00:32:19.785 [2024-11-26 19:18:36.619824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.785 [2024-11-26 19:18:36.620076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.785 [2024-11-26 19:18:36.620110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.785 qpair failed and we were unable to recover it. 00:32:19.785 [2024-11-26 19:18:36.620340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.785 [2024-11-26 19:18:36.620552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.785 [2024-11-26 19:18:36.620586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.785 qpair failed and we were unable to recover it. 00:32:19.785 [2024-11-26 19:18:36.620828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.785 [2024-11-26 19:18:36.620999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.785 [2024-11-26 19:18:36.621018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.785 qpair failed and we were unable to recover it. 00:32:19.785 [2024-11-26 19:18:36.621267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.785 [2024-11-26 19:18:36.621387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.785 [2024-11-26 19:18:36.621405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.785 qpair failed and we were unable to recover it. 00:32:19.785 [2024-11-26 19:18:36.621588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.785 [2024-11-26 19:18:36.621694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.785 [2024-11-26 19:18:36.621711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.785 qpair failed and we were unable to recover it. 00:32:19.785 [2024-11-26 19:18:36.621934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.785 [2024-11-26 19:18:36.622109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.785 [2024-11-26 19:18:36.622128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.785 qpair failed and we were unable to recover it. 00:32:19.785 [2024-11-26 19:18:36.622250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.785 [2024-11-26 19:18:36.622350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.785 [2024-11-26 19:18:36.622368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.785 qpair failed and we were unable to recover it. 00:32:19.785 [2024-11-26 19:18:36.622536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.785 [2024-11-26 19:18:36.622774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.785 [2024-11-26 19:18:36.622806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.785 qpair failed and we were unable to recover it. 00:32:19.785 [2024-11-26 19:18:36.623082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.785 [2024-11-26 19:18:36.623224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.785 [2024-11-26 19:18:36.623257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.785 qpair failed and we were unable to recover it. 00:32:19.785 [2024-11-26 19:18:36.623455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.785 [2024-11-26 19:18:36.623789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.786 [2024-11-26 19:18:36.623822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.786 qpair failed and we were unable to recover it. 00:32:19.786 [2024-11-26 19:18:36.624053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.786 [2024-11-26 19:18:36.624307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.786 [2024-11-26 19:18:36.624342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.786 qpair failed and we were unable to recover it. 00:32:19.786 [2024-11-26 19:18:36.624525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.786 [2024-11-26 19:18:36.624789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.786 [2024-11-26 19:18:36.624824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.786 qpair failed and we were unable to recover it. 00:32:19.786 [2024-11-26 19:18:36.624995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.786 [2024-11-26 19:18:36.625213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.786 [2024-11-26 19:18:36.625248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.786 qpair failed and we were unable to recover it. 00:32:19.786 [2024-11-26 19:18:36.625399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.786 [2024-11-26 19:18:36.625595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.786 [2024-11-26 19:18:36.625629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.786 qpair failed and we were unable to recover it. 00:32:19.786 [2024-11-26 19:18:36.625764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.786 [2024-11-26 19:18:36.626077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.786 [2024-11-26 19:18:36.626095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.786 qpair failed and we were unable to recover it. 00:32:19.786 [2024-11-26 19:18:36.626328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.786 [2024-11-26 19:18:36.626516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.786 [2024-11-26 19:18:36.626550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.786 qpair failed and we were unable to recover it. 00:32:19.786 [2024-11-26 19:18:36.626807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.786 [2024-11-26 19:18:36.626992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.786 [2024-11-26 19:18:36.627030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.786 qpair failed and we were unable to recover it. 00:32:19.786 [2024-11-26 19:18:36.627230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.786 [2024-11-26 19:18:36.627482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.786 [2024-11-26 19:18:36.627516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.786 qpair failed and we were unable to recover it. 00:32:19.786 [2024-11-26 19:18:36.627857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.786 [2024-11-26 19:18:36.628097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.786 [2024-11-26 19:18:36.628116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.786 qpair failed and we were unable to recover it. 00:32:19.786 [2024-11-26 19:18:36.628349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.786 [2024-11-26 19:18:36.628459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.786 [2024-11-26 19:18:36.628476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.786 qpair failed and we were unable to recover it. 00:32:19.786 [2024-11-26 19:18:36.628633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.786 [2024-11-26 19:18:36.628902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.786 [2024-11-26 19:18:36.628937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.786 qpair failed and we were unable to recover it. 00:32:19.786 [2024-11-26 19:18:36.629224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.786 [2024-11-26 19:18:36.630531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.786 [2024-11-26 19:18:36.630565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.786 qpair failed and we were unable to recover it. 00:32:19.786 [2024-11-26 19:18:36.630823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.786 [2024-11-26 19:18:36.631091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.786 [2024-11-26 19:18:36.631126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.786 qpair failed and we were unable to recover it. 00:32:19.786 [2024-11-26 19:18:36.632381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.786 [2024-11-26 19:18:36.632588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.786 [2024-11-26 19:18:36.632626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.786 qpair failed and we were unable to recover it. 00:32:19.786 [2024-11-26 19:18:36.632841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.786 [2024-11-26 19:18:36.633092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.786 [2024-11-26 19:18:36.633128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:19.786 qpair failed and we were unable to recover it. 00:32:19.786 [2024-11-26 19:18:36.633348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.786 [2024-11-26 19:18:36.633516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.786 [2024-11-26 19:18:36.633557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.786 qpair failed and we were unable to recover it. 00:32:19.786 [2024-11-26 19:18:36.633821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.786 [2024-11-26 19:18:36.633977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.786 [2024-11-26 19:18:36.634012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.786 qpair failed and we were unable to recover it. 00:32:19.786 [2024-11-26 19:18:36.634214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.786 [2024-11-26 19:18:36.634323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.786 [2024-11-26 19:18:36.634335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.786 qpair failed and we were unable to recover it. 00:32:19.786 [2024-11-26 19:18:36.634549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.786 [2024-11-26 19:18:36.634762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.786 [2024-11-26 19:18:36.634795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.786 qpair failed and we were unable to recover it. 00:32:19.786 [2024-11-26 19:18:36.635004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.786 [2024-11-26 19:18:36.635131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.786 [2024-11-26 19:18:36.635164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.786 qpair failed and we were unable to recover it. 00:32:19.786 [2024-11-26 19:18:36.635358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.786 [2024-11-26 19:18:36.635614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.786 [2024-11-26 19:18:36.635626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.786 qpair failed and we were unable to recover it. 00:32:19.786 [2024-11-26 19:18:36.635808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.786 [2024-11-26 19:18:36.635885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.786 [2024-11-26 19:18:36.635898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.786 qpair failed and we were unable to recover it. 00:32:19.786 [2024-11-26 19:18:36.636064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.786 [2024-11-26 19:18:36.636235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.787 [2024-11-26 19:18:36.636269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.787 qpair failed and we were unable to recover it. 00:32:19.787 [2024-11-26 19:18:36.636470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.787 [2024-11-26 19:18:36.636611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.787 [2024-11-26 19:18:36.636644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.787 qpair failed and we were unable to recover it. 00:32:19.787 [2024-11-26 19:18:36.636791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.787 [2024-11-26 19:18:36.636986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.787 [2024-11-26 19:18:36.637021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.787 qpair failed and we were unable to recover it. 00:32:19.787 [2024-11-26 19:18:36.637221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.787 [2024-11-26 19:18:36.637360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.787 [2024-11-26 19:18:36.637372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.787 qpair failed and we were unable to recover it. 00:32:19.787 [2024-11-26 19:18:36.637448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.787 [2024-11-26 19:18:36.637708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.787 [2024-11-26 19:18:36.637721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.787 qpair failed and we were unable to recover it. 00:32:19.787 [2024-11-26 19:18:36.637861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.787 [2024-11-26 19:18:36.637960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.787 [2024-11-26 19:18:36.637971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.787 qpair failed and we were unable to recover it. 00:32:19.787 [2024-11-26 19:18:36.638131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.787 [2024-11-26 19:18:36.638289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.787 [2024-11-26 19:18:36.638302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.787 qpair failed and we were unable to recover it. 00:32:19.787 [2024-11-26 19:18:36.638449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.787 [2024-11-26 19:18:36.638558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.787 [2024-11-26 19:18:36.638570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.787 qpair failed and we were unable to recover it. 00:32:19.787 [2024-11-26 19:18:36.638656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.787 [2024-11-26 19:18:36.638800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.787 [2024-11-26 19:18:36.638813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.787 qpair failed and we were unable to recover it. 00:32:19.787 [2024-11-26 19:18:36.639043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.787 [2024-11-26 19:18:36.639576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.787 [2024-11-26 19:18:36.639609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.787 qpair failed and we were unable to recover it. 00:32:19.787 [2024-11-26 19:18:36.639850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.787 [2024-11-26 19:18:36.640082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.787 [2024-11-26 19:18:36.640098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.787 qpair failed and we were unable to recover it. 00:32:19.787 [2024-11-26 19:18:36.640203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.787 [2024-11-26 19:18:36.640294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.787 [2024-11-26 19:18:36.640306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.787 qpair failed and we were unable to recover it. 00:32:19.787 [2024-11-26 19:18:36.640395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.787 [2024-11-26 19:18:36.640489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.787 [2024-11-26 19:18:36.640522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.787 qpair failed and we were unable to recover it. 00:32:19.787 [2024-11-26 19:18:36.640734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.787 [2024-11-26 19:18:36.640933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.787 [2024-11-26 19:18:36.640945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.787 qpair failed and we were unable to recover it. 00:32:19.787 [2024-11-26 19:18:36.641065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.787 [2024-11-26 19:18:36.641153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.787 [2024-11-26 19:18:36.641167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.787 qpair failed and we were unable to recover it. 00:32:19.787 [2024-11-26 19:18:36.641262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.787 [2024-11-26 19:18:36.641409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.787 [2024-11-26 19:18:36.641440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.787 qpair failed and we were unable to recover it. 00:32:19.787 [2024-11-26 19:18:36.641558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.787 [2024-11-26 19:18:36.641689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.787 [2024-11-26 19:18:36.641723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.787 qpair failed and we were unable to recover it. 00:32:19.787 [2024-11-26 19:18:36.641854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.787 [2024-11-26 19:18:36.642051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.787 [2024-11-26 19:18:36.642085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.787 qpair failed and we were unable to recover it. 00:32:19.787 [2024-11-26 19:18:36.642269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.787 [2024-11-26 19:18:36.642403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.787 [2024-11-26 19:18:36.642434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.787 qpair failed and we were unable to recover it. 00:32:19.787 [2024-11-26 19:18:36.642637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.787 [2024-11-26 19:18:36.642909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.787 [2024-11-26 19:18:36.642956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.787 qpair failed and we were unable to recover it. 00:32:19.787 [2024-11-26 19:18:36.643047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.787 [2024-11-26 19:18:36.643190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.787 [2024-11-26 19:18:36.643203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.787 qpair failed and we were unable to recover it. 00:32:19.787 [2024-11-26 19:18:36.643302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.787 [2024-11-26 19:18:36.643373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.787 [2024-11-26 19:18:36.643386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.787 qpair failed and we were unable to recover it. 00:32:19.787 [2024-11-26 19:18:36.643476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.787 [2024-11-26 19:18:36.643719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.787 [2024-11-26 19:18:36.643751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.787 qpair failed and we were unable to recover it. 00:32:19.787 [2024-11-26 19:18:36.644030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.787 [2024-11-26 19:18:36.644122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.788 [2024-11-26 19:18:36.644151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.788 qpair failed and we were unable to recover it. 00:32:19.788 [2024-11-26 19:18:36.644341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.788 [2024-11-26 19:18:36.644479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.788 [2024-11-26 19:18:36.644510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.788 qpair failed and we were unable to recover it. 00:32:19.788 [2024-11-26 19:18:36.644631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.788 [2024-11-26 19:18:36.644807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.788 [2024-11-26 19:18:36.644839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.788 qpair failed and we were unable to recover it. 00:32:19.788 [2024-11-26 19:18:36.645110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.788 [2024-11-26 19:18:36.645214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.788 [2024-11-26 19:18:36.645225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.788 qpair failed and we were unable to recover it. 00:32:19.788 [2024-11-26 19:18:36.645300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.788 [2024-11-26 19:18:36.645380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.788 [2024-11-26 19:18:36.645410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.788 qpair failed and we were unable to recover it. 00:32:19.788 [2024-11-26 19:18:36.645636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.788 [2024-11-26 19:18:36.645769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.788 [2024-11-26 19:18:36.645803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.788 qpair failed and we were unable to recover it. 00:32:19.788 [2024-11-26 19:18:36.646001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.788 [2024-11-26 19:18:36.646069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.788 [2024-11-26 19:18:36.646080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.788 qpair failed and we were unable to recover it. 00:32:19.788 [2024-11-26 19:18:36.646239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.788 [2024-11-26 19:18:36.646345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.788 [2024-11-26 19:18:36.646376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.788 qpair failed and we were unable to recover it. 00:32:19.788 [2024-11-26 19:18:36.646497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.788 [2024-11-26 19:18:36.646767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.788 [2024-11-26 19:18:36.646800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.788 qpair failed and we were unable to recover it. 00:32:19.788 [2024-11-26 19:18:36.647085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.788 [2024-11-26 19:18:36.647159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.788 [2024-11-26 19:18:36.647171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.788 qpair failed and we were unable to recover it. 00:32:19.788 [2024-11-26 19:18:36.647274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.788 [2024-11-26 19:18:36.647386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.788 [2024-11-26 19:18:36.647418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.788 qpair failed and we were unable to recover it. 00:32:19.788 [2024-11-26 19:18:36.647545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.788 [2024-11-26 19:18:36.647677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.788 [2024-11-26 19:18:36.647709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.788 qpair failed and we were unable to recover it. 00:32:19.788 [2024-11-26 19:18:36.647902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.788 [2024-11-26 19:18:36.648801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.788 [2024-11-26 19:18:36.648829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.788 qpair failed and we were unable to recover it. 00:32:19.788 [2024-11-26 19:18:36.649102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.788 [2024-11-26 19:18:36.649347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.788 [2024-11-26 19:18:36.649381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.788 qpair failed and we were unable to recover it. 00:32:19.788 [2024-11-26 19:18:36.649538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.788 [2024-11-26 19:18:36.650876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.788 [2024-11-26 19:18:36.650906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.788 qpair failed and we were unable to recover it. 00:32:19.788 [2024-11-26 19:18:36.651186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.788 [2024-11-26 19:18:36.651292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.788 [2024-11-26 19:18:36.651307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.788 qpair failed and we were unable to recover it. 00:32:19.788 [2024-11-26 19:18:36.651518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.788 [2024-11-26 19:18:36.651639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.788 [2024-11-26 19:18:36.651652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.788 qpair failed and we were unable to recover it. 00:32:19.788 [2024-11-26 19:18:36.651756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.788 [2024-11-26 19:18:36.651925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.788 [2024-11-26 19:18:36.651938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.788 qpair failed and we were unable to recover it. 00:32:19.788 [2024-11-26 19:18:36.652052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.788 [2024-11-26 19:18:36.652147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.788 [2024-11-26 19:18:36.652159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.788 qpair failed and we were unable to recover it. 00:32:19.788 [2024-11-26 19:18:36.652256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.788 [2024-11-26 19:18:36.652355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.788 [2024-11-26 19:18:36.652367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.788 qpair failed and we were unable to recover it. 00:32:19.788 [2024-11-26 19:18:36.652498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.788 [2024-11-26 19:18:36.652631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.788 [2024-11-26 19:18:36.652665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.788 qpair failed and we were unable to recover it. 00:32:19.788 [2024-11-26 19:18:36.652799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.788 [2024-11-26 19:18:36.652986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.788 [2024-11-26 19:18:36.653021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.788 qpair failed and we were unable to recover it. 00:32:19.788 [2024-11-26 19:18:36.653156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.788 [2024-11-26 19:18:36.653246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.788 [2024-11-26 19:18:36.653260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.788 qpair failed and we were unable to recover it. 00:32:19.788 [2024-11-26 19:18:36.653345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.789 [2024-11-26 19:18:36.653447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.789 [2024-11-26 19:18:36.653461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.789 qpair failed and we were unable to recover it. 00:32:19.789 [2024-11-26 19:18:36.653574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.789 [2024-11-26 19:18:36.653745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.789 [2024-11-26 19:18:36.653758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.789 qpair failed and we were unable to recover it. 00:32:19.789 [2024-11-26 19:18:36.653853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.789 [2024-11-26 19:18:36.653914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.789 [2024-11-26 19:18:36.653926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.789 qpair failed and we were unable to recover it. 00:32:19.789 [2024-11-26 19:18:36.654030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.789 [2024-11-26 19:18:36.654178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.789 [2024-11-26 19:18:36.654192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.789 qpair failed and we were unable to recover it. 00:32:19.789 [2024-11-26 19:18:36.654343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.789 [2024-11-26 19:18:36.654417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.789 [2024-11-26 19:18:36.654431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.789 qpair failed and we were unable to recover it. 00:32:19.789 [2024-11-26 19:18:36.654502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.789 [2024-11-26 19:18:36.654589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.789 [2024-11-26 19:18:36.654600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.789 qpair failed and we were unable to recover it. 00:32:19.789 [2024-11-26 19:18:36.654675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.789 [2024-11-26 19:18:36.654808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.789 [2024-11-26 19:18:36.654842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.789 qpair failed and we were unable to recover it. 00:32:19.789 [2024-11-26 19:18:36.654973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.789 [2024-11-26 19:18:36.655100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.789 [2024-11-26 19:18:36.655140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.789 qpair failed and we were unable to recover it. 00:32:19.789 [2024-11-26 19:18:36.655339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.789 [2024-11-26 19:18:36.655464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.789 [2024-11-26 19:18:36.655496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.789 qpair failed and we were unable to recover it. 00:32:19.789 [2024-11-26 19:18:36.655645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.789 [2024-11-26 19:18:36.655830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.789 [2024-11-26 19:18:36.655864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.789 qpair failed and we were unable to recover it. 00:32:19.789 [2024-11-26 19:18:36.655977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.789 [2024-11-26 19:18:36.656078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.789 [2024-11-26 19:18:36.656091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.789 qpair failed and we were unable to recover it. 00:32:19.789 [2024-11-26 19:18:36.656188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.789 [2024-11-26 19:18:36.656343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.789 [2024-11-26 19:18:36.656357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.789 qpair failed and we were unable to recover it. 00:32:19.789 [2024-11-26 19:18:36.656524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.789 [2024-11-26 19:18:36.657027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.789 [2024-11-26 19:18:36.657054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.789 qpair failed and we were unable to recover it. 00:32:19.789 [2024-11-26 19:18:36.657146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.789 [2024-11-26 19:18:36.657301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.789 [2024-11-26 19:18:36.657314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.789 qpair failed and we were unable to recover it. 00:32:19.789 [2024-11-26 19:18:36.657461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.789 [2024-11-26 19:18:36.657603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.789 [2024-11-26 19:18:36.657636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.789 qpair failed and we were unable to recover it. 00:32:19.789 [2024-11-26 19:18:36.657831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.789 [2024-11-26 19:18:36.657971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.789 [2024-11-26 19:18:36.658008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.789 qpair failed and we were unable to recover it. 00:32:19.789 [2024-11-26 19:18:36.658234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.789 [2024-11-26 19:18:36.658378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.789 [2024-11-26 19:18:36.658391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.789 qpair failed and we were unable to recover it. 00:32:19.789 [2024-11-26 19:18:36.658469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.789 [2024-11-26 19:18:36.658539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.789 [2024-11-26 19:18:36.658555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.789 qpair failed and we were unable to recover it. 00:32:19.789 [2024-11-26 19:18:36.658643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.789 [2024-11-26 19:18:36.658713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.789 [2024-11-26 19:18:36.658750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.789 qpair failed and we were unable to recover it. 00:32:19.789 [2024-11-26 19:18:36.658884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.789 [2024-11-26 19:18:36.659004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.789 [2024-11-26 19:18:36.659040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.789 qpair failed and we were unable to recover it. 00:32:19.789 [2024-11-26 19:18:36.659160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.789 [2024-11-26 19:18:36.659293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.789 [2024-11-26 19:18:36.659327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.789 qpair failed and we were unable to recover it. 00:32:19.789 [2024-11-26 19:18:36.659465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.789 [2024-11-26 19:18:36.660015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.789 [2024-11-26 19:18:36.660034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.789 qpair failed and we were unable to recover it. 00:32:19.789 [2024-11-26 19:18:36.660130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.789 [2024-11-26 19:18:36.660398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.790 [2024-11-26 19:18:36.660412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.790 qpair failed and we were unable to recover it. 00:32:19.790 [2024-11-26 19:18:36.660498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.790 [2024-11-26 19:18:36.660574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.790 [2024-11-26 19:18:36.660586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.790 qpair failed and we were unable to recover it. 00:32:19.790 [2024-11-26 19:18:36.660672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.790 [2024-11-26 19:18:36.660756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.790 [2024-11-26 19:18:36.660769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.790 qpair failed and we were unable to recover it. 00:32:19.790 [2024-11-26 19:18:36.660987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.790 [2024-11-26 19:18:36.661073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.790 [2024-11-26 19:18:36.661087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.790 qpair failed and we were unable to recover it. 00:32:19.790 [2024-11-26 19:18:36.661235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.790 [2024-11-26 19:18:36.661332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.790 [2024-11-26 19:18:36.661345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.790 qpair failed and we were unable to recover it. 00:32:19.790 [2024-11-26 19:18:36.661436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.790 [2024-11-26 19:18:36.661525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.790 [2024-11-26 19:18:36.661548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.790 qpair failed and we were unable to recover it. 00:32:19.790 [2024-11-26 19:18:36.661629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.790 [2024-11-26 19:18:36.661698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.790 [2024-11-26 19:18:36.661710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.790 qpair failed and we were unable to recover it. 00:32:19.790 [2024-11-26 19:18:36.661806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.790 [2024-11-26 19:18:36.661894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.790 [2024-11-26 19:18:36.661906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.790 qpair failed and we were unable to recover it. 00:32:19.790 [2024-11-26 19:18:36.661987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.790 [2024-11-26 19:18:36.662125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.790 [2024-11-26 19:18:36.662138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.790 qpair failed and we were unable to recover it. 00:32:19.790 [2024-11-26 19:18:36.662234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.790 [2024-11-26 19:18:36.662375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.790 [2024-11-26 19:18:36.662387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.790 qpair failed and we were unable to recover it. 00:32:19.790 [2024-11-26 19:18:36.662476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.790 [2024-11-26 19:18:36.662643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.790 [2024-11-26 19:18:36.662656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.790 qpair failed and we were unable to recover it. 00:32:19.790 [2024-11-26 19:18:36.662741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.790 [2024-11-26 19:18:36.662826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.790 [2024-11-26 19:18:36.662837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.790 qpair failed and we were unable to recover it. 00:32:19.790 [2024-11-26 19:18:36.662902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.790 [2024-11-26 19:18:36.662990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.790 [2024-11-26 19:18:36.663002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.790 qpair failed and we were unable to recover it. 00:32:19.790 [2024-11-26 19:18:36.663074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.790 [2024-11-26 19:18:36.663143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.790 [2024-11-26 19:18:36.663155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.790 qpair failed and we were unable to recover it. 00:32:19.790 [2024-11-26 19:18:36.663227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.790 [2024-11-26 19:18:36.663298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.790 [2024-11-26 19:18:36.663310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.790 qpair failed and we were unable to recover it. 00:32:19.790 [2024-11-26 19:18:36.663380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.790 [2024-11-26 19:18:36.663524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.790 [2024-11-26 19:18:36.663536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.790 qpair failed and we were unable to recover it. 00:32:19.790 [2024-11-26 19:18:36.663692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.790 [2024-11-26 19:18:36.663762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.790 [2024-11-26 19:18:36.663775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.790 qpair failed and we were unable to recover it. 00:32:19.790 [2024-11-26 19:18:36.663845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.790 [2024-11-26 19:18:36.663916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.790 [2024-11-26 19:18:36.663928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.790 qpair failed and we were unable to recover it. 00:32:19.790 [2024-11-26 19:18:36.664011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.790 [2024-11-26 19:18:36.664077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.790 [2024-11-26 19:18:36.664088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.790 qpair failed and we were unable to recover it. 00:32:19.791 [2024-11-26 19:18:36.664268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.791 [2024-11-26 19:18:36.664351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.791 [2024-11-26 19:18:36.664365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.791 qpair failed and we were unable to recover it. 00:32:19.791 [2024-11-26 19:18:36.664436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.791 [2024-11-26 19:18:36.664504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.791 [2024-11-26 19:18:36.664516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.791 qpair failed and we were unable to recover it. 00:32:19.791 [2024-11-26 19:18:36.664651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.791 [2024-11-26 19:18:36.664726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.791 [2024-11-26 19:18:36.664739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.791 qpair failed and we were unable to recover it. 00:32:19.791 [2024-11-26 19:18:36.664820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.791 [2024-11-26 19:18:36.664887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.791 [2024-11-26 19:18:36.664901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.791 qpair failed and we were unable to recover it. 00:32:19.791 [2024-11-26 19:18:36.664992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.791 [2024-11-26 19:18:36.665059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.791 [2024-11-26 19:18:36.665072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.791 qpair failed and we were unable to recover it. 00:32:19.791 [2024-11-26 19:18:36.665150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.791 [2024-11-26 19:18:36.665235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.791 [2024-11-26 19:18:36.665249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.791 qpair failed and we were unable to recover it. 00:32:19.791 [2024-11-26 19:18:36.665351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.791 [2024-11-26 19:18:36.665421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.791 [2024-11-26 19:18:36.665433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.791 qpair failed and we were unable to recover it. 00:32:19.791 [2024-11-26 19:18:36.665511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.791 [2024-11-26 19:18:36.665578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.791 [2024-11-26 19:18:36.665591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.791 qpair failed and we were unable to recover it. 00:32:19.791 [2024-11-26 19:18:36.665732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.791 [2024-11-26 19:18:36.665813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.791 [2024-11-26 19:18:36.665827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.791 qpair failed and we were unable to recover it. 00:32:19.791 [2024-11-26 19:18:36.665906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.791 [2024-11-26 19:18:36.665976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.791 [2024-11-26 19:18:36.665989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.791 qpair failed and we were unable to recover it. 00:32:19.791 [2024-11-26 19:18:36.666067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.791 [2024-11-26 19:18:36.666136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.791 [2024-11-26 19:18:36.666147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.791 qpair failed and we were unable to recover it. 00:32:19.791 [2024-11-26 19:18:36.666226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.791 [2024-11-26 19:18:36.666292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.791 [2024-11-26 19:18:36.666304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.791 qpair failed and we were unable to recover it. 00:32:19.791 [2024-11-26 19:18:36.666369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.791 [2024-11-26 19:18:36.666443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.791 [2024-11-26 19:18:36.666454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.791 qpair failed and we were unable to recover it. 00:32:19.791 [2024-11-26 19:18:36.666538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.791 [2024-11-26 19:18:36.666602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.791 [2024-11-26 19:18:36.666615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.791 qpair failed and we were unable to recover it. 00:32:19.791 [2024-11-26 19:18:36.666774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.791 [2024-11-26 19:18:36.666914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.791 [2024-11-26 19:18:36.666926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.791 qpair failed and we were unable to recover it. 00:32:19.791 [2024-11-26 19:18:36.667004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.791 [2024-11-26 19:18:36.667071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.791 [2024-11-26 19:18:36.667082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.791 qpair failed and we were unable to recover it. 00:32:19.791 [2024-11-26 19:18:36.667148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.791 [2024-11-26 19:18:36.667212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.791 [2024-11-26 19:18:36.667224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.791 qpair failed and we were unable to recover it. 00:32:19.791 [2024-11-26 19:18:36.667291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.791 [2024-11-26 19:18:36.667433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.791 [2024-11-26 19:18:36.667446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.791 qpair failed and we were unable to recover it. 00:32:19.791 [2024-11-26 19:18:36.667527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.791 [2024-11-26 19:18:36.667603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.791 [2024-11-26 19:18:36.667614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.791 qpair failed and we were unable to recover it. 00:32:19.791 [2024-11-26 19:18:36.667714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.791 [2024-11-26 19:18:36.667855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.791 [2024-11-26 19:18:36.667868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.791 qpair failed and we were unable to recover it. 00:32:19.791 [2024-11-26 19:18:36.667963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.791 [2024-11-26 19:18:36.668036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.791 [2024-11-26 19:18:36.668049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.791 qpair failed and we were unable to recover it. 00:32:19.791 [2024-11-26 19:18:36.668116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.791 [2024-11-26 19:18:36.668181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.791 [2024-11-26 19:18:36.668192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.791 qpair failed and we were unable to recover it. 00:32:19.791 [2024-11-26 19:18:36.668260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.791 [2024-11-26 19:18:36.668331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.791 [2024-11-26 19:18:36.668342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.791 qpair failed and we were unable to recover it. 00:32:19.791 [2024-11-26 19:18:36.668412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.791 [2024-11-26 19:18:36.668548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.791 [2024-11-26 19:18:36.668560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.791 qpair failed and we were unable to recover it. 00:32:19.791 [2024-11-26 19:18:36.668631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.791 [2024-11-26 19:18:36.668693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.791 [2024-11-26 19:18:36.668704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.792 qpair failed and we were unable to recover it. 00:32:19.792 [2024-11-26 19:18:36.668785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.792 [2024-11-26 19:18:36.668850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.792 [2024-11-26 19:18:36.668861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.792 qpair failed and we were unable to recover it. 00:32:19.792 [2024-11-26 19:18:36.669007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.792 [2024-11-26 19:18:36.669087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.792 [2024-11-26 19:18:36.669099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.792 qpair failed and we were unable to recover it. 00:32:19.792 [2024-11-26 19:18:36.669245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.792 [2024-11-26 19:18:36.669322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.792 [2024-11-26 19:18:36.669336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.792 qpair failed and we were unable to recover it. 00:32:19.792 [2024-11-26 19:18:36.669429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.792 [2024-11-26 19:18:36.669501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.792 [2024-11-26 19:18:36.669514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.792 qpair failed and we were unable to recover it. 00:32:19.792 [2024-11-26 19:18:36.669599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.792 [2024-11-26 19:18:36.669683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.792 [2024-11-26 19:18:36.669696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.792 qpair failed and we were unable to recover it. 00:32:19.792 [2024-11-26 19:18:36.669781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.792 [2024-11-26 19:18:36.669849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.792 [2024-11-26 19:18:36.669860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.792 qpair failed and we were unable to recover it. 00:32:19.792 [2024-11-26 19:18:36.669927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.792 [2024-11-26 19:18:36.670013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.792 [2024-11-26 19:18:36.670025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.792 qpair failed and we were unable to recover it. 00:32:19.792 [2024-11-26 19:18:36.670107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.792 [2024-11-26 19:18:36.670187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.792 [2024-11-26 19:18:36.670200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.792 qpair failed and we were unable to recover it. 00:32:19.792 [2024-11-26 19:18:36.670337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.792 [2024-11-26 19:18:36.670417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.792 [2024-11-26 19:18:36.670430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.792 qpair failed and we were unable to recover it. 00:32:19.792 [2024-11-26 19:18:36.670501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.792 [2024-11-26 19:18:36.670575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.792 [2024-11-26 19:18:36.670587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.792 qpair failed and we were unable to recover it. 00:32:19.792 [2024-11-26 19:18:36.670663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.792 [2024-11-26 19:18:36.670810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.792 [2024-11-26 19:18:36.670823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.792 qpair failed and we were unable to recover it. 00:32:19.792 [2024-11-26 19:18:36.670917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.792 [2024-11-26 19:18:36.670985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:19.792 [2024-11-26 19:18:36.670997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:19.792 qpair failed and we were unable to recover it. 00:32:19.792 [2024-11-26 19:18:36.671065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.077 [2024-11-26 19:18:36.671138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.077 [2024-11-26 19:18:36.671150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.077 qpair failed and we were unable to recover it. 00:32:20.077 [2024-11-26 19:18:36.671243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.077 [2024-11-26 19:18:36.671314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.078 [2024-11-26 19:18:36.671327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.078 qpair failed and we were unable to recover it. 00:32:20.078 [2024-11-26 19:18:36.671425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.078 [2024-11-26 19:18:36.671520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.078 [2024-11-26 19:18:36.671534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.078 qpair failed and we were unable to recover it. 00:32:20.078 [2024-11-26 19:18:36.671614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.078 [2024-11-26 19:18:36.671679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.078 [2024-11-26 19:18:36.671692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.078 qpair failed and we were unable to recover it. 00:32:20.078 [2024-11-26 19:18:36.671908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.078 [2024-11-26 19:18:36.671988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.078 [2024-11-26 19:18:36.672001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.078 qpair failed and we were unable to recover it. 00:32:20.078 [2024-11-26 19:18:36.672079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.078 [2024-11-26 19:18:36.672172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.078 [2024-11-26 19:18:36.672184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.078 qpair failed and we were unable to recover it. 00:32:20.078 [2024-11-26 19:18:36.672426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.078 [2024-11-26 19:18:36.672502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.078 [2024-11-26 19:18:36.672514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.078 qpair failed and we were unable to recover it. 00:32:20.078 [2024-11-26 19:18:36.672586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.078 [2024-11-26 19:18:36.672654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.078 [2024-11-26 19:18:36.672668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.078 qpair failed and we were unable to recover it. 00:32:20.078 [2024-11-26 19:18:36.672806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.078 [2024-11-26 19:18:36.672896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.078 [2024-11-26 19:18:36.672908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.078 qpair failed and we were unable to recover it. 00:32:20.078 [2024-11-26 19:18:36.672974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.078 [2024-11-26 19:18:36.673048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.078 [2024-11-26 19:18:36.673061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.078 qpair failed and we were unable to recover it. 00:32:20.078 [2024-11-26 19:18:36.673204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.078 [2024-11-26 19:18:36.673295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.078 [2024-11-26 19:18:36.673308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.078 qpair failed and we were unable to recover it. 00:32:20.078 [2024-11-26 19:18:36.673386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.078 [2024-11-26 19:18:36.673452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.078 [2024-11-26 19:18:36.673464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.078 qpair failed and we were unable to recover it. 00:32:20.078 [2024-11-26 19:18:36.673532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.078 [2024-11-26 19:18:36.673606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.078 [2024-11-26 19:18:36.673618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.078 qpair failed and we were unable to recover it. 00:32:20.078 [2024-11-26 19:18:36.673706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.078 [2024-11-26 19:18:36.673796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.078 [2024-11-26 19:18:36.673808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.078 qpair failed and we were unable to recover it. 00:32:20.078 [2024-11-26 19:18:36.673876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.078 [2024-11-26 19:18:36.673959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.078 [2024-11-26 19:18:36.673972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.078 qpair failed and we were unable to recover it. 00:32:20.078 [2024-11-26 19:18:36.674038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.078 [2024-11-26 19:18:36.674114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.078 [2024-11-26 19:18:36.674126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.078 qpair failed and we were unable to recover it. 00:32:20.078 [2024-11-26 19:18:36.674259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.078 [2024-11-26 19:18:36.674323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.078 [2024-11-26 19:18:36.674336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.078 qpair failed and we were unable to recover it. 00:32:20.078 [2024-11-26 19:18:36.674418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.078 [2024-11-26 19:18:36.674487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.078 [2024-11-26 19:18:36.674500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.078 qpair failed and we were unable to recover it. 00:32:20.078 [2024-11-26 19:18:36.674640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.078 [2024-11-26 19:18:36.674723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.078 [2024-11-26 19:18:36.674736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.078 qpair failed and we were unable to recover it. 00:32:20.078 [2024-11-26 19:18:36.674815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.078 [2024-11-26 19:18:36.674880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.078 [2024-11-26 19:18:36.674893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.078 qpair failed and we were unable to recover it. 00:32:20.078 [2024-11-26 19:18:36.674975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.078 [2024-11-26 19:18:36.675059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.078 [2024-11-26 19:18:36.675071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.078 qpair failed and we were unable to recover it. 00:32:20.078 [2024-11-26 19:18:36.675144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.078 [2024-11-26 19:18:36.675216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.078 [2024-11-26 19:18:36.675230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.078 qpair failed and we were unable to recover it. 00:32:20.078 [2024-11-26 19:18:36.675319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.078 [2024-11-26 19:18:36.675382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.078 [2024-11-26 19:18:36.675394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.078 qpair failed and we were unable to recover it. 00:32:20.078 [2024-11-26 19:18:36.675480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.078 [2024-11-26 19:18:36.675560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.078 [2024-11-26 19:18:36.675571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.078 qpair failed and we were unable to recover it. 00:32:20.079 [2024-11-26 19:18:36.675640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.079 [2024-11-26 19:18:36.675710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.079 [2024-11-26 19:18:36.675723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.079 qpair failed and we were unable to recover it. 00:32:20.079 [2024-11-26 19:18:36.675798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.079 [2024-11-26 19:18:36.675933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.079 [2024-11-26 19:18:36.675946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.079 qpair failed and we were unable to recover it. 00:32:20.079 [2024-11-26 19:18:36.676027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.079 [2024-11-26 19:18:36.676167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.079 [2024-11-26 19:18:36.676179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.079 qpair failed and we were unable to recover it. 00:32:20.079 [2024-11-26 19:18:36.676248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.079 [2024-11-26 19:18:36.676318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.079 [2024-11-26 19:18:36.676330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.079 qpair failed and we were unable to recover it. 00:32:20.079 [2024-11-26 19:18:36.676468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.079 [2024-11-26 19:18:36.676535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.079 [2024-11-26 19:18:36.676547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.079 qpair failed and we were unable to recover it. 00:32:20.079 [2024-11-26 19:18:36.676701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.079 [2024-11-26 19:18:36.676765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.079 [2024-11-26 19:18:36.676776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.079 qpair failed and we were unable to recover it. 00:32:20.079 [2024-11-26 19:18:36.676876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.079 [2024-11-26 19:18:36.676978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.079 [2024-11-26 19:18:36.677000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.079 qpair failed and we were unable to recover it. 00:32:20.079 [2024-11-26 19:18:36.677111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.079 [2024-11-26 19:18:36.677283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.079 [2024-11-26 19:18:36.677305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.079 qpair failed and we were unable to recover it. 00:32:20.079 [2024-11-26 19:18:36.677438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.079 [2024-11-26 19:18:36.677557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.079 [2024-11-26 19:18:36.677579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:20.079 qpair failed and we were unable to recover it. 00:32:20.079 [2024-11-26 19:18:36.677663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.079 [2024-11-26 19:18:36.677740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.079 [2024-11-26 19:18:36.677752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.079 qpair failed and we were unable to recover it. 00:32:20.079 [2024-11-26 19:18:36.677824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.079 [2024-11-26 19:18:36.677891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.079 [2024-11-26 19:18:36.677903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.079 qpair failed and we were unable to recover it. 00:32:20.079 [2024-11-26 19:18:36.677980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.079 [2024-11-26 19:18:36.678044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.079 [2024-11-26 19:18:36.678056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.079 qpair failed and we were unable to recover it. 00:32:20.079 [2024-11-26 19:18:36.678132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.079 [2024-11-26 19:18:36.678197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.079 [2024-11-26 19:18:36.678210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.079 qpair failed and we were unable to recover it. 00:32:20.079 [2024-11-26 19:18:36.678273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.079 [2024-11-26 19:18:36.678417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.079 [2024-11-26 19:18:36.678430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.079 qpair failed and we were unable to recover it. 00:32:20.079 [2024-11-26 19:18:36.678596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.079 [2024-11-26 19:18:36.678667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.079 [2024-11-26 19:18:36.678679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.079 qpair failed and we were unable to recover it. 00:32:20.079 [2024-11-26 19:18:36.678762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.079 [2024-11-26 19:18:36.678837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.079 [2024-11-26 19:18:36.678850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.079 qpair failed and we were unable to recover it. 00:32:20.079 [2024-11-26 19:18:36.678990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.079 [2024-11-26 19:18:36.679062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.079 [2024-11-26 19:18:36.679075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.079 qpair failed and we were unable to recover it. 00:32:20.079 [2024-11-26 19:18:36.679228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.079 [2024-11-26 19:18:36.679313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.079 [2024-11-26 19:18:36.679325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.079 qpair failed and we were unable to recover it. 00:32:20.079 [2024-11-26 19:18:36.679393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.079 [2024-11-26 19:18:36.679472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.079 [2024-11-26 19:18:36.679484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.079 qpair failed and we were unable to recover it. 00:32:20.079 [2024-11-26 19:18:36.679557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.079 [2024-11-26 19:18:36.679623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.079 [2024-11-26 19:18:36.679635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.079 qpair failed and we were unable to recover it. 00:32:20.079 [2024-11-26 19:18:36.679727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.079 [2024-11-26 19:18:36.679809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.079 [2024-11-26 19:18:36.679821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.079 qpair failed and we were unable to recover it. 00:32:20.079 [2024-11-26 19:18:36.679902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.079 [2024-11-26 19:18:36.679968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.079 [2024-11-26 19:18:36.679981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.079 qpair failed and we were unable to recover it. 00:32:20.079 [2024-11-26 19:18:36.680125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.079 [2024-11-26 19:18:36.680207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.080 [2024-11-26 19:18:36.680221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.080 qpair failed and we were unable to recover it. 00:32:20.080 [2024-11-26 19:18:36.680306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.080 [2024-11-26 19:18:36.680382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.080 [2024-11-26 19:18:36.680394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.080 qpair failed and we were unable to recover it. 00:32:20.080 [2024-11-26 19:18:36.680552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.080 [2024-11-26 19:18:36.680635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.080 [2024-11-26 19:18:36.680648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.080 qpair failed and we were unable to recover it. 00:32:20.080 [2024-11-26 19:18:36.680716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.080 [2024-11-26 19:18:36.680781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.080 [2024-11-26 19:18:36.680794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.080 qpair failed and we were unable to recover it. 00:32:20.080 [2024-11-26 19:18:36.680873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.080 [2024-11-26 19:18:36.680945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.080 [2024-11-26 19:18:36.680963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.080 qpair failed and we were unable to recover it. 00:32:20.080 [2024-11-26 19:18:36.681054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.080 [2024-11-26 19:18:36.681117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.080 [2024-11-26 19:18:36.681129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.080 qpair failed and we were unable to recover it. 00:32:20.080 [2024-11-26 19:18:36.681211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.080 [2024-11-26 19:18:36.681308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.080 [2024-11-26 19:18:36.681320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.080 qpair failed and we were unable to recover it. 00:32:20.080 [2024-11-26 19:18:36.681461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.080 [2024-11-26 19:18:36.681536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.080 [2024-11-26 19:18:36.681548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.080 qpair failed and we were unable to recover it. 00:32:20.080 [2024-11-26 19:18:36.681616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.080 [2024-11-26 19:18:36.681753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.080 [2024-11-26 19:18:36.681766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.080 qpair failed and we were unable to recover it. 00:32:20.080 [2024-11-26 19:18:36.681850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.080 [2024-11-26 19:18:36.681940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.080 [2024-11-26 19:18:36.681958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.080 qpair failed and we were unable to recover it. 00:32:20.080 [2024-11-26 19:18:36.682032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.080 [2024-11-26 19:18:36.682190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.080 [2024-11-26 19:18:36.682204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.080 qpair failed and we were unable to recover it. 00:32:20.080 [2024-11-26 19:18:36.682278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.080 [2024-11-26 19:18:36.682349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.080 [2024-11-26 19:18:36.682361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.080 qpair failed and we were unable to recover it. 00:32:20.080 [2024-11-26 19:18:36.682443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.080 [2024-11-26 19:18:36.682512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.080 [2024-11-26 19:18:36.682524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.080 qpair failed and we were unable to recover it. 00:32:20.080 [2024-11-26 19:18:36.682588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.080 [2024-11-26 19:18:36.682682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.080 [2024-11-26 19:18:36.682694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.080 qpair failed and we were unable to recover it. 00:32:20.080 [2024-11-26 19:18:36.682772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.080 [2024-11-26 19:18:36.682910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.080 [2024-11-26 19:18:36.682923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.080 qpair failed and we were unable to recover it. 00:32:20.080 [2024-11-26 19:18:36.683075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.080 [2024-11-26 19:18:36.683217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.080 [2024-11-26 19:18:36.683229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.080 qpair failed and we were unable to recover it. 00:32:20.080 [2024-11-26 19:18:36.683314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.080 [2024-11-26 19:18:36.683394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.080 [2024-11-26 19:18:36.683408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.080 qpair failed and we were unable to recover it. 00:32:20.080 [2024-11-26 19:18:36.683473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.080 [2024-11-26 19:18:36.683552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.080 [2024-11-26 19:18:36.683564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.080 qpair failed and we were unable to recover it. 00:32:20.080 [2024-11-26 19:18:36.683640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.080 [2024-11-26 19:18:36.683711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.080 [2024-11-26 19:18:36.683723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.080 qpair failed and we were unable to recover it. 00:32:20.080 [2024-11-26 19:18:36.683819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.080 [2024-11-26 19:18:36.683882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.080 [2024-11-26 19:18:36.683894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.080 qpair failed and we were unable to recover it. 00:32:20.080 [2024-11-26 19:18:36.683975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.080 [2024-11-26 19:18:36.684162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.080 [2024-11-26 19:18:36.684175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.080 qpair failed and we were unable to recover it. 00:32:20.080 [2024-11-26 19:18:36.684311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.080 [2024-11-26 19:18:36.684465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.080 [2024-11-26 19:18:36.684477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.080 qpair failed and we were unable to recover it. 00:32:20.081 [2024-11-26 19:18:36.684545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.081 [2024-11-26 19:18:36.684618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.081 [2024-11-26 19:18:36.684630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.081 qpair failed and we were unable to recover it. 00:32:20.081 [2024-11-26 19:18:36.684785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.081 [2024-11-26 19:18:36.684927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.081 [2024-11-26 19:18:36.684938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.081 qpair failed and we were unable to recover it. 00:32:20.081 [2024-11-26 19:18:36.685029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.081 [2024-11-26 19:18:36.685122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.081 [2024-11-26 19:18:36.685134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.081 qpair failed and we were unable to recover it. 00:32:20.081 [2024-11-26 19:18:36.685213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.081 [2024-11-26 19:18:36.685280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.081 [2024-11-26 19:18:36.685292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.081 qpair failed and we were unable to recover it. 00:32:20.081 [2024-11-26 19:18:36.685387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.081 [2024-11-26 19:18:36.685452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.081 [2024-11-26 19:18:36.685464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.081 qpair failed and we were unable to recover it. 00:32:20.081 [2024-11-26 19:18:36.685563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.081 [2024-11-26 19:18:36.685624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.081 [2024-11-26 19:18:36.685638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.081 qpair failed and we were unable to recover it. 00:32:20.081 [2024-11-26 19:18:36.685709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.081 [2024-11-26 19:18:36.685796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.081 [2024-11-26 19:18:36.685809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.081 qpair failed and we were unable to recover it. 00:32:20.081 [2024-11-26 19:18:36.685971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.081 [2024-11-26 19:18:36.686044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.081 [2024-11-26 19:18:36.686055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.081 qpair failed and we were unable to recover it. 00:32:20.081 [2024-11-26 19:18:36.686139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.081 [2024-11-26 19:18:36.686212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.081 [2024-11-26 19:18:36.686223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.081 qpair failed and we were unable to recover it. 00:32:20.081 [2024-11-26 19:18:36.686293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.081 [2024-11-26 19:18:36.686360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.081 [2024-11-26 19:18:36.686370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.081 qpair failed and we were unable to recover it. 00:32:20.081 [2024-11-26 19:18:36.686454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.081 [2024-11-26 19:18:36.686527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.081 [2024-11-26 19:18:36.686539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.081 qpair failed and we were unable to recover it. 00:32:20.081 [2024-11-26 19:18:36.686605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.081 [2024-11-26 19:18:36.686738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.081 [2024-11-26 19:18:36.686749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.081 qpair failed and we were unable to recover it. 00:32:20.081 [2024-11-26 19:18:36.686890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.081 [2024-11-26 19:18:36.686992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.081 [2024-11-26 19:18:36.687007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.081 qpair failed and we were unable to recover it. 00:32:20.081 [2024-11-26 19:18:36.687104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.081 [2024-11-26 19:18:36.687187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.081 [2024-11-26 19:18:36.687198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.081 qpair failed and we were unable to recover it. 00:32:20.081 [2024-11-26 19:18:36.687267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.081 [2024-11-26 19:18:36.687416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.081 [2024-11-26 19:18:36.687429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.081 qpair failed and we were unable to recover it. 00:32:20.081 [2024-11-26 19:18:36.687500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.081 [2024-11-26 19:18:36.687632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.081 [2024-11-26 19:18:36.687645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.081 qpair failed and we were unable to recover it. 00:32:20.081 [2024-11-26 19:18:36.687715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.081 [2024-11-26 19:18:36.687851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.081 [2024-11-26 19:18:36.687863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.081 qpair failed and we were unable to recover it. 00:32:20.081 [2024-11-26 19:18:36.687928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.081 [2024-11-26 19:18:36.688020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.081 [2024-11-26 19:18:36.688033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.081 qpair failed and we were unable to recover it. 00:32:20.081 [2024-11-26 19:18:36.688112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.081 [2024-11-26 19:18:36.688326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.081 [2024-11-26 19:18:36.688338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.081 qpair failed and we were unable to recover it. 00:32:20.081 [2024-11-26 19:18:36.688493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.081 [2024-11-26 19:18:36.688560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.081 [2024-11-26 19:18:36.688573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.081 qpair failed and we were unable to recover it. 00:32:20.081 [2024-11-26 19:18:36.688659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.081 [2024-11-26 19:18:36.688736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.081 [2024-11-26 19:18:36.688748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.081 qpair failed and we were unable to recover it. 00:32:20.081 [2024-11-26 19:18:36.688827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.081 [2024-11-26 19:18:36.688921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.081 [2024-11-26 19:18:36.688933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.081 qpair failed and we were unable to recover it. 00:32:20.081 [2024-11-26 19:18:36.689025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.081 [2024-11-26 19:18:36.689127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.081 [2024-11-26 19:18:36.689141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.081 qpair failed and we were unable to recover it. 00:32:20.081 [2024-11-26 19:18:36.689226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.081 [2024-11-26 19:18:36.689304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.081 [2024-11-26 19:18:36.689316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.081 qpair failed and we were unable to recover it. 00:32:20.082 [2024-11-26 19:18:36.689478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.082 [2024-11-26 19:18:36.689545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.082 [2024-11-26 19:18:36.689558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.082 qpair failed and we were unable to recover it. 00:32:20.082 [2024-11-26 19:18:36.689695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.082 [2024-11-26 19:18:36.689833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.082 [2024-11-26 19:18:36.689845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.082 qpair failed and we were unable to recover it. 00:32:20.082 [2024-11-26 19:18:36.689933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.082 [2024-11-26 19:18:36.690017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.082 [2024-11-26 19:18:36.690030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.082 qpair failed and we were unable to recover it. 00:32:20.082 [2024-11-26 19:18:36.690094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.082 [2024-11-26 19:18:36.690197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.082 [2024-11-26 19:18:36.690209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.082 qpair failed and we were unable to recover it. 00:32:20.082 [2024-11-26 19:18:36.690278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.082 [2024-11-26 19:18:36.690347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.082 [2024-11-26 19:18:36.690360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.082 qpair failed and we were unable to recover it. 00:32:20.082 [2024-11-26 19:18:36.690528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.082 [2024-11-26 19:18:36.690613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.082 [2024-11-26 19:18:36.690625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.082 qpair failed and we were unable to recover it. 00:32:20.082 [2024-11-26 19:18:36.690699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.082 [2024-11-26 19:18:36.690771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.082 [2024-11-26 19:18:36.690783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.082 qpair failed and we were unable to recover it. 00:32:20.082 [2024-11-26 19:18:36.690862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.082 [2024-11-26 19:18:36.690934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.082 [2024-11-26 19:18:36.690945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.082 qpair failed and we were unable to recover it. 00:32:20.082 [2024-11-26 19:18:36.691035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.082 [2024-11-26 19:18:36.691107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.082 [2024-11-26 19:18:36.691124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.082 qpair failed and we were unable to recover it. 00:32:20.082 [2024-11-26 19:18:36.691205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.082 [2024-11-26 19:18:36.691356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.082 [2024-11-26 19:18:36.691368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.082 qpair failed and we were unable to recover it. 00:32:20.082 [2024-11-26 19:18:36.691503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.082 [2024-11-26 19:18:36.691581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.082 [2024-11-26 19:18:36.691593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.082 qpair failed and we were unable to recover it. 00:32:20.082 [2024-11-26 19:18:36.691663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.082 [2024-11-26 19:18:36.691747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.082 [2024-11-26 19:18:36.691760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.082 qpair failed and we were unable to recover it. 00:32:20.082 [2024-11-26 19:18:36.691825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.082 [2024-11-26 19:18:36.691888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.082 [2024-11-26 19:18:36.691900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.082 qpair failed and we were unable to recover it. 00:32:20.082 [2024-11-26 19:18:36.691997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.082 [2024-11-26 19:18:36.692089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.082 [2024-11-26 19:18:36.692102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.082 qpair failed and we were unable to recover it. 00:32:20.082 [2024-11-26 19:18:36.692257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.082 [2024-11-26 19:18:36.692335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.082 [2024-11-26 19:18:36.692348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.082 qpair failed and we were unable to recover it. 00:32:20.082 [2024-11-26 19:18:36.692417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.082 [2024-11-26 19:18:36.692553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.082 [2024-11-26 19:18:36.692565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.082 qpair failed and we were unable to recover it. 00:32:20.082 [2024-11-26 19:18:36.692638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.082 [2024-11-26 19:18:36.692714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.082 [2024-11-26 19:18:36.692726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.082 qpair failed and we were unable to recover it. 00:32:20.082 [2024-11-26 19:18:36.692804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.082 [2024-11-26 19:18:36.692869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.082 [2024-11-26 19:18:36.692881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.082 qpair failed and we were unable to recover it. 00:32:20.082 [2024-11-26 19:18:36.693077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.082 [2024-11-26 19:18:36.693145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.082 [2024-11-26 19:18:36.693158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.082 qpair failed and we were unable to recover it. 00:32:20.082 [2024-11-26 19:18:36.693245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.082 [2024-11-26 19:18:36.693313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.082 [2024-11-26 19:18:36.693326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.082 qpair failed and we were unable to recover it. 00:32:20.082 [2024-11-26 19:18:36.693466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.082 [2024-11-26 19:18:36.693540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.082 [2024-11-26 19:18:36.693551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.082 qpair failed and we were unable to recover it. 00:32:20.082 [2024-11-26 19:18:36.693645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.082 [2024-11-26 19:18:36.693716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.083 [2024-11-26 19:18:36.693728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.083 qpair failed and we were unable to recover it. 00:32:20.083 [2024-11-26 19:18:36.693793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.083 [2024-11-26 19:18:36.693956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.083 [2024-11-26 19:18:36.693969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.083 qpair failed and we were unable to recover it. 00:32:20.083 [2024-11-26 19:18:36.694110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.083 [2024-11-26 19:18:36.694191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.083 [2024-11-26 19:18:36.694203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.083 qpair failed and we were unable to recover it. 00:32:20.083 [2024-11-26 19:18:36.694283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.083 [2024-11-26 19:18:36.694350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.083 [2024-11-26 19:18:36.694362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.083 qpair failed and we were unable to recover it. 00:32:20.083 [2024-11-26 19:18:36.694503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.083 [2024-11-26 19:18:36.694583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.083 [2024-11-26 19:18:36.694596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.083 qpair failed and we were unable to recover it. 00:32:20.083 [2024-11-26 19:18:36.694662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.083 [2024-11-26 19:18:36.694752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.083 [2024-11-26 19:18:36.694763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.083 qpair failed and we were unable to recover it. 00:32:20.083 [2024-11-26 19:18:36.694908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.083 [2024-11-26 19:18:36.695019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.083 [2024-11-26 19:18:36.695031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.083 qpair failed and we were unable to recover it. 00:32:20.083 [2024-11-26 19:18:36.695104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.083 [2024-11-26 19:18:36.695255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.083 [2024-11-26 19:18:36.695267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.083 qpair failed and we were unable to recover it. 00:32:20.083 [2024-11-26 19:18:36.695343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.083 [2024-11-26 19:18:36.695426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.083 [2024-11-26 19:18:36.695438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.083 qpair failed and we were unable to recover it. 00:32:20.083 [2024-11-26 19:18:36.695587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.083 [2024-11-26 19:18:36.695749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.083 [2024-11-26 19:18:36.695760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.083 qpair failed and we were unable to recover it. 00:32:20.083 [2024-11-26 19:18:36.695833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.083 [2024-11-26 19:18:36.695935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.083 [2024-11-26 19:18:36.695964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.083 qpair failed and we were unable to recover it. 00:32:20.083 [2024-11-26 19:18:36.696035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.083 [2024-11-26 19:18:36.696134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.083 [2024-11-26 19:18:36.696145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.083 qpair failed and we were unable to recover it. 00:32:20.083 [2024-11-26 19:18:36.696223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.083 [2024-11-26 19:18:36.696366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.083 [2024-11-26 19:18:36.696378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.083 qpair failed and we were unable to recover it. 00:32:20.083 [2024-11-26 19:18:36.696516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.083 [2024-11-26 19:18:36.696602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.083 [2024-11-26 19:18:36.696615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.083 qpair failed and we were unable to recover it. 00:32:20.083 [2024-11-26 19:18:36.696687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.083 [2024-11-26 19:18:36.696754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.083 [2024-11-26 19:18:36.696766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.083 qpair failed and we were unable to recover it. 00:32:20.083 [2024-11-26 19:18:36.696839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.083 [2024-11-26 19:18:36.696926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.083 [2024-11-26 19:18:36.696939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.083 qpair failed and we were unable to recover it. 00:32:20.083 [2024-11-26 19:18:36.697023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.083 [2024-11-26 19:18:36.697107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.083 [2024-11-26 19:18:36.697119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.083 qpair failed and we were unable to recover it. 00:32:20.083 [2024-11-26 19:18:36.697192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.083 [2024-11-26 19:18:36.697268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.083 [2024-11-26 19:18:36.697280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.083 qpair failed and we were unable to recover it. 00:32:20.083 [2024-11-26 19:18:36.697432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.084 [2024-11-26 19:18:36.697568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.084 [2024-11-26 19:18:36.697581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.084 qpair failed and we were unable to recover it. 00:32:20.084 [2024-11-26 19:18:36.697655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.084 [2024-11-26 19:18:36.697786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.084 [2024-11-26 19:18:36.697799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.084 qpair failed and we were unable to recover it. 00:32:20.084 [2024-11-26 19:18:36.697880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.084 [2024-11-26 19:18:36.697961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.084 [2024-11-26 19:18:36.697974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.084 qpair failed and we were unable to recover it. 00:32:20.084 [2024-11-26 19:18:36.698048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.084 [2024-11-26 19:18:36.698180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.084 [2024-11-26 19:18:36.698192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.084 qpair failed and we were unable to recover it. 00:32:20.084 [2024-11-26 19:18:36.698291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.084 [2024-11-26 19:18:36.698509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.084 [2024-11-26 19:18:36.698521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.084 qpair failed and we were unable to recover it. 00:32:20.084 [2024-11-26 19:18:36.698654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.084 [2024-11-26 19:18:36.698724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.084 [2024-11-26 19:18:36.698738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.084 qpair failed and we were unable to recover it. 00:32:20.084 [2024-11-26 19:18:36.698821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.084 [2024-11-26 19:18:36.698909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.084 [2024-11-26 19:18:36.698922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.084 qpair failed and we were unable to recover it. 00:32:20.084 [2024-11-26 19:18:36.699054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.084 [2024-11-26 19:18:36.699119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.084 [2024-11-26 19:18:36.699131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.084 qpair failed and we were unable to recover it. 00:32:20.084 [2024-11-26 19:18:36.699214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.084 [2024-11-26 19:18:36.699348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.084 [2024-11-26 19:18:36.699359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.084 qpair failed and we were unable to recover it. 00:32:20.084 [2024-11-26 19:18:36.699443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.084 [2024-11-26 19:18:36.699576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.084 [2024-11-26 19:18:36.699588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.084 qpair failed and we were unable to recover it. 00:32:20.084 [2024-11-26 19:18:36.699738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.084 [2024-11-26 19:18:36.699814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.084 [2024-11-26 19:18:36.699826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.084 qpair failed and we were unable to recover it. 00:32:20.084 [2024-11-26 19:18:36.699887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.084 [2024-11-26 19:18:36.700019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.084 [2024-11-26 19:18:36.700031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.084 qpair failed and we were unable to recover it. 00:32:20.084 [2024-11-26 19:18:36.700170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.084 [2024-11-26 19:18:36.700232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.084 [2024-11-26 19:18:36.700244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.084 qpair failed and we were unable to recover it. 00:32:20.084 [2024-11-26 19:18:36.700316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.084 [2024-11-26 19:18:36.700395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.084 [2024-11-26 19:18:36.700406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.084 qpair failed and we were unable to recover it. 00:32:20.084 [2024-11-26 19:18:36.700477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.084 [2024-11-26 19:18:36.700545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.084 [2024-11-26 19:18:36.700557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.084 qpair failed and we were unable to recover it. 00:32:20.084 [2024-11-26 19:18:36.700724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.084 [2024-11-26 19:18:36.700815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.084 [2024-11-26 19:18:36.700827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.084 qpair failed and we were unable to recover it. 00:32:20.084 [2024-11-26 19:18:36.701043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.084 [2024-11-26 19:18:36.701119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.084 [2024-11-26 19:18:36.701131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.084 qpair failed and we were unable to recover it. 00:32:20.084 [2024-11-26 19:18:36.701210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.084 [2024-11-26 19:18:36.701286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.084 [2024-11-26 19:18:36.701298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.084 qpair failed and we were unable to recover it. 00:32:20.084 [2024-11-26 19:18:36.701439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.084 [2024-11-26 19:18:36.701520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.084 [2024-11-26 19:18:36.701532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.084 qpair failed and we were unable to recover it. 00:32:20.084 [2024-11-26 19:18:36.701613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.084 [2024-11-26 19:18:36.701690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.084 [2024-11-26 19:18:36.701702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.084 qpair failed and we were unable to recover it. 00:32:20.084 [2024-11-26 19:18:36.701786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.084 [2024-11-26 19:18:36.701858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.084 [2024-11-26 19:18:36.701870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.084 qpair failed and we were unable to recover it. 00:32:20.084 [2024-11-26 19:18:36.701955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.084 [2024-11-26 19:18:36.702038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.084 [2024-11-26 19:18:36.702049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.084 qpair failed and we were unable to recover it. 00:32:20.085 [2024-11-26 19:18:36.702110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.085 [2024-11-26 19:18:36.702179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.085 [2024-11-26 19:18:36.702191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.085 qpair failed and we were unable to recover it. 00:32:20.085 [2024-11-26 19:18:36.702273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.085 [2024-11-26 19:18:36.702405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.085 [2024-11-26 19:18:36.702416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.085 qpair failed and we were unable to recover it. 00:32:20.085 [2024-11-26 19:18:36.702506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.085 [2024-11-26 19:18:36.702643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.085 [2024-11-26 19:18:36.702655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.085 qpair failed and we were unable to recover it. 00:32:20.085 [2024-11-26 19:18:36.702749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.085 [2024-11-26 19:18:36.702911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.085 [2024-11-26 19:18:36.702922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.085 qpair failed and we were unable to recover it. 00:32:20.085 [2024-11-26 19:18:36.703087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.085 [2024-11-26 19:18:36.703159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.085 [2024-11-26 19:18:36.703171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.085 qpair failed and we were unable to recover it. 00:32:20.085 [2024-11-26 19:18:36.703268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.085 [2024-11-26 19:18:36.703425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.085 [2024-11-26 19:18:36.703436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.085 qpair failed and we were unable to recover it. 00:32:20.085 [2024-11-26 19:18:36.703590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.085 [2024-11-26 19:18:36.703668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.085 [2024-11-26 19:18:36.703680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.085 qpair failed and we were unable to recover it. 00:32:20.085 [2024-11-26 19:18:36.703820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.085 [2024-11-26 19:18:36.703887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.085 [2024-11-26 19:18:36.703899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.085 qpair failed and we were unable to recover it. 00:32:20.085 [2024-11-26 19:18:36.704044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.085 [2024-11-26 19:18:36.704135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.085 [2024-11-26 19:18:36.704148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.085 qpair failed and we were unable to recover it. 00:32:20.085 [2024-11-26 19:18:36.704287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.085 [2024-11-26 19:18:36.704418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.085 [2024-11-26 19:18:36.704430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.085 qpair failed and we were unable to recover it. 00:32:20.085 [2024-11-26 19:18:36.704515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.085 [2024-11-26 19:18:36.704680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.085 [2024-11-26 19:18:36.704692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.085 qpair failed and we were unable to recover it. 00:32:20.085 [2024-11-26 19:18:36.704794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.085 [2024-11-26 19:18:36.704872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.085 [2024-11-26 19:18:36.704901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.085 qpair failed and we were unable to recover it. 00:32:20.085 [2024-11-26 19:18:36.705133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.085 [2024-11-26 19:18:36.705291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.085 [2024-11-26 19:18:36.705304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.085 qpair failed and we were unable to recover it. 00:32:20.085 [2024-11-26 19:18:36.705382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.085 [2024-11-26 19:18:36.705462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.085 [2024-11-26 19:18:36.705473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.085 qpair failed and we were unable to recover it. 00:32:20.085 [2024-11-26 19:18:36.705565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.085 [2024-11-26 19:18:36.705702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.085 [2024-11-26 19:18:36.705715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.085 qpair failed and we were unable to recover it. 00:32:20.085 [2024-11-26 19:18:36.705849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.085 [2024-11-26 19:18:36.705925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.085 [2024-11-26 19:18:36.705937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.085 qpair failed and we were unable to recover it. 00:32:20.085 [2024-11-26 19:18:36.706144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.085 [2024-11-26 19:18:36.706216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.085 [2024-11-26 19:18:36.706228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.085 qpair failed and we were unable to recover it. 00:32:20.085 [2024-11-26 19:18:36.706322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.085 [2024-11-26 19:18:36.706462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.085 [2024-11-26 19:18:36.706474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.085 qpair failed and we were unable to recover it. 00:32:20.085 [2024-11-26 19:18:36.706565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.085 [2024-11-26 19:18:36.706627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.085 [2024-11-26 19:18:36.706639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.085 qpair failed and we were unable to recover it. 00:32:20.085 [2024-11-26 19:18:36.706705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.085 [2024-11-26 19:18:36.706845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.085 [2024-11-26 19:18:36.706857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.085 qpair failed and we were unable to recover it. 00:32:20.085 [2024-11-26 19:18:36.706942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.085 [2024-11-26 19:18:36.707020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.085 [2024-11-26 19:18:36.707033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.085 qpair failed and we were unable to recover it. 00:32:20.085 [2024-11-26 19:18:36.707196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.085 [2024-11-26 19:18:36.707266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.085 [2024-11-26 19:18:36.707278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.085 qpair failed and we were unable to recover it. 00:32:20.085 [2024-11-26 19:18:36.707348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.085 [2024-11-26 19:18:36.707417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.085 [2024-11-26 19:18:36.707428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.085 qpair failed and we were unable to recover it. 00:32:20.086 [2024-11-26 19:18:36.707562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.086 [2024-11-26 19:18:36.707643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.086 [2024-11-26 19:18:36.707654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.086 qpair failed and we were unable to recover it. 00:32:20.086 [2024-11-26 19:18:36.707718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.086 [2024-11-26 19:18:36.707874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.086 [2024-11-26 19:18:36.707886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.086 qpair failed and we were unable to recover it. 00:32:20.086 [2024-11-26 19:18:36.707991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.086 [2024-11-26 19:18:36.708063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.086 [2024-11-26 19:18:36.708075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.086 qpair failed and we were unable to recover it. 00:32:20.086 [2024-11-26 19:18:36.708219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.086 [2024-11-26 19:18:36.708297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.086 [2024-11-26 19:18:36.708309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.086 qpair failed and we were unable to recover it. 00:32:20.086 [2024-11-26 19:18:36.708517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.086 [2024-11-26 19:18:36.708607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.086 [2024-11-26 19:18:36.708620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.086 qpair failed and we were unable to recover it. 00:32:20.086 [2024-11-26 19:18:36.708706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.086 [2024-11-26 19:18:36.708856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.086 [2024-11-26 19:18:36.708868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.086 qpair failed and we were unable to recover it. 00:32:20.086 [2024-11-26 19:18:36.709076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.086 [2024-11-26 19:18:36.709311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.086 [2024-11-26 19:18:36.709322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.086 qpair failed and we were unable to recover it. 00:32:20.086 [2024-11-26 19:18:36.709472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.086 [2024-11-26 19:18:36.709661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.086 [2024-11-26 19:18:36.709673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.086 qpair failed and we were unable to recover it. 00:32:20.086 [2024-11-26 19:18:36.709840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.086 [2024-11-26 19:18:36.709916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.086 [2024-11-26 19:18:36.709928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.086 qpair failed and we were unable to recover it. 00:32:20.086 [2024-11-26 19:18:36.710026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.086 [2024-11-26 19:18:36.710100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.086 [2024-11-26 19:18:36.710113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.086 qpair failed and we were unable to recover it. 00:32:20.086 [2024-11-26 19:18:36.710267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.086 [2024-11-26 19:18:36.710402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.086 [2024-11-26 19:18:36.710414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.086 qpair failed and we were unable to recover it. 00:32:20.086 [2024-11-26 19:18:36.710507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.086 [2024-11-26 19:18:36.710597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.086 [2024-11-26 19:18:36.710610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.086 qpair failed and we were unable to recover it. 00:32:20.086 [2024-11-26 19:18:36.710763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.086 [2024-11-26 19:18:36.710853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.086 [2024-11-26 19:18:36.710865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.086 qpair failed and we were unable to recover it. 00:32:20.086 [2024-11-26 19:18:36.710931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.086 [2024-11-26 19:18:36.711074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.086 [2024-11-26 19:18:36.711086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.086 qpair failed and we were unable to recover it. 00:32:20.086 [2024-11-26 19:18:36.711155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.086 [2024-11-26 19:18:36.711230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.086 [2024-11-26 19:18:36.711242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.086 qpair failed and we were unable to recover it. 00:32:20.086 [2024-11-26 19:18:36.711373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.086 [2024-11-26 19:18:36.711516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.086 [2024-11-26 19:18:36.711527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.086 qpair failed and we were unable to recover it. 00:32:20.086 [2024-11-26 19:18:36.711616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.086 [2024-11-26 19:18:36.711773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.086 [2024-11-26 19:18:36.711786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.086 qpair failed and we were unable to recover it. 00:32:20.086 [2024-11-26 19:18:36.711865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.086 [2024-11-26 19:18:36.711944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.086 [2024-11-26 19:18:36.711960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.086 qpair failed and we were unable to recover it. 00:32:20.086 [2024-11-26 19:18:36.712101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.086 [2024-11-26 19:18:36.712200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.086 [2024-11-26 19:18:36.712211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.086 qpair failed and we were unable to recover it. 00:32:20.086 [2024-11-26 19:18:36.712301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.086 [2024-11-26 19:18:36.712444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.086 [2024-11-26 19:18:36.712456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.086 qpair failed and we were unable to recover it. 00:32:20.086 [2024-11-26 19:18:36.712520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.086 [2024-11-26 19:18:36.712594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.086 [2024-11-26 19:18:36.712607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.086 qpair failed and we were unable to recover it. 00:32:20.087 [2024-11-26 19:18:36.712767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.087 [2024-11-26 19:18:36.712861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.087 [2024-11-26 19:18:36.712873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.087 qpair failed and we were unable to recover it. 00:32:20.087 [2024-11-26 19:18:36.712957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.087 [2024-11-26 19:18:36.713033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.087 [2024-11-26 19:18:36.713045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.087 qpair failed and we were unable to recover it. 00:32:20.087 [2024-11-26 19:18:36.713182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.087 [2024-11-26 19:18:36.713255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.087 [2024-11-26 19:18:36.713267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.087 qpair failed and we were unable to recover it. 00:32:20.087 [2024-11-26 19:18:36.713350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.087 [2024-11-26 19:18:36.713501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.087 [2024-11-26 19:18:36.713514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.087 qpair failed and we were unable to recover it. 00:32:20.087 [2024-11-26 19:18:36.713595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.087 [2024-11-26 19:18:36.713659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.087 [2024-11-26 19:18:36.713671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.087 qpair failed and we were unable to recover it. 00:32:20.087 [2024-11-26 19:18:36.713757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.087 [2024-11-26 19:18:36.713900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.087 [2024-11-26 19:18:36.713911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.087 qpair failed and we were unable to recover it. 00:32:20.087 [2024-11-26 19:18:36.713984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.087 [2024-11-26 19:18:36.714059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.087 [2024-11-26 19:18:36.714072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.087 qpair failed and we were unable to recover it. 00:32:20.087 [2024-11-26 19:18:36.714169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.087 [2024-11-26 19:18:36.714248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.087 [2024-11-26 19:18:36.714260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.087 qpair failed and we were unable to recover it. 00:32:20.087 [2024-11-26 19:18:36.714359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.087 [2024-11-26 19:18:36.714491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.087 [2024-11-26 19:18:36.714503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.087 qpair failed and we were unable to recover it. 00:32:20.087 [2024-11-26 19:18:36.714635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.087 [2024-11-26 19:18:36.714837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.087 [2024-11-26 19:18:36.714849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.087 qpair failed and we were unable to recover it. 00:32:20.087 [2024-11-26 19:18:36.714979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.087 [2024-11-26 19:18:36.715063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.087 [2024-11-26 19:18:36.715075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.087 qpair failed and we were unable to recover it. 00:32:20.087 [2024-11-26 19:18:36.715178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.087 [2024-11-26 19:18:36.715235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.087 [2024-11-26 19:18:36.715247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.087 qpair failed and we were unable to recover it. 00:32:20.087 [2024-11-26 19:18:36.715333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.087 [2024-11-26 19:18:36.715479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.087 [2024-11-26 19:18:36.715492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.087 qpair failed and we were unable to recover it. 00:32:20.087 [2024-11-26 19:18:36.715582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.087 [2024-11-26 19:18:36.715645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.087 [2024-11-26 19:18:36.715657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.087 qpair failed and we were unable to recover it. 00:32:20.087 [2024-11-26 19:18:36.715806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.087 [2024-11-26 19:18:36.715892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.087 [2024-11-26 19:18:36.715905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.087 qpair failed and we were unable to recover it. 00:32:20.087 [2024-11-26 19:18:36.716065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.087 [2024-11-26 19:18:36.716152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.087 [2024-11-26 19:18:36.716164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.087 qpair failed and we were unable to recover it. 00:32:20.087 [2024-11-26 19:18:36.716241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.087 [2024-11-26 19:18:36.716319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.087 [2024-11-26 19:18:36.716330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.087 qpair failed and we were unable to recover it. 00:32:20.087 [2024-11-26 19:18:36.716408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.087 [2024-11-26 19:18:36.716487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.087 [2024-11-26 19:18:36.716500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.088 qpair failed and we were unable to recover it. 00:32:20.088 [2024-11-26 19:18:36.716574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.088 [2024-11-26 19:18:36.716783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.088 [2024-11-26 19:18:36.716795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.088 qpair failed and we were unable to recover it. 00:32:20.088 [2024-11-26 19:18:36.716884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.088 [2024-11-26 19:18:36.717020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.088 [2024-11-26 19:18:36.717032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.088 qpair failed and we were unable to recover it. 00:32:20.088 [2024-11-26 19:18:36.717232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.088 [2024-11-26 19:18:36.717310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.088 [2024-11-26 19:18:36.717322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.088 qpair failed and we were unable to recover it. 00:32:20.088 [2024-11-26 19:18:36.717416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.088 [2024-11-26 19:18:36.717480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.088 [2024-11-26 19:18:36.717492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.088 qpair failed and we were unable to recover it. 00:32:20.088 [2024-11-26 19:18:36.717559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.088 [2024-11-26 19:18:36.717648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.088 [2024-11-26 19:18:36.717660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.088 qpair failed and we were unable to recover it. 00:32:20.088 [2024-11-26 19:18:36.717800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.088 [2024-11-26 19:18:36.717869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.088 [2024-11-26 19:18:36.717881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.088 qpair failed and we were unable to recover it. 00:32:20.088 [2024-11-26 19:18:36.718037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.088 [2024-11-26 19:18:36.718114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.088 [2024-11-26 19:18:36.718126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.088 qpair failed and we were unable to recover it. 00:32:20.088 [2024-11-26 19:18:36.718229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.088 [2024-11-26 19:18:36.718391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.088 [2024-11-26 19:18:36.718404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.088 qpair failed and we were unable to recover it. 00:32:20.088 [2024-11-26 19:18:36.718476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.088 [2024-11-26 19:18:36.718544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.088 [2024-11-26 19:18:36.718556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.088 qpair failed and we were unable to recover it. 00:32:20.088 [2024-11-26 19:18:36.718623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.088 [2024-11-26 19:18:36.718697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.088 [2024-11-26 19:18:36.718709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.088 qpair failed and we were unable to recover it. 00:32:20.088 [2024-11-26 19:18:36.718788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.088 [2024-11-26 19:18:36.718852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.088 [2024-11-26 19:18:36.718864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.088 qpair failed and we were unable to recover it. 00:32:20.088 [2024-11-26 19:18:36.718997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.088 [2024-11-26 19:18:36.719143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.088 [2024-11-26 19:18:36.719156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.088 qpair failed and we were unable to recover it. 00:32:20.088 [2024-11-26 19:18:36.719291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.088 [2024-11-26 19:18:36.719356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.088 [2024-11-26 19:18:36.719369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.088 qpair failed and we were unable to recover it. 00:32:20.088 [2024-11-26 19:18:36.719434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.088 [2024-11-26 19:18:36.719579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.088 [2024-11-26 19:18:36.719592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.088 qpair failed and we were unable to recover it. 00:32:20.088 [2024-11-26 19:18:36.719656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.088 [2024-11-26 19:18:36.719720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.088 [2024-11-26 19:18:36.719732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.088 qpair failed and we were unable to recover it. 00:32:20.088 [2024-11-26 19:18:36.719819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.088 [2024-11-26 19:18:36.719894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.088 [2024-11-26 19:18:36.719906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.088 qpair failed and we were unable to recover it. 00:32:20.088 [2024-11-26 19:18:36.719984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.088 [2024-11-26 19:18:36.720055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.088 [2024-11-26 19:18:36.720068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.088 qpair failed and we were unable to recover it. 00:32:20.088 [2024-11-26 19:18:36.720147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.088 [2024-11-26 19:18:36.720226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.088 [2024-11-26 19:18:36.720238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.088 qpair failed and we were unable to recover it. 00:32:20.088 [2024-11-26 19:18:36.720394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.088 [2024-11-26 19:18:36.720541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.088 [2024-11-26 19:18:36.720554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.088 qpair failed and we were unable to recover it. 00:32:20.088 [2024-11-26 19:18:36.720640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.088 [2024-11-26 19:18:36.720715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.088 [2024-11-26 19:18:36.720728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.088 qpair failed and we were unable to recover it. 00:32:20.088 [2024-11-26 19:18:36.720887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.088 [2024-11-26 19:18:36.720973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.088 [2024-11-26 19:18:36.720986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.088 qpair failed and we were unable to recover it. 00:32:20.089 [2024-11-26 19:18:36.721067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.089 [2024-11-26 19:18:36.721140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.089 [2024-11-26 19:18:36.721153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.089 qpair failed and we were unable to recover it. 00:32:20.089 [2024-11-26 19:18:36.721226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.089 [2024-11-26 19:18:36.721311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.089 [2024-11-26 19:18:36.721323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.089 qpair failed and we were unable to recover it. 00:32:20.089 [2024-11-26 19:18:36.721529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.089 [2024-11-26 19:18:36.721592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.089 [2024-11-26 19:18:36.721603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.089 qpair failed and we were unable to recover it. 00:32:20.089 [2024-11-26 19:18:36.721756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.089 [2024-11-26 19:18:36.721893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.089 [2024-11-26 19:18:36.721905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.089 qpair failed and we were unable to recover it. 00:32:20.089 [2024-11-26 19:18:36.721977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.089 [2024-11-26 19:18:36.722058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.089 [2024-11-26 19:18:36.722069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.089 qpair failed and we were unable to recover it. 00:32:20.089 [2024-11-26 19:18:36.722204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.089 [2024-11-26 19:18:36.722429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.089 [2024-11-26 19:18:36.722443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.089 qpair failed and we were unable to recover it. 00:32:20.089 [2024-11-26 19:18:36.722538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.089 [2024-11-26 19:18:36.722618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.089 [2024-11-26 19:18:36.722630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.089 qpair failed and we were unable to recover it. 00:32:20.089 [2024-11-26 19:18:36.722700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.089 [2024-11-26 19:18:36.722769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.089 [2024-11-26 19:18:36.722780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.089 qpair failed and we were unable to recover it. 00:32:20.089 [2024-11-26 19:18:36.723012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.089 [2024-11-26 19:18:36.723089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.089 [2024-11-26 19:18:36.723100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.089 qpair failed and we were unable to recover it. 00:32:20.089 [2024-11-26 19:18:36.723188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.089 [2024-11-26 19:18:36.723277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.089 [2024-11-26 19:18:36.723289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.089 qpair failed and we were unable to recover it. 00:32:20.089 [2024-11-26 19:18:36.723492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.089 [2024-11-26 19:18:36.723629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.089 [2024-11-26 19:18:36.723641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.089 qpair failed and we were unable to recover it. 00:32:20.089 [2024-11-26 19:18:36.723779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.089 [2024-11-26 19:18:36.723870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.089 [2024-11-26 19:18:36.723882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.089 qpair failed and we were unable to recover it. 00:32:20.089 [2024-11-26 19:18:36.724024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.089 [2024-11-26 19:18:36.724101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.089 [2024-11-26 19:18:36.724113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.089 qpair failed and we were unable to recover it. 00:32:20.089 [2024-11-26 19:18:36.724255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.089 [2024-11-26 19:18:36.724333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.089 [2024-11-26 19:18:36.724345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.089 qpair failed and we were unable to recover it. 00:32:20.089 [2024-11-26 19:18:36.724424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.089 [2024-11-26 19:18:36.724482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.089 [2024-11-26 19:18:36.724493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.089 qpair failed and we were unable to recover it. 00:32:20.089 [2024-11-26 19:18:36.724718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.089 [2024-11-26 19:18:36.724882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.089 [2024-11-26 19:18:36.724898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.089 qpair failed and we were unable to recover it. 00:32:20.089 [2024-11-26 19:18:36.724983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.089 [2024-11-26 19:18:36.725114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.089 [2024-11-26 19:18:36.725126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.089 qpair failed and we were unable to recover it. 00:32:20.089 [2024-11-26 19:18:36.725192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.089 [2024-11-26 19:18:36.725268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.089 [2024-11-26 19:18:36.725280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.089 qpair failed and we were unable to recover it. 00:32:20.089 [2024-11-26 19:18:36.725481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.089 [2024-11-26 19:18:36.725641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.089 [2024-11-26 19:18:36.725654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.090 qpair failed and we were unable to recover it. 00:32:20.090 [2024-11-26 19:18:36.725724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.090 [2024-11-26 19:18:36.725866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.090 [2024-11-26 19:18:36.725877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.090 qpair failed and we were unable to recover it. 00:32:20.090 [2024-11-26 19:18:36.726068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.090 [2024-11-26 19:18:36.726160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.090 [2024-11-26 19:18:36.726171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.090 qpair failed and we were unable to recover it. 00:32:20.090 [2024-11-26 19:18:36.726237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.090 [2024-11-26 19:18:36.726311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.090 [2024-11-26 19:18:36.726324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.090 qpair failed and we were unable to recover it. 00:32:20.090 [2024-11-26 19:18:36.726500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.090 [2024-11-26 19:18:36.726571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.090 [2024-11-26 19:18:36.726584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.090 qpair failed and we were unable to recover it. 00:32:20.090 [2024-11-26 19:18:36.726724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.090 [2024-11-26 19:18:36.726816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.090 [2024-11-26 19:18:36.726828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.090 qpair failed and we were unable to recover it. 00:32:20.090 [2024-11-26 19:18:36.726986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.090 [2024-11-26 19:18:36.727065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.090 [2024-11-26 19:18:36.727078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.090 qpair failed and we were unable to recover it. 00:32:20.090 [2024-11-26 19:18:36.727210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.090 [2024-11-26 19:18:36.727340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.090 [2024-11-26 19:18:36.727354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.090 qpair failed and we were unable to recover it. 00:32:20.090 [2024-11-26 19:18:36.727431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.090 [2024-11-26 19:18:36.727571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.090 [2024-11-26 19:18:36.727583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.090 qpair failed and we were unable to recover it. 00:32:20.090 [2024-11-26 19:18:36.727720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.090 [2024-11-26 19:18:36.727877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.090 [2024-11-26 19:18:36.727888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.090 qpair failed and we were unable to recover it. 00:32:20.090 [2024-11-26 19:18:36.727959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.090 [2024-11-26 19:18:36.728023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.090 [2024-11-26 19:18:36.728034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.090 qpair failed and we were unable to recover it. 00:32:20.090 [2024-11-26 19:18:36.728107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.090 [2024-11-26 19:18:36.728202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.090 [2024-11-26 19:18:36.728214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.090 qpair failed and we were unable to recover it. 00:32:20.090 [2024-11-26 19:18:36.728357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.090 [2024-11-26 19:18:36.728451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.090 [2024-11-26 19:18:36.728464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.090 qpair failed and we were unable to recover it. 00:32:20.090 [2024-11-26 19:18:36.728551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.090 [2024-11-26 19:18:36.728614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.090 [2024-11-26 19:18:36.728625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.090 qpair failed and we were unable to recover it. 00:32:20.090 [2024-11-26 19:18:36.728762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.090 [2024-11-26 19:18:36.728845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.090 [2024-11-26 19:18:36.728856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.090 qpair failed and we were unable to recover it. 00:32:20.090 [2024-11-26 19:18:36.728934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.090 [2024-11-26 19:18:36.729025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.090 [2024-11-26 19:18:36.729038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.090 qpair failed and we were unable to recover it. 00:32:20.090 [2024-11-26 19:18:36.729109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.090 [2024-11-26 19:18:36.729353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.090 [2024-11-26 19:18:36.729365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.090 qpair failed and we were unable to recover it. 00:32:20.090 [2024-11-26 19:18:36.729506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.090 [2024-11-26 19:18:36.729572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.091 [2024-11-26 19:18:36.729587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.091 qpair failed and we were unable to recover it. 00:32:20.091 [2024-11-26 19:18:36.729737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.091 [2024-11-26 19:18:36.729813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.091 [2024-11-26 19:18:36.729825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.091 qpair failed and we were unable to recover it. 00:32:20.091 [2024-11-26 19:18:36.729895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.091 [2024-11-26 19:18:36.729972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.091 [2024-11-26 19:18:36.729984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.091 qpair failed and we were unable to recover it. 00:32:20.091 [2024-11-26 19:18:36.730048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.091 [2024-11-26 19:18:36.730209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.091 [2024-11-26 19:18:36.730221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.091 qpair failed and we were unable to recover it. 00:32:20.091 [2024-11-26 19:18:36.730382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.091 [2024-11-26 19:18:36.730449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.091 [2024-11-26 19:18:36.730461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.091 qpair failed and we were unable to recover it. 00:32:20.091 [2024-11-26 19:18:36.730599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.091 [2024-11-26 19:18:36.730689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.091 [2024-11-26 19:18:36.730702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.091 qpair failed and we were unable to recover it. 00:32:20.091 [2024-11-26 19:18:36.730786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.091 [2024-11-26 19:18:36.730864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.091 [2024-11-26 19:18:36.730876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.091 qpair failed and we were unable to recover it. 00:32:20.091 [2024-11-26 19:18:36.730956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.091 [2024-11-26 19:18:36.731029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.091 [2024-11-26 19:18:36.731040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.091 qpair failed and we were unable to recover it. 00:32:20.091 [2024-11-26 19:18:36.731141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.091 [2024-11-26 19:18:36.731375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.091 [2024-11-26 19:18:36.731386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.091 qpair failed and we were unable to recover it. 00:32:20.091 [2024-11-26 19:18:36.731483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.091 [2024-11-26 19:18:36.731556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.091 [2024-11-26 19:18:36.731569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.091 qpair failed and we were unable to recover it. 00:32:20.091 [2024-11-26 19:18:36.731670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.091 [2024-11-26 19:18:36.731731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.091 [2024-11-26 19:18:36.731742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.091 qpair failed and we were unable to recover it. 00:32:20.091 [2024-11-26 19:18:36.731822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.091 [2024-11-26 19:18:36.731907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.091 [2024-11-26 19:18:36.731919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.091 qpair failed and we were unable to recover it. 00:32:20.091 [2024-11-26 19:18:36.732003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.091 [2024-11-26 19:18:36.732166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.091 [2024-11-26 19:18:36.732179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.091 qpair failed and we were unable to recover it. 00:32:20.091 [2024-11-26 19:18:36.732326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.091 [2024-11-26 19:18:36.732404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.091 [2024-11-26 19:18:36.732416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.091 qpair failed and we were unable to recover it. 00:32:20.091 [2024-11-26 19:18:36.732483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.091 [2024-11-26 19:18:36.732616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.091 [2024-11-26 19:18:36.732627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.091 qpair failed and we were unable to recover it. 00:32:20.091 [2024-11-26 19:18:36.732711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.091 [2024-11-26 19:18:36.732814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.091 [2024-11-26 19:18:36.732826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.091 qpair failed and we were unable to recover it. 00:32:20.091 [2024-11-26 19:18:36.732983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.091 [2024-11-26 19:18:36.733180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.091 [2024-11-26 19:18:36.733192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.091 qpair failed and we were unable to recover it. 00:32:20.091 [2024-11-26 19:18:36.733396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.091 [2024-11-26 19:18:36.733490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.091 [2024-11-26 19:18:36.733502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.091 qpair failed and we were unable to recover it. 00:32:20.091 [2024-11-26 19:18:36.733586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.091 [2024-11-26 19:18:36.733654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.091 [2024-11-26 19:18:36.733665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.091 qpair failed and we were unable to recover it. 00:32:20.091 [2024-11-26 19:18:36.733746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.091 [2024-11-26 19:18:36.733889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.091 [2024-11-26 19:18:36.733901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.092 qpair failed and we were unable to recover it. 00:32:20.092 [2024-11-26 19:18:36.734057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.092 [2024-11-26 19:18:36.734227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.092 [2024-11-26 19:18:36.734240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.092 qpair failed and we were unable to recover it. 00:32:20.092 [2024-11-26 19:18:36.734320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.092 [2024-11-26 19:18:36.734448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.092 [2024-11-26 19:18:36.734460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.092 qpair failed and we were unable to recover it. 00:32:20.092 [2024-11-26 19:18:36.734611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.092 [2024-11-26 19:18:36.734699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.092 [2024-11-26 19:18:36.734712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.092 qpair failed and we were unable to recover it. 00:32:20.092 [2024-11-26 19:18:36.734854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.092 [2024-11-26 19:18:36.734927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.092 [2024-11-26 19:18:36.734940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.092 qpair failed and we were unable to recover it. 00:32:20.092 [2024-11-26 19:18:36.735032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.092 [2024-11-26 19:18:36.735100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.092 [2024-11-26 19:18:36.735111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.092 qpair failed and we were unable to recover it. 00:32:20.092 [2024-11-26 19:18:36.735178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.092 [2024-11-26 19:18:36.735267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.092 [2024-11-26 19:18:36.735279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.092 qpair failed and we were unable to recover it. 00:32:20.092 [2024-11-26 19:18:36.735413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.092 [2024-11-26 19:18:36.735478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.092 [2024-11-26 19:18:36.735490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.092 qpair failed and we were unable to recover it. 00:32:20.092 [2024-11-26 19:18:36.735581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.092 [2024-11-26 19:18:36.735777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.092 [2024-11-26 19:18:36.735789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.092 qpair failed and we were unable to recover it. 00:32:20.092 [2024-11-26 19:18:36.735856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.092 [2024-11-26 19:18:36.735939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.092 [2024-11-26 19:18:36.735956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.092 qpair failed and we were unable to recover it. 00:32:20.092 [2024-11-26 19:18:36.736035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.092 [2024-11-26 19:18:36.736103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.092 [2024-11-26 19:18:36.736115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.092 qpair failed and we were unable to recover it. 00:32:20.092 [2024-11-26 19:18:36.736320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.092 [2024-11-26 19:18:36.736464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.092 [2024-11-26 19:18:36.736477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.092 qpair failed and we were unable to recover it. 00:32:20.092 [2024-11-26 19:18:36.736549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.092 [2024-11-26 19:18:36.736621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.092 [2024-11-26 19:18:36.736632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.092 qpair failed and we were unable to recover it. 00:32:20.092 [2024-11-26 19:18:36.736713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.092 [2024-11-26 19:18:36.736788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.092 [2024-11-26 19:18:36.736800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.092 qpair failed and we were unable to recover it. 00:32:20.092 [2024-11-26 19:18:36.736866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.092 [2024-11-26 19:18:36.736966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.092 [2024-11-26 19:18:36.736978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.092 qpair failed and we were unable to recover it. 00:32:20.092 [2024-11-26 19:18:36.737056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.092 [2024-11-26 19:18:36.737202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.092 [2024-11-26 19:18:36.737214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.092 qpair failed and we were unable to recover it. 00:32:20.092 [2024-11-26 19:18:36.737412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.092 [2024-11-26 19:18:36.737478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.092 [2024-11-26 19:18:36.737489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.092 qpair failed and we were unable to recover it. 00:32:20.092 [2024-11-26 19:18:36.737628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.092 [2024-11-26 19:18:36.737697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.092 [2024-11-26 19:18:36.737709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.092 qpair failed and we were unable to recover it. 00:32:20.092 [2024-11-26 19:18:36.737798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.092 [2024-11-26 19:18:36.737933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.092 [2024-11-26 19:18:36.737945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.092 qpair failed and we were unable to recover it. 00:32:20.092 [2024-11-26 19:18:36.738122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.092 [2024-11-26 19:18:36.738185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.092 [2024-11-26 19:18:36.738196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.092 qpair failed and we were unable to recover it. 00:32:20.092 [2024-11-26 19:18:36.738264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.092 [2024-11-26 19:18:36.738408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.093 [2024-11-26 19:18:36.738419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.093 qpair failed and we were unable to recover it. 00:32:20.093 [2024-11-26 19:18:36.738505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.093 [2024-11-26 19:18:36.738592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.093 [2024-11-26 19:18:36.738604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.093 qpair failed and we were unable to recover it. 00:32:20.093 [2024-11-26 19:18:36.738756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.093 [2024-11-26 19:18:36.738836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.093 [2024-11-26 19:18:36.738848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.093 qpair failed and we were unable to recover it. 00:32:20.093 [2024-11-26 19:18:36.738951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.093 [2024-11-26 19:18:36.739080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.093 [2024-11-26 19:18:36.739092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.093 qpair failed and we were unable to recover it. 00:32:20.093 [2024-11-26 19:18:36.739234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.093 [2024-11-26 19:18:36.739432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.093 [2024-11-26 19:18:36.739445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.093 qpair failed and we were unable to recover it. 00:32:20.093 [2024-11-26 19:18:36.739507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.093 [2024-11-26 19:18:36.739576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.093 [2024-11-26 19:18:36.739587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.093 qpair failed and we were unable to recover it. 00:32:20.093 [2024-11-26 19:18:36.739658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.093 [2024-11-26 19:18:36.739726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.093 [2024-11-26 19:18:36.739737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.093 qpair failed and we were unable to recover it. 00:32:20.093 [2024-11-26 19:18:36.739869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.093 [2024-11-26 19:18:36.740080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.093 [2024-11-26 19:18:36.740092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.093 qpair failed and we were unable to recover it. 00:32:20.093 [2024-11-26 19:18:36.740186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.093 [2024-11-26 19:18:36.740250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.093 [2024-11-26 19:18:36.740261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.093 qpair failed and we were unable to recover it. 00:32:20.093 [2024-11-26 19:18:36.740398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.093 [2024-11-26 19:18:36.740473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.093 [2024-11-26 19:18:36.740484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.093 qpair failed and we were unable to recover it. 00:32:20.093 [2024-11-26 19:18:36.740615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.093 [2024-11-26 19:18:36.740763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.093 [2024-11-26 19:18:36.740774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.093 qpair failed and we were unable to recover it. 00:32:20.093 [2024-11-26 19:18:36.740916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.093 [2024-11-26 19:18:36.740982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.093 [2024-11-26 19:18:36.740994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.093 qpair failed and we were unable to recover it. 00:32:20.093 [2024-11-26 19:18:36.741067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.093 [2024-11-26 19:18:36.741195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.093 [2024-11-26 19:18:36.741206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.093 qpair failed and we were unable to recover it. 00:32:20.093 [2024-11-26 19:18:36.741276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.093 [2024-11-26 19:18:36.741407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.093 [2024-11-26 19:18:36.741418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.093 qpair failed and we were unable to recover it. 00:32:20.093 [2024-11-26 19:18:36.741501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.093 [2024-11-26 19:18:36.741567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.093 [2024-11-26 19:18:36.741578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.093 qpair failed and we were unable to recover it. 00:32:20.093 [2024-11-26 19:18:36.741653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.093 [2024-11-26 19:18:36.741810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.093 [2024-11-26 19:18:36.741823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.093 qpair failed and we were unable to recover it. 00:32:20.093 [2024-11-26 19:18:36.741916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.093 [2024-11-26 19:18:36.741980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.093 [2024-11-26 19:18:36.741993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.093 qpair failed and we were unable to recover it. 00:32:20.093 [2024-11-26 19:18:36.742084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.093 [2024-11-26 19:18:36.742164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.093 [2024-11-26 19:18:36.742175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.093 qpair failed and we were unable to recover it. 00:32:20.093 [2024-11-26 19:18:36.742240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.093 [2024-11-26 19:18:36.742347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.093 [2024-11-26 19:18:36.742359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.093 qpair failed and we were unable to recover it. 00:32:20.093 [2024-11-26 19:18:36.742448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.093 [2024-11-26 19:18:36.742542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.093 [2024-11-26 19:18:36.742555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.093 qpair failed and we were unable to recover it. 00:32:20.094 [2024-11-26 19:18:36.742623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.094 [2024-11-26 19:18:36.742684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.094 [2024-11-26 19:18:36.742696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.094 qpair failed and we were unable to recover it. 00:32:20.094 [2024-11-26 19:18:36.742779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.094 [2024-11-26 19:18:36.742853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.094 [2024-11-26 19:18:36.742865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.094 qpair failed and we were unable to recover it. 00:32:20.094 [2024-11-26 19:18:36.742939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.094 [2024-11-26 19:18:36.743015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.094 [2024-11-26 19:18:36.743027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.094 qpair failed and we were unable to recover it. 00:32:20.094 [2024-11-26 19:18:36.743162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.094 [2024-11-26 19:18:36.743229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.094 [2024-11-26 19:18:36.743241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.094 qpair failed and we were unable to recover it. 00:32:20.094 [2024-11-26 19:18:36.743323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.094 [2024-11-26 19:18:36.743387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.094 [2024-11-26 19:18:36.743399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.094 qpair failed and we were unable to recover it. 00:32:20.094 [2024-11-26 19:18:36.743533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.094 [2024-11-26 19:18:36.743611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.094 [2024-11-26 19:18:36.743623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.094 qpair failed and we were unable to recover it. 00:32:20.094 [2024-11-26 19:18:36.743761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.094 [2024-11-26 19:18:36.743834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.094 [2024-11-26 19:18:36.743846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.094 qpair failed and we were unable to recover it. 00:32:20.094 [2024-11-26 19:18:36.743915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.094 [2024-11-26 19:18:36.744044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.094 [2024-11-26 19:18:36.744056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.094 qpair failed and we were unable to recover it. 00:32:20.094 [2024-11-26 19:18:36.744124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.094 [2024-11-26 19:18:36.744184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.094 [2024-11-26 19:18:36.744196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.094 qpair failed and we were unable to recover it. 00:32:20.094 [2024-11-26 19:18:36.744280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.094 [2024-11-26 19:18:36.744436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.094 [2024-11-26 19:18:36.744448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.094 qpair failed and we were unable to recover it. 00:32:20.094 [2024-11-26 19:18:36.744613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.094 [2024-11-26 19:18:36.744750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.094 [2024-11-26 19:18:36.744762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.094 qpair failed and we were unable to recover it. 00:32:20.094 [2024-11-26 19:18:36.744838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.094 [2024-11-26 19:18:36.744971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.094 [2024-11-26 19:18:36.744983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.094 qpair failed and we were unable to recover it. 00:32:20.094 [2024-11-26 19:18:36.745067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.094 [2024-11-26 19:18:36.745215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.094 [2024-11-26 19:18:36.745226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.094 qpair failed and we were unable to recover it. 00:32:20.094 [2024-11-26 19:18:36.745305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.094 [2024-11-26 19:18:36.745509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.094 [2024-11-26 19:18:36.745520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.094 qpair failed and we were unable to recover it. 00:32:20.094 [2024-11-26 19:18:36.745617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.094 [2024-11-26 19:18:36.745764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.094 [2024-11-26 19:18:36.745776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.094 qpair failed and we were unable to recover it. 00:32:20.094 [2024-11-26 19:18:36.745837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.094 [2024-11-26 19:18:36.745916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.094 [2024-11-26 19:18:36.745927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.094 qpair failed and we were unable to recover it. 00:32:20.094 [2024-11-26 19:18:36.745999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.094 [2024-11-26 19:18:36.746062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.094 [2024-11-26 19:18:36.746074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.094 qpair failed and we were unable to recover it. 00:32:20.094 [2024-11-26 19:18:36.746220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.094 [2024-11-26 19:18:36.746352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.094 [2024-11-26 19:18:36.746364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.094 qpair failed and we were unable to recover it. 00:32:20.094 [2024-11-26 19:18:36.746427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.094 [2024-11-26 19:18:36.746508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.095 [2024-11-26 19:18:36.746520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.095 qpair failed and we were unable to recover it. 00:32:20.095 [2024-11-26 19:18:36.746593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.095 [2024-11-26 19:18:36.746721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.095 [2024-11-26 19:18:36.746733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.095 qpair failed and we were unable to recover it. 00:32:20.095 [2024-11-26 19:18:36.746902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.095 [2024-11-26 19:18:36.746995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.095 [2024-11-26 19:18:36.747008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.095 qpair failed and we were unable to recover it. 00:32:20.095 [2024-11-26 19:18:36.747077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.095 [2024-11-26 19:18:36.747258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.095 [2024-11-26 19:18:36.747270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.095 qpair failed and we were unable to recover it. 00:32:20.095 [2024-11-26 19:18:36.747347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.095 [2024-11-26 19:18:36.747406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.095 [2024-11-26 19:18:36.747419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.095 qpair failed and we were unable to recover it. 00:32:20.095 [2024-11-26 19:18:36.747489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.095 [2024-11-26 19:18:36.747627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.095 [2024-11-26 19:18:36.747638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.095 qpair failed and we were unable to recover it. 00:32:20.095 [2024-11-26 19:18:36.747772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.095 [2024-11-26 19:18:36.747905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.095 [2024-11-26 19:18:36.747917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.095 qpair failed and we were unable to recover it. 00:32:20.095 [2024-11-26 19:18:36.748139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.095 [2024-11-26 19:18:36.748219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.095 [2024-11-26 19:18:36.748231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.095 qpair failed and we were unable to recover it. 00:32:20.095 [2024-11-26 19:18:36.748319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.095 [2024-11-26 19:18:36.748455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.095 [2024-11-26 19:18:36.748466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.095 qpair failed and we were unable to recover it. 00:32:20.095 [2024-11-26 19:18:36.748548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.095 [2024-11-26 19:18:36.748614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.095 [2024-11-26 19:18:36.748626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.095 qpair failed and we were unable to recover it. 00:32:20.095 [2024-11-26 19:18:36.748781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.095 [2024-11-26 19:18:36.748857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.095 [2024-11-26 19:18:36.748869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.095 qpair failed and we were unable to recover it. 00:32:20.095 [2024-11-26 19:18:36.748944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.095 [2024-11-26 19:18:36.749161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.095 [2024-11-26 19:18:36.749173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.095 qpair failed and we were unable to recover it. 00:32:20.095 [2024-11-26 19:18:36.749247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.095 [2024-11-26 19:18:36.749312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.095 [2024-11-26 19:18:36.749324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.095 qpair failed and we were unable to recover it. 00:32:20.095 [2024-11-26 19:18:36.749470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.095 [2024-11-26 19:18:36.749600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.095 [2024-11-26 19:18:36.749612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.095 qpair failed and we were unable to recover it. 00:32:20.095 [2024-11-26 19:18:36.749684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.095 [2024-11-26 19:18:36.749821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.095 [2024-11-26 19:18:36.749833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.095 qpair failed and we were unable to recover it. 00:32:20.095 [2024-11-26 19:18:36.749917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.095 [2024-11-26 19:18:36.750167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.095 [2024-11-26 19:18:36.750181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.095 qpair failed and we were unable to recover it. 00:32:20.095 [2024-11-26 19:18:36.750260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.095 [2024-11-26 19:18:36.750482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.095 [2024-11-26 19:18:36.750494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.095 qpair failed and we were unable to recover it. 00:32:20.095 [2024-11-26 19:18:36.750629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.095 [2024-11-26 19:18:36.750702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.095 [2024-11-26 19:18:36.750712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.095 qpair failed and we were unable to recover it. 00:32:20.095 [2024-11-26 19:18:36.750864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.095 [2024-11-26 19:18:36.750938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.095 [2024-11-26 19:18:36.750957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.095 qpair failed and we were unable to recover it. 00:32:20.095 [2024-11-26 19:18:36.751160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.095 [2024-11-26 19:18:36.751252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.095 [2024-11-26 19:18:36.751266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.095 qpair failed and we were unable to recover it. 00:32:20.095 [2024-11-26 19:18:36.751336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.095 [2024-11-26 19:18:36.751410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.096 [2024-11-26 19:18:36.751423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.096 qpair failed and we were unable to recover it. 00:32:20.096 [2024-11-26 19:18:36.751500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.096 [2024-11-26 19:18:36.751578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.096 [2024-11-26 19:18:36.751590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.096 qpair failed and we were unable to recover it. 00:32:20.096 [2024-11-26 19:18:36.751669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.096 [2024-11-26 19:18:36.751746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.096 [2024-11-26 19:18:36.751759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.096 qpair failed and we were unable to recover it. 00:32:20.096 [2024-11-26 19:18:36.751913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.096 [2024-11-26 19:18:36.752052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.096 [2024-11-26 19:18:36.752065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.096 qpair failed and we were unable to recover it. 00:32:20.096 [2024-11-26 19:18:36.752151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.096 [2024-11-26 19:18:36.752294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.096 [2024-11-26 19:18:36.752306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.096 qpair failed and we were unable to recover it. 00:32:20.096 [2024-11-26 19:18:36.752370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.096 [2024-11-26 19:18:36.752568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.096 [2024-11-26 19:18:36.752580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.096 qpair failed and we were unable to recover it. 00:32:20.096 [2024-11-26 19:18:36.752664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.096 [2024-11-26 19:18:36.752812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.096 [2024-11-26 19:18:36.752823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.096 qpair failed and we were unable to recover it. 00:32:20.096 [2024-11-26 19:18:36.752985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.096 [2024-11-26 19:18:36.753085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.096 [2024-11-26 19:18:36.753102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:20.096 qpair failed and we were unable to recover it. 00:32:20.096 [2024-11-26 19:18:36.753248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.096 [2024-11-26 19:18:36.753328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.096 [2024-11-26 19:18:36.753343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:20.096 qpair failed and we were unable to recover it. 00:32:20.096 [2024-11-26 19:18:36.753516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.096 [2024-11-26 19:18:36.753655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.096 [2024-11-26 19:18:36.753670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:20.096 qpair failed and we were unable to recover it. 00:32:20.096 [2024-11-26 19:18:36.753754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.096 [2024-11-26 19:18:36.753914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.096 [2024-11-26 19:18:36.753930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:20.096 qpair failed and we were unable to recover it. 00:32:20.096 [2024-11-26 19:18:36.754032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.096 [2024-11-26 19:18:36.754186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.096 [2024-11-26 19:18:36.754210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.096 qpair failed and we were unable to recover it. 00:32:20.096 [2024-11-26 19:18:36.754293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.096 [2024-11-26 19:18:36.754440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.096 [2024-11-26 19:18:36.754455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.096 qpair failed and we were unable to recover it. 00:32:20.096 [2024-11-26 19:18:36.754671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.096 [2024-11-26 19:18:36.754822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.096 [2024-11-26 19:18:36.754837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.096 qpair failed and we were unable to recover it. 00:32:20.096 [2024-11-26 19:18:36.754941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.096 [2024-11-26 19:18:36.755052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.096 [2024-11-26 19:18:36.755068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.096 qpair failed and we were unable to recover it. 00:32:20.096 [2024-11-26 19:18:36.755140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.096 [2024-11-26 19:18:36.755220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.096 [2024-11-26 19:18:36.755235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.096 qpair failed and we were unable to recover it. 00:32:20.096 [2024-11-26 19:18:36.755469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.096 [2024-11-26 19:18:36.755550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.097 [2024-11-26 19:18:36.755565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.097 qpair failed and we were unable to recover it. 00:32:20.097 [2024-11-26 19:18:36.755666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.097 [2024-11-26 19:18:36.755818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.097 [2024-11-26 19:18:36.755834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.097 qpair failed and we were unable to recover it. 00:32:20.097 [2024-11-26 19:18:36.755927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.097 [2024-11-26 19:18:36.756028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.097 [2024-11-26 19:18:36.756045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.097 qpair failed and we were unable to recover it. 00:32:20.097 [2024-11-26 19:18:36.756142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.097 [2024-11-26 19:18:36.756229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.097 [2024-11-26 19:18:36.756244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.097 qpair failed and we were unable to recover it. 00:32:20.097 [2024-11-26 19:18:36.756327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.097 [2024-11-26 19:18:36.756411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.097 [2024-11-26 19:18:36.756428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.097 qpair failed and we were unable to recover it. 00:32:20.097 [2024-11-26 19:18:36.756499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.097 [2024-11-26 19:18:36.756576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.097 [2024-11-26 19:18:36.756592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.097 qpair failed and we were unable to recover it. 00:32:20.097 [2024-11-26 19:18:36.756681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.097 [2024-11-26 19:18:36.756825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.097 [2024-11-26 19:18:36.756840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.097 qpair failed and we were unable to recover it. 00:32:20.097 [2024-11-26 19:18:36.757006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.097 [2024-11-26 19:18:36.757106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.097 [2024-11-26 19:18:36.757122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.097 qpair failed and we were unable to recover it. 00:32:20.097 [2024-11-26 19:18:36.757262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.097 [2024-11-26 19:18:36.757336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.097 [2024-11-26 19:18:36.757356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.097 qpair failed and we were unable to recover it. 00:32:20.097 [2024-11-26 19:18:36.757508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.097 [2024-11-26 19:18:36.757594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.097 [2024-11-26 19:18:36.757609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.097 qpair failed and we were unable to recover it. 00:32:20.097 [2024-11-26 19:18:36.757755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.097 [2024-11-26 19:18:36.757905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.097 [2024-11-26 19:18:36.757921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.097 qpair failed and we were unable to recover it. 00:32:20.097 [2024-11-26 19:18:36.758067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.097 [2024-11-26 19:18:36.758150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.097 [2024-11-26 19:18:36.758166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.097 qpair failed and we were unable to recover it. 00:32:20.097 [2024-11-26 19:18:36.758243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.097 [2024-11-26 19:18:36.758378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.097 [2024-11-26 19:18:36.758393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.097 qpair failed and we were unable to recover it. 00:32:20.097 [2024-11-26 19:18:36.758598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.097 [2024-11-26 19:18:36.758737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.097 [2024-11-26 19:18:36.758754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.097 qpair failed and we were unable to recover it. 00:32:20.097 [2024-11-26 19:18:36.758847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.097 [2024-11-26 19:18:36.758932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.097 [2024-11-26 19:18:36.758952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.097 qpair failed and we were unable to recover it. 00:32:20.097 [2024-11-26 19:18:36.759092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.097 [2024-11-26 19:18:36.759181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.097 [2024-11-26 19:18:36.759197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.097 qpair failed and we were unable to recover it. 00:32:20.097 [2024-11-26 19:18:36.759376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.097 [2024-11-26 19:18:36.759468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.097 [2024-11-26 19:18:36.759484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.097 qpair failed and we were unable to recover it. 00:32:20.097 [2024-11-26 19:18:36.759557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.097 [2024-11-26 19:18:36.759711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.097 [2024-11-26 19:18:36.759727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.097 qpair failed and we were unable to recover it. 00:32:20.097 [2024-11-26 19:18:36.759802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.097 [2024-11-26 19:18:36.759877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.097 [2024-11-26 19:18:36.759895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.097 qpair failed and we were unable to recover it. 00:32:20.098 [2024-11-26 19:18:36.759992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.098 [2024-11-26 19:18:36.760222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.098 [2024-11-26 19:18:36.760238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.098 qpair failed and we were unable to recover it. 00:32:20.098 [2024-11-26 19:18:36.760320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.098 [2024-11-26 19:18:36.760476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.098 [2024-11-26 19:18:36.760491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.098 qpair failed and we were unable to recover it. 00:32:20.098 [2024-11-26 19:18:36.760631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.098 [2024-11-26 19:18:36.760716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.098 [2024-11-26 19:18:36.760733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.098 qpair failed and we were unable to recover it. 00:32:20.098 [2024-11-26 19:18:36.760883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.098 [2024-11-26 19:18:36.760975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.098 [2024-11-26 19:18:36.760991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.098 qpair failed and we were unable to recover it. 00:32:20.098 [2024-11-26 19:18:36.761149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.098 [2024-11-26 19:18:36.761217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.098 [2024-11-26 19:18:36.761233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.098 qpair failed and we were unable to recover it. 00:32:20.098 [2024-11-26 19:18:36.761309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.098 [2024-11-26 19:18:36.761383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.098 [2024-11-26 19:18:36.761398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.098 qpair failed and we were unable to recover it. 00:32:20.098 [2024-11-26 19:18:36.761549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.098 [2024-11-26 19:18:36.761697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.098 [2024-11-26 19:18:36.761715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.098 qpair failed and we were unable to recover it. 00:32:20.098 [2024-11-26 19:18:36.761808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.098 [2024-11-26 19:18:36.761891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.098 [2024-11-26 19:18:36.761906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.098 qpair failed and we were unable to recover it. 00:32:20.098 [2024-11-26 19:18:36.761983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.098 [2024-11-26 19:18:36.762146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.098 [2024-11-26 19:18:36.762161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.098 qpair failed and we were unable to recover it. 00:32:20.098 [2024-11-26 19:18:36.762299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.098 [2024-11-26 19:18:36.762485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.098 [2024-11-26 19:18:36.762503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.098 qpair failed and we were unable to recover it. 00:32:20.098 [2024-11-26 19:18:36.762577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.098 [2024-11-26 19:18:36.762653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.098 [2024-11-26 19:18:36.762669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.098 qpair failed and we were unable to recover it. 00:32:20.098 [2024-11-26 19:18:36.762881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.098 [2024-11-26 19:18:36.763045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.098 [2024-11-26 19:18:36.763062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.098 qpair failed and we were unable to recover it. 00:32:20.098 [2024-11-26 19:18:36.763216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.098 [2024-11-26 19:18:36.763393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.098 [2024-11-26 19:18:36.763408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.098 qpair failed and we were unable to recover it. 00:32:20.098 [2024-11-26 19:18:36.763491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.098 [2024-11-26 19:18:36.763626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.098 [2024-11-26 19:18:36.763641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.098 qpair failed and we were unable to recover it. 00:32:20.098 [2024-11-26 19:18:36.763785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.098 [2024-11-26 19:18:36.763971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.098 [2024-11-26 19:18:36.763987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.098 qpair failed and we were unable to recover it. 00:32:20.098 [2024-11-26 19:18:36.764084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.098 [2024-11-26 19:18:36.764158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.098 [2024-11-26 19:18:36.764173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.098 qpair failed and we were unable to recover it. 00:32:20.098 [2024-11-26 19:18:36.764324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.098 [2024-11-26 19:18:36.764488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.098 [2024-11-26 19:18:36.764504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.098 qpair failed and we were unable to recover it. 00:32:20.098 [2024-11-26 19:18:36.764656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.098 [2024-11-26 19:18:36.764742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.098 [2024-11-26 19:18:36.764758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.098 qpair failed and we were unable to recover it. 00:32:20.098 [2024-11-26 19:18:36.764932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.098 [2024-11-26 19:18:36.765021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.099 [2024-11-26 19:18:36.765037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.099 qpair failed and we were unable to recover it. 00:32:20.099 [2024-11-26 19:18:36.765182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.099 [2024-11-26 19:18:36.765271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.099 [2024-11-26 19:18:36.765289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.099 qpair failed and we were unable to recover it. 00:32:20.099 [2024-11-26 19:18:36.765458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.099 [2024-11-26 19:18:36.765550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.099 [2024-11-26 19:18:36.765566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.099 qpair failed and we were unable to recover it. 00:32:20.099 [2024-11-26 19:18:36.765655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.099 [2024-11-26 19:18:36.765739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.099 [2024-11-26 19:18:36.765754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.099 qpair failed and we were unable to recover it. 00:32:20.099 [2024-11-26 19:18:36.765931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.099 [2024-11-26 19:18:36.766019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.099 [2024-11-26 19:18:36.766035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.099 qpair failed and we were unable to recover it. 00:32:20.099 [2024-11-26 19:18:36.766178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.099 [2024-11-26 19:18:36.766247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.099 [2024-11-26 19:18:36.766263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.099 qpair failed and we were unable to recover it. 00:32:20.099 [2024-11-26 19:18:36.766363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.099 [2024-11-26 19:18:36.766510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.099 [2024-11-26 19:18:36.766526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.099 qpair failed and we were unable to recover it. 00:32:20.099 [2024-11-26 19:18:36.766672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.099 [2024-11-26 19:18:36.766772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.099 [2024-11-26 19:18:36.766787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.099 qpair failed and we were unable to recover it. 00:32:20.099 [2024-11-26 19:18:36.766865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.099 [2024-11-26 19:18:36.766957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.099 [2024-11-26 19:18:36.766973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.099 qpair failed and we were unable to recover it. 00:32:20.099 [2024-11-26 19:18:36.767062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.099 [2024-11-26 19:18:36.767202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.099 [2024-11-26 19:18:36.767218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.099 qpair failed and we were unable to recover it. 00:32:20.099 [2024-11-26 19:18:36.767357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.099 [2024-11-26 19:18:36.767436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.099 [2024-11-26 19:18:36.767452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.099 qpair failed and we were unable to recover it. 00:32:20.099 [2024-11-26 19:18:36.767602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.099 [2024-11-26 19:18:36.767684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.099 [2024-11-26 19:18:36.767699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.099 qpair failed and we were unable to recover it. 00:32:20.099 [2024-11-26 19:18:36.767854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.099 [2024-11-26 19:18:36.767946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.099 [2024-11-26 19:18:36.767966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.099 qpair failed and we were unable to recover it. 00:32:20.099 [2024-11-26 19:18:36.768119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.099 [2024-11-26 19:18:36.768202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.099 [2024-11-26 19:18:36.768218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.099 qpair failed and we were unable to recover it. 00:32:20.099 [2024-11-26 19:18:36.768298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.099 [2024-11-26 19:18:36.768463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.099 [2024-11-26 19:18:36.768478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.099 qpair failed and we were unable to recover it. 00:32:20.099 [2024-11-26 19:18:36.768556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.099 [2024-11-26 19:18:36.768625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.099 [2024-11-26 19:18:36.768639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.099 qpair failed and we were unable to recover it. 00:32:20.099 [2024-11-26 19:18:36.768726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.099 [2024-11-26 19:18:36.768813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.099 [2024-11-26 19:18:36.768829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.099 qpair failed and we were unable to recover it. 00:32:20.099 [2024-11-26 19:18:36.768963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.099 [2024-11-26 19:18:36.769116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.099 [2024-11-26 19:18:36.769132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.099 qpair failed and we were unable to recover it. 00:32:20.099 [2024-11-26 19:18:36.769282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.099 [2024-11-26 19:18:36.769357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.099 [2024-11-26 19:18:36.769373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.099 qpair failed and we were unable to recover it. 00:32:20.099 [2024-11-26 19:18:36.769468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.099 [2024-11-26 19:18:36.769551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.099 [2024-11-26 19:18:36.769566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.099 qpair failed and we were unable to recover it. 00:32:20.099 [2024-11-26 19:18:36.769729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.099 [2024-11-26 19:18:36.769804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.100 [2024-11-26 19:18:36.769820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.100 qpair failed and we were unable to recover it. 00:32:20.100 [2024-11-26 19:18:36.769885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.100 [2024-11-26 19:18:36.769959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.100 [2024-11-26 19:18:36.769975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.100 qpair failed and we were unable to recover it. 00:32:20.100 [2024-11-26 19:18:36.770128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.100 [2024-11-26 19:18:36.770230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.100 [2024-11-26 19:18:36.770245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.100 qpair failed and we were unable to recover it. 00:32:20.100 [2024-11-26 19:18:36.770324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.100 [2024-11-26 19:18:36.770421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.100 [2024-11-26 19:18:36.770437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.100 qpair failed and we were unable to recover it. 00:32:20.100 [2024-11-26 19:18:36.770536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.100 [2024-11-26 19:18:36.770742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.100 [2024-11-26 19:18:36.770757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.100 qpair failed and we were unable to recover it. 00:32:20.100 [2024-11-26 19:18:36.770823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.100 [2024-11-26 19:18:36.771063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.100 [2024-11-26 19:18:36.771079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.100 qpair failed and we were unable to recover it. 00:32:20.100 [2024-11-26 19:18:36.771166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.100 [2024-11-26 19:18:36.771243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.100 [2024-11-26 19:18:36.771258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.100 qpair failed and we were unable to recover it. 00:32:20.100 [2024-11-26 19:18:36.771339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.100 [2024-11-26 19:18:36.771473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.100 [2024-11-26 19:18:36.771488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.100 qpair failed and we were unable to recover it. 00:32:20.100 [2024-11-26 19:18:36.771694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.100 [2024-11-26 19:18:36.771774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.100 [2024-11-26 19:18:36.771789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.100 qpair failed and we were unable to recover it. 00:32:20.100 [2024-11-26 19:18:36.771995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.100 [2024-11-26 19:18:36.772134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.100 [2024-11-26 19:18:36.772149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.100 qpair failed and we were unable to recover it. 00:32:20.100 [2024-11-26 19:18:36.772235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.100 [2024-11-26 19:18:36.772387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.100 [2024-11-26 19:18:36.772402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.100 qpair failed and we were unable to recover it. 00:32:20.100 [2024-11-26 19:18:36.772475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.100 [2024-11-26 19:18:36.772551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.100 [2024-11-26 19:18:36.772566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.100 qpair failed and we were unable to recover it. 00:32:20.100 [2024-11-26 19:18:36.772719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.100 [2024-11-26 19:18:36.772808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.100 [2024-11-26 19:18:36.772822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.100 qpair failed and we were unable to recover it. 00:32:20.100 [2024-11-26 19:18:36.772925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.100 [2024-11-26 19:18:36.773085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.100 [2024-11-26 19:18:36.773101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.100 qpair failed and we were unable to recover it. 00:32:20.100 [2024-11-26 19:18:36.773258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.100 [2024-11-26 19:18:36.773330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.100 [2024-11-26 19:18:36.773345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.100 qpair failed and we were unable to recover it. 00:32:20.100 [2024-11-26 19:18:36.773436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.101 [2024-11-26 19:18:36.773583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.101 [2024-11-26 19:18:36.773597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.101 qpair failed and we were unable to recover it. 00:32:20.101 [2024-11-26 19:18:36.773703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.101 [2024-11-26 19:18:36.773843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.101 [2024-11-26 19:18:36.773859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.101 qpair failed and we were unable to recover it. 00:32:20.101 [2024-11-26 19:18:36.773931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.101 [2024-11-26 19:18:36.774079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.101 [2024-11-26 19:18:36.774095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.101 qpair failed and we were unable to recover it. 00:32:20.101 [2024-11-26 19:18:36.774185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.101 [2024-11-26 19:18:36.774257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.101 [2024-11-26 19:18:36.774272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.101 qpair failed and we were unable to recover it. 00:32:20.101 [2024-11-26 19:18:36.774353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.101 [2024-11-26 19:18:36.774427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.101 [2024-11-26 19:18:36.774441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.101 qpair failed and we were unable to recover it. 00:32:20.101 [2024-11-26 19:18:36.774583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.101 [2024-11-26 19:18:36.774663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.101 [2024-11-26 19:18:36.774679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.101 qpair failed and we were unable to recover it. 00:32:20.101 [2024-11-26 19:18:36.774753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.101 [2024-11-26 19:18:36.774908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.101 [2024-11-26 19:18:36.774924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.101 qpair failed and we were unable to recover it. 00:32:20.101 [2024-11-26 19:18:36.775067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.101 [2024-11-26 19:18:36.775146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.101 [2024-11-26 19:18:36.775162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.101 qpair failed and we were unable to recover it. 00:32:20.101 [2024-11-26 19:18:36.775258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.101 [2024-11-26 19:18:36.775335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.101 [2024-11-26 19:18:36.775351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.101 qpair failed and we were unable to recover it. 00:32:20.101 [2024-11-26 19:18:36.775424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.101 [2024-11-26 19:18:36.775506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.101 [2024-11-26 19:18:36.775520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.101 qpair failed and we were unable to recover it. 00:32:20.101 [2024-11-26 19:18:36.775656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.101 [2024-11-26 19:18:36.775789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.101 [2024-11-26 19:18:36.775805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.101 qpair failed and we were unable to recover it. 00:32:20.101 [2024-11-26 19:18:36.775945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.101 [2024-11-26 19:18:36.776045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.101 [2024-11-26 19:18:36.776062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.101 qpair failed and we were unable to recover it. 00:32:20.101 [2024-11-26 19:18:36.776199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.101 [2024-11-26 19:18:36.776299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.101 [2024-11-26 19:18:36.776315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.101 qpair failed and we were unable to recover it. 00:32:20.101 [2024-11-26 19:18:36.776540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.101 [2024-11-26 19:18:36.776610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.101 [2024-11-26 19:18:36.776626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.101 qpair failed and we were unable to recover it. 00:32:20.101 [2024-11-26 19:18:36.776707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.101 [2024-11-26 19:18:36.776842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.101 [2024-11-26 19:18:36.776857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.101 qpair failed and we were unable to recover it. 00:32:20.101 [2024-11-26 19:18:36.776945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.101 [2024-11-26 19:18:36.777212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.101 [2024-11-26 19:18:36.777228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.101 qpair failed and we were unable to recover it. 00:32:20.101 [2024-11-26 19:18:36.777318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.101 [2024-11-26 19:18:36.777405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.101 [2024-11-26 19:18:36.777422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.101 qpair failed and we were unable to recover it. 00:32:20.101 [2024-11-26 19:18:36.777566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.101 [2024-11-26 19:18:36.777719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.101 [2024-11-26 19:18:36.777735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.101 qpair failed and we were unable to recover it. 00:32:20.101 [2024-11-26 19:18:36.777957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.101 [2024-11-26 19:18:36.778119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.101 [2024-11-26 19:18:36.778135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.101 qpair failed and we were unable to recover it. 00:32:20.101 [2024-11-26 19:18:36.778343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.101 [2024-11-26 19:18:36.778433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.101 [2024-11-26 19:18:36.778449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.101 qpair failed and we were unable to recover it. 00:32:20.101 [2024-11-26 19:18:36.778613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.101 [2024-11-26 19:18:36.778684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.101 [2024-11-26 19:18:36.778699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.101 qpair failed and we were unable to recover it. 00:32:20.101 [2024-11-26 19:18:36.778782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.101 [2024-11-26 19:18:36.778990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.101 [2024-11-26 19:18:36.779006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.101 qpair failed and we were unable to recover it. 00:32:20.101 [2024-11-26 19:18:36.779173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.101 [2024-11-26 19:18:36.779272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.102 [2024-11-26 19:18:36.779288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.102 qpair failed and we were unable to recover it. 00:32:20.102 [2024-11-26 19:18:36.779495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.102 [2024-11-26 19:18:36.779584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.102 [2024-11-26 19:18:36.779600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.102 qpair failed and we were unable to recover it. 00:32:20.102 [2024-11-26 19:18:36.779691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.102 [2024-11-26 19:18:36.779827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.102 [2024-11-26 19:18:36.779842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.102 qpair failed and we were unable to recover it. 00:32:20.102 [2024-11-26 19:18:36.779938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.102 [2024-11-26 19:18:36.780151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.102 [2024-11-26 19:18:36.780167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.102 qpair failed and we were unable to recover it. 00:32:20.102 [2024-11-26 19:18:36.780239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.102 [2024-11-26 19:18:36.780474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.102 [2024-11-26 19:18:36.780489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.102 qpair failed and we were unable to recover it. 00:32:20.102 [2024-11-26 19:18:36.780577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.102 [2024-11-26 19:18:36.780650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.102 [2024-11-26 19:18:36.780665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.102 qpair failed and we were unable to recover it. 00:32:20.102 [2024-11-26 19:18:36.780823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.102 [2024-11-26 19:18:36.780970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.102 [2024-11-26 19:18:36.780986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.102 qpair failed and we were unable to recover it. 00:32:20.102 [2024-11-26 19:18:36.781058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.102 [2024-11-26 19:18:36.781140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.102 [2024-11-26 19:18:36.781155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.102 qpair failed and we were unable to recover it. 00:32:20.102 [2024-11-26 19:18:36.781317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.102 [2024-11-26 19:18:36.781410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.102 [2024-11-26 19:18:36.781426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.102 qpair failed and we were unable to recover it. 00:32:20.102 [2024-11-26 19:18:36.781637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.102 [2024-11-26 19:18:36.781773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.102 [2024-11-26 19:18:36.781788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.102 qpair failed and we were unable to recover it. 00:32:20.102 [2024-11-26 19:18:36.781995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.102 [2024-11-26 19:18:36.782097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.102 [2024-11-26 19:18:36.782113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.102 qpair failed and we were unable to recover it. 00:32:20.102 [2024-11-26 19:18:36.782256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.102 [2024-11-26 19:18:36.782327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.102 [2024-11-26 19:18:36.782342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.102 qpair failed and we were unable to recover it. 00:32:20.102 [2024-11-26 19:18:36.782441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.102 [2024-11-26 19:18:36.782587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.102 [2024-11-26 19:18:36.782602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.102 qpair failed and we were unable to recover it. 00:32:20.102 [2024-11-26 19:18:36.782684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.102 [2024-11-26 19:18:36.782771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.102 [2024-11-26 19:18:36.782787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.102 qpair failed and we were unable to recover it. 00:32:20.102 [2024-11-26 19:18:36.782891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.102 [2024-11-26 19:18:36.783096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.102 [2024-11-26 19:18:36.783112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.102 qpair failed and we were unable to recover it. 00:32:20.102 [2024-11-26 19:18:36.783271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.102 [2024-11-26 19:18:36.783412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.102 [2024-11-26 19:18:36.783429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:20.102 qpair failed and we were unable to recover it. 00:32:20.102 [2024-11-26 19:18:36.783567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.102 [2024-11-26 19:18:36.783645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.102 [2024-11-26 19:18:36.783661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:20.102 qpair failed and we were unable to recover it. 00:32:20.102 [2024-11-26 19:18:36.783730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.102 [2024-11-26 19:18:36.783908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.102 [2024-11-26 19:18:36.783923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:20.102 qpair failed and we were unable to recover it. 00:32:20.102 [2024-11-26 19:18:36.784076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.102 [2024-11-26 19:18:36.784157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.102 [2024-11-26 19:18:36.784172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:20.102 qpair failed and we were unable to recover it. 00:32:20.102 [2024-11-26 19:18:36.784269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.102 [2024-11-26 19:18:36.784413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.102 [2024-11-26 19:18:36.784429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:20.102 qpair failed and we were unable to recover it. 00:32:20.102 [2024-11-26 19:18:36.784513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.102 [2024-11-26 19:18:36.784647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.102 [2024-11-26 19:18:36.784663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:20.102 qpair failed and we were unable to recover it. 00:32:20.102 [2024-11-26 19:18:36.784750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.103 [2024-11-26 19:18:36.784848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.103 [2024-11-26 19:18:36.784864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:20.103 qpair failed and we were unable to recover it. 00:32:20.103 [2024-11-26 19:18:36.784956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.103 [2024-11-26 19:18:36.785023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.103 [2024-11-26 19:18:36.785037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:20.103 qpair failed and we were unable to recover it. 00:32:20.103 [2024-11-26 19:18:36.785126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.103 [2024-11-26 19:18:36.785264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.103 [2024-11-26 19:18:36.785279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:20.103 qpair failed and we were unable to recover it. 00:32:20.103 [2024-11-26 19:18:36.785360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.103 [2024-11-26 19:18:36.785438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.103 [2024-11-26 19:18:36.785454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:20.103 qpair failed and we were unable to recover it. 00:32:20.103 [2024-11-26 19:18:36.785549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.103 [2024-11-26 19:18:36.785714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.103 [2024-11-26 19:18:36.785731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.103 qpair failed and we were unable to recover it. 00:32:20.103 [2024-11-26 19:18:36.785808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.103 [2024-11-26 19:18:36.785883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.103 [2024-11-26 19:18:36.785895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.103 qpair failed and we were unable to recover it. 00:32:20.103 [2024-11-26 19:18:36.786031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.103 [2024-11-26 19:18:36.786171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.103 [2024-11-26 19:18:36.786182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.103 qpair failed and we were unable to recover it. 00:32:20.103 [2024-11-26 19:18:36.786320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.103 [2024-11-26 19:18:36.786452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.103 [2024-11-26 19:18:36.786464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.103 qpair failed and we were unable to recover it. 00:32:20.103 [2024-11-26 19:18:36.786546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.103 [2024-11-26 19:18:36.786610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.103 [2024-11-26 19:18:36.786623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.103 qpair failed and we were unable to recover it. 00:32:20.103 [2024-11-26 19:18:36.786788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.103 [2024-11-26 19:18:36.786864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.103 [2024-11-26 19:18:36.786876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.103 qpair failed and we were unable to recover it. 00:32:20.103 [2024-11-26 19:18:36.787060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.103 [2024-11-26 19:18:36.787205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.103 [2024-11-26 19:18:36.787217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.103 qpair failed and we were unable to recover it. 00:32:20.103 [2024-11-26 19:18:36.787412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.103 [2024-11-26 19:18:36.787560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.103 [2024-11-26 19:18:36.787573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.103 qpair failed and we were unable to recover it. 00:32:20.103 [2024-11-26 19:18:36.787659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.103 [2024-11-26 19:18:36.787746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.103 [2024-11-26 19:18:36.787759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.103 qpair failed and we were unable to recover it. 00:32:20.103 [2024-11-26 19:18:36.787900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.103 [2024-11-26 19:18:36.787965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.103 [2024-11-26 19:18:36.787977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.103 qpair failed and we were unable to recover it. 00:32:20.103 [2024-11-26 19:18:36.788063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.103 [2024-11-26 19:18:36.788199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.103 [2024-11-26 19:18:36.788210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.103 qpair failed and we were unable to recover it. 00:32:20.103 [2024-11-26 19:18:36.788374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.103 [2024-11-26 19:18:36.788445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.103 [2024-11-26 19:18:36.788456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.103 qpair failed and we were unable to recover it. 00:32:20.103 [2024-11-26 19:18:36.788605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.103 [2024-11-26 19:18:36.788738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.103 [2024-11-26 19:18:36.788751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.103 qpair failed and we were unable to recover it. 00:32:20.103 [2024-11-26 19:18:36.788889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.103 [2024-11-26 19:18:36.788980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.103 [2024-11-26 19:18:36.788993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.103 qpair failed and we were unable to recover it. 00:32:20.103 [2024-11-26 19:18:36.789055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.103 [2024-11-26 19:18:36.789212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.103 [2024-11-26 19:18:36.789224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.103 qpair failed and we were unable to recover it. 00:32:20.103 [2024-11-26 19:18:36.789289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.103 [2024-11-26 19:18:36.789364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.103 [2024-11-26 19:18:36.789374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.103 qpair failed and we were unable to recover it. 00:32:20.103 [2024-11-26 19:18:36.789504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.104 [2024-11-26 19:18:36.789560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.104 [2024-11-26 19:18:36.789572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.104 qpair failed and we were unable to recover it. 00:32:20.104 [2024-11-26 19:18:36.789659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.104 [2024-11-26 19:18:36.789722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.104 [2024-11-26 19:18:36.789733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.104 qpair failed and we were unable to recover it. 00:32:20.104 [2024-11-26 19:18:36.789818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.104 [2024-11-26 19:18:36.789871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.104 [2024-11-26 19:18:36.789881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.104 qpair failed and we were unable to recover it. 00:32:20.104 [2024-11-26 19:18:36.789973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.104 [2024-11-26 19:18:36.790138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.104 [2024-11-26 19:18:36.790150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.104 qpair failed and we were unable to recover it. 00:32:20.104 [2024-11-26 19:18:36.790225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.104 [2024-11-26 19:18:36.790291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.104 [2024-11-26 19:18:36.790302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.104 qpair failed and we were unable to recover it. 00:32:20.104 [2024-11-26 19:18:36.790385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.104 [2024-11-26 19:18:36.790447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.104 [2024-11-26 19:18:36.790458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.104 qpair failed and we were unable to recover it. 00:32:20.104 [2024-11-26 19:18:36.790550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.104 [2024-11-26 19:18:36.790674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.104 [2024-11-26 19:18:36.790686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.104 qpair failed and we were unable to recover it. 00:32:20.104 [2024-11-26 19:18:36.790768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.104 [2024-11-26 19:18:36.790910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.104 [2024-11-26 19:18:36.790922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.104 qpair failed and we were unable to recover it. 00:32:20.104 [2024-11-26 19:18:36.790996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.104 [2024-11-26 19:18:36.791075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.104 [2024-11-26 19:18:36.791086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.104 qpair failed and we were unable to recover it. 00:32:20.104 [2024-11-26 19:18:36.791157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.104 [2024-11-26 19:18:36.791217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.104 [2024-11-26 19:18:36.791227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.104 qpair failed and we were unable to recover it. 00:32:20.104 [2024-11-26 19:18:36.791359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.104 [2024-11-26 19:18:36.791503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.104 [2024-11-26 19:18:36.791515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.104 qpair failed and we were unable to recover it. 00:32:20.104 [2024-11-26 19:18:36.791585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.104 [2024-11-26 19:18:36.791714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.104 [2024-11-26 19:18:36.791726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.104 qpair failed and we were unable to recover it. 00:32:20.104 [2024-11-26 19:18:36.791810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.104 [2024-11-26 19:18:36.791875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.104 [2024-11-26 19:18:36.791886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.104 qpair failed and we were unable to recover it. 00:32:20.104 [2024-11-26 19:18:36.792014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.104 [2024-11-26 19:18:36.792093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.104 [2024-11-26 19:18:36.792105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.104 qpair failed and we were unable to recover it. 00:32:20.104 [2024-11-26 19:18:36.792199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.104 [2024-11-26 19:18:36.792399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.104 [2024-11-26 19:18:36.792411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.104 qpair failed and we were unable to recover it. 00:32:20.104 [2024-11-26 19:18:36.792491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.104 [2024-11-26 19:18:36.792582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.104 [2024-11-26 19:18:36.792594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.104 qpair failed and we were unable to recover it. 00:32:20.104 [2024-11-26 19:18:36.792802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.104 [2024-11-26 19:18:36.792878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.104 [2024-11-26 19:18:36.792890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.104 qpair failed and we were unable to recover it. 00:32:20.104 [2024-11-26 19:18:36.793043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.104 [2024-11-26 19:18:36.793137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.104 [2024-11-26 19:18:36.793149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.104 qpair failed and we were unable to recover it. 00:32:20.104 [2024-11-26 19:18:36.793282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.104 [2024-11-26 19:18:36.793360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.104 [2024-11-26 19:18:36.793371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.104 qpair failed and we were unable to recover it. 00:32:20.104 [2024-11-26 19:18:36.793460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.104 [2024-11-26 19:18:36.793544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.104 [2024-11-26 19:18:36.793556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.105 qpair failed and we were unable to recover it. 00:32:20.105 [2024-11-26 19:18:36.793725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.105 [2024-11-26 19:18:36.793800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.105 [2024-11-26 19:18:36.793812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.105 qpair failed and we were unable to recover it. 00:32:20.105 [2024-11-26 19:18:36.793889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.105 [2024-11-26 19:18:36.793955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.105 [2024-11-26 19:18:36.793966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.105 qpair failed and we were unable to recover it. 00:32:20.105 [2024-11-26 19:18:36.794033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.105 [2024-11-26 19:18:36.794122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.105 [2024-11-26 19:18:36.794135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.105 qpair failed and we were unable to recover it. 00:32:20.105 [2024-11-26 19:18:36.794270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.105 [2024-11-26 19:18:36.794332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.105 [2024-11-26 19:18:36.794344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.105 qpair failed and we were unable to recover it. 00:32:20.105 [2024-11-26 19:18:36.794419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.105 [2024-11-26 19:18:36.794638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.105 [2024-11-26 19:18:36.794649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.105 qpair failed and we were unable to recover it. 00:32:20.105 [2024-11-26 19:18:36.794721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.105 [2024-11-26 19:18:36.794814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.105 [2024-11-26 19:18:36.794826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.105 qpair failed and we were unable to recover it. 00:32:20.105 [2024-11-26 19:18:36.794895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.105 [2024-11-26 19:18:36.794961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.105 [2024-11-26 19:18:36.794972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.105 qpair failed and we were unable to recover it. 00:32:20.105 [2024-11-26 19:18:36.795112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.105 [2024-11-26 19:18:36.795238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.105 [2024-11-26 19:18:36.795251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.105 qpair failed and we were unable to recover it. 00:32:20.105 [2024-11-26 19:18:36.795318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.105 [2024-11-26 19:18:36.795445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.105 [2024-11-26 19:18:36.795456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.105 qpair failed and we were unable to recover it. 00:32:20.105 [2024-11-26 19:18:36.795536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.105 [2024-11-26 19:18:36.795616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.105 [2024-11-26 19:18:36.795627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.105 qpair failed and we were unable to recover it. 00:32:20.105 [2024-11-26 19:18:36.795715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.105 [2024-11-26 19:18:36.795861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.105 [2024-11-26 19:18:36.795873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.105 qpair failed and we were unable to recover it. 00:32:20.105 [2024-11-26 19:18:36.795956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.105 [2024-11-26 19:18:36.796029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.105 [2024-11-26 19:18:36.796040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.105 qpair failed and we were unable to recover it. 00:32:20.105 [2024-11-26 19:18:36.796119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.105 [2024-11-26 19:18:36.796212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.105 [2024-11-26 19:18:36.796224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.105 qpair failed and we were unable to recover it. 00:32:20.105 [2024-11-26 19:18:36.796296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.105 [2024-11-26 19:18:36.796435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.105 [2024-11-26 19:18:36.796447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.105 qpair failed and we were unable to recover it. 00:32:20.105 [2024-11-26 19:18:36.796577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.105 [2024-11-26 19:18:36.796724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.105 [2024-11-26 19:18:36.796738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.105 qpair failed and we were unable to recover it. 00:32:20.105 [2024-11-26 19:18:36.796814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.105 [2024-11-26 19:18:36.796887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.105 [2024-11-26 19:18:36.796898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.105 qpair failed and we were unable to recover it. 00:32:20.105 [2024-11-26 19:18:36.796976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.105 [2024-11-26 19:18:36.797065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.105 [2024-11-26 19:18:36.797077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.105 qpair failed and we were unable to recover it. 00:32:20.105 [2024-11-26 19:18:36.797146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.105 [2024-11-26 19:18:36.797213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.105 [2024-11-26 19:18:36.797224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.105 qpair failed and we were unable to recover it. 00:32:20.105 [2024-11-26 19:18:36.797298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.105 [2024-11-26 19:18:36.797358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.105 [2024-11-26 19:18:36.797369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.105 qpair failed and we were unable to recover it. 00:32:20.105 [2024-11-26 19:18:36.797533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.105 [2024-11-26 19:18:36.797694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.105 [2024-11-26 19:18:36.797706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.105 qpair failed and we were unable to recover it. 00:32:20.105 [2024-11-26 19:18:36.797840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.105 [2024-11-26 19:18:36.797987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.106 [2024-11-26 19:18:36.797999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.106 qpair failed and we were unable to recover it. 00:32:20.106 [2024-11-26 19:18:36.798077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.106 [2024-11-26 19:18:36.798271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.106 [2024-11-26 19:18:36.798284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.106 qpair failed and we were unable to recover it. 00:32:20.106 [2024-11-26 19:18:36.798362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.106 [2024-11-26 19:18:36.798521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.106 [2024-11-26 19:18:36.798533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.106 qpair failed and we were unable to recover it. 00:32:20.106 [2024-11-26 19:18:36.798596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.106 [2024-11-26 19:18:36.798745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.106 [2024-11-26 19:18:36.798758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.106 qpair failed and we were unable to recover it. 00:32:20.106 [2024-11-26 19:18:36.798890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.106 [2024-11-26 19:18:36.799020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.106 [2024-11-26 19:18:36.799035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.106 qpair failed and we were unable to recover it. 00:32:20.106 [2024-11-26 19:18:36.799107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.106 [2024-11-26 19:18:36.799171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.106 [2024-11-26 19:18:36.799183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.106 qpair failed and we were unable to recover it. 00:32:20.106 [2024-11-26 19:18:36.799254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.106 [2024-11-26 19:18:36.799325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.106 [2024-11-26 19:18:36.799338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.106 qpair failed and we were unable to recover it. 00:32:20.106 [2024-11-26 19:18:36.799433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.106 [2024-11-26 19:18:36.799578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.106 [2024-11-26 19:18:36.799591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.106 qpair failed and we were unable to recover it. 00:32:20.106 [2024-11-26 19:18:36.799732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.106 [2024-11-26 19:18:36.799826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.106 [2024-11-26 19:18:36.799838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.106 qpair failed and we were unable to recover it. 00:32:20.106 [2024-11-26 19:18:36.799922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.106 [2024-11-26 19:18:36.799996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.106 [2024-11-26 19:18:36.800008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.106 qpair failed and we were unable to recover it. 00:32:20.106 [2024-11-26 19:18:36.800156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.106 [2024-11-26 19:18:36.800240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.106 [2024-11-26 19:18:36.800251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.106 qpair failed and we were unable to recover it. 00:32:20.106 [2024-11-26 19:18:36.800339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.106 [2024-11-26 19:18:36.800410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.106 [2024-11-26 19:18:36.800422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.106 qpair failed and we were unable to recover it. 00:32:20.106 [2024-11-26 19:18:36.800504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.106 [2024-11-26 19:18:36.800639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.106 [2024-11-26 19:18:36.800652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.106 qpair failed and we were unable to recover it. 00:32:20.106 [2024-11-26 19:18:36.800718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.106 [2024-11-26 19:18:36.800857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.106 [2024-11-26 19:18:36.800869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.106 qpair failed and we were unable to recover it. 00:32:20.106 [2024-11-26 19:18:36.800997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.106 [2024-11-26 19:18:36.801081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.106 [2024-11-26 19:18:36.801095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.106 qpair failed and we were unable to recover it. 00:32:20.106 [2024-11-26 19:18:36.801242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.106 [2024-11-26 19:18:36.801483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.106 [2024-11-26 19:18:36.801495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.106 qpair failed and we were unable to recover it. 00:32:20.106 [2024-11-26 19:18:36.801566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.106 [2024-11-26 19:18:36.801662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.106 [2024-11-26 19:18:36.801674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.106 qpair failed and we were unable to recover it. 00:32:20.106 [2024-11-26 19:18:36.801752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.106 [2024-11-26 19:18:36.801841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.106 [2024-11-26 19:18:36.801853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.106 qpair failed and we were unable to recover it. 00:32:20.106 [2024-11-26 19:18:36.801991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.106 [2024-11-26 19:18:36.802138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.106 [2024-11-26 19:18:36.802150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.106 qpair failed and we were unable to recover it. 00:32:20.106 [2024-11-26 19:18:36.802224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.106 [2024-11-26 19:18:36.802289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.106 [2024-11-26 19:18:36.802299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.106 qpair failed and we were unable to recover it. 00:32:20.106 [2024-11-26 19:18:36.802380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.106 [2024-11-26 19:18:36.802509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.106 [2024-11-26 19:18:36.802521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.106 qpair failed and we were unable to recover it. 00:32:20.106 [2024-11-26 19:18:36.802598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.106 [2024-11-26 19:18:36.802675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.106 [2024-11-26 19:18:36.802687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.106 qpair failed and we were unable to recover it. 00:32:20.106 [2024-11-26 19:18:36.802764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.106 [2024-11-26 19:18:36.802889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.106 [2024-11-26 19:18:36.802900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.106 qpair failed and we were unable to recover it. 00:32:20.107 [2024-11-26 19:18:36.803031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.107 [2024-11-26 19:18:36.803235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.107 [2024-11-26 19:18:36.803247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.107 qpair failed and we were unable to recover it. 00:32:20.107 [2024-11-26 19:18:36.803443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.107 [2024-11-26 19:18:36.803514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.107 [2024-11-26 19:18:36.803527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.107 qpair failed and we were unable to recover it. 00:32:20.107 [2024-11-26 19:18:36.803599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.107 [2024-11-26 19:18:36.803673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.107 [2024-11-26 19:18:36.803684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.107 qpair failed and we were unable to recover it. 00:32:20.107 [2024-11-26 19:18:36.803820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.107 [2024-11-26 19:18:36.803955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.107 [2024-11-26 19:18:36.803967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.107 qpair failed and we were unable to recover it. 00:32:20.107 [2024-11-26 19:18:36.804105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.107 [2024-11-26 19:18:36.804188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.107 [2024-11-26 19:18:36.804199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.107 qpair failed and we were unable to recover it. 00:32:20.107 [2024-11-26 19:18:36.804283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.107 [2024-11-26 19:18:36.804353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.107 [2024-11-26 19:18:36.804364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.107 qpair failed and we were unable to recover it. 00:32:20.107 [2024-11-26 19:18:36.804434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.107 [2024-11-26 19:18:36.804574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.107 [2024-11-26 19:18:36.804586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.107 qpair failed and we were unable to recover it. 00:32:20.107 [2024-11-26 19:18:36.804653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.107 [2024-11-26 19:18:36.804733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.107 [2024-11-26 19:18:36.804745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.107 qpair failed and we were unable to recover it. 00:32:20.107 [2024-11-26 19:18:36.804822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.107 [2024-11-26 19:18:36.804968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.107 [2024-11-26 19:18:36.804980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.107 qpair failed and we were unable to recover it. 00:32:20.107 [2024-11-26 19:18:36.805055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.107 [2024-11-26 19:18:36.805164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.107 [2024-11-26 19:18:36.805176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.107 qpair failed and we were unable to recover it. 00:32:20.107 [2024-11-26 19:18:36.805303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.107 [2024-11-26 19:18:36.805428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.107 [2024-11-26 19:18:36.805440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.107 qpair failed and we were unable to recover it. 00:32:20.107 [2024-11-26 19:18:36.805653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.107 [2024-11-26 19:18:36.805802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.107 [2024-11-26 19:18:36.805814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.107 qpair failed and we were unable to recover it. 00:32:20.107 [2024-11-26 19:18:36.805900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.107 [2024-11-26 19:18:36.805968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.107 [2024-11-26 19:18:36.805980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.107 qpair failed and we were unable to recover it. 00:32:20.107 [2024-11-26 19:18:36.806042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.107 [2024-11-26 19:18:36.806123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.107 [2024-11-26 19:18:36.806134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.107 qpair failed and we were unable to recover it. 00:32:20.107 [2024-11-26 19:18:36.806204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.107 [2024-11-26 19:18:36.806336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.107 [2024-11-26 19:18:36.806347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.107 qpair failed and we were unable to recover it. 00:32:20.107 [2024-11-26 19:18:36.806428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.107 [2024-11-26 19:18:36.806620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.107 [2024-11-26 19:18:36.806632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.107 qpair failed and we were unable to recover it. 00:32:20.107 [2024-11-26 19:18:36.806718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.107 [2024-11-26 19:18:36.806857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.107 [2024-11-26 19:18:36.806868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.107 qpair failed and we were unable to recover it. 00:32:20.107 [2024-11-26 19:18:36.806929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.107 [2024-11-26 19:18:36.807008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.107 [2024-11-26 19:18:36.807019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.107 qpair failed and we were unable to recover it. 00:32:20.107 [2024-11-26 19:18:36.807079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.107 [2024-11-26 19:18:36.807211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.107 [2024-11-26 19:18:36.807222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.107 qpair failed and we were unable to recover it. 00:32:20.107 [2024-11-26 19:18:36.807417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.107 [2024-11-26 19:18:36.807483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.107 [2024-11-26 19:18:36.807495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.107 qpair failed and we were unable to recover it. 00:32:20.107 [2024-11-26 19:18:36.807574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.107 [2024-11-26 19:18:36.807640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.107 [2024-11-26 19:18:36.807651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.107 qpair failed and we were unable to recover it. 00:32:20.107 [2024-11-26 19:18:36.807713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.107 [2024-11-26 19:18:36.807797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.107 [2024-11-26 19:18:36.807809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.107 qpair failed and we were unable to recover it. 00:32:20.107 [2024-11-26 19:18:36.807888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.107 [2024-11-26 19:18:36.807959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.107 [2024-11-26 19:18:36.807971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.107 qpair failed and we were unable to recover it. 00:32:20.108 [2024-11-26 19:18:36.808039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.108 [2024-11-26 19:18:36.808101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.108 [2024-11-26 19:18:36.808113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.108 qpair failed and we were unable to recover it. 00:32:20.108 [2024-11-26 19:18:36.808244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.108 [2024-11-26 19:18:36.808389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.108 [2024-11-26 19:18:36.808401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.108 qpair failed and we were unable to recover it. 00:32:20.108 [2024-11-26 19:18:36.808537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.108 [2024-11-26 19:18:36.808619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.108 [2024-11-26 19:18:36.808631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.108 qpair failed and we were unable to recover it. 00:32:20.108 [2024-11-26 19:18:36.808824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.108 [2024-11-26 19:18:36.808906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.108 [2024-11-26 19:18:36.808918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.108 qpair failed and we were unable to recover it. 00:32:20.108 [2024-11-26 19:18:36.808993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.108 [2024-11-26 19:18:36.809132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.108 [2024-11-26 19:18:36.809143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.108 qpair failed and we were unable to recover it. 00:32:20.108 [2024-11-26 19:18:36.809226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.108 [2024-11-26 19:18:36.809307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.108 [2024-11-26 19:18:36.809319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.108 qpair failed and we were unable to recover it. 00:32:20.108 [2024-11-26 19:18:36.809402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.108 [2024-11-26 19:18:36.809476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.108 [2024-11-26 19:18:36.809487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.108 qpair failed and we were unable to recover it. 00:32:20.108 [2024-11-26 19:18:36.809568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.108 [2024-11-26 19:18:36.809638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.108 [2024-11-26 19:18:36.809650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.108 qpair failed and we were unable to recover it. 00:32:20.108 [2024-11-26 19:18:36.809715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.108 [2024-11-26 19:18:36.809785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.108 [2024-11-26 19:18:36.809797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.108 qpair failed and we were unable to recover it. 00:32:20.108 [2024-11-26 19:18:36.809953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.108 [2024-11-26 19:18:36.810021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.108 [2024-11-26 19:18:36.810033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.108 qpair failed and we were unable to recover it. 00:32:20.108 [2024-11-26 19:18:36.810114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.108 [2024-11-26 19:18:36.810339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.108 [2024-11-26 19:18:36.810350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.108 qpair failed and we were unable to recover it. 00:32:20.108 [2024-11-26 19:18:36.810424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.108 [2024-11-26 19:18:36.810478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.108 [2024-11-26 19:18:36.810489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.108 qpair failed and we were unable to recover it. 00:32:20.108 [2024-11-26 19:18:36.810559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.108 [2024-11-26 19:18:36.810636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.108 [2024-11-26 19:18:36.810647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.108 qpair failed and we were unable to recover it. 00:32:20.108 [2024-11-26 19:18:36.810724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.108 [2024-11-26 19:18:36.810791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.108 [2024-11-26 19:18:36.810803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.108 qpair failed and we were unable to recover it. 00:32:20.108 [2024-11-26 19:18:36.810877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.108 [2024-11-26 19:18:36.810956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.108 [2024-11-26 19:18:36.810968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.108 qpair failed and we were unable to recover it. 00:32:20.108 [2024-11-26 19:18:36.811099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.108 [2024-11-26 19:18:36.811169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.108 [2024-11-26 19:18:36.811181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.108 qpair failed and we were unable to recover it. 00:32:20.108 [2024-11-26 19:18:36.811324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.108 [2024-11-26 19:18:36.811419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.108 [2024-11-26 19:18:36.811430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.108 qpair failed and we were unable to recover it. 00:32:20.108 [2024-11-26 19:18:36.811493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.108 [2024-11-26 19:18:36.811570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.108 [2024-11-26 19:18:36.811581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.108 qpair failed and we were unable to recover it. 00:32:20.108 [2024-11-26 19:18:36.811710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.108 [2024-11-26 19:18:36.811859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.108 [2024-11-26 19:18:36.811870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.108 qpair failed and we were unable to recover it. 00:32:20.108 [2024-11-26 19:18:36.812026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.108 [2024-11-26 19:18:36.812169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.108 [2024-11-26 19:18:36.812181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.108 qpair failed and we were unable to recover it. 00:32:20.108 [2024-11-26 19:18:36.812255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.108 [2024-11-26 19:18:36.812332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.108 [2024-11-26 19:18:36.812344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.108 qpair failed and we were unable to recover it. 00:32:20.108 [2024-11-26 19:18:36.812410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.108 [2024-11-26 19:18:36.812474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.108 [2024-11-26 19:18:36.812484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.108 qpair failed and we were unable to recover it. 00:32:20.108 [2024-11-26 19:18:36.812545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.108 [2024-11-26 19:18:36.812619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.109 [2024-11-26 19:18:36.812632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.109 qpair failed and we were unable to recover it. 00:32:20.109 [2024-11-26 19:18:36.812781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.109 [2024-11-26 19:18:36.812908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.109 [2024-11-26 19:18:36.812920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.109 qpair failed and we were unable to recover it. 00:32:20.109 [2024-11-26 19:18:36.813011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.109 [2024-11-26 19:18:36.813084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.109 [2024-11-26 19:18:36.813096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.109 qpair failed and we were unable to recover it. 00:32:20.109 [2024-11-26 19:18:36.813315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.109 [2024-11-26 19:18:36.813386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.109 [2024-11-26 19:18:36.813397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.109 qpair failed and we were unable to recover it. 00:32:20.109 [2024-11-26 19:18:36.813475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.109 [2024-11-26 19:18:36.813555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.109 [2024-11-26 19:18:36.813566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.109 qpair failed and we were unable to recover it. 00:32:20.109 [2024-11-26 19:18:36.813785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.109 [2024-11-26 19:18:36.813846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.109 [2024-11-26 19:18:36.813858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.109 qpair failed and we were unable to recover it. 00:32:20.109 [2024-11-26 19:18:36.813935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.109 [2024-11-26 19:18:36.814023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.109 [2024-11-26 19:18:36.814035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.109 qpair failed and we were unable to recover it. 00:32:20.109 [2024-11-26 19:18:36.814184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.109 [2024-11-26 19:18:36.814255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.109 [2024-11-26 19:18:36.814266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.109 qpair failed and we were unable to recover it. 00:32:20.109 [2024-11-26 19:18:36.814430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.109 [2024-11-26 19:18:36.814581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.109 [2024-11-26 19:18:36.814593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.109 qpair failed and we were unable to recover it. 00:32:20.109 [2024-11-26 19:18:36.814821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.109 [2024-11-26 19:18:36.814900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.109 [2024-11-26 19:18:36.814912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.109 qpair failed and we were unable to recover it. 00:32:20.109 [2024-11-26 19:18:36.815071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.109 [2024-11-26 19:18:36.815134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.109 [2024-11-26 19:18:36.815145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.109 qpair failed and we were unable to recover it. 00:32:20.109 [2024-11-26 19:18:36.815219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.109 [2024-11-26 19:18:36.815358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.109 [2024-11-26 19:18:36.815371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.109 qpair failed and we were unable to recover it. 00:32:20.109 [2024-11-26 19:18:36.815518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.109 [2024-11-26 19:18:36.815590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.109 [2024-11-26 19:18:36.815603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.109 qpair failed and we were unable to recover it. 00:32:20.109 [2024-11-26 19:18:36.815744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.109 [2024-11-26 19:18:36.815803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.109 [2024-11-26 19:18:36.815815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.109 qpair failed and we were unable to recover it. 00:32:20.109 [2024-11-26 19:18:36.815897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.109 [2024-11-26 19:18:36.815977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.109 [2024-11-26 19:18:36.815989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.109 qpair failed and we were unable to recover it. 00:32:20.109 [2024-11-26 19:18:36.816143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.109 [2024-11-26 19:18:36.816206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.109 [2024-11-26 19:18:36.816217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.109 qpair failed and we were unable to recover it. 00:32:20.109 [2024-11-26 19:18:36.816289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.109 [2024-11-26 19:18:36.816397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.109 [2024-11-26 19:18:36.816409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.109 qpair failed and we were unable to recover it. 00:32:20.109 [2024-11-26 19:18:36.816486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.109 [2024-11-26 19:18:36.816559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.109 [2024-11-26 19:18:36.816570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.109 qpair failed and we were unable to recover it. 00:32:20.109 [2024-11-26 19:18:36.816630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.109 [2024-11-26 19:18:36.816758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.109 [2024-11-26 19:18:36.816769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.109 qpair failed and we were unable to recover it. 00:32:20.109 [2024-11-26 19:18:36.816898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.109 [2024-11-26 19:18:36.816971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.109 [2024-11-26 19:18:36.816983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.109 qpair failed and we were unable to recover it. 00:32:20.109 [2024-11-26 19:18:36.817061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.109 [2024-11-26 19:18:36.817125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.109 [2024-11-26 19:18:36.817136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.109 qpair failed and we were unable to recover it. 00:32:20.109 [2024-11-26 19:18:36.817222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.109 [2024-11-26 19:18:36.817283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.110 [2024-11-26 19:18:36.817294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.110 qpair failed and we were unable to recover it. 00:32:20.110 [2024-11-26 19:18:36.817431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.110 [2024-11-26 19:18:36.817494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.110 [2024-11-26 19:18:36.817506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.110 qpair failed and we were unable to recover it. 00:32:20.110 [2024-11-26 19:18:36.817565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.110 [2024-11-26 19:18:36.817697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.110 [2024-11-26 19:18:36.817709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.110 qpair failed and we were unable to recover it. 00:32:20.110 [2024-11-26 19:18:36.817771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.110 [2024-11-26 19:18:36.817906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.110 [2024-11-26 19:18:36.817918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.110 qpair failed and we were unable to recover it. 00:32:20.110 [2024-11-26 19:18:36.818063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.110 [2024-11-26 19:18:36.818136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.110 [2024-11-26 19:18:36.818148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.110 qpair failed and we were unable to recover it. 00:32:20.110 [2024-11-26 19:18:36.818268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.110 [2024-11-26 19:18:36.818394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.110 [2024-11-26 19:18:36.818405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.110 qpair failed and we were unable to recover it. 00:32:20.110 [2024-11-26 19:18:36.818578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.110 [2024-11-26 19:18:36.818716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.110 [2024-11-26 19:18:36.818728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.110 qpair failed and we were unable to recover it. 00:32:20.110 [2024-11-26 19:18:36.818878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.110 [2024-11-26 19:18:36.818957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.110 [2024-11-26 19:18:36.818969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.110 qpair failed and we were unable to recover it. 00:32:20.110 [2024-11-26 19:18:36.819032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.110 [2024-11-26 19:18:36.819095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.110 [2024-11-26 19:18:36.819106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.110 qpair failed and we were unable to recover it. 00:32:20.110 [2024-11-26 19:18:36.819175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.110 [2024-11-26 19:18:36.819324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.110 [2024-11-26 19:18:36.819335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.110 qpair failed and we were unable to recover it. 00:32:20.110 [2024-11-26 19:18:36.819403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.110 [2024-11-26 19:18:36.819531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.110 [2024-11-26 19:18:36.819543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.110 qpair failed and we were unable to recover it. 00:32:20.110 [2024-11-26 19:18:36.819767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.110 [2024-11-26 19:18:36.819842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.110 [2024-11-26 19:18:36.819853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.110 qpair failed and we were unable to recover it. 00:32:20.110 [2024-11-26 19:18:36.819940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.110 [2024-11-26 19:18:36.820027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.110 [2024-11-26 19:18:36.820039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.110 qpair failed and we were unable to recover it. 00:32:20.110 [2024-11-26 19:18:36.820138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.110 [2024-11-26 19:18:36.820227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.110 [2024-11-26 19:18:36.820238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.110 qpair failed and we were unable to recover it. 00:32:20.110 [2024-11-26 19:18:36.820316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.110 [2024-11-26 19:18:36.820422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.110 [2024-11-26 19:18:36.820433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.110 qpair failed and we were unable to recover it. 00:32:20.110 [2024-11-26 19:18:36.820530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.110 [2024-11-26 19:18:36.820679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.110 [2024-11-26 19:18:36.820691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.110 qpair failed and we were unable to recover it. 00:32:20.110 [2024-11-26 19:18:36.820848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.110 [2024-11-26 19:18:36.820921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.110 [2024-11-26 19:18:36.820937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.110 qpair failed and we were unable to recover it. 00:32:20.110 [2024-11-26 19:18:36.821026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.110 [2024-11-26 19:18:36.821099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.110 [2024-11-26 19:18:36.821115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.110 qpair failed and we were unable to recover it. 00:32:20.110 [2024-11-26 19:18:36.821200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.110 [2024-11-26 19:18:36.821273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.110 [2024-11-26 19:18:36.821288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.110 qpair failed and we were unable to recover it. 00:32:20.110 [2024-11-26 19:18:36.821358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.110 [2024-11-26 19:18:36.821499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.110 [2024-11-26 19:18:36.821515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.110 qpair failed and we were unable to recover it. 00:32:20.110 [2024-11-26 19:18:36.821662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.110 [2024-11-26 19:18:36.821803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.110 [2024-11-26 19:18:36.821819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.110 qpair failed and we were unable to recover it. 00:32:20.110 [2024-11-26 19:18:36.821891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.110 [2024-11-26 19:18:36.822039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.110 [2024-11-26 19:18:36.822056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.110 qpair failed and we were unable to recover it. 00:32:20.110 [2024-11-26 19:18:36.822139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.111 [2024-11-26 19:18:36.822345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.111 [2024-11-26 19:18:36.822360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.111 qpair failed and we were unable to recover it. 00:32:20.111 [2024-11-26 19:18:36.822497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.111 [2024-11-26 19:18:36.822583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.111 [2024-11-26 19:18:36.822598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.111 qpair failed and we were unable to recover it. 00:32:20.111 [2024-11-26 19:18:36.822678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.111 [2024-11-26 19:18:36.822834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.111 [2024-11-26 19:18:36.822850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.111 qpair failed and we were unable to recover it. 00:32:20.111 [2024-11-26 19:18:36.822926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.111 [2024-11-26 19:18:36.823092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.111 [2024-11-26 19:18:36.823108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.111 qpair failed and we were unable to recover it. 00:32:20.111 [2024-11-26 19:18:36.823348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.111 [2024-11-26 19:18:36.823623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.111 [2024-11-26 19:18:36.823638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.111 qpair failed and we were unable to recover it. 00:32:20.111 [2024-11-26 19:18:36.823735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.111 [2024-11-26 19:18:36.823831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.111 [2024-11-26 19:18:36.823846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.111 qpair failed and we were unable to recover it. 00:32:20.111 [2024-11-26 19:18:36.823942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.111 [2024-11-26 19:18:36.824103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.111 [2024-11-26 19:18:36.824119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.111 qpair failed and we were unable to recover it. 00:32:20.111 [2024-11-26 19:18:36.824212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.111 [2024-11-26 19:18:36.824299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.111 [2024-11-26 19:18:36.824313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.111 qpair failed and we were unable to recover it. 00:32:20.111 [2024-11-26 19:18:36.824479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.111 [2024-11-26 19:18:36.824617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.111 [2024-11-26 19:18:36.824633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.111 qpair failed and we were unable to recover it. 00:32:20.111 [2024-11-26 19:18:36.824703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.111 [2024-11-26 19:18:36.824775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.111 [2024-11-26 19:18:36.824790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.111 qpair failed and we were unable to recover it. 00:32:20.111 [2024-11-26 19:18:36.824868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.111 [2024-11-26 19:18:36.825072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.111 [2024-11-26 19:18:36.825089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.111 qpair failed and we were unable to recover it. 00:32:20.111 [2024-11-26 19:18:36.825275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.111 [2024-11-26 19:18:36.825349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.111 [2024-11-26 19:18:36.825364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.111 qpair failed and we were unable to recover it. 00:32:20.111 [2024-11-26 19:18:36.825507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.111 [2024-11-26 19:18:36.825610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.111 [2024-11-26 19:18:36.825625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.111 qpair failed and we were unable to recover it. 00:32:20.111 [2024-11-26 19:18:36.825712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.111 [2024-11-26 19:18:36.825810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.111 [2024-11-26 19:18:36.825825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.111 qpair failed and we were unable to recover it. 00:32:20.111 [2024-11-26 19:18:36.825936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.111 [2024-11-26 19:18:36.826038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.111 [2024-11-26 19:18:36.826053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.111 qpair failed and we were unable to recover it. 00:32:20.111 [2024-11-26 19:18:36.826151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.111 [2024-11-26 19:18:36.826287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.111 [2024-11-26 19:18:36.826302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.111 qpair failed and we were unable to recover it. 00:32:20.111 [2024-11-26 19:18:36.826397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.111 [2024-11-26 19:18:36.826470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.111 [2024-11-26 19:18:36.826487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.111 qpair failed and we were unable to recover it. 00:32:20.111 [2024-11-26 19:18:36.826574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.111 [2024-11-26 19:18:36.826710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.111 [2024-11-26 19:18:36.826725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:20.111 qpair failed and we were unable to recover it. 00:32:20.111 [2024-11-26 19:18:36.826874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.111 [2024-11-26 19:18:36.827008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.111 [2024-11-26 19:18:36.827020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.111 qpair failed and we were unable to recover it. 00:32:20.111 [2024-11-26 19:18:36.827173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.111 [2024-11-26 19:18:36.827261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.111 [2024-11-26 19:18:36.827273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.111 qpair failed and we were unable to recover it. 00:32:20.111 [2024-11-26 19:18:36.827360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.111 [2024-11-26 19:18:36.827425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.111 [2024-11-26 19:18:36.827436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.111 qpair failed and we were unable to recover it. 00:32:20.111 [2024-11-26 19:18:36.827512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.111 [2024-11-26 19:18:36.827659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.112 [2024-11-26 19:18:36.827671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.112 qpair failed and we were unable to recover it. 00:32:20.112 [2024-11-26 19:18:36.827746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.112 [2024-11-26 19:18:36.827891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.112 [2024-11-26 19:18:36.827902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.112 qpair failed and we were unable to recover it. 00:32:20.112 [2024-11-26 19:18:36.828058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.112 [2024-11-26 19:18:36.828125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.112 [2024-11-26 19:18:36.828137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.112 qpair failed and we were unable to recover it. 00:32:20.112 [2024-11-26 19:18:36.828215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.112 [2024-11-26 19:18:36.828385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.112 [2024-11-26 19:18:36.828396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.112 qpair failed and we were unable to recover it. 00:32:20.112 [2024-11-26 19:18:36.828470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.112 [2024-11-26 19:18:36.828548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.112 [2024-11-26 19:18:36.828561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.112 qpair failed and we were unable to recover it. 00:32:20.112 [2024-11-26 19:18:36.828636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.112 [2024-11-26 19:18:36.828860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.112 [2024-11-26 19:18:36.828872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.112 qpair failed and we were unable to recover it. 00:32:20.112 [2024-11-26 19:18:36.829037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.112 [2024-11-26 19:18:36.829114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.112 [2024-11-26 19:18:36.829126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.112 qpair failed and we were unable to recover it. 00:32:20.112 [2024-11-26 19:18:36.829270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.112 [2024-11-26 19:18:36.829416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.112 [2024-11-26 19:18:36.829428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.112 qpair failed and we were unable to recover it. 00:32:20.112 [2024-11-26 19:18:36.829576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.112 [2024-11-26 19:18:36.829663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.112 [2024-11-26 19:18:36.829675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.112 qpair failed and we were unable to recover it. 00:32:20.112 [2024-11-26 19:18:36.829874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.112 [2024-11-26 19:18:36.830021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.112 [2024-11-26 19:18:36.830033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.112 qpair failed and we were unable to recover it. 00:32:20.112 [2024-11-26 19:18:36.830106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.112 [2024-11-26 19:18:36.830194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.112 [2024-11-26 19:18:36.830206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.112 qpair failed and we were unable to recover it. 00:32:20.112 [2024-11-26 19:18:36.830339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.112 [2024-11-26 19:18:36.830501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.112 [2024-11-26 19:18:36.830513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.112 qpair failed and we were unable to recover it. 00:32:20.112 [2024-11-26 19:18:36.830660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.112 [2024-11-26 19:18:36.830799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.112 [2024-11-26 19:18:36.830810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.112 qpair failed and we were unable to recover it. 00:32:20.112 [2024-11-26 19:18:36.830883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.112 [2024-11-26 19:18:36.831035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.112 [2024-11-26 19:18:36.831049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.112 qpair failed and we were unable to recover it. 00:32:20.112 [2024-11-26 19:18:36.831139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.112 [2024-11-26 19:18:36.831279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.112 [2024-11-26 19:18:36.831291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.112 qpair failed and we were unable to recover it. 00:32:20.112 [2024-11-26 19:18:36.831372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.112 [2024-11-26 19:18:36.831435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.112 [2024-11-26 19:18:36.831447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.112 qpair failed and we were unable to recover it. 00:32:20.112 [2024-11-26 19:18:36.831519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.112 [2024-11-26 19:18:36.831584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.112 [2024-11-26 19:18:36.831596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.112 qpair failed and we were unable to recover it. 00:32:20.112 [2024-11-26 19:18:36.831739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.112 [2024-11-26 19:18:36.831869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.112 [2024-11-26 19:18:36.831881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.112 qpair failed and we were unable to recover it. 00:32:20.112 [2024-11-26 19:18:36.831956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.112 [2024-11-26 19:18:36.832122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.112 [2024-11-26 19:18:36.832143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.113 qpair failed and we were unable to recover it. 00:32:20.113 [2024-11-26 19:18:36.832219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.113 [2024-11-26 19:18:36.832282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.113 [2024-11-26 19:18:36.832294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.113 qpair failed and we were unable to recover it. 00:32:20.113 [2024-11-26 19:18:36.832358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.113 [2024-11-26 19:18:36.832448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.113 [2024-11-26 19:18:36.832460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.113 qpair failed and we were unable to recover it. 00:32:20.113 [2024-11-26 19:18:36.832555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.113 [2024-11-26 19:18:36.832628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.113 [2024-11-26 19:18:36.832640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.113 qpair failed and we were unable to recover it. 00:32:20.113 [2024-11-26 19:18:36.832716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.113 [2024-11-26 19:18:36.832782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.113 [2024-11-26 19:18:36.832794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.113 qpair failed and we were unable to recover it. 00:32:20.113 [2024-11-26 19:18:36.832852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.113 [2024-11-26 19:18:36.832983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.113 [2024-11-26 19:18:36.832997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.113 qpair failed and we were unable to recover it. 00:32:20.113 [2024-11-26 19:18:36.833132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.113 [2024-11-26 19:18:36.833216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.113 [2024-11-26 19:18:36.833228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.113 qpair failed and we were unable to recover it. 00:32:20.113 [2024-11-26 19:18:36.833290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.113 [2024-11-26 19:18:36.833362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.113 [2024-11-26 19:18:36.833373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.113 qpair failed and we were unable to recover it. 00:32:20.113 [2024-11-26 19:18:36.833436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.113 [2024-11-26 19:18:36.833579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.113 [2024-11-26 19:18:36.833591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.113 qpair failed and we were unable to recover it. 00:32:20.113 [2024-11-26 19:18:36.833669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.113 [2024-11-26 19:18:36.833822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.113 [2024-11-26 19:18:36.833854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.113 qpair failed and we were unable to recover it. 00:32:20.113 [2024-11-26 19:18:36.833973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.113 [2024-11-26 19:18:36.834085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.113 [2024-11-26 19:18:36.834118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.113 qpair failed and we were unable to recover it. 00:32:20.113 [2024-11-26 19:18:36.834301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.113 [2024-11-26 19:18:36.834474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.113 [2024-11-26 19:18:36.834485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.113 qpair failed and we were unable to recover it. 00:32:20.113 [2024-11-26 19:18:36.834550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.113 [2024-11-26 19:18:36.834623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.113 [2024-11-26 19:18:36.834635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.113 qpair failed and we were unable to recover it. 00:32:20.113 [2024-11-26 19:18:36.834761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.113 [2024-11-26 19:18:36.834851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.113 [2024-11-26 19:18:36.834863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.113 qpair failed and we were unable to recover it. 00:32:20.113 [2024-11-26 19:18:36.834995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.113 [2024-11-26 19:18:36.835187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.113 [2024-11-26 19:18:36.835199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.113 qpair failed and we were unable to recover it. 00:32:20.113 [2024-11-26 19:18:36.835326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.113 [2024-11-26 19:18:36.835421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.113 [2024-11-26 19:18:36.835434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.113 qpair failed and we were unable to recover it. 00:32:20.113 [2024-11-26 19:18:36.835632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.113 [2024-11-26 19:18:36.835763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.113 [2024-11-26 19:18:36.835774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.113 qpair failed and we were unable to recover it. 00:32:20.113 [2024-11-26 19:18:36.835911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.113 [2024-11-26 19:18:36.835987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.113 [2024-11-26 19:18:36.835999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.113 qpair failed and we were unable to recover it. 00:32:20.113 [2024-11-26 19:18:36.836072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.113 [2024-11-26 19:18:36.836198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.113 [2024-11-26 19:18:36.836209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.113 qpair failed and we were unable to recover it. 00:32:20.113 [2024-11-26 19:18:36.836277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.113 [2024-11-26 19:18:36.836415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.113 [2024-11-26 19:18:36.836427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.113 qpair failed and we were unable to recover it. 00:32:20.113 [2024-11-26 19:18:36.836502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.113 [2024-11-26 19:18:36.836664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.113 [2024-11-26 19:18:36.836675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.113 qpair failed and we were unable to recover it. 00:32:20.113 [2024-11-26 19:18:36.836809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.113 [2024-11-26 19:18:36.836956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.113 [2024-11-26 19:18:36.836968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.113 qpair failed and we were unable to recover it. 00:32:20.113 [2024-11-26 19:18:36.837149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.113 [2024-11-26 19:18:36.837229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.114 [2024-11-26 19:18:36.837240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.114 qpair failed and we were unable to recover it. 00:32:20.114 [2024-11-26 19:18:36.837375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.114 [2024-11-26 19:18:36.837515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.114 [2024-11-26 19:18:36.837526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.114 qpair failed and we were unable to recover it. 00:32:20.114 [2024-11-26 19:18:36.837612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.114 [2024-11-26 19:18:36.837751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.114 [2024-11-26 19:18:36.837763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.114 qpair failed and we were unable to recover it. 00:32:20.114 [2024-11-26 19:18:36.837827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.114 [2024-11-26 19:18:36.837961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.114 [2024-11-26 19:18:36.837976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.114 qpair failed and we were unable to recover it. 00:32:20.114 [2024-11-26 19:18:36.838052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.114 [2024-11-26 19:18:36.838144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.114 [2024-11-26 19:18:36.838156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.114 qpair failed and we were unable to recover it. 00:32:20.114 [2024-11-26 19:18:36.838221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.114 [2024-11-26 19:18:36.838280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.114 [2024-11-26 19:18:36.838292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.114 qpair failed and we were unable to recover it. 00:32:20.114 [2024-11-26 19:18:36.838446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.114 [2024-11-26 19:18:36.838630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.114 [2024-11-26 19:18:36.838661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.114 qpair failed and we were unable to recover it. 00:32:20.114 [2024-11-26 19:18:36.838791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.114 [2024-11-26 19:18:36.838965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.114 [2024-11-26 19:18:36.838997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.114 qpair failed and we were unable to recover it. 00:32:20.114 [2024-11-26 19:18:36.839121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.114 [2024-11-26 19:18:36.839359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.114 [2024-11-26 19:18:36.839391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.114 qpair failed and we were unable to recover it. 00:32:20.114 [2024-11-26 19:18:36.839516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.114 [2024-11-26 19:18:36.839673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.114 [2024-11-26 19:18:36.839685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.114 qpair failed and we were unable to recover it. 00:32:20.114 [2024-11-26 19:18:36.839767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.114 [2024-11-26 19:18:36.839912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.114 [2024-11-26 19:18:36.839943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.114 qpair failed and we were unable to recover it. 00:32:20.114 [2024-11-26 19:18:36.840151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.114 [2024-11-26 19:18:36.840318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.114 [2024-11-26 19:18:36.840348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.114 qpair failed and we were unable to recover it. 00:32:20.114 [2024-11-26 19:18:36.840557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.114 [2024-11-26 19:18:36.840682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.114 [2024-11-26 19:18:36.840714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.114 qpair failed and we were unable to recover it. 00:32:20.114 [2024-11-26 19:18:36.840840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.114 [2024-11-26 19:18:36.840939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.114 [2024-11-26 19:18:36.840982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.114 qpair failed and we were unable to recover it. 00:32:20.114 [2024-11-26 19:18:36.841176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.114 [2024-11-26 19:18:36.841293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.114 [2024-11-26 19:18:36.841325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.114 qpair failed and we were unable to recover it. 00:32:20.114 [2024-11-26 19:18:36.841510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.114 [2024-11-26 19:18:36.841748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.114 [2024-11-26 19:18:36.841780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.114 qpair failed and we were unable to recover it. 00:32:20.114 [2024-11-26 19:18:36.841903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.114 [2024-11-26 19:18:36.842144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.114 [2024-11-26 19:18:36.842177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.114 qpair failed and we were unable to recover it. 00:32:20.114 [2024-11-26 19:18:36.842301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.114 [2024-11-26 19:18:36.842492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.114 [2024-11-26 19:18:36.842523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.114 qpair failed and we were unable to recover it. 00:32:20.114 [2024-11-26 19:18:36.842641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.114 [2024-11-26 19:18:36.842744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.115 [2024-11-26 19:18:36.842774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.115 qpair failed and we were unable to recover it. 00:32:20.115 [2024-11-26 19:18:36.842899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.115 [2024-11-26 19:18:36.843098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.115 [2024-11-26 19:18:36.843130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.115 qpair failed and we were unable to recover it. 00:32:20.115 [2024-11-26 19:18:36.843305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.115 [2024-11-26 19:18:36.843474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.115 [2024-11-26 19:18:36.843507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.115 qpair failed and we were unable to recover it. 00:32:20.115 [2024-11-26 19:18:36.843627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.115 [2024-11-26 19:18:36.843807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.115 [2024-11-26 19:18:36.843818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.115 qpair failed and we were unable to recover it. 00:32:20.115 [2024-11-26 19:18:36.843956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.115 [2024-11-26 19:18:36.844109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.115 [2024-11-26 19:18:36.844141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.115 qpair failed and we were unable to recover it. 00:32:20.115 [2024-11-26 19:18:36.844253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.115 [2024-11-26 19:18:36.844371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.115 [2024-11-26 19:18:36.844401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.115 qpair failed and we were unable to recover it. 00:32:20.115 [2024-11-26 19:18:36.844603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.115 [2024-11-26 19:18:36.844775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.115 [2024-11-26 19:18:36.844787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.115 qpair failed and we were unable to recover it. 00:32:20.115 [2024-11-26 19:18:36.844927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.115 [2024-11-26 19:18:36.845053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.115 [2024-11-26 19:18:36.845087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.115 qpair failed and we were unable to recover it. 00:32:20.115 [2024-11-26 19:18:36.845222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.115 [2024-11-26 19:18:36.845345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.115 [2024-11-26 19:18:36.845377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.115 qpair failed and we were unable to recover it. 00:32:20.115 [2024-11-26 19:18:36.845494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.115 [2024-11-26 19:18:36.845592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.115 [2024-11-26 19:18:36.845623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.115 qpair failed and we were unable to recover it. 00:32:20.115 [2024-11-26 19:18:36.845750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.115 [2024-11-26 19:18:36.846035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.115 [2024-11-26 19:18:36.846067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.115 qpair failed and we were unable to recover it. 00:32:20.115 [2024-11-26 19:18:36.846205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.115 [2024-11-26 19:18:36.846376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.115 [2024-11-26 19:18:36.846407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.115 qpair failed and we were unable to recover it. 00:32:20.115 [2024-11-26 19:18:36.846647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.115 [2024-11-26 19:18:36.846770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.115 [2024-11-26 19:18:36.846817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.115 qpair failed and we were unable to recover it. 00:32:20.115 [2024-11-26 19:18:36.846997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.115 [2024-11-26 19:18:36.847184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.115 [2024-11-26 19:18:36.847215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.115 qpair failed and we were unable to recover it. 00:32:20.115 [2024-11-26 19:18:36.847340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.115 [2024-11-26 19:18:36.847533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.115 [2024-11-26 19:18:36.847565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.115 qpair failed and we were unable to recover it. 00:32:20.115 [2024-11-26 19:18:36.847803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.115 [2024-11-26 19:18:36.847956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.115 [2024-11-26 19:18:36.847990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.115 qpair failed and we were unable to recover it. 00:32:20.115 [2024-11-26 19:18:36.848239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.115 [2024-11-26 19:18:36.848419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.115 [2024-11-26 19:18:36.848451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.115 qpair failed and we were unable to recover it. 00:32:20.115 [2024-11-26 19:18:36.848585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.115 [2024-11-26 19:18:36.848837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.115 [2024-11-26 19:18:36.848848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.115 qpair failed and we were unable to recover it. 00:32:20.115 [2024-11-26 19:18:36.848914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.115 [2024-11-26 19:18:36.849161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.115 [2024-11-26 19:18:36.849193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.115 qpair failed and we were unable to recover it. 00:32:20.116 [2024-11-26 19:18:36.849372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.116 [2024-11-26 19:18:36.849552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.116 [2024-11-26 19:18:36.849583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.116 qpair failed and we were unable to recover it. 00:32:20.116 [2024-11-26 19:18:36.849755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.116 [2024-11-26 19:18:36.849846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.116 [2024-11-26 19:18:36.849857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.116 qpair failed and we were unable to recover it. 00:32:20.116 [2024-11-26 19:18:36.850081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.116 [2024-11-26 19:18:36.850271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.116 [2024-11-26 19:18:36.850303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.116 qpair failed and we were unable to recover it. 00:32:20.116 [2024-11-26 19:18:36.850414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.116 [2024-11-26 19:18:36.850581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.116 [2024-11-26 19:18:36.850613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.116 qpair failed and we were unable to recover it. 00:32:20.116 [2024-11-26 19:18:36.850747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.116 [2024-11-26 19:18:36.850979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.116 [2024-11-26 19:18:36.851011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.116 qpair failed and we were unable to recover it. 00:32:20.116 [2024-11-26 19:18:36.851242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.116 [2024-11-26 19:18:36.851476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.116 [2024-11-26 19:18:36.851507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.116 qpair failed and we were unable to recover it. 00:32:20.116 [2024-11-26 19:18:36.851635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.116 [2024-11-26 19:18:36.851821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.116 [2024-11-26 19:18:36.851853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.116 qpair failed and we were unable to recover it. 00:32:20.116 [2024-11-26 19:18:36.852036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.116 [2024-11-26 19:18:36.852153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.116 [2024-11-26 19:18:36.852185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.116 qpair failed and we were unable to recover it. 00:32:20.116 [2024-11-26 19:18:36.852370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.116 [2024-11-26 19:18:36.852491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.116 [2024-11-26 19:18:36.852522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.116 qpair failed and we were unable to recover it. 00:32:20.116 [2024-11-26 19:18:36.852689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.116 [2024-11-26 19:18:36.852910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.116 [2024-11-26 19:18:36.852921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.116 qpair failed and we were unable to recover it. 00:32:20.116 [2024-11-26 19:18:36.853064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.116 [2024-11-26 19:18:36.853155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.116 [2024-11-26 19:18:36.853167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.116 qpair failed and we were unable to recover it. 00:32:20.116 [2024-11-26 19:18:36.853255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.116 [2024-11-26 19:18:36.853332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.116 [2024-11-26 19:18:36.853344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.116 qpair failed and we were unable to recover it. 00:32:20.116 [2024-11-26 19:18:36.853408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.116 [2024-11-26 19:18:36.853465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.116 [2024-11-26 19:18:36.853476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.116 qpair failed and we were unable to recover it. 00:32:20.116 [2024-11-26 19:18:36.853617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.116 [2024-11-26 19:18:36.853788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.116 [2024-11-26 19:18:36.853818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.116 qpair failed and we were unable to recover it. 00:32:20.116 [2024-11-26 19:18:36.853996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.116 [2024-11-26 19:18:36.854111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.116 [2024-11-26 19:18:36.854142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.116 qpair failed and we were unable to recover it. 00:32:20.116 [2024-11-26 19:18:36.854262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.116 [2024-11-26 19:18:36.854379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.116 [2024-11-26 19:18:36.854411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.116 qpair failed and we were unable to recover it. 00:32:20.116 [2024-11-26 19:18:36.854603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.116 [2024-11-26 19:18:36.854746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.116 [2024-11-26 19:18:36.854757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.116 qpair failed and we were unable to recover it. 00:32:20.116 [2024-11-26 19:18:36.854899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.116 [2024-11-26 19:18:36.855058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.116 [2024-11-26 19:18:36.855090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.116 qpair failed and we were unable to recover it. 00:32:20.116 [2024-11-26 19:18:36.855261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.116 [2024-11-26 19:18:36.855460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.116 [2024-11-26 19:18:36.855492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.116 qpair failed and we were unable to recover it. 00:32:20.116 [2024-11-26 19:18:36.855666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.117 [2024-11-26 19:18:36.855831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.117 [2024-11-26 19:18:36.855842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.117 qpair failed and we were unable to recover it. 00:32:20.117 [2024-11-26 19:18:36.856004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.117 [2024-11-26 19:18:36.856098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.117 [2024-11-26 19:18:36.856109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.117 qpair failed and we were unable to recover it. 00:32:20.117 [2024-11-26 19:18:36.856307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.117 [2024-11-26 19:18:36.856441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.117 [2024-11-26 19:18:36.856471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.117 qpair failed and we were unable to recover it. 00:32:20.117 [2024-11-26 19:18:36.856661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.117 [2024-11-26 19:18:36.856783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.117 [2024-11-26 19:18:36.856814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.117 qpair failed and we were unable to recover it. 00:32:20.117 [2024-11-26 19:18:36.857014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.117 [2024-11-26 19:18:36.857136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.117 [2024-11-26 19:18:36.857167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.117 qpair failed and we were unable to recover it. 00:32:20.117 [2024-11-26 19:18:36.857281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.117 [2024-11-26 19:18:36.857459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.117 [2024-11-26 19:18:36.857491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.117 qpair failed and we were unable to recover it. 00:32:20.117 [2024-11-26 19:18:36.857677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.117 [2024-11-26 19:18:36.857760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.117 [2024-11-26 19:18:36.857771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.117 qpair failed and we were unable to recover it. 00:32:20.117 [2024-11-26 19:18:36.857907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.117 [2024-11-26 19:18:36.858100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.117 [2024-11-26 19:18:36.858139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.117 qpair failed and we were unable to recover it. 00:32:20.117 [2024-11-26 19:18:36.858328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.117 [2024-11-26 19:18:36.858459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.117 [2024-11-26 19:18:36.858488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.117 qpair failed and we were unable to recover it. 00:32:20.117 [2024-11-26 19:18:36.858663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.117 [2024-11-26 19:18:36.858794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.117 [2024-11-26 19:18:36.858804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.117 qpair failed and we were unable to recover it. 00:32:20.117 [2024-11-26 19:18:36.858871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.117 [2024-11-26 19:18:36.859001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.117 [2024-11-26 19:18:36.859014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.117 qpair failed and we were unable to recover it. 00:32:20.117 [2024-11-26 19:18:36.859153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.117 [2024-11-26 19:18:36.859214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.117 [2024-11-26 19:18:36.859224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.117 qpair failed and we were unable to recover it. 00:32:20.117 [2024-11-26 19:18:36.859352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.117 [2024-11-26 19:18:36.859432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.117 [2024-11-26 19:18:36.859444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.117 qpair failed and we were unable to recover it. 00:32:20.117 [2024-11-26 19:18:36.859601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.117 [2024-11-26 19:18:36.859683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.117 [2024-11-26 19:18:36.859694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.117 qpair failed and we were unable to recover it. 00:32:20.117 [2024-11-26 19:18:36.859767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.117 [2024-11-26 19:18:36.859856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.117 [2024-11-26 19:18:36.859868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.117 qpair failed and we were unable to recover it. 00:32:20.117 [2024-11-26 19:18:36.859938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.117 [2024-11-26 19:18:36.860067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.117 [2024-11-26 19:18:36.860078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.117 qpair failed and we were unable to recover it. 00:32:20.117 [2024-11-26 19:18:36.860158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.117 [2024-11-26 19:18:36.860228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.117 [2024-11-26 19:18:36.860239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.117 qpair failed and we were unable to recover it. 00:32:20.117 [2024-11-26 19:18:36.860319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.117 [2024-11-26 19:18:36.860458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.117 [2024-11-26 19:18:36.860489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.117 qpair failed and we were unable to recover it. 00:32:20.117 [2024-11-26 19:18:36.860617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.117 [2024-11-26 19:18:36.860749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.117 [2024-11-26 19:18:36.860781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.117 qpair failed and we were unable to recover it. 00:32:20.117 [2024-11-26 19:18:36.860887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.117 [2024-11-26 19:18:36.861017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.117 [2024-11-26 19:18:36.861049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.117 qpair failed and we were unable to recover it. 00:32:20.118 [2024-11-26 19:18:36.861163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.118 [2024-11-26 19:18:36.861434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.118 [2024-11-26 19:18:36.861467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.118 qpair failed and we were unable to recover it. 00:32:20.118 [2024-11-26 19:18:36.861583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.118 [2024-11-26 19:18:36.861764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.118 [2024-11-26 19:18:36.861796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.118 qpair failed and we were unable to recover it. 00:32:20.118 [2024-11-26 19:18:36.861908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.118 [2024-11-26 19:18:36.862103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.118 [2024-11-26 19:18:36.862136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.118 qpair failed and we were unable to recover it. 00:32:20.118 [2024-11-26 19:18:36.862375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.118 [2024-11-26 19:18:36.862578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.118 [2024-11-26 19:18:36.862610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.118 qpair failed and we were unable to recover it. 00:32:20.118 [2024-11-26 19:18:36.862796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.118 [2024-11-26 19:18:36.862908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.118 [2024-11-26 19:18:36.862940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.118 qpair failed and we were unable to recover it. 00:32:20.118 [2024-11-26 19:18:36.863141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.118 [2024-11-26 19:18:36.863314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.118 [2024-11-26 19:18:36.863346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.118 qpair failed and we were unable to recover it. 00:32:20.118 [2024-11-26 19:18:36.863463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.118 [2024-11-26 19:18:36.863628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.118 [2024-11-26 19:18:36.863659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.118 qpair failed and we were unable to recover it. 00:32:20.118 [2024-11-26 19:18:36.863899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.118 [2024-11-26 19:18:36.864022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.118 [2024-11-26 19:18:36.864055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.118 qpair failed and we were unable to recover it. 00:32:20.118 [2024-11-26 19:18:36.864188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.118 [2024-11-26 19:18:36.864365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.118 [2024-11-26 19:18:36.864395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.118 qpair failed and we were unable to recover it. 00:32:20.118 [2024-11-26 19:18:36.864512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.118 [2024-11-26 19:18:36.864631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.118 [2024-11-26 19:18:36.864662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.118 qpair failed and we were unable to recover it. 00:32:20.118 [2024-11-26 19:18:36.864782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.118 [2024-11-26 19:18:36.864871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.118 [2024-11-26 19:18:36.864883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.118 qpair failed and we were unable to recover it. 00:32:20.118 [2024-11-26 19:18:36.864970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.118 [2024-11-26 19:18:36.865063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.118 [2024-11-26 19:18:36.865074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.118 qpair failed and we were unable to recover it. 00:32:20.118 [2024-11-26 19:18:36.865203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.118 [2024-11-26 19:18:36.865347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.118 [2024-11-26 19:18:36.865359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.118 qpair failed and we were unable to recover it. 00:32:20.118 [2024-11-26 19:18:36.865430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.118 [2024-11-26 19:18:36.865503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.118 [2024-11-26 19:18:36.865514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.118 qpair failed and we were unable to recover it. 00:32:20.118 [2024-11-26 19:18:36.865650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.118 [2024-11-26 19:18:36.865728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.118 [2024-11-26 19:18:36.865740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.118 qpair failed and we were unable to recover it. 00:32:20.118 [2024-11-26 19:18:36.865798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.118 [2024-11-26 19:18:36.865929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.118 [2024-11-26 19:18:36.865940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.118 qpair failed and we were unable to recover it. 00:32:20.118 [2024-11-26 19:18:36.866093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.118 [2024-11-26 19:18:36.866172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.118 [2024-11-26 19:18:36.866184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.118 qpair failed and we were unable to recover it. 00:32:20.118 [2024-11-26 19:18:36.866251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.118 [2024-11-26 19:18:36.866435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.118 [2024-11-26 19:18:36.866466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.118 qpair failed and we were unable to recover it. 00:32:20.118 [2024-11-26 19:18:36.866637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.118 [2024-11-26 19:18:36.866769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.118 [2024-11-26 19:18:36.866801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.118 qpair failed and we were unable to recover it. 00:32:20.118 [2024-11-26 19:18:36.867033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.118 [2024-11-26 19:18:36.867176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.118 [2024-11-26 19:18:36.867187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.118 qpair failed and we were unable to recover it. 00:32:20.118 [2024-11-26 19:18:36.867274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.118 [2024-11-26 19:18:36.867428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.118 [2024-11-26 19:18:36.867440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.118 qpair failed and we were unable to recover it. 00:32:20.118 [2024-11-26 19:18:36.867512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.118 [2024-11-26 19:18:36.867584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.118 [2024-11-26 19:18:36.867594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.118 qpair failed and we were unable to recover it. 00:32:20.118 [2024-11-26 19:18:36.867670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.118 [2024-11-26 19:18:36.867770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.118 [2024-11-26 19:18:36.867780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.118 qpair failed and we were unable to recover it. 00:32:20.119 [2024-11-26 19:18:36.867870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.119 [2024-11-26 19:18:36.867964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.119 [2024-11-26 19:18:36.867995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.119 qpair failed and we were unable to recover it. 00:32:20.119 [2024-11-26 19:18:36.868179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.119 [2024-11-26 19:18:36.868302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.119 [2024-11-26 19:18:36.868334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.119 qpair failed and we were unable to recover it. 00:32:20.119 [2024-11-26 19:18:36.868515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.119 [2024-11-26 19:18:36.868702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.119 [2024-11-26 19:18:36.868713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.119 qpair failed and we were unable to recover it. 00:32:20.119 [2024-11-26 19:18:36.868795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.119 [2024-11-26 19:18:36.868925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.119 [2024-11-26 19:18:36.868936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.119 qpair failed and we were unable to recover it. 00:32:20.119 [2024-11-26 19:18:36.869081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.119 [2024-11-26 19:18:36.869151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.119 [2024-11-26 19:18:36.869163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.119 qpair failed and we were unable to recover it. 00:32:20.119 [2024-11-26 19:18:36.869316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.119 [2024-11-26 19:18:36.869488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.119 [2024-11-26 19:18:36.869520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.119 qpair failed and we were unable to recover it. 00:32:20.119 [2024-11-26 19:18:36.869646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.119 [2024-11-26 19:18:36.869899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.119 [2024-11-26 19:18:36.869930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.119 qpair failed and we were unable to recover it. 00:32:20.119 [2024-11-26 19:18:36.870046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.119 [2024-11-26 19:18:36.870287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.119 [2024-11-26 19:18:36.870319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.119 qpair failed and we were unable to recover it. 00:32:20.119 [2024-11-26 19:18:36.870490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.119 [2024-11-26 19:18:36.870653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.119 [2024-11-26 19:18:36.870664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.119 qpair failed and we were unable to recover it. 00:32:20.119 [2024-11-26 19:18:36.870739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.119 [2024-11-26 19:18:36.870892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.119 [2024-11-26 19:18:36.870923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.119 qpair failed and we were unable to recover it. 00:32:20.119 [2024-11-26 19:18:36.871125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.119 [2024-11-26 19:18:36.871356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.119 [2024-11-26 19:18:36.871388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.119 qpair failed and we were unable to recover it. 00:32:20.119 [2024-11-26 19:18:36.871599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.119 [2024-11-26 19:18:36.871716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.119 [2024-11-26 19:18:36.871760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.119 qpair failed and we were unable to recover it. 00:32:20.119 [2024-11-26 19:18:36.871830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.119 [2024-11-26 19:18:36.871989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.119 [2024-11-26 19:18:36.872002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.119 qpair failed and we were unable to recover it. 00:32:20.119 [2024-11-26 19:18:36.872070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.119 [2024-11-26 19:18:36.872214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.119 [2024-11-26 19:18:36.872225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.119 qpair failed and we were unable to recover it. 00:32:20.119 [2024-11-26 19:18:36.872380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.119 [2024-11-26 19:18:36.872546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.119 [2024-11-26 19:18:36.872578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.119 qpair failed and we were unable to recover it. 00:32:20.119 [2024-11-26 19:18:36.872779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.119 [2024-11-26 19:18:36.872983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.119 [2024-11-26 19:18:36.873016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.119 qpair failed and we were unable to recover it. 00:32:20.119 [2024-11-26 19:18:36.873208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.119 [2024-11-26 19:18:36.873391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.119 [2024-11-26 19:18:36.873423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.119 qpair failed and we were unable to recover it. 00:32:20.119 [2024-11-26 19:18:36.873544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.119 [2024-11-26 19:18:36.873713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.119 [2024-11-26 19:18:36.873745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.119 qpair failed and we were unable to recover it. 00:32:20.119 [2024-11-26 19:18:36.873957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.119 [2024-11-26 19:18:36.874046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.119 [2024-11-26 19:18:36.874058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.119 qpair failed and we were unable to recover it. 00:32:20.119 [2024-11-26 19:18:36.874288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.119 [2024-11-26 19:18:36.874434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.119 [2024-11-26 19:18:36.874445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.119 qpair failed and we were unable to recover it. 00:32:20.119 [2024-11-26 19:18:36.874580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.119 [2024-11-26 19:18:36.874725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.119 [2024-11-26 19:18:36.874736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.119 qpair failed and we were unable to recover it. 00:32:20.119 [2024-11-26 19:18:36.874825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.119 [2024-11-26 19:18:36.874996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.120 [2024-11-26 19:18:36.875028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.120 qpair failed and we were unable to recover it. 00:32:20.120 [2024-11-26 19:18:36.875161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.120 [2024-11-26 19:18:36.875332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.120 [2024-11-26 19:18:36.875363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.120 qpair failed and we were unable to recover it. 00:32:20.120 [2024-11-26 19:18:36.875603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.120 [2024-11-26 19:18:36.875769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.120 [2024-11-26 19:18:36.875800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.120 qpair failed and we were unable to recover it. 00:32:20.120 [2024-11-26 19:18:36.875978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.120 [2024-11-26 19:18:36.876166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.120 [2024-11-26 19:18:36.876197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.120 qpair failed and we were unable to recover it. 00:32:20.120 [2024-11-26 19:18:36.876410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.120 [2024-11-26 19:18:36.876601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.120 [2024-11-26 19:18:36.876632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.120 qpair failed and we were unable to recover it. 00:32:20.120 [2024-11-26 19:18:36.876872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.120 [2024-11-26 19:18:36.876999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.120 [2024-11-26 19:18:36.877033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.120 qpair failed and we were unable to recover it. 00:32:20.120 [2024-11-26 19:18:36.877223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.120 [2024-11-26 19:18:36.877393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.120 [2024-11-26 19:18:36.877425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.120 qpair failed and we were unable to recover it. 00:32:20.120 [2024-11-26 19:18:36.877618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.120 [2024-11-26 19:18:36.877836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.120 [2024-11-26 19:18:36.877867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.120 qpair failed and we were unable to recover it. 00:32:20.120 [2024-11-26 19:18:36.878046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.120 [2024-11-26 19:18:36.878179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.120 [2024-11-26 19:18:36.878210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.120 qpair failed and we were unable to recover it. 00:32:20.120 [2024-11-26 19:18:36.878316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.120 [2024-11-26 19:18:36.878561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.120 [2024-11-26 19:18:36.878593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.120 qpair failed and we were unable to recover it. 00:32:20.120 [2024-11-26 19:18:36.878790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.120 [2024-11-26 19:18:36.878908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.120 [2024-11-26 19:18:36.878940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.120 qpair failed and we were unable to recover it. 00:32:20.120 [2024-11-26 19:18:36.879149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.120 [2024-11-26 19:18:36.879338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.120 [2024-11-26 19:18:36.879368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.120 qpair failed and we were unable to recover it. 00:32:20.120 [2024-11-26 19:18:36.879491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.120 [2024-11-26 19:18:36.879736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.120 [2024-11-26 19:18:36.879766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.120 qpair failed and we were unable to recover it. 00:32:20.120 [2024-11-26 19:18:36.879958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.120 [2024-11-26 19:18:36.880217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.120 [2024-11-26 19:18:36.880249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.120 qpair failed and we were unable to recover it. 00:32:20.120 [2024-11-26 19:18:36.880437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.120 [2024-11-26 19:18:36.880623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.120 [2024-11-26 19:18:36.880659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.120 qpair failed and we were unable to recover it. 00:32:20.120 [2024-11-26 19:18:36.880895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.120 [2024-11-26 19:18:36.880973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.120 [2024-11-26 19:18:36.880987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.120 qpair failed and we were unable to recover it. 00:32:20.120 [2024-11-26 19:18:36.881083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.120 [2024-11-26 19:18:36.881308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.120 [2024-11-26 19:18:36.881340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.120 qpair failed and we were unable to recover it. 00:32:20.120 [2024-11-26 19:18:36.881600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.120 [2024-11-26 19:18:36.881777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.120 [2024-11-26 19:18:36.881808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.120 qpair failed and we were unable to recover it. 00:32:20.120 [2024-11-26 19:18:36.881935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.120 [2024-11-26 19:18:36.882057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.120 [2024-11-26 19:18:36.882088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.120 qpair failed and we were unable to recover it. 00:32:20.120 [2024-11-26 19:18:36.882289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.120 [2024-11-26 19:18:36.882448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.120 [2024-11-26 19:18:36.882459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.120 qpair failed and we were unable to recover it. 00:32:20.120 [2024-11-26 19:18:36.882599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.120 [2024-11-26 19:18:36.882768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.120 [2024-11-26 19:18:36.882780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.120 qpair failed and we were unable to recover it. 00:32:20.120 [2024-11-26 19:18:36.882870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.120 [2024-11-26 19:18:36.883046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.120 [2024-11-26 19:18:36.883080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.120 qpair failed and we were unable to recover it. 00:32:20.120 [2024-11-26 19:18:36.883263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.120 [2024-11-26 19:18:36.883499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.120 [2024-11-26 19:18:36.883529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.120 qpair failed and we were unable to recover it. 00:32:20.120 [2024-11-26 19:18:36.883732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.121 [2024-11-26 19:18:36.883811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.121 [2024-11-26 19:18:36.883822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.121 qpair failed and we were unable to recover it. 00:32:20.121 [2024-11-26 19:18:36.883955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.121 [2024-11-26 19:18:36.884121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.121 [2024-11-26 19:18:36.884136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.121 qpair failed and we were unable to recover it. 00:32:20.121 [2024-11-26 19:18:36.884214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.121 [2024-11-26 19:18:36.884378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.121 [2024-11-26 19:18:36.884390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.121 qpair failed and we were unable to recover it. 00:32:20.121 [2024-11-26 19:18:36.884523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.121 [2024-11-26 19:18:36.884689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.121 [2024-11-26 19:18:36.884719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.121 qpair failed and we were unable to recover it. 00:32:20.121 [2024-11-26 19:18:36.884985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.121 [2024-11-26 19:18:36.885166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.121 [2024-11-26 19:18:36.885197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.121 qpair failed and we were unable to recover it. 00:32:20.121 [2024-11-26 19:18:36.885332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.121 [2024-11-26 19:18:36.885445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.121 [2024-11-26 19:18:36.885476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.121 qpair failed and we were unable to recover it. 00:32:20.121 [2024-11-26 19:18:36.885653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.121 [2024-11-26 19:18:36.885901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.121 [2024-11-26 19:18:36.885933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.121 qpair failed and we were unable to recover it. 00:32:20.121 [2024-11-26 19:18:36.886063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.121 [2024-11-26 19:18:36.886231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.121 [2024-11-26 19:18:36.886262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.121 qpair failed and we were unable to recover it. 00:32:20.121 [2024-11-26 19:18:36.886523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.121 [2024-11-26 19:18:36.886683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.121 [2024-11-26 19:18:36.886714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.121 qpair failed and we were unable to recover it. 00:32:20.121 [2024-11-26 19:18:36.886888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.121 [2024-11-26 19:18:36.887069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.121 [2024-11-26 19:18:36.887101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.121 qpair failed and we were unable to recover it. 00:32:20.121 [2024-11-26 19:18:36.887298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.121 [2024-11-26 19:18:36.887472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.121 [2024-11-26 19:18:36.887504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.121 qpair failed and we were unable to recover it. 00:32:20.121 [2024-11-26 19:18:36.887710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.121 [2024-11-26 19:18:36.887890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.121 [2024-11-26 19:18:36.887926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.121 qpair failed and we were unable to recover it. 00:32:20.121 [2024-11-26 19:18:36.888112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.121 [2024-11-26 19:18:36.888360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.121 [2024-11-26 19:18:36.888390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.121 qpair failed and we were unable to recover it. 00:32:20.121 [2024-11-26 19:18:36.888591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.121 [2024-11-26 19:18:36.888756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.121 [2024-11-26 19:18:36.888787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.121 qpair failed and we were unable to recover it. 00:32:20.121 [2024-11-26 19:18:36.888907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.121 [2024-11-26 19:18:36.889076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.121 [2024-11-26 19:18:36.889088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.121 qpair failed and we were unable to recover it. 00:32:20.121 [2024-11-26 19:18:36.889218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.121 [2024-11-26 19:18:36.889312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.121 [2024-11-26 19:18:36.889323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.121 qpair failed and we were unable to recover it. 00:32:20.121 [2024-11-26 19:18:36.889450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.121 [2024-11-26 19:18:36.889602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.121 [2024-11-26 19:18:36.889633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.121 qpair failed and we were unable to recover it. 00:32:20.121 [2024-11-26 19:18:36.889880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.121 [2024-11-26 19:18:36.890132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.121 [2024-11-26 19:18:36.890165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.121 qpair failed and we were unable to recover it. 00:32:20.121 [2024-11-26 19:18:36.890338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.121 [2024-11-26 19:18:36.890467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.121 [2024-11-26 19:18:36.890497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.121 qpair failed and we were unable to recover it. 00:32:20.121 [2024-11-26 19:18:36.890700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.121 [2024-11-26 19:18:36.890884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.121 [2024-11-26 19:18:36.890915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.122 qpair failed and we were unable to recover it. 00:32:20.122 [2024-11-26 19:18:36.891096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.122 [2024-11-26 19:18:36.891222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.122 [2024-11-26 19:18:36.891253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.122 qpair failed and we were unable to recover it. 00:32:20.122 [2024-11-26 19:18:36.891434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.122 [2024-11-26 19:18:36.891614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.122 [2024-11-26 19:18:36.891650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.122 qpair failed and we were unable to recover it. 00:32:20.122 [2024-11-26 19:18:36.891783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.122 [2024-11-26 19:18:36.891861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.122 [2024-11-26 19:18:36.891871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.122 qpair failed and we were unable to recover it. 00:32:20.122 [2024-11-26 19:18:36.892002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.122 [2024-11-26 19:18:36.892119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.122 [2024-11-26 19:18:36.892150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.122 qpair failed and we were unable to recover it. 00:32:20.122 [2024-11-26 19:18:36.892349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.122 [2024-11-26 19:18:36.892541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.122 [2024-11-26 19:18:36.892572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.122 qpair failed and we were unable to recover it. 00:32:20.122 [2024-11-26 19:18:36.892696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.122 [2024-11-26 19:18:36.892892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.122 [2024-11-26 19:18:36.892924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.122 qpair failed and we were unable to recover it. 00:32:20.122 [2024-11-26 19:18:36.893072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.122 [2024-11-26 19:18:36.893277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.122 [2024-11-26 19:18:36.893309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.122 qpair failed and we were unable to recover it. 00:32:20.122 [2024-11-26 19:18:36.893439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.122 [2024-11-26 19:18:36.893587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.122 [2024-11-26 19:18:36.893598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.122 qpair failed and we were unable to recover it. 00:32:20.122 [2024-11-26 19:18:36.893748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.122 [2024-11-26 19:18:36.893961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.122 [2024-11-26 19:18:36.893994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.122 qpair failed and we were unable to recover it. 00:32:20.122 [2024-11-26 19:18:36.894235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.122 [2024-11-26 19:18:36.894521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.122 [2024-11-26 19:18:36.894552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.122 qpair failed and we were unable to recover it. 00:32:20.122 [2024-11-26 19:18:36.894743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.122 [2024-11-26 19:18:36.894993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.122 [2024-11-26 19:18:36.895025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.122 qpair failed and we were unable to recover it. 00:32:20.122 [2024-11-26 19:18:36.895275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.122 [2024-11-26 19:18:36.895511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.122 [2024-11-26 19:18:36.895542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.122 qpair failed and we were unable to recover it. 00:32:20.122 [2024-11-26 19:18:36.895732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.122 [2024-11-26 19:18:36.895852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.122 [2024-11-26 19:18:36.895884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.122 qpair failed and we were unable to recover it. 00:32:20.122 [2024-11-26 19:18:36.896145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.122 [2024-11-26 19:18:36.896322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.122 [2024-11-26 19:18:36.896353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.122 qpair failed and we were unable to recover it. 00:32:20.122 [2024-11-26 19:18:36.896528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.122 [2024-11-26 19:18:36.896657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.122 [2024-11-26 19:18:36.896669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.122 qpair failed and we were unable to recover it. 00:32:20.122 [2024-11-26 19:18:36.896749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.122 [2024-11-26 19:18:36.896826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.122 [2024-11-26 19:18:36.896865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.122 qpair failed and we were unable to recover it. 00:32:20.122 [2024-11-26 19:18:36.897046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.122 [2024-11-26 19:18:36.897150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.122 [2024-11-26 19:18:36.897182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.122 qpair failed and we were unable to recover it. 00:32:20.122 [2024-11-26 19:18:36.897422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.122 [2024-11-26 19:18:36.897533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.122 [2024-11-26 19:18:36.897544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.122 qpair failed and we were unable to recover it. 00:32:20.122 [2024-11-26 19:18:36.897650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.122 [2024-11-26 19:18:36.897788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.122 [2024-11-26 19:18:36.897818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.122 qpair failed and we were unable to recover it. 00:32:20.122 [2024-11-26 19:18:36.898005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.122 [2024-11-26 19:18:36.898112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.122 [2024-11-26 19:18:36.898143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.122 qpair failed and we were unable to recover it. 00:32:20.122 [2024-11-26 19:18:36.898329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.122 [2024-11-26 19:18:36.898443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.122 [2024-11-26 19:18:36.898474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.122 qpair failed and we were unable to recover it. 00:32:20.122 [2024-11-26 19:18:36.898609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.122 [2024-11-26 19:18:36.898797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.122 [2024-11-26 19:18:36.898829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.122 qpair failed and we were unable to recover it. 00:32:20.122 [2024-11-26 19:18:36.899039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.122 [2024-11-26 19:18:36.899242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.122 [2024-11-26 19:18:36.899273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.122 qpair failed and we were unable to recover it. 00:32:20.122 [2024-11-26 19:18:36.899487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.122 [2024-11-26 19:18:36.899682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.122 [2024-11-26 19:18:36.899721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.123 qpair failed and we were unable to recover it. 00:32:20.123 [2024-11-26 19:18:36.899862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.123 [2024-11-26 19:18:36.900040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.123 [2024-11-26 19:18:36.900052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.123 qpair failed and we were unable to recover it. 00:32:20.123 [2024-11-26 19:18:36.900126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.123 [2024-11-26 19:18:36.900276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.123 [2024-11-26 19:18:36.900308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.123 qpair failed and we were unable to recover it. 00:32:20.123 [2024-11-26 19:18:36.900427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.123 [2024-11-26 19:18:36.900604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.123 [2024-11-26 19:18:36.900637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.123 qpair failed and we were unable to recover it. 00:32:20.123 [2024-11-26 19:18:36.900837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.123 [2024-11-26 19:18:36.900917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.123 [2024-11-26 19:18:36.900928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.123 qpair failed and we were unable to recover it. 00:32:20.123 [2024-11-26 19:18:36.901016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.123 [2024-11-26 19:18:36.901089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.123 [2024-11-26 19:18:36.901099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.123 qpair failed and we were unable to recover it. 00:32:20.123 [2024-11-26 19:18:36.901178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.123 [2024-11-26 19:18:36.901306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.123 [2024-11-26 19:18:36.901318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.123 qpair failed and we were unable to recover it. 00:32:20.123 [2024-11-26 19:18:36.901472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.123 [2024-11-26 19:18:36.901653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.123 [2024-11-26 19:18:36.901685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.123 qpair failed and we were unable to recover it. 00:32:20.123 [2024-11-26 19:18:36.901936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.123 [2024-11-26 19:18:36.902133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.123 [2024-11-26 19:18:36.902165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.123 qpair failed and we were unable to recover it. 00:32:20.123 [2024-11-26 19:18:36.902388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.123 [2024-11-26 19:18:36.902576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.123 [2024-11-26 19:18:36.902587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.123 qpair failed and we were unable to recover it. 00:32:20.123 [2024-11-26 19:18:36.902671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.123 [2024-11-26 19:18:36.902805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.123 [2024-11-26 19:18:36.902829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.123 qpair failed and we were unable to recover it. 00:32:20.123 [2024-11-26 19:18:36.902957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.123 [2024-11-26 19:18:36.903155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.123 [2024-11-26 19:18:36.903186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.123 qpair failed and we were unable to recover it. 00:32:20.123 [2024-11-26 19:18:36.903429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.123 [2024-11-26 19:18:36.903550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.123 [2024-11-26 19:18:36.903581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.123 qpair failed and we were unable to recover it. 00:32:20.123 [2024-11-26 19:18:36.903700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.123 [2024-11-26 19:18:36.903786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.123 [2024-11-26 19:18:36.903798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.123 qpair failed and we were unable to recover it. 00:32:20.123 [2024-11-26 19:18:36.903889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.123 [2024-11-26 19:18:36.904026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.123 [2024-11-26 19:18:36.904059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.123 qpair failed and we were unable to recover it. 00:32:20.123 [2024-11-26 19:18:36.904233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.123 [2024-11-26 19:18:36.904367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.123 [2024-11-26 19:18:36.904398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.123 qpair failed and we were unable to recover it. 00:32:20.123 [2024-11-26 19:18:36.904528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.123 [2024-11-26 19:18:36.904654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.123 [2024-11-26 19:18:36.904664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.123 qpair failed and we were unable to recover it. 00:32:20.123 [2024-11-26 19:18:36.904813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.123 [2024-11-26 19:18:36.904974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.123 [2024-11-26 19:18:36.905005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.123 qpair failed and we were unable to recover it. 00:32:20.123 [2024-11-26 19:18:36.905121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.123 [2024-11-26 19:18:36.905304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.123 [2024-11-26 19:18:36.905335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.123 qpair failed and we were unable to recover it. 00:32:20.123 [2024-11-26 19:18:36.905513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.123 [2024-11-26 19:18:36.905644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.123 [2024-11-26 19:18:36.905675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.123 qpair failed and we were unable to recover it. 00:32:20.123 [2024-11-26 19:18:36.905852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.123 [2024-11-26 19:18:36.906113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.123 [2024-11-26 19:18:36.906144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.123 qpair failed and we were unable to recover it. 00:32:20.123 [2024-11-26 19:18:36.906280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.123 [2024-11-26 19:18:36.906460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.123 [2024-11-26 19:18:36.906490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.123 qpair failed and we were unable to recover it. 00:32:20.123 [2024-11-26 19:18:36.906734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.123 [2024-11-26 19:18:36.906933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.123 [2024-11-26 19:18:36.906976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.123 qpair failed and we were unable to recover it. 00:32:20.123 [2024-11-26 19:18:36.907131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.123 [2024-11-26 19:18:36.907257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.123 [2024-11-26 19:18:36.907288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.123 qpair failed and we were unable to recover it. 00:32:20.124 [2024-11-26 19:18:36.907527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.124 [2024-11-26 19:18:36.907700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.124 [2024-11-26 19:18:36.907731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.124 qpair failed and we were unable to recover it. 00:32:20.124 [2024-11-26 19:18:36.907864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.124 [2024-11-26 19:18:36.908042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.124 [2024-11-26 19:18:36.908076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.124 qpair failed and we were unable to recover it. 00:32:20.124 [2024-11-26 19:18:36.908259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.124 [2024-11-26 19:18:36.908431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.124 [2024-11-26 19:18:36.908462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.124 qpair failed and we were unable to recover it. 00:32:20.124 [2024-11-26 19:18:36.908634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.124 [2024-11-26 19:18:36.908749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.124 [2024-11-26 19:18:36.908781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.124 qpair failed and we were unable to recover it. 00:32:20.124 [2024-11-26 19:18:36.908904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.124 [2024-11-26 19:18:36.909141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.124 [2024-11-26 19:18:36.909175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.124 qpair failed and we were unable to recover it. 00:32:20.124 [2024-11-26 19:18:36.909416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.124 [2024-11-26 19:18:36.909645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.124 [2024-11-26 19:18:36.909676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.124 qpair failed and we were unable to recover it. 00:32:20.124 [2024-11-26 19:18:36.909805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.124 [2024-11-26 19:18:36.909995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.124 [2024-11-26 19:18:36.910027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.124 qpair failed and we were unable to recover it. 00:32:20.124 [2024-11-26 19:18:36.910212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.124 [2024-11-26 19:18:36.913188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.124 [2024-11-26 19:18:36.913223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.124 qpair failed and we were unable to recover it. 00:32:20.124 [2024-11-26 19:18:36.913414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.124 [2024-11-26 19:18:36.913602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.124 [2024-11-26 19:18:36.913632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.124 qpair failed and we were unable to recover it. 00:32:20.124 [2024-11-26 19:18:36.913889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.124 [2024-11-26 19:18:36.914023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.124 [2024-11-26 19:18:36.914055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.124 qpair failed and we were unable to recover it. 00:32:20.124 [2024-11-26 19:18:36.914206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.124 [2024-11-26 19:18:36.914383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.124 [2024-11-26 19:18:36.914414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.124 qpair failed and we were unable to recover it. 00:32:20.124 [2024-11-26 19:18:36.914598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.124 [2024-11-26 19:18:36.914776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.124 [2024-11-26 19:18:36.914808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.124 qpair failed and we were unable to recover it. 00:32:20.124 [2024-11-26 19:18:36.914943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.124 [2024-11-26 19:18:36.915069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.124 [2024-11-26 19:18:36.915100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.124 qpair failed and we were unable to recover it. 00:32:20.124 [2024-11-26 19:18:36.915349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.124 [2024-11-26 19:18:36.915582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.124 [2024-11-26 19:18:36.915614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.124 qpair failed and we were unable to recover it. 00:32:20.124 [2024-11-26 19:18:36.915879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.124 [2024-11-26 19:18:36.916069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.124 [2024-11-26 19:18:36.916101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.124 qpair failed and we were unable to recover it. 00:32:20.124 [2024-11-26 19:18:36.916291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.124 [2024-11-26 19:18:36.916438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.124 [2024-11-26 19:18:36.916449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.124 qpair failed and we were unable to recover it. 00:32:20.124 [2024-11-26 19:18:36.916591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.124 [2024-11-26 19:18:36.916728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.124 [2024-11-26 19:18:36.916766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.124 qpair failed and we were unable to recover it. 00:32:20.124 [2024-11-26 19:18:36.916980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.124 [2024-11-26 19:18:36.917222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.124 [2024-11-26 19:18:36.917254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.124 qpair failed and we were unable to recover it. 00:32:20.124 [2024-11-26 19:18:36.917367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.124 [2024-11-26 19:18:36.917482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.124 [2024-11-26 19:18:36.917513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.124 qpair failed and we were unable to recover it. 00:32:20.124 [2024-11-26 19:18:36.917642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.124 [2024-11-26 19:18:36.917761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.124 [2024-11-26 19:18:36.917792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.124 qpair failed and we were unable to recover it. 00:32:20.124 [2024-11-26 19:18:36.918032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.124 [2024-11-26 19:18:36.918209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.124 [2024-11-26 19:18:36.918240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.124 qpair failed and we were unable to recover it. 00:32:20.124 [2024-11-26 19:18:36.918452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.124 [2024-11-26 19:18:36.918629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.124 [2024-11-26 19:18:36.918640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.124 qpair failed and we were unable to recover it. 00:32:20.124 [2024-11-26 19:18:36.918786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.124 [2024-11-26 19:18:36.918912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.124 [2024-11-26 19:18:36.918942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.124 qpair failed and we were unable to recover it. 00:32:20.124 [2024-11-26 19:18:36.919095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.124 [2024-11-26 19:18:36.919276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.124 [2024-11-26 19:18:36.919306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.124 qpair failed and we were unable to recover it. 00:32:20.124 [2024-11-26 19:18:36.919489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.124 [2024-11-26 19:18:36.919745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.124 [2024-11-26 19:18:36.919777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.124 qpair failed and we were unable to recover it. 00:32:20.124 [2024-11-26 19:18:36.919973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.124 [2024-11-26 19:18:36.920209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.124 [2024-11-26 19:18:36.920240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.124 qpair failed and we were unable to recover it. 00:32:20.124 [2024-11-26 19:18:36.920423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.124 [2024-11-26 19:18:36.920553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.124 [2024-11-26 19:18:36.920583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.124 qpair failed and we were unable to recover it. 00:32:20.124 [2024-11-26 19:18:36.920768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.124 [2024-11-26 19:18:36.920871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.125 [2024-11-26 19:18:36.920902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.125 qpair failed and we were unable to recover it. 00:32:20.125 [2024-11-26 19:18:36.921196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.125 [2024-11-26 19:18:36.921375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.125 [2024-11-26 19:18:36.921406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.125 qpair failed and we were unable to recover it. 00:32:20.125 [2024-11-26 19:18:36.921588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.125 [2024-11-26 19:18:36.921669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.125 [2024-11-26 19:18:36.921680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.125 qpair failed and we were unable to recover it. 00:32:20.125 [2024-11-26 19:18:36.921816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.125 [2024-11-26 19:18:36.921946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.125 [2024-11-26 19:18:36.921995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.125 qpair failed and we were unable to recover it. 00:32:20.125 [2024-11-26 19:18:36.922171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.125 [2024-11-26 19:18:36.922435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.125 [2024-11-26 19:18:36.922466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.125 qpair failed and we were unable to recover it. 00:32:20.125 [2024-11-26 19:18:36.922653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.125 [2024-11-26 19:18:36.922868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.125 [2024-11-26 19:18:36.922898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.125 qpair failed and we were unable to recover it. 00:32:20.125 [2024-11-26 19:18:36.923100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.125 [2024-11-26 19:18:36.923302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.125 [2024-11-26 19:18:36.923334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.125 qpair failed and we were unable to recover it. 00:32:20.125 [2024-11-26 19:18:36.923522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.125 [2024-11-26 19:18:36.923706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.125 [2024-11-26 19:18:36.923736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.125 qpair failed and we were unable to recover it. 00:32:20.125 [2024-11-26 19:18:36.923960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.125 [2024-11-26 19:18:36.924222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.125 [2024-11-26 19:18:36.924253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.125 qpair failed and we were unable to recover it. 00:32:20.125 [2024-11-26 19:18:36.924475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.125 [2024-11-26 19:18:36.924591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.125 [2024-11-26 19:18:36.924615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.125 qpair failed and we were unable to recover it. 00:32:20.125 [2024-11-26 19:18:36.924755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.125 [2024-11-26 19:18:36.924857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.125 [2024-11-26 19:18:36.924868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.125 qpair failed and we were unable to recover it. 00:32:20.125 [2024-11-26 19:18:36.924956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.125 [2024-11-26 19:18:36.925035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.125 [2024-11-26 19:18:36.925045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.125 qpair failed and we were unable to recover it. 00:32:20.125 [2024-11-26 19:18:36.925155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.125 [2024-11-26 19:18:36.925358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.125 [2024-11-26 19:18:36.925388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.125 qpair failed and we were unable to recover it. 00:32:20.125 [2024-11-26 19:18:36.925572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.125 [2024-11-26 19:18:36.925760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.125 [2024-11-26 19:18:36.925791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.125 qpair failed and we were unable to recover it. 00:32:20.125 [2024-11-26 19:18:36.926026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.125 [2024-11-26 19:18:36.926243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.125 [2024-11-26 19:18:36.926254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.125 qpair failed and we were unable to recover it. 00:32:20.125 [2024-11-26 19:18:36.926409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.125 [2024-11-26 19:18:36.926522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.125 [2024-11-26 19:18:36.926553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.125 qpair failed and we were unable to recover it. 00:32:20.125 [2024-11-26 19:18:36.926737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.125 [2024-11-26 19:18:36.926884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.125 [2024-11-26 19:18:36.926922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.125 qpair failed and we were unable to recover it. 00:32:20.125 [2024-11-26 19:18:36.927180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.125 [2024-11-26 19:18:36.927420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.125 [2024-11-26 19:18:36.927451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.125 qpair failed and we were unable to recover it. 00:32:20.125 [2024-11-26 19:18:36.927641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.125 [2024-11-26 19:18:36.927801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.125 [2024-11-26 19:18:36.927832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.125 qpair failed and we were unable to recover it. 00:32:20.125 [2024-11-26 19:18:36.928027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.125 [2024-11-26 19:18:36.928261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.125 [2024-11-26 19:18:36.928292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.125 qpair failed and we were unable to recover it. 00:32:20.125 [2024-11-26 19:18:36.928578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.125 [2024-11-26 19:18:36.928706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.125 [2024-11-26 19:18:36.928737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.125 qpair failed and we were unable to recover it. 00:32:20.125 [2024-11-26 19:18:36.929000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.125 [2024-11-26 19:18:36.929142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.125 [2024-11-26 19:18:36.929175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.125 qpair failed and we were unable to recover it. 00:32:20.125 [2024-11-26 19:18:36.929300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.125 [2024-11-26 19:18:36.929432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.125 [2024-11-26 19:18:36.929463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.125 qpair failed and we were unable to recover it. 00:32:20.125 [2024-11-26 19:18:36.929654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.125 [2024-11-26 19:18:36.929841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.125 [2024-11-26 19:18:36.929853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.125 qpair failed and we were unable to recover it. 00:32:20.125 [2024-11-26 19:18:36.930010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.125 [2024-11-26 19:18:36.930092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.125 [2024-11-26 19:18:36.930103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.125 qpair failed and we were unable to recover it. 00:32:20.126 [2024-11-26 19:18:36.930205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.126 [2024-11-26 19:18:36.930338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.126 [2024-11-26 19:18:36.930350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.126 qpair failed and we were unable to recover it. 00:32:20.126 [2024-11-26 19:18:36.930494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.126 [2024-11-26 19:18:36.930548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.126 [2024-11-26 19:18:36.930559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.126 qpair failed and we were unable to recover it. 00:32:20.126 [2024-11-26 19:18:36.930686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.126 [2024-11-26 19:18:36.930822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.126 [2024-11-26 19:18:36.930855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.126 qpair failed and we were unable to recover it. 00:32:20.126 [2024-11-26 19:18:36.930985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.126 [2024-11-26 19:18:36.931184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.126 [2024-11-26 19:18:36.931215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.126 qpair failed and we were unable to recover it. 00:32:20.126 [2024-11-26 19:18:36.931457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.126 [2024-11-26 19:18:36.931571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.126 [2024-11-26 19:18:36.931601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.126 qpair failed and we were unable to recover it. 00:32:20.126 [2024-11-26 19:18:36.931726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.126 [2024-11-26 19:18:36.931916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.126 [2024-11-26 19:18:36.931956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.126 qpair failed and we were unable to recover it. 00:32:20.126 [2024-11-26 19:18:36.932093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.126 [2024-11-26 19:18:36.932212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.126 [2024-11-26 19:18:36.932244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.126 qpair failed and we were unable to recover it. 00:32:20.126 [2024-11-26 19:18:36.932438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.126 [2024-11-26 19:18:36.932608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.126 [2024-11-26 19:18:36.932640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.126 qpair failed and we were unable to recover it. 00:32:20.126 [2024-11-26 19:18:36.932764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.126 [2024-11-26 19:18:36.932880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.126 [2024-11-26 19:18:36.932912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.126 qpair failed and we were unable to recover it. 00:32:20.126 [2024-11-26 19:18:36.933114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.126 [2024-11-26 19:18:36.933250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.126 [2024-11-26 19:18:36.933283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.126 qpair failed and we were unable to recover it. 00:32:20.126 [2024-11-26 19:18:36.933470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.126 [2024-11-26 19:18:36.933649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.126 [2024-11-26 19:18:36.933682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.126 qpair failed and we were unable to recover it. 00:32:20.126 [2024-11-26 19:18:36.933883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.126 [2024-11-26 19:18:36.934082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.126 [2024-11-26 19:18:36.934114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.126 qpair failed and we were unable to recover it. 00:32:20.126 [2024-11-26 19:18:36.934291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.126 [2024-11-26 19:18:36.934394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.126 [2024-11-26 19:18:36.934425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.126 qpair failed and we were unable to recover it. 00:32:20.126 [2024-11-26 19:18:36.934598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.126 [2024-11-26 19:18:36.934736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.126 [2024-11-26 19:18:36.934747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.126 qpair failed and we were unable to recover it. 00:32:20.126 [2024-11-26 19:18:36.934888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.126 [2024-11-26 19:18:36.935012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.126 [2024-11-26 19:18:36.935044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.126 qpair failed and we were unable to recover it. 00:32:20.126 [2024-11-26 19:18:36.935180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.126 [2024-11-26 19:18:36.935439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.126 [2024-11-26 19:18:36.935469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.126 qpair failed and we were unable to recover it. 00:32:20.126 [2024-11-26 19:18:36.935575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.126 [2024-11-26 19:18:36.935703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.126 [2024-11-26 19:18:36.935734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.126 qpair failed and we were unable to recover it. 00:32:20.126 [2024-11-26 19:18:36.935909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.126 [2024-11-26 19:18:36.936047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.126 [2024-11-26 19:18:36.936059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.126 qpair failed and we were unable to recover it. 00:32:20.126 [2024-11-26 19:18:36.936275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.126 [2024-11-26 19:18:36.936430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.126 [2024-11-26 19:18:36.936461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.126 qpair failed and we were unable to recover it. 00:32:20.126 [2024-11-26 19:18:36.936599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.126 [2024-11-26 19:18:36.936803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.126 [2024-11-26 19:18:36.936835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.126 qpair failed and we were unable to recover it. 00:32:20.126 [2024-11-26 19:18:36.936955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.126 [2024-11-26 19:18:36.937025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.126 [2024-11-26 19:18:36.937036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.126 qpair failed and we were unable to recover it. 00:32:20.126 [2024-11-26 19:18:36.937223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.126 [2024-11-26 19:18:36.937321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.126 [2024-11-26 19:18:36.937332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.126 qpair failed and we were unable to recover it. 00:32:20.126 [2024-11-26 19:18:36.937500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.126 [2024-11-26 19:18:36.937735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.126 [2024-11-26 19:18:36.937767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.126 qpair failed and we were unable to recover it. 00:32:20.126 [2024-11-26 19:18:36.937938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.126 [2024-11-26 19:18:36.938152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.126 [2024-11-26 19:18:36.938183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.127 qpair failed and we were unable to recover it. 00:32:20.127 [2024-11-26 19:18:36.938309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.127 [2024-11-26 19:18:36.938437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.127 [2024-11-26 19:18:36.938467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.127 qpair failed and we were unable to recover it. 00:32:20.127 [2024-11-26 19:18:36.938603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.127 [2024-11-26 19:18:36.938708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.127 [2024-11-26 19:18:36.938739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.127 qpair failed and we were unable to recover it. 00:32:20.127 [2024-11-26 19:18:36.938937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.127 [2024-11-26 19:18:36.939017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.127 [2024-11-26 19:18:36.939029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.127 qpair failed and we were unable to recover it. 00:32:20.127 [2024-11-26 19:18:36.939105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.127 [2024-11-26 19:18:36.939244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.127 [2024-11-26 19:18:36.939256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.127 qpair failed and we were unable to recover it. 00:32:20.127 [2024-11-26 19:18:36.939335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.127 [2024-11-26 19:18:36.939529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.127 [2024-11-26 19:18:36.939540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.127 qpair failed and we were unable to recover it. 00:32:20.127 [2024-11-26 19:18:36.939684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.127 [2024-11-26 19:18:36.939834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.127 [2024-11-26 19:18:36.939847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.127 qpair failed and we were unable to recover it. 00:32:20.127 [2024-11-26 19:18:36.939935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.127 [2024-11-26 19:18:36.940092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.127 [2024-11-26 19:18:36.940104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.127 qpair failed and we were unable to recover it. 00:32:20.127 [2024-11-26 19:18:36.940229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.127 [2024-11-26 19:18:36.940306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.127 [2024-11-26 19:18:36.940317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.127 qpair failed and we were unable to recover it. 00:32:20.127 [2024-11-26 19:18:36.940464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.127 [2024-11-26 19:18:36.940672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.127 [2024-11-26 19:18:36.940702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.127 qpair failed and we were unable to recover it. 00:32:20.127 [2024-11-26 19:18:36.940891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.127 [2024-11-26 19:18:36.940997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.127 [2024-11-26 19:18:36.941035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.127 qpair failed and we were unable to recover it. 00:32:20.127 [2024-11-26 19:18:36.941173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.127 [2024-11-26 19:18:36.941356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.127 [2024-11-26 19:18:36.941389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.127 qpair failed and we were unable to recover it. 00:32:20.127 [2024-11-26 19:18:36.941572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.127 [2024-11-26 19:18:36.941755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.127 [2024-11-26 19:18:36.941784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.127 qpair failed and we were unable to recover it. 00:32:20.127 [2024-11-26 19:18:36.942043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.127 [2024-11-26 19:18:36.942125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.127 [2024-11-26 19:18:36.942136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.127 qpair failed and we were unable to recover it. 00:32:20.127 [2024-11-26 19:18:36.942202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.127 [2024-11-26 19:18:36.942288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.127 [2024-11-26 19:18:36.942300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.127 qpair failed and we were unable to recover it. 00:32:20.127 [2024-11-26 19:18:36.942369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.127 [2024-11-26 19:18:36.942507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.127 [2024-11-26 19:18:36.942538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.127 qpair failed and we were unable to recover it. 00:32:20.127 [2024-11-26 19:18:36.942715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.127 [2024-11-26 19:18:36.942831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.127 [2024-11-26 19:18:36.942864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.127 qpair failed and we were unable to recover it. 00:32:20.127 [2024-11-26 19:18:36.943078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.127 [2024-11-26 19:18:36.943178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.127 [2024-11-26 19:18:36.943209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.127 qpair failed and we were unable to recover it. 00:32:20.127 [2024-11-26 19:18:36.943337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.127 [2024-11-26 19:18:36.943439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.127 [2024-11-26 19:18:36.943470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.127 qpair failed and we were unable to recover it. 00:32:20.127 [2024-11-26 19:18:36.943589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.127 [2024-11-26 19:18:36.943758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.127 [2024-11-26 19:18:36.943770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.127 qpair failed and we were unable to recover it. 00:32:20.127 [2024-11-26 19:18:36.944013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.127 [2024-11-26 19:18:36.944170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.128 [2024-11-26 19:18:36.944208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.128 qpair failed and we were unable to recover it. 00:32:20.128 [2024-11-26 19:18:36.944391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.128 [2024-11-26 19:18:36.944510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.128 [2024-11-26 19:18:36.944543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.128 qpair failed and we were unable to recover it. 00:32:20.128 [2024-11-26 19:18:36.944650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.128 [2024-11-26 19:18:36.944842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.128 [2024-11-26 19:18:36.944874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.128 qpair failed and we were unable to recover it. 00:32:20.128 [2024-11-26 19:18:36.945074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.128 [2024-11-26 19:18:36.945218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.128 [2024-11-26 19:18:36.945229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.128 qpair failed and we were unable to recover it. 00:32:20.128 [2024-11-26 19:18:36.945471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.128 [2024-11-26 19:18:36.945653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.128 [2024-11-26 19:18:36.945686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.128 qpair failed and we were unable to recover it. 00:32:20.128 [2024-11-26 19:18:36.945880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.128 [2024-11-26 19:18:36.946058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.128 [2024-11-26 19:18:36.946101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.128 qpair failed and we were unable to recover it. 00:32:20.128 [2024-11-26 19:18:36.946265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.128 [2024-11-26 19:18:36.946338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.128 [2024-11-26 19:18:36.946348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.128 qpair failed and we were unable to recover it. 00:32:20.128 [2024-11-26 19:18:36.946424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.128 [2024-11-26 19:18:36.946514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.128 [2024-11-26 19:18:36.946524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.128 qpair failed and we were unable to recover it. 00:32:20.128 [2024-11-26 19:18:36.946607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.128 [2024-11-26 19:18:36.946762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.128 [2024-11-26 19:18:36.946775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.128 qpair failed and we were unable to recover it. 00:32:20.128 [2024-11-26 19:18:36.946841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.128 [2024-11-26 19:18:36.947001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.128 [2024-11-26 19:18:36.947013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.128 qpair failed and we were unable to recover it. 00:32:20.128 [2024-11-26 19:18:36.947079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.128 [2024-11-26 19:18:36.947168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.128 [2024-11-26 19:18:36.947182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.128 qpair failed and we were unable to recover it. 00:32:20.128 [2024-11-26 19:18:36.947332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.128 [2024-11-26 19:18:36.947491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.128 [2024-11-26 19:18:36.947503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.128 qpair failed and we were unable to recover it. 00:32:20.128 [2024-11-26 19:18:36.947589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.128 [2024-11-26 19:18:36.947666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.128 [2024-11-26 19:18:36.947677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.128 qpair failed and we were unable to recover it. 00:32:20.128 [2024-11-26 19:18:36.947746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.128 [2024-11-26 19:18:36.947879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.128 [2024-11-26 19:18:36.947890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.128 qpair failed and we were unable to recover it. 00:32:20.128 [2024-11-26 19:18:36.948084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.128 [2024-11-26 19:18:36.948176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.128 [2024-11-26 19:18:36.948188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.128 qpair failed and we were unable to recover it. 00:32:20.128 [2024-11-26 19:18:36.948279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.128 [2024-11-26 19:18:36.948357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.128 [2024-11-26 19:18:36.948369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.128 qpair failed and we were unable to recover it. 00:32:20.128 [2024-11-26 19:18:36.948445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.128 [2024-11-26 19:18:36.948574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.128 [2024-11-26 19:18:36.948586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.128 qpair failed and we were unable to recover it. 00:32:20.128 [2024-11-26 19:18:36.948660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.128 [2024-11-26 19:18:36.948731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.128 [2024-11-26 19:18:36.948741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.128 qpair failed and we were unable to recover it. 00:32:20.128 [2024-11-26 19:18:36.948806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.128 [2024-11-26 19:18:36.948934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.128 [2024-11-26 19:18:36.948945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.128 qpair failed and we were unable to recover it. 00:32:20.128 [2024-11-26 19:18:36.949091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.128 [2024-11-26 19:18:36.949171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.128 [2024-11-26 19:18:36.949183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.128 qpair failed and we were unable to recover it. 00:32:20.128 [2024-11-26 19:18:36.949272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.128 [2024-11-26 19:18:36.949503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.128 [2024-11-26 19:18:36.949541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.128 qpair failed and we were unable to recover it. 00:32:20.128 [2024-11-26 19:18:36.949742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.128 [2024-11-26 19:18:36.949820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.128 [2024-11-26 19:18:36.949843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.128 qpair failed and we were unable to recover it. 00:32:20.128 [2024-11-26 19:18:36.949989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.128 [2024-11-26 19:18:36.950150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.128 [2024-11-26 19:18:36.950180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.128 qpair failed and we were unable to recover it. 00:32:20.128 [2024-11-26 19:18:36.950301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.128 [2024-11-26 19:18:36.950419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.128 [2024-11-26 19:18:36.950450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.128 qpair failed and we were unable to recover it. 00:32:20.128 [2024-11-26 19:18:36.950640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.128 [2024-11-26 19:18:36.950767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.128 [2024-11-26 19:18:36.950778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.128 qpair failed and we were unable to recover it. 00:32:20.128 [2024-11-26 19:18:36.950857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.128 [2024-11-26 19:18:36.950941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.129 [2024-11-26 19:18:36.950982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.129 qpair failed and we were unable to recover it. 00:32:20.129 [2024-11-26 19:18:36.951113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.129 [2024-11-26 19:18:36.951298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.129 [2024-11-26 19:18:36.951330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.129 qpair failed and we were unable to recover it. 00:32:20.129 [2024-11-26 19:18:36.951572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.129 [2024-11-26 19:18:36.951761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.129 [2024-11-26 19:18:36.951792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.129 qpair failed and we were unable to recover it. 00:32:20.129 [2024-11-26 19:18:36.951918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.129 [2024-11-26 19:18:36.952009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.129 [2024-11-26 19:18:36.952022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.129 qpair failed and we were unable to recover it. 00:32:20.129 [2024-11-26 19:18:36.952246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.129 [2024-11-26 19:18:36.952485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.129 [2024-11-26 19:18:36.952516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.129 qpair failed and we were unable to recover it. 00:32:20.129 [2024-11-26 19:18:36.952645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.129 [2024-11-26 19:18:36.952776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.129 [2024-11-26 19:18:36.952788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.129 qpair failed and we were unable to recover it. 00:32:20.129 [2024-11-26 19:18:36.953021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.129 [2024-11-26 19:18:36.953101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.129 [2024-11-26 19:18:36.953112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.129 qpair failed and we were unable to recover it. 00:32:20.129 [2024-11-26 19:18:36.953193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.129 [2024-11-26 19:18:36.953345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.129 [2024-11-26 19:18:36.953376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.129 qpair failed and we were unable to recover it. 00:32:20.129 [2024-11-26 19:18:36.953553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.129 [2024-11-26 19:18:36.953676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.129 [2024-11-26 19:18:36.953706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.129 qpair failed and we were unable to recover it. 00:32:20.129 [2024-11-26 19:18:36.953826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.129 [2024-11-26 19:18:36.953908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.129 [2024-11-26 19:18:36.953919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.129 qpair failed and we were unable to recover it. 00:32:20.129 [2024-11-26 19:18:36.954006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.129 [2024-11-26 19:18:36.954074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.129 [2024-11-26 19:18:36.954085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.129 qpair failed and we were unable to recover it. 00:32:20.129 [2024-11-26 19:18:36.954160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.129 [2024-11-26 19:18:36.954227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.129 [2024-11-26 19:18:36.954238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.129 qpair failed and we were unable to recover it. 00:32:20.129 [2024-11-26 19:18:36.954382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.129 [2024-11-26 19:18:36.954553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.129 [2024-11-26 19:18:36.954585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.129 qpair failed and we were unable to recover it. 00:32:20.129 [2024-11-26 19:18:36.954691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.129 [2024-11-26 19:18:36.954873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.129 [2024-11-26 19:18:36.954903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.129 qpair failed and we were unable to recover it. 00:32:20.129 [2024-11-26 19:18:36.955020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.129 [2024-11-26 19:18:36.955152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.129 [2024-11-26 19:18:36.955164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.129 qpair failed and we were unable to recover it. 00:32:20.129 [2024-11-26 19:18:36.955382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.129 [2024-11-26 19:18:36.955448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.129 [2024-11-26 19:18:36.955459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.129 qpair failed and we were unable to recover it. 00:32:20.129 [2024-11-26 19:18:36.955626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.129 [2024-11-26 19:18:36.955702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.129 [2024-11-26 19:18:36.955713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.129 qpair failed and we were unable to recover it. 00:32:20.129 [2024-11-26 19:18:36.955842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.129 [2024-11-26 19:18:36.955976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.129 [2024-11-26 19:18:36.955989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.129 qpair failed and we were unable to recover it. 00:32:20.129 [2024-11-26 19:18:36.956135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.129 [2024-11-26 19:18:36.956224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.129 [2024-11-26 19:18:36.956236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.129 qpair failed and we were unable to recover it. 00:32:20.129 [2024-11-26 19:18:36.956318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.129 [2024-11-26 19:18:36.956393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.129 [2024-11-26 19:18:36.956405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.129 qpair failed and we were unable to recover it. 00:32:20.129 [2024-11-26 19:18:36.956612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.129 [2024-11-26 19:18:36.956728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.129 [2024-11-26 19:18:36.956760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.129 qpair failed and we were unable to recover it. 00:32:20.129 [2024-11-26 19:18:36.956931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.129 [2024-11-26 19:18:36.957008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.129 [2024-11-26 19:18:36.957021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.129 qpair failed and we were unable to recover it. 00:32:20.129 [2024-11-26 19:18:36.957089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.129 [2024-11-26 19:18:36.957170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.129 [2024-11-26 19:18:36.957181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.129 qpair failed and we were unable to recover it. 00:32:20.129 [2024-11-26 19:18:36.957267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.129 [2024-11-26 19:18:36.957335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.129 [2024-11-26 19:18:36.957346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.129 qpair failed and we were unable to recover it. 00:32:20.129 [2024-11-26 19:18:36.957422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.129 [2024-11-26 19:18:36.957554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.129 [2024-11-26 19:18:36.957566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.129 qpair failed and we were unable to recover it. 00:32:20.129 [2024-11-26 19:18:36.957631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.129 [2024-11-26 19:18:36.957711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.129 [2024-11-26 19:18:36.957721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.129 qpair failed and we were unable to recover it. 00:32:20.130 [2024-11-26 19:18:36.957813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.130 [2024-11-26 19:18:36.957919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.130 [2024-11-26 19:18:36.957959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.130 qpair failed and we were unable to recover it. 00:32:20.130 [2024-11-26 19:18:36.958133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.130 [2024-11-26 19:18:36.958316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.130 [2024-11-26 19:18:36.958348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.130 qpair failed and we were unable to recover it. 00:32:20.130 [2024-11-26 19:18:36.958475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.130 [2024-11-26 19:18:36.958606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.130 [2024-11-26 19:18:36.958637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.130 qpair failed and we were unable to recover it. 00:32:20.130 [2024-11-26 19:18:36.958756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.130 [2024-11-26 19:18:36.958931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.130 [2024-11-26 19:18:36.958942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.130 qpair failed and we were unable to recover it. 00:32:20.130 [2024-11-26 19:18:36.959021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.130 [2024-11-26 19:18:36.959155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.130 [2024-11-26 19:18:36.959166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.130 qpair failed and we were unable to recover it. 00:32:20.130 [2024-11-26 19:18:36.959301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.130 [2024-11-26 19:18:36.959371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.130 [2024-11-26 19:18:36.959382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.130 qpair failed and we were unable to recover it. 00:32:20.130 [2024-11-26 19:18:36.959590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.130 [2024-11-26 19:18:36.959730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.130 [2024-11-26 19:18:36.959742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.130 qpair failed and we were unable to recover it. 00:32:20.130 [2024-11-26 19:18:36.959886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.130 [2024-11-26 19:18:36.959993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.130 [2024-11-26 19:18:36.960028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.130 qpair failed and we were unable to recover it. 00:32:20.130 [2024-11-26 19:18:36.960141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.130 [2024-11-26 19:18:36.960249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.130 [2024-11-26 19:18:36.960281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.130 qpair failed and we were unable to recover it. 00:32:20.130 [2024-11-26 19:18:36.960397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.130 [2024-11-26 19:18:36.960584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.130 [2024-11-26 19:18:36.960616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.130 qpair failed and we were unable to recover it. 00:32:20.130 [2024-11-26 19:18:36.960751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.130 [2024-11-26 19:18:36.960894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.130 [2024-11-26 19:18:36.960906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.130 qpair failed and we were unable to recover it. 00:32:20.130 [2024-11-26 19:18:36.960980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.130 [2024-11-26 19:18:36.961046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.130 [2024-11-26 19:18:36.961056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.130 qpair failed and we were unable to recover it. 00:32:20.130 [2024-11-26 19:18:36.961124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.130 [2024-11-26 19:18:36.961273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.130 [2024-11-26 19:18:36.961303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.130 qpair failed and we were unable to recover it. 00:32:20.130 [2024-11-26 19:18:36.961433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.130 [2024-11-26 19:18:36.961606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.130 [2024-11-26 19:18:36.961636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.130 qpair failed and we were unable to recover it. 00:32:20.130 [2024-11-26 19:18:36.961808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.130 [2024-11-26 19:18:36.961998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.130 [2024-11-26 19:18:36.962031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.130 qpair failed and we were unable to recover it. 00:32:20.130 [2024-11-26 19:18:36.962210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.130 [2024-11-26 19:18:36.962378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.130 [2024-11-26 19:18:36.962409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.130 qpair failed and we were unable to recover it. 00:32:20.130 [2024-11-26 19:18:36.962585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.130 [2024-11-26 19:18:36.962737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.130 [2024-11-26 19:18:36.962748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.130 qpair failed and we were unable to recover it. 00:32:20.130 [2024-11-26 19:18:36.962890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.130 [2024-11-26 19:18:36.962990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.130 [2024-11-26 19:18:36.963023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.130 qpair failed and we were unable to recover it. 00:32:20.130 [2024-11-26 19:18:36.963148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.130 [2024-11-26 19:18:36.963371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.130 [2024-11-26 19:18:36.963404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.130 qpair failed and we were unable to recover it. 00:32:20.130 [2024-11-26 19:18:36.963633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.130 [2024-11-26 19:18:36.963818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.130 [2024-11-26 19:18:36.963830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.130 qpair failed and we were unable to recover it. 00:32:20.130 [2024-11-26 19:18:36.963993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.130 [2024-11-26 19:18:36.964153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.130 [2024-11-26 19:18:36.964193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.130 qpair failed and we were unable to recover it. 00:32:20.130 [2024-11-26 19:18:36.964313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.130 [2024-11-26 19:18:36.964503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.130 [2024-11-26 19:18:36.964533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.130 qpair failed and we were unable to recover it. 00:32:20.130 [2024-11-26 19:18:36.964641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.130 [2024-11-26 19:18:36.964846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.130 [2024-11-26 19:18:36.964858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.130 qpair failed and we were unable to recover it. 00:32:20.130 [2024-11-26 19:18:36.965067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.130 [2024-11-26 19:18:36.965252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.130 [2024-11-26 19:18:36.965282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.130 qpair failed and we were unable to recover it. 00:32:20.130 [2024-11-26 19:18:36.965473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.130 [2024-11-26 19:18:36.965596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.130 [2024-11-26 19:18:36.965627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.130 qpair failed and we were unable to recover it. 00:32:20.130 [2024-11-26 19:18:36.965802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.130 [2024-11-26 19:18:36.966064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.130 [2024-11-26 19:18:36.966096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.130 qpair failed and we were unable to recover it. 00:32:20.130 [2024-11-26 19:18:36.966241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.130 [2024-11-26 19:18:36.966421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.131 [2024-11-26 19:18:36.966452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.131 qpair failed and we were unable to recover it. 00:32:20.131 [2024-11-26 19:18:36.966588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.131 [2024-11-26 19:18:36.966689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.131 [2024-11-26 19:18:36.966721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.131 qpair failed and we were unable to recover it. 00:32:20.131 [2024-11-26 19:18:36.966907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.131 [2024-11-26 19:18:36.967118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.131 [2024-11-26 19:18:36.967151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.131 qpair failed and we were unable to recover it. 00:32:20.131 [2024-11-26 19:18:36.967276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.131 [2024-11-26 19:18:36.967450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.131 [2024-11-26 19:18:36.967482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.131 qpair failed and we were unable to recover it. 00:32:20.131 [2024-11-26 19:18:36.967683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.131 [2024-11-26 19:18:36.967786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.131 [2024-11-26 19:18:36.967818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.131 qpair failed and we were unable to recover it. 00:32:20.131 [2024-11-26 19:18:36.968002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.131 [2024-11-26 19:18:36.968133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.131 [2024-11-26 19:18:36.968164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.131 qpair failed and we were unable to recover it. 00:32:20.131 [2024-11-26 19:18:36.968278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.131 [2024-11-26 19:18:36.968511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.131 [2024-11-26 19:18:36.968543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.131 qpair failed and we were unable to recover it. 00:32:20.131 [2024-11-26 19:18:36.968750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.131 [2024-11-26 19:18:36.968872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.131 [2024-11-26 19:18:36.968884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.131 qpair failed and we were unable to recover it. 00:32:20.131 [2024-11-26 19:18:36.968954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.131 [2024-11-26 19:18:36.969018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.131 [2024-11-26 19:18:36.969029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.131 qpair failed and we were unable to recover it. 00:32:20.131 [2024-11-26 19:18:36.969192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.131 [2024-11-26 19:18:36.969379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.131 [2024-11-26 19:18:36.969411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.131 qpair failed and we were unable to recover it. 00:32:20.131 [2024-11-26 19:18:36.969605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.131 [2024-11-26 19:18:36.969709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.131 [2024-11-26 19:18:36.969741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.131 qpair failed and we were unable to recover it. 00:32:20.131 [2024-11-26 19:18:36.969872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.131 [2024-11-26 19:18:36.969960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.131 [2024-11-26 19:18:36.969974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.131 qpair failed and we were unable to recover it. 00:32:20.131 [2024-11-26 19:18:36.970054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.131 [2024-11-26 19:18:36.970178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.131 [2024-11-26 19:18:36.970190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.131 qpair failed and we were unable to recover it. 00:32:20.131 [2024-11-26 19:18:36.970271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.131 [2024-11-26 19:18:36.970351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.131 [2024-11-26 19:18:36.970362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.131 qpair failed and we were unable to recover it. 00:32:20.131 [2024-11-26 19:18:36.970432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.131 [2024-11-26 19:18:36.970495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.131 [2024-11-26 19:18:36.970506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.131 qpair failed and we were unable to recover it. 00:32:20.131 [2024-11-26 19:18:36.970582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.131 [2024-11-26 19:18:36.970728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.131 [2024-11-26 19:18:36.970741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.131 qpair failed and we were unable to recover it. 00:32:20.131 [2024-11-26 19:18:36.970821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.131 [2024-11-26 19:18:36.970895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.131 [2024-11-26 19:18:36.970905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.131 qpair failed and we were unable to recover it. 00:32:20.131 [2024-11-26 19:18:36.971035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.131 [2024-11-26 19:18:36.971117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.131 [2024-11-26 19:18:36.971128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.131 qpair failed and we were unable to recover it. 00:32:20.131 [2024-11-26 19:18:36.971200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.131 [2024-11-26 19:18:36.971289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.131 [2024-11-26 19:18:36.971300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.131 qpair failed and we were unable to recover it. 00:32:20.131 [2024-11-26 19:18:36.971448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.131 [2024-11-26 19:18:36.971539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.131 [2024-11-26 19:18:36.971551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.131 qpair failed and we were unable to recover it. 00:32:20.131 [2024-11-26 19:18:36.971617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.131 [2024-11-26 19:18:36.971761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.131 [2024-11-26 19:18:36.971792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.131 qpair failed and we were unable to recover it. 00:32:20.131 [2024-11-26 19:18:36.971914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.131 [2024-11-26 19:18:36.972033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.131 [2024-11-26 19:18:36.972066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.131 qpair failed and we were unable to recover it. 00:32:20.131 [2024-11-26 19:18:36.972238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.131 [2024-11-26 19:18:36.972364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.131 [2024-11-26 19:18:36.972395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.131 qpair failed and we were unable to recover it. 00:32:20.131 [2024-11-26 19:18:36.972510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.131 [2024-11-26 19:18:36.972623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.131 [2024-11-26 19:18:36.972656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.131 qpair failed and we were unable to recover it. 00:32:20.131 [2024-11-26 19:18:36.972864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.131 [2024-11-26 19:18:36.972981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.131 [2024-11-26 19:18:36.973014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.131 qpair failed and we were unable to recover it. 00:32:20.131 [2024-11-26 19:18:36.973184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.131 [2024-11-26 19:18:36.973335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.131 [2024-11-26 19:18:36.973347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.131 qpair failed and we were unable to recover it. 00:32:20.131 [2024-11-26 19:18:36.973419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.131 [2024-11-26 19:18:36.973507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.131 [2024-11-26 19:18:36.973518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.131 qpair failed and we were unable to recover it. 00:32:20.131 [2024-11-26 19:18:36.973598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.131 [2024-11-26 19:18:36.973751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.131 [2024-11-26 19:18:36.973762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.131 qpair failed and we were unable to recover it. 00:32:20.131 [2024-11-26 19:18:36.973890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.131 [2024-11-26 19:18:36.973964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.131 [2024-11-26 19:18:36.973976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.131 qpair failed and we were unable to recover it. 00:32:20.131 [2024-11-26 19:18:36.974122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.131 [2024-11-26 19:18:36.974301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.131 [2024-11-26 19:18:36.974332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.131 qpair failed and we were unable to recover it. 00:32:20.131 [2024-11-26 19:18:36.974515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.131 [2024-11-26 19:18:36.974626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.132 [2024-11-26 19:18:36.974638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.132 qpair failed and we were unable to recover it. 00:32:20.132 [2024-11-26 19:18:36.974705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.132 [2024-11-26 19:18:36.974764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.132 [2024-11-26 19:18:36.974776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.132 qpair failed and we were unable to recover it. 00:32:20.132 [2024-11-26 19:18:36.974865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.414 [2024-11-26 19:18:36.975004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.414 [2024-11-26 19:18:36.975016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.414 qpair failed and we were unable to recover it. 00:32:20.414 [2024-11-26 19:18:36.975149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.414 [2024-11-26 19:18:36.975342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.414 [2024-11-26 19:18:36.975354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.414 qpair failed and we were unable to recover it. 00:32:20.414 [2024-11-26 19:18:36.975551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.414 [2024-11-26 19:18:36.975628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.414 [2024-11-26 19:18:36.975639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.414 qpair failed and we were unable to recover it. 00:32:20.414 [2024-11-26 19:18:36.975782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.414 [2024-11-26 19:18:36.975853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.414 [2024-11-26 19:18:36.975865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.414 qpair failed and we were unable to recover it. 00:32:20.414 [2024-11-26 19:18:36.975956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.414 [2024-11-26 19:18:36.976043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.414 [2024-11-26 19:18:36.976054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.414 qpair failed and we were unable to recover it. 00:32:20.414 [2024-11-26 19:18:36.976181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.414 [2024-11-26 19:18:36.976251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.414 [2024-11-26 19:18:36.976262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.414 qpair failed and we were unable to recover it. 00:32:20.414 [2024-11-26 19:18:36.976398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.414 [2024-11-26 19:18:36.976544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.414 [2024-11-26 19:18:36.976555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.414 qpair failed and we were unable to recover it. 00:32:20.414 [2024-11-26 19:18:36.976694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.414 [2024-11-26 19:18:36.976772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.414 [2024-11-26 19:18:36.976783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.414 qpair failed and we were unable to recover it. 00:32:20.414 [2024-11-26 19:18:36.976923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.414 [2024-11-26 19:18:36.976987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.414 [2024-11-26 19:18:36.976998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.414 qpair failed and we were unable to recover it. 00:32:20.415 [2024-11-26 19:18:36.977066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.415 [2024-11-26 19:18:36.977150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.415 [2024-11-26 19:18:36.977160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.415 qpair failed and we were unable to recover it. 00:32:20.415 [2024-11-26 19:18:36.977362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.415 [2024-11-26 19:18:36.977488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.415 [2024-11-26 19:18:36.977499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.415 qpair failed and we were unable to recover it. 00:32:20.415 [2024-11-26 19:18:36.977640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.415 [2024-11-26 19:18:36.977718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.415 [2024-11-26 19:18:36.977729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.415 qpair failed and we were unable to recover it. 00:32:20.415 [2024-11-26 19:18:36.977831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.415 [2024-11-26 19:18:36.977921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.415 [2024-11-26 19:18:36.977932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.415 qpair failed and we were unable to recover it. 00:32:20.415 [2024-11-26 19:18:36.978086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.415 [2024-11-26 19:18:36.978167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.415 [2024-11-26 19:18:36.978178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.415 qpair failed and we were unable to recover it. 00:32:20.415 [2024-11-26 19:18:36.978262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.415 [2024-11-26 19:18:36.978404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.415 [2024-11-26 19:18:36.978416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.415 qpair failed and we were unable to recover it. 00:32:20.415 [2024-11-26 19:18:36.978507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.415 [2024-11-26 19:18:36.978663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.415 [2024-11-26 19:18:36.978674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.415 qpair failed and we were unable to recover it. 00:32:20.415 [2024-11-26 19:18:36.978751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.415 [2024-11-26 19:18:36.978840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.415 [2024-11-26 19:18:36.978852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.415 qpair failed and we were unable to recover it. 00:32:20.415 [2024-11-26 19:18:36.978997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.415 [2024-11-26 19:18:36.979130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.415 [2024-11-26 19:18:36.979142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.415 qpair failed and we were unable to recover it. 00:32:20.415 [2024-11-26 19:18:36.979228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.415 [2024-11-26 19:18:36.979359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.415 [2024-11-26 19:18:36.979370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.415 qpair failed and we were unable to recover it. 00:32:20.415 [2024-11-26 19:18:36.979444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.415 [2024-11-26 19:18:36.979525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.415 [2024-11-26 19:18:36.979535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.415 qpair failed and we were unable to recover it. 00:32:20.415 [2024-11-26 19:18:36.979617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.415 [2024-11-26 19:18:36.979758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.415 [2024-11-26 19:18:36.979769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.415 qpair failed and we were unable to recover it. 00:32:20.415 [2024-11-26 19:18:36.979832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.415 [2024-11-26 19:18:36.979904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.415 [2024-11-26 19:18:36.979915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.415 qpair failed and we were unable to recover it. 00:32:20.415 [2024-11-26 19:18:36.979974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.415 [2024-11-26 19:18:36.980048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.415 [2024-11-26 19:18:36.980058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.415 qpair failed and we were unable to recover it. 00:32:20.415 [2024-11-26 19:18:36.980130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.415 [2024-11-26 19:18:36.980259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.415 [2024-11-26 19:18:36.980270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.415 qpair failed and we were unable to recover it. 00:32:20.415 [2024-11-26 19:18:36.980376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.415 [2024-11-26 19:18:36.980475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.415 [2024-11-26 19:18:36.980506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.415 qpair failed and we were unable to recover it. 00:32:20.415 [2024-11-26 19:18:36.980688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.415 [2024-11-26 19:18:36.980801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.415 [2024-11-26 19:18:36.980833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.415 qpair failed and we were unable to recover it. 00:32:20.415 [2024-11-26 19:18:36.980954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.415 [2024-11-26 19:18:36.981046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.415 [2024-11-26 19:18:36.981057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.415 qpair failed and we were unable to recover it. 00:32:20.415 [2024-11-26 19:18:36.981209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.415 [2024-11-26 19:18:36.981322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.415 [2024-11-26 19:18:36.981352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.415 qpair failed and we were unable to recover it. 00:32:20.415 [2024-11-26 19:18:36.981592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.415 [2024-11-26 19:18:36.981695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.415 [2024-11-26 19:18:36.981725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.415 qpair failed and we were unable to recover it. 00:32:20.415 [2024-11-26 19:18:36.981848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.415 [2024-11-26 19:18:36.981971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.415 [2024-11-26 19:18:36.982003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.415 qpair failed and we were unable to recover it. 00:32:20.415 [2024-11-26 19:18:36.982187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.415 [2024-11-26 19:18:36.982422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.416 [2024-11-26 19:18:36.982454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.416 qpair failed and we were unable to recover it. 00:32:20.416 [2024-11-26 19:18:36.982630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.416 [2024-11-26 19:18:36.982810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.416 [2024-11-26 19:18:36.982841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.416 qpair failed and we were unable to recover it. 00:32:20.416 [2024-11-26 19:18:36.983044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.416 [2024-11-26 19:18:36.983196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.416 [2024-11-26 19:18:36.983233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.416 qpair failed and we were unable to recover it. 00:32:20.416 [2024-11-26 19:18:36.983420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.416 [2024-11-26 19:18:36.983527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.416 [2024-11-26 19:18:36.983558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.416 qpair failed and we were unable to recover it. 00:32:20.416 [2024-11-26 19:18:36.983685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.416 [2024-11-26 19:18:36.983798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.416 [2024-11-26 19:18:36.983810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.416 qpair failed and we were unable to recover it. 00:32:20.416 [2024-11-26 19:18:36.983955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.416 [2024-11-26 19:18:36.984087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.416 [2024-11-26 19:18:36.984099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.416 qpair failed and we were unable to recover it. 00:32:20.416 [2024-11-26 19:18:36.984162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.416 [2024-11-26 19:18:36.984245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.416 [2024-11-26 19:18:36.984256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.416 qpair failed and we were unable to recover it. 00:32:20.416 [2024-11-26 19:18:36.984335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.416 [2024-11-26 19:18:36.984539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.416 [2024-11-26 19:18:36.984570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.416 qpair failed and we were unable to recover it. 00:32:20.416 [2024-11-26 19:18:36.984705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.416 [2024-11-26 19:18:36.984827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.416 [2024-11-26 19:18:36.984859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.416 qpair failed and we were unable to recover it. 00:32:20.416 [2024-11-26 19:18:36.984987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.416 [2024-11-26 19:18:36.985123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.416 [2024-11-26 19:18:36.985135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.416 qpair failed and we were unable to recover it. 00:32:20.416 [2024-11-26 19:18:36.985339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.416 [2024-11-26 19:18:36.985574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.416 [2024-11-26 19:18:36.985606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.416 qpair failed and we were unable to recover it. 00:32:20.416 [2024-11-26 19:18:36.985723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.416 [2024-11-26 19:18:36.985834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.416 [2024-11-26 19:18:36.985869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.416 qpair failed and we were unable to recover it. 00:32:20.416 [2024-11-26 19:18:36.985936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.416 [2024-11-26 19:18:36.986020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.416 [2024-11-26 19:18:36.986035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.416 qpair failed and we were unable to recover it. 00:32:20.416 [2024-11-26 19:18:36.986168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.416 [2024-11-26 19:18:36.986371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.416 [2024-11-26 19:18:36.986403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.416 qpair failed and we were unable to recover it. 00:32:20.416 [2024-11-26 19:18:36.986587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.416 [2024-11-26 19:18:36.986712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.416 [2024-11-26 19:18:36.986724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.416 qpair failed and we were unable to recover it. 00:32:20.416 [2024-11-26 19:18:36.986872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.416 [2024-11-26 19:18:36.986954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.416 [2024-11-26 19:18:36.986966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.416 qpair failed and we were unable to recover it. 00:32:20.416 [2024-11-26 19:18:36.987153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.416 [2024-11-26 19:18:36.987310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.416 [2024-11-26 19:18:36.987342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.416 qpair failed and we were unable to recover it. 00:32:20.416 [2024-11-26 19:18:36.987522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.416 [2024-11-26 19:18:36.987705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.416 [2024-11-26 19:18:36.987737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.416 qpair failed and we were unable to recover it. 00:32:20.416 [2024-11-26 19:18:36.987917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.416 [2024-11-26 19:18:36.988054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.416 [2024-11-26 19:18:36.988097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.416 qpair failed and we were unable to recover it. 00:32:20.416 [2024-11-26 19:18:36.988232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.416 [2024-11-26 19:18:36.988313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.416 [2024-11-26 19:18:36.988325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.416 qpair failed and we were unable to recover it. 00:32:20.416 [2024-11-26 19:18:36.988426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.416 [2024-11-26 19:18:36.988554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.416 [2024-11-26 19:18:36.988576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.416 qpair failed and we were unable to recover it. 00:32:20.416 [2024-11-26 19:18:36.988706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.416 [2024-11-26 19:18:36.988901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.416 [2024-11-26 19:18:36.988912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.416 qpair failed and we were unable to recover it. 00:32:20.416 [2024-11-26 19:18:36.988995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.416 [2024-11-26 19:18:36.989152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.416 [2024-11-26 19:18:36.989166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.416 qpair failed and we were unable to recover it. 00:32:20.416 [2024-11-26 19:18:36.989232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.416 [2024-11-26 19:18:36.989304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.416 [2024-11-26 19:18:36.989315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.416 qpair failed and we were unable to recover it. 00:32:20.416 [2024-11-26 19:18:36.989439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.416 [2024-11-26 19:18:36.989538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.416 [2024-11-26 19:18:36.989571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.416 qpair failed and we were unable to recover it. 00:32:20.416 [2024-11-26 19:18:36.989759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.416 [2024-11-26 19:18:36.989884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.417 [2024-11-26 19:18:36.989915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.417 qpair failed and we were unable to recover it. 00:32:20.417 [2024-11-26 19:18:36.990058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.417 [2024-11-26 19:18:36.990243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.417 [2024-11-26 19:18:36.990274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.417 qpair failed and we were unable to recover it. 00:32:20.417 [2024-11-26 19:18:36.990390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.417 [2024-11-26 19:18:36.990503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.417 [2024-11-26 19:18:36.990534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.417 qpair failed and we were unable to recover it. 00:32:20.417 [2024-11-26 19:18:36.990654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.417 [2024-11-26 19:18:36.990840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.417 [2024-11-26 19:18:36.990871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.417 qpair failed and we were unable to recover it. 00:32:20.417 [2024-11-26 19:18:36.991129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.417 [2024-11-26 19:18:36.991258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.417 [2024-11-26 19:18:36.991270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.417 qpair failed and we were unable to recover it. 00:32:20.417 [2024-11-26 19:18:36.991330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.417 [2024-11-26 19:18:36.991420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.417 [2024-11-26 19:18:36.991431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.417 qpair failed and we were unable to recover it. 00:32:20.417 [2024-11-26 19:18:36.991514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.417 [2024-11-26 19:18:36.991720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.417 [2024-11-26 19:18:36.991732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.417 qpair failed and we were unable to recover it. 00:32:20.417 [2024-11-26 19:18:36.991814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.417 [2024-11-26 19:18:36.992022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.417 [2024-11-26 19:18:36.992036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.417 qpair failed and we were unable to recover it. 00:32:20.417 [2024-11-26 19:18:36.992099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.417 [2024-11-26 19:18:36.992178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.417 [2024-11-26 19:18:36.992190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.417 qpair failed and we were unable to recover it. 00:32:20.417 [2024-11-26 19:18:36.992340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.417 [2024-11-26 19:18:36.992492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.417 [2024-11-26 19:18:36.992523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.417 qpair failed and we were unable to recover it. 00:32:20.417 [2024-11-26 19:18:36.992648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.417 [2024-11-26 19:18:36.992771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.417 [2024-11-26 19:18:36.992782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.417 qpair failed and we were unable to recover it. 00:32:20.417 [2024-11-26 19:18:36.992917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.417 [2024-11-26 19:18:36.993077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.417 [2024-11-26 19:18:36.993111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.417 qpair failed and we were unable to recover it. 00:32:20.417 [2024-11-26 19:18:36.993379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.417 [2024-11-26 19:18:36.993568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.417 [2024-11-26 19:18:36.993600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.417 qpair failed and we were unable to recover it. 00:32:20.417 [2024-11-26 19:18:36.993711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.417 [2024-11-26 19:18:36.993907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.417 [2024-11-26 19:18:36.993940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.417 qpair failed and we were unable to recover it. 00:32:20.417 [2024-11-26 19:18:36.994096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.417 [2024-11-26 19:18:36.994195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.417 [2024-11-26 19:18:36.994228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.417 qpair failed and we were unable to recover it. 00:32:20.417 [2024-11-26 19:18:36.994340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.417 [2024-11-26 19:18:36.994458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.417 [2024-11-26 19:18:36.994469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.417 qpair failed and we were unable to recover it. 00:32:20.417 [2024-11-26 19:18:36.994535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.417 [2024-11-26 19:18:36.994679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.417 [2024-11-26 19:18:36.994709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.417 qpair failed and we were unable to recover it. 00:32:20.417 [2024-11-26 19:18:36.994976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.417 [2024-11-26 19:18:36.995103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.417 [2024-11-26 19:18:36.995135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.417 qpair failed and we were unable to recover it. 00:32:20.417 [2024-11-26 19:18:36.995264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.417 [2024-11-26 19:18:36.995418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.417 [2024-11-26 19:18:36.995429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.417 qpair failed and we were unable to recover it. 00:32:20.417 [2024-11-26 19:18:36.995572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.417 [2024-11-26 19:18:36.995780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.417 [2024-11-26 19:18:36.995812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.417 qpair failed and we were unable to recover it. 00:32:20.417 [2024-11-26 19:18:36.995996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.417 [2024-11-26 19:18:36.996198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.417 [2024-11-26 19:18:36.996230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.417 qpair failed and we were unable to recover it. 00:32:20.417 [2024-11-26 19:18:36.996365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.417 [2024-11-26 19:18:36.996626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.417 [2024-11-26 19:18:36.996658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.417 qpair failed and we were unable to recover it. 00:32:20.417 [2024-11-26 19:18:36.996844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.418 [2024-11-26 19:18:36.996974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.418 [2024-11-26 19:18:36.997002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.418 qpair failed and we were unable to recover it. 00:32:20.418 [2024-11-26 19:18:36.997070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.418 [2024-11-26 19:18:36.997133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.418 [2024-11-26 19:18:36.997143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.418 qpair failed and we were unable to recover it. 00:32:20.418 [2024-11-26 19:18:36.997256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.418 [2024-11-26 19:18:36.997387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.418 [2024-11-26 19:18:36.997399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.418 qpair failed and we were unable to recover it. 00:32:20.418 [2024-11-26 19:18:36.997493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.418 [2024-11-26 19:18:36.997666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.418 [2024-11-26 19:18:36.997697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.418 qpair failed and we were unable to recover it. 00:32:20.418 [2024-11-26 19:18:36.997870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.418 [2024-11-26 19:18:36.998062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.418 [2024-11-26 19:18:36.998074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.418 qpair failed and we were unable to recover it. 00:32:20.418 [2024-11-26 19:18:36.998137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.418 [2024-11-26 19:18:36.998320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.418 [2024-11-26 19:18:36.998331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.418 qpair failed and we were unable to recover it. 00:32:20.418 [2024-11-26 19:18:36.998495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.418 [2024-11-26 19:18:36.998676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.418 [2024-11-26 19:18:36.998708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.418 qpair failed and we were unable to recover it. 00:32:20.418 [2024-11-26 19:18:36.998908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.418 [2024-11-26 19:18:36.999093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.418 [2024-11-26 19:18:36.999125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.418 qpair failed and we were unable to recover it. 00:32:20.418 [2024-11-26 19:18:36.999410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.418 [2024-11-26 19:18:36.999589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.418 [2024-11-26 19:18:36.999621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.418 qpair failed and we were unable to recover it. 00:32:20.418 [2024-11-26 19:18:36.999835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.418 [2024-11-26 19:18:36.999991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.418 [2024-11-26 19:18:37.000004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.418 qpair failed and we were unable to recover it. 00:32:20.418 [2024-11-26 19:18:37.000079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.418 [2024-11-26 19:18:37.000156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.418 [2024-11-26 19:18:37.000167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.418 qpair failed and we were unable to recover it. 00:32:20.418 [2024-11-26 19:18:37.000320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.418 [2024-11-26 19:18:37.000420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.418 [2024-11-26 19:18:37.000451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.418 qpair failed and we were unable to recover it. 00:32:20.418 [2024-11-26 19:18:37.000572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.418 [2024-11-26 19:18:37.000751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.418 [2024-11-26 19:18:37.000783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.418 qpair failed and we were unable to recover it. 00:32:20.418 [2024-11-26 19:18:37.001050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.418 [2024-11-26 19:18:37.001295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.418 [2024-11-26 19:18:37.001307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.418 qpair failed and we were unable to recover it. 00:32:20.418 [2024-11-26 19:18:37.001393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.418 [2024-11-26 19:18:37.001488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.418 [2024-11-26 19:18:37.001519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.418 qpair failed and we were unable to recover it. 00:32:20.418 [2024-11-26 19:18:37.001708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.418 [2024-11-26 19:18:37.001846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.418 [2024-11-26 19:18:37.001858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.418 qpair failed and we were unable to recover it. 00:32:20.418 [2024-11-26 19:18:37.002002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.418 [2024-11-26 19:18:37.002081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.418 [2024-11-26 19:18:37.002092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.418 qpair failed and we were unable to recover it. 00:32:20.418 [2024-11-26 19:18:37.002240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.418 [2024-11-26 19:18:37.002357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.418 [2024-11-26 19:18:37.002388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.418 qpair failed and we were unable to recover it. 00:32:20.418 [2024-11-26 19:18:37.002559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.418 [2024-11-26 19:18:37.002796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.418 [2024-11-26 19:18:37.002828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.418 qpair failed and we were unable to recover it. 00:32:20.418 [2024-11-26 19:18:37.002941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.418 [2024-11-26 19:18:37.003065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.418 [2024-11-26 19:18:37.003076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.418 qpair failed and we were unable to recover it. 00:32:20.418 [2024-11-26 19:18:37.003213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.418 [2024-11-26 19:18:37.003471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.418 [2024-11-26 19:18:37.003502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.418 qpair failed and we were unable to recover it. 00:32:20.418 [2024-11-26 19:18:37.003768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.418 [2024-11-26 19:18:37.004002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.418 [2024-11-26 19:18:37.004043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.418 qpair failed and we were unable to recover it. 00:32:20.418 [2024-11-26 19:18:37.004118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.418 [2024-11-26 19:18:37.004210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.418 [2024-11-26 19:18:37.004222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.419 qpair failed and we were unable to recover it. 00:32:20.419 [2024-11-26 19:18:37.004367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.419 [2024-11-26 19:18:37.004499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.419 [2024-11-26 19:18:37.004510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.419 qpair failed and we were unable to recover it. 00:32:20.419 [2024-11-26 19:18:37.004639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.419 [2024-11-26 19:18:37.004835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.419 [2024-11-26 19:18:37.004848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.419 qpair failed and we were unable to recover it. 00:32:20.419 [2024-11-26 19:18:37.005044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.419 [2024-11-26 19:18:37.005292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.419 [2024-11-26 19:18:37.005325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.419 qpair failed and we were unable to recover it. 00:32:20.419 [2024-11-26 19:18:37.005544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.419 [2024-11-26 19:18:37.005730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.419 [2024-11-26 19:18:37.005762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.419 qpair failed and we were unable to recover it. 00:32:20.419 [2024-11-26 19:18:37.005902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.419 [2024-11-26 19:18:37.006104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.419 [2024-11-26 19:18:37.006143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.419 qpair failed and we were unable to recover it. 00:32:20.419 [2024-11-26 19:18:37.006217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.419 [2024-11-26 19:18:37.006371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.419 [2024-11-26 19:18:37.006383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.419 qpair failed and we were unable to recover it. 00:32:20.419 [2024-11-26 19:18:37.006532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.419 [2024-11-26 19:18:37.006685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.419 [2024-11-26 19:18:37.006717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.419 qpair failed and we were unable to recover it. 00:32:20.419 [2024-11-26 19:18:37.006840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.419 [2024-11-26 19:18:37.007011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.419 [2024-11-26 19:18:37.007045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.419 qpair failed and we were unable to recover it. 00:32:20.419 [2024-11-26 19:18:37.007152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.419 [2024-11-26 19:18:37.007269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.419 [2024-11-26 19:18:37.007281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.419 qpair failed and we were unable to recover it. 00:32:20.419 [2024-11-26 19:18:37.007423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.419 [2024-11-26 19:18:37.007640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.419 [2024-11-26 19:18:37.007651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.419 qpair failed and we were unable to recover it. 00:32:20.419 [2024-11-26 19:18:37.007733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.419 [2024-11-26 19:18:37.007815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.419 [2024-11-26 19:18:37.007826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.419 qpair failed and we were unable to recover it. 00:32:20.419 [2024-11-26 19:18:37.007890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.419 [2024-11-26 19:18:37.007993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.419 [2024-11-26 19:18:37.008026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.419 qpair failed and we were unable to recover it. 00:32:20.419 [2024-11-26 19:18:37.008151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.419 [2024-11-26 19:18:37.008323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.419 [2024-11-26 19:18:37.008354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.419 qpair failed and we were unable to recover it. 00:32:20.419 [2024-11-26 19:18:37.008552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.419 [2024-11-26 19:18:37.008749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.419 [2024-11-26 19:18:37.008781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.419 qpair failed and we were unable to recover it. 00:32:20.419 [2024-11-26 19:18:37.008919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.419 [2024-11-26 19:18:37.009111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.419 [2024-11-26 19:18:37.009123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.419 qpair failed and we were unable to recover it. 00:32:20.419 [2024-11-26 19:18:37.009202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.419 [2024-11-26 19:18:37.009367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.419 [2024-11-26 19:18:37.009379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.419 qpair failed and we were unable to recover it. 00:32:20.419 [2024-11-26 19:18:37.009597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.419 [2024-11-26 19:18:37.009671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.419 [2024-11-26 19:18:37.009710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.419 qpair failed and we were unable to recover it. 00:32:20.419 [2024-11-26 19:18:37.009900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.419 [2024-11-26 19:18:37.010037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.419 [2024-11-26 19:18:37.010070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.419 qpair failed and we were unable to recover it. 00:32:20.419 [2024-11-26 19:18:37.010193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.419 [2024-11-26 19:18:37.010322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.419 [2024-11-26 19:18:37.010354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.419 qpair failed and we were unable to recover it. 00:32:20.419 [2024-11-26 19:18:37.010553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.419 [2024-11-26 19:18:37.010729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.419 [2024-11-26 19:18:37.010762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.419 qpair failed and we were unable to recover it. 00:32:20.419 [2024-11-26 19:18:37.010937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.419 [2024-11-26 19:18:37.011142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.419 [2024-11-26 19:18:37.011176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.419 qpair failed and we were unable to recover it. 00:32:20.420 [2024-11-26 19:18:37.011306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.420 [2024-11-26 19:18:37.011501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.420 [2024-11-26 19:18:37.011533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.420 qpair failed and we were unable to recover it. 00:32:20.420 [2024-11-26 19:18:37.011641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.420 [2024-11-26 19:18:37.011826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.420 [2024-11-26 19:18:37.011838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.420 qpair failed and we were unable to recover it. 00:32:20.420 [2024-11-26 19:18:37.011973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.420 [2024-11-26 19:18:37.012051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.420 [2024-11-26 19:18:37.012062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.420 qpair failed and we were unable to recover it. 00:32:20.420 [2024-11-26 19:18:37.012152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.420 [2024-11-26 19:18:37.012322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.420 [2024-11-26 19:18:37.012353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.420 qpair failed and we were unable to recover it. 00:32:20.420 [2024-11-26 19:18:37.012538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.420 [2024-11-26 19:18:37.012649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.420 [2024-11-26 19:18:37.012682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.420 qpair failed and we were unable to recover it. 00:32:20.420 [2024-11-26 19:18:37.012803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.420 [2024-11-26 19:18:37.012913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.420 [2024-11-26 19:18:37.012944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.420 qpair failed and we were unable to recover it. 00:32:20.420 [2024-11-26 19:18:37.013101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.420 [2024-11-26 19:18:37.013271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.420 [2024-11-26 19:18:37.013283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.420 qpair failed and we were unable to recover it. 00:32:20.420 [2024-11-26 19:18:37.013375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.420 [2024-11-26 19:18:37.013452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.420 [2024-11-26 19:18:37.013463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.420 qpair failed and we were unable to recover it. 00:32:20.420 [2024-11-26 19:18:37.013607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.420 [2024-11-26 19:18:37.013781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.420 [2024-11-26 19:18:37.013813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.420 qpair failed and we were unable to recover it. 00:32:20.420 [2024-11-26 19:18:37.013922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.420 [2024-11-26 19:18:37.014121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.420 [2024-11-26 19:18:37.014134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.420 qpair failed and we were unable to recover it. 00:32:20.420 [2024-11-26 19:18:37.014197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.420 [2024-11-26 19:18:37.014350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.420 [2024-11-26 19:18:37.014382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.420 qpair failed and we were unable to recover it. 00:32:20.420 [2024-11-26 19:18:37.014511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.420 [2024-11-26 19:18:37.014626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.420 [2024-11-26 19:18:37.014658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.420 qpair failed and we were unable to recover it. 00:32:20.420 [2024-11-26 19:18:37.014891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.420 [2024-11-26 19:18:37.015074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.420 [2024-11-26 19:18:37.015114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.420 qpair failed and we were unable to recover it. 00:32:20.420 [2024-11-26 19:18:37.015410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.420 [2024-11-26 19:18:37.015584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.420 [2024-11-26 19:18:37.015616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.420 qpair failed and we were unable to recover it. 00:32:20.420 [2024-11-26 19:18:37.015814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.420 [2024-11-26 19:18:37.015984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.420 [2024-11-26 19:18:37.016017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.420 qpair failed and we were unable to recover it. 00:32:20.420 [2024-11-26 19:18:37.016310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.420 [2024-11-26 19:18:37.016433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.420 [2024-11-26 19:18:37.016465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.420 qpair failed and we were unable to recover it. 00:32:20.420 [2024-11-26 19:18:37.016723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.420 [2024-11-26 19:18:37.016849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.420 [2024-11-26 19:18:37.016881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.420 qpair failed and we were unable to recover it. 00:32:20.420 [2024-11-26 19:18:37.017049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.420 [2024-11-26 19:18:37.017210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.421 [2024-11-26 19:18:37.017240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.421 qpair failed and we were unable to recover it. 00:32:20.421 [2024-11-26 19:18:37.017501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.421 [2024-11-26 19:18:37.017639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.421 [2024-11-26 19:18:37.017671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.421 qpair failed and we were unable to recover it. 00:32:20.421 [2024-11-26 19:18:37.017781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.421 [2024-11-26 19:18:37.018023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.421 [2024-11-26 19:18:37.018057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.421 qpair failed and we were unable to recover it. 00:32:20.421 [2024-11-26 19:18:37.018242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.421 [2024-11-26 19:18:37.018420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.421 [2024-11-26 19:18:37.018453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.421 qpair failed and we were unable to recover it. 00:32:20.421 [2024-11-26 19:18:37.018646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.421 [2024-11-26 19:18:37.018812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.421 [2024-11-26 19:18:37.018843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.421 qpair failed and we were unable to recover it. 00:32:20.421 [2024-11-26 19:18:37.018978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.421 [2024-11-26 19:18:37.019071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.421 [2024-11-26 19:18:37.019088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.421 qpair failed and we were unable to recover it. 00:32:20.421 [2024-11-26 19:18:37.019234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.421 [2024-11-26 19:18:37.019324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.421 [2024-11-26 19:18:37.019340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.421 qpair failed and we were unable to recover it. 00:32:20.421 [2024-11-26 19:18:37.019481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.421 [2024-11-26 19:18:37.019631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.421 [2024-11-26 19:18:37.019664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.421 qpair failed and we were unable to recover it. 00:32:20.421 [2024-11-26 19:18:37.019789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.421 [2024-11-26 19:18:37.019919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.421 [2024-11-26 19:18:37.019959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.421 qpair failed and we were unable to recover it. 00:32:20.421 [2024-11-26 19:18:37.020204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.421 [2024-11-26 19:18:37.020330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.421 [2024-11-26 19:18:37.020361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.421 qpair failed and we were unable to recover it. 00:32:20.421 [2024-11-26 19:18:37.020546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.421 [2024-11-26 19:18:37.020648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.421 [2024-11-26 19:18:37.020680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.421 qpair failed and we were unable to recover it. 00:32:20.421 [2024-11-26 19:18:37.020857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.421 [2024-11-26 19:18:37.021035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.421 [2024-11-26 19:18:37.021068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.421 qpair failed and we were unable to recover it. 00:32:20.421 [2024-11-26 19:18:37.021240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.421 [2024-11-26 19:18:37.021352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.421 [2024-11-26 19:18:37.021383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.421 qpair failed and we were unable to recover it. 00:32:20.421 [2024-11-26 19:18:37.021528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.421 [2024-11-26 19:18:37.021708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.421 [2024-11-26 19:18:37.021739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.421 qpair failed and we were unable to recover it. 00:32:20.421 [2024-11-26 19:18:37.021871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.421 [2024-11-26 19:18:37.022103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.421 [2024-11-26 19:18:37.022120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.421 qpair failed and we were unable to recover it. 00:32:20.421 [2024-11-26 19:18:37.022272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.421 [2024-11-26 19:18:37.022354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.421 [2024-11-26 19:18:37.022375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.421 qpair failed and we were unable to recover it. 00:32:20.421 [2024-11-26 19:18:37.022469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.421 [2024-11-26 19:18:37.022565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.421 [2024-11-26 19:18:37.022580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.421 qpair failed and we were unable to recover it. 00:32:20.421 [2024-11-26 19:18:37.022730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.421 [2024-11-26 19:18:37.022884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.421 [2024-11-26 19:18:37.022919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.421 qpair failed and we were unable to recover it. 00:32:20.421 [2024-11-26 19:18:37.023196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.421 [2024-11-26 19:18:37.023309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.421 [2024-11-26 19:18:37.023341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.421 qpair failed and we were unable to recover it. 00:32:20.421 [2024-11-26 19:18:37.023521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.421 [2024-11-26 19:18:37.023719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.421 [2024-11-26 19:18:37.023750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.421 qpair failed and we were unable to recover it. 00:32:20.421 [2024-11-26 19:18:37.023931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.421 [2024-11-26 19:18:37.024050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.421 [2024-11-26 19:18:37.024083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.421 qpair failed and we were unable to recover it. 00:32:20.421 [2024-11-26 19:18:37.024199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.421 [2024-11-26 19:18:37.024378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.421 [2024-11-26 19:18:37.024409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.421 qpair failed and we were unable to recover it. 00:32:20.421 [2024-11-26 19:18:37.024543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.421 [2024-11-26 19:18:37.024805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.421 [2024-11-26 19:18:37.024837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.421 qpair failed and we were unable to recover it. 00:32:20.421 [2024-11-26 19:18:37.025034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.421 [2024-11-26 19:18:37.025272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.421 [2024-11-26 19:18:37.025308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.421 qpair failed and we were unable to recover it. 00:32:20.422 [2024-11-26 19:18:37.025559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.422 [2024-11-26 19:18:37.025798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.422 [2024-11-26 19:18:37.025829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.422 qpair failed and we were unable to recover it. 00:32:20.422 [2024-11-26 19:18:37.026009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.422 [2024-11-26 19:18:37.026202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.422 [2024-11-26 19:18:37.026241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.422 qpair failed and we were unable to recover it. 00:32:20.422 [2024-11-26 19:18:37.026487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.422 [2024-11-26 19:18:37.026723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.422 [2024-11-26 19:18:37.026754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.422 qpair failed and we were unable to recover it. 00:32:20.422 [2024-11-26 19:18:37.026972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.422 [2024-11-26 19:18:37.027175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.422 [2024-11-26 19:18:37.027190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.422 qpair failed and we were unable to recover it. 00:32:20.422 [2024-11-26 19:18:37.027278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.422 [2024-11-26 19:18:37.027424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.422 [2024-11-26 19:18:37.027439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.422 qpair failed and we were unable to recover it. 00:32:20.422 [2024-11-26 19:18:37.027662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.422 [2024-11-26 19:18:37.027868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.422 [2024-11-26 19:18:37.027900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.422 qpair failed and we were unable to recover it. 00:32:20.422 [2024-11-26 19:18:37.028091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.422 [2024-11-26 19:18:37.028196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.422 [2024-11-26 19:18:37.028226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.422 qpair failed and we were unable to recover it. 00:32:20.422 [2024-11-26 19:18:37.028343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.422 [2024-11-26 19:18:37.028425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.422 [2024-11-26 19:18:37.028440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.422 qpair failed and we were unable to recover it. 00:32:20.422 [2024-11-26 19:18:37.028530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.422 [2024-11-26 19:18:37.028677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.422 [2024-11-26 19:18:37.028694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.422 qpair failed and we were unable to recover it. 00:32:20.422 [2024-11-26 19:18:37.028763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.422 [2024-11-26 19:18:37.028922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.422 [2024-11-26 19:18:37.028936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.422 qpair failed and we were unable to recover it. 00:32:20.422 [2024-11-26 19:18:37.029041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.422 [2024-11-26 19:18:37.029222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.422 [2024-11-26 19:18:37.029253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.422 qpair failed and we were unable to recover it. 00:32:20.422 [2024-11-26 19:18:37.029378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.422 [2024-11-26 19:18:37.029569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.422 [2024-11-26 19:18:37.029601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.422 qpair failed and we were unable to recover it. 00:32:20.422 [2024-11-26 19:18:37.029725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.422 [2024-11-26 19:18:37.029855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.422 [2024-11-26 19:18:37.029887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.422 qpair failed and we were unable to recover it. 00:32:20.422 [2024-11-26 19:18:37.030105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.422 [2024-11-26 19:18:37.030301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.422 [2024-11-26 19:18:37.030316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.422 qpair failed and we were unable to recover it. 00:32:20.422 [2024-11-26 19:18:37.030500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.422 [2024-11-26 19:18:37.030589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.422 [2024-11-26 19:18:37.030605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.422 qpair failed and we were unable to recover it. 00:32:20.422 [2024-11-26 19:18:37.030758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.422 [2024-11-26 19:18:37.030916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.422 [2024-11-26 19:18:37.030958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.422 qpair failed and we were unable to recover it. 00:32:20.422 [2024-11-26 19:18:37.031146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.422 [2024-11-26 19:18:37.031252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.422 [2024-11-26 19:18:37.031284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.422 qpair failed and we were unable to recover it. 00:32:20.422 [2024-11-26 19:18:37.031472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.422 [2024-11-26 19:18:37.031615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.422 [2024-11-26 19:18:37.031648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.422 qpair failed and we were unable to recover it. 00:32:20.422 [2024-11-26 19:18:37.031769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.422 [2024-11-26 19:18:37.031964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.422 [2024-11-26 19:18:37.031998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.422 qpair failed and we were unable to recover it. 00:32:20.422 [2024-11-26 19:18:37.032118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.422 [2024-11-26 19:18:37.032224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.422 [2024-11-26 19:18:37.032255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.422 qpair failed and we were unable to recover it. 00:32:20.422 [2024-11-26 19:18:37.032370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.422 [2024-11-26 19:18:37.032552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.422 [2024-11-26 19:18:37.032585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.422 qpair failed and we were unable to recover it. 00:32:20.422 [2024-11-26 19:18:37.032761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.422 [2024-11-26 19:18:37.032868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.422 [2024-11-26 19:18:37.032900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.422 qpair failed and we were unable to recover it. 00:32:20.422 [2024-11-26 19:18:37.033106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.422 [2024-11-26 19:18:37.033235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.422 [2024-11-26 19:18:37.033269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.423 qpair failed and we were unable to recover it. 00:32:20.423 [2024-11-26 19:18:37.033390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.423 [2024-11-26 19:18:37.033516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.423 [2024-11-26 19:18:37.033549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.423 qpair failed and we were unable to recover it. 00:32:20.423 [2024-11-26 19:18:37.033774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.423 [2024-11-26 19:18:37.033983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.423 [2024-11-26 19:18:37.034000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.423 qpair failed and we were unable to recover it. 00:32:20.423 [2024-11-26 19:18:37.034102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.423 [2024-11-26 19:18:37.034274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.423 [2024-11-26 19:18:37.034305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.423 qpair failed and we were unable to recover it. 00:32:20.423 [2024-11-26 19:18:37.034570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.423 [2024-11-26 19:18:37.034819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.423 [2024-11-26 19:18:37.034853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.423 qpair failed and we were unable to recover it. 00:32:20.423 [2024-11-26 19:18:37.035103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.423 [2024-11-26 19:18:37.035254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.423 [2024-11-26 19:18:37.035269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.423 qpair failed and we were unable to recover it. 00:32:20.423 [2024-11-26 19:18:37.035435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.423 [2024-11-26 19:18:37.035516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.423 [2024-11-26 19:18:37.035532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.423 qpair failed and we were unable to recover it. 00:32:20.423 [2024-11-26 19:18:37.035685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.423 [2024-11-26 19:18:37.035796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.423 [2024-11-26 19:18:37.035828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.423 qpair failed and we were unable to recover it. 00:32:20.423 [2024-11-26 19:18:37.035969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.423 [2024-11-26 19:18:37.036084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.423 [2024-11-26 19:18:37.036115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.423 qpair failed and we were unable to recover it. 00:32:20.423 [2024-11-26 19:18:37.036237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.423 [2024-11-26 19:18:37.036386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.423 [2024-11-26 19:18:37.036401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.423 qpair failed and we were unable to recover it. 00:32:20.423 [2024-11-26 19:18:37.036557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.423 [2024-11-26 19:18:37.036639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.423 [2024-11-26 19:18:37.036655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.423 qpair failed and we were unable to recover it. 00:32:20.423 [2024-11-26 19:18:37.036814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.423 [2024-11-26 19:18:37.036901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.423 [2024-11-26 19:18:37.036916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.423 qpair failed and we were unable to recover it. 00:32:20.423 [2024-11-26 19:18:37.037062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.423 [2024-11-26 19:18:37.037309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.423 [2024-11-26 19:18:37.037325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.423 qpair failed and we were unable to recover it. 00:32:20.423 [2024-11-26 19:18:37.037411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.423 [2024-11-26 19:18:37.037503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.423 [2024-11-26 19:18:37.037519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.423 qpair failed and we were unable to recover it. 00:32:20.423 [2024-11-26 19:18:37.037668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.423 [2024-11-26 19:18:37.037763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.423 [2024-11-26 19:18:37.037779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.423 qpair failed and we were unable to recover it. 00:32:20.423 [2024-11-26 19:18:37.037927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.423 [2024-11-26 19:18:37.039334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.423 [2024-11-26 19:18:37.039366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.423 qpair failed and we were unable to recover it. 00:32:20.423 [2024-11-26 19:18:37.039550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.423 [2024-11-26 19:18:37.039800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.423 [2024-11-26 19:18:37.039817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.423 qpair failed and we were unable to recover it. 00:32:20.423 [2024-11-26 19:18:37.039924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.423 [2024-11-26 19:18:37.040035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.423 [2024-11-26 19:18:37.040052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.423 qpair failed and we were unable to recover it. 00:32:20.423 [2024-11-26 19:18:37.040128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.423 [2024-11-26 19:18:37.040274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.423 [2024-11-26 19:18:37.040289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.423 qpair failed and we were unable to recover it. 00:32:20.423 [2024-11-26 19:18:37.040433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.423 [2024-11-26 19:18:37.040617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.423 [2024-11-26 19:18:37.040648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.423 qpair failed and we were unable to recover it. 00:32:20.423 [2024-11-26 19:18:37.040787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.423 [2024-11-26 19:18:37.041010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.423 [2024-11-26 19:18:37.041045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.423 qpair failed and we were unable to recover it. 00:32:20.423 [2024-11-26 19:18:37.041301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.423 [2024-11-26 19:18:37.041450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.423 [2024-11-26 19:18:37.041482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.423 qpair failed and we were unable to recover it. 00:32:20.423 [2024-11-26 19:18:37.041605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.424 [2024-11-26 19:18:37.041713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.424 [2024-11-26 19:18:37.041745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.424 qpair failed and we were unable to recover it. 00:32:20.424 [2024-11-26 19:18:37.041883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.424 [2024-11-26 19:18:37.041996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.424 [2024-11-26 19:18:37.042012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.424 qpair failed and we were unable to recover it. 00:32:20.424 [2024-11-26 19:18:37.042671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.424 [2024-11-26 19:18:37.042934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.424 [2024-11-26 19:18:37.042958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.424 qpair failed and we were unable to recover it. 00:32:20.424 [2024-11-26 19:18:37.043110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.424 [2024-11-26 19:18:37.043278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.424 [2024-11-26 19:18:37.043294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.424 qpair failed and we were unable to recover it. 00:32:20.424 [2024-11-26 19:18:37.043397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.424 [2024-11-26 19:18:37.043498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.424 [2024-11-26 19:18:37.043515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.424 qpair failed and we were unable to recover it. 00:32:20.424 [2024-11-26 19:18:37.043691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.424 [2024-11-26 19:18:37.043796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.424 [2024-11-26 19:18:37.043812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.424 qpair failed and we were unable to recover it. 00:32:20.424 [2024-11-26 19:18:37.043961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.424 [2024-11-26 19:18:37.044041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.424 [2024-11-26 19:18:37.044057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.424 qpair failed and we were unable to recover it. 00:32:20.424 [2024-11-26 19:18:37.044211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.424 [2024-11-26 19:18:37.044288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.424 [2024-11-26 19:18:37.044304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.424 qpair failed and we were unable to recover it. 00:32:20.424 [2024-11-26 19:18:37.044455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.424 [2024-11-26 19:18:37.044595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.424 [2024-11-26 19:18:37.044614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.424 qpair failed and we were unable to recover it. 00:32:20.424 [2024-11-26 19:18:37.044689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.424 [2024-11-26 19:18:37.044893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.424 [2024-11-26 19:18:37.044909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.424 qpair failed and we were unable to recover it. 00:32:20.424 [2024-11-26 19:18:37.044983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.424 [2024-11-26 19:18:37.045066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.424 [2024-11-26 19:18:37.045081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.424 qpair failed and we were unable to recover it. 00:32:20.424 [2024-11-26 19:18:37.045153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.424 [2024-11-26 19:18:37.045226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.424 [2024-11-26 19:18:37.045241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.424 qpair failed and we were unable to recover it. 00:32:20.424 [2024-11-26 19:18:37.045379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.424 [2024-11-26 19:18:37.045511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.424 [2024-11-26 19:18:37.045527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.424 qpair failed and we were unable to recover it. 00:32:20.424 [2024-11-26 19:18:37.045632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.424 [2024-11-26 19:18:37.045734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.424 [2024-11-26 19:18:37.045749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.424 qpair failed and we were unable to recover it. 00:32:20.424 [2024-11-26 19:18:37.045895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.424 [2024-11-26 19:18:37.046046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.424 [2024-11-26 19:18:37.046062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.424 qpair failed and we were unable to recover it. 00:32:20.424 [2024-11-26 19:18:37.046140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.424 [2024-11-26 19:18:37.046232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.424 [2024-11-26 19:18:37.046246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.424 qpair failed and we were unable to recover it. 00:32:20.424 [2024-11-26 19:18:37.046409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.424 [2024-11-26 19:18:37.046579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.424 [2024-11-26 19:18:37.046596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.424 qpair failed and we were unable to recover it. 00:32:20.424 [2024-11-26 19:18:37.046684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.424 [2024-11-26 19:18:37.046754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.424 [2024-11-26 19:18:37.046768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.424 qpair failed and we were unable to recover it. 00:32:20.424 [2024-11-26 19:18:37.046859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.424 [2024-11-26 19:18:37.047000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.424 [2024-11-26 19:18:37.047017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.424 qpair failed and we were unable to recover it. 00:32:20.424 [2024-11-26 19:18:37.047187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.424 [2024-11-26 19:18:37.047267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.424 [2024-11-26 19:18:37.047283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.424 qpair failed and we were unable to recover it. 00:32:20.424 [2024-11-26 19:18:37.047370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.424 [2024-11-26 19:18:37.047459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.424 [2024-11-26 19:18:37.047475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.424 qpair failed and we were unable to recover it. 00:32:20.424 [2024-11-26 19:18:37.047562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.424 [2024-11-26 19:18:37.047642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.424 [2024-11-26 19:18:37.047657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.424 qpair failed and we were unable to recover it. 00:32:20.424 [2024-11-26 19:18:37.047745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.424 [2024-11-26 19:18:37.047815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.424 [2024-11-26 19:18:37.047831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.424 qpair failed and we were unable to recover it. 00:32:20.425 [2024-11-26 19:18:37.047908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.425 [2024-11-26 19:18:37.047992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.425 [2024-11-26 19:18:37.048009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.425 qpair failed and we were unable to recover it. 00:32:20.425 [2024-11-26 19:18:37.048099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.425 [2024-11-26 19:18:37.048231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.425 [2024-11-26 19:18:37.048247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.425 qpair failed and we were unable to recover it. 00:32:20.425 [2024-11-26 19:18:37.048332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.425 [2024-11-26 19:18:37.048519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.425 [2024-11-26 19:18:37.048535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.425 qpair failed and we were unable to recover it. 00:32:20.425 [2024-11-26 19:18:37.048622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.425 [2024-11-26 19:18:37.048759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.425 [2024-11-26 19:18:37.048775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.425 qpair failed and we were unable to recover it. 00:32:20.425 [2024-11-26 19:18:37.048874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.425 [2024-11-26 19:18:37.049023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.425 [2024-11-26 19:18:37.049041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.425 qpair failed and we were unable to recover it. 00:32:20.425 [2024-11-26 19:18:37.049173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.425 [2024-11-26 19:18:37.049320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.425 [2024-11-26 19:18:37.049336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.425 qpair failed and we were unable to recover it. 00:32:20.425 [2024-11-26 19:18:37.049410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.425 [2024-11-26 19:18:37.049488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.425 [2024-11-26 19:18:37.049502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.425 qpair failed and we were unable to recover it. 00:32:20.425 [2024-11-26 19:18:37.049638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.425 [2024-11-26 19:18:37.049785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.425 [2024-11-26 19:18:37.049801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.425 qpair failed and we were unable to recover it. 00:32:20.425 [2024-11-26 19:18:37.049886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.425 [2024-11-26 19:18:37.049963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.425 [2024-11-26 19:18:37.049977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.425 qpair failed and we were unable to recover it. 00:32:20.425 [2024-11-26 19:18:37.050042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.425 [2024-11-26 19:18:37.050119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.425 [2024-11-26 19:18:37.050133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.425 qpair failed and we were unable to recover it. 00:32:20.425 [2024-11-26 19:18:37.050218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.425 [2024-11-26 19:18:37.050362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.425 [2024-11-26 19:18:37.050378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.425 qpair failed and we were unable to recover it. 00:32:20.425 [2024-11-26 19:18:37.050461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.425 [2024-11-26 19:18:37.050666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.425 [2024-11-26 19:18:37.050682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.425 qpair failed and we were unable to recover it. 00:32:20.425 [2024-11-26 19:18:37.050760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.425 [2024-11-26 19:18:37.050845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.425 [2024-11-26 19:18:37.050860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.425 qpair failed and we were unable to recover it. 00:32:20.425 [2024-11-26 19:18:37.051023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.425 [2024-11-26 19:18:37.051109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.425 [2024-11-26 19:18:37.051125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.425 qpair failed and we were unable to recover it. 00:32:20.425 [2024-11-26 19:18:37.051289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.425 [2024-11-26 19:18:37.051435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.425 [2024-11-26 19:18:37.051450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.425 qpair failed and we were unable to recover it. 00:32:20.425 [2024-11-26 19:18:37.051596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.425 [2024-11-26 19:18:37.051672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.425 [2024-11-26 19:18:37.051688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.425 qpair failed and we were unable to recover it. 00:32:20.425 [2024-11-26 19:18:37.051791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.425 [2024-11-26 19:18:37.051895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.425 [2024-11-26 19:18:37.051910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.425 qpair failed and we were unable to recover it. 00:32:20.425 [2024-11-26 19:18:37.052125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.425 [2024-11-26 19:18:37.052281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.425 [2024-11-26 19:18:37.052293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.425 qpair failed and we were unable to recover it. 00:32:20.425 [2024-11-26 19:18:37.052373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.425 [2024-11-26 19:18:37.052527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.425 [2024-11-26 19:18:37.052539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.425 qpair failed and we were unable to recover it. 00:32:20.425 [2024-11-26 19:18:37.052635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.425 [2024-11-26 19:18:37.052696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.425 [2024-11-26 19:18:37.052708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.425 qpair failed and we were unable to recover it. 00:32:20.425 [2024-11-26 19:18:37.052778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.425 [2024-11-26 19:18:37.052974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.425 [2024-11-26 19:18:37.052986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.425 qpair failed and we were unable to recover it. 00:32:20.425 [2024-11-26 19:18:37.053068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.425 [2024-11-26 19:18:37.053140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.425 [2024-11-26 19:18:37.053150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.425 qpair failed and we were unable to recover it. 00:32:20.425 [2024-11-26 19:18:37.053239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.425 [2024-11-26 19:18:37.053309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.425 [2024-11-26 19:18:37.053321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.425 qpair failed and we were unable to recover it. 00:32:20.425 [2024-11-26 19:18:37.053396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.425 [2024-11-26 19:18:37.053552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.426 [2024-11-26 19:18:37.053563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.426 qpair failed and we were unable to recover it. 00:32:20.426 [2024-11-26 19:18:37.053634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.426 [2024-11-26 19:18:37.053716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.426 [2024-11-26 19:18:37.053728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.426 qpair failed and we were unable to recover it. 00:32:20.426 [2024-11-26 19:18:37.053817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.426 [2024-11-26 19:18:37.053876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.426 [2024-11-26 19:18:37.053886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.426 qpair failed and we were unable to recover it. 00:32:20.426 [2024-11-26 19:18:37.053943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.426 [2024-11-26 19:18:37.054086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.426 [2024-11-26 19:18:37.054098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.426 qpair failed and we were unable to recover it. 00:32:20.426 [2024-11-26 19:18:37.054305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.426 [2024-11-26 19:18:37.054375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.426 [2024-11-26 19:18:37.054387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.426 qpair failed and we were unable to recover it. 00:32:20.426 [2024-11-26 19:18:37.054452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.426 [2024-11-26 19:18:37.054514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.426 [2024-11-26 19:18:37.054525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.426 qpair failed and we were unable to recover it. 00:32:20.426 [2024-11-26 19:18:37.054600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.426 [2024-11-26 19:18:37.054660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.426 [2024-11-26 19:18:37.054670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.426 qpair failed and we were unable to recover it. 00:32:20.426 [2024-11-26 19:18:37.054732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.426 [2024-11-26 19:18:37.054875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.426 [2024-11-26 19:18:37.054886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.426 qpair failed and we were unable to recover it. 00:32:20.426 [2024-11-26 19:18:37.054961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.426 [2024-11-26 19:18:37.055034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.426 [2024-11-26 19:18:37.055045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.426 qpair failed and we were unable to recover it. 00:32:20.426 [2024-11-26 19:18:37.055104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.426 [2024-11-26 19:18:37.055184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.426 [2024-11-26 19:18:37.055194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.426 qpair failed and we were unable to recover it. 00:32:20.426 [2024-11-26 19:18:37.055327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.426 [2024-11-26 19:18:37.055405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.426 [2024-11-26 19:18:37.055417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.426 qpair failed and we were unable to recover it. 00:32:20.426 [2024-11-26 19:18:37.055487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.426 [2024-11-26 19:18:37.055626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.426 [2024-11-26 19:18:37.055638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.426 qpair failed and we were unable to recover it. 00:32:20.426 [2024-11-26 19:18:37.055708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.426 [2024-11-26 19:18:37.055773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.426 [2024-11-26 19:18:37.055784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.426 qpair failed and we were unable to recover it. 00:32:20.426 [2024-11-26 19:18:37.055863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.426 [2024-11-26 19:18:37.056000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.426 [2024-11-26 19:18:37.056013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.426 qpair failed and we were unable to recover it. 00:32:20.426 [2024-11-26 19:18:37.056080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.426 [2024-11-26 19:18:37.056149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.426 [2024-11-26 19:18:37.056160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.426 qpair failed and we were unable to recover it. 00:32:20.426 [2024-11-26 19:18:37.056364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.426 [2024-11-26 19:18:37.056431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.426 [2024-11-26 19:18:37.056441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.426 qpair failed and we were unable to recover it. 00:32:20.426 [2024-11-26 19:18:37.056579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.426 [2024-11-26 19:18:37.056744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.426 [2024-11-26 19:18:37.056756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.426 qpair failed and we were unable to recover it. 00:32:20.426 [2024-11-26 19:18:37.056975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.426 [2024-11-26 19:18:37.057052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.426 [2024-11-26 19:18:37.057064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.426 qpair failed and we were unable to recover it. 00:32:20.426 [2024-11-26 19:18:37.057124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.426 [2024-11-26 19:18:37.057180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.426 [2024-11-26 19:18:37.057191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.426 qpair failed and we were unable to recover it. 00:32:20.426 [2024-11-26 19:18:37.057321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.427 [2024-11-26 19:18:37.057395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.427 [2024-11-26 19:18:37.057408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.427 qpair failed and we were unable to recover it. 00:32:20.427 [2024-11-26 19:18:37.057475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.427 [2024-11-26 19:18:37.057564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.427 [2024-11-26 19:18:37.057576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.427 qpair failed and we were unable to recover it. 00:32:20.427 [2024-11-26 19:18:37.057717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.427 [2024-11-26 19:18:37.057777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.427 [2024-11-26 19:18:37.057787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.427 qpair failed and we were unable to recover it. 00:32:20.427 [2024-11-26 19:18:37.057851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.427 [2024-11-26 19:18:37.057936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.427 [2024-11-26 19:18:37.057952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.427 qpair failed and we were unable to recover it. 00:32:20.427 [2024-11-26 19:18:37.058100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.427 [2024-11-26 19:18:37.058178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.427 [2024-11-26 19:18:37.058190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.427 qpair failed and we were unable to recover it. 00:32:20.427 [2024-11-26 19:18:37.058358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.427 [2024-11-26 19:18:37.058430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.427 [2024-11-26 19:18:37.058441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.427 qpair failed and we were unable to recover it. 00:32:20.427 [2024-11-26 19:18:37.058579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.427 [2024-11-26 19:18:37.058665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.427 [2024-11-26 19:18:37.058677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.427 qpair failed and we were unable to recover it. 00:32:20.427 [2024-11-26 19:18:37.058765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.427 [2024-11-26 19:18:37.058845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.427 [2024-11-26 19:18:37.058855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.427 qpair failed and we were unable to recover it. 00:32:20.427 [2024-11-26 19:18:37.058920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.427 [2024-11-26 19:18:37.059057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.427 [2024-11-26 19:18:37.059070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.427 qpair failed and we were unable to recover it. 00:32:20.427 [2024-11-26 19:18:37.059147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.427 [2024-11-26 19:18:37.059293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.427 [2024-11-26 19:18:37.059305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.427 qpair failed and we were unable to recover it. 00:32:20.427 [2024-11-26 19:18:37.059440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.427 [2024-11-26 19:18:37.059626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.427 [2024-11-26 19:18:37.059638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.427 qpair failed and we were unable to recover it. 00:32:20.427 [2024-11-26 19:18:37.059706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.427 [2024-11-26 19:18:37.059791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.427 [2024-11-26 19:18:37.059803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.427 qpair failed and we were unable to recover it. 00:32:20.427 [2024-11-26 19:18:37.059932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.427 [2024-11-26 19:18:37.060078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.427 [2024-11-26 19:18:37.060090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.427 qpair failed and we were unable to recover it. 00:32:20.427 [2024-11-26 19:18:37.060225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.427 [2024-11-26 19:18:37.060297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.427 [2024-11-26 19:18:37.060310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.427 qpair failed and we were unable to recover it. 00:32:20.427 [2024-11-26 19:18:37.060372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.427 [2024-11-26 19:18:37.060462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.427 [2024-11-26 19:18:37.060474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.427 qpair failed and we were unable to recover it. 00:32:20.427 [2024-11-26 19:18:37.060550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.427 [2024-11-26 19:18:37.060691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.427 [2024-11-26 19:18:37.060703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.427 qpair failed and we were unable to recover it. 00:32:20.427 [2024-11-26 19:18:37.060781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.427 [2024-11-26 19:18:37.060848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.427 [2024-11-26 19:18:37.060857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.427 qpair failed and we were unable to recover it. 00:32:20.427 [2024-11-26 19:18:37.060918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.427 [2024-11-26 19:18:37.060995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.427 [2024-11-26 19:18:37.061006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.427 qpair failed and we were unable to recover it. 00:32:20.427 [2024-11-26 19:18:37.061091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.427 [2024-11-26 19:18:37.061181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.427 [2024-11-26 19:18:37.061193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.427 qpair failed and we were unable to recover it. 00:32:20.427 [2024-11-26 19:18:37.061279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.427 [2024-11-26 19:18:37.061347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.427 [2024-11-26 19:18:37.061358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.427 qpair failed and we were unable to recover it. 00:32:20.427 [2024-11-26 19:18:37.061490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.427 [2024-11-26 19:18:37.061557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.427 [2024-11-26 19:18:37.061568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.427 qpair failed and we were unable to recover it. 00:32:20.427 [2024-11-26 19:18:37.061634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.427 [2024-11-26 19:18:37.061709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.427 [2024-11-26 19:18:37.061720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.427 qpair failed and we were unable to recover it. 00:32:20.427 [2024-11-26 19:18:37.061785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.427 [2024-11-26 19:18:37.061845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.427 [2024-11-26 19:18:37.061856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.427 qpair failed and we were unable to recover it. 00:32:20.427 [2024-11-26 19:18:37.061953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.427 [2024-11-26 19:18:37.062032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.427 [2024-11-26 19:18:37.062044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.428 qpair failed and we were unable to recover it. 00:32:20.428 [2024-11-26 19:18:37.062243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.428 [2024-11-26 19:18:37.062329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.428 [2024-11-26 19:18:37.062342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.428 qpair failed and we were unable to recover it. 00:32:20.428 [2024-11-26 19:18:37.062419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.428 [2024-11-26 19:18:37.062490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.428 [2024-11-26 19:18:37.062501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.428 qpair failed and we were unable to recover it. 00:32:20.428 [2024-11-26 19:18:37.062567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.428 [2024-11-26 19:18:37.062696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.428 [2024-11-26 19:18:37.062708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.428 qpair failed and we were unable to recover it. 00:32:20.428 [2024-11-26 19:18:37.062791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.428 [2024-11-26 19:18:37.062865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.428 [2024-11-26 19:18:37.062878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.428 qpair failed and we were unable to recover it. 00:32:20.428 [2024-11-26 19:18:37.062956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.428 [2024-11-26 19:18:37.063024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.428 [2024-11-26 19:18:37.063035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.428 qpair failed and we were unable to recover it. 00:32:20.428 [2024-11-26 19:18:37.063099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.428 [2024-11-26 19:18:37.063237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.428 [2024-11-26 19:18:37.063249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.428 qpair failed and we were unable to recover it. 00:32:20.428 [2024-11-26 19:18:37.063381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.428 [2024-11-26 19:18:37.063450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.428 [2024-11-26 19:18:37.063462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.428 qpair failed and we were unable to recover it. 00:32:20.428 [2024-11-26 19:18:37.063542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.428 [2024-11-26 19:18:37.063613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.428 [2024-11-26 19:18:37.063625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.428 qpair failed and we were unable to recover it. 00:32:20.428 [2024-11-26 19:18:37.063689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.428 [2024-11-26 19:18:37.063757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.428 [2024-11-26 19:18:37.063768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.428 qpair failed and we were unable to recover it. 00:32:20.428 [2024-11-26 19:18:37.063898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.428 [2024-11-26 19:18:37.063978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.428 [2024-11-26 19:18:37.063991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.428 qpair failed and we were unable to recover it. 00:32:20.428 [2024-11-26 19:18:37.064062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.428 [2024-11-26 19:18:37.064139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.428 [2024-11-26 19:18:37.064153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.428 qpair failed and we were unable to recover it. 00:32:20.428 [2024-11-26 19:18:37.064238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.428 [2024-11-26 19:18:37.064315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.428 [2024-11-26 19:18:37.064327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.428 qpair failed and we were unable to recover it. 00:32:20.428 [2024-11-26 19:18:37.064395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.428 [2024-11-26 19:18:37.064524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.428 [2024-11-26 19:18:37.064536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.428 qpair failed and we were unable to recover it. 00:32:20.428 [2024-11-26 19:18:37.064620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.428 [2024-11-26 19:18:37.064690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.428 [2024-11-26 19:18:37.064700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.428 qpair failed and we were unable to recover it. 00:32:20.428 [2024-11-26 19:18:37.064763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.428 [2024-11-26 19:18:37.064820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.428 [2024-11-26 19:18:37.064831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.428 qpair failed and we were unable to recover it. 00:32:20.428 [2024-11-26 19:18:37.064911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.428 [2024-11-26 19:18:37.065074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.428 [2024-11-26 19:18:37.065086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.428 qpair failed and we were unable to recover it. 00:32:20.428 [2024-11-26 19:18:37.065229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.428 [2024-11-26 19:18:37.065369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.428 [2024-11-26 19:18:37.065381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.428 qpair failed and we were unable to recover it. 00:32:20.428 [2024-11-26 19:18:37.065517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.428 [2024-11-26 19:18:37.065590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.428 [2024-11-26 19:18:37.065602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.428 qpair failed and we were unable to recover it. 00:32:20.428 [2024-11-26 19:18:37.065678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.428 [2024-11-26 19:18:37.065744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.428 [2024-11-26 19:18:37.065757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.428 qpair failed and we were unable to recover it. 00:32:20.428 [2024-11-26 19:18:37.065830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.428 [2024-11-26 19:18:37.065894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.428 [2024-11-26 19:18:37.065904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.428 qpair failed and we were unable to recover it. 00:32:20.428 [2024-11-26 19:18:37.066034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.428 [2024-11-26 19:18:37.066117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.428 [2024-11-26 19:18:37.066132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.428 qpair failed and we were unable to recover it. 00:32:20.428 [2024-11-26 19:18:37.066193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.428 [2024-11-26 19:18:37.066258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.428 [2024-11-26 19:18:37.066269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.428 qpair failed and we were unable to recover it. 00:32:20.428 [2024-11-26 19:18:37.066471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.429 [2024-11-26 19:18:37.066604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.429 [2024-11-26 19:18:37.066615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.429 qpair failed and we were unable to recover it. 00:32:20.429 [2024-11-26 19:18:37.066696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.429 [2024-11-26 19:18:37.066769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.429 [2024-11-26 19:18:37.066781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.429 qpair failed and we were unable to recover it. 00:32:20.429 [2024-11-26 19:18:37.066849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.429 [2024-11-26 19:18:37.066982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.429 [2024-11-26 19:18:37.066994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.429 qpair failed and we were unable to recover it. 00:32:20.429 [2024-11-26 19:18:37.067057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.429 [2024-11-26 19:18:37.067149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.429 [2024-11-26 19:18:37.067161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.429 qpair failed and we were unable to recover it. 00:32:20.429 [2024-11-26 19:18:37.067252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.429 [2024-11-26 19:18:37.067393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.429 [2024-11-26 19:18:37.067405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.429 qpair failed and we were unable to recover it. 00:32:20.429 [2024-11-26 19:18:37.067487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.429 [2024-11-26 19:18:37.067614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.429 [2024-11-26 19:18:37.067627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.429 qpair failed and we were unable to recover it. 00:32:20.429 [2024-11-26 19:18:37.067695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.429 [2024-11-26 19:18:37.067794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.429 [2024-11-26 19:18:37.067807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.429 qpair failed and we were unable to recover it. 00:32:20.429 [2024-11-26 19:18:37.067877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.429 [2024-11-26 19:18:37.067955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.429 [2024-11-26 19:18:37.067968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.429 qpair failed and we were unable to recover it. 00:32:20.429 [2024-11-26 19:18:37.068102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.429 [2024-11-26 19:18:37.068236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.429 [2024-11-26 19:18:37.068249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.429 qpair failed and we were unable to recover it. 00:32:20.429 [2024-11-26 19:18:37.068318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.429 [2024-11-26 19:18:37.068516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.429 [2024-11-26 19:18:37.068527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.429 qpair failed and we were unable to recover it. 00:32:20.429 [2024-11-26 19:18:37.068662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.429 [2024-11-26 19:18:37.068745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.429 [2024-11-26 19:18:37.068757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.429 qpair failed and we were unable to recover it. 00:32:20.429 [2024-11-26 19:18:37.068899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.429 [2024-11-26 19:18:37.069055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.429 [2024-11-26 19:18:37.069068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.429 qpair failed and we were unable to recover it. 00:32:20.429 [2024-11-26 19:18:37.069159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.429 [2024-11-26 19:18:37.069234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.429 [2024-11-26 19:18:37.069246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.429 qpair failed and we were unable to recover it. 00:32:20.429 [2024-11-26 19:18:37.069325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.429 [2024-11-26 19:18:37.069402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.429 [2024-11-26 19:18:37.069414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.429 qpair failed and we were unable to recover it. 00:32:20.429 [2024-11-26 19:18:37.069582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.429 [2024-11-26 19:18:37.069660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.429 [2024-11-26 19:18:37.069679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.429 qpair failed and we were unable to recover it. 00:32:20.429 [2024-11-26 19:18:37.069751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.429 [2024-11-26 19:18:37.069817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.429 [2024-11-26 19:18:37.069827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.429 qpair failed and we were unable to recover it. 00:32:20.429 [2024-11-26 19:18:37.069965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.429 [2024-11-26 19:18:37.070028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.429 [2024-11-26 19:18:37.070039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.429 qpair failed and we were unable to recover it. 00:32:20.429 [2024-11-26 19:18:37.070112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.429 [2024-11-26 19:18:37.070188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.429 [2024-11-26 19:18:37.070199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.429 qpair failed and we were unable to recover it. 00:32:20.429 [2024-11-26 19:18:37.070277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.429 [2024-11-26 19:18:37.070342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.429 [2024-11-26 19:18:37.070353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.429 qpair failed and we were unable to recover it. 00:32:20.429 [2024-11-26 19:18:37.070439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.429 [2024-11-26 19:18:37.070518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.429 [2024-11-26 19:18:37.070529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.429 qpair failed and we were unable to recover it. 00:32:20.429 [2024-11-26 19:18:37.070660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.429 [2024-11-26 19:18:37.070727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.429 [2024-11-26 19:18:37.070739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.429 qpair failed and we were unable to recover it. 00:32:20.429 [2024-11-26 19:18:37.070827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.429 [2024-11-26 19:18:37.071042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.429 [2024-11-26 19:18:37.071054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.429 qpair failed and we were unable to recover it. 00:32:20.429 [2024-11-26 19:18:37.071116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.429 [2024-11-26 19:18:37.071174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.429 [2024-11-26 19:18:37.071185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.429 qpair failed and we were unable to recover it. 00:32:20.429 [2024-11-26 19:18:37.071312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.429 [2024-11-26 19:18:37.071452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.429 [2024-11-26 19:18:37.071464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.429 qpair failed and we were unable to recover it. 00:32:20.430 [2024-11-26 19:18:37.071540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.430 [2024-11-26 19:18:37.071673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.430 [2024-11-26 19:18:37.071684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.430 qpair failed and we were unable to recover it. 00:32:20.430 [2024-11-26 19:18:37.071763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.430 [2024-11-26 19:18:37.071907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.430 [2024-11-26 19:18:37.071919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.430 qpair failed and we were unable to recover it. 00:32:20.430 [2024-11-26 19:18:37.071993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.430 [2024-11-26 19:18:37.072123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.430 [2024-11-26 19:18:37.072135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.430 qpair failed and we were unable to recover it. 00:32:20.430 [2024-11-26 19:18:37.072211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.430 [2024-11-26 19:18:37.072282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.430 [2024-11-26 19:18:37.072293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.430 qpair failed and we were unable to recover it. 00:32:20.430 [2024-11-26 19:18:37.072381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.430 [2024-11-26 19:18:37.072514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.430 [2024-11-26 19:18:37.072526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.430 qpair failed and we were unable to recover it. 00:32:20.430 [2024-11-26 19:18:37.072657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.430 [2024-11-26 19:18:37.072736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.430 [2024-11-26 19:18:37.072748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.430 qpair failed and we were unable to recover it. 00:32:20.430 [2024-11-26 19:18:37.072823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.430 [2024-11-26 19:18:37.072904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.430 [2024-11-26 19:18:37.072916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.430 qpair failed and we were unable to recover it. 00:32:20.430 [2024-11-26 19:18:37.072986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.430 [2024-11-26 19:18:37.073117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.430 [2024-11-26 19:18:37.073129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.430 qpair failed and we were unable to recover it. 00:32:20.430 [2024-11-26 19:18:37.073204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.430 [2024-11-26 19:18:37.073275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.430 [2024-11-26 19:18:37.073286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.430 qpair failed and we were unable to recover it. 00:32:20.430 [2024-11-26 19:18:37.073350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.430 [2024-11-26 19:18:37.073411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.430 [2024-11-26 19:18:37.073423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.430 qpair failed and we were unable to recover it. 00:32:20.430 [2024-11-26 19:18:37.073557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.430 [2024-11-26 19:18:37.073643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.430 [2024-11-26 19:18:37.073654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.430 qpair failed and we were unable to recover it. 00:32:20.430 [2024-11-26 19:18:37.073719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.430 [2024-11-26 19:18:37.073853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.430 [2024-11-26 19:18:37.073865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.430 qpair failed and we were unable to recover it. 00:32:20.430 [2024-11-26 19:18:37.073928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.430 [2024-11-26 19:18:37.073995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.430 [2024-11-26 19:18:37.074007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.430 qpair failed and we were unable to recover it. 00:32:20.430 [2024-11-26 19:18:37.074090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.430 [2024-11-26 19:18:37.074157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.430 [2024-11-26 19:18:37.074168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.430 qpair failed and we were unable to recover it. 00:32:20.430 [2024-11-26 19:18:37.074234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.430 [2024-11-26 19:18:37.074306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.430 [2024-11-26 19:18:37.074319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.430 qpair failed and we were unable to recover it. 00:32:20.430 [2024-11-26 19:18:37.074384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.430 [2024-11-26 19:18:37.074444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.430 [2024-11-26 19:18:37.074456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.430 qpair failed and we were unable to recover it. 00:32:20.430 [2024-11-26 19:18:37.074516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.430 [2024-11-26 19:18:37.074711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.430 [2024-11-26 19:18:37.074723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.430 qpair failed and we were unable to recover it. 00:32:20.430 [2024-11-26 19:18:37.074797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.430 [2024-11-26 19:18:37.074882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.430 [2024-11-26 19:18:37.074894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.430 qpair failed and we were unable to recover it. 00:32:20.430 [2024-11-26 19:18:37.075027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.430 [2024-11-26 19:18:37.075170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.430 [2024-11-26 19:18:37.075182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.430 qpair failed and we were unable to recover it. 00:32:20.430 [2024-11-26 19:18:37.075245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.430 [2024-11-26 19:18:37.075307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.430 [2024-11-26 19:18:37.075318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.430 qpair failed and we were unable to recover it. 00:32:20.430 [2024-11-26 19:18:37.075398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.431 [2024-11-26 19:18:37.075524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.431 [2024-11-26 19:18:37.075536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.431 qpair failed and we were unable to recover it. 00:32:20.431 [2024-11-26 19:18:37.075691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.431 [2024-11-26 19:18:37.075781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.431 [2024-11-26 19:18:37.075793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.431 qpair failed and we were unable to recover it. 00:32:20.431 [2024-11-26 19:18:37.075871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.431 [2024-11-26 19:18:37.076019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.431 [2024-11-26 19:18:37.076032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.431 qpair failed and we were unable to recover it. 00:32:20.431 [2024-11-26 19:18:37.076125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.431 [2024-11-26 19:18:37.076271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.431 [2024-11-26 19:18:37.076283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.431 qpair failed and we were unable to recover it. 00:32:20.431 [2024-11-26 19:18:37.076459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.431 [2024-11-26 19:18:37.076535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.431 [2024-11-26 19:18:37.076546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.431 qpair failed and we were unable to recover it. 00:32:20.431 [2024-11-26 19:18:37.076703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.431 [2024-11-26 19:18:37.076774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.431 [2024-11-26 19:18:37.076786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.431 qpair failed and we were unable to recover it. 00:32:20.431 [2024-11-26 19:18:37.076855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.431 [2024-11-26 19:18:37.077019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.431 [2024-11-26 19:18:37.077031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.431 qpair failed and we were unable to recover it. 00:32:20.431 [2024-11-26 19:18:37.077130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.431 [2024-11-26 19:18:37.077189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.431 [2024-11-26 19:18:37.077200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.431 qpair failed and we were unable to recover it. 00:32:20.431 [2024-11-26 19:18:37.077276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.431 [2024-11-26 19:18:37.077358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.431 [2024-11-26 19:18:37.077369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.431 qpair failed and we were unable to recover it. 00:32:20.431 [2024-11-26 19:18:37.077435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.431 [2024-11-26 19:18:37.077584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.431 [2024-11-26 19:18:37.077597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.431 qpair failed and we were unable to recover it. 00:32:20.431 [2024-11-26 19:18:37.077729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.431 [2024-11-26 19:18:37.077817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.431 [2024-11-26 19:18:37.077828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.431 qpair failed and we were unable to recover it. 00:32:20.431 [2024-11-26 19:18:37.077906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.431 [2024-11-26 19:18:37.078047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.431 [2024-11-26 19:18:37.078060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.431 qpair failed and we were unable to recover it. 00:32:20.431 [2024-11-26 19:18:37.078133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.431 [2024-11-26 19:18:37.078225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.431 [2024-11-26 19:18:37.078236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.431 qpair failed and we were unable to recover it. 00:32:20.431 [2024-11-26 19:18:37.078304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.431 [2024-11-26 19:18:37.078433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.431 [2024-11-26 19:18:37.078444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.431 qpair failed and we were unable to recover it. 00:32:20.431 [2024-11-26 19:18:37.078528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.431 [2024-11-26 19:18:37.078603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.431 [2024-11-26 19:18:37.078615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.431 qpair failed and we were unable to recover it. 00:32:20.431 [2024-11-26 19:18:37.078679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.431 [2024-11-26 19:18:37.078834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.431 [2024-11-26 19:18:37.078846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.431 qpair failed and we were unable to recover it. 00:32:20.431 [2024-11-26 19:18:37.078931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.431 [2024-11-26 19:18:37.079069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.431 [2024-11-26 19:18:37.079080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.431 qpair failed and we were unable to recover it. 00:32:20.431 [2024-11-26 19:18:37.079213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.431 [2024-11-26 19:18:37.079289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.431 [2024-11-26 19:18:37.079301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.431 qpair failed and we were unable to recover it. 00:32:20.431 [2024-11-26 19:18:37.079390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.431 [2024-11-26 19:18:37.079455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.431 [2024-11-26 19:18:37.079466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.431 qpair failed and we were unable to recover it. 00:32:20.431 [2024-11-26 19:18:37.079528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.431 [2024-11-26 19:18:37.079594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.431 [2024-11-26 19:18:37.079606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.431 qpair failed and we were unable to recover it. 00:32:20.431 [2024-11-26 19:18:37.079753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.432 [2024-11-26 19:18:37.079819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.432 [2024-11-26 19:18:37.079830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.432 qpair failed and we were unable to recover it. 00:32:20.432 [2024-11-26 19:18:37.079896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.432 [2024-11-26 19:18:37.079986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.432 [2024-11-26 19:18:37.079998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.432 qpair failed and we were unable to recover it. 00:32:20.432 [2024-11-26 19:18:37.080220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.432 [2024-11-26 19:18:37.080294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.432 [2024-11-26 19:18:37.080305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.432 qpair failed and we were unable to recover it. 00:32:20.432 [2024-11-26 19:18:37.080543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.432 [2024-11-26 19:18:37.080624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.432 [2024-11-26 19:18:37.080635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.432 qpair failed and we were unable to recover it. 00:32:20.432 [2024-11-26 19:18:37.080831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.432 [2024-11-26 19:18:37.080962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.432 [2024-11-26 19:18:37.080974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.432 qpair failed and we were unable to recover it. 00:32:20.432 [2024-11-26 19:18:37.081227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.432 [2024-11-26 19:18:37.081306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.432 [2024-11-26 19:18:37.081319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.432 qpair failed and we were unable to recover it. 00:32:20.432 [2024-11-26 19:18:37.081488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.432 [2024-11-26 19:18:37.081567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.432 [2024-11-26 19:18:37.081579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.432 qpair failed and we were unable to recover it. 00:32:20.432 [2024-11-26 19:18:37.081715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.432 [2024-11-26 19:18:37.081812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.432 [2024-11-26 19:18:37.081823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.432 qpair failed and we were unable to recover it. 00:32:20.432 [2024-11-26 19:18:37.081974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.432 [2024-11-26 19:18:37.082140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.432 [2024-11-26 19:18:37.082151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.432 qpair failed and we were unable to recover it. 00:32:20.432 [2024-11-26 19:18:37.082346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.432 [2024-11-26 19:18:37.082541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.432 [2024-11-26 19:18:37.082552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.432 qpair failed and we were unable to recover it. 00:32:20.432 [2024-11-26 19:18:37.082622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.432 [2024-11-26 19:18:37.082750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.432 [2024-11-26 19:18:37.082761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.432 qpair failed and we were unable to recover it. 00:32:20.432 [2024-11-26 19:18:37.082890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.432 [2024-11-26 19:18:37.082957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.432 [2024-11-26 19:18:37.082970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.432 qpair failed and we were unable to recover it. 00:32:20.432 [2024-11-26 19:18:37.083106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.432 [2024-11-26 19:18:37.083180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.432 [2024-11-26 19:18:37.083192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.432 qpair failed and we were unable to recover it. 00:32:20.432 [2024-11-26 19:18:37.083320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.432 [2024-11-26 19:18:37.083393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.432 [2024-11-26 19:18:37.083404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.432 qpair failed and we were unable to recover it. 00:32:20.432 [2024-11-26 19:18:37.083542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.432 [2024-11-26 19:18:37.083628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.432 [2024-11-26 19:18:37.083639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.432 qpair failed and we were unable to recover it. 00:32:20.432 [2024-11-26 19:18:37.083734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.432 [2024-11-26 19:18:37.083867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.432 [2024-11-26 19:18:37.083879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.432 qpair failed and we were unable to recover it. 00:32:20.432 [2024-11-26 19:18:37.083968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.433 [2024-11-26 19:18:37.084118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.433 [2024-11-26 19:18:37.084129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.433 qpair failed and we were unable to recover it. 00:32:20.433 [2024-11-26 19:18:37.084288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.433 [2024-11-26 19:18:37.084429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.433 [2024-11-26 19:18:37.084440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.433 qpair failed and we were unable to recover it. 00:32:20.433 [2024-11-26 19:18:37.084527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.433 [2024-11-26 19:18:37.084688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.433 [2024-11-26 19:18:37.084699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.433 qpair failed and we were unable to recover it. 00:32:20.433 [2024-11-26 19:18:37.084833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.433 [2024-11-26 19:18:37.084902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.433 [2024-11-26 19:18:37.084913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.433 qpair failed and we were unable to recover it. 00:32:20.433 [2024-11-26 19:18:37.084989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.433 [2024-11-26 19:18:37.085064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.433 [2024-11-26 19:18:37.085076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.433 qpair failed and we were unable to recover it. 00:32:20.433 [2024-11-26 19:18:37.085151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.433 [2024-11-26 19:18:37.085305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.433 [2024-11-26 19:18:37.085338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.433 qpair failed and we were unable to recover it. 00:32:20.433 [2024-11-26 19:18:37.085456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.433 [2024-11-26 19:18:37.085649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.433 [2024-11-26 19:18:37.085681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.433 qpair failed and we were unable to recover it. 00:32:20.433 [2024-11-26 19:18:37.085858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.433 [2024-11-26 19:18:37.086047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.433 [2024-11-26 19:18:37.086060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.433 qpair failed and we were unable to recover it. 00:32:20.433 [2024-11-26 19:18:37.086189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.433 [2024-11-26 19:18:37.086265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.433 [2024-11-26 19:18:37.086276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.433 qpair failed and we were unable to recover it. 00:32:20.433 [2024-11-26 19:18:37.086424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.433 [2024-11-26 19:18:37.086597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.433 [2024-11-26 19:18:37.086628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.433 qpair failed and we were unable to recover it. 00:32:20.433 [2024-11-26 19:18:37.086761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.433 [2024-11-26 19:18:37.086988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.433 [2024-11-26 19:18:37.086999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.433 qpair failed and we were unable to recover it. 00:32:20.433 [2024-11-26 19:18:37.087076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.433 [2024-11-26 19:18:37.087223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.433 [2024-11-26 19:18:37.087235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.433 qpair failed and we were unable to recover it. 00:32:20.433 [2024-11-26 19:18:37.087321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.433 [2024-11-26 19:18:37.087479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.433 [2024-11-26 19:18:37.087490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.433 qpair failed and we were unable to recover it. 00:32:20.433 [2024-11-26 19:18:37.087566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.433 [2024-11-26 19:18:37.087696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.433 [2024-11-26 19:18:37.087708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.433 qpair failed and we were unable to recover it. 00:32:20.433 [2024-11-26 19:18:37.087802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.433 [2024-11-26 19:18:37.087877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.433 [2024-11-26 19:18:37.087889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.433 qpair failed and we were unable to recover it. 00:32:20.433 [2024-11-26 19:18:37.087985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.433 [2024-11-26 19:18:37.088160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.433 [2024-11-26 19:18:37.088192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.433 qpair failed and we were unable to recover it. 00:32:20.433 [2024-11-26 19:18:37.088320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.433 [2024-11-26 19:18:37.088450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.433 [2024-11-26 19:18:37.088480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.433 qpair failed and we were unable to recover it. 00:32:20.433 [2024-11-26 19:18:37.088600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.433 [2024-11-26 19:18:37.088697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.433 [2024-11-26 19:18:37.088727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.433 qpair failed and we were unable to recover it. 00:32:20.433 [2024-11-26 19:18:37.088841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.433 [2024-11-26 19:18:37.088937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.433 [2024-11-26 19:18:37.088983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.433 qpair failed and we were unable to recover it. 00:32:20.433 [2024-11-26 19:18:37.089220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.433 [2024-11-26 19:18:37.089356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.433 [2024-11-26 19:18:37.089388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.433 qpair failed and we were unable to recover it. 00:32:20.433 [2024-11-26 19:18:37.089506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.433 [2024-11-26 19:18:37.089620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.433 [2024-11-26 19:18:37.089651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.433 qpair failed and we were unable to recover it. 00:32:20.433 [2024-11-26 19:18:37.089822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.434 [2024-11-26 19:18:37.090004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.434 [2024-11-26 19:18:37.090016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.434 qpair failed and we were unable to recover it. 00:32:20.434 [2024-11-26 19:18:37.090161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.434 [2024-11-26 19:18:37.090298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.434 [2024-11-26 19:18:37.090309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.434 qpair failed and we were unable to recover it. 00:32:20.434 [2024-11-26 19:18:37.090488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.434 [2024-11-26 19:18:37.090606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.434 [2024-11-26 19:18:37.090636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.434 qpair failed and we were unable to recover it. 00:32:20.434 [2024-11-26 19:18:37.090771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.434 [2024-11-26 19:18:37.090936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.434 [2024-11-26 19:18:37.090979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.434 qpair failed and we were unable to recover it. 00:32:20.434 [2024-11-26 19:18:37.091149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.434 [2024-11-26 19:18:37.091226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.434 [2024-11-26 19:18:37.091238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.434 qpair failed and we were unable to recover it. 00:32:20.434 [2024-11-26 19:18:37.091320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.434 [2024-11-26 19:18:37.091403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.434 [2024-11-26 19:18:37.091414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.434 qpair failed and we were unable to recover it. 00:32:20.434 [2024-11-26 19:18:37.091544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.434 [2024-11-26 19:18:37.091609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.434 [2024-11-26 19:18:37.091620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.434 qpair failed and we were unable to recover it. 00:32:20.434 [2024-11-26 19:18:37.091710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.434 [2024-11-26 19:18:37.091877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.434 [2024-11-26 19:18:37.091888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.434 qpair failed and we were unable to recover it. 00:32:20.434 [2024-11-26 19:18:37.092093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.434 [2024-11-26 19:18:37.092318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.434 [2024-11-26 19:18:37.092331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.434 qpair failed and we were unable to recover it. 00:32:20.434 [2024-11-26 19:18:37.092406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.434 [2024-11-26 19:18:37.092503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.434 [2024-11-26 19:18:37.092514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.434 qpair failed and we were unable to recover it. 00:32:20.434 [2024-11-26 19:18:37.092650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.434 [2024-11-26 19:18:37.092739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.434 [2024-11-26 19:18:37.092751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.434 qpair failed and we were unable to recover it. 00:32:20.434 [2024-11-26 19:18:37.092881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.434 [2024-11-26 19:18:37.092950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.434 [2024-11-26 19:18:37.092963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.434 qpair failed and we were unable to recover it. 00:32:20.434 [2024-11-26 19:18:37.093122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.434 [2024-11-26 19:18:37.093192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.434 [2024-11-26 19:18:37.093204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.434 qpair failed and we were unable to recover it. 00:32:20.434 [2024-11-26 19:18:37.093397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.434 [2024-11-26 19:18:37.093464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.434 [2024-11-26 19:18:37.093474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.434 qpair failed and we were unable to recover it. 00:32:20.434 [2024-11-26 19:18:37.093608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.434 [2024-11-26 19:18:37.093759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.434 [2024-11-26 19:18:37.093771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.434 qpair failed and we were unable to recover it. 00:32:20.434 [2024-11-26 19:18:37.093843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.434 [2024-11-26 19:18:37.093988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.434 [2024-11-26 19:18:37.094023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.434 qpair failed and we were unable to recover it. 00:32:20.434 [2024-11-26 19:18:37.094129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.434 [2024-11-26 19:18:37.094298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.434 [2024-11-26 19:18:37.094329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.434 qpair failed and we were unable to recover it. 00:32:20.434 [2024-11-26 19:18:37.094437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.434 [2024-11-26 19:18:37.094558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.434 [2024-11-26 19:18:37.094589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.434 qpair failed and we were unable to recover it. 00:32:20.434 [2024-11-26 19:18:37.094773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.434 [2024-11-26 19:18:37.094877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.434 [2024-11-26 19:18:37.094909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.434 qpair failed and we were unable to recover it. 00:32:20.434 [2024-11-26 19:18:37.095096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.434 [2024-11-26 19:18:37.095224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.434 [2024-11-26 19:18:37.095261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.434 qpair failed and we were unable to recover it. 00:32:20.434 [2024-11-26 19:18:37.095328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.434 [2024-11-26 19:18:37.095385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.434 [2024-11-26 19:18:37.095395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.434 qpair failed and we were unable to recover it. 00:32:20.434 [2024-11-26 19:18:37.095488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.434 [2024-11-26 19:18:37.095555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.435 [2024-11-26 19:18:37.095567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.435 qpair failed and we were unable to recover it. 00:32:20.435 [2024-11-26 19:18:37.095714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.435 [2024-11-26 19:18:37.095860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.435 [2024-11-26 19:18:37.095872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.435 qpair failed and we were unable to recover it. 00:32:20.435 [2024-11-26 19:18:37.095965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.435 [2024-11-26 19:18:37.096061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.435 [2024-11-26 19:18:37.096073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.435 qpair failed and we were unable to recover it. 00:32:20.435 [2024-11-26 19:18:37.096206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.435 [2024-11-26 19:18:37.096266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.435 [2024-11-26 19:18:37.096278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.435 qpair failed and we were unable to recover it. 00:32:20.435 [2024-11-26 19:18:37.096359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.435 [2024-11-26 19:18:37.096422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.435 [2024-11-26 19:18:37.096432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.435 qpair failed and we were unable to recover it. 00:32:20.435 [2024-11-26 19:18:37.096494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.435 [2024-11-26 19:18:37.096555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.435 [2024-11-26 19:18:37.096565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.435 qpair failed and we were unable to recover it. 00:32:20.435 [2024-11-26 19:18:37.096635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.435 [2024-11-26 19:18:37.096708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.435 [2024-11-26 19:18:37.096738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.435 qpair failed and we were unable to recover it. 00:32:20.435 [2024-11-26 19:18:37.096930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.435 [2024-11-26 19:18:37.097147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.435 [2024-11-26 19:18:37.097159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.435 qpair failed and we were unable to recover it. 00:32:20.435 [2024-11-26 19:18:37.097322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.435 [2024-11-26 19:18:37.097462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.435 [2024-11-26 19:18:37.097474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.435 qpair failed and we were unable to recover it. 00:32:20.435 [2024-11-26 19:18:37.097615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.435 [2024-11-26 19:18:37.097743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.435 [2024-11-26 19:18:37.097755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.435 qpair failed and we were unable to recover it. 00:32:20.435 [2024-11-26 19:18:37.097968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.435 [2024-11-26 19:18:37.098098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.435 [2024-11-26 19:18:37.098129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.435 qpair failed and we were unable to recover it. 00:32:20.435 [2024-11-26 19:18:37.098311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.435 [2024-11-26 19:18:37.098429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.435 [2024-11-26 19:18:37.098440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.435 qpair failed and we were unable to recover it. 00:32:20.435 [2024-11-26 19:18:37.098512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.435 [2024-11-26 19:18:37.098589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.435 [2024-11-26 19:18:37.098601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.435 qpair failed and we were unable to recover it. 00:32:20.435 [2024-11-26 19:18:37.098684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.435 [2024-11-26 19:18:37.098760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.435 [2024-11-26 19:18:37.098771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.435 qpair failed and we were unable to recover it. 00:32:20.435 [2024-11-26 19:18:37.098912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.435 [2024-11-26 19:18:37.098976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.435 [2024-11-26 19:18:37.098987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.435 qpair failed and we were unable to recover it. 00:32:20.435 [2024-11-26 19:18:37.099062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.435 [2024-11-26 19:18:37.099135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.435 [2024-11-26 19:18:37.099146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.435 qpair failed and we were unable to recover it. 00:32:20.435 [2024-11-26 19:18:37.099238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.435 [2024-11-26 19:18:37.099308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.435 [2024-11-26 19:18:37.099320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.435 qpair failed and we were unable to recover it. 00:32:20.435 [2024-11-26 19:18:37.099477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.435 [2024-11-26 19:18:37.099669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.435 [2024-11-26 19:18:37.099707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.435 qpair failed and we were unable to recover it. 00:32:20.435 [2024-11-26 19:18:37.099827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.435 [2024-11-26 19:18:37.099945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.435 [2024-11-26 19:18:37.099984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.435 qpair failed and we were unable to recover it. 00:32:20.435 [2024-11-26 19:18:37.100103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.435 [2024-11-26 19:18:37.100304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.435 [2024-11-26 19:18:37.100335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.435 qpair failed and we were unable to recover it. 00:32:20.435 [2024-11-26 19:18:37.100537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.435 [2024-11-26 19:18:37.100706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.435 [2024-11-26 19:18:37.100736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.435 qpair failed and we were unable to recover it. 00:32:20.435 [2024-11-26 19:18:37.100928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.435 [2024-11-26 19:18:37.101039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.435 [2024-11-26 19:18:37.101072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.435 qpair failed and we were unable to recover it. 00:32:20.435 [2024-11-26 19:18:37.101260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.435 [2024-11-26 19:18:37.101371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.435 [2024-11-26 19:18:37.101402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.435 qpair failed and we were unable to recover it. 00:32:20.435 [2024-11-26 19:18:37.101516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.435 [2024-11-26 19:18:37.101744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.435 [2024-11-26 19:18:37.101776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.436 qpair failed and we were unable to recover it. 00:32:20.436 [2024-11-26 19:18:37.101967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.436 [2024-11-26 19:18:37.102170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.436 [2024-11-26 19:18:37.102201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.436 qpair failed and we were unable to recover it. 00:32:20.436 [2024-11-26 19:18:37.102376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.436 [2024-11-26 19:18:37.102589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.436 [2024-11-26 19:18:37.102621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.436 qpair failed and we were unable to recover it. 00:32:20.436 [2024-11-26 19:18:37.102801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.436 [2024-11-26 19:18:37.102915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.436 [2024-11-26 19:18:37.102956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.436 qpair failed and we were unable to recover it. 00:32:20.436 [2024-11-26 19:18:37.103204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.436 [2024-11-26 19:18:37.103322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.436 [2024-11-26 19:18:37.103359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.436 qpair failed and we were unable to recover it. 00:32:20.436 [2024-11-26 19:18:37.103628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.436 [2024-11-26 19:18:37.103806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.436 [2024-11-26 19:18:37.103837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.436 qpair failed and we were unable to recover it. 00:32:20.436 [2024-11-26 19:18:37.104028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.436 [2024-11-26 19:18:37.104132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.436 [2024-11-26 19:18:37.104164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.436 qpair failed and we were unable to recover it. 00:32:20.436 [2024-11-26 19:18:37.104342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.436 [2024-11-26 19:18:37.104473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.436 [2024-11-26 19:18:37.104498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.436 qpair failed and we were unable to recover it. 00:32:20.436 [2024-11-26 19:18:37.104732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.436 [2024-11-26 19:18:37.104899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.436 [2024-11-26 19:18:37.104930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.436 qpair failed and we were unable to recover it. 00:32:20.436 [2024-11-26 19:18:37.105066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.436 [2024-11-26 19:18:37.105185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.436 [2024-11-26 19:18:37.105197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.436 qpair failed and we were unable to recover it. 00:32:20.436 [2024-11-26 19:18:37.105409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.436 [2024-11-26 19:18:37.105503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.436 [2024-11-26 19:18:37.105534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.436 qpair failed and we were unable to recover it. 00:32:20.436 [2024-11-26 19:18:37.105724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.436 [2024-11-26 19:18:37.105834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.436 [2024-11-26 19:18:37.105866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.436 qpair failed and we were unable to recover it. 00:32:20.436 [2024-11-26 19:18:37.105979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.436 [2024-11-26 19:18:37.106160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.436 [2024-11-26 19:18:37.106191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.436 qpair failed and we were unable to recover it. 00:32:20.436 [2024-11-26 19:18:37.106365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.436 [2024-11-26 19:18:37.106501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.436 [2024-11-26 19:18:37.106531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.436 qpair failed and we were unable to recover it. 00:32:20.436 [2024-11-26 19:18:37.106646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.436 [2024-11-26 19:18:37.106907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.436 [2024-11-26 19:18:37.106944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.436 qpair failed and we were unable to recover it. 00:32:20.436 [2024-11-26 19:18:37.107136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.436 [2024-11-26 19:18:37.107295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.436 [2024-11-26 19:18:37.107307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.436 qpair failed and we were unable to recover it. 00:32:20.436 [2024-11-26 19:18:37.107396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.436 [2024-11-26 19:18:37.107481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.436 [2024-11-26 19:18:37.107492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.436 qpair failed and we were unable to recover it. 00:32:20.436 [2024-11-26 19:18:37.107640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.436 [2024-11-26 19:18:37.107756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.436 [2024-11-26 19:18:37.107787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.436 qpair failed and we were unable to recover it. 00:32:20.436 [2024-11-26 19:18:37.107994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.436 [2024-11-26 19:18:37.108190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.436 [2024-11-26 19:18:37.108203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.436 qpair failed and we were unable to recover it. 00:32:20.436 [2024-11-26 19:18:37.108348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.436 [2024-11-26 19:18:37.108490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.436 [2024-11-26 19:18:37.108501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.436 qpair failed and we were unable to recover it. 00:32:20.437 [2024-11-26 19:18:37.108597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.437 [2024-11-26 19:18:37.108664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.437 [2024-11-26 19:18:37.108676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.437 qpair failed and we were unable to recover it. 00:32:20.437 [2024-11-26 19:18:37.108850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.437 [2024-11-26 19:18:37.109039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.437 [2024-11-26 19:18:37.109051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.437 qpair failed and we were unable to recover it. 00:32:20.437 [2024-11-26 19:18:37.109124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.437 [2024-11-26 19:18:37.109194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.437 [2024-11-26 19:18:37.109205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.437 qpair failed and we were unable to recover it. 00:32:20.437 [2024-11-26 19:18:37.109404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.437 [2024-11-26 19:18:37.109497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.437 [2024-11-26 19:18:37.109508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.437 qpair failed and we were unable to recover it. 00:32:20.437 [2024-11-26 19:18:37.109638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.437 [2024-11-26 19:18:37.109719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.437 [2024-11-26 19:18:37.109730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.437 qpair failed and we were unable to recover it. 00:32:20.437 [2024-11-26 19:18:37.109870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.437 [2024-11-26 19:18:37.110021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.437 [2024-11-26 19:18:37.110032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.437 qpair failed and we were unable to recover it. 00:32:20.437 [2024-11-26 19:18:37.110170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.437 [2024-11-26 19:18:37.110302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.437 [2024-11-26 19:18:37.110314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.437 qpair failed and we were unable to recover it. 00:32:20.437 [2024-11-26 19:18:37.110401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.437 [2024-11-26 19:18:37.110465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.437 [2024-11-26 19:18:37.110477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.437 qpair failed and we were unable to recover it. 00:32:20.437 [2024-11-26 19:18:37.110607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.437 [2024-11-26 19:18:37.110741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.437 [2024-11-26 19:18:37.110753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.437 qpair failed and we were unable to recover it. 00:32:20.437 [2024-11-26 19:18:37.110823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.437 [2024-11-26 19:18:37.110944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.437 [2024-11-26 19:18:37.110958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.437 qpair failed and we were unable to recover it. 00:32:20.437 [2024-11-26 19:18:37.111030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.437 [2024-11-26 19:18:37.111118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.437 [2024-11-26 19:18:37.111129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.437 qpair failed and we were unable to recover it. 00:32:20.437 [2024-11-26 19:18:37.111188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.437 [2024-11-26 19:18:37.111256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.437 [2024-11-26 19:18:37.111266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.437 qpair failed and we were unable to recover it. 00:32:20.437 [2024-11-26 19:18:37.111534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.437 [2024-11-26 19:18:37.111594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.437 [2024-11-26 19:18:37.111605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.437 qpair failed and we were unable to recover it. 00:32:20.437 [2024-11-26 19:18:37.111836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.437 [2024-11-26 19:18:37.111905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.437 [2024-11-26 19:18:37.111918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.437 qpair failed and we were unable to recover it. 00:32:20.437 [2024-11-26 19:18:37.112085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.437 [2024-11-26 19:18:37.112173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.437 [2024-11-26 19:18:37.112185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.437 qpair failed and we were unable to recover it. 00:32:20.437 [2024-11-26 19:18:37.112336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.437 [2024-11-26 19:18:37.112467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.437 [2024-11-26 19:18:37.112479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.437 qpair failed and we were unable to recover it. 00:32:20.437 [2024-11-26 19:18:37.112549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.437 [2024-11-26 19:18:37.112633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.437 [2024-11-26 19:18:37.112644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.437 qpair failed and we were unable to recover it. 00:32:20.437 [2024-11-26 19:18:37.112712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.437 [2024-11-26 19:18:37.112856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.437 [2024-11-26 19:18:37.112867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.437 qpair failed and we were unable to recover it. 00:32:20.437 [2024-11-26 19:18:37.112954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.437 [2024-11-26 19:18:37.113091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.437 [2024-11-26 19:18:37.113102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.437 qpair failed and we were unable to recover it. 00:32:20.437 [2024-11-26 19:18:37.113234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.437 [2024-11-26 19:18:37.113310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.437 [2024-11-26 19:18:37.113321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.437 qpair failed and we were unable to recover it. 00:32:20.437 [2024-11-26 19:18:37.113449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.437 [2024-11-26 19:18:37.113592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.438 [2024-11-26 19:18:37.113603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.438 qpair failed and we were unable to recover it. 00:32:20.438 [2024-11-26 19:18:37.113687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.438 [2024-11-26 19:18:37.113755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.438 [2024-11-26 19:18:37.113768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.438 qpair failed and we were unable to recover it. 00:32:20.438 [2024-11-26 19:18:37.113849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.438 [2024-11-26 19:18:37.113969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.438 [2024-11-26 19:18:37.114002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.438 qpair failed and we were unable to recover it. 00:32:20.438 [2024-11-26 19:18:37.114105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.438 [2024-11-26 19:18:37.114214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.438 [2024-11-26 19:18:37.114245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.438 qpair failed and we were unable to recover it. 00:32:20.438 [2024-11-26 19:18:37.114425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.438 [2024-11-26 19:18:37.114547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.438 [2024-11-26 19:18:37.114578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.438 qpair failed and we were unable to recover it. 00:32:20.438 [2024-11-26 19:18:37.114707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.438 [2024-11-26 19:18:37.114823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.438 [2024-11-26 19:18:37.114855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.438 qpair failed and we were unable to recover it. 00:32:20.438 [2024-11-26 19:18:37.114967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.438 [2024-11-26 19:18:37.115138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.438 [2024-11-26 19:18:37.115170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.438 qpair failed and we were unable to recover it. 00:32:20.438 [2024-11-26 19:18:37.115285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.438 [2024-11-26 19:18:37.115375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.438 [2024-11-26 19:18:37.115386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.438 qpair failed and we were unable to recover it. 00:32:20.438 [2024-11-26 19:18:37.115466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.438 [2024-11-26 19:18:37.115665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.438 [2024-11-26 19:18:37.115697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.438 qpair failed and we were unable to recover it. 00:32:20.438 [2024-11-26 19:18:37.115808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.438 [2024-11-26 19:18:37.115942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.438 [2024-11-26 19:18:37.116024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.438 qpair failed and we were unable to recover it. 00:32:20.438 [2024-11-26 19:18:37.116160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.438 [2024-11-26 19:18:37.116236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.438 [2024-11-26 19:18:37.116248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.438 qpair failed and we were unable to recover it. 00:32:20.438 [2024-11-26 19:18:37.116322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.438 [2024-11-26 19:18:37.116382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.438 [2024-11-26 19:18:37.116392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.438 qpair failed and we were unable to recover it. 00:32:20.438 [2024-11-26 19:18:37.116524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.438 [2024-11-26 19:18:37.116714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.438 [2024-11-26 19:18:37.116745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.438 qpair failed and we were unable to recover it. 00:32:20.438 [2024-11-26 19:18:37.116870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.438 [2024-11-26 19:18:37.116984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.438 [2024-11-26 19:18:37.117018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.438 qpair failed and we were unable to recover it. 00:32:20.438 [2024-11-26 19:18:37.117134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.438 [2024-11-26 19:18:37.117378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.438 [2024-11-26 19:18:37.117410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.438 qpair failed and we were unable to recover it. 00:32:20.438 [2024-11-26 19:18:37.117495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.438 [2024-11-26 19:18:37.117622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.438 [2024-11-26 19:18:37.117633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.438 qpair failed and we were unable to recover it. 00:32:20.438 [2024-11-26 19:18:37.117717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.438 [2024-11-26 19:18:37.117774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.438 [2024-11-26 19:18:37.117784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.438 qpair failed and we were unable to recover it. 00:32:20.438 [2024-11-26 19:18:37.117866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.438 [2024-11-26 19:18:37.117962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.438 [2024-11-26 19:18:37.117975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.438 qpair failed and we were unable to recover it. 00:32:20.438 [2024-11-26 19:18:37.118060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.438 [2024-11-26 19:18:37.118193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.438 [2024-11-26 19:18:37.118224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.438 qpair failed and we were unable to recover it. 00:32:20.439 [2024-11-26 19:18:37.118327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.439 [2024-11-26 19:18:37.118497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.439 [2024-11-26 19:18:37.118527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.439 qpair failed and we were unable to recover it. 00:32:20.439 [2024-11-26 19:18:37.118638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.439 [2024-11-26 19:18:37.118766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.439 [2024-11-26 19:18:37.118796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.439 qpair failed and we were unable to recover it. 00:32:20.439 [2024-11-26 19:18:37.118910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.439 [2024-11-26 19:18:37.119078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.439 [2024-11-26 19:18:37.119090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.439 qpair failed and we were unable to recover it. 00:32:20.439 [2024-11-26 19:18:37.119255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.439 [2024-11-26 19:18:37.119434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.439 [2024-11-26 19:18:37.119465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.439 qpair failed and we were unable to recover it. 00:32:20.439 [2024-11-26 19:18:37.119707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.439 [2024-11-26 19:18:37.119892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.439 [2024-11-26 19:18:37.119924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.439 qpair failed and we were unable to recover it. 00:32:20.439 [2024-11-26 19:18:37.120227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.439 [2024-11-26 19:18:37.120370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.439 [2024-11-26 19:18:37.120402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.439 qpair failed and we were unable to recover it. 00:32:20.439 [2024-11-26 19:18:37.120679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.439 [2024-11-26 19:18:37.120975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.439 [2024-11-26 19:18:37.121007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.439 qpair failed and we were unable to recover it. 00:32:20.439 [2024-11-26 19:18:37.121136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.439 [2024-11-26 19:18:37.121271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.439 [2024-11-26 19:18:37.121303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.439 qpair failed and we were unable to recover it. 00:32:20.439 [2024-11-26 19:18:37.121485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.439 [2024-11-26 19:18:37.121582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.439 [2024-11-26 19:18:37.121614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.439 qpair failed and we were unable to recover it. 00:32:20.439 [2024-11-26 19:18:37.121795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.439 [2024-11-26 19:18:37.121900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.439 [2024-11-26 19:18:37.121934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.439 qpair failed and we were unable to recover it. 00:32:20.439 [2024-11-26 19:18:37.122115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.439 [2024-11-26 19:18:37.122257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.439 [2024-11-26 19:18:37.122269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.439 qpair failed and we were unable to recover it. 00:32:20.439 [2024-11-26 19:18:37.122409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.439 [2024-11-26 19:18:37.122552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.439 [2024-11-26 19:18:37.122584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.439 qpair failed and we were unable to recover it. 00:32:20.439 [2024-11-26 19:18:37.122756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.439 [2024-11-26 19:18:37.123037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.439 [2024-11-26 19:18:37.123070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.439 qpair failed and we were unable to recover it. 00:32:20.439 [2024-11-26 19:18:37.123170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.439 [2024-11-26 19:18:37.123313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.439 [2024-11-26 19:18:37.123325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.439 qpair failed and we were unable to recover it. 00:32:20.439 [2024-11-26 19:18:37.123465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.439 [2024-11-26 19:18:37.123603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.439 [2024-11-26 19:18:37.123615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.439 qpair failed and we were unable to recover it. 00:32:20.439 [2024-11-26 19:18:37.123757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.439 [2024-11-26 19:18:37.123909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.439 [2024-11-26 19:18:37.123920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.439 qpair failed and we were unable to recover it. 00:32:20.439 [2024-11-26 19:18:37.124054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.439 [2024-11-26 19:18:37.124133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.439 [2024-11-26 19:18:37.124144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.439 qpair failed and we were unable to recover it. 00:32:20.439 [2024-11-26 19:18:37.124268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.439 [2024-11-26 19:18:37.124377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.439 [2024-11-26 19:18:37.124407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.439 qpair failed and we were unable to recover it. 00:32:20.439 [2024-11-26 19:18:37.124533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.439 [2024-11-26 19:18:37.124659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.439 [2024-11-26 19:18:37.124691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.439 qpair failed and we were unable to recover it. 00:32:20.439 [2024-11-26 19:18:37.124805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.439 [2024-11-26 19:18:37.124907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.439 [2024-11-26 19:18:37.124938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.439 qpair failed and we were unable to recover it. 00:32:20.439 [2024-11-26 19:18:37.125181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.439 [2024-11-26 19:18:37.125242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.439 [2024-11-26 19:18:37.125253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.439 qpair failed and we were unable to recover it. 00:32:20.439 [2024-11-26 19:18:37.125345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.439 [2024-11-26 19:18:37.125516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.439 [2024-11-26 19:18:37.125546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.439 qpair failed and we were unable to recover it. 00:32:20.439 [2024-11-26 19:18:37.125731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.440 [2024-11-26 19:18:37.125845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.440 [2024-11-26 19:18:37.125876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.440 qpair failed and we were unable to recover it. 00:32:20.440 [2024-11-26 19:18:37.125993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.440 [2024-11-26 19:18:37.126115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.440 [2024-11-26 19:18:37.126148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.440 qpair failed and we were unable to recover it. 00:32:20.440 [2024-11-26 19:18:37.126391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.440 [2024-11-26 19:18:37.126510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.440 [2024-11-26 19:18:37.126541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.440 qpair failed and we were unable to recover it. 00:32:20.440 [2024-11-26 19:18:37.126730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.440 [2024-11-26 19:18:37.126832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.440 [2024-11-26 19:18:37.126863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.440 qpair failed and we were unable to recover it. 00:32:20.440 [2024-11-26 19:18:37.126988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.440 [2024-11-26 19:18:37.127164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.440 [2024-11-26 19:18:37.127194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.440 qpair failed and we were unable to recover it. 00:32:20.440 [2024-11-26 19:18:37.127393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.440 [2024-11-26 19:18:37.127585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.440 [2024-11-26 19:18:37.127607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.440 qpair failed and we were unable to recover it. 00:32:20.440 [2024-11-26 19:18:37.127743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.440 [2024-11-26 19:18:37.127807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.440 [2024-11-26 19:18:37.127818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.440 qpair failed and we were unable to recover it. 00:32:20.440 [2024-11-26 19:18:37.127897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.440 [2024-11-26 19:18:37.127970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.440 [2024-11-26 19:18:37.127998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.440 qpair failed and we were unable to recover it. 00:32:20.440 [2024-11-26 19:18:37.128064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.440 [2024-11-26 19:18:37.128206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.440 [2024-11-26 19:18:37.128218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.440 qpair failed and we were unable to recover it. 00:32:20.440 [2024-11-26 19:18:37.128314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.440 [2024-11-26 19:18:37.128506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.440 [2024-11-26 19:18:37.128536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.440 qpair failed and we were unable to recover it. 00:32:20.440 [2024-11-26 19:18:37.128640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.440 [2024-11-26 19:18:37.128840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.440 [2024-11-26 19:18:37.128870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.440 qpair failed and we were unable to recover it. 00:32:20.440 [2024-11-26 19:18:37.129002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.440 [2024-11-26 19:18:37.129189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.440 [2024-11-26 19:18:37.129200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.440 qpair failed and we were unable to recover it. 00:32:20.440 [2024-11-26 19:18:37.129331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.440 [2024-11-26 19:18:37.129518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.440 [2024-11-26 19:18:37.129549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.440 qpair failed and we were unable to recover it. 00:32:20.440 [2024-11-26 19:18:37.129816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.440 [2024-11-26 19:18:37.129934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.440 [2024-11-26 19:18:37.129975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:20.440 qpair failed and we were unable to recover it. 00:32:20.440 [2024-11-26 19:18:37.130140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.440 [2024-11-26 19:18:37.130390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.440 [2024-11-26 19:18:37.130430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.440 qpair failed and we were unable to recover it. 00:32:20.440 [2024-11-26 19:18:37.130713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.440 [2024-11-26 19:18:37.130854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.440 [2024-11-26 19:18:37.130887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.440 qpair failed and we were unable to recover it. 00:32:20.440 [2024-11-26 19:18:37.131033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.440 [2024-11-26 19:18:37.131165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.440 [2024-11-26 19:18:37.131196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.440 qpair failed and we were unable to recover it. 00:32:20.440 [2024-11-26 19:18:37.131382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.440 [2024-11-26 19:18:37.131602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.440 [2024-11-26 19:18:37.131634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.440 qpair failed and we were unable to recover it. 00:32:20.440 [2024-11-26 19:18:37.131826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.440 [2024-11-26 19:18:37.131942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.440 [2024-11-26 19:18:37.131988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.440 qpair failed and we were unable to recover it. 00:32:20.440 [2024-11-26 19:18:37.132175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.440 [2024-11-26 19:18:37.132322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.440 [2024-11-26 19:18:37.132338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.440 qpair failed and we were unable to recover it. 00:32:20.440 [2024-11-26 19:18:37.132499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.440 [2024-11-26 19:18:37.132578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.440 [2024-11-26 19:18:37.132596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.440 qpair failed and we were unable to recover it. 00:32:20.440 [2024-11-26 19:18:37.132804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.440 [2024-11-26 19:18:37.132994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.440 [2024-11-26 19:18:37.133028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.440 qpair failed and we were unable to recover it. 00:32:20.440 [2024-11-26 19:18:37.133274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.440 [2024-11-26 19:18:37.133454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.441 [2024-11-26 19:18:37.133485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.441 qpair failed and we were unable to recover it. 00:32:20.441 [2024-11-26 19:18:37.133771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.441 [2024-11-26 19:18:37.134014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.441 [2024-11-26 19:18:37.134062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.441 qpair failed and we were unable to recover it. 00:32:20.441 [2024-11-26 19:18:37.134256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.441 [2024-11-26 19:18:37.134455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.441 [2024-11-26 19:18:37.134471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.441 qpair failed and we were unable to recover it. 00:32:20.441 [2024-11-26 19:18:37.134615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.441 [2024-11-26 19:18:37.134766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.441 [2024-11-26 19:18:37.134795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.441 qpair failed and we were unable to recover it. 00:32:20.441 [2024-11-26 19:18:37.134916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.441 [2024-11-26 19:18:37.135049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.441 [2024-11-26 19:18:37.135081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.441 qpair failed and we were unable to recover it. 00:32:20.441 [2024-11-26 19:18:37.135254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.441 [2024-11-26 19:18:37.135401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.441 [2024-11-26 19:18:37.135432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.441 qpair failed and we were unable to recover it. 00:32:20.441 [2024-11-26 19:18:37.135553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.441 [2024-11-26 19:18:37.135765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.441 [2024-11-26 19:18:37.135797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.441 qpair failed and we were unable to recover it. 00:32:20.441 [2024-11-26 19:18:37.135922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.441 [2024-11-26 19:18:37.136096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.441 [2024-11-26 19:18:37.136128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.441 qpair failed and we were unable to recover it. 00:32:20.441 [2024-11-26 19:18:37.136367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.441 [2024-11-26 19:18:37.136482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.441 [2024-11-26 19:18:37.136497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.441 qpair failed and we were unable to recover it. 00:32:20.441 [2024-11-26 19:18:37.136651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.441 [2024-11-26 19:18:37.136810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.441 [2024-11-26 19:18:37.136826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.441 qpair failed and we were unable to recover it. 00:32:20.441 [2024-11-26 19:18:37.136903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.441 [2024-11-26 19:18:37.137099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.441 [2024-11-26 19:18:37.137133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.441 qpair failed and we were unable to recover it. 00:32:20.441 [2024-11-26 19:18:37.137239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.441 [2024-11-26 19:18:37.137364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.441 [2024-11-26 19:18:37.137396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.441 qpair failed and we were unable to recover it. 00:32:20.441 [2024-11-26 19:18:37.137585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.441 [2024-11-26 19:18:37.137756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.441 [2024-11-26 19:18:37.137795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.441 qpair failed and we were unable to recover it. 00:32:20.441 [2024-11-26 19:18:37.137929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.441 [2024-11-26 19:18:37.138052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.441 [2024-11-26 19:18:37.138085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.441 qpair failed and we were unable to recover it. 00:32:20.441 [2024-11-26 19:18:37.138189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.441 [2024-11-26 19:18:37.138455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.441 [2024-11-26 19:18:37.138487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.441 qpair failed and we were unable to recover it. 00:32:20.441 [2024-11-26 19:18:37.138604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.441 [2024-11-26 19:18:37.138833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.441 [2024-11-26 19:18:37.138866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.441 qpair failed and we were unable to recover it. 00:32:20.441 [2024-11-26 19:18:37.139072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.441 [2024-11-26 19:18:37.139312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.441 [2024-11-26 19:18:37.139328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.441 qpair failed and we were unable to recover it. 00:32:20.441 [2024-11-26 19:18:37.139460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.441 [2024-11-26 19:18:37.139538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.441 [2024-11-26 19:18:37.139553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.441 qpair failed and we were unable to recover it. 00:32:20.441 [2024-11-26 19:18:37.139651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.441 [2024-11-26 19:18:37.139852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.441 [2024-11-26 19:18:37.139884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.441 qpair failed and we were unable to recover it. 00:32:20.441 [2024-11-26 19:18:37.140064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.441 [2024-11-26 19:18:37.140239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.441 [2024-11-26 19:18:37.140272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.441 qpair failed and we were unable to recover it. 00:32:20.441 [2024-11-26 19:18:37.140455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.441 [2024-11-26 19:18:37.140574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.441 [2024-11-26 19:18:37.140615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.441 qpair failed and we were unable to recover it. 00:32:20.441 [2024-11-26 19:18:37.140821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.441 [2024-11-26 19:18:37.140930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.441 [2024-11-26 19:18:37.140985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.441 qpair failed and we were unable to recover it. 00:32:20.441 [2024-11-26 19:18:37.141164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.441 [2024-11-26 19:18:37.141348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.441 [2024-11-26 19:18:37.141380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.441 qpair failed and we were unable to recover it. 00:32:20.442 [2024-11-26 19:18:37.141587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.442 [2024-11-26 19:18:37.141758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.442 [2024-11-26 19:18:37.141775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.442 qpair failed and we were unable to recover it. 00:32:20.442 [2024-11-26 19:18:37.141960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.442 [2024-11-26 19:18:37.142218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.442 [2024-11-26 19:18:37.142249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.442 qpair failed and we were unable to recover it. 00:32:20.442 [2024-11-26 19:18:37.142360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.442 [2024-11-26 19:18:37.142506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.442 [2024-11-26 19:18:37.142522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.442 qpair failed and we were unable to recover it. 00:32:20.442 [2024-11-26 19:18:37.142666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.442 [2024-11-26 19:18:37.142737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.442 [2024-11-26 19:18:37.142752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.442 qpair failed and we were unable to recover it. 00:32:20.442 [2024-11-26 19:18:37.143004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.442 [2024-11-26 19:18:37.143225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.442 [2024-11-26 19:18:37.143241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.442 qpair failed and we were unable to recover it. 00:32:20.442 [2024-11-26 19:18:37.143404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.442 [2024-11-26 19:18:37.143493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.442 [2024-11-26 19:18:37.143508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.442 qpair failed and we were unable to recover it. 00:32:20.442 [2024-11-26 19:18:37.143591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.442 [2024-11-26 19:18:37.143729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.442 [2024-11-26 19:18:37.143759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.442 qpair failed and we were unable to recover it. 00:32:20.442 [2024-11-26 19:18:37.143965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.442 [2024-11-26 19:18:37.144092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.442 [2024-11-26 19:18:37.144133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.442 qpair failed and we were unable to recover it. 00:32:20.442 [2024-11-26 19:18:37.144291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.442 [2024-11-26 19:18:37.144511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.442 [2024-11-26 19:18:37.144543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.442 qpair failed and we were unable to recover it. 00:32:20.442 [2024-11-26 19:18:37.144837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.442 [2024-11-26 19:18:37.144970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.442 [2024-11-26 19:18:37.145004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.442 qpair failed and we were unable to recover it. 00:32:20.442 [2024-11-26 19:18:37.145199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.442 [2024-11-26 19:18:37.145317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.442 [2024-11-26 19:18:37.145349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.442 qpair failed and we were unable to recover it. 00:32:20.442 [2024-11-26 19:18:37.145614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.442 [2024-11-26 19:18:37.145714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.442 [2024-11-26 19:18:37.145748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.442 qpair failed and we were unable to recover it. 00:32:20.442 [2024-11-26 19:18:37.145880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.442 [2024-11-26 19:18:37.145997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.442 [2024-11-26 19:18:37.146029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.442 qpair failed and we were unable to recover it. 00:32:20.442 [2024-11-26 19:18:37.146230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.442 [2024-11-26 19:18:37.146345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.442 [2024-11-26 19:18:37.146377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.442 qpair failed and we were unable to recover it. 00:32:20.442 [2024-11-26 19:18:37.146563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.442 [2024-11-26 19:18:37.146714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.442 [2024-11-26 19:18:37.146731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.442 qpair failed and we were unable to recover it. 00:32:20.442 [2024-11-26 19:18:37.146825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.442 [2024-11-26 19:18:37.146970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.442 [2024-11-26 19:18:37.146987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.442 qpair failed and we were unable to recover it. 00:32:20.442 [2024-11-26 19:18:37.147088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.442 [2024-11-26 19:18:37.147176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.442 [2024-11-26 19:18:37.147191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.442 qpair failed and we were unable to recover it. 00:32:20.442 [2024-11-26 19:18:37.147281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.442 [2024-11-26 19:18:37.147375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.442 [2024-11-26 19:18:37.147391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.442 qpair failed and we were unable to recover it. 00:32:20.442 [2024-11-26 19:18:37.147561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.442 [2024-11-26 19:18:37.147652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.442 [2024-11-26 19:18:37.147667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.442 qpair failed and we were unable to recover it. 00:32:20.442 [2024-11-26 19:18:37.147823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.442 [2024-11-26 19:18:37.147897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.442 [2024-11-26 19:18:37.147914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.442 qpair failed and we were unable to recover it. 00:32:20.442 [2024-11-26 19:18:37.148012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.442 [2024-11-26 19:18:37.148097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.442 [2024-11-26 19:18:37.148113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.442 qpair failed and we were unable to recover it. 00:32:20.442 [2024-11-26 19:18:37.148200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.442 [2024-11-26 19:18:37.148267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.442 [2024-11-26 19:18:37.148281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.442 qpair failed and we were unable to recover it. 00:32:20.443 [2024-11-26 19:18:37.148371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.443 [2024-11-26 19:18:37.148451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.443 [2024-11-26 19:18:37.148465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.443 qpair failed and we were unable to recover it. 00:32:20.443 [2024-11-26 19:18:37.148609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.443 [2024-11-26 19:18:37.148840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.443 [2024-11-26 19:18:37.148856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.443 qpair failed and we were unable to recover it. 00:32:20.443 [2024-11-26 19:18:37.148946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.443 [2024-11-26 19:18:37.149022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.443 [2024-11-26 19:18:37.149037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.443 qpair failed and we were unable to recover it. 00:32:20.443 [2024-11-26 19:18:37.149115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.443 [2024-11-26 19:18:37.149203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.443 [2024-11-26 19:18:37.149219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.443 qpair failed and we were unable to recover it. 00:32:20.443 [2024-11-26 19:18:37.149300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.443 [2024-11-26 19:18:37.149450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.443 [2024-11-26 19:18:37.149480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.443 qpair failed and we were unable to recover it. 00:32:20.443 [2024-11-26 19:18:37.149652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.443 [2024-11-26 19:18:37.149818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.443 [2024-11-26 19:18:37.149851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.443 qpair failed and we were unable to recover it. 00:32:20.443 [2024-11-26 19:18:37.149990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.443 [2024-11-26 19:18:37.150094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.443 [2024-11-26 19:18:37.150126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.443 qpair failed and we were unable to recover it. 00:32:20.443 [2024-11-26 19:18:37.150245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.443 [2024-11-26 19:18:37.150459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.443 [2024-11-26 19:18:37.150491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.443 qpair failed and we were unable to recover it. 00:32:20.443 [2024-11-26 19:18:37.150668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.443 [2024-11-26 19:18:37.150785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.443 [2024-11-26 19:18:37.150817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.443 qpair failed and we were unable to recover it. 00:32:20.443 [2024-11-26 19:18:37.150961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.443 [2024-11-26 19:18:37.151140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.443 [2024-11-26 19:18:37.151172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.443 qpair failed and we were unable to recover it. 00:32:20.443 [2024-11-26 19:18:37.151307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.443 [2024-11-26 19:18:37.151406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.443 [2024-11-26 19:18:37.151421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.443 qpair failed and we were unable to recover it. 00:32:20.443 [2024-11-26 19:18:37.151561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.443 [2024-11-26 19:18:37.151633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.443 [2024-11-26 19:18:37.151648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.443 qpair failed and we were unable to recover it. 00:32:20.443 [2024-11-26 19:18:37.151741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.443 [2024-11-26 19:18:37.151899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.443 [2024-11-26 19:18:37.151929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.443 qpair failed and we were unable to recover it. 00:32:20.443 [2024-11-26 19:18:37.152086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.443 [2024-11-26 19:18:37.152314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.443 [2024-11-26 19:18:37.152346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.443 qpair failed and we were unable to recover it. 00:32:20.443 [2024-11-26 19:18:37.152544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.443 [2024-11-26 19:18:37.152723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.443 [2024-11-26 19:18:37.152738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.443 qpair failed and we were unable to recover it. 00:32:20.443 [2024-11-26 19:18:37.152988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.443 [2024-11-26 19:18:37.153170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.443 [2024-11-26 19:18:37.153186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.443 qpair failed and we were unable to recover it. 00:32:20.443 [2024-11-26 19:18:37.153279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.443 [2024-11-26 19:18:37.153441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.443 [2024-11-26 19:18:37.153473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.443 qpair failed and we were unable to recover it. 00:32:20.443 [2024-11-26 19:18:37.153646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.443 [2024-11-26 19:18:37.153883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.443 [2024-11-26 19:18:37.153914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.443 qpair failed and we were unable to recover it. 00:32:20.443 [2024-11-26 19:18:37.154037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.443 [2024-11-26 19:18:37.154154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.443 [2024-11-26 19:18:37.154192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.443 qpair failed and we were unable to recover it. 00:32:20.443 [2024-11-26 19:18:37.154346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.443 [2024-11-26 19:18:37.154444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.443 [2024-11-26 19:18:37.154460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.443 qpair failed and we were unable to recover it. 00:32:20.443 [2024-11-26 19:18:37.154629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.443 [2024-11-26 19:18:37.154765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.443 [2024-11-26 19:18:37.154781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.443 qpair failed and we were unable to recover it. 00:32:20.443 [2024-11-26 19:18:37.154937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.443 [2024-11-26 19:18:37.155142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.443 [2024-11-26 19:18:37.155173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.443 qpair failed and we were unable to recover it. 00:32:20.443 [2024-11-26 19:18:37.155283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.443 [2024-11-26 19:18:37.155451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.444 [2024-11-26 19:18:37.155483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.444 qpair failed and we were unable to recover it. 00:32:20.444 [2024-11-26 19:18:37.155691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.444 [2024-11-26 19:18:37.155878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.444 [2024-11-26 19:18:37.155911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.444 qpair failed and we were unable to recover it. 00:32:20.444 [2024-11-26 19:18:37.156105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.444 [2024-11-26 19:18:37.156233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.444 [2024-11-26 19:18:37.156249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.444 qpair failed and we were unable to recover it. 00:32:20.444 [2024-11-26 19:18:37.156404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.444 [2024-11-26 19:18:37.156625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.444 [2024-11-26 19:18:37.156656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.444 qpair failed and we were unable to recover it. 00:32:20.444 [2024-11-26 19:18:37.156811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.444 [2024-11-26 19:18:37.156942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.444 [2024-11-26 19:18:37.156998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.444 qpair failed and we were unable to recover it. 00:32:20.444 [2024-11-26 19:18:37.157220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.444 [2024-11-26 19:18:37.157340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.444 [2024-11-26 19:18:37.157371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.444 qpair failed and we were unable to recover it. 00:32:20.444 [2024-11-26 19:18:37.157560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.444 [2024-11-26 19:18:37.157781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.444 [2024-11-26 19:18:37.157818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.444 qpair failed and we were unable to recover it. 00:32:20.444 [2024-11-26 19:18:37.157944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.444 [2024-11-26 19:18:37.158074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.444 [2024-11-26 19:18:37.158105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.444 qpair failed and we were unable to recover it. 00:32:20.444 [2024-11-26 19:18:37.158218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.444 [2024-11-26 19:18:37.158419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.444 [2024-11-26 19:18:37.158436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.444 qpair failed and we were unable to recover it. 00:32:20.444 [2024-11-26 19:18:37.158573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.444 [2024-11-26 19:18:37.158718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.444 [2024-11-26 19:18:37.158734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.444 qpair failed and we were unable to recover it. 00:32:20.444 [2024-11-26 19:18:37.158871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.444 [2024-11-26 19:18:37.159024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.444 [2024-11-26 19:18:37.159040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.444 qpair failed and we were unable to recover it. 00:32:20.444 [2024-11-26 19:18:37.159125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.444 [2024-11-26 19:18:37.159207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.444 [2024-11-26 19:18:37.159224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.444 qpair failed and we were unable to recover it. 00:32:20.444 [2024-11-26 19:18:37.159375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.444 [2024-11-26 19:18:37.159543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.444 [2024-11-26 19:18:37.159576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.444 qpair failed and we were unable to recover it. 00:32:20.444 [2024-11-26 19:18:37.159820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.444 [2024-11-26 19:18:37.159925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.444 [2024-11-26 19:18:37.159966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.444 qpair failed and we were unable to recover it. 00:32:20.444 [2024-11-26 19:18:37.160085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.444 [2024-11-26 19:18:37.160344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.444 [2024-11-26 19:18:37.160387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.444 qpair failed and we were unable to recover it. 00:32:20.444 [2024-11-26 19:18:37.160470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.444 [2024-11-26 19:18:37.160565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.444 [2024-11-26 19:18:37.160581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.444 qpair failed and we were unable to recover it. 00:32:20.444 [2024-11-26 19:18:37.160791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.444 [2024-11-26 19:18:37.160941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.444 [2024-11-26 19:18:37.160982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.444 qpair failed and we were unable to recover it. 00:32:20.444 [2024-11-26 19:18:37.161137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.444 [2024-11-26 19:18:37.161281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.444 [2024-11-26 19:18:37.161297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.444 qpair failed and we were unable to recover it. 00:32:20.444 [2024-11-26 19:18:37.161385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.444 [2024-11-26 19:18:37.161592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.444 [2024-11-26 19:18:37.161607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.444 qpair failed and we were unable to recover it. 00:32:20.444 [2024-11-26 19:18:37.161773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.444 [2024-11-26 19:18:37.161858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.444 [2024-11-26 19:18:37.161874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.444 qpair failed and we were unable to recover it. 00:32:20.445 [2024-11-26 19:18:37.161981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.445 [2024-11-26 19:18:37.162068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.445 [2024-11-26 19:18:37.162084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.445 qpair failed and we were unable to recover it. 00:32:20.445 [2024-11-26 19:18:37.162182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.445 [2024-11-26 19:18:37.162269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.445 [2024-11-26 19:18:37.162284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.445 qpair failed and we were unable to recover it. 00:32:20.445 [2024-11-26 19:18:37.162420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.445 [2024-11-26 19:18:37.162496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.445 [2024-11-26 19:18:37.162511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.445 qpair failed and we were unable to recover it. 00:32:20.445 [2024-11-26 19:18:37.162581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.445 [2024-11-26 19:18:37.162699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.445 [2024-11-26 19:18:37.162717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.445 qpair failed and we were unable to recover it. 00:32:20.445 [2024-11-26 19:18:37.162790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.445 [2024-11-26 19:18:37.162868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.445 [2024-11-26 19:18:37.162882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.445 qpair failed and we were unable to recover it. 00:32:20.445 [2024-11-26 19:18:37.162992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.445 [2024-11-26 19:18:37.163066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.445 [2024-11-26 19:18:37.163080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.445 qpair failed and we were unable to recover it. 00:32:20.445 [2024-11-26 19:18:37.163295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.445 [2024-11-26 19:18:37.163367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.445 [2024-11-26 19:18:37.163383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.445 qpair failed and we were unable to recover it. 00:32:20.445 [2024-11-26 19:18:37.163596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.445 [2024-11-26 19:18:37.163691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.445 [2024-11-26 19:18:37.163707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.445 qpair failed and we were unable to recover it. 00:32:20.445 [2024-11-26 19:18:37.163853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.445 [2024-11-26 19:18:37.164063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.445 [2024-11-26 19:18:37.164098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.445 qpair failed and we were unable to recover it. 00:32:20.445 [2024-11-26 19:18:37.164221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.445 [2024-11-26 19:18:37.164385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.445 [2024-11-26 19:18:37.164401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.445 qpair failed and we were unable to recover it. 00:32:20.445 [2024-11-26 19:18:37.164632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.445 [2024-11-26 19:18:37.164773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.445 [2024-11-26 19:18:37.164806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.445 qpair failed and we were unable to recover it. 00:32:20.445 [2024-11-26 19:18:37.164934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.445 [2024-11-26 19:18:37.165118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.445 [2024-11-26 19:18:37.165151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.445 qpair failed and we were unable to recover it. 00:32:20.445 [2024-11-26 19:18:37.165271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.445 [2024-11-26 19:18:37.165397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.445 [2024-11-26 19:18:37.165429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.445 qpair failed and we were unable to recover it. 00:32:20.445 [2024-11-26 19:18:37.165556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.445 [2024-11-26 19:18:37.165683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.445 [2024-11-26 19:18:37.165699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.445 qpair failed and we were unable to recover it. 00:32:20.445 [2024-11-26 19:18:37.165778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.445 [2024-11-26 19:18:37.165962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.445 [2024-11-26 19:18:37.165996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.445 qpair failed and we were unable to recover it. 00:32:20.445 [2024-11-26 19:18:37.166109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.445 [2024-11-26 19:18:37.166236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.445 [2024-11-26 19:18:37.166266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.445 qpair failed and we were unable to recover it. 00:32:20.445 [2024-11-26 19:18:37.166391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.445 [2024-11-26 19:18:37.166537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.445 [2024-11-26 19:18:37.166554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.445 qpair failed and we were unable to recover it. 00:32:20.445 [2024-11-26 19:18:37.166641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.445 [2024-11-26 19:18:37.166727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.445 [2024-11-26 19:18:37.166749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.445 qpair failed and we were unable to recover it. 00:32:20.445 [2024-11-26 19:18:37.166849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.445 [2024-11-26 19:18:37.166935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.445 [2024-11-26 19:18:37.166953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.445 qpair failed and we were unable to recover it. 00:32:20.445 [2024-11-26 19:18:37.167043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.445 [2024-11-26 19:18:37.167111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.445 [2024-11-26 19:18:37.167125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.445 qpair failed and we were unable to recover it. 00:32:20.445 [2024-11-26 19:18:37.167283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.445 [2024-11-26 19:18:37.167430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.445 [2024-11-26 19:18:37.167461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.445 qpair failed and we were unable to recover it. 00:32:20.445 [2024-11-26 19:18:37.167636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.445 [2024-11-26 19:18:37.167818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.445 [2024-11-26 19:18:37.167848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.445 qpair failed and we were unable to recover it. 00:32:20.445 [2024-11-26 19:18:37.167969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.445 [2024-11-26 19:18:37.168085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.445 [2024-11-26 19:18:37.168117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.445 qpair failed and we were unable to recover it. 00:32:20.446 [2024-11-26 19:18:37.168291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.446 [2024-11-26 19:18:37.168497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.446 [2024-11-26 19:18:37.168528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.446 qpair failed and we were unable to recover it. 00:32:20.446 [2024-11-26 19:18:37.168646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.446 [2024-11-26 19:18:37.168768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.446 [2024-11-26 19:18:37.168800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.446 qpair failed and we were unable to recover it. 00:32:20.446 [2024-11-26 19:18:37.168995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.446 [2024-11-26 19:18:37.169161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.446 [2024-11-26 19:18:37.169178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.446 qpair failed and we were unable to recover it. 00:32:20.446 [2024-11-26 19:18:37.169334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.446 [2024-11-26 19:18:37.169427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.446 [2024-11-26 19:18:37.169443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.446 qpair failed and we were unable to recover it. 00:32:20.446 [2024-11-26 19:18:37.169530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.446 [2024-11-26 19:18:37.169669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.446 [2024-11-26 19:18:37.169702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.446 qpair failed and we were unable to recover it. 00:32:20.446 [2024-11-26 19:18:37.169957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.446 [2024-11-26 19:18:37.170085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.446 [2024-11-26 19:18:37.170116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.446 qpair failed and we were unable to recover it. 00:32:20.446 [2024-11-26 19:18:37.170292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.446 [2024-11-26 19:18:37.170399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.446 [2024-11-26 19:18:37.170429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.446 qpair failed and we were unable to recover it. 00:32:20.446 [2024-11-26 19:18:37.170691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.446 [2024-11-26 19:18:37.170961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.446 [2024-11-26 19:18:37.170994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.446 qpair failed and we were unable to recover it. 00:32:20.446 [2024-11-26 19:18:37.171237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.446 [2024-11-26 19:18:37.171362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.446 [2024-11-26 19:18:37.171394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.446 qpair failed and we were unable to recover it. 00:32:20.446 [2024-11-26 19:18:37.171501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.446 [2024-11-26 19:18:37.171609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.446 [2024-11-26 19:18:37.171625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.446 qpair failed and we were unable to recover it. 00:32:20.446 [2024-11-26 19:18:37.171777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.446 [2024-11-26 19:18:37.171990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.446 [2024-11-26 19:18:37.172006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.446 qpair failed and we were unable to recover it. 00:32:20.446 [2024-11-26 19:18:37.172210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.446 [2024-11-26 19:18:37.172303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.446 [2024-11-26 19:18:37.172349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.446 qpair failed and we were unable to recover it. 00:32:20.446 [2024-11-26 19:18:37.172467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.446 [2024-11-26 19:18:37.172593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.446 [2024-11-26 19:18:37.172625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.446 qpair failed and we were unable to recover it. 00:32:20.446 [2024-11-26 19:18:37.172764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.446 [2024-11-26 19:18:37.172874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.446 [2024-11-26 19:18:37.172906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.446 qpair failed and we were unable to recover it. 00:32:20.446 [2024-11-26 19:18:37.173043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.446 [2024-11-26 19:18:37.173223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.446 [2024-11-26 19:18:37.173260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.446 qpair failed and we were unable to recover it. 00:32:20.446 [2024-11-26 19:18:37.173376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.446 [2024-11-26 19:18:37.173610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.446 [2024-11-26 19:18:37.173626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.446 qpair failed and we were unable to recover it. 00:32:20.446 [2024-11-26 19:18:37.173768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.446 [2024-11-26 19:18:37.173921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.446 [2024-11-26 19:18:37.173966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.446 qpair failed and we were unable to recover it. 00:32:20.446 [2024-11-26 19:18:37.174175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.446 [2024-11-26 19:18:37.174297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.446 [2024-11-26 19:18:37.174329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.446 qpair failed and we were unable to recover it. 00:32:20.446 [2024-11-26 19:18:37.174604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.446 [2024-11-26 19:18:37.174724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.446 [2024-11-26 19:18:37.174756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.446 qpair failed and we were unable to recover it. 00:32:20.446 [2024-11-26 19:18:37.174937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.446 [2024-11-26 19:18:37.175119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.446 [2024-11-26 19:18:37.175150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.446 qpair failed and we were unable to recover it. 00:32:20.446 [2024-11-26 19:18:37.175340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.446 [2024-11-26 19:18:37.175517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.446 [2024-11-26 19:18:37.175550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.446 qpair failed and we were unable to recover it. 00:32:20.446 [2024-11-26 19:18:37.175742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.446 [2024-11-26 19:18:37.175914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.446 [2024-11-26 19:18:37.175945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.446 qpair failed and we were unable to recover it. 00:32:20.446 [2024-11-26 19:18:37.176077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.446 [2024-11-26 19:18:37.176259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.446 [2024-11-26 19:18:37.176291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.446 qpair failed and we were unable to recover it. 00:32:20.446 [2024-11-26 19:18:37.176507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.446 [2024-11-26 19:18:37.176601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.447 [2024-11-26 19:18:37.176617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.447 qpair failed and we were unable to recover it. 00:32:20.447 [2024-11-26 19:18:37.176758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.447 [2024-11-26 19:18:37.176916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.447 [2024-11-26 19:18:37.176931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.447 qpair failed and we were unable to recover it. 00:32:20.447 [2024-11-26 19:18:37.177088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.447 [2024-11-26 19:18:37.177205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.447 [2024-11-26 19:18:37.177220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.447 qpair failed and we were unable to recover it. 00:32:20.447 [2024-11-26 19:18:37.177308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.447 [2024-11-26 19:18:37.177462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.447 [2024-11-26 19:18:37.177494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.447 qpair failed and we were unable to recover it. 00:32:20.447 [2024-11-26 19:18:37.177678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.447 [2024-11-26 19:18:37.177792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.447 [2024-11-26 19:18:37.177823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.447 qpair failed and we were unable to recover it. 00:32:20.447 [2024-11-26 19:18:37.177936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.447 [2024-11-26 19:18:37.178056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.447 [2024-11-26 19:18:37.178087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.447 qpair failed and we were unable to recover it. 00:32:20.447 [2024-11-26 19:18:37.178287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.447 [2024-11-26 19:18:37.178499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.447 [2024-11-26 19:18:37.178531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.447 qpair failed and we were unable to recover it. 00:32:20.447 [2024-11-26 19:18:37.178717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.447 [2024-11-26 19:18:37.178932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.447 [2024-11-26 19:18:37.178973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.447 qpair failed and we were unable to recover it. 00:32:20.447 [2024-11-26 19:18:37.179100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.447 [2024-11-26 19:18:37.179214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.447 [2024-11-26 19:18:37.179244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.447 qpair failed and we were unable to recover it. 00:32:20.447 [2024-11-26 19:18:37.179462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.447 [2024-11-26 19:18:37.179648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.447 [2024-11-26 19:18:37.179679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.447 qpair failed and we were unable to recover it. 00:32:20.447 [2024-11-26 19:18:37.179925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.447 [2024-11-26 19:18:37.180056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.447 [2024-11-26 19:18:37.180089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.447 qpair failed and we were unable to recover it. 00:32:20.447 [2024-11-26 19:18:37.180219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.447 [2024-11-26 19:18:37.180340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.447 [2024-11-26 19:18:37.180371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.447 qpair failed and we were unable to recover it. 00:32:20.447 [2024-11-26 19:18:37.180495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.447 [2024-11-26 19:18:37.180692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.447 [2024-11-26 19:18:37.180709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.447 qpair failed and we were unable to recover it. 00:32:20.447 [2024-11-26 19:18:37.180804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.447 [2024-11-26 19:18:37.180946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.447 [2024-11-26 19:18:37.180984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.447 qpair failed and we were unable to recover it. 00:32:20.447 [2024-11-26 19:18:37.181067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.447 [2024-11-26 19:18:37.181163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.447 [2024-11-26 19:18:37.181178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.447 qpair failed and we were unable to recover it. 00:32:20.447 [2024-11-26 19:18:37.181400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.447 [2024-11-26 19:18:37.181589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.447 [2024-11-26 19:18:37.181621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.447 qpair failed and we were unable to recover it. 00:32:20.447 [2024-11-26 19:18:37.181748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.447 [2024-11-26 19:18:37.181854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.447 [2024-11-26 19:18:37.181886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.447 qpair failed and we were unable to recover it. 00:32:20.447 [2024-11-26 19:18:37.181999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.447 [2024-11-26 19:18:37.182113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.447 [2024-11-26 19:18:37.182143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.447 qpair failed and we were unable to recover it. 00:32:20.447 [2024-11-26 19:18:37.182357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.447 [2024-11-26 19:18:37.182485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.447 [2024-11-26 19:18:37.182518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.447 qpair failed and we were unable to recover it. 00:32:20.447 [2024-11-26 19:18:37.182739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.447 [2024-11-26 19:18:37.182882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.447 [2024-11-26 19:18:37.182897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.447 qpair failed and we were unable to recover it. 00:32:20.447 [2024-11-26 19:18:37.183072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.447 [2024-11-26 19:18:37.183212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.447 [2024-11-26 19:18:37.183228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.447 qpair failed and we were unable to recover it. 00:32:20.447 [2024-11-26 19:18:37.183315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.447 [2024-11-26 19:18:37.183399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.447 [2024-11-26 19:18:37.183415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.447 qpair failed and we were unable to recover it. 00:32:20.447 [2024-11-26 19:18:37.183567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.447 [2024-11-26 19:18:37.183645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.447 [2024-11-26 19:18:37.183660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.447 qpair failed and we were unable to recover it. 00:32:20.447 [2024-11-26 19:18:37.183745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.447 [2024-11-26 19:18:37.183851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.447 [2024-11-26 19:18:37.183881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.447 qpair failed and we were unable to recover it. 00:32:20.447 [2024-11-26 19:18:37.184073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.447 [2024-11-26 19:18:37.184264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.448 [2024-11-26 19:18:37.184294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.448 qpair failed and we were unable to recover it. 00:32:20.448 [2024-11-26 19:18:37.184475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.448 [2024-11-26 19:18:37.184683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.448 [2024-11-26 19:18:37.184714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.448 qpair failed and we were unable to recover it. 00:32:20.448 [2024-11-26 19:18:37.184866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.448 [2024-11-26 19:18:37.185055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.448 [2024-11-26 19:18:37.185088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.448 qpair failed and we were unable to recover it. 00:32:20.448 [2024-11-26 19:18:37.185210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.448 [2024-11-26 19:18:37.185358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.448 [2024-11-26 19:18:37.185373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.448 qpair failed and we were unable to recover it. 00:32:20.448 [2024-11-26 19:18:37.185550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.448 [2024-11-26 19:18:37.185822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.448 [2024-11-26 19:18:37.185854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.448 qpair failed and we were unable to recover it. 00:32:20.448 [2024-11-26 19:18:37.186039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.448 [2024-11-26 19:18:37.186178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.448 [2024-11-26 19:18:37.186209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.448 qpair failed and we were unable to recover it. 00:32:20.448 [2024-11-26 19:18:37.186385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.448 [2024-11-26 19:18:37.186585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.448 [2024-11-26 19:18:37.186617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.448 qpair failed and we were unable to recover it. 00:32:20.448 [2024-11-26 19:18:37.186734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.448 [2024-11-26 19:18:37.186875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.448 [2024-11-26 19:18:37.186905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.448 qpair failed and we were unable to recover it. 00:32:20.448 [2024-11-26 19:18:37.187015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.448 [2024-11-26 19:18:37.187257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.448 [2024-11-26 19:18:37.187289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.448 qpair failed and we were unable to recover it. 00:32:20.448 [2024-11-26 19:18:37.187469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.448 [2024-11-26 19:18:37.187670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.448 [2024-11-26 19:18:37.187701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.448 qpair failed and we were unable to recover it. 00:32:20.448 [2024-11-26 19:18:37.187823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.448 [2024-11-26 19:18:37.188037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.448 [2024-11-26 19:18:37.188071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.448 qpair failed and we were unable to recover it. 00:32:20.448 [2024-11-26 19:18:37.188216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.448 [2024-11-26 19:18:37.188351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.448 [2024-11-26 19:18:37.188383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.448 qpair failed and we were unable to recover it. 00:32:20.448 [2024-11-26 19:18:37.188573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.448 [2024-11-26 19:18:37.188727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.448 [2024-11-26 19:18:37.188743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.448 qpair failed and we were unable to recover it. 00:32:20.448 [2024-11-26 19:18:37.188842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.448 [2024-11-26 19:18:37.188987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.448 [2024-11-26 19:18:37.189021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.448 qpair failed and we were unable to recover it. 00:32:20.448 [2024-11-26 19:18:37.189137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.448 [2024-11-26 19:18:37.189321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.448 [2024-11-26 19:18:37.189351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.448 qpair failed and we were unable to recover it. 00:32:20.448 [2024-11-26 19:18:37.189525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.448 [2024-11-26 19:18:37.189699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.448 [2024-11-26 19:18:37.189742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.448 qpair failed and we were unable to recover it. 00:32:20.448 [2024-11-26 19:18:37.189884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.448 [2024-11-26 19:18:37.190047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.448 [2024-11-26 19:18:37.190063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.448 qpair failed and we were unable to recover it. 00:32:20.448 [2024-11-26 19:18:37.190216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.448 [2024-11-26 19:18:37.190436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.448 [2024-11-26 19:18:37.190452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.448 qpair failed and we were unable to recover it. 00:32:20.448 [2024-11-26 19:18:37.190595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.448 [2024-11-26 19:18:37.190751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.448 [2024-11-26 19:18:37.190789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.448 qpair failed and we were unable to recover it. 00:32:20.448 [2024-11-26 19:18:37.190919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.448 [2024-11-26 19:18:37.191052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.448 [2024-11-26 19:18:37.191084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.448 qpair failed and we were unable to recover it. 00:32:20.448 [2024-11-26 19:18:37.191256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.448 [2024-11-26 19:18:37.191370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.448 [2024-11-26 19:18:37.191387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.448 qpair failed and we were unable to recover it. 00:32:20.448 [2024-11-26 19:18:37.191524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.448 [2024-11-26 19:18:37.191615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.448 [2024-11-26 19:18:37.191630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.448 qpair failed and we were unable to recover it. 00:32:20.448 [2024-11-26 19:18:37.191721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.448 [2024-11-26 19:18:37.191856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.449 [2024-11-26 19:18:37.191886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.449 qpair failed and we were unable to recover it. 00:32:20.449 [2024-11-26 19:18:37.191993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.449 [2024-11-26 19:18:37.192126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.449 [2024-11-26 19:18:37.192159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.449 qpair failed and we were unable to recover it. 00:32:20.449 [2024-11-26 19:18:37.192332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.449 [2024-11-26 19:18:37.192496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.449 [2024-11-26 19:18:37.192512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.449 qpair failed and we were unable to recover it. 00:32:20.449 [2024-11-26 19:18:37.192663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.449 [2024-11-26 19:18:37.192799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.449 [2024-11-26 19:18:37.192834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.449 qpair failed and we were unable to recover it. 00:32:20.449 [2024-11-26 19:18:37.193039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.449 [2024-11-26 19:18:37.193159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.449 [2024-11-26 19:18:37.193192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.449 qpair failed and we were unable to recover it. 00:32:20.449 [2024-11-26 19:18:37.193379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.449 [2024-11-26 19:18:37.193564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.449 [2024-11-26 19:18:37.193596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.449 qpair failed and we were unable to recover it. 00:32:20.449 [2024-11-26 19:18:37.193775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.449 [2024-11-26 19:18:37.193960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.449 [2024-11-26 19:18:37.193994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.449 qpair failed and we were unable to recover it. 00:32:20.449 [2024-11-26 19:18:37.194130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.449 [2024-11-26 19:18:37.194260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.449 [2024-11-26 19:18:37.194292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.449 qpair failed and we were unable to recover it. 00:32:20.449 [2024-11-26 19:18:37.194425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.449 [2024-11-26 19:18:37.194548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.449 [2024-11-26 19:18:37.194581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.449 qpair failed and we were unable to recover it. 00:32:20.449 [2024-11-26 19:18:37.194710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.449 [2024-11-26 19:18:37.194893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.449 [2024-11-26 19:18:37.194925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.449 qpair failed and we were unable to recover it. 00:32:20.449 [2024-11-26 19:18:37.195110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.449 [2024-11-26 19:18:37.195286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.449 [2024-11-26 19:18:37.195301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.449 qpair failed and we were unable to recover it. 00:32:20.449 [2024-11-26 19:18:37.195460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.449 [2024-11-26 19:18:37.195597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.449 [2024-11-26 19:18:37.195628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.449 qpair failed and we were unable to recover it. 00:32:20.449 [2024-11-26 19:18:37.195737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.449 [2024-11-26 19:18:37.195845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.449 [2024-11-26 19:18:37.195876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.449 qpair failed and we were unable to recover it. 00:32:20.449 [2024-11-26 19:18:37.196076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.449 [2024-11-26 19:18:37.196264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.449 [2024-11-26 19:18:37.196297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.449 qpair failed and we were unable to recover it. 00:32:20.449 [2024-11-26 19:18:37.196418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.449 [2024-11-26 19:18:37.196669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.449 [2024-11-26 19:18:37.196685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.449 qpair failed and we were unable to recover it. 00:32:20.449 [2024-11-26 19:18:37.196758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.449 [2024-11-26 19:18:37.196853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.449 [2024-11-26 19:18:37.196868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.449 qpair failed and we were unable to recover it. 00:32:20.449 [2024-11-26 19:18:37.197048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.449 [2024-11-26 19:18:37.197147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.449 [2024-11-26 19:18:37.197162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.449 qpair failed and we were unable to recover it. 00:32:20.449 [2024-11-26 19:18:37.197309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.449 [2024-11-26 19:18:37.197402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.449 [2024-11-26 19:18:37.197417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.449 qpair failed and we were unable to recover it. 00:32:20.449 [2024-11-26 19:18:37.197519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.449 [2024-11-26 19:18:37.197656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.449 [2024-11-26 19:18:37.197671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.449 qpair failed and we were unable to recover it. 00:32:20.449 [2024-11-26 19:18:37.197808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.449 [2024-11-26 19:18:37.198015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.449 [2024-11-26 19:18:37.198031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.449 qpair failed and we were unable to recover it. 00:32:20.449 [2024-11-26 19:18:37.198133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.449 [2024-11-26 19:18:37.198229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.449 [2024-11-26 19:18:37.198260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.449 qpair failed and we were unable to recover it. 00:32:20.449 [2024-11-26 19:18:37.198398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.449 [2024-11-26 19:18:37.198574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.449 [2024-11-26 19:18:37.198604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.449 qpair failed and we were unable to recover it. 00:32:20.449 [2024-11-26 19:18:37.198772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.450 [2024-11-26 19:18:37.198882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.450 [2024-11-26 19:18:37.198912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.450 qpair failed and we were unable to recover it. 00:32:20.450 [2024-11-26 19:18:37.199057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.450 [2024-11-26 19:18:37.199174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.450 [2024-11-26 19:18:37.199206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.450 qpair failed and we were unable to recover it. 00:32:20.450 [2024-11-26 19:18:37.199332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.450 [2024-11-26 19:18:37.199500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.450 [2024-11-26 19:18:37.199530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.450 qpair failed and we were unable to recover it. 00:32:20.450 [2024-11-26 19:18:37.199651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.450 [2024-11-26 19:18:37.199740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.450 [2024-11-26 19:18:37.199756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.450 qpair failed and we were unable to recover it. 00:32:20.450 [2024-11-26 19:18:37.199929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.450 [2024-11-26 19:18:37.200117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.450 [2024-11-26 19:18:37.200149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.450 qpair failed and we were unable to recover it. 00:32:20.450 [2024-11-26 19:18:37.200335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.450 [2024-11-26 19:18:37.200454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.450 [2024-11-26 19:18:37.200486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.450 qpair failed and we were unable to recover it. 00:32:20.450 [2024-11-26 19:18:37.200615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.450 [2024-11-26 19:18:37.200710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.450 [2024-11-26 19:18:37.200725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.450 qpair failed and we were unable to recover it. 00:32:20.450 [2024-11-26 19:18:37.200997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.450 [2024-11-26 19:18:37.201178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.450 [2024-11-26 19:18:37.201210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.450 qpair failed and we were unable to recover it. 00:32:20.450 [2024-11-26 19:18:37.201344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.450 [2024-11-26 19:18:37.201521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.450 [2024-11-26 19:18:37.201553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.450 qpair failed and we were unable to recover it. 00:32:20.450 [2024-11-26 19:18:37.201658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.450 [2024-11-26 19:18:37.201900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.450 [2024-11-26 19:18:37.201931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.450 qpair failed and we were unable to recover it. 00:32:20.450 [2024-11-26 19:18:37.202115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.450 [2024-11-26 19:18:37.202353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.450 [2024-11-26 19:18:37.202384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.450 qpair failed and we were unable to recover it. 00:32:20.450 [2024-11-26 19:18:37.202658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.450 [2024-11-26 19:18:37.202766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.450 [2024-11-26 19:18:37.202798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.450 qpair failed and we were unable to recover it. 00:32:20.450 [2024-11-26 19:18:37.202916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.450 [2024-11-26 19:18:37.203096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.450 [2024-11-26 19:18:37.203129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.450 qpair failed and we were unable to recover it. 00:32:20.450 [2024-11-26 19:18:37.203302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.450 [2024-11-26 19:18:37.203585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.450 [2024-11-26 19:18:37.203616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.450 qpair failed and we were unable to recover it. 00:32:20.450 [2024-11-26 19:18:37.203752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.450 [2024-11-26 19:18:37.203920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.450 [2024-11-26 19:18:37.203961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.450 qpair failed and we were unable to recover it. 00:32:20.450 [2024-11-26 19:18:37.204161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.450 [2024-11-26 19:18:37.204335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.450 [2024-11-26 19:18:37.204365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.450 qpair failed and we were unable to recover it. 00:32:20.450 [2024-11-26 19:18:37.204558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.450 [2024-11-26 19:18:37.204669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.450 [2024-11-26 19:18:37.204701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.450 qpair failed and we were unable to recover it. 00:32:20.450 [2024-11-26 19:18:37.204836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.450 [2024-11-26 19:18:37.205013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.450 [2024-11-26 19:18:37.205047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.450 qpair failed and we were unable to recover it. 00:32:20.450 [2024-11-26 19:18:37.205289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.450 [2024-11-26 19:18:37.205465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.450 [2024-11-26 19:18:37.205480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.450 qpair failed and we were unable to recover it. 00:32:20.451 [2024-11-26 19:18:37.205642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.451 [2024-11-26 19:18:37.205879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.451 [2024-11-26 19:18:37.205910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.451 qpair failed and we were unable to recover it. 00:32:20.451 [2024-11-26 19:18:37.206107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.451 [2024-11-26 19:18:37.206285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.451 [2024-11-26 19:18:37.206300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.451 qpair failed and we were unable to recover it. 00:32:20.451 [2024-11-26 19:18:37.206459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.451 [2024-11-26 19:18:37.206690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.451 [2024-11-26 19:18:37.206721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.451 qpair failed and we were unable to recover it. 00:32:20.451 [2024-11-26 19:18:37.206911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.451 [2024-11-26 19:18:37.207037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.451 [2024-11-26 19:18:37.207068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.451 qpair failed and we were unable to recover it. 00:32:20.451 [2024-11-26 19:18:37.207310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.451 [2024-11-26 19:18:37.207441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.451 [2024-11-26 19:18:37.207472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.451 qpair failed and we were unable to recover it. 00:32:20.451 [2024-11-26 19:18:37.207651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.451 [2024-11-26 19:18:37.207846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.451 [2024-11-26 19:18:37.207877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.451 qpair failed and we were unable to recover it. 00:32:20.451 [2024-11-26 19:18:37.208067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.451 [2024-11-26 19:18:37.208182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.451 [2024-11-26 19:18:37.208218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.451 qpair failed and we were unable to recover it. 00:32:20.451 [2024-11-26 19:18:37.208332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.451 [2024-11-26 19:18:37.208513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.451 [2024-11-26 19:18:37.208528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.451 qpair failed and we were unable to recover it. 00:32:20.451 [2024-11-26 19:18:37.208691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.451 [2024-11-26 19:18:37.208996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.451 [2024-11-26 19:18:37.209029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.451 qpair failed and we were unable to recover it. 00:32:20.451 [2024-11-26 19:18:37.209235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.451 [2024-11-26 19:18:37.209347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.451 [2024-11-26 19:18:37.209377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.451 qpair failed and we were unable to recover it. 00:32:20.451 [2024-11-26 19:18:37.209613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.451 [2024-11-26 19:18:37.209696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.451 [2024-11-26 19:18:37.209711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.451 qpair failed and we were unable to recover it. 00:32:20.451 [2024-11-26 19:18:37.209969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.451 [2024-11-26 19:18:37.210155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.451 [2024-11-26 19:18:37.210186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.451 qpair failed and we were unable to recover it. 00:32:20.451 [2024-11-26 19:18:37.210412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.451 [2024-11-26 19:18:37.210611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.451 [2024-11-26 19:18:37.210626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.451 qpair failed and we were unable to recover it. 00:32:20.451 [2024-11-26 19:18:37.210795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.451 [2024-11-26 19:18:37.210898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.451 [2024-11-26 19:18:37.210930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.451 qpair failed and we were unable to recover it. 00:32:20.451 [2024-11-26 19:18:37.211065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.451 [2024-11-26 19:18:37.211176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.451 [2024-11-26 19:18:37.211207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.451 qpair failed and we were unable to recover it. 00:32:20.451 [2024-11-26 19:18:37.211389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.451 [2024-11-26 19:18:37.211579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.451 [2024-11-26 19:18:37.211609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.451 qpair failed and we were unable to recover it. 00:32:20.451 [2024-11-26 19:18:37.211856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.451 [2024-11-26 19:18:37.212027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.451 [2024-11-26 19:18:37.212069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.451 qpair failed and we were unable to recover it. 00:32:20.451 [2024-11-26 19:18:37.212320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.451 [2024-11-26 19:18:37.212506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.451 [2024-11-26 19:18:37.212537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.451 qpair failed and we were unable to recover it. 00:32:20.451 [2024-11-26 19:18:37.212665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.451 [2024-11-26 19:18:37.212782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.451 [2024-11-26 19:18:37.212813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.451 qpair failed and we were unable to recover it. 00:32:20.451 [2024-11-26 19:18:37.213019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.451 [2024-11-26 19:18:37.213206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.451 [2024-11-26 19:18:37.213238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.451 qpair failed and we were unable to recover it. 00:32:20.451 [2024-11-26 19:18:37.213404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.451 [2024-11-26 19:18:37.213502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.451 [2024-11-26 19:18:37.213519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.451 qpair failed and we were unable to recover it. 00:32:20.451 [2024-11-26 19:18:37.213624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.451 [2024-11-26 19:18:37.213741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.451 [2024-11-26 19:18:37.213773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.451 qpair failed and we were unable to recover it. 00:32:20.451 [2024-11-26 19:18:37.213906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.452 [2024-11-26 19:18:37.214092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.452 [2024-11-26 19:18:37.214126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.452 qpair failed and we were unable to recover it. 00:32:20.452 [2024-11-26 19:18:37.214246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.452 [2024-11-26 19:18:37.214366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.452 [2024-11-26 19:18:37.214398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.452 qpair failed and we were unable to recover it. 00:32:20.452 [2024-11-26 19:18:37.214568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.452 [2024-11-26 19:18:37.214753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.452 [2024-11-26 19:18:37.214783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.452 qpair failed and we were unable to recover it. 00:32:20.452 [2024-11-26 19:18:37.214903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.452 [2024-11-26 19:18:37.215082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.452 [2024-11-26 19:18:37.215114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.452 qpair failed and we were unable to recover it. 00:32:20.452 [2024-11-26 19:18:37.215291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.452 [2024-11-26 19:18:37.215406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.452 [2024-11-26 19:18:37.215437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.452 qpair failed and we were unable to recover it. 00:32:20.452 [2024-11-26 19:18:37.215564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.452 [2024-11-26 19:18:37.215798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.452 [2024-11-26 19:18:37.215829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.452 qpair failed and we were unable to recover it. 00:32:20.452 [2024-11-26 19:18:37.216028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.452 [2024-11-26 19:18:37.216215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.452 [2024-11-26 19:18:37.216245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.452 qpair failed and we were unable to recover it. 00:32:20.452 [2024-11-26 19:18:37.216433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.452 [2024-11-26 19:18:37.216599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.452 [2024-11-26 19:18:37.216614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.452 qpair failed and we were unable to recover it. 00:32:20.452 [2024-11-26 19:18:37.216686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.452 [2024-11-26 19:18:37.216832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.452 [2024-11-26 19:18:37.216848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.452 qpair failed and we were unable to recover it. 00:32:20.452 [2024-11-26 19:18:37.216995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.452 [2024-11-26 19:18:37.217198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.452 [2024-11-26 19:18:37.217213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.452 qpair failed and we were unable to recover it. 00:32:20.452 [2024-11-26 19:18:37.217351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.452 [2024-11-26 19:18:37.217445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.452 [2024-11-26 19:18:37.217460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.452 qpair failed and we were unable to recover it. 00:32:20.452 [2024-11-26 19:18:37.217550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.452 [2024-11-26 19:18:37.217631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.452 [2024-11-26 19:18:37.217647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.452 qpair failed and we were unable to recover it. 00:32:20.452 [2024-11-26 19:18:37.217745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.452 [2024-11-26 19:18:37.217814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.452 [2024-11-26 19:18:37.217829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.452 qpair failed and we were unable to recover it. 00:32:20.452 [2024-11-26 19:18:37.217909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.452 [2024-11-26 19:18:37.218144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.452 [2024-11-26 19:18:37.218177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.452 qpair failed and we were unable to recover it. 00:32:20.452 [2024-11-26 19:18:37.218356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.452 [2024-11-26 19:18:37.218488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.452 [2024-11-26 19:18:37.218520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.452 qpair failed and we were unable to recover it. 00:32:20.452 [2024-11-26 19:18:37.218722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.452 [2024-11-26 19:18:37.218801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.452 [2024-11-26 19:18:37.218816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.452 qpair failed and we were unable to recover it. 00:32:20.452 [2024-11-26 19:18:37.219023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.452 [2024-11-26 19:18:37.219174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.452 [2024-11-26 19:18:37.219206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.452 qpair failed and we were unable to recover it. 00:32:20.452 [2024-11-26 19:18:37.219323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.452 [2024-11-26 19:18:37.219451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.452 [2024-11-26 19:18:37.219484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.452 qpair failed and we were unable to recover it. 00:32:20.452 [2024-11-26 19:18:37.219678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.452 [2024-11-26 19:18:37.219808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.452 [2024-11-26 19:18:37.219839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.452 qpair failed and we were unable to recover it. 00:32:20.452 [2024-11-26 19:18:37.219963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.452 [2024-11-26 19:18:37.220079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.452 [2024-11-26 19:18:37.220109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.452 qpair failed and we were unable to recover it. 00:32:20.452 [2024-11-26 19:18:37.220309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.452 [2024-11-26 19:18:37.220544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.452 [2024-11-26 19:18:37.220577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.452 qpair failed and we were unable to recover it. 00:32:20.452 [2024-11-26 19:18:37.220751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.452 [2024-11-26 19:18:37.220937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.452 [2024-11-26 19:18:37.220980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.452 qpair failed and we were unable to recover it. 00:32:20.452 [2024-11-26 19:18:37.221169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.452 [2024-11-26 19:18:37.221284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.452 [2024-11-26 19:18:37.221315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.452 qpair failed and we were unable to recover it. 00:32:20.453 [2024-11-26 19:18:37.221495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.453 [2024-11-26 19:18:37.221644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.453 [2024-11-26 19:18:37.221659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.453 qpair failed and we were unable to recover it. 00:32:20.453 [2024-11-26 19:18:37.221807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.453 [2024-11-26 19:18:37.221968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.453 [2024-11-26 19:18:37.222002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.453 qpair failed and we were unable to recover it. 00:32:20.453 [2024-11-26 19:18:37.222176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.453 [2024-11-26 19:18:37.222368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.453 [2024-11-26 19:18:37.222400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.453 qpair failed and we were unable to recover it. 00:32:20.453 [2024-11-26 19:18:37.222648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.453 [2024-11-26 19:18:37.222890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.453 [2024-11-26 19:18:37.222906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.453 qpair failed and we were unable to recover it. 00:32:20.453 [2024-11-26 19:18:37.223006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.453 [2024-11-26 19:18:37.223203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.453 [2024-11-26 19:18:37.223218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.453 qpair failed and we were unable to recover it. 00:32:20.453 [2024-11-26 19:18:37.223447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.453 [2024-11-26 19:18:37.223538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.453 [2024-11-26 19:18:37.223554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.453 qpair failed and we were unable to recover it. 00:32:20.453 [2024-11-26 19:18:37.223728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.453 [2024-11-26 19:18:37.223902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.453 [2024-11-26 19:18:37.223935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.453 qpair failed and we were unable to recover it. 00:32:20.453 [2024-11-26 19:18:37.224076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.453 [2024-11-26 19:18:37.224255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.453 [2024-11-26 19:18:37.224287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.453 qpair failed and we were unable to recover it. 00:32:20.453 [2024-11-26 19:18:37.224388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.453 [2024-11-26 19:18:37.224532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.453 [2024-11-26 19:18:37.224547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.453 qpair failed and we were unable to recover it. 00:32:20.453 [2024-11-26 19:18:37.224706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.453 [2024-11-26 19:18:37.224858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.453 [2024-11-26 19:18:37.224889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.453 qpair failed and we were unable to recover it. 00:32:20.453 [2024-11-26 19:18:37.225103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.453 [2024-11-26 19:18:37.225316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.453 [2024-11-26 19:18:37.225353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.453 qpair failed and we were unable to recover it. 00:32:20.453 [2024-11-26 19:18:37.225536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.453 [2024-11-26 19:18:37.225779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.453 [2024-11-26 19:18:37.225811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.453 qpair failed and we were unable to recover it. 00:32:20.453 [2024-11-26 19:18:37.225996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.453 [2024-11-26 19:18:37.226120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.453 [2024-11-26 19:18:37.226152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.453 qpair failed and we were unable to recover it. 00:32:20.453 [2024-11-26 19:18:37.226392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.453 [2024-11-26 19:18:37.226577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.453 [2024-11-26 19:18:37.226608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.453 qpair failed and we were unable to recover it. 00:32:20.453 [2024-11-26 19:18:37.226781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.453 [2024-11-26 19:18:37.226968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.453 [2024-11-26 19:18:37.227001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.453 qpair failed and we were unable to recover it. 00:32:20.453 [2024-11-26 19:18:37.227130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.453 [2024-11-26 19:18:37.227247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.453 [2024-11-26 19:18:37.227278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.453 qpair failed and we were unable to recover it. 00:32:20.453 [2024-11-26 19:18:37.227414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.453 [2024-11-26 19:18:37.227511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.453 [2024-11-26 19:18:37.227526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.453 qpair failed and we were unable to recover it. 00:32:20.453 [2024-11-26 19:18:37.227666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.453 [2024-11-26 19:18:37.227810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.453 [2024-11-26 19:18:37.227827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.453 qpair failed and we were unable to recover it. 00:32:20.453 [2024-11-26 19:18:37.227989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.453 [2024-11-26 19:18:37.228112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.453 [2024-11-26 19:18:37.228143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.453 qpair failed and we were unable to recover it. 00:32:20.453 [2024-11-26 19:18:37.228251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.453 [2024-11-26 19:18:37.228428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.453 [2024-11-26 19:18:37.228443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.453 qpair failed and we were unable to recover it. 00:32:20.453 [2024-11-26 19:18:37.228525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.453 [2024-11-26 19:18:37.228674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.453 [2024-11-26 19:18:37.228689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.453 qpair failed and we were unable to recover it. 00:32:20.453 [2024-11-26 19:18:37.228770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.453 [2024-11-26 19:18:37.228856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.453 [2024-11-26 19:18:37.228870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.453 qpair failed and we were unable to recover it. 00:32:20.453 [2024-11-26 19:18:37.228946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.453 [2024-11-26 19:18:37.229115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.453 [2024-11-26 19:18:37.229134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.453 qpair failed and we were unable to recover it. 00:32:20.454 [2024-11-26 19:18:37.229226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.454 [2024-11-26 19:18:37.229296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.454 [2024-11-26 19:18:37.229309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.454 qpair failed and we were unable to recover it. 00:32:20.454 [2024-11-26 19:18:37.229469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.454 [2024-11-26 19:18:37.229612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.454 [2024-11-26 19:18:37.229642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.454 qpair failed and we were unable to recover it. 00:32:20.454 [2024-11-26 19:18:37.229913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.454 [2024-11-26 19:18:37.230042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.454 [2024-11-26 19:18:37.230075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.454 qpair failed and we were unable to recover it. 00:32:20.454 [2024-11-26 19:18:37.230258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.454 [2024-11-26 19:18:37.230372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.454 [2024-11-26 19:18:37.230404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.454 qpair failed and we were unable to recover it. 00:32:20.454 [2024-11-26 19:18:37.230526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.454 [2024-11-26 19:18:37.230644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.454 [2024-11-26 19:18:37.230681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.454 qpair failed and we were unable to recover it. 00:32:20.454 [2024-11-26 19:18:37.230826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.454 [2024-11-26 19:18:37.230910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.454 [2024-11-26 19:18:37.230924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.454 qpair failed and we were unable to recover it. 00:32:20.454 [2024-11-26 19:18:37.231077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.454 [2024-11-26 19:18:37.231170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.454 [2024-11-26 19:18:37.231185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.454 qpair failed and we were unable to recover it. 00:32:20.454 [2024-11-26 19:18:37.231308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.454 [2024-11-26 19:18:37.231450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.454 [2024-11-26 19:18:37.231465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.454 qpair failed and we were unable to recover it. 00:32:20.454 [2024-11-26 19:18:37.231620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.454 [2024-11-26 19:18:37.231767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.454 [2024-11-26 19:18:37.231784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.454 qpair failed and we were unable to recover it. 00:32:20.454 [2024-11-26 19:18:37.231920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.454 [2024-11-26 19:18:37.232011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.454 [2024-11-26 19:18:37.232027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.454 qpair failed and we were unable to recover it. 00:32:20.454 [2024-11-26 19:18:37.232168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.454 [2024-11-26 19:18:37.232263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.454 [2024-11-26 19:18:37.232278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.454 qpair failed and we were unable to recover it. 00:32:20.454 [2024-11-26 19:18:37.232364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.454 [2024-11-26 19:18:37.232572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.454 [2024-11-26 19:18:37.232588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.454 qpair failed and we were unable to recover it. 00:32:20.454 [2024-11-26 19:18:37.232688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.454 [2024-11-26 19:18:37.232791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.454 [2024-11-26 19:18:37.232822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.454 qpair failed and we were unable to recover it. 00:32:20.454 [2024-11-26 19:18:37.232939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.454 [2024-11-26 19:18:37.233127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.454 [2024-11-26 19:18:37.233158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.454 qpair failed and we were unable to recover it. 00:32:20.454 [2024-11-26 19:18:37.233341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.454 [2024-11-26 19:18:37.233473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.454 [2024-11-26 19:18:37.233504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.454 qpair failed and we were unable to recover it. 00:32:20.454 [2024-11-26 19:18:37.233690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.454 [2024-11-26 19:18:37.233863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.454 [2024-11-26 19:18:37.233895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.454 qpair failed and we were unable to recover it. 00:32:20.454 [2024-11-26 19:18:37.234080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.454 [2024-11-26 19:18:37.234254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.454 [2024-11-26 19:18:37.234285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.454 qpair failed and we were unable to recover it. 00:32:20.454 [2024-11-26 19:18:37.234469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.454 [2024-11-26 19:18:37.234678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.454 [2024-11-26 19:18:37.234709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.454 qpair failed and we were unable to recover it. 00:32:20.454 [2024-11-26 19:18:37.234841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.454 [2024-11-26 19:18:37.235015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.454 [2024-11-26 19:18:37.235049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.454 qpair failed and we were unable to recover it. 00:32:20.454 [2024-11-26 19:18:37.235236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.454 [2024-11-26 19:18:37.235519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.454 [2024-11-26 19:18:37.235550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.454 qpair failed and we were unable to recover it. 00:32:20.454 [2024-11-26 19:18:37.235833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.454 [2024-11-26 19:18:37.236017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.454 [2024-11-26 19:18:37.236050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.454 qpair failed and we were unable to recover it. 00:32:20.454 [2024-11-26 19:18:37.236180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.454 [2024-11-26 19:18:37.236295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.454 [2024-11-26 19:18:37.236327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.454 qpair failed and we were unable to recover it. 00:32:20.455 [2024-11-26 19:18:37.236453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.455 [2024-11-26 19:18:37.236600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.455 [2024-11-26 19:18:37.236639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.455 qpair failed and we were unable to recover it. 00:32:20.455 [2024-11-26 19:18:37.236827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.455 [2024-11-26 19:18:37.237000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.455 [2024-11-26 19:18:37.237033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.455 qpair failed and we were unable to recover it. 00:32:20.455 [2024-11-26 19:18:37.237218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.455 [2024-11-26 19:18:37.237322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.455 [2024-11-26 19:18:37.237354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.455 qpair failed and we were unable to recover it. 00:32:20.455 [2024-11-26 19:18:37.237541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.455 [2024-11-26 19:18:37.237705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.455 [2024-11-26 19:18:37.237736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.455 qpair failed and we were unable to recover it. 00:32:20.455 [2024-11-26 19:18:37.237854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.455 [2024-11-26 19:18:37.238057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.455 [2024-11-26 19:18:37.238088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.455 qpair failed and we were unable to recover it. 00:32:20.455 [2024-11-26 19:18:37.238285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.455 [2024-11-26 19:18:37.238484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.455 [2024-11-26 19:18:37.238499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.455 qpair failed and we were unable to recover it. 00:32:20.455 [2024-11-26 19:18:37.238584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.455 [2024-11-26 19:18:37.238678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.455 [2024-11-26 19:18:37.238710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.455 qpair failed and we were unable to recover it. 00:32:20.455 [2024-11-26 19:18:37.238911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.455 [2024-11-26 19:18:37.239046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.455 [2024-11-26 19:18:37.239078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.455 qpair failed and we were unable to recover it. 00:32:20.455 [2024-11-26 19:18:37.239219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.455 [2024-11-26 19:18:37.239391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.455 [2024-11-26 19:18:37.239422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.455 qpair failed and we were unable to recover it. 00:32:20.455 [2024-11-26 19:18:37.239596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.455 [2024-11-26 19:18:37.239754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.455 [2024-11-26 19:18:37.239769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.455 qpair failed and we were unable to recover it. 00:32:20.455 [2024-11-26 19:18:37.239930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.455 [2024-11-26 19:18:37.240017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.455 [2024-11-26 19:18:37.240033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.455 qpair failed and we were unable to recover it. 00:32:20.455 [2024-11-26 19:18:37.240176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.455 [2024-11-26 19:18:37.240341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.455 [2024-11-26 19:18:37.240373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.455 qpair failed and we were unable to recover it. 00:32:20.455 [2024-11-26 19:18:37.240483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.455 [2024-11-26 19:18:37.240667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.455 [2024-11-26 19:18:37.240697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.455 qpair failed and we were unable to recover it. 00:32:20.455 [2024-11-26 19:18:37.240870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.455 [2024-11-26 19:18:37.240993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.455 [2024-11-26 19:18:37.241027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.455 qpair failed and we were unable to recover it. 00:32:20.455 [2024-11-26 19:18:37.241204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.455 [2024-11-26 19:18:37.241381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.455 [2024-11-26 19:18:37.241411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.455 qpair failed and we were unable to recover it. 00:32:20.455 [2024-11-26 19:18:37.241589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.455 [2024-11-26 19:18:37.241770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.455 [2024-11-26 19:18:37.241802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.455 qpair failed and we were unable to recover it. 00:32:20.455 [2024-11-26 19:18:37.241977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.455 [2024-11-26 19:18:37.242151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.455 [2024-11-26 19:18:37.242184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.455 qpair failed and we were unable to recover it. 00:32:20.455 [2024-11-26 19:18:37.242329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.455 [2024-11-26 19:18:37.242407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.455 [2024-11-26 19:18:37.242423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.455 qpair failed and we were unable to recover it. 00:32:20.455 [2024-11-26 19:18:37.242597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.455 [2024-11-26 19:18:37.242772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.455 [2024-11-26 19:18:37.242805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.455 qpair failed and we were unable to recover it. 00:32:20.455 [2024-11-26 19:18:37.243008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.455 [2024-11-26 19:18:37.243197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.455 [2024-11-26 19:18:37.243229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.456 qpair failed and we were unable to recover it. 00:32:20.456 [2024-11-26 19:18:37.243342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.456 [2024-11-26 19:18:37.243507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.456 [2024-11-26 19:18:37.243538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.456 qpair failed and we were unable to recover it. 00:32:20.456 [2024-11-26 19:18:37.243823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.456 [2024-11-26 19:18:37.244082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.456 [2024-11-26 19:18:37.244114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.456 qpair failed and we were unable to recover it. 00:32:20.456 [2024-11-26 19:18:37.244256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.456 [2024-11-26 19:18:37.244410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.456 [2024-11-26 19:18:37.244425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.456 qpair failed and we were unable to recover it. 00:32:20.456 [2024-11-26 19:18:37.244583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.456 [2024-11-26 19:18:37.244785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.456 [2024-11-26 19:18:37.244800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.456 qpair failed and we were unable to recover it. 00:32:20.456 [2024-11-26 19:18:37.244959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.456 [2024-11-26 19:18:37.245105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.456 [2024-11-26 19:18:37.245136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.456 qpair failed and we were unable to recover it. 00:32:20.456 [2024-11-26 19:18:37.245254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.456 [2024-11-26 19:18:37.245513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.456 [2024-11-26 19:18:37.245544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.456 qpair failed and we were unable to recover it. 00:32:20.456 [2024-11-26 19:18:37.245718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.456 [2024-11-26 19:18:37.245803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.456 [2024-11-26 19:18:37.245818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.456 qpair failed and we were unable to recover it. 00:32:20.456 [2024-11-26 19:18:37.245968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.456 [2024-11-26 19:18:37.246143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.456 [2024-11-26 19:18:37.246175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.456 qpair failed and we were unable to recover it. 00:32:20.456 [2024-11-26 19:18:37.246299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.456 [2024-11-26 19:18:37.246501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.456 [2024-11-26 19:18:37.246538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.456 qpair failed and we were unable to recover it. 00:32:20.456 [2024-11-26 19:18:37.246780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.456 [2024-11-26 19:18:37.246877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.456 [2024-11-26 19:18:37.246893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.456 qpair failed and we were unable to recover it. 00:32:20.456 [2024-11-26 19:18:37.246980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.456 [2024-11-26 19:18:37.247203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.456 [2024-11-26 19:18:37.247218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.456 qpair failed and we were unable to recover it. 00:32:20.456 [2024-11-26 19:18:37.247310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.456 [2024-11-26 19:18:37.247547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.456 [2024-11-26 19:18:37.247579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.456 qpair failed and we were unable to recover it. 00:32:20.456 [2024-11-26 19:18:37.247760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.456 [2024-11-26 19:18:37.247875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.456 [2024-11-26 19:18:37.247906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.456 qpair failed and we were unable to recover it. 00:32:20.456 [2024-11-26 19:18:37.248152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.456 [2024-11-26 19:18:37.248391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.456 [2024-11-26 19:18:37.248422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.456 qpair failed and we were unable to recover it. 00:32:20.456 [2024-11-26 19:18:37.248693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.456 [2024-11-26 19:18:37.248858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.456 [2024-11-26 19:18:37.248889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.456 qpair failed and we were unable to recover it. 00:32:20.456 [2024-11-26 19:18:37.249182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.456 [2024-11-26 19:18:37.249425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.456 [2024-11-26 19:18:37.249458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.456 qpair failed and we were unable to recover it. 00:32:20.456 [2024-11-26 19:18:37.249658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.456 [2024-11-26 19:18:37.249813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.456 [2024-11-26 19:18:37.249844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.456 qpair failed and we were unable to recover it. 00:32:20.456 [2024-11-26 19:18:37.250049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.456 [2024-11-26 19:18:37.250187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.456 [2024-11-26 19:18:37.250218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.456 qpair failed and we were unable to recover it. 00:32:20.456 [2024-11-26 19:18:37.250327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.456 [2024-11-26 19:18:37.250528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.456 [2024-11-26 19:18:37.250544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.456 qpair failed and we were unable to recover it. 00:32:20.456 [2024-11-26 19:18:37.250712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.456 [2024-11-26 19:18:37.250854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.456 [2024-11-26 19:18:37.250886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.456 qpair failed and we were unable to recover it. 00:32:20.456 [2024-11-26 19:18:37.251077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.456 [2024-11-26 19:18:37.251276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.456 [2024-11-26 19:18:37.251307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.456 qpair failed and we were unable to recover it. 00:32:20.456 [2024-11-26 19:18:37.251494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.456 [2024-11-26 19:18:37.251594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.456 [2024-11-26 19:18:37.251633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.456 qpair failed and we were unable to recover it. 00:32:20.456 [2024-11-26 19:18:37.251850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.456 [2024-11-26 19:18:37.251965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.456 [2024-11-26 19:18:37.251996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.456 qpair failed and we were unable to recover it. 00:32:20.456 [2024-11-26 19:18:37.252187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.456 [2024-11-26 19:18:37.252422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.456 [2024-11-26 19:18:37.252453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.457 qpair failed and we were unable to recover it. 00:32:20.457 [2024-11-26 19:18:37.252640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.457 [2024-11-26 19:18:37.252736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.457 [2024-11-26 19:18:37.252752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.457 qpair failed and we were unable to recover it. 00:32:20.457 [2024-11-26 19:18:37.252905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.457 [2024-11-26 19:18:37.252989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.457 [2024-11-26 19:18:37.253003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.457 qpair failed and we were unable to recover it. 00:32:20.457 [2024-11-26 19:18:37.253157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.457 [2024-11-26 19:18:37.253238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.457 [2024-11-26 19:18:37.253254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.457 qpair failed and we were unable to recover it. 00:32:20.457 [2024-11-26 19:18:37.253334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.457 [2024-11-26 19:18:37.253549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.457 [2024-11-26 19:18:37.253580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.457 qpair failed and we were unable to recover it. 00:32:20.457 [2024-11-26 19:18:37.253793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.457 [2024-11-26 19:18:37.253981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.457 [2024-11-26 19:18:37.254014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.457 qpair failed and we were unable to recover it. 00:32:20.457 [2024-11-26 19:18:37.254284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.457 [2024-11-26 19:18:37.254393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.457 [2024-11-26 19:18:37.254408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.457 qpair failed and we were unable to recover it. 00:32:20.457 [2024-11-26 19:18:37.254557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.457 [2024-11-26 19:18:37.254676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.457 [2024-11-26 19:18:37.254707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.457 qpair failed and we were unable to recover it. 00:32:20.457 [2024-11-26 19:18:37.254917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.457 [2024-11-26 19:18:37.255098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.457 [2024-11-26 19:18:37.255130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.457 qpair failed and we were unable to recover it. 00:32:20.457 [2024-11-26 19:18:37.255315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.457 [2024-11-26 19:18:37.255495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.457 [2024-11-26 19:18:37.255511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.457 qpair failed and we were unable to recover it. 00:32:20.457 [2024-11-26 19:18:37.255652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.457 [2024-11-26 19:18:37.255817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.457 [2024-11-26 19:18:37.255849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.457 qpair failed and we were unable to recover it. 00:32:20.457 [2024-11-26 19:18:37.255985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.457 [2024-11-26 19:18:37.256121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.457 [2024-11-26 19:18:37.256151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.457 qpair failed and we were unable to recover it. 00:32:20.457 [2024-11-26 19:18:37.256269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.457 [2024-11-26 19:18:37.256440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.457 [2024-11-26 19:18:37.256472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.457 qpair failed and we were unable to recover it. 00:32:20.457 [2024-11-26 19:18:37.256673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.457 [2024-11-26 19:18:37.256894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.457 [2024-11-26 19:18:37.256925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.457 qpair failed and we were unable to recover it. 00:32:20.457 [2024-11-26 19:18:37.257140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.457 [2024-11-26 19:18:37.257271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.457 [2024-11-26 19:18:37.257301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.457 qpair failed and we were unable to recover it. 00:32:20.457 [2024-11-26 19:18:37.257512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.457 [2024-11-26 19:18:37.257722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.457 [2024-11-26 19:18:37.257754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.457 qpair failed and we were unable to recover it. 00:32:20.457 [2024-11-26 19:18:37.257939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.457 [2024-11-26 19:18:37.258136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.457 [2024-11-26 19:18:37.258166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.457 qpair failed and we were unable to recover it. 00:32:20.457 [2024-11-26 19:18:37.258353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.457 [2024-11-26 19:18:37.258471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.457 [2024-11-26 19:18:37.258502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.457 qpair failed and we were unable to recover it. 00:32:20.457 [2024-11-26 19:18:37.258619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.457 [2024-11-26 19:18:37.258723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.457 [2024-11-26 19:18:37.258754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.457 qpair failed and we were unable to recover it. 00:32:20.457 [2024-11-26 19:18:37.258923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.457 [2024-11-26 19:18:37.259121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.457 [2024-11-26 19:18:37.259153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.457 qpair failed and we were unable to recover it. 00:32:20.457 [2024-11-26 19:18:37.259365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.457 [2024-11-26 19:18:37.259490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.457 [2024-11-26 19:18:37.259522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.457 qpair failed and we were unable to recover it. 00:32:20.457 [2024-11-26 19:18:37.259723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.457 [2024-11-26 19:18:37.259891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.457 [2024-11-26 19:18:37.259922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.457 qpair failed and we were unable to recover it. 00:32:20.457 [2024-11-26 19:18:37.260123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.457 [2024-11-26 19:18:37.260302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.457 [2024-11-26 19:18:37.260334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.457 qpair failed and we were unable to recover it. 00:32:20.457 [2024-11-26 19:18:37.260509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.457 [2024-11-26 19:18:37.260600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.457 [2024-11-26 19:18:37.260615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.457 qpair failed and we were unable to recover it. 00:32:20.457 [2024-11-26 19:18:37.260772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.457 [2024-11-26 19:18:37.260852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.457 [2024-11-26 19:18:37.260868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.457 qpair failed and we were unable to recover it. 00:32:20.458 [2024-11-26 19:18:37.260965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.458 [2024-11-26 19:18:37.261046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.458 [2024-11-26 19:18:37.261061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.458 qpair failed and we were unable to recover it. 00:32:20.458 [2024-11-26 19:18:37.261201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.458 [2024-11-26 19:18:37.261341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.458 [2024-11-26 19:18:37.261356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.458 qpair failed and we were unable to recover it. 00:32:20.458 [2024-11-26 19:18:37.261504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.458 [2024-11-26 19:18:37.261747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.458 [2024-11-26 19:18:37.261777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.458 qpair failed and we were unable to recover it. 00:32:20.458 [2024-11-26 19:18:37.261911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.458 [2024-11-26 19:18:37.262105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.458 [2024-11-26 19:18:37.262138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.458 qpair failed and we were unable to recover it. 00:32:20.458 [2024-11-26 19:18:37.262353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.458 [2024-11-26 19:18:37.262533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.458 [2024-11-26 19:18:37.262564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.458 qpair failed and we were unable to recover it. 00:32:20.458 [2024-11-26 19:18:37.262766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.458 [2024-11-26 19:18:37.262906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.458 [2024-11-26 19:18:37.262936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.458 qpair failed and we were unable to recover it. 00:32:20.458 [2024-11-26 19:18:37.263084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.458 [2024-11-26 19:18:37.263318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.458 [2024-11-26 19:18:37.263349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.458 qpair failed and we were unable to recover it. 00:32:20.458 [2024-11-26 19:18:37.263522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.458 [2024-11-26 19:18:37.263601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.458 [2024-11-26 19:18:37.263617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.458 qpair failed and we were unable to recover it. 00:32:20.458 [2024-11-26 19:18:37.263840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.458 [2024-11-26 19:18:37.263975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.458 [2024-11-26 19:18:37.263992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.458 qpair failed and we were unable to recover it. 00:32:20.458 [2024-11-26 19:18:37.264080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.458 [2024-11-26 19:18:37.264230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.458 [2024-11-26 19:18:37.264245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.458 qpair failed and we were unable to recover it. 00:32:20.458 [2024-11-26 19:18:37.264483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.458 [2024-11-26 19:18:37.264579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.458 [2024-11-26 19:18:37.264595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.458 qpair failed and we were unable to recover it. 00:32:20.458 [2024-11-26 19:18:37.264770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.458 [2024-11-26 19:18:37.265000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.458 [2024-11-26 19:18:37.265040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.458 qpair failed and we were unable to recover it. 00:32:20.458 [2024-11-26 19:18:37.265246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.458 [2024-11-26 19:18:37.265382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.458 [2024-11-26 19:18:37.265413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.458 qpair failed and we were unable to recover it. 00:32:20.458 [2024-11-26 19:18:37.265530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.458 [2024-11-26 19:18:37.265697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.458 [2024-11-26 19:18:37.265728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.458 qpair failed and we were unable to recover it. 00:32:20.458 [2024-11-26 19:18:37.265897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.458 [2024-11-26 19:18:37.266020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.458 [2024-11-26 19:18:37.266053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.458 qpair failed and we were unable to recover it. 00:32:20.458 [2024-11-26 19:18:37.266231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.458 [2024-11-26 19:18:37.266331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.458 [2024-11-26 19:18:37.266360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.458 qpair failed and we were unable to recover it. 00:32:20.458 [2024-11-26 19:18:37.266601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.458 [2024-11-26 19:18:37.266840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.458 [2024-11-26 19:18:37.266869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.458 qpair failed and we were unable to recover it. 00:32:20.458 [2024-11-26 19:18:37.267142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.458 [2024-11-26 19:18:37.267256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.458 [2024-11-26 19:18:37.267289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.458 qpair failed and we were unable to recover it. 00:32:20.458 [2024-11-26 19:18:37.267472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.458 [2024-11-26 19:18:37.267605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.458 [2024-11-26 19:18:37.267620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.458 qpair failed and we were unable to recover it. 00:32:20.458 [2024-11-26 19:18:37.267707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.458 [2024-11-26 19:18:37.267878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.458 [2024-11-26 19:18:37.267920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.458 qpair failed and we were unable to recover it. 00:32:20.458 [2024-11-26 19:18:37.268046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.458 [2024-11-26 19:18:37.268228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.458 [2024-11-26 19:18:37.268260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.458 qpair failed and we were unable to recover it. 00:32:20.458 [2024-11-26 19:18:37.268442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.458 [2024-11-26 19:18:37.268620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.458 [2024-11-26 19:18:37.268651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.458 qpair failed and we were unable to recover it. 00:32:20.458 [2024-11-26 19:18:37.268901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.458 [2024-11-26 19:18:37.269091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.458 [2024-11-26 19:18:37.269124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.458 qpair failed and we were unable to recover it. 00:32:20.458 [2024-11-26 19:18:37.269312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.458 [2024-11-26 19:18:37.269493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.458 [2024-11-26 19:18:37.269524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.458 qpair failed and we were unable to recover it. 00:32:20.458 [2024-11-26 19:18:37.269707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.459 [2024-11-26 19:18:37.269882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.459 [2024-11-26 19:18:37.269914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.459 qpair failed and we were unable to recover it. 00:32:20.459 [2024-11-26 19:18:37.270050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.459 [2024-11-26 19:18:37.270230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.459 [2024-11-26 19:18:37.270261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.459 qpair failed and we were unable to recover it. 00:32:20.459 [2024-11-26 19:18:37.270379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.459 [2024-11-26 19:18:37.270552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.459 [2024-11-26 19:18:37.270583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.459 qpair failed and we were unable to recover it. 00:32:20.459 [2024-11-26 19:18:37.270723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.459 [2024-11-26 19:18:37.270888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.459 [2024-11-26 19:18:37.270920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.459 qpair failed and we were unable to recover it. 00:32:20.459 [2024-11-26 19:18:37.271121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.459 [2024-11-26 19:18:37.271296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.459 [2024-11-26 19:18:37.271327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.459 qpair failed and we were unable to recover it. 00:32:20.459 [2024-11-26 19:18:37.271452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.459 [2024-11-26 19:18:37.271630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.459 [2024-11-26 19:18:37.271661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.459 qpair failed and we were unable to recover it. 00:32:20.459 [2024-11-26 19:18:37.271783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.459 [2024-11-26 19:18:37.271907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.459 [2024-11-26 19:18:37.271938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.459 qpair failed and we were unable to recover it. 00:32:20.459 [2024-11-26 19:18:37.272067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.459 [2024-11-26 19:18:37.272179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.459 [2024-11-26 19:18:37.272210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.459 qpair failed and we were unable to recover it. 00:32:20.459 [2024-11-26 19:18:37.272428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.459 [2024-11-26 19:18:37.272613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.459 [2024-11-26 19:18:37.272645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.459 qpair failed and we were unable to recover it. 00:32:20.459 [2024-11-26 19:18:37.272913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.459 [2024-11-26 19:18:37.273071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.459 [2024-11-26 19:18:37.273104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.459 qpair failed and we were unable to recover it. 00:32:20.459 [2024-11-26 19:18:37.273289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.459 [2024-11-26 19:18:37.273499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.459 [2024-11-26 19:18:37.273530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.459 qpair failed and we were unable to recover it. 00:32:20.459 [2024-11-26 19:18:37.273714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.459 [2024-11-26 19:18:37.273885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.459 [2024-11-26 19:18:37.273915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.459 qpair failed and we were unable to recover it. 00:32:20.459 [2024-11-26 19:18:37.274052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.459 [2024-11-26 19:18:37.274256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.459 [2024-11-26 19:18:37.274286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.459 qpair failed and we were unable to recover it. 00:32:20.459 [2024-11-26 19:18:37.274405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.459 [2024-11-26 19:18:37.274593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.459 [2024-11-26 19:18:37.274624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.459 qpair failed and we were unable to recover it. 00:32:20.459 [2024-11-26 19:18:37.274735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.459 [2024-11-26 19:18:37.274920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.459 [2024-11-26 19:18:37.274935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.459 qpair failed and we were unable to recover it. 00:32:20.459 [2024-11-26 19:18:37.275115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.459 [2024-11-26 19:18:37.275193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.459 [2024-11-26 19:18:37.275209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.459 qpair failed and we were unable to recover it. 00:32:20.459 [2024-11-26 19:18:37.275380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.459 [2024-11-26 19:18:37.275478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.459 [2024-11-26 19:18:37.275516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.459 qpair failed and we were unable to recover it. 00:32:20.459 [2024-11-26 19:18:37.275720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.459 [2024-11-26 19:18:37.275855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.459 [2024-11-26 19:18:37.275885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.459 qpair failed and we were unable to recover it. 00:32:20.459 [2024-11-26 19:18:37.276126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.459 [2024-11-26 19:18:37.276307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.459 [2024-11-26 19:18:37.276339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.459 qpair failed and we were unable to recover it. 00:32:20.459 [2024-11-26 19:18:37.276508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.459 [2024-11-26 19:18:37.276653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.459 [2024-11-26 19:18:37.276668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.459 qpair failed and we were unable to recover it. 00:32:20.459 [2024-11-26 19:18:37.276755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.459 [2024-11-26 19:18:37.276994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.459 [2024-11-26 19:18:37.277028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.459 qpair failed and we were unable to recover it. 00:32:20.459 [2024-11-26 19:18:37.277217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.459 [2024-11-26 19:18:37.277419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.459 [2024-11-26 19:18:37.277450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.459 qpair failed and we were unable to recover it. 00:32:20.459 [2024-11-26 19:18:37.277639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.459 [2024-11-26 19:18:37.277799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.459 [2024-11-26 19:18:37.277830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.459 qpair failed and we were unable to recover it. 00:32:20.459 [2024-11-26 19:18:37.278079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.459 [2024-11-26 19:18:37.278198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.459 [2024-11-26 19:18:37.278229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.459 qpair failed and we were unable to recover it. 00:32:20.459 [2024-11-26 19:18:37.278345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.459 [2024-11-26 19:18:37.278576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.459 [2024-11-26 19:18:37.278606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.459 qpair failed and we were unable to recover it. 00:32:20.460 [2024-11-26 19:18:37.278810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.460 [2024-11-26 19:18:37.278940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.460 [2024-11-26 19:18:37.278960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.460 qpair failed and we were unable to recover it. 00:32:20.460 [2024-11-26 19:18:37.279029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.460 [2024-11-26 19:18:37.279192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.460 [2024-11-26 19:18:37.279224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.460 qpair failed and we were unable to recover it. 00:32:20.460 [2024-11-26 19:18:37.279397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.460 [2024-11-26 19:18:37.279517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.460 [2024-11-26 19:18:37.279547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.460 qpair failed and we were unable to recover it. 00:32:20.460 [2024-11-26 19:18:37.279729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.460 [2024-11-26 19:18:37.279815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.460 [2024-11-26 19:18:37.279831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.460 qpair failed and we were unable to recover it. 00:32:20.460 [2024-11-26 19:18:37.279978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.460 [2024-11-26 19:18:37.280058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.460 [2024-11-26 19:18:37.280073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.460 qpair failed and we were unable to recover it. 00:32:20.460 [2024-11-26 19:18:37.280278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.460 [2024-11-26 19:18:37.280441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.460 [2024-11-26 19:18:37.280472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.460 qpair failed and we were unable to recover it. 00:32:20.460 [2024-11-26 19:18:37.280730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.460 [2024-11-26 19:18:37.280849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.460 [2024-11-26 19:18:37.280879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.460 qpair failed and we were unable to recover it. 00:32:20.460 [2024-11-26 19:18:37.281063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.460 [2024-11-26 19:18:37.281312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.460 [2024-11-26 19:18:37.281343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.460 qpair failed and we were unable to recover it. 00:32:20.460 [2024-11-26 19:18:37.281541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.460 [2024-11-26 19:18:37.281732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.460 [2024-11-26 19:18:37.281770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.460 qpair failed and we were unable to recover it. 00:32:20.460 [2024-11-26 19:18:37.281919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.460 [2024-11-26 19:18:37.282086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.460 [2024-11-26 19:18:37.282102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.460 qpair failed and we were unable to recover it. 00:32:20.460 [2024-11-26 19:18:37.282179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.460 [2024-11-26 19:18:37.282276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.460 [2024-11-26 19:18:37.282291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.460 qpair failed and we were unable to recover it. 00:32:20.460 [2024-11-26 19:18:37.282544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.460 [2024-11-26 19:18:37.282642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.460 [2024-11-26 19:18:37.282658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.460 qpair failed and we were unable to recover it. 00:32:20.460 [2024-11-26 19:18:37.282824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.460 [2024-11-26 19:18:37.282941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.460 [2024-11-26 19:18:37.282981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.460 qpair failed and we were unable to recover it. 00:32:20.460 [2024-11-26 19:18:37.283093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.460 [2024-11-26 19:18:37.283206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.460 [2024-11-26 19:18:37.283242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.460 qpair failed and we were unable to recover it. 00:32:20.460 [2024-11-26 19:18:37.283426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.460 [2024-11-26 19:18:37.283601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.460 [2024-11-26 19:18:37.283632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.460 qpair failed and we were unable to recover it. 00:32:20.460 [2024-11-26 19:18:37.283906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.460 [2024-11-26 19:18:37.284078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.460 [2024-11-26 19:18:37.284094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.460 qpair failed and we were unable to recover it. 00:32:20.460 [2024-11-26 19:18:37.284194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.460 [2024-11-26 19:18:37.284436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.460 [2024-11-26 19:18:37.284466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.460 qpair failed and we were unable to recover it. 00:32:20.460 [2024-11-26 19:18:37.284586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.460 [2024-11-26 19:18:37.284714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.460 [2024-11-26 19:18:37.284746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.460 qpair failed and we were unable to recover it. 00:32:20.460 [2024-11-26 19:18:37.284856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.460 [2024-11-26 19:18:37.284946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.460 [2024-11-26 19:18:37.284978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.460 qpair failed and we were unable to recover it. 00:32:20.460 [2024-11-26 19:18:37.285054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.460 [2024-11-26 19:18:37.285222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.460 [2024-11-26 19:18:37.285237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.460 qpair failed and we were unable to recover it. 00:32:20.460 [2024-11-26 19:18:37.285423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.460 [2024-11-26 19:18:37.285616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.460 [2024-11-26 19:18:37.285647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.460 qpair failed and we were unable to recover it. 00:32:20.460 [2024-11-26 19:18:37.285837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.460 [2024-11-26 19:18:37.285969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.460 [2024-11-26 19:18:37.286002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.460 qpair failed and we were unable to recover it. 00:32:20.460 [2024-11-26 19:18:37.286127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.460 [2024-11-26 19:18:37.286360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.460 [2024-11-26 19:18:37.286391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.460 qpair failed and we were unable to recover it. 00:32:20.460 [2024-11-26 19:18:37.286573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.460 [2024-11-26 19:18:37.286689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.460 [2024-11-26 19:18:37.286727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.460 qpair failed and we were unable to recover it. 00:32:20.460 [2024-11-26 19:18:37.286937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.460 [2024-11-26 19:18:37.287083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.460 [2024-11-26 19:18:37.287115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.461 qpair failed and we were unable to recover it. 00:32:20.461 [2024-11-26 19:18:37.287222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.461 [2024-11-26 19:18:37.287390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.461 [2024-11-26 19:18:37.287421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.461 qpair failed and we were unable to recover it. 00:32:20.461 [2024-11-26 19:18:37.287560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.461 [2024-11-26 19:18:37.287670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.461 [2024-11-26 19:18:37.287702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.461 qpair failed and we were unable to recover it. 00:32:20.461 [2024-11-26 19:18:37.287868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.461 [2024-11-26 19:18:37.288021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.461 [2024-11-26 19:18:37.288037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.461 qpair failed and we were unable to recover it. 00:32:20.461 [2024-11-26 19:18:37.288185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.461 [2024-11-26 19:18:37.288337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.461 [2024-11-26 19:18:37.288369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.461 qpair failed and we were unable to recover it. 00:32:20.461 [2024-11-26 19:18:37.288552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.461 [2024-11-26 19:18:37.288674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.461 [2024-11-26 19:18:37.288705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.461 qpair failed and we were unable to recover it. 00:32:20.461 [2024-11-26 19:18:37.288885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.461 [2024-11-26 19:18:37.289119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.461 [2024-11-26 19:18:37.289152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.461 qpair failed and we were unable to recover it. 00:32:20.461 [2024-11-26 19:18:37.289419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.461 [2024-11-26 19:18:37.289550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.461 [2024-11-26 19:18:37.289566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.461 qpair failed and we were unable to recover it. 00:32:20.461 [2024-11-26 19:18:37.289653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.461 [2024-11-26 19:18:37.289741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.461 [2024-11-26 19:18:37.289771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.461 qpair failed and we were unable to recover it. 00:32:20.461 [2024-11-26 19:18:37.289882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.461 [2024-11-26 19:18:37.290131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.461 [2024-11-26 19:18:37.290164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.461 qpair failed and we were unable to recover it. 00:32:20.461 [2024-11-26 19:18:37.290308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.461 [2024-11-26 19:18:37.290590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.461 [2024-11-26 19:18:37.290622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.461 qpair failed and we were unable to recover it. 00:32:20.461 [2024-11-26 19:18:37.290794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.461 [2024-11-26 19:18:37.290909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.461 [2024-11-26 19:18:37.290940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.461 qpair failed and we were unable to recover it. 00:32:20.461 [2024-11-26 19:18:37.291194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.461 [2024-11-26 19:18:37.291372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.461 [2024-11-26 19:18:37.291403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.461 qpair failed and we were unable to recover it. 00:32:20.461 [2024-11-26 19:18:37.291643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.461 [2024-11-26 19:18:37.291745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.461 [2024-11-26 19:18:37.291777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.461 qpair failed and we were unable to recover it. 00:32:20.461 [2024-11-26 19:18:37.292063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.461 [2024-11-26 19:18:37.292250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.461 [2024-11-26 19:18:37.292280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.461 qpair failed and we were unable to recover it. 00:32:20.461 [2024-11-26 19:18:37.292467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.461 [2024-11-26 19:18:37.292669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.461 [2024-11-26 19:18:37.292701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.461 qpair failed and we were unable to recover it. 00:32:20.461 [2024-11-26 19:18:37.292867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.461 [2024-11-26 19:18:37.293014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.461 [2024-11-26 19:18:37.293030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.461 qpair failed and we were unable to recover it. 00:32:20.461 [2024-11-26 19:18:37.293100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.461 [2024-11-26 19:18:37.293237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.461 [2024-11-26 19:18:37.293252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.461 qpair failed and we were unable to recover it. 00:32:20.461 [2024-11-26 19:18:37.293414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.461 [2024-11-26 19:18:37.293608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.461 [2024-11-26 19:18:37.293623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.461 qpair failed and we were unable to recover it. 00:32:20.461 [2024-11-26 19:18:37.293792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.461 [2024-11-26 19:18:37.293862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.461 [2024-11-26 19:18:37.293877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.461 qpair failed and we were unable to recover it. 00:32:20.461 [2024-11-26 19:18:37.293974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.461 [2024-11-26 19:18:37.294135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.461 [2024-11-26 19:18:37.294171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.461 qpair failed and we were unable to recover it. 00:32:20.461 [2024-11-26 19:18:37.294294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.461 [2024-11-26 19:18:37.294506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.461 [2024-11-26 19:18:37.294537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.461 qpair failed and we were unable to recover it. 00:32:20.461 [2024-11-26 19:18:37.294657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.461 [2024-11-26 19:18:37.294758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.462 [2024-11-26 19:18:37.294773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.462 qpair failed and we were unable to recover it. 00:32:20.462 [2024-11-26 19:18:37.294922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.462 [2024-11-26 19:18:37.295016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.462 [2024-11-26 19:18:37.295033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.462 qpair failed and we were unable to recover it. 00:32:20.462 [2024-11-26 19:18:37.295126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.462 [2024-11-26 19:18:37.295306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.462 [2024-11-26 19:18:37.295336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.462 qpair failed and we were unable to recover it. 00:32:20.462 [2024-11-26 19:18:37.295520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.462 [2024-11-26 19:18:37.295634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.462 [2024-11-26 19:18:37.295666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.462 qpair failed and we were unable to recover it. 00:32:20.462 [2024-11-26 19:18:37.295792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.462 [2024-11-26 19:18:37.295958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.462 [2024-11-26 19:18:37.295974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.462 qpair failed and we were unable to recover it. 00:32:20.462 [2024-11-26 19:18:37.296132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.462 [2024-11-26 19:18:37.296243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.462 [2024-11-26 19:18:37.296274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.462 qpair failed and we were unable to recover it. 00:32:20.462 [2024-11-26 19:18:37.296445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.462 [2024-11-26 19:18:37.296548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.462 [2024-11-26 19:18:37.296580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.462 qpair failed and we were unable to recover it. 00:32:20.462 [2024-11-26 19:18:37.296768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.462 [2024-11-26 19:18:37.296937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.462 [2024-11-26 19:18:37.297011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.462 qpair failed and we were unable to recover it. 00:32:20.462 [2024-11-26 19:18:37.297137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.462 [2024-11-26 19:18:37.297315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.462 [2024-11-26 19:18:37.297346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.462 qpair failed and we were unable to recover it. 00:32:20.462 [2024-11-26 19:18:37.297520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.462 [2024-11-26 19:18:37.297620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.462 [2024-11-26 19:18:37.297652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.462 qpair failed and we were unable to recover it. 00:32:20.462 [2024-11-26 19:18:37.297834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.462 [2024-11-26 19:18:37.297900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.462 [2024-11-26 19:18:37.297915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.462 qpair failed and we were unable to recover it. 00:32:20.462 [2024-11-26 19:18:37.297999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.462 [2024-11-26 19:18:37.298204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.462 [2024-11-26 19:18:37.298220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.462 qpair failed and we were unable to recover it. 00:32:20.462 [2024-11-26 19:18:37.298373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.462 [2024-11-26 19:18:37.298511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.462 [2024-11-26 19:18:37.298526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.462 qpair failed and we were unable to recover it. 00:32:20.462 [2024-11-26 19:18:37.298672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.462 [2024-11-26 19:18:37.298816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.462 [2024-11-26 19:18:37.298831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.462 qpair failed and we were unable to recover it. 00:32:20.462 [2024-11-26 19:18:37.298903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.462 [2024-11-26 19:18:37.299056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.462 [2024-11-26 19:18:37.299073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.462 qpair failed and we were unable to recover it. 00:32:20.462 [2024-11-26 19:18:37.299174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.462 [2024-11-26 19:18:37.299257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.462 [2024-11-26 19:18:37.299272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.462 qpair failed and we were unable to recover it. 00:32:20.462 [2024-11-26 19:18:37.299370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.462 [2024-11-26 19:18:37.299546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.462 [2024-11-26 19:18:37.299577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.462 qpair failed and we were unable to recover it. 00:32:20.462 [2024-11-26 19:18:37.299769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.462 [2024-11-26 19:18:37.299872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.462 [2024-11-26 19:18:37.299911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.462 qpair failed and we were unable to recover it. 00:32:20.462 [2024-11-26 19:18:37.300005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.462 [2024-11-26 19:18:37.300146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.462 [2024-11-26 19:18:37.300161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.462 qpair failed and we were unable to recover it. 00:32:20.462 [2024-11-26 19:18:37.300247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.462 [2024-11-26 19:18:37.300450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.462 [2024-11-26 19:18:37.300480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.462 qpair failed and we were unable to recover it. 00:32:20.462 [2024-11-26 19:18:37.300585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.462 [2024-11-26 19:18:37.300858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.462 [2024-11-26 19:18:37.300891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.462 qpair failed and we were unable to recover it. 00:32:20.462 [2024-11-26 19:18:37.301089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.462 [2024-11-26 19:18:37.301257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.462 [2024-11-26 19:18:37.301288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.462 qpair failed and we were unable to recover it. 00:32:20.462 [2024-11-26 19:18:37.301392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.462 [2024-11-26 19:18:37.301588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.462 [2024-11-26 19:18:37.301619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.462 qpair failed and we were unable to recover it. 00:32:20.462 [2024-11-26 19:18:37.301795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.462 [2024-11-26 19:18:37.301982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.462 [2024-11-26 19:18:37.302024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.462 qpair failed and we were unable to recover it. 00:32:20.462 [2024-11-26 19:18:37.302216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.462 [2024-11-26 19:18:37.302437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.462 [2024-11-26 19:18:37.302469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.462 qpair failed and we were unable to recover it. 00:32:20.462 [2024-11-26 19:18:37.302651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.462 [2024-11-26 19:18:37.302830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.462 [2024-11-26 19:18:37.302861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.462 qpair failed and we were unable to recover it. 00:32:20.462 [2024-11-26 19:18:37.303047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.462 [2024-11-26 19:18:37.303331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.462 [2024-11-26 19:18:37.303361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.462 qpair failed and we were unable to recover it. 00:32:20.462 [2024-11-26 19:18:37.303484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.463 [2024-11-26 19:18:37.303680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.463 [2024-11-26 19:18:37.303710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.463 qpair failed and we were unable to recover it. 00:32:20.463 [2024-11-26 19:18:37.303883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.463 [2024-11-26 19:18:37.304033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.463 [2024-11-26 19:18:37.304078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.463 qpair failed and we were unable to recover it. 00:32:20.463 [2024-11-26 19:18:37.304208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.463 [2024-11-26 19:18:37.304335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.463 [2024-11-26 19:18:37.304366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.463 qpair failed and we were unable to recover it. 00:32:20.463 [2024-11-26 19:18:37.304550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.463 [2024-11-26 19:18:37.304709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.463 [2024-11-26 19:18:37.304724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.463 qpair failed and we were unable to recover it. 00:32:20.463 [2024-11-26 19:18:37.304876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.463 [2024-11-26 19:18:37.305059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.463 [2024-11-26 19:18:37.305091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.463 qpair failed and we were unable to recover it. 00:32:20.463 [2024-11-26 19:18:37.305213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.463 [2024-11-26 19:18:37.305416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.463 [2024-11-26 19:18:37.305448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.463 qpair failed and we were unable to recover it. 00:32:20.463 [2024-11-26 19:18:37.305550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.463 [2024-11-26 19:18:37.305800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.463 [2024-11-26 19:18:37.305831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.463 qpair failed and we were unable to recover it. 00:32:20.463 [2024-11-26 19:18:37.306010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.463 [2024-11-26 19:18:37.306191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.463 [2024-11-26 19:18:37.306221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.463 qpair failed and we were unable to recover it. 00:32:20.463 [2024-11-26 19:18:37.306422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.463 [2024-11-26 19:18:37.306658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.463 [2024-11-26 19:18:37.306690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.463 qpair failed and we were unable to recover it. 00:32:20.463 [2024-11-26 19:18:37.306887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.463 [2024-11-26 19:18:37.307013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.463 [2024-11-26 19:18:37.307045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.463 qpair failed and we were unable to recover it. 00:32:20.463 [2024-11-26 19:18:37.307225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.463 [2024-11-26 19:18:37.307419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.463 [2024-11-26 19:18:37.307450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.463 qpair failed and we were unable to recover it. 00:32:20.463 [2024-11-26 19:18:37.307635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.463 [2024-11-26 19:18:37.307824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.463 [2024-11-26 19:18:37.307855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.463 qpair failed and we were unable to recover it. 00:32:20.463 [2024-11-26 19:18:37.308048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.463 [2024-11-26 19:18:37.308132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.463 [2024-11-26 19:18:37.308147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.463 qpair failed and we were unable to recover it. 00:32:20.463 [2024-11-26 19:18:37.308330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.463 [2024-11-26 19:18:37.308508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.463 [2024-11-26 19:18:37.308538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.463 qpair failed and we were unable to recover it. 00:32:20.463 [2024-11-26 19:18:37.308684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.463 [2024-11-26 19:18:37.308867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.463 [2024-11-26 19:18:37.308900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.463 qpair failed and we were unable to recover it. 00:32:20.463 [2024-11-26 19:18:37.309052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.463 [2024-11-26 19:18:37.309208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.463 [2024-11-26 19:18:37.309236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.463 qpair failed and we were unable to recover it. 00:32:20.463 [2024-11-26 19:18:37.309356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.463 [2024-11-26 19:18:37.309537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.463 [2024-11-26 19:18:37.309577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.463 qpair failed and we were unable to recover it. 00:32:20.463 [2024-11-26 19:18:37.309822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.463 [2024-11-26 19:18:37.310059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.463 [2024-11-26 19:18:37.310075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.463 qpair failed and we were unable to recover it. 00:32:20.463 [2024-11-26 19:18:37.310285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.463 [2024-11-26 19:18:37.310385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.463 [2024-11-26 19:18:37.310400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.463 qpair failed and we were unable to recover it. 00:32:20.463 [2024-11-26 19:18:37.310562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.463 [2024-11-26 19:18:37.310644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.463 [2024-11-26 19:18:37.310658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.463 qpair failed and we were unable to recover it. 00:32:20.463 [2024-11-26 19:18:37.310742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.463 [2024-11-26 19:18:37.310877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.463 [2024-11-26 19:18:37.310891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.463 qpair failed and we were unable to recover it. 00:32:20.463 [2024-11-26 19:18:37.311097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.463 [2024-11-26 19:18:37.311236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.463 [2024-11-26 19:18:37.311251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.463 qpair failed and we were unable to recover it. 00:32:20.463 [2024-11-26 19:18:37.311411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.463 [2024-11-26 19:18:37.311560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.463 [2024-11-26 19:18:37.311591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.463 qpair failed and we were unable to recover it. 00:32:20.463 [2024-11-26 19:18:37.311731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.463 [2024-11-26 19:18:37.311910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.463 [2024-11-26 19:18:37.311959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.463 qpair failed and we were unable to recover it. 00:32:20.463 [2024-11-26 19:18:37.312186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.463 [2024-11-26 19:18:37.312378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.463 [2024-11-26 19:18:37.312411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.463 qpair failed and we were unable to recover it. 00:32:20.463 [2024-11-26 19:18:37.312550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.463 [2024-11-26 19:18:37.312737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.463 [2024-11-26 19:18:37.312752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.463 qpair failed and we were unable to recover it. 00:32:20.463 [2024-11-26 19:18:37.312902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.463 [2024-11-26 19:18:37.313107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.463 [2024-11-26 19:18:37.313124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.463 qpair failed and we were unable to recover it. 00:32:20.463 [2024-11-26 19:18:37.313210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.463 [2024-11-26 19:18:37.313369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.464 [2024-11-26 19:18:37.313411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.464 qpair failed and we were unable to recover it. 00:32:20.464 [2024-11-26 19:18:37.313546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.464 [2024-11-26 19:18:37.313787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.464 [2024-11-26 19:18:37.313818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.464 qpair failed and we were unable to recover it. 00:32:20.464 [2024-11-26 19:18:37.313943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.464 [2024-11-26 19:18:37.314115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.464 [2024-11-26 19:18:37.314132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.464 qpair failed and we were unable to recover it. 00:32:20.464 [2024-11-26 19:18:37.314306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.464 [2024-11-26 19:18:37.314448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.464 [2024-11-26 19:18:37.314463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.464 qpair failed and we were unable to recover it. 00:32:20.464 [2024-11-26 19:18:37.314544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.464 [2024-11-26 19:18:37.314620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.464 [2024-11-26 19:18:37.314634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.464 qpair failed and we were unable to recover it. 00:32:20.464 [2024-11-26 19:18:37.314786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.743 [2024-11-26 19:18:37.314874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.743 [2024-11-26 19:18:37.314889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.743 qpair failed and we were unable to recover it. 00:32:20.743 [2024-11-26 19:18:37.315032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.743 [2024-11-26 19:18:37.315115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.743 [2024-11-26 19:18:37.315131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.743 qpair failed and we were unable to recover it. 00:32:20.743 [2024-11-26 19:18:37.315213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.743 [2024-11-26 19:18:37.315297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.743 [2024-11-26 19:18:37.315312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.743 qpair failed and we were unable to recover it. 00:32:20.743 [2024-11-26 19:18:37.315400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.743 [2024-11-26 19:18:37.315479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.743 [2024-11-26 19:18:37.315494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.743 qpair failed and we were unable to recover it. 00:32:20.743 [2024-11-26 19:18:37.315585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.743 [2024-11-26 19:18:37.315724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.743 [2024-11-26 19:18:37.315739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.743 qpair failed and we were unable to recover it. 00:32:20.743 [2024-11-26 19:18:37.315842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.743 [2024-11-26 19:18:37.315979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.743 [2024-11-26 19:18:37.315999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.743 qpair failed and we were unable to recover it. 00:32:20.743 [2024-11-26 19:18:37.316077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.743 [2024-11-26 19:18:37.316145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.743 [2024-11-26 19:18:37.316159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.743 qpair failed and we were unable to recover it. 00:32:20.743 [2024-11-26 19:18:37.316237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.743 [2024-11-26 19:18:37.316304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.743 [2024-11-26 19:18:37.316317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.743 qpair failed and we were unable to recover it. 00:32:20.743 [2024-11-26 19:18:37.316408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.743 [2024-11-26 19:18:37.316552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.743 [2024-11-26 19:18:37.316568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.743 qpair failed and we were unable to recover it. 00:32:20.743 [2024-11-26 19:18:37.316723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.743 [2024-11-26 19:18:37.316862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.743 [2024-11-26 19:18:37.316878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.743 qpair failed and we were unable to recover it. 00:32:20.743 [2024-11-26 19:18:37.316971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.743 [2024-11-26 19:18:37.317061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.743 [2024-11-26 19:18:37.317077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.743 qpair failed and we were unable to recover it. 00:32:20.743 [2024-11-26 19:18:37.317295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.743 [2024-11-26 19:18:37.317365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.743 [2024-11-26 19:18:37.317380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.743 qpair failed and we were unable to recover it. 00:32:20.743 [2024-11-26 19:18:37.317639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.743 [2024-11-26 19:18:37.317803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.744 [2024-11-26 19:18:37.317820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.744 qpair failed and we were unable to recover it. 00:32:20.744 [2024-11-26 19:18:37.317914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.744 [2024-11-26 19:18:37.318014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.744 [2024-11-26 19:18:37.318031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.744 qpair failed and we were unable to recover it. 00:32:20.744 [2024-11-26 19:18:37.318207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.744 [2024-11-26 19:18:37.318356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.744 [2024-11-26 19:18:37.318372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.744 qpair failed and we were unable to recover it. 00:32:20.744 [2024-11-26 19:18:37.318463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.744 [2024-11-26 19:18:37.318610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.744 [2024-11-26 19:18:37.318625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.744 qpair failed and we were unable to recover it. 00:32:20.744 [2024-11-26 19:18:37.318773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.744 [2024-11-26 19:18:37.318927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.744 [2024-11-26 19:18:37.318943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.744 qpair failed and we were unable to recover it. 00:32:20.744 [2024-11-26 19:18:37.319040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.744 [2024-11-26 19:18:37.319125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.744 [2024-11-26 19:18:37.319141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.744 qpair failed and we were unable to recover it. 00:32:20.744 [2024-11-26 19:18:37.319365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.744 [2024-11-26 19:18:37.319488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.744 [2024-11-26 19:18:37.319520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.744 qpair failed and we were unable to recover it. 00:32:20.744 [2024-11-26 19:18:37.319727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.744 [2024-11-26 19:18:37.319915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.744 [2024-11-26 19:18:37.319959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.744 qpair failed and we were unable to recover it. 00:32:20.744 [2024-11-26 19:18:37.320131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.744 [2024-11-26 19:18:37.320305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.744 [2024-11-26 19:18:37.320349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.744 qpair failed and we were unable to recover it. 00:32:20.744 [2024-11-26 19:18:37.320558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.744 [2024-11-26 19:18:37.320835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.744 [2024-11-26 19:18:37.320865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.744 qpair failed and we were unable to recover it. 00:32:20.744 [2024-11-26 19:18:37.321071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.744 [2024-11-26 19:18:37.321200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.744 [2024-11-26 19:18:37.321231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.744 qpair failed and we were unable to recover it. 00:32:20.744 [2024-11-26 19:18:37.321468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.744 [2024-11-26 19:18:37.321653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.744 [2024-11-26 19:18:37.321684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.744 qpair failed and we were unable to recover it. 00:32:20.744 [2024-11-26 19:18:37.321878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.744 [2024-11-26 19:18:37.322011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.744 [2024-11-26 19:18:37.322028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.744 qpair failed and we were unable to recover it. 00:32:20.744 [2024-11-26 19:18:37.322170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.744 [2024-11-26 19:18:37.322375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.744 [2024-11-26 19:18:37.322407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.744 qpair failed and we were unable to recover it. 00:32:20.744 [2024-11-26 19:18:37.322650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.744 [2024-11-26 19:18:37.322807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.744 [2024-11-26 19:18:37.322839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.744 qpair failed and we were unable to recover it. 00:32:20.744 [2024-11-26 19:18:37.322972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.744 [2024-11-26 19:18:37.323223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.744 [2024-11-26 19:18:37.323254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.744 qpair failed and we were unable to recover it. 00:32:20.744 [2024-11-26 19:18:37.323372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.744 [2024-11-26 19:18:37.323487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.744 [2024-11-26 19:18:37.323519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.744 qpair failed and we were unable to recover it. 00:32:20.744 [2024-11-26 19:18:37.323690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.744 [2024-11-26 19:18:37.323762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.744 [2024-11-26 19:18:37.323778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.744 qpair failed and we were unable to recover it. 00:32:20.744 [2024-11-26 19:18:37.323851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.744 [2024-11-26 19:18:37.323942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.744 [2024-11-26 19:18:37.323968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.744 qpair failed and we were unable to recover it. 00:32:20.744 [2024-11-26 19:18:37.324047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.744 [2024-11-26 19:18:37.324222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.744 [2024-11-26 19:18:37.324237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.744 qpair failed and we were unable to recover it. 00:32:20.744 [2024-11-26 19:18:37.324331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.744 [2024-11-26 19:18:37.324499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.744 [2024-11-26 19:18:37.324514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.744 qpair failed and we were unable to recover it. 00:32:20.744 [2024-11-26 19:18:37.324658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.744 [2024-11-26 19:18:37.324893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.744 [2024-11-26 19:18:37.324924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.744 qpair failed and we were unable to recover it. 00:32:20.744 [2024-11-26 19:18:37.325067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.745 [2024-11-26 19:18:37.325275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.745 [2024-11-26 19:18:37.325306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.745 qpair failed and we were unable to recover it. 00:32:20.745 [2024-11-26 19:18:37.325494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.745 [2024-11-26 19:18:37.325631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.745 [2024-11-26 19:18:37.325663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.745 qpair failed and we were unable to recover it. 00:32:20.745 [2024-11-26 19:18:37.325801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.745 [2024-11-26 19:18:37.325969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.745 [2024-11-26 19:18:37.326002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.745 qpair failed and we were unable to recover it. 00:32:20.745 [2024-11-26 19:18:37.326268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.745 [2024-11-26 19:18:37.326442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.745 [2024-11-26 19:18:37.326475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.745 qpair failed and we were unable to recover it. 00:32:20.745 [2024-11-26 19:18:37.326678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.745 [2024-11-26 19:18:37.326789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.745 [2024-11-26 19:18:37.326819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.745 qpair failed and we were unable to recover it. 00:32:20.745 [2024-11-26 19:18:37.327018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.745 [2024-11-26 19:18:37.327225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.745 [2024-11-26 19:18:37.327257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.745 qpair failed and we were unable to recover it. 00:32:20.745 [2024-11-26 19:18:37.327461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.745 [2024-11-26 19:18:37.327657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.745 [2024-11-26 19:18:37.327689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.745 qpair failed and we were unable to recover it. 00:32:20.745 [2024-11-26 19:18:37.327839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.745 [2024-11-26 19:18:37.327995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.745 [2024-11-26 19:18:37.328011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.745 qpair failed and we were unable to recover it. 00:32:20.745 [2024-11-26 19:18:37.328103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.745 [2024-11-26 19:18:37.328186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.745 [2024-11-26 19:18:37.328202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.745 qpair failed and we were unable to recover it. 00:32:20.745 [2024-11-26 19:18:37.328371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.745 [2024-11-26 19:18:37.328511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.745 [2024-11-26 19:18:37.328527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.745 qpair failed and we were unable to recover it. 00:32:20.745 [2024-11-26 19:18:37.328698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.745 [2024-11-26 19:18:37.328856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.745 [2024-11-26 19:18:37.328886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.745 qpair failed and we were unable to recover it. 00:32:20.745 [2024-11-26 19:18:37.329008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.745 [2024-11-26 19:18:37.329137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.745 [2024-11-26 19:18:37.329170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.745 qpair failed and we were unable to recover it. 00:32:20.745 [2024-11-26 19:18:37.329308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.745 [2024-11-26 19:18:37.329595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.745 [2024-11-26 19:18:37.329626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.745 qpair failed and we were unable to recover it. 00:32:20.745 [2024-11-26 19:18:37.329826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.745 [2024-11-26 19:18:37.330069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.745 [2024-11-26 19:18:37.330102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.745 qpair failed and we were unable to recover it. 00:32:20.745 [2024-11-26 19:18:37.330293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.745 [2024-11-26 19:18:37.330468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.745 [2024-11-26 19:18:37.330499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.745 qpair failed and we were unable to recover it. 00:32:20.745 [2024-11-26 19:18:37.330694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.745 [2024-11-26 19:18:37.330885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.745 [2024-11-26 19:18:37.330916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.745 qpair failed and we were unable to recover it. 00:32:20.745 [2024-11-26 19:18:37.331061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.745 [2024-11-26 19:18:37.331244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.745 [2024-11-26 19:18:37.331275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.745 qpair failed and we were unable to recover it. 00:32:20.745 [2024-11-26 19:18:37.331415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.745 [2024-11-26 19:18:37.331532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.745 [2024-11-26 19:18:37.331565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.745 qpair failed and we were unable to recover it. 00:32:20.745 [2024-11-26 19:18:37.331804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.745 [2024-11-26 19:18:37.332004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.745 [2024-11-26 19:18:37.332036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.745 qpair failed and we were unable to recover it. 00:32:20.745 [2024-11-26 19:18:37.332225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.745 [2024-11-26 19:18:37.332410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.745 [2024-11-26 19:18:37.332441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.745 qpair failed and we were unable to recover it. 00:32:20.745 [2024-11-26 19:18:37.332702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.745 [2024-11-26 19:18:37.332878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.745 [2024-11-26 19:18:37.332909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.745 qpair failed and we were unable to recover it. 00:32:20.745 [2024-11-26 19:18:37.333043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.745 [2024-11-26 19:18:37.333295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.745 [2024-11-26 19:18:37.333325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.745 qpair failed and we were unable to recover it. 00:32:20.745 [2024-11-26 19:18:37.333451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.745 [2024-11-26 19:18:37.333611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.745 [2024-11-26 19:18:37.333627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.745 qpair failed and we were unable to recover it. 00:32:20.745 [2024-11-26 19:18:37.333709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.745 [2024-11-26 19:18:37.333804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.746 [2024-11-26 19:18:37.333821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.746 qpair failed and we were unable to recover it. 00:32:20.746 [2024-11-26 19:18:37.333908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.746 [2024-11-26 19:18:37.334142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.746 [2024-11-26 19:18:37.334159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.746 qpair failed and we were unable to recover it. 00:32:20.746 [2024-11-26 19:18:37.334250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.746 [2024-11-26 19:18:37.334462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.746 [2024-11-26 19:18:37.334494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.746 qpair failed and we were unable to recover it. 00:32:20.746 [2024-11-26 19:18:37.334699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.746 [2024-11-26 19:18:37.334870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.746 [2024-11-26 19:18:37.334901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.746 qpair failed and we were unable to recover it. 00:32:20.746 [2024-11-26 19:18:37.335043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.746 [2024-11-26 19:18:37.335286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.746 [2024-11-26 19:18:37.335317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.746 qpair failed and we were unable to recover it. 00:32:20.746 [2024-11-26 19:18:37.335505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.746 [2024-11-26 19:18:37.335607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.746 [2024-11-26 19:18:37.335639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.746 qpair failed and we were unable to recover it. 00:32:20.746 [2024-11-26 19:18:37.335813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.746 [2024-11-26 19:18:37.335994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.746 [2024-11-26 19:18:37.336009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.746 qpair failed and we were unable to recover it. 00:32:20.746 [2024-11-26 19:18:37.336181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.746 [2024-11-26 19:18:37.336306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.746 [2024-11-26 19:18:37.336338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.746 qpair failed and we were unable to recover it. 00:32:20.746 [2024-11-26 19:18:37.336439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.746 [2024-11-26 19:18:37.336557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.746 [2024-11-26 19:18:37.336589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.746 qpair failed and we were unable to recover it. 00:32:20.746 [2024-11-26 19:18:37.336717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.746 [2024-11-26 19:18:37.336872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.746 [2024-11-26 19:18:37.336888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.746 qpair failed and we were unable to recover it. 00:32:20.746 [2024-11-26 19:18:37.336978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.746 [2024-11-26 19:18:37.337120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.746 [2024-11-26 19:18:37.337135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.746 qpair failed and we were unable to recover it. 00:32:20.746 [2024-11-26 19:18:37.337204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.746 [2024-11-26 19:18:37.337395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.746 [2024-11-26 19:18:37.337426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.746 qpair failed and we were unable to recover it. 00:32:20.746 [2024-11-26 19:18:37.337599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.746 [2024-11-26 19:18:37.337801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.746 [2024-11-26 19:18:37.337832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.746 qpair failed and we were unable to recover it. 00:32:20.746 [2024-11-26 19:18:37.338016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.746 [2024-11-26 19:18:37.338113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.746 [2024-11-26 19:18:37.338128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.746 qpair failed and we were unable to recover it. 00:32:20.746 [2024-11-26 19:18:37.338292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.746 [2024-11-26 19:18:37.338385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.746 [2024-11-26 19:18:37.338404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.746 qpair failed and we were unable to recover it. 00:32:20.746 [2024-11-26 19:18:37.338479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.746 [2024-11-26 19:18:37.338623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.746 [2024-11-26 19:18:37.338653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.746 qpair failed and we were unable to recover it. 00:32:20.746 [2024-11-26 19:18:37.338848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.746 [2024-11-26 19:18:37.338972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.746 [2024-11-26 19:18:37.339005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.746 qpair failed and we were unable to recover it. 00:32:20.746 [2024-11-26 19:18:37.339187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.746 [2024-11-26 19:18:37.339307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.746 [2024-11-26 19:18:37.339339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.746 qpair failed and we were unable to recover it. 00:32:20.746 [2024-11-26 19:18:37.339528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.746 [2024-11-26 19:18:37.339652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.746 [2024-11-26 19:18:37.339684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.746 qpair failed and we were unable to recover it. 00:32:20.746 [2024-11-26 19:18:37.339857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.746 [2024-11-26 19:18:37.340124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.746 [2024-11-26 19:18:37.340157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.746 qpair failed and we were unable to recover it. 00:32:20.746 [2024-11-26 19:18:37.340277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.746 [2024-11-26 19:18:37.340446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.746 [2024-11-26 19:18:37.340477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.746 qpair failed and we were unable to recover it. 00:32:20.746 [2024-11-26 19:18:37.340677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.746 [2024-11-26 19:18:37.340883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.746 [2024-11-26 19:18:37.340914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.746 qpair failed and we were unable to recover it. 00:32:20.746 [2024-11-26 19:18:37.341080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.747 [2024-11-26 19:18:37.341221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.747 [2024-11-26 19:18:37.341236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.747 qpair failed and we were unable to recover it. 00:32:20.747 [2024-11-26 19:18:37.341326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.747 [2024-11-26 19:18:37.341411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.747 [2024-11-26 19:18:37.341426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.747 qpair failed and we were unable to recover it. 00:32:20.747 [2024-11-26 19:18:37.341636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.747 [2024-11-26 19:18:37.341713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.747 [2024-11-26 19:18:37.341732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.747 qpair failed and we were unable to recover it. 00:32:20.747 [2024-11-26 19:18:37.341830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.747 [2024-11-26 19:18:37.341985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.747 [2024-11-26 19:18:37.342044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.747 qpair failed and we were unable to recover it. 00:32:20.747 [2024-11-26 19:18:37.342244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.747 [2024-11-26 19:18:37.342363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.747 [2024-11-26 19:18:37.342395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.747 qpair failed and we were unable to recover it. 00:32:20.747 [2024-11-26 19:18:37.342507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.747 [2024-11-26 19:18:37.342690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.747 [2024-11-26 19:18:37.342721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.747 qpair failed and we were unable to recover it. 00:32:20.747 [2024-11-26 19:18:37.342982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.747 [2024-11-26 19:18:37.343121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.747 [2024-11-26 19:18:37.343152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.747 qpair failed and we were unable to recover it. 00:32:20.747 [2024-11-26 19:18:37.343333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.747 [2024-11-26 19:18:37.343510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.747 [2024-11-26 19:18:37.343542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.747 qpair failed and we were unable to recover it. 00:32:20.747 [2024-11-26 19:18:37.343774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.747 [2024-11-26 19:18:37.343958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.747 [2024-11-26 19:18:37.343974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.747 qpair failed and we were unable to recover it. 00:32:20.747 [2024-11-26 19:18:37.344090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.747 [2024-11-26 19:18:37.344230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.747 [2024-11-26 19:18:37.344246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.747 qpair failed and we were unable to recover it. 00:32:20.747 [2024-11-26 19:18:37.344382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.747 [2024-11-26 19:18:37.344623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.747 [2024-11-26 19:18:37.344653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.747 qpair failed and we were unable to recover it. 00:32:20.747 [2024-11-26 19:18:37.344794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.747 [2024-11-26 19:18:37.345028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.747 [2024-11-26 19:18:37.345059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.747 qpair failed and we were unable to recover it. 00:32:20.747 [2024-11-26 19:18:37.345231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.747 [2024-11-26 19:18:37.345409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.747 [2024-11-26 19:18:37.345440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.747 qpair failed and we were unable to recover it. 00:32:20.747 [2024-11-26 19:18:37.345562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.747 [2024-11-26 19:18:37.345823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.747 [2024-11-26 19:18:37.345855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.747 qpair failed and we were unable to recover it. 00:32:20.747 [2024-11-26 19:18:37.345985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.747 [2024-11-26 19:18:37.346123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.747 [2024-11-26 19:18:37.346139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.747 qpair failed and we were unable to recover it. 00:32:20.747 [2024-11-26 19:18:37.346296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.747 [2024-11-26 19:18:37.346473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.747 [2024-11-26 19:18:37.346504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.747 qpair failed and we were unable to recover it. 00:32:20.747 [2024-11-26 19:18:37.346713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.747 [2024-11-26 19:18:37.346960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.747 [2024-11-26 19:18:37.346993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.747 qpair failed and we were unable to recover it. 00:32:20.747 [2024-11-26 19:18:37.347187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.747 [2024-11-26 19:18:37.347369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.747 [2024-11-26 19:18:37.347399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.747 qpair failed and we were unable to recover it. 00:32:20.747 [2024-11-26 19:18:37.347606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.747 [2024-11-26 19:18:37.347709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.747 [2024-11-26 19:18:37.347740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.747 qpair failed and we were unable to recover it. 00:32:20.747 [2024-11-26 19:18:37.347868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.747 [2024-11-26 19:18:37.348054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.747 [2024-11-26 19:18:37.348087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.747 qpair failed and we were unable to recover it. 00:32:20.747 [2024-11-26 19:18:37.348330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.747 [2024-11-26 19:18:37.348443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.747 [2024-11-26 19:18:37.348458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.747 qpair failed and we were unable to recover it. 00:32:20.747 [2024-11-26 19:18:37.348687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.747 [2024-11-26 19:18:37.348836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.747 [2024-11-26 19:18:37.348852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.747 qpair failed and we were unable to recover it. 00:32:20.747 [2024-11-26 19:18:37.348990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.747 [2024-11-26 19:18:37.349157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.747 [2024-11-26 19:18:37.349172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.747 qpair failed and we were unable to recover it. 00:32:20.747 [2024-11-26 19:18:37.349255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.747 [2024-11-26 19:18:37.349401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.747 [2024-11-26 19:18:37.349416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.747 qpair failed and we were unable to recover it. 00:32:20.747 [2024-11-26 19:18:37.349554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.747 [2024-11-26 19:18:37.349714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.748 [2024-11-26 19:18:37.349729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.748 qpair failed and we were unable to recover it. 00:32:20.748 [2024-11-26 19:18:37.349851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.748 [2024-11-26 19:18:37.350024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.748 [2024-11-26 19:18:37.350057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.748 qpair failed and we were unable to recover it. 00:32:20.748 [2024-11-26 19:18:37.350180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.748 [2024-11-26 19:18:37.350279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.748 [2024-11-26 19:18:37.350295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.748 qpair failed and we were unable to recover it. 00:32:20.748 [2024-11-26 19:18:37.350463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.748 [2024-11-26 19:18:37.350584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.748 [2024-11-26 19:18:37.350616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.748 qpair failed and we were unable to recover it. 00:32:20.748 [2024-11-26 19:18:37.350786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.748 [2024-11-26 19:18:37.351023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.748 [2024-11-26 19:18:37.351039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.748 qpair failed and we were unable to recover it. 00:32:20.748 [2024-11-26 19:18:37.351111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.748 [2024-11-26 19:18:37.351180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.748 [2024-11-26 19:18:37.351194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.748 qpair failed and we were unable to recover it. 00:32:20.748 [2024-11-26 19:18:37.351408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.748 [2024-11-26 19:18:37.351583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.748 [2024-11-26 19:18:37.351615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.748 qpair failed and we were unable to recover it. 00:32:20.748 [2024-11-26 19:18:37.351741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.748 [2024-11-26 19:18:37.351910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.748 [2024-11-26 19:18:37.351942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.748 qpair failed and we were unable to recover it. 00:32:20.748 [2024-11-26 19:18:37.352072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.748 [2024-11-26 19:18:37.352350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.748 [2024-11-26 19:18:37.352381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.748 qpair failed and we were unable to recover it. 00:32:20.748 [2024-11-26 19:18:37.352552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.748 [2024-11-26 19:18:37.352760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.748 [2024-11-26 19:18:37.352797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.748 qpair failed and we were unable to recover it. 00:32:20.748 [2024-11-26 19:18:37.352952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.748 [2024-11-26 19:18:37.353058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.748 [2024-11-26 19:18:37.353074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.748 qpair failed and we were unable to recover it. 00:32:20.748 [2024-11-26 19:18:37.353291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.748 [2024-11-26 19:18:37.353453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.748 [2024-11-26 19:18:37.353469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.748 qpair failed and we were unable to recover it. 00:32:20.748 [2024-11-26 19:18:37.353621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.748 [2024-11-26 19:18:37.353717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.748 [2024-11-26 19:18:37.353733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.748 qpair failed and we were unable to recover it. 00:32:20.748 [2024-11-26 19:18:37.353885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.748 [2024-11-26 19:18:37.353981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.748 [2024-11-26 19:18:37.353998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.748 qpair failed and we were unable to recover it. 00:32:20.748 [2024-11-26 19:18:37.354099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.748 [2024-11-26 19:18:37.354287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.748 [2024-11-26 19:18:37.354302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.748 qpair failed and we were unable to recover it. 00:32:20.748 [2024-11-26 19:18:37.354440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.748 [2024-11-26 19:18:37.354556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.748 [2024-11-26 19:18:37.354588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.748 qpair failed and we were unable to recover it. 00:32:20.748 [2024-11-26 19:18:37.354765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.748 [2024-11-26 19:18:37.354876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.748 [2024-11-26 19:18:37.354907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.748 qpair failed and we were unable to recover it. 00:32:20.748 [2024-11-26 19:18:37.355105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.748 [2024-11-26 19:18:37.355229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.748 [2024-11-26 19:18:37.355259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.748 qpair failed and we were unable to recover it. 00:32:20.748 [2024-11-26 19:18:37.355398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.748 [2024-11-26 19:18:37.355592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.748 [2024-11-26 19:18:37.355623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.748 qpair failed and we were unable to recover it. 00:32:20.748 [2024-11-26 19:18:37.355809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.748 [2024-11-26 19:18:37.355955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.748 [2024-11-26 19:18:37.355987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.748 qpair failed and we were unable to recover it. 00:32:20.748 [2024-11-26 19:18:37.356170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.748 [2024-11-26 19:18:37.356360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.748 [2024-11-26 19:18:37.356391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.748 qpair failed and we were unable to recover it. 00:32:20.748 [2024-11-26 19:18:37.356567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.748 [2024-11-26 19:18:37.356749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.748 [2024-11-26 19:18:37.356779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.748 qpair failed and we were unable to recover it. 00:32:20.748 [2024-11-26 19:18:37.356955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.748 [2024-11-26 19:18:37.357041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.748 [2024-11-26 19:18:37.357057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.748 qpair failed and we were unable to recover it. 00:32:20.748 [2024-11-26 19:18:37.357212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.748 [2024-11-26 19:18:37.357422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.749 [2024-11-26 19:18:37.357438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.749 qpair failed and we were unable to recover it. 00:32:20.749 [2024-11-26 19:18:37.357525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.749 [2024-11-26 19:18:37.357670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.749 [2024-11-26 19:18:37.357685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.749 qpair failed and we were unable to recover it. 00:32:20.749 [2024-11-26 19:18:37.357774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.749 [2024-11-26 19:18:37.357857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.749 [2024-11-26 19:18:37.357871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.749 qpair failed and we were unable to recover it. 00:32:20.749 [2024-11-26 19:18:37.357958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.749 [2024-11-26 19:18:37.358042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.749 [2024-11-26 19:18:37.358055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.749 qpair failed and we were unable to recover it. 00:32:20.749 [2024-11-26 19:18:37.358208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.749 [2024-11-26 19:18:37.358295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.749 [2024-11-26 19:18:37.358310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.749 qpair failed and we were unable to recover it. 00:32:20.749 [2024-11-26 19:18:37.358470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.749 [2024-11-26 19:18:37.358557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.749 [2024-11-26 19:18:37.358572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.749 qpair failed and we were unable to recover it. 00:32:20.749 [2024-11-26 19:18:37.358655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.749 [2024-11-26 19:18:37.358796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.749 [2024-11-26 19:18:37.358833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.749 qpair failed and we were unable to recover it. 00:32:20.749 [2024-11-26 19:18:37.358967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.749 [2024-11-26 19:18:37.359143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.749 [2024-11-26 19:18:37.359174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.749 qpair failed and we were unable to recover it. 00:32:20.749 [2024-11-26 19:18:37.359352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.749 [2024-11-26 19:18:37.359629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.749 [2024-11-26 19:18:37.359660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.749 qpair failed and we were unable to recover it. 00:32:20.749 [2024-11-26 19:18:37.359853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.749 [2024-11-26 19:18:37.360024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.749 [2024-11-26 19:18:37.360056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.749 qpair failed and we were unable to recover it. 00:32:20.749 [2024-11-26 19:18:37.360171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.749 [2024-11-26 19:18:37.360379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.749 [2024-11-26 19:18:37.360411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.749 qpair failed and we were unable to recover it. 00:32:20.749 [2024-11-26 19:18:37.360610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.749 [2024-11-26 19:18:37.360871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.749 [2024-11-26 19:18:37.360903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.749 qpair failed and we were unable to recover it. 00:32:20.749 [2024-11-26 19:18:37.361125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.749 [2024-11-26 19:18:37.361293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.749 [2024-11-26 19:18:37.361325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.749 qpair failed and we were unable to recover it. 00:32:20.749 [2024-11-26 19:18:37.361573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.749 [2024-11-26 19:18:37.361744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.749 [2024-11-26 19:18:37.361759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.749 qpair failed and we were unable to recover it. 00:32:20.749 [2024-11-26 19:18:37.361916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.749 [2024-11-26 19:18:37.362145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.749 [2024-11-26 19:18:37.362178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.749 qpair failed and we were unable to recover it. 00:32:20.749 [2024-11-26 19:18:37.362353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.749 [2024-11-26 19:18:37.362554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.749 [2024-11-26 19:18:37.362585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.749 qpair failed and we were unable to recover it. 00:32:20.749 [2024-11-26 19:18:37.362770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.749 [2024-11-26 19:18:37.362902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.749 [2024-11-26 19:18:37.362934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.749 qpair failed and we were unable to recover it. 00:32:20.749 [2024-11-26 19:18:37.363154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.749 [2024-11-26 19:18:37.363244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.749 [2024-11-26 19:18:37.363259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.749 qpair failed and we were unable to recover it. 00:32:20.749 [2024-11-26 19:18:37.363419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.749 [2024-11-26 19:18:37.363572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.749 [2024-11-26 19:18:37.363588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.749 qpair failed and we were unable to recover it. 00:32:20.749 [2024-11-26 19:18:37.363802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.749 [2024-11-26 19:18:37.363978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.750 [2024-11-26 19:18:37.364011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.750 qpair failed and we were unable to recover it. 00:32:20.750 [2024-11-26 19:18:37.364142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.750 [2024-11-26 19:18:37.364321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.750 [2024-11-26 19:18:37.364352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.750 qpair failed and we were unable to recover it. 00:32:20.750 [2024-11-26 19:18:37.364548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.750 [2024-11-26 19:18:37.364757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.750 [2024-11-26 19:18:37.364788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.750 qpair failed and we were unable to recover it. 00:32:20.750 [2024-11-26 19:18:37.364985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.750 [2024-11-26 19:18:37.365160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.750 [2024-11-26 19:18:37.365193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.750 qpair failed and we were unable to recover it. 00:32:20.750 [2024-11-26 19:18:37.365315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.750 [2024-11-26 19:18:37.365422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.750 [2024-11-26 19:18:37.365455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.750 qpair failed and we were unable to recover it. 00:32:20.750 [2024-11-26 19:18:37.365563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.750 [2024-11-26 19:18:37.365691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.750 [2024-11-26 19:18:37.365707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.750 qpair failed and we were unable to recover it. 00:32:20.750 [2024-11-26 19:18:37.365786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.750 [2024-11-26 19:18:37.365986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.750 [2024-11-26 19:18:37.366001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.750 qpair failed and we were unable to recover it. 00:32:20.750 [2024-11-26 19:18:37.366173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.750 [2024-11-26 19:18:37.366266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.750 [2024-11-26 19:18:37.366282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.750 qpair failed and we were unable to recover it. 00:32:20.750 [2024-11-26 19:18:37.366426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.750 [2024-11-26 19:18:37.366574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.750 [2024-11-26 19:18:37.366590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.750 qpair failed and we were unable to recover it. 00:32:20.750 [2024-11-26 19:18:37.366745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.750 [2024-11-26 19:18:37.366837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.750 [2024-11-26 19:18:37.366870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.750 qpair failed and we were unable to recover it. 00:32:20.750 [2024-11-26 19:18:37.367045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.750 [2024-11-26 19:18:37.367170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.750 [2024-11-26 19:18:37.367201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.750 qpair failed and we were unable to recover it. 00:32:20.750 [2024-11-26 19:18:37.367326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.750 [2024-11-26 19:18:37.367433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.750 [2024-11-26 19:18:37.367464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.750 qpair failed and we were unable to recover it. 00:32:20.750 [2024-11-26 19:18:37.367590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.750 [2024-11-26 19:18:37.367699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.750 [2024-11-26 19:18:37.367731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.750 qpair failed and we were unable to recover it. 00:32:20.750 [2024-11-26 19:18:37.367911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.750 [2024-11-26 19:18:37.368154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.750 [2024-11-26 19:18:37.368187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.750 qpair failed and we were unable to recover it. 00:32:20.750 [2024-11-26 19:18:37.368363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.750 [2024-11-26 19:18:37.368565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.750 [2024-11-26 19:18:37.368596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.750 qpair failed and we were unable to recover it. 00:32:20.750 [2024-11-26 19:18:37.368802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.750 [2024-11-26 19:18:37.368909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.750 [2024-11-26 19:18:37.368941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.750 qpair failed and we were unable to recover it. 00:32:20.750 [2024-11-26 19:18:37.369166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.750 [2024-11-26 19:18:37.369344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.750 [2024-11-26 19:18:37.369374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.750 qpair failed and we were unable to recover it. 00:32:20.750 [2024-11-26 19:18:37.369572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.750 [2024-11-26 19:18:37.369660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.750 [2024-11-26 19:18:37.369675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.750 qpair failed and we were unable to recover it. 00:32:20.750 [2024-11-26 19:18:37.369938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.750 [2024-11-26 19:18:37.370208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.750 [2024-11-26 19:18:37.370239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.750 qpair failed and we were unable to recover it. 00:32:20.750 [2024-11-26 19:18:37.370481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.750 [2024-11-26 19:18:37.370652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.750 [2024-11-26 19:18:37.370683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.750 qpair failed and we were unable to recover it. 00:32:20.750 [2024-11-26 19:18:37.370855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.750 [2024-11-26 19:18:37.370953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.750 [2024-11-26 19:18:37.370969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.750 qpair failed and we were unable to recover it. 00:32:20.750 [2024-11-26 19:18:37.371117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.750 [2024-11-26 19:18:37.371345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.750 [2024-11-26 19:18:37.371377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.750 qpair failed and we were unable to recover it. 00:32:20.750 [2024-11-26 19:18:37.371641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.750 [2024-11-26 19:18:37.371826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.750 [2024-11-26 19:18:37.371859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.750 qpair failed and we were unable to recover it. 00:32:20.750 [2024-11-26 19:18:37.371994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.750 [2024-11-26 19:18:37.372191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.750 [2024-11-26 19:18:37.372223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.750 qpair failed and we were unable to recover it. 00:32:20.751 [2024-11-26 19:18:37.372396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.751 [2024-11-26 19:18:37.372598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.751 [2024-11-26 19:18:37.372629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.751 qpair failed and we were unable to recover it. 00:32:20.751 [2024-11-26 19:18:37.372837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.751 [2024-11-26 19:18:37.373022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.751 [2024-11-26 19:18:37.373054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.751 qpair failed and we were unable to recover it. 00:32:20.751 [2024-11-26 19:18:37.373231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.751 [2024-11-26 19:18:37.373426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.751 [2024-11-26 19:18:37.373458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.751 qpair failed and we were unable to recover it. 00:32:20.751 [2024-11-26 19:18:37.373673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.751 [2024-11-26 19:18:37.373791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.751 [2024-11-26 19:18:37.373807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.751 qpair failed and we were unable to recover it. 00:32:20.751 [2024-11-26 19:18:37.374010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.751 [2024-11-26 19:18:37.374181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.751 [2024-11-26 19:18:37.374216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.751 qpair failed and we were unable to recover it. 00:32:20.751 [2024-11-26 19:18:37.374325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.751 [2024-11-26 19:18:37.374487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.751 [2024-11-26 19:18:37.374519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.751 qpair failed and we were unable to recover it. 00:32:20.751 [2024-11-26 19:18:37.374643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.751 [2024-11-26 19:18:37.374907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.751 [2024-11-26 19:18:37.374939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.751 qpair failed and we were unable to recover it. 00:32:20.751 [2024-11-26 19:18:37.375161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.751 [2024-11-26 19:18:37.375358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.751 [2024-11-26 19:18:37.375388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.751 qpair failed and we were unable to recover it. 00:32:20.751 [2024-11-26 19:18:37.375519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.751 [2024-11-26 19:18:37.375701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.751 [2024-11-26 19:18:37.375732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.751 qpair failed and we were unable to recover it. 00:32:20.751 [2024-11-26 19:18:37.375944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.751 [2024-11-26 19:18:37.376213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.751 [2024-11-26 19:18:37.376244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.751 qpair failed and we were unable to recover it. 00:32:20.751 [2024-11-26 19:18:37.376427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.751 [2024-11-26 19:18:37.376621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.751 [2024-11-26 19:18:37.376652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.751 qpair failed and we were unable to recover it. 00:32:20.751 [2024-11-26 19:18:37.376826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.751 [2024-11-26 19:18:37.377069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.751 [2024-11-26 19:18:37.377102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.751 qpair failed and we were unable to recover it. 00:32:20.751 [2024-11-26 19:18:37.377293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.751 [2024-11-26 19:18:37.377474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.751 [2024-11-26 19:18:37.377505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.751 qpair failed and we were unable to recover it. 00:32:20.751 [2024-11-26 19:18:37.377684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.751 [2024-11-26 19:18:37.377856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.751 [2024-11-26 19:18:37.377871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.751 qpair failed and we were unable to recover it. 00:32:20.751 [2024-11-26 19:18:37.378020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.751 [2024-11-26 19:18:37.378156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.751 [2024-11-26 19:18:37.378175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.751 qpair failed and we were unable to recover it. 00:32:20.751 [2024-11-26 19:18:37.378282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.751 [2024-11-26 19:18:37.378362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.751 [2024-11-26 19:18:37.378377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.751 qpair failed and we were unable to recover it. 00:32:20.751 [2024-11-26 19:18:37.378530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.751 [2024-11-26 19:18:37.378658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.751 [2024-11-26 19:18:37.378690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.751 qpair failed and we were unable to recover it. 00:32:20.751 [2024-11-26 19:18:37.378808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.751 [2024-11-26 19:18:37.379043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.751 [2024-11-26 19:18:37.379073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.751 qpair failed and we were unable to recover it. 00:32:20.751 [2024-11-26 19:18:37.379271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.751 [2024-11-26 19:18:37.379392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.751 [2024-11-26 19:18:37.379424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.751 qpair failed and we were unable to recover it. 00:32:20.751 [2024-11-26 19:18:37.379606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.751 [2024-11-26 19:18:37.379806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.751 [2024-11-26 19:18:37.379837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.751 qpair failed and we were unable to recover it. 00:32:20.751 [2024-11-26 19:18:37.380025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.751 [2024-11-26 19:18:37.380237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.751 [2024-11-26 19:18:37.380268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.751 qpair failed and we were unable to recover it. 00:32:20.751 [2024-11-26 19:18:37.380447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.751 [2024-11-26 19:18:37.380550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.751 [2024-11-26 19:18:37.380580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.751 qpair failed and we were unable to recover it. 00:32:20.752 [2024-11-26 19:18:37.380703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.752 [2024-11-26 19:18:37.380879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.752 [2024-11-26 19:18:37.380894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.752 qpair failed and we were unable to recover it. 00:32:20.752 [2024-11-26 19:18:37.381136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.752 [2024-11-26 19:18:37.381245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.752 [2024-11-26 19:18:37.381277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.752 qpair failed and we were unable to recover it. 00:32:20.752 [2024-11-26 19:18:37.381504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.752 [2024-11-26 19:18:37.381712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.752 [2024-11-26 19:18:37.381745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.752 qpair failed and we were unable to recover it. 00:32:20.752 [2024-11-26 19:18:37.381971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.752 [2024-11-26 19:18:37.382125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.752 [2024-11-26 19:18:37.382157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.752 qpair failed and we were unable to recover it. 00:32:20.752 [2024-11-26 19:18:37.382285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.752 [2024-11-26 19:18:37.382466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.752 [2024-11-26 19:18:37.382497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.752 qpair failed and we were unable to recover it. 00:32:20.752 [2024-11-26 19:18:37.382682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.752 [2024-11-26 19:18:37.382786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.752 [2024-11-26 19:18:37.382816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.752 qpair failed and we were unable to recover it. 00:32:20.752 [2024-11-26 19:18:37.382943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.752 [2024-11-26 19:18:37.383207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.752 [2024-11-26 19:18:37.383239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.752 qpair failed and we were unable to recover it. 00:32:20.752 [2024-11-26 19:18:37.383478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.752 [2024-11-26 19:18:37.383607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.752 [2024-11-26 19:18:37.383638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.752 qpair failed and we were unable to recover it. 00:32:20.752 [2024-11-26 19:18:37.383759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.752 [2024-11-26 19:18:37.383941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.752 [2024-11-26 19:18:37.383982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.752 qpair failed and we were unable to recover it. 00:32:20.752 [2024-11-26 19:18:37.384244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.752 [2024-11-26 19:18:37.384351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.752 [2024-11-26 19:18:37.384381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.752 qpair failed and we were unable to recover it. 00:32:20.752 [2024-11-26 19:18:37.384575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.752 [2024-11-26 19:18:37.384758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.752 [2024-11-26 19:18:37.384790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.752 qpair failed and we were unable to recover it. 00:32:20.752 [2024-11-26 19:18:37.384970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.752 [2024-11-26 19:18:37.385122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.752 [2024-11-26 19:18:37.385154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.752 qpair failed and we were unable to recover it. 00:32:20.752 [2024-11-26 19:18:37.385253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.752 [2024-11-26 19:18:37.385437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.752 [2024-11-26 19:18:37.385469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.752 qpair failed and we were unable to recover it. 00:32:20.752 [2024-11-26 19:18:37.385661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.752 [2024-11-26 19:18:37.385776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.752 [2024-11-26 19:18:37.385792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.752 qpair failed and we were unable to recover it. 00:32:20.752 [2024-11-26 19:18:37.386006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.752 [2024-11-26 19:18:37.386206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.752 [2024-11-26 19:18:37.386237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.752 qpair failed and we were unable to recover it. 00:32:20.752 [2024-11-26 19:18:37.386368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.752 [2024-11-26 19:18:37.386552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.752 [2024-11-26 19:18:37.386582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.752 qpair failed and we were unable to recover it. 00:32:20.752 [2024-11-26 19:18:37.386688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.752 [2024-11-26 19:18:37.386863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.752 [2024-11-26 19:18:37.386895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.752 qpair failed and we were unable to recover it. 00:32:20.752 [2024-11-26 19:18:37.387161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.752 [2024-11-26 19:18:37.387364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.752 [2024-11-26 19:18:37.387396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.752 qpair failed and we were unable to recover it. 00:32:20.752 [2024-11-26 19:18:37.387518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.752 [2024-11-26 19:18:37.387762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.752 [2024-11-26 19:18:37.387792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.752 qpair failed and we were unable to recover it. 00:32:20.752 [2024-11-26 19:18:37.387982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.752 [2024-11-26 19:18:37.388153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.752 [2024-11-26 19:18:37.388186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.752 qpair failed and we were unable to recover it. 00:32:20.752 [2024-11-26 19:18:37.388326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.752 [2024-11-26 19:18:37.388490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.752 [2024-11-26 19:18:37.388522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.752 qpair failed and we were unable to recover it. 00:32:20.752 [2024-11-26 19:18:37.388639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.752 [2024-11-26 19:18:37.388812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.752 [2024-11-26 19:18:37.388827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.752 qpair failed and we were unable to recover it. 00:32:20.752 [2024-11-26 19:18:37.388909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.752 [2024-11-26 19:18:37.388995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.753 [2024-11-26 19:18:37.389010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.753 qpair failed and we were unable to recover it. 00:32:20.753 [2024-11-26 19:18:37.389167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.753 [2024-11-26 19:18:37.389342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.753 [2024-11-26 19:18:37.389357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.753 qpair failed and we were unable to recover it. 00:32:20.753 [2024-11-26 19:18:37.389497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.753 [2024-11-26 19:18:37.389570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.753 [2024-11-26 19:18:37.389585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.753 qpair failed and we were unable to recover it. 00:32:20.753 [2024-11-26 19:18:37.389656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.753 [2024-11-26 19:18:37.389729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.753 [2024-11-26 19:18:37.389744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.753 qpair failed and we were unable to recover it. 00:32:20.753 [2024-11-26 19:18:37.389904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.753 [2024-11-26 19:18:37.389972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.753 [2024-11-26 19:18:37.389987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.753 qpair failed and we were unable to recover it. 00:32:20.753 [2024-11-26 19:18:37.390128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.753 [2024-11-26 19:18:37.390286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.753 [2024-11-26 19:18:37.390318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.753 qpair failed and we were unable to recover it. 00:32:20.753 [2024-11-26 19:18:37.390495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.753 [2024-11-26 19:18:37.390703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.753 [2024-11-26 19:18:37.390734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.753 qpair failed and we were unable to recover it. 00:32:20.753 [2024-11-26 19:18:37.390944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.753 [2024-11-26 19:18:37.391216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.753 [2024-11-26 19:18:37.391247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.753 qpair failed and we were unable to recover it. 00:32:20.753 [2024-11-26 19:18:37.391443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.753 [2024-11-26 19:18:37.391725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.753 [2024-11-26 19:18:37.391758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.753 qpair failed and we were unable to recover it. 00:32:20.753 [2024-11-26 19:18:37.392026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.753 [2024-11-26 19:18:37.392206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.753 [2024-11-26 19:18:37.392238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.753 qpair failed and we were unable to recover it. 00:32:20.753 [2024-11-26 19:18:37.392414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.753 [2024-11-26 19:18:37.392529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.753 [2024-11-26 19:18:37.392560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.753 qpair failed and we were unable to recover it. 00:32:20.753 [2024-11-26 19:18:37.392735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.753 [2024-11-26 19:18:37.392912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.753 [2024-11-26 19:18:37.392931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.753 qpair failed and we were unable to recover it. 00:32:20.753 [2024-11-26 19:18:37.393138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.753 [2024-11-26 19:18:37.393231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.753 [2024-11-26 19:18:37.393246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.753 qpair failed and we were unable to recover it. 00:32:20.753 [2024-11-26 19:18:37.393395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.753 [2024-11-26 19:18:37.393567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.753 [2024-11-26 19:18:37.393599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.753 qpair failed and we were unable to recover it. 00:32:20.753 [2024-11-26 19:18:37.393722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.753 [2024-11-26 19:18:37.393932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.753 [2024-11-26 19:18:37.393973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.753 qpair failed and we were unable to recover it. 00:32:20.753 [2024-11-26 19:18:37.394184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.753 [2024-11-26 19:18:37.394417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.753 [2024-11-26 19:18:37.394447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.753 qpair failed and we were unable to recover it. 00:32:20.753 [2024-11-26 19:18:37.394624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.753 [2024-11-26 19:18:37.394823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.753 [2024-11-26 19:18:37.394855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.753 qpair failed and we were unable to recover it. 00:32:20.753 [2024-11-26 19:18:37.395057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.753 [2024-11-26 19:18:37.395216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.753 [2024-11-26 19:18:37.395231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.753 qpair failed and we were unable to recover it. 00:32:20.753 [2024-11-26 19:18:37.395381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.753 [2024-11-26 19:18:37.395504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.753 [2024-11-26 19:18:37.395534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.753 qpair failed and we were unable to recover it. 00:32:20.753 [2024-11-26 19:18:37.395656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.753 [2024-11-26 19:18:37.395845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.753 [2024-11-26 19:18:37.395877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.753 qpair failed and we were unable to recover it. 00:32:20.753 [2024-11-26 19:18:37.396073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.753 [2024-11-26 19:18:37.396213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.753 [2024-11-26 19:18:37.396228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.753 qpair failed and we were unable to recover it. 00:32:20.753 [2024-11-26 19:18:37.396448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.753 [2024-11-26 19:18:37.396615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.753 [2024-11-26 19:18:37.396634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.753 qpair failed and we were unable to recover it. 00:32:20.753 [2024-11-26 19:18:37.396773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.753 [2024-11-26 19:18:37.396914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.754 [2024-11-26 19:18:37.396945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.754 qpair failed and we were unable to recover it. 00:32:20.754 [2024-11-26 19:18:37.397084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.754 [2024-11-26 19:18:37.397272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.754 [2024-11-26 19:18:37.397304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.754 qpair failed and we were unable to recover it. 00:32:20.754 [2024-11-26 19:18:37.397492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.754 [2024-11-26 19:18:37.397616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.754 [2024-11-26 19:18:37.397647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.754 qpair failed and we were unable to recover it. 00:32:20.754 [2024-11-26 19:18:37.397830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.754 [2024-11-26 19:18:37.397959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.754 [2024-11-26 19:18:37.397992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.754 qpair failed and we were unable to recover it. 00:32:20.754 [2024-11-26 19:18:37.398193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.754 [2024-11-26 19:18:37.398320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.754 [2024-11-26 19:18:37.398350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.754 qpair failed and we were unable to recover it. 00:32:20.754 [2024-11-26 19:18:37.398541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.754 [2024-11-26 19:18:37.398721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.754 [2024-11-26 19:18:37.398753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.754 qpair failed and we were unable to recover it. 00:32:20.754 [2024-11-26 19:18:37.398935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.754 [2024-11-26 19:18:37.399030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.754 [2024-11-26 19:18:37.399047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.754 qpair failed and we were unable to recover it. 00:32:20.754 [2024-11-26 19:18:37.399209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.754 [2024-11-26 19:18:37.399401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.754 [2024-11-26 19:18:37.399432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.754 qpair failed and we were unable to recover it. 00:32:20.754 [2024-11-26 19:18:37.399573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.754 [2024-11-26 19:18:37.399690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.754 [2024-11-26 19:18:37.399722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.754 qpair failed and we were unable to recover it. 00:32:20.754 [2024-11-26 19:18:37.399839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.754 [2024-11-26 19:18:37.400082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.754 [2024-11-26 19:18:37.400114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.754 qpair failed and we were unable to recover it. 00:32:20.754 [2024-11-26 19:18:37.400251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.754 [2024-11-26 19:18:37.400390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.754 [2024-11-26 19:18:37.400421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.754 qpair failed and we were unable to recover it. 00:32:20.754 [2024-11-26 19:18:37.400601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.754 [2024-11-26 19:18:37.400792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.754 [2024-11-26 19:18:37.400823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.754 qpair failed and we were unable to recover it. 00:32:20.754 [2024-11-26 19:18:37.401002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.754 [2024-11-26 19:18:37.401242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.754 [2024-11-26 19:18:37.401273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.754 qpair failed and we were unable to recover it. 00:32:20.754 [2024-11-26 19:18:37.401466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.754 [2024-11-26 19:18:37.401661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.754 [2024-11-26 19:18:37.401692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.754 qpair failed and we were unable to recover it. 00:32:20.754 [2024-11-26 19:18:37.401924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.754 [2024-11-26 19:18:37.402013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.754 [2024-11-26 19:18:37.402028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.754 qpair failed and we were unable to recover it. 00:32:20.754 [2024-11-26 19:18:37.402106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.754 [2024-11-26 19:18:37.402329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.754 [2024-11-26 19:18:37.402361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.754 qpair failed and we were unable to recover it. 00:32:20.754 [2024-11-26 19:18:37.402543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.754 [2024-11-26 19:18:37.402657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.754 [2024-11-26 19:18:37.402689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.754 qpair failed and we were unable to recover it. 00:32:20.754 [2024-11-26 19:18:37.402797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.754 [2024-11-26 19:18:37.402910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.754 [2024-11-26 19:18:37.402942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.754 qpair failed and we were unable to recover it. 00:32:20.754 [2024-11-26 19:18:37.403070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.754 [2024-11-26 19:18:37.403232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.754 [2024-11-26 19:18:37.403248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.754 qpair failed and we were unable to recover it. 00:32:20.754 [2024-11-26 19:18:37.403334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.754 [2024-11-26 19:18:37.403503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.754 [2024-11-26 19:18:37.403534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.754 qpair failed and we were unable to recover it. 00:32:20.754 [2024-11-26 19:18:37.403812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.754 [2024-11-26 19:18:37.404077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.754 [2024-11-26 19:18:37.404110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.754 qpair failed and we were unable to recover it. 00:32:20.754 [2024-11-26 19:18:37.404278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.754 [2024-11-26 19:18:37.404361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.754 [2024-11-26 19:18:37.404376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.754 qpair failed and we were unable to recover it. 00:32:20.754 [2024-11-26 19:18:37.404589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.755 [2024-11-26 19:18:37.404760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.755 [2024-11-26 19:18:37.404790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.755 qpair failed and we were unable to recover it. 00:32:20.755 [2024-11-26 19:18:37.405056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.755 [2024-11-26 19:18:37.405232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.755 [2024-11-26 19:18:37.405264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.755 qpair failed and we were unable to recover it. 00:32:20.755 [2024-11-26 19:18:37.405526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.755 [2024-11-26 19:18:37.405783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.755 [2024-11-26 19:18:37.405799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.755 qpair failed and we were unable to recover it. 00:32:20.755 [2024-11-26 19:18:37.405957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.755 [2024-11-26 19:18:37.406114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.755 [2024-11-26 19:18:37.406144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.755 qpair failed and we were unable to recover it. 00:32:20.755 [2024-11-26 19:18:37.406265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.755 [2024-11-26 19:18:37.406395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.755 [2024-11-26 19:18:37.406426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.755 qpair failed and we were unable to recover it. 00:32:20.755 [2024-11-26 19:18:37.406621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.755 [2024-11-26 19:18:37.406798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.755 [2024-11-26 19:18:37.406829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.755 qpair failed and we were unable to recover it. 00:32:20.755 [2024-11-26 19:18:37.406945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.755 [2024-11-26 19:18:37.407118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.755 [2024-11-26 19:18:37.407134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.755 qpair failed and we were unable to recover it. 00:32:20.755 [2024-11-26 19:18:37.407281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.755 [2024-11-26 19:18:37.407394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.755 [2024-11-26 19:18:37.407425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.755 qpair failed and we were unable to recover it. 00:32:20.755 [2024-11-26 19:18:37.407630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.755 [2024-11-26 19:18:37.407740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.755 [2024-11-26 19:18:37.407771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.755 qpair failed and we were unable to recover it. 00:32:20.755 [2024-11-26 19:18:37.407885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.755 [2024-11-26 19:18:37.407989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.755 [2024-11-26 19:18:37.408005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.755 qpair failed and we were unable to recover it. 00:32:20.755 [2024-11-26 19:18:37.408183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.755 [2024-11-26 19:18:37.408372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.755 [2024-11-26 19:18:37.408403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.755 qpair failed and we were unable to recover it. 00:32:20.755 [2024-11-26 19:18:37.408520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.755 [2024-11-26 19:18:37.408703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.755 [2024-11-26 19:18:37.408734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.755 qpair failed and we were unable to recover it. 00:32:20.755 [2024-11-26 19:18:37.408913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.755 [2024-11-26 19:18:37.409110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.755 [2024-11-26 19:18:37.409142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.755 qpair failed and we were unable to recover it. 00:32:20.755 [2024-11-26 19:18:37.409265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.755 [2024-11-26 19:18:37.409456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.755 [2024-11-26 19:18:37.409487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.755 qpair failed and we were unable to recover it. 00:32:20.755 [2024-11-26 19:18:37.409700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.755 [2024-11-26 19:18:37.409875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.755 [2024-11-26 19:18:37.409906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.755 qpair failed and we were unable to recover it. 00:32:20.755 [2024-11-26 19:18:37.410099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.755 [2024-11-26 19:18:37.410278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.755 [2024-11-26 19:18:37.410293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.755 qpair failed and we were unable to recover it. 00:32:20.755 [2024-11-26 19:18:37.410439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.755 [2024-11-26 19:18:37.410590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.755 [2024-11-26 19:18:37.410621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.755 qpair failed and we were unable to recover it. 00:32:20.755 [2024-11-26 19:18:37.410757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.755 [2024-11-26 19:18:37.410870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.755 [2024-11-26 19:18:37.410901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.755 qpair failed and we were unable to recover it. 00:32:20.755 [2024-11-26 19:18:37.411084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.755 [2024-11-26 19:18:37.411206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.755 [2024-11-26 19:18:37.411236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.755 qpair failed and we were unable to recover it. 00:32:20.755 [2024-11-26 19:18:37.411412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.755 [2024-11-26 19:18:37.411524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.756 [2024-11-26 19:18:37.411555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.756 qpair failed and we were unable to recover it. 00:32:20.756 [2024-11-26 19:18:37.411760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.756 [2024-11-26 19:18:37.411978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.756 [2024-11-26 19:18:37.412012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.756 qpair failed and we were unable to recover it. 00:32:20.756 [2024-11-26 19:18:37.412255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.756 [2024-11-26 19:18:37.412376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.756 [2024-11-26 19:18:37.412407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.756 qpair failed and we were unable to recover it. 00:32:20.756 [2024-11-26 19:18:37.412594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.756 [2024-11-26 19:18:37.412759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.756 [2024-11-26 19:18:37.412790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.756 qpair failed and we were unable to recover it. 00:32:20.756 [2024-11-26 19:18:37.413214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.756 [2024-11-26 19:18:37.413537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.756 [2024-11-26 19:18:37.413572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.756 qpair failed and we were unable to recover it. 00:32:20.756 [2024-11-26 19:18:37.413767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.756 [2024-11-26 19:18:37.413965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.756 [2024-11-26 19:18:37.414004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.756 qpair failed and we were unable to recover it. 00:32:20.756 [2024-11-26 19:18:37.414099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.756 [2024-11-26 19:18:37.414265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.756 [2024-11-26 19:18:37.414281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.756 qpair failed and we were unable to recover it. 00:32:20.756 [2024-11-26 19:18:37.414459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.756 [2024-11-26 19:18:37.414540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.756 [2024-11-26 19:18:37.414555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.756 qpair failed and we were unable to recover it. 00:32:20.756 [2024-11-26 19:18:37.414798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.756 [2024-11-26 19:18:37.415018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.756 [2024-11-26 19:18:37.415051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.756 qpair failed and we were unable to recover it. 00:32:20.756 [2024-11-26 19:18:37.415227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.756 [2024-11-26 19:18:37.415353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.756 [2024-11-26 19:18:37.415391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.756 qpair failed and we were unable to recover it. 00:32:20.756 [2024-11-26 19:18:37.415519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.756 [2024-11-26 19:18:37.415636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.756 [2024-11-26 19:18:37.415668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.756 qpair failed and we were unable to recover it. 00:32:20.756 [2024-11-26 19:18:37.415841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.756 [2024-11-26 19:18:37.416022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.756 [2024-11-26 19:18:37.416038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.756 qpair failed and we were unable to recover it. 00:32:20.756 [2024-11-26 19:18:37.416117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.756 [2024-11-26 19:18:37.416253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.756 [2024-11-26 19:18:37.416268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.756 qpair failed and we were unable to recover it. 00:32:20.756 [2024-11-26 19:18:37.416363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.756 [2024-11-26 19:18:37.416502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.756 [2024-11-26 19:18:37.416518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.756 qpair failed and we were unable to recover it. 00:32:20.756 [2024-11-26 19:18:37.416664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.756 [2024-11-26 19:18:37.416838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.756 [2024-11-26 19:18:37.416868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.756 qpair failed and we were unable to recover it. 00:32:20.756 [2024-11-26 19:18:37.416993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.756 [2024-11-26 19:18:37.417263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.756 [2024-11-26 19:18:37.417294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.756 qpair failed and we were unable to recover it. 00:32:20.756 [2024-11-26 19:18:37.417504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.756 [2024-11-26 19:18:37.417635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.756 [2024-11-26 19:18:37.417666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.756 qpair failed and we were unable to recover it. 00:32:20.756 [2024-11-26 19:18:37.417840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.756 [2024-11-26 19:18:37.417988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.756 [2024-11-26 19:18:37.418004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.756 qpair failed and we were unable to recover it. 00:32:20.756 [2024-11-26 19:18:37.418148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.756 [2024-11-26 19:18:37.418284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.756 [2024-11-26 19:18:37.418300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.756 qpair failed and we were unable to recover it. 00:32:20.756 [2024-11-26 19:18:37.418545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.756 [2024-11-26 19:18:37.418779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.756 [2024-11-26 19:18:37.418818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.756 qpair failed and we were unable to recover it. 00:32:20.756 [2024-11-26 19:18:37.419063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.756 [2024-11-26 19:18:37.419252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.756 [2024-11-26 19:18:37.419267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.756 qpair failed and we were unable to recover it. 00:32:20.756 [2024-11-26 19:18:37.419405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.756 [2024-11-26 19:18:37.419632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.756 [2024-11-26 19:18:37.419663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.756 qpair failed and we were unable to recover it. 00:32:20.756 [2024-11-26 19:18:37.419835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.756 [2024-11-26 19:18:37.420096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.756 [2024-11-26 19:18:37.420127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.756 qpair failed and we were unable to recover it. 00:32:20.756 [2024-11-26 19:18:37.420250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.756 [2024-11-26 19:18:37.420337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.756 [2024-11-26 19:18:37.420353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.756 qpair failed and we were unable to recover it. 00:32:20.757 [2024-11-26 19:18:37.420506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.757 [2024-11-26 19:18:37.420687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.757 [2024-11-26 19:18:37.420718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.757 qpair failed and we were unable to recover it. 00:32:20.757 [2024-11-26 19:18:37.420822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.757 [2024-11-26 19:18:37.420990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.757 [2024-11-26 19:18:37.421023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.757 qpair failed and we were unable to recover it. 00:32:20.757 [2024-11-26 19:18:37.421163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.757 [2024-11-26 19:18:37.421295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.757 [2024-11-26 19:18:37.421326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.757 qpair failed and we were unable to recover it. 00:32:20.757 [2024-11-26 19:18:37.421502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.757 [2024-11-26 19:18:37.421628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.757 [2024-11-26 19:18:37.421658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.757 qpair failed and we were unable to recover it. 00:32:20.757 [2024-11-26 19:18:37.421787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.757 [2024-11-26 19:18:37.421879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.757 [2024-11-26 19:18:37.421895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.757 qpair failed and we were unable to recover it. 00:32:20.757 [2024-11-26 19:18:37.421983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.757 [2024-11-26 19:18:37.422120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.757 [2024-11-26 19:18:37.422135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.757 qpair failed and we were unable to recover it. 00:32:20.757 [2024-11-26 19:18:37.422275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.757 [2024-11-26 19:18:37.422426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.757 [2024-11-26 19:18:37.422458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.757 qpair failed and we were unable to recover it. 00:32:20.757 [2024-11-26 19:18:37.422582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.757 [2024-11-26 19:18:37.422692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.757 [2024-11-26 19:18:37.422723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.757 qpair failed and we were unable to recover it. 00:32:20.757 [2024-11-26 19:18:37.422908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.757 [2024-11-26 19:18:37.423101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.757 [2024-11-26 19:18:37.423117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.757 qpair failed and we were unable to recover it. 00:32:20.757 [2024-11-26 19:18:37.423320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.757 [2024-11-26 19:18:37.423489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.757 [2024-11-26 19:18:37.423520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.757 qpair failed and we were unable to recover it. 00:32:20.757 [2024-11-26 19:18:37.423701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.757 [2024-11-26 19:18:37.423868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.757 [2024-11-26 19:18:37.423899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.757 qpair failed and we were unable to recover it. 00:32:20.757 [2024-11-26 19:18:37.424155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.757 [2024-11-26 19:18:37.424301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.757 [2024-11-26 19:18:37.424332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.757 qpair failed and we were unable to recover it. 00:32:20.757 [2024-11-26 19:18:37.424476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.757 [2024-11-26 19:18:37.424644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.757 [2024-11-26 19:18:37.424675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.757 qpair failed and we were unable to recover it. 00:32:20.757 [2024-11-26 19:18:37.424906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.757 [2024-11-26 19:18:37.425104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.757 [2024-11-26 19:18:37.425120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.757 qpair failed and we were unable to recover it. 00:32:20.757 [2024-11-26 19:18:37.425208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.757 [2024-11-26 19:18:37.425387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.757 [2024-11-26 19:18:37.425422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.757 qpair failed and we were unable to recover it. 00:32:20.757 [2024-11-26 19:18:37.425537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.757 [2024-11-26 19:18:37.425665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.757 [2024-11-26 19:18:37.425697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.757 qpair failed and we were unable to recover it. 00:32:20.757 [2024-11-26 19:18:37.425964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.757 [2024-11-26 19:18:37.426109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.757 [2024-11-26 19:18:37.426141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.757 qpair failed and we were unable to recover it. 00:32:20.757 [2024-11-26 19:18:37.426325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.757 [2024-11-26 19:18:37.426506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.757 [2024-11-26 19:18:37.426539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.757 qpair failed and we were unable to recover it. 00:32:20.757 [2024-11-26 19:18:37.426731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.757 [2024-11-26 19:18:37.426846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.757 [2024-11-26 19:18:37.426877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.757 qpair failed and we were unable to recover it. 00:32:20.757 [2024-11-26 19:18:37.427013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.757 [2024-11-26 19:18:37.427170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.757 [2024-11-26 19:18:37.427185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.757 qpair failed and we were unable to recover it. 00:32:20.757 [2024-11-26 19:18:37.427368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.757 [2024-11-26 19:18:37.427468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.757 [2024-11-26 19:18:37.427500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.757 qpair failed and we were unable to recover it. 00:32:20.757 [2024-11-26 19:18:37.427627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.757 [2024-11-26 19:18:37.427792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.757 [2024-11-26 19:18:37.427808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.757 qpair failed and we were unable to recover it. 00:32:20.757 [2024-11-26 19:18:37.427961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.757 [2024-11-26 19:18:37.428217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.757 [2024-11-26 19:18:37.428248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.757 qpair failed and we were unable to recover it. 00:32:20.757 [2024-11-26 19:18:37.428386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.757 [2024-11-26 19:18:37.428497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.757 [2024-11-26 19:18:37.428527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.758 qpair failed and we were unable to recover it. 00:32:20.758 [2024-11-26 19:18:37.428639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.758 [2024-11-26 19:18:37.428741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.758 [2024-11-26 19:18:37.428772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.758 qpair failed and we were unable to recover it. 00:32:20.758 [2024-11-26 19:18:37.429021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.758 [2024-11-26 19:18:37.429280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.758 [2024-11-26 19:18:37.429311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.758 qpair failed and we were unable to recover it. 00:32:20.758 [2024-11-26 19:18:37.429500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.758 [2024-11-26 19:18:37.429625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.758 [2024-11-26 19:18:37.429656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.758 qpair failed and we were unable to recover it. 00:32:20.758 [2024-11-26 19:18:37.429894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.758 [2024-11-26 19:18:37.430029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.758 [2024-11-26 19:18:37.430062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.758 qpair failed and we were unable to recover it. 00:32:20.758 [2024-11-26 19:18:37.430172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.758 [2024-11-26 19:18:37.430339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.758 [2024-11-26 19:18:37.430371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.758 qpair failed and we were unable to recover it. 00:32:20.758 [2024-11-26 19:18:37.430561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.758 [2024-11-26 19:18:37.430823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.758 [2024-11-26 19:18:37.430854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.758 qpair failed and we were unable to recover it. 00:32:20.758 [2024-11-26 19:18:37.431037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.758 [2024-11-26 19:18:37.431272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.758 [2024-11-26 19:18:37.431287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.758 qpair failed and we were unable to recover it. 00:32:20.758 [2024-11-26 19:18:37.431366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.758 [2024-11-26 19:18:37.431438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.758 [2024-11-26 19:18:37.431452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.758 qpair failed and we were unable to recover it. 00:32:20.758 [2024-11-26 19:18:37.431599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.758 [2024-11-26 19:18:37.431715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.758 [2024-11-26 19:18:37.431747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.758 qpair failed and we were unable to recover it. 00:32:20.758 [2024-11-26 19:18:37.431919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.758 [2024-11-26 19:18:37.432068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.758 [2024-11-26 19:18:37.432100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.758 qpair failed and we were unable to recover it. 00:32:20.758 [2024-11-26 19:18:37.432184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.758 [2024-11-26 19:18:37.432258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.758 [2024-11-26 19:18:37.432272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.758 qpair failed and we were unable to recover it. 00:32:20.758 [2024-11-26 19:18:37.432437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.758 [2024-11-26 19:18:37.432622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.758 [2024-11-26 19:18:37.432653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.758 qpair failed and we were unable to recover it. 00:32:20.758 [2024-11-26 19:18:37.432835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.758 [2024-11-26 19:18:37.433029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.758 [2024-11-26 19:18:37.433045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.758 qpair failed and we were unable to recover it. 00:32:20.758 [2024-11-26 19:18:37.433137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.758 [2024-11-26 19:18:37.433337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.758 [2024-11-26 19:18:37.433352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.758 qpair failed and we were unable to recover it. 00:32:20.758 [2024-11-26 19:18:37.433560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.758 [2024-11-26 19:18:37.433657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.758 [2024-11-26 19:18:37.433673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.758 qpair failed and we were unable to recover it. 00:32:20.758 [2024-11-26 19:18:37.433812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.758 [2024-11-26 19:18:37.433957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.758 [2024-11-26 19:18:37.433990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.758 qpair failed and we were unable to recover it. 00:32:20.758 [2024-11-26 19:18:37.434181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.758 [2024-11-26 19:18:37.434298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.758 [2024-11-26 19:18:37.434330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.758 qpair failed and we were unable to recover it. 00:32:20.758 [2024-11-26 19:18:37.434511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.758 [2024-11-26 19:18:37.434611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.758 [2024-11-26 19:18:37.434643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.758 qpair failed and we were unable to recover it. 00:32:20.758 [2024-11-26 19:18:37.434814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.758 [2024-11-26 19:18:37.434918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.758 [2024-11-26 19:18:37.434956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.758 qpair failed and we were unable to recover it. 00:32:20.758 [2024-11-26 19:18:37.435183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.758 [2024-11-26 19:18:37.435269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.758 [2024-11-26 19:18:37.435284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.758 qpair failed and we were unable to recover it. 00:32:20.758 [2024-11-26 19:18:37.435457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.758 [2024-11-26 19:18:37.435632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.758 [2024-11-26 19:18:37.435647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.758 qpair failed and we were unable to recover it. 00:32:20.758 [2024-11-26 19:18:37.435799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.758 [2024-11-26 19:18:37.435901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.758 [2024-11-26 19:18:37.435917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.758 qpair failed and we were unable to recover it. 00:32:20.758 [2024-11-26 19:18:37.436085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.758 [2024-11-26 19:18:37.436216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.758 [2024-11-26 19:18:37.436254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.758 qpair failed and we were unable to recover it. 00:32:20.758 [2024-11-26 19:18:37.436427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.759 [2024-11-26 19:18:37.436563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.759 [2024-11-26 19:18:37.436594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.759 qpair failed and we were unable to recover it. 00:32:20.759 [2024-11-26 19:18:37.436711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.759 [2024-11-26 19:18:37.436884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.759 [2024-11-26 19:18:37.436916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.759 qpair failed and we were unable to recover it. 00:32:20.759 [2024-11-26 19:18:37.437048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.759 [2024-11-26 19:18:37.437228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.759 [2024-11-26 19:18:37.437244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.759 qpair failed and we were unable to recover it. 00:32:20.759 [2024-11-26 19:18:37.437329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.759 [2024-11-26 19:18:37.437421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.759 [2024-11-26 19:18:37.437436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.759 qpair failed and we were unable to recover it. 00:32:20.759 [2024-11-26 19:18:37.437516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.759 [2024-11-26 19:18:37.437725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.759 [2024-11-26 19:18:37.437740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.759 qpair failed and we were unable to recover it. 00:32:20.759 [2024-11-26 19:18:37.437899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.759 [2024-11-26 19:18:37.437983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.759 [2024-11-26 19:18:37.438000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.759 qpair failed and we were unable to recover it. 00:32:20.759 [2024-11-26 19:18:37.438102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.759 [2024-11-26 19:18:37.438198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.759 [2024-11-26 19:18:37.438213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.759 qpair failed and we were unable to recover it. 00:32:20.759 [2024-11-26 19:18:37.438377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.759 [2024-11-26 19:18:37.438504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.759 [2024-11-26 19:18:37.438535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.759 qpair failed and we were unable to recover it. 00:32:20.759 [2024-11-26 19:18:37.438678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.759 [2024-11-26 19:18:37.438852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.759 [2024-11-26 19:18:37.438885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.759 qpair failed and we were unable to recover it. 00:32:20.759 [2024-11-26 19:18:37.439070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.759 [2024-11-26 19:18:37.439331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.759 [2024-11-26 19:18:37.439347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.759 qpair failed and we were unable to recover it. 00:32:20.759 [2024-11-26 19:18:37.439442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.759 [2024-11-26 19:18:37.439522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.759 [2024-11-26 19:18:37.439538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.759 qpair failed and we were unable to recover it. 00:32:20.759 [2024-11-26 19:18:37.439613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.759 [2024-11-26 19:18:37.439880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.759 [2024-11-26 19:18:37.439911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.759 qpair failed and we were unable to recover it. 00:32:20.759 [2024-11-26 19:18:37.440128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.759 [2024-11-26 19:18:37.440289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.759 [2024-11-26 19:18:37.440305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.759 qpair failed and we were unable to recover it. 00:32:20.759 [2024-11-26 19:18:37.440477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.759 [2024-11-26 19:18:37.440660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.759 [2024-11-26 19:18:37.440693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.759 qpair failed and we were unable to recover it. 00:32:20.759 [2024-11-26 19:18:37.440889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.759 [2024-11-26 19:18:37.441006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.759 [2024-11-26 19:18:37.441023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.759 qpair failed and we were unable to recover it. 00:32:20.759 [2024-11-26 19:18:37.441176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.759 [2024-11-26 19:18:37.441278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.759 [2024-11-26 19:18:37.441294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.759 qpair failed and we were unable to recover it. 00:32:20.759 [2024-11-26 19:18:37.441365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.759 [2024-11-26 19:18:37.441504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.759 [2024-11-26 19:18:37.441519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.759 qpair failed and we were unable to recover it. 00:32:20.759 [2024-11-26 19:18:37.441663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.759 [2024-11-26 19:18:37.441762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.759 [2024-11-26 19:18:37.441777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.759 qpair failed and we were unable to recover it. 00:32:20.759 [2024-11-26 19:18:37.441866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.759 [2024-11-26 19:18:37.442035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.759 [2024-11-26 19:18:37.442069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.759 qpair failed and we were unable to recover it. 00:32:20.759 [2024-11-26 19:18:37.442252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.759 [2024-11-26 19:18:37.442373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.759 [2024-11-26 19:18:37.442405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.759 qpair failed and we were unable to recover it. 00:32:20.759 [2024-11-26 19:18:37.442517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.759 [2024-11-26 19:18:37.442721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.759 [2024-11-26 19:18:37.442753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.759 qpair failed and we were unable to recover it. 00:32:20.759 [2024-11-26 19:18:37.442873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.759 [2024-11-26 19:18:37.442955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.759 [2024-11-26 19:18:37.442971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.759 qpair failed and we were unable to recover it. 00:32:20.759 [2024-11-26 19:18:37.443055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.759 [2024-11-26 19:18:37.443277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.759 [2024-11-26 19:18:37.443294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.759 qpair failed and we were unable to recover it. 00:32:20.759 [2024-11-26 19:18:37.443459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.759 [2024-11-26 19:18:37.443602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.759 [2024-11-26 19:18:37.443617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.759 qpair failed and we were unable to recover it. 00:32:20.759 [2024-11-26 19:18:37.443784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.760 [2024-11-26 19:18:37.443995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.760 [2024-11-26 19:18:37.444028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.760 qpair failed and we were unable to recover it. 00:32:20.760 [2024-11-26 19:18:37.444215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.760 [2024-11-26 19:18:37.444452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.760 [2024-11-26 19:18:37.444484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.760 qpair failed and we were unable to recover it. 00:32:20.760 [2024-11-26 19:18:37.444606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.760 [2024-11-26 19:18:37.444836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.760 [2024-11-26 19:18:37.444869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.760 qpair failed and we were unable to recover it. 00:32:20.760 [2024-11-26 19:18:37.445050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.760 [2024-11-26 19:18:37.445187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.760 [2024-11-26 19:18:37.445203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.760 qpair failed and we were unable to recover it. 00:32:20.760 [2024-11-26 19:18:37.445299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.760 [2024-11-26 19:18:37.445509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.760 [2024-11-26 19:18:37.445540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.760 qpair failed and we were unable to recover it. 00:32:20.760 [2024-11-26 19:18:37.445726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.760 [2024-11-26 19:18:37.445861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.760 [2024-11-26 19:18:37.445893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.760 qpair failed and we were unable to recover it. 00:32:20.760 [2024-11-26 19:18:37.446107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.760 [2024-11-26 19:18:37.446282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.760 [2024-11-26 19:18:37.446313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.760 qpair failed and we were unable to recover it. 00:32:20.760 [2024-11-26 19:18:37.446501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.760 [2024-11-26 19:18:37.446618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.760 [2024-11-26 19:18:37.446650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.760 qpair failed and we were unable to recover it. 00:32:20.760 [2024-11-26 19:18:37.446773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.760 [2024-11-26 19:18:37.446969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.760 [2024-11-26 19:18:37.446987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.760 qpair failed and we were unable to recover it. 00:32:20.760 [2024-11-26 19:18:37.447169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.760 [2024-11-26 19:18:37.447388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.760 [2024-11-26 19:18:37.447420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.760 qpair failed and we were unable to recover it. 00:32:20.760 [2024-11-26 19:18:37.447548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.760 [2024-11-26 19:18:37.447829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.760 [2024-11-26 19:18:37.447860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.760 qpair failed and we were unable to recover it. 00:32:20.760 [2024-11-26 19:18:37.448057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.760 [2024-11-26 19:18:37.448204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.760 [2024-11-26 19:18:37.448219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.760 qpair failed and we were unable to recover it. 00:32:20.760 [2024-11-26 19:18:37.448380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.760 [2024-11-26 19:18:37.448533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.760 [2024-11-26 19:18:37.448566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.760 qpair failed and we were unable to recover it. 00:32:20.760 [2024-11-26 19:18:37.448749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.760 [2024-11-26 19:18:37.448916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.760 [2024-11-26 19:18:37.448957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.760 qpair failed and we were unable to recover it. 00:32:20.760 [2024-11-26 19:18:37.449078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.760 [2024-11-26 19:18:37.449162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.760 [2024-11-26 19:18:37.449178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.760 qpair failed and we were unable to recover it. 00:32:20.760 [2024-11-26 19:18:37.449253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.760 [2024-11-26 19:18:37.449410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.760 [2024-11-26 19:18:37.449425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.760 qpair failed and we were unable to recover it. 00:32:20.760 [2024-11-26 19:18:37.449519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.760 [2024-11-26 19:18:37.449591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.760 [2024-11-26 19:18:37.449604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.760 qpair failed and we were unable to recover it. 00:32:20.760 [2024-11-26 19:18:37.449711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.760 [2024-11-26 19:18:37.449822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.760 [2024-11-26 19:18:37.449852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.760 qpair failed and we were unable to recover it. 00:32:20.760 [2024-11-26 19:18:37.449989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.760 [2024-11-26 19:18:37.450176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.760 [2024-11-26 19:18:37.450207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.761 qpair failed and we were unable to recover it. 00:32:20.761 [2024-11-26 19:18:37.450368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.761 [2024-11-26 19:18:37.450441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.761 [2024-11-26 19:18:37.450455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.761 qpair failed and we were unable to recover it. 00:32:20.761 [2024-11-26 19:18:37.450682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.761 [2024-11-26 19:18:37.450846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.761 [2024-11-26 19:18:37.450863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.761 qpair failed and we were unable to recover it. 00:32:20.761 [2024-11-26 19:18:37.450933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.761 [2024-11-26 19:18:37.451014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.761 [2024-11-26 19:18:37.451027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.761 qpair failed and we were unable to recover it. 00:32:20.761 [2024-11-26 19:18:37.451114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.761 [2024-11-26 19:18:37.451204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.761 [2024-11-26 19:18:37.451218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.761 qpair failed and we were unable to recover it. 00:32:20.761 [2024-11-26 19:18:37.451368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.761 [2024-11-26 19:18:37.451516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.761 [2024-11-26 19:18:37.451532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.761 qpair failed and we were unable to recover it. 00:32:20.761 [2024-11-26 19:18:37.451621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.761 [2024-11-26 19:18:37.451712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.761 [2024-11-26 19:18:37.451741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.761 qpair failed and we were unable to recover it. 00:32:20.761 [2024-11-26 19:18:37.451856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.761 [2024-11-26 19:18:37.452037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.761 [2024-11-26 19:18:37.452071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.761 qpair failed and we were unable to recover it. 00:32:20.761 [2024-11-26 19:18:37.452242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.761 [2024-11-26 19:18:37.452419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.761 [2024-11-26 19:18:37.452437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.761 qpair failed and we were unable to recover it. 00:32:20.761 [2024-11-26 19:18:37.452527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.761 [2024-11-26 19:18:37.452671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.761 [2024-11-26 19:18:37.452687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.761 qpair failed and we were unable to recover it. 00:32:20.761 [2024-11-26 19:18:37.452859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.761 [2024-11-26 19:18:37.453100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.761 [2024-11-26 19:18:37.453132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.761 qpair failed and we were unable to recover it. 00:32:20.761 [2024-11-26 19:18:37.453266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.761 [2024-11-26 19:18:37.453381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.761 [2024-11-26 19:18:37.453414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.761 qpair failed and we were unable to recover it. 00:32:20.761 [2024-11-26 19:18:37.453529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.761 [2024-11-26 19:18:37.453650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.761 [2024-11-26 19:18:37.453682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.761 qpair failed and we were unable to recover it. 00:32:20.761 [2024-11-26 19:18:37.453868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.761 [2024-11-26 19:18:37.453986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.761 [2024-11-26 19:18:37.454002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.761 qpair failed and we were unable to recover it. 00:32:20.761 [2024-11-26 19:18:37.454090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.761 [2024-11-26 19:18:37.454232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.761 [2024-11-26 19:18:37.454263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.761 qpair failed and we were unable to recover it. 00:32:20.761 [2024-11-26 19:18:37.454440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.761 [2024-11-26 19:18:37.454539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.761 [2024-11-26 19:18:37.454568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.761 qpair failed and we were unable to recover it. 00:32:20.761 [2024-11-26 19:18:37.454686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.761 [2024-11-26 19:18:37.454814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.761 [2024-11-26 19:18:37.454845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.761 qpair failed and we were unable to recover it. 00:32:20.761 [2024-11-26 19:18:37.455019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.761 [2024-11-26 19:18:37.455121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.761 [2024-11-26 19:18:37.455151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.761 qpair failed and we were unable to recover it. 00:32:20.761 [2024-11-26 19:18:37.455333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.761 [2024-11-26 19:18:37.455435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.761 [2024-11-26 19:18:37.455468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.761 qpair failed and we were unable to recover it. 00:32:20.761 [2024-11-26 19:18:37.455606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.761 [2024-11-26 19:18:37.455779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.761 [2024-11-26 19:18:37.455810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.761 qpair failed and we were unable to recover it. 00:32:20.761 [2024-11-26 19:18:37.455923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.761 [2024-11-26 19:18:37.456066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.761 [2024-11-26 19:18:37.456084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.761 qpair failed and we were unable to recover it. 00:32:20.761 [2024-11-26 19:18:37.456226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.761 [2024-11-26 19:18:37.456386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.761 [2024-11-26 19:18:37.456417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.761 qpair failed and we were unable to recover it. 00:32:20.761 [2024-11-26 19:18:37.456659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.761 [2024-11-26 19:18:37.456774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.761 [2024-11-26 19:18:37.456806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.761 qpair failed and we were unable to recover it. 00:32:20.761 [2024-11-26 19:18:37.456926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.762 [2024-11-26 19:18:37.457206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.762 [2024-11-26 19:18:37.457222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.762 qpair failed and we were unable to recover it. 00:32:20.762 [2024-11-26 19:18:37.457298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.762 [2024-11-26 19:18:37.457482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.762 [2024-11-26 19:18:37.457498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.762 qpair failed and we were unable to recover it. 00:32:20.762 [2024-11-26 19:18:37.457711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.762 [2024-11-26 19:18:37.457855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.762 [2024-11-26 19:18:37.457871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.762 qpair failed and we were unable to recover it. 00:32:20.762 [2024-11-26 19:18:37.457961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.762 [2024-11-26 19:18:37.458129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.762 [2024-11-26 19:18:37.458161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.762 qpair failed and we were unable to recover it. 00:32:20.762 [2024-11-26 19:18:37.458334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.762 [2024-11-26 19:18:37.458581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.762 [2024-11-26 19:18:37.458614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.762 qpair failed and we were unable to recover it. 00:32:20.762 [2024-11-26 19:18:37.458749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.762 [2024-11-26 19:18:37.458853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.762 [2024-11-26 19:18:37.458868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.762 qpair failed and we were unable to recover it. 00:32:20.762 [2024-11-26 19:18:37.459013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.762 [2024-11-26 19:18:37.459110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.762 [2024-11-26 19:18:37.459126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.762 qpair failed and we were unable to recover it. 00:32:20.762 [2024-11-26 19:18:37.459335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.762 [2024-11-26 19:18:37.459409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.762 [2024-11-26 19:18:37.459423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.762 qpair failed and we were unable to recover it. 00:32:20.762 [2024-11-26 19:18:37.459532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.762 [2024-11-26 19:18:37.459680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.762 [2024-11-26 19:18:37.459697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.762 qpair failed and we were unable to recover it. 00:32:20.762 [2024-11-26 19:18:37.459781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.762 [2024-11-26 19:18:37.459920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.762 [2024-11-26 19:18:37.459984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.762 qpair failed and we were unable to recover it. 00:32:20.762 [2024-11-26 19:18:37.460187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.762 [2024-11-26 19:18:37.460292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.762 [2024-11-26 19:18:37.460323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.762 qpair failed and we were unable to recover it. 00:32:20.762 [2024-11-26 19:18:37.460520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.762 [2024-11-26 19:18:37.460651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.762 [2024-11-26 19:18:37.460682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.762 qpair failed and we were unable to recover it. 00:32:20.762 [2024-11-26 19:18:37.460926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.762 [2024-11-26 19:18:37.461031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.762 [2024-11-26 19:18:37.461046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.762 qpair failed and we were unable to recover it. 00:32:20.762 [2024-11-26 19:18:37.461146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.762 [2024-11-26 19:18:37.461303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.762 [2024-11-26 19:18:37.461341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.762 qpair failed and we were unable to recover it. 00:32:20.762 [2024-11-26 19:18:37.461618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.762 [2024-11-26 19:18:37.461790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.762 [2024-11-26 19:18:37.461822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.762 qpair failed and we were unable to recover it. 00:32:20.762 [2024-11-26 19:18:37.462003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.762 [2024-11-26 19:18:37.462094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.762 [2024-11-26 19:18:37.462110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.762 qpair failed and we were unable to recover it. 00:32:20.762 [2024-11-26 19:18:37.462366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.762 [2024-11-26 19:18:37.462482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.762 [2024-11-26 19:18:37.462513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.762 qpair failed and we were unable to recover it. 00:32:20.762 [2024-11-26 19:18:37.462706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.762 [2024-11-26 19:18:37.462900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.762 [2024-11-26 19:18:37.462932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.762 qpair failed and we were unable to recover it. 00:32:20.762 [2024-11-26 19:18:37.463137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.762 [2024-11-26 19:18:37.463349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.762 [2024-11-26 19:18:37.463382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.762 qpair failed and we were unable to recover it. 00:32:20.762 [2024-11-26 19:18:37.463513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.762 [2024-11-26 19:18:37.463753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.762 [2024-11-26 19:18:37.463786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.762 qpair failed and we were unable to recover it. 00:32:20.762 [2024-11-26 19:18:37.463997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.762 [2024-11-26 19:18:37.464081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.762 [2024-11-26 19:18:37.464097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.762 qpair failed and we were unable to recover it. 00:32:20.762 [2024-11-26 19:18:37.464241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.762 [2024-11-26 19:18:37.464323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.762 [2024-11-26 19:18:37.464338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.762 qpair failed and we were unable to recover it. 00:32:20.762 [2024-11-26 19:18:37.464481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.762 [2024-11-26 19:18:37.464573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.762 [2024-11-26 19:18:37.464589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.763 qpair failed and we were unable to recover it. 00:32:20.763 [2024-11-26 19:18:37.464734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.763 [2024-11-26 19:18:37.464823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.763 [2024-11-26 19:18:37.464839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.763 qpair failed and we were unable to recover it. 00:32:20.763 [2024-11-26 19:18:37.464942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.763 [2024-11-26 19:18:37.465105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.763 [2024-11-26 19:18:37.465121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.763 qpair failed and we were unable to recover it. 00:32:20.763 [2024-11-26 19:18:37.465201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.763 [2024-11-26 19:18:37.465281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.763 [2024-11-26 19:18:37.465296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.763 qpair failed and we were unable to recover it. 00:32:20.763 [2024-11-26 19:18:37.465375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.763 [2024-11-26 19:18:37.465470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.763 [2024-11-26 19:18:37.465499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.763 qpair failed and we were unable to recover it. 00:32:20.763 [2024-11-26 19:18:37.465614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.763 [2024-11-26 19:18:37.465718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.763 [2024-11-26 19:18:37.465748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.763 qpair failed and we were unable to recover it. 00:32:20.763 [2024-11-26 19:18:37.465861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.763 [2024-11-26 19:18:37.465991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.763 [2024-11-26 19:18:37.466024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.763 qpair failed and we were unable to recover it. 00:32:20.763 [2024-11-26 19:18:37.466135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.763 [2024-11-26 19:18:37.466277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.763 [2024-11-26 19:18:37.466292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.763 qpair failed and we were unable to recover it. 00:32:20.763 [2024-11-26 19:18:37.466361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.763 [2024-11-26 19:18:37.466516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.763 [2024-11-26 19:18:37.466531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.763 qpair failed and we were unable to recover it. 00:32:20.763 [2024-11-26 19:18:37.466711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.763 [2024-11-26 19:18:37.466869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.763 [2024-11-26 19:18:37.466902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.763 qpair failed and we were unable to recover it. 00:32:20.763 [2024-11-26 19:18:37.467094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.763 [2024-11-26 19:18:37.467263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.763 [2024-11-26 19:18:37.467294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.763 qpair failed and we were unable to recover it. 00:32:20.763 [2024-11-26 19:18:37.467478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.763 [2024-11-26 19:18:37.467687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.763 [2024-11-26 19:18:37.467719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.763 qpair failed and we were unable to recover it. 00:32:20.763 [2024-11-26 19:18:37.467899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.763 [2024-11-26 19:18:37.467988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.763 [2024-11-26 19:18:37.468003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.763 qpair failed and we were unable to recover it. 00:32:20.763 [2024-11-26 19:18:37.468073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.763 [2024-11-26 19:18:37.468256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.763 [2024-11-26 19:18:37.468271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.763 qpair failed and we were unable to recover it. 00:32:20.763 [2024-11-26 19:18:37.468354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.763 [2024-11-26 19:18:37.468449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.763 [2024-11-26 19:18:37.468467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.763 qpair failed and we were unable to recover it. 00:32:20.763 [2024-11-26 19:18:37.468649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.763 [2024-11-26 19:18:37.468829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.763 [2024-11-26 19:18:37.468859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.763 qpair failed and we were unable to recover it. 00:32:20.763 [2024-11-26 19:18:37.468985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.763 [2024-11-26 19:18:37.469132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.763 [2024-11-26 19:18:37.469147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.763 qpair failed and we were unable to recover it. 00:32:20.763 [2024-11-26 19:18:37.469304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.763 [2024-11-26 19:18:37.469486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.763 [2024-11-26 19:18:37.469517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.763 qpair failed and we were unable to recover it. 00:32:20.763 [2024-11-26 19:18:37.469641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.763 [2024-11-26 19:18:37.469776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.763 [2024-11-26 19:18:37.469809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.763 qpair failed and we were unable to recover it. 00:32:20.763 [2024-11-26 19:18:37.469977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.763 [2024-11-26 19:18:37.470136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.763 [2024-11-26 19:18:37.470167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.763 qpair failed and we were unable to recover it. 00:32:20.763 [2024-11-26 19:18:37.470353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.763 [2024-11-26 19:18:37.470531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.763 [2024-11-26 19:18:37.470565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.763 qpair failed and we were unable to recover it. 00:32:20.763 [2024-11-26 19:18:37.470750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.763 [2024-11-26 19:18:37.470861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.763 [2024-11-26 19:18:37.470892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.763 qpair failed and we were unable to recover it. 00:32:20.763 [2024-11-26 19:18:37.471090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.763 [2024-11-26 19:18:37.471267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.763 [2024-11-26 19:18:37.471298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.764 qpair failed and we were unable to recover it. 00:32:20.764 [2024-11-26 19:18:37.471485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.764 [2024-11-26 19:18:37.471614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.764 [2024-11-26 19:18:37.471645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.764 qpair failed and we were unable to recover it. 00:32:20.764 [2024-11-26 19:18:37.471831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.764 [2024-11-26 19:18:37.471956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.764 [2024-11-26 19:18:37.471994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.764 qpair failed and we were unable to recover it. 00:32:20.764 [2024-11-26 19:18:37.472183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.764 [2024-11-26 19:18:37.472304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.764 [2024-11-26 19:18:37.472336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.764 qpair failed and we were unable to recover it. 00:32:20.764 [2024-11-26 19:18:37.472453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.764 [2024-11-26 19:18:37.472645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.764 [2024-11-26 19:18:37.472676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.764 qpair failed and we were unable to recover it. 00:32:20.764 [2024-11-26 19:18:37.472797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.764 [2024-11-26 19:18:37.472972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.764 [2024-11-26 19:18:37.473003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.764 qpair failed and we were unable to recover it. 00:32:20.764 [2024-11-26 19:18:37.473191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.764 [2024-11-26 19:18:37.473273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.764 [2024-11-26 19:18:37.473288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.764 qpair failed and we were unable to recover it. 00:32:20.764 [2024-11-26 19:18:37.473442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.764 [2024-11-26 19:18:37.473609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.764 [2024-11-26 19:18:37.473625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.764 qpair failed and we were unable to recover it. 00:32:20.764 [2024-11-26 19:18:37.473698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.764 [2024-11-26 19:18:37.473785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.764 [2024-11-26 19:18:37.473816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.764 qpair failed and we were unable to recover it. 00:32:20.764 [2024-11-26 19:18:37.473944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.764 [2024-11-26 19:18:37.474061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.764 [2024-11-26 19:18:37.474092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.764 qpair failed and we were unable to recover it. 00:32:20.764 [2024-11-26 19:18:37.474269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.764 [2024-11-26 19:18:37.474435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.764 [2024-11-26 19:18:37.474451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.764 qpair failed and we were unable to recover it. 00:32:20.764 [2024-11-26 19:18:37.474603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.764 [2024-11-26 19:18:37.474702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.764 [2024-11-26 19:18:37.474717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.764 qpair failed and we were unable to recover it. 00:32:20.764 [2024-11-26 19:18:37.474866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.764 [2024-11-26 19:18:37.474959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.764 [2024-11-26 19:18:37.474974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.764 qpair failed and we were unable to recover it. 00:32:20.764 [2024-11-26 19:18:37.475075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.764 [2024-11-26 19:18:37.475223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.764 [2024-11-26 19:18:37.475239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.764 qpair failed and we were unable to recover it. 00:32:20.764 [2024-11-26 19:18:37.475323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.764 [2024-11-26 19:18:37.475471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.764 [2024-11-26 19:18:37.475486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.764 qpair failed and we were unable to recover it. 00:32:20.764 [2024-11-26 19:18:37.475595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.764 [2024-11-26 19:18:37.475685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.764 [2024-11-26 19:18:37.475701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.764 qpair failed and we were unable to recover it. 00:32:20.764 [2024-11-26 19:18:37.475773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.764 [2024-11-26 19:18:37.475869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.764 [2024-11-26 19:18:37.475899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.764 qpair failed and we were unable to recover it. 00:32:20.764 [2024-11-26 19:18:37.476100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.764 [2024-11-26 19:18:37.476203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.764 [2024-11-26 19:18:37.476235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.764 qpair failed and we were unable to recover it. 00:32:20.764 [2024-11-26 19:18:37.476351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.764 [2024-11-26 19:18:37.476520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.764 [2024-11-26 19:18:37.476536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.764 qpair failed and we were unable to recover it. 00:32:20.764 [2024-11-26 19:18:37.476673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.764 [2024-11-26 19:18:37.476817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.764 [2024-11-26 19:18:37.476832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.764 qpair failed and we were unable to recover it. 00:32:20.764 [2024-11-26 19:18:37.476978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.764 [2024-11-26 19:18:37.477053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.764 [2024-11-26 19:18:37.477068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.764 qpair failed and we were unable to recover it. 00:32:20.764 [2024-11-26 19:18:37.477151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.764 [2024-11-26 19:18:37.477227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.764 [2024-11-26 19:18:37.477242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.764 qpair failed and we were unable to recover it. 00:32:20.764 [2024-11-26 19:18:37.477312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.764 [2024-11-26 19:18:37.477463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.765 [2024-11-26 19:18:37.477497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.765 qpair failed and we were unable to recover it. 00:32:20.765 [2024-11-26 19:18:37.477686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.765 [2024-11-26 19:18:37.477796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.765 [2024-11-26 19:18:37.477825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.765 qpair failed and we were unable to recover it. 00:32:20.765 [2024-11-26 19:18:37.477960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.765 [2024-11-26 19:18:37.478214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.765 [2024-11-26 19:18:37.478231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.765 qpair failed and we were unable to recover it. 00:32:20.765 [2024-11-26 19:18:37.478306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.765 [2024-11-26 19:18:37.478388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.765 [2024-11-26 19:18:37.478403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.765 qpair failed and we were unable to recover it. 00:32:20.765 [2024-11-26 19:18:37.478562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.765 [2024-11-26 19:18:37.478713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.765 [2024-11-26 19:18:37.478728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.765 qpair failed and we were unable to recover it. 00:32:20.765 [2024-11-26 19:18:37.478892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.765 [2024-11-26 19:18:37.479000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.765 [2024-11-26 19:18:37.479034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.765 qpair failed and we were unable to recover it. 00:32:20.765 [2024-11-26 19:18:37.479216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.765 [2024-11-26 19:18:37.479293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.765 [2024-11-26 19:18:37.479306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.765 qpair failed and we were unable to recover it. 00:32:20.765 [2024-11-26 19:18:37.479387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.765 [2024-11-26 19:18:37.479463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.765 [2024-11-26 19:18:37.479477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.765 qpair failed and we were unable to recover it. 00:32:20.765 [2024-11-26 19:18:37.479666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.765 [2024-11-26 19:18:37.479758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.765 [2024-11-26 19:18:37.479774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.765 qpair failed and we were unable to recover it. 00:32:20.765 [2024-11-26 19:18:37.479919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.765 [2024-11-26 19:18:37.480006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.765 [2024-11-26 19:18:37.480023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.765 qpair failed and we were unable to recover it. 00:32:20.765 [2024-11-26 19:18:37.480110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.765 [2024-11-26 19:18:37.480175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.765 [2024-11-26 19:18:37.480189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.765 qpair failed and we were unable to recover it. 00:32:20.765 [2024-11-26 19:18:37.480264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.765 [2024-11-26 19:18:37.480348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.765 [2024-11-26 19:18:37.480362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.765 qpair failed and we were unable to recover it. 00:32:20.765 [2024-11-26 19:18:37.480457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.765 [2024-11-26 19:18:37.480625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.765 [2024-11-26 19:18:37.480657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.765 qpair failed and we were unable to recover it. 00:32:20.765 [2024-11-26 19:18:37.480865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.765 [2024-11-26 19:18:37.481047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.765 [2024-11-26 19:18:37.481080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.765 qpair failed and we were unable to recover it. 00:32:20.765 [2024-11-26 19:18:37.481314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.765 [2024-11-26 19:18:37.481471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.765 [2024-11-26 19:18:37.481501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.765 qpair failed and we were unable to recover it. 00:32:20.765 [2024-11-26 19:18:37.481612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.765 [2024-11-26 19:18:37.481722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.765 [2024-11-26 19:18:37.481753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.765 qpair failed and we were unable to recover it. 00:32:20.765 [2024-11-26 19:18:37.481968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.765 [2024-11-26 19:18:37.482135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.765 [2024-11-26 19:18:37.482152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.765 qpair failed and we were unable to recover it. 00:32:20.765 [2024-11-26 19:18:37.482232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.765 [2024-11-26 19:18:37.482375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.765 [2024-11-26 19:18:37.482391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.765 qpair failed and we were unable to recover it. 00:32:20.765 [2024-11-26 19:18:37.482528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.765 [2024-11-26 19:18:37.482704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.765 [2024-11-26 19:18:37.482736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.765 qpair failed and we were unable to recover it. 00:32:20.765 [2024-11-26 19:18:37.482864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.765 [2024-11-26 19:18:37.482983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.765 [2024-11-26 19:18:37.483014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.765 qpair failed and we were unable to recover it. 00:32:20.765 [2024-11-26 19:18:37.483138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.765 [2024-11-26 19:18:37.483261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.765 [2024-11-26 19:18:37.483303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.765 qpair failed and we were unable to recover it. 00:32:20.765 [2024-11-26 19:18:37.483383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.765 [2024-11-26 19:18:37.483460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.765 [2024-11-26 19:18:37.483475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.765 qpair failed and we were unable to recover it. 00:32:20.765 [2024-11-26 19:18:37.483712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.765 [2024-11-26 19:18:37.483884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.765 [2024-11-26 19:18:37.483916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.765 qpair failed and we were unable to recover it. 00:32:20.765 [2024-11-26 19:18:37.484112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.765 [2024-11-26 19:18:37.484230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.765 [2024-11-26 19:18:37.484246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.766 qpair failed and we were unable to recover it. 00:32:20.766 [2024-11-26 19:18:37.484398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.766 [2024-11-26 19:18:37.484543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.766 [2024-11-26 19:18:37.484558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.766 qpair failed and we were unable to recover it. 00:32:20.766 [2024-11-26 19:18:37.484626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.766 [2024-11-26 19:18:37.484773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.766 [2024-11-26 19:18:37.484788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.766 qpair failed and we were unable to recover it. 00:32:20.766 [2024-11-26 19:18:37.484877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.766 [2024-11-26 19:18:37.484959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.766 [2024-11-26 19:18:37.484975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.766 qpair failed and we were unable to recover it. 00:32:20.766 [2024-11-26 19:18:37.485049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.766 [2024-11-26 19:18:37.485130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.766 [2024-11-26 19:18:37.485144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.766 qpair failed and we were unable to recover it. 00:32:20.766 [2024-11-26 19:18:37.485235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.766 [2024-11-26 19:18:37.485321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.766 [2024-11-26 19:18:37.485336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.766 qpair failed and we were unable to recover it. 00:32:20.766 [2024-11-26 19:18:37.485425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.766 [2024-11-26 19:18:37.485676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.766 [2024-11-26 19:18:37.485706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.766 qpair failed and we were unable to recover it. 00:32:20.766 [2024-11-26 19:18:37.485815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.766 [2024-11-26 19:18:37.485917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.766 [2024-11-26 19:18:37.485955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.766 qpair failed and we were unable to recover it. 00:32:20.766 [2024-11-26 19:18:37.486139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.766 [2024-11-26 19:18:37.486280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.766 [2024-11-26 19:18:37.486315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.766 qpair failed and we were unable to recover it. 00:32:20.766 [2024-11-26 19:18:37.486567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.766 [2024-11-26 19:18:37.486667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.766 [2024-11-26 19:18:37.486698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.766 qpair failed and we were unable to recover it. 00:32:20.766 [2024-11-26 19:18:37.486817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.766 [2024-11-26 19:18:37.486911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.766 [2024-11-26 19:18:37.486926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.766 qpair failed and we were unable to recover it. 00:32:20.766 [2024-11-26 19:18:37.487166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.766 [2024-11-26 19:18:37.487254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.766 [2024-11-26 19:18:37.487286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.766 qpair failed and we were unable to recover it. 00:32:20.766 [2024-11-26 19:18:37.487424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.766 [2024-11-26 19:18:37.487534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.766 [2024-11-26 19:18:37.487567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.766 qpair failed and we were unable to recover it. 00:32:20.766 [2024-11-26 19:18:37.487699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.766 [2024-11-26 19:18:37.487828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.766 [2024-11-26 19:18:37.487859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.766 qpair failed and we were unable to recover it. 00:32:20.766 [2024-11-26 19:18:37.488000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.766 [2024-11-26 19:18:37.488238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.766 [2024-11-26 19:18:37.488268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.766 qpair failed and we were unable to recover it. 00:32:20.766 [2024-11-26 19:18:37.488448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.766 [2024-11-26 19:18:37.488584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.766 [2024-11-26 19:18:37.488602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.766 qpair failed and we were unable to recover it. 00:32:20.766 [2024-11-26 19:18:37.488766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.766 [2024-11-26 19:18:37.488907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.766 [2024-11-26 19:18:37.488923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.766 qpair failed and we were unable to recover it. 00:32:20.766 [2024-11-26 19:18:37.489014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.766 [2024-11-26 19:18:37.489081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.766 [2024-11-26 19:18:37.489097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.766 qpair failed and we were unable to recover it. 00:32:20.766 [2024-11-26 19:18:37.489166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.766 [2024-11-26 19:18:37.489315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.766 [2024-11-26 19:18:37.489346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.766 qpair failed and we were unable to recover it. 00:32:20.766 [2024-11-26 19:18:37.489478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.766 [2024-11-26 19:18:37.489582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.766 [2024-11-26 19:18:37.489612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.766 qpair failed and we were unable to recover it. 00:32:20.766 [2024-11-26 19:18:37.489890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.766 [2024-11-26 19:18:37.490077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.766 [2024-11-26 19:18:37.490112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.767 qpair failed and we were unable to recover it. 00:32:20.767 [2024-11-26 19:18:37.490309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.767 [2024-11-26 19:18:37.490552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.767 [2024-11-26 19:18:37.490567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.767 qpair failed and we were unable to recover it. 00:32:20.767 [2024-11-26 19:18:37.490721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.767 [2024-11-26 19:18:37.490868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.767 [2024-11-26 19:18:37.490900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.767 qpair failed and we were unable to recover it. 00:32:20.767 [2024-11-26 19:18:37.491028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.767 [2024-11-26 19:18:37.491230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.767 [2024-11-26 19:18:37.491262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.767 qpair failed and we were unable to recover it. 00:32:20.767 [2024-11-26 19:18:37.491512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.767 [2024-11-26 19:18:37.491586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.767 [2024-11-26 19:18:37.491602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.767 qpair failed and we were unable to recover it. 00:32:20.767 [2024-11-26 19:18:37.491689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.767 [2024-11-26 19:18:37.491911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.767 [2024-11-26 19:18:37.491942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.767 qpair failed and we were unable to recover it. 00:32:20.767 [2024-11-26 19:18:37.492080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.767 [2024-11-26 19:18:37.492315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.767 [2024-11-26 19:18:37.492348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.767 qpair failed and we were unable to recover it. 00:32:20.767 [2024-11-26 19:18:37.492539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.767 [2024-11-26 19:18:37.492608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.767 [2024-11-26 19:18:37.492624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.767 qpair failed and we were unable to recover it. 00:32:20.767 [2024-11-26 19:18:37.492695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.767 [2024-11-26 19:18:37.492766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.767 [2024-11-26 19:18:37.492779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.767 qpair failed and we were unable to recover it. 00:32:20.767 [2024-11-26 19:18:37.493047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.767 [2024-11-26 19:18:37.493242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.767 [2024-11-26 19:18:37.493274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.767 qpair failed and we were unable to recover it. 00:32:20.767 [2024-11-26 19:18:37.493502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.767 [2024-11-26 19:18:37.493690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.767 [2024-11-26 19:18:37.493722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.767 qpair failed and we were unable to recover it. 00:32:20.767 [2024-11-26 19:18:37.493851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.767 [2024-11-26 19:18:37.493969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.767 [2024-11-26 19:18:37.494002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.767 qpair failed and we were unable to recover it. 00:32:20.767 [2024-11-26 19:18:37.494132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.767 [2024-11-26 19:18:37.494251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.767 [2024-11-26 19:18:37.494281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.767 qpair failed and we were unable to recover it. 00:32:20.767 [2024-11-26 19:18:37.494490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.767 [2024-11-26 19:18:37.494613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.767 [2024-11-26 19:18:37.494644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.767 qpair failed and we were unable to recover it. 00:32:20.767 [2024-11-26 19:18:37.494906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.767 [2024-11-26 19:18:37.495035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.767 [2024-11-26 19:18:37.495066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.767 qpair failed and we were unable to recover it. 00:32:20.767 [2024-11-26 19:18:37.495191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.767 [2024-11-26 19:18:37.495330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.767 [2024-11-26 19:18:37.495346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.767 qpair failed and we were unable to recover it. 00:32:20.767 [2024-11-26 19:18:37.495500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.767 [2024-11-26 19:18:37.495585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.767 [2024-11-26 19:18:37.495601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.767 qpair failed and we were unable to recover it. 00:32:20.767 [2024-11-26 19:18:37.495689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.767 [2024-11-26 19:18:37.495923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.767 [2024-11-26 19:18:37.495965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.767 qpair failed and we were unable to recover it. 00:32:20.767 [2024-11-26 19:18:37.496098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.767 [2024-11-26 19:18:37.496269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.767 [2024-11-26 19:18:37.496301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.767 qpair failed and we were unable to recover it. 00:32:20.767 [2024-11-26 19:18:37.496487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.767 [2024-11-26 19:18:37.496662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.767 [2024-11-26 19:18:37.496692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.767 qpair failed and we were unable to recover it. 00:32:20.767 [2024-11-26 19:18:37.496864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.767 [2024-11-26 19:18:37.496988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.767 [2024-11-26 19:18:37.497026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.767 qpair failed and we were unable to recover it. 00:32:20.767 [2024-11-26 19:18:37.497113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.767 [2024-11-26 19:18:37.497259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.767 [2024-11-26 19:18:37.497274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.767 qpair failed and we were unable to recover it. 00:32:20.767 [2024-11-26 19:18:37.497428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.767 [2024-11-26 19:18:37.497565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.767 [2024-11-26 19:18:37.497580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.767 qpair failed and we were unable to recover it. 00:32:20.768 [2024-11-26 19:18:37.497656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.768 [2024-11-26 19:18:37.497818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.768 [2024-11-26 19:18:37.497833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.768 qpair failed and we were unable to recover it. 00:32:20.768 [2024-11-26 19:18:37.497907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.768 [2024-11-26 19:18:37.498075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.768 [2024-11-26 19:18:37.498109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.768 qpair failed and we were unable to recover it. 00:32:20.768 [2024-11-26 19:18:37.498229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.768 [2024-11-26 19:18:37.498397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.768 [2024-11-26 19:18:37.498428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.768 qpair failed and we were unable to recover it. 00:32:20.768 [2024-11-26 19:18:37.498562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.768 [2024-11-26 19:18:37.498741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.768 [2024-11-26 19:18:37.498773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.768 qpair failed and we were unable to recover it. 00:32:20.768 [2024-11-26 19:18:37.498975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.768 [2024-11-26 19:18:37.499146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.768 [2024-11-26 19:18:37.499162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.768 qpair failed and we were unable to recover it. 00:32:20.768 [2024-11-26 19:18:37.499255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.768 [2024-11-26 19:18:37.499326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.768 [2024-11-26 19:18:37.499341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.768 qpair failed and we were unable to recover it. 00:32:20.768 [2024-11-26 19:18:37.499496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.768 [2024-11-26 19:18:37.499643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.768 [2024-11-26 19:18:37.499660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.768 qpair failed and we were unable to recover it. 00:32:20.768 [2024-11-26 19:18:37.499824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.768 [2024-11-26 19:18:37.500033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.768 [2024-11-26 19:18:37.500065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.768 qpair failed and we were unable to recover it. 00:32:20.768 [2024-11-26 19:18:37.500206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.768 [2024-11-26 19:18:37.500422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.768 [2024-11-26 19:18:37.500454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.768 qpair failed and we were unable to recover it. 00:32:20.768 [2024-11-26 19:18:37.500591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.768 [2024-11-26 19:18:37.500803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.768 [2024-11-26 19:18:37.500836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.768 qpair failed and we were unable to recover it. 00:32:20.768 [2024-11-26 19:18:37.501070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.768 [2024-11-26 19:18:37.501221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.768 [2024-11-26 19:18:37.501238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.768 qpair failed and we were unable to recover it. 00:32:20.768 [2024-11-26 19:18:37.501341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.768 [2024-11-26 19:18:37.501419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.768 [2024-11-26 19:18:37.501434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.768 qpair failed and we were unable to recover it. 00:32:20.768 [2024-11-26 19:18:37.501519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.768 [2024-11-26 19:18:37.501724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.768 [2024-11-26 19:18:37.501741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.768 qpair failed and we were unable to recover it. 00:32:20.768 [2024-11-26 19:18:37.501886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.768 [2024-11-26 19:18:37.501980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.768 [2024-11-26 19:18:37.501994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.768 qpair failed and we were unable to recover it. 00:32:20.768 [2024-11-26 19:18:37.502084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.768 [2024-11-26 19:18:37.502161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.768 [2024-11-26 19:18:37.502178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.768 qpair failed and we were unable to recover it. 00:32:20.768 [2024-11-26 19:18:37.502251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.768 [2024-11-26 19:18:37.502324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.768 [2024-11-26 19:18:37.502337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.768 qpair failed and we were unable to recover it. 00:32:20.768 [2024-11-26 19:18:37.502408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.768 [2024-11-26 19:18:37.502496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.768 [2024-11-26 19:18:37.502514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.768 qpair failed and we were unable to recover it. 00:32:20.768 [2024-11-26 19:18:37.502747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.768 [2024-11-26 19:18:37.502923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.768 [2024-11-26 19:18:37.502937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.768 qpair failed and we were unable to recover it. 00:32:20.768 [2024-11-26 19:18:37.503089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.768 [2024-11-26 19:18:37.503296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.768 [2024-11-26 19:18:37.503341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.768 qpair failed and we were unable to recover it. 00:32:20.768 [2024-11-26 19:18:37.503521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.768 [2024-11-26 19:18:37.503699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.768 [2024-11-26 19:18:37.503731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.768 qpair failed and we were unable to recover it. 00:32:20.768 [2024-11-26 19:18:37.503856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.768 [2024-11-26 19:18:37.503965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.768 [2024-11-26 19:18:37.503980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.768 qpair failed and we were unable to recover it. 00:32:20.768 [2024-11-26 19:18:37.504054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.768 [2024-11-26 19:18:37.504152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.768 [2024-11-26 19:18:37.504183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.768 qpair failed and we were unable to recover it. 00:32:20.768 [2024-11-26 19:18:37.504319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.768 [2024-11-26 19:18:37.504555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.768 [2024-11-26 19:18:37.504588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.768 qpair failed and we were unable to recover it. 00:32:20.768 [2024-11-26 19:18:37.504803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.768 [2024-11-26 19:18:37.504984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.768 [2024-11-26 19:18:37.505018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.768 qpair failed and we were unable to recover it. 00:32:20.769 [2024-11-26 19:18:37.505126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.769 [2024-11-26 19:18:37.505290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.769 [2024-11-26 19:18:37.505328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.769 qpair failed and we were unable to recover it. 00:32:20.769 [2024-11-26 19:18:37.505503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.769 [2024-11-26 19:18:37.505653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.769 [2024-11-26 19:18:37.505686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.769 qpair failed and we were unable to recover it. 00:32:20.769 [2024-11-26 19:18:37.505902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.769 [2024-11-26 19:18:37.506150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.769 [2024-11-26 19:18:37.506183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.769 qpair failed and we were unable to recover it. 00:32:20.769 [2024-11-26 19:18:37.506445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.769 [2024-11-26 19:18:37.506645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.769 [2024-11-26 19:18:37.506676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.769 qpair failed and we were unable to recover it. 00:32:20.769 [2024-11-26 19:18:37.506798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.769 [2024-11-26 19:18:37.507006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.769 [2024-11-26 19:18:37.507039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.769 qpair failed and we were unable to recover it. 00:32:20.769 [2024-11-26 19:18:37.507170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.769 [2024-11-26 19:18:37.507248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.769 [2024-11-26 19:18:37.507263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.769 qpair failed and we were unable to recover it. 00:32:20.769 [2024-11-26 19:18:37.507412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.769 [2024-11-26 19:18:37.507597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.769 [2024-11-26 19:18:37.507628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.769 qpair failed and we were unable to recover it. 00:32:20.769 [2024-11-26 19:18:37.507739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.769 [2024-11-26 19:18:37.507852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.769 [2024-11-26 19:18:37.507883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.769 qpair failed and we were unable to recover it. 00:32:20.769 [2024-11-26 19:18:37.508013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.769 [2024-11-26 19:18:37.508185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.769 [2024-11-26 19:18:37.508216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.769 qpair failed and we were unable to recover it. 00:32:20.769 [2024-11-26 19:18:37.508400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.769 [2024-11-26 19:18:37.508486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.769 [2024-11-26 19:18:37.508502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.769 qpair failed and we were unable to recover it. 00:32:20.769 [2024-11-26 19:18:37.508643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.769 [2024-11-26 19:18:37.508759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.769 [2024-11-26 19:18:37.508789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.769 qpair failed and we were unable to recover it. 00:32:20.769 [2024-11-26 19:18:37.508971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.769 [2024-11-26 19:18:37.509164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.769 [2024-11-26 19:18:37.509207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.769 qpair failed and we were unable to recover it. 00:32:20.769 [2024-11-26 19:18:37.509415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.769 [2024-11-26 19:18:37.509635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.769 [2024-11-26 19:18:37.509651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.769 qpair failed and we were unable to recover it. 00:32:20.769 [2024-11-26 19:18:37.509753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.769 [2024-11-26 19:18:37.509966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.769 [2024-11-26 19:18:37.510000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.769 qpair failed and we were unable to recover it. 00:32:20.769 [2024-11-26 19:18:37.510130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.769 [2024-11-26 19:18:37.510346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.769 [2024-11-26 19:18:37.510378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.769 qpair failed and we were unable to recover it. 00:32:20.769 [2024-11-26 19:18:37.510570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.769 [2024-11-26 19:18:37.510740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.769 [2024-11-26 19:18:37.510772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.769 qpair failed and we were unable to recover it. 00:32:20.769 [2024-11-26 19:18:37.510902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.769 [2024-11-26 19:18:37.511050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.769 [2024-11-26 19:18:37.511067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.769 qpair failed and we were unable to recover it. 00:32:20.769 [2024-11-26 19:18:37.511236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.769 [2024-11-26 19:18:37.511413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.769 [2024-11-26 19:18:37.511444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.769 qpair failed and we were unable to recover it. 00:32:20.769 [2024-11-26 19:18:37.511563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.769 [2024-11-26 19:18:37.511674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.769 [2024-11-26 19:18:37.511704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.769 qpair failed and we were unable to recover it. 00:32:20.769 [2024-11-26 19:18:37.511965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.769 [2024-11-26 19:18:37.512208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.769 [2024-11-26 19:18:37.512223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.769 qpair failed and we were unable to recover it. 00:32:20.769 [2024-11-26 19:18:37.512326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.769 [2024-11-26 19:18:37.512501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.769 [2024-11-26 19:18:37.512516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.769 qpair failed and we were unable to recover it. 00:32:20.769 [2024-11-26 19:18:37.512719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.769 [2024-11-26 19:18:37.512866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.769 [2024-11-26 19:18:37.512881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.769 qpair failed and we were unable to recover it. 00:32:20.769 [2024-11-26 19:18:37.512970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.769 [2024-11-26 19:18:37.513131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.769 [2024-11-26 19:18:37.513147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.769 qpair failed and we were unable to recover it. 00:32:20.769 [2024-11-26 19:18:37.513293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.769 [2024-11-26 19:18:37.513563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.769 [2024-11-26 19:18:37.513595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.769 qpair failed and we were unable to recover it. 00:32:20.770 [2024-11-26 19:18:37.513794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.770 [2024-11-26 19:18:37.513910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.770 [2024-11-26 19:18:37.513942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.770 qpair failed and we were unable to recover it. 00:32:20.770 [2024-11-26 19:18:37.514127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.770 [2024-11-26 19:18:37.514303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.770 [2024-11-26 19:18:37.514334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.770 qpair failed and we were unable to recover it. 00:32:20.770 [2024-11-26 19:18:37.514467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.770 [2024-11-26 19:18:37.514669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.770 [2024-11-26 19:18:37.514684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.770 qpair failed and we were unable to recover it. 00:32:20.770 [2024-11-26 19:18:37.514895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.770 [2024-11-26 19:18:37.515048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.770 [2024-11-26 19:18:37.515080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.770 qpair failed and we were unable to recover it. 00:32:20.770 [2024-11-26 19:18:37.515206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.770 [2024-11-26 19:18:37.515384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.770 [2024-11-26 19:18:37.515416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.770 qpair failed and we were unable to recover it. 00:32:20.770 [2024-11-26 19:18:37.515537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.770 [2024-11-26 19:18:37.515724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.770 [2024-11-26 19:18:37.515756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.770 qpair failed and we were unable to recover it. 00:32:20.770 [2024-11-26 19:18:37.515937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.770 [2024-11-26 19:18:37.516144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.770 [2024-11-26 19:18:37.516178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.770 qpair failed and we were unable to recover it. 00:32:20.770 [2024-11-26 19:18:37.516373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.770 [2024-11-26 19:18:37.516537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.770 [2024-11-26 19:18:37.516570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.770 qpair failed and we were unable to recover it. 00:32:20.770 [2024-11-26 19:18:37.516683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.770 [2024-11-26 19:18:37.516807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.770 [2024-11-26 19:18:37.516839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.770 qpair failed and we were unable to recover it. 00:32:20.770 [2024-11-26 19:18:37.516962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.770 [2024-11-26 19:18:37.517082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.770 [2024-11-26 19:18:37.517098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.770 qpair failed and we were unable to recover it. 00:32:20.770 [2024-11-26 19:18:37.517236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.770 [2024-11-26 19:18:37.517439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.770 [2024-11-26 19:18:37.517456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.770 qpair failed and we were unable to recover it. 00:32:20.770 [2024-11-26 19:18:37.517545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.770 [2024-11-26 19:18:37.517684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.770 [2024-11-26 19:18:37.517700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.770 qpair failed and we were unable to recover it. 00:32:20.770 [2024-11-26 19:18:37.517851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.770 [2024-11-26 19:18:37.517928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.770 [2024-11-26 19:18:37.517943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.770 qpair failed and we were unable to recover it. 00:32:20.770 [2024-11-26 19:18:37.518034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.770 [2024-11-26 19:18:37.518184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.770 [2024-11-26 19:18:37.518200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.770 qpair failed and we were unable to recover it. 00:32:20.770 [2024-11-26 19:18:37.518353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.770 [2024-11-26 19:18:37.518433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.770 [2024-11-26 19:18:37.518448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.770 qpair failed and we were unable to recover it. 00:32:20.770 [2024-11-26 19:18:37.518596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.770 [2024-11-26 19:18:37.518691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.770 [2024-11-26 19:18:37.518707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.770 qpair failed and we were unable to recover it. 00:32:20.770 [2024-11-26 19:18:37.518896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.770 [2024-11-26 19:18:37.518968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.770 [2024-11-26 19:18:37.518985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.770 qpair failed and we were unable to recover it. 00:32:20.770 [2024-11-26 19:18:37.519139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.770 [2024-11-26 19:18:37.519284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.770 [2024-11-26 19:18:37.519316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.770 qpair failed and we were unable to recover it. 00:32:20.770 [2024-11-26 19:18:37.519421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.770 [2024-11-26 19:18:37.519531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.770 [2024-11-26 19:18:37.519564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.770 qpair failed and we were unable to recover it. 00:32:20.770 [2024-11-26 19:18:37.519709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.770 [2024-11-26 19:18:37.519809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.770 [2024-11-26 19:18:37.519846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.770 qpair failed and we were unable to recover it. 00:32:20.770 [2024-11-26 19:18:37.520036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.770 [2024-11-26 19:18:37.520119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.770 [2024-11-26 19:18:37.520136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.770 qpair failed and we were unable to recover it. 00:32:20.770 [2024-11-26 19:18:37.520226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.770 [2024-11-26 19:18:37.520409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.770 [2024-11-26 19:18:37.520441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.770 qpair failed and we were unable to recover it. 00:32:20.770 [2024-11-26 19:18:37.520652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.770 [2024-11-26 19:18:37.520783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.770 [2024-11-26 19:18:37.520815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.770 qpair failed and we were unable to recover it. 00:32:20.770 [2024-11-26 19:18:37.520934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.770 [2024-11-26 19:18:37.521084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.771 [2024-11-26 19:18:37.521100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.771 qpair failed and we were unable to recover it. 00:32:20.771 [2024-11-26 19:18:37.521172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.771 [2024-11-26 19:18:37.521272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.771 [2024-11-26 19:18:37.521304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.771 qpair failed and we were unable to recover it. 00:32:20.771 [2024-11-26 19:18:37.521485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.771 [2024-11-26 19:18:37.521652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.771 [2024-11-26 19:18:37.521685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.771 qpair failed and we were unable to recover it. 00:32:20.771 [2024-11-26 19:18:37.521794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.771 [2024-11-26 19:18:37.521990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.771 [2024-11-26 19:18:37.522022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.771 qpair failed and we were unable to recover it. 00:32:20.771 [2024-11-26 19:18:37.522200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.771 [2024-11-26 19:18:37.522387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.771 [2024-11-26 19:18:37.522417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.771 qpair failed and we were unable to recover it. 00:32:20.771 [2024-11-26 19:18:37.522604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.771 [2024-11-26 19:18:37.522718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.771 [2024-11-26 19:18:37.522750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.771 qpair failed and we were unable to recover it. 00:32:20.771 [2024-11-26 19:18:37.522944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.771 [2024-11-26 19:18:37.523175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.771 [2024-11-26 19:18:37.523193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.771 qpair failed and we were unable to recover it. 00:32:20.771 [2024-11-26 19:18:37.523345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.771 [2024-11-26 19:18:37.523447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.771 [2024-11-26 19:18:37.523479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.771 qpair failed and we were unable to recover it. 00:32:20.771 [2024-11-26 19:18:37.523654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.771 [2024-11-26 19:18:37.523822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.771 [2024-11-26 19:18:37.523854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.771 qpair failed and we were unable to recover it. 00:32:20.771 [2024-11-26 19:18:37.524098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.771 [2024-11-26 19:18:37.524223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.771 [2024-11-26 19:18:37.524255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.771 qpair failed and we were unable to recover it. 00:32:20.771 [2024-11-26 19:18:37.524496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.771 [2024-11-26 19:18:37.524677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.771 [2024-11-26 19:18:37.524694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.771 qpair failed and we were unable to recover it. 00:32:20.771 [2024-11-26 19:18:37.524835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.771 [2024-11-26 19:18:37.525007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.771 [2024-11-26 19:18:37.525023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.771 qpair failed and we were unable to recover it. 00:32:20.771 [2024-11-26 19:18:37.525205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.771 [2024-11-26 19:18:37.525467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.771 [2024-11-26 19:18:37.525499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.771 qpair failed and we were unable to recover it. 00:32:20.771 [2024-11-26 19:18:37.525684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.771 [2024-11-26 19:18:37.525872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.771 [2024-11-26 19:18:37.525904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.771 qpair failed and we were unable to recover it. 00:32:20.771 [2024-11-26 19:18:37.526092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.771 [2024-11-26 19:18:37.526286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.771 [2024-11-26 19:18:37.526318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.771 qpair failed and we were unable to recover it. 00:32:20.771 [2024-11-26 19:18:37.526561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.771 [2024-11-26 19:18:37.526638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.771 [2024-11-26 19:18:37.526653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.771 qpair failed and we were unable to recover it. 00:32:20.771 [2024-11-26 19:18:37.526793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.771 [2024-11-26 19:18:37.526965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.771 [2024-11-26 19:18:37.526997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.771 qpair failed and we were unable to recover it. 00:32:20.771 [2024-11-26 19:18:37.527145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.771 [2024-11-26 19:18:37.527259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.771 [2024-11-26 19:18:37.527289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.771 qpair failed and we were unable to recover it. 00:32:20.771 [2024-11-26 19:18:37.527467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.771 [2024-11-26 19:18:37.527632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.771 [2024-11-26 19:18:37.527648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.771 qpair failed and we were unable to recover it. 00:32:20.771 [2024-11-26 19:18:37.527806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.771 [2024-11-26 19:18:37.527895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.771 [2024-11-26 19:18:37.527925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.771 qpair failed and we were unable to recover it. 00:32:20.771 [2024-11-26 19:18:37.528119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.771 [2024-11-26 19:18:37.528360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.771 [2024-11-26 19:18:37.528390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.771 qpair failed and we were unable to recover it. 00:32:20.771 [2024-11-26 19:18:37.528573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.771 [2024-11-26 19:18:37.528667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.771 [2024-11-26 19:18:37.528682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.771 qpair failed and we were unable to recover it. 00:32:20.771 [2024-11-26 19:18:37.528770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.771 [2024-11-26 19:18:37.528858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.771 [2024-11-26 19:18:37.528873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.771 qpair failed and we were unable to recover it. 00:32:20.772 [2024-11-26 19:18:37.528974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.772 [2024-11-26 19:18:37.529070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.772 [2024-11-26 19:18:37.529086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.772 qpair failed and we were unable to recover it. 00:32:20.772 [2024-11-26 19:18:37.529252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.772 [2024-11-26 19:18:37.529379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.772 [2024-11-26 19:18:37.529411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.772 qpair failed and we were unable to recover it. 00:32:20.772 [2024-11-26 19:18:37.529676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.772 [2024-11-26 19:18:37.529801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.772 [2024-11-26 19:18:37.529833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.772 qpair failed and we were unable to recover it. 00:32:20.772 [2024-11-26 19:18:37.529971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.772 [2024-11-26 19:18:37.530158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.772 [2024-11-26 19:18:37.530189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.772 qpair failed and we were unable to recover it. 00:32:20.772 [2024-11-26 19:18:37.530314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.772 [2024-11-26 19:18:37.530494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.772 [2024-11-26 19:18:37.530526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.772 qpair failed and we were unable to recover it. 00:32:20.772 [2024-11-26 19:18:37.530634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.772 [2024-11-26 19:18:37.530831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.772 [2024-11-26 19:18:37.530863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.772 qpair failed and we were unable to recover it. 00:32:20.772 [2024-11-26 19:18:37.530980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.772 [2024-11-26 19:18:37.531088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.772 [2024-11-26 19:18:37.531104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.772 qpair failed and we were unable to recover it. 00:32:20.772 [2024-11-26 19:18:37.531191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.772 [2024-11-26 19:18:37.531271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.772 [2024-11-26 19:18:37.531287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.772 qpair failed and we were unable to recover it. 00:32:20.772 [2024-11-26 19:18:37.531497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.772 [2024-11-26 19:18:37.531591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.772 [2024-11-26 19:18:37.531606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.772 qpair failed and we were unable to recover it. 00:32:20.772 [2024-11-26 19:18:37.531761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.772 [2024-11-26 19:18:37.531904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.772 [2024-11-26 19:18:37.531937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.772 qpair failed and we were unable to recover it. 00:32:20.772 [2024-11-26 19:18:37.532094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.772 [2024-11-26 19:18:37.532211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.772 [2024-11-26 19:18:37.532241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.772 qpair failed and we were unable to recover it. 00:32:20.772 [2024-11-26 19:18:37.532436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.772 [2024-11-26 19:18:37.532557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.772 [2024-11-26 19:18:37.532589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.772 qpair failed and we were unable to recover it. 00:32:20.772 [2024-11-26 19:18:37.532778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.772 [2024-11-26 19:18:37.532942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.772 [2024-11-26 19:18:37.532986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.772 qpair failed and we were unable to recover it. 00:32:20.772 [2024-11-26 19:18:37.533178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.772 [2024-11-26 19:18:37.533354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.772 [2024-11-26 19:18:37.533387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.772 qpair failed and we were unable to recover it. 00:32:20.772 [2024-11-26 19:18:37.533566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.772 [2024-11-26 19:18:37.533753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.772 [2024-11-26 19:18:37.533785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.772 qpair failed and we were unable to recover it. 00:32:20.772 [2024-11-26 19:18:37.533980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.772 [2024-11-26 19:18:37.534098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.772 [2024-11-26 19:18:37.534130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.772 qpair failed and we were unable to recover it. 00:32:20.772 [2024-11-26 19:18:37.534379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.772 [2024-11-26 19:18:37.534512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.772 [2024-11-26 19:18:37.534528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.772 qpair failed and we were unable to recover it. 00:32:20.772 [2024-11-26 19:18:37.534668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.772 [2024-11-26 19:18:37.534873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.772 [2024-11-26 19:18:37.534889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.772 qpair failed and we were unable to recover it. 00:32:20.773 [2024-11-26 19:18:37.534993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.773 [2024-11-26 19:18:37.535077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.773 [2024-11-26 19:18:37.535092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.773 qpair failed and we were unable to recover it. 00:32:20.773 [2024-11-26 19:18:37.535227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.773 [2024-11-26 19:18:37.535301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.773 [2024-11-26 19:18:37.535318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.773 qpair failed and we were unable to recover it. 00:32:20.773 [2024-11-26 19:18:37.535537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.773 [2024-11-26 19:18:37.535678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.773 [2024-11-26 19:18:37.535694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.773 qpair failed and we were unable to recover it. 00:32:20.773 [2024-11-26 19:18:37.535845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.773 [2024-11-26 19:18:37.535931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.773 [2024-11-26 19:18:37.535952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.773 qpair failed and we were unable to recover it. 00:32:20.773 [2024-11-26 19:18:37.536032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.773 [2024-11-26 19:18:37.536120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.773 [2024-11-26 19:18:37.536135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.773 qpair failed and we were unable to recover it. 00:32:20.773 [2024-11-26 19:18:37.536218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.773 [2024-11-26 19:18:37.536321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.773 [2024-11-26 19:18:37.536352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.773 qpair failed and we were unable to recover it. 00:32:20.773 [2024-11-26 19:18:37.536478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.773 [2024-11-26 19:18:37.536592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.773 [2024-11-26 19:18:37.536630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.773 qpair failed and we were unable to recover it. 00:32:20.773 [2024-11-26 19:18:37.536757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.773 [2024-11-26 19:18:37.536877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.773 [2024-11-26 19:18:37.536909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.773 qpair failed and we were unable to recover it. 00:32:20.773 [2024-11-26 19:18:37.537196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.773 [2024-11-26 19:18:37.537371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.773 [2024-11-26 19:18:37.537402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.773 qpair failed and we were unable to recover it. 00:32:20.773 [2024-11-26 19:18:37.537576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.773 [2024-11-26 19:18:37.537651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.773 [2024-11-26 19:18:37.537667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.773 qpair failed and we were unable to recover it. 00:32:20.773 [2024-11-26 19:18:37.537833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.773 [2024-11-26 19:18:37.537902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.773 [2024-11-26 19:18:37.537918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.773 qpair failed and we were unable to recover it. 00:32:20.773 [2024-11-26 19:18:37.538009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.773 [2024-11-26 19:18:37.538242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.773 [2024-11-26 19:18:37.538276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.773 qpair failed and we were unable to recover it. 00:32:20.773 [2024-11-26 19:18:37.538393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.773 [2024-11-26 19:18:37.538514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.773 [2024-11-26 19:18:37.538547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.773 qpair failed and we were unable to recover it. 00:32:20.773 [2024-11-26 19:18:37.538681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.773 [2024-11-26 19:18:37.538864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.773 [2024-11-26 19:18:37.538896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.773 qpair failed and we were unable to recover it. 00:32:20.773 [2024-11-26 19:18:37.539047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.773 [2024-11-26 19:18:37.539161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.773 [2024-11-26 19:18:37.539193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.773 qpair failed and we were unable to recover it. 00:32:20.773 [2024-11-26 19:18:37.539323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.773 [2024-11-26 19:18:37.539496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.773 [2024-11-26 19:18:37.539512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.773 qpair failed and we were unable to recover it. 00:32:20.773 [2024-11-26 19:18:37.539655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.773 [2024-11-26 19:18:37.539794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.773 [2024-11-26 19:18:37.539814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.773 qpair failed and we were unable to recover it. 00:32:20.773 [2024-11-26 19:18:37.539896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.773 [2024-11-26 19:18:37.539971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.773 [2024-11-26 19:18:37.539988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.773 qpair failed and we were unable to recover it. 00:32:20.773 [2024-11-26 19:18:37.540157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.773 [2024-11-26 19:18:37.540225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.773 [2024-11-26 19:18:37.540241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.773 qpair failed and we were unable to recover it. 00:32:20.773 [2024-11-26 19:18:37.540380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.773 [2024-11-26 19:18:37.540490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.773 [2024-11-26 19:18:37.540521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.773 qpair failed and we were unable to recover it. 00:32:20.773 [2024-11-26 19:18:37.540645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.773 [2024-11-26 19:18:37.540754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.773 [2024-11-26 19:18:37.540785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.773 qpair failed and we were unable to recover it. 00:32:20.773 [2024-11-26 19:18:37.540912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.773 [2024-11-26 19:18:37.541044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.773 [2024-11-26 19:18:37.541076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.773 qpair failed and we were unable to recover it. 00:32:20.774 [2024-11-26 19:18:37.541145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.774 [2024-11-26 19:18:37.541298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.774 [2024-11-26 19:18:37.541313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.774 qpair failed and we were unable to recover it. 00:32:20.774 [2024-11-26 19:18:37.541425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.774 [2024-11-26 19:18:37.541509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.774 [2024-11-26 19:18:37.541524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.774 qpair failed and we were unable to recover it. 00:32:20.774 [2024-11-26 19:18:37.541606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.774 [2024-11-26 19:18:37.541780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.774 [2024-11-26 19:18:37.541797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.774 qpair failed and we were unable to recover it. 00:32:20.774 [2024-11-26 19:18:37.541942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.774 [2024-11-26 19:18:37.542018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.774 [2024-11-26 19:18:37.542034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.774 qpair failed and we were unable to recover it. 00:32:20.774 [2024-11-26 19:18:37.542186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.774 [2024-11-26 19:18:37.542399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.774 [2024-11-26 19:18:37.542431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.774 qpair failed and we were unable to recover it. 00:32:20.774 [2024-11-26 19:18:37.542678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.774 [2024-11-26 19:18:37.542854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.774 [2024-11-26 19:18:37.542886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.774 qpair failed and we were unable to recover it. 00:32:20.774 [2024-11-26 19:18:37.543141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.774 [2024-11-26 19:18:37.543270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.774 [2024-11-26 19:18:37.543285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.774 qpair failed and we were unable to recover it. 00:32:20.774 [2024-11-26 19:18:37.543419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.774 [2024-11-26 19:18:37.543499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.774 [2024-11-26 19:18:37.543515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.774 qpair failed and we were unable to recover it. 00:32:20.774 [2024-11-26 19:18:37.543661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.774 [2024-11-26 19:18:37.543861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.774 [2024-11-26 19:18:37.543893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.774 qpair failed and we were unable to recover it. 00:32:20.774 [2024-11-26 19:18:37.544084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.774 [2024-11-26 19:18:37.544287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.774 [2024-11-26 19:18:37.544320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.774 qpair failed and we were unable to recover it. 00:32:20.774 [2024-11-26 19:18:37.544568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.774 [2024-11-26 19:18:37.544767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.774 [2024-11-26 19:18:37.544799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.774 qpair failed and we were unable to recover it. 00:32:20.774 [2024-11-26 19:18:37.544911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.774 [2024-11-26 19:18:37.545186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.774 [2024-11-26 19:18:37.545218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.774 qpair failed and we were unable to recover it. 00:32:20.774 [2024-11-26 19:18:37.545420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.774 [2024-11-26 19:18:37.545599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.774 [2024-11-26 19:18:37.545631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.774 qpair failed and we were unable to recover it. 00:32:20.774 [2024-11-26 19:18:37.545735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.774 [2024-11-26 19:18:37.545971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.774 [2024-11-26 19:18:37.546006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.774 qpair failed and we were unable to recover it. 00:32:20.774 [2024-11-26 19:18:37.546182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.774 [2024-11-26 19:18:37.546368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.774 [2024-11-26 19:18:37.546399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.774 qpair failed and we were unable to recover it. 00:32:20.774 [2024-11-26 19:18:37.546590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.774 [2024-11-26 19:18:37.546717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.774 [2024-11-26 19:18:37.546748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.774 qpair failed and we were unable to recover it. 00:32:20.774 [2024-11-26 19:18:37.546867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.774 [2024-11-26 19:18:37.546978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.774 [2024-11-26 19:18:37.547009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.774 qpair failed and we were unable to recover it. 00:32:20.774 [2024-11-26 19:18:37.547191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.774 [2024-11-26 19:18:37.547269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.774 [2024-11-26 19:18:37.547285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.774 qpair failed and we were unable to recover it. 00:32:20.774 [2024-11-26 19:18:37.547373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.774 [2024-11-26 19:18:37.547583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.774 [2024-11-26 19:18:37.547615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.774 qpair failed and we were unable to recover it. 00:32:20.774 [2024-11-26 19:18:37.547726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.774 [2024-11-26 19:18:37.547846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.774 [2024-11-26 19:18:37.547878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.774 qpair failed and we were unable to recover it. 00:32:20.774 [2024-11-26 19:18:37.548122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.774 [2024-11-26 19:18:37.548296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.774 [2024-11-26 19:18:37.548328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.774 qpair failed and we were unable to recover it. 00:32:20.774 [2024-11-26 19:18:37.548458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.774 [2024-11-26 19:18:37.548568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.774 [2024-11-26 19:18:37.548601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.774 qpair failed and we were unable to recover it. 00:32:20.774 [2024-11-26 19:18:37.548844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.774 [2024-11-26 19:18:37.548978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.774 [2024-11-26 19:18:37.549011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.774 qpair failed and we were unable to recover it. 00:32:20.774 [2024-11-26 19:18:37.549190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.774 [2024-11-26 19:18:37.549301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.774 [2024-11-26 19:18:37.549333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.774 qpair failed and we were unable to recover it. 00:32:20.774 [2024-11-26 19:18:37.549446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.775 [2024-11-26 19:18:37.549627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.775 [2024-11-26 19:18:37.549643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.775 qpair failed and we were unable to recover it. 00:32:20.775 [2024-11-26 19:18:37.549716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.775 [2024-11-26 19:18:37.549808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.775 [2024-11-26 19:18:37.549823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.775 qpair failed and we were unable to recover it. 00:32:20.775 [2024-11-26 19:18:37.549964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.775 [2024-11-26 19:18:37.550073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.775 [2024-11-26 19:18:37.550089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.775 qpair failed and we were unable to recover it. 00:32:20.775 [2024-11-26 19:18:37.550163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.775 [2024-11-26 19:18:37.550297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.775 [2024-11-26 19:18:37.550312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.775 qpair failed and we were unable to recover it. 00:32:20.775 [2024-11-26 19:18:37.550399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.775 [2024-11-26 19:18:37.550534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.775 [2024-11-26 19:18:37.550551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.775 qpair failed and we were unable to recover it. 00:32:20.775 [2024-11-26 19:18:37.550646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.775 [2024-11-26 19:18:37.550738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.775 [2024-11-26 19:18:37.550753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.775 qpair failed and we were unable to recover it. 00:32:20.775 [2024-11-26 19:18:37.550859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.775 [2024-11-26 19:18:37.550998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.775 [2024-11-26 19:18:37.551014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.775 qpair failed and we were unable to recover it. 00:32:20.775 [2024-11-26 19:18:37.551168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.775 [2024-11-26 19:18:37.551341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.775 [2024-11-26 19:18:37.551374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.775 qpair failed and we were unable to recover it. 00:32:20.775 [2024-11-26 19:18:37.551645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.775 [2024-11-26 19:18:37.551817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.775 [2024-11-26 19:18:37.551850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.775 qpair failed and we were unable to recover it. 00:32:20.775 [2024-11-26 19:18:37.551977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.775 [2024-11-26 19:18:37.552170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.775 [2024-11-26 19:18:37.552208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.775 qpair failed and we were unable to recover it. 00:32:20.775 [2024-11-26 19:18:37.552277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.775 [2024-11-26 19:18:37.552372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.775 [2024-11-26 19:18:37.552388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.775 qpair failed and we were unable to recover it. 00:32:20.775 [2024-11-26 19:18:37.552535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.775 [2024-11-26 19:18:37.552625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.775 [2024-11-26 19:18:37.552641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.775 qpair failed and we were unable to recover it. 00:32:20.775 [2024-11-26 19:18:37.552724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.775 [2024-11-26 19:18:37.552808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.775 [2024-11-26 19:18:37.552825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.775 qpair failed and we were unable to recover it. 00:32:20.775 [2024-11-26 19:18:37.553036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.775 [2024-11-26 19:18:37.553122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.775 [2024-11-26 19:18:37.553138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.775 qpair failed and we were unable to recover it. 00:32:20.775 [2024-11-26 19:18:37.553232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.775 [2024-11-26 19:18:37.553373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.775 [2024-11-26 19:18:37.553389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.775 qpair failed and we were unable to recover it. 00:32:20.775 [2024-11-26 19:18:37.553607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.775 [2024-11-26 19:18:37.553747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.775 [2024-11-26 19:18:37.553763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.775 qpair failed and we were unable to recover it. 00:32:20.775 [2024-11-26 19:18:37.553915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.775 [2024-11-26 19:18:37.554036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.775 [2024-11-26 19:18:37.554069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.775 qpair failed and we were unable to recover it. 00:32:20.775 [2024-11-26 19:18:37.554244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.775 [2024-11-26 19:18:37.554352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.775 [2024-11-26 19:18:37.554384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.775 qpair failed and we were unable to recover it. 00:32:20.775 [2024-11-26 19:18:37.554499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.775 [2024-11-26 19:18:37.554657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.775 [2024-11-26 19:18:37.554673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.775 qpair failed and we were unable to recover it. 00:32:20.775 [2024-11-26 19:18:37.554769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.775 [2024-11-26 19:18:37.554850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.775 [2024-11-26 19:18:37.554865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.775 qpair failed and we were unable to recover it. 00:32:20.775 [2024-11-26 19:18:37.554977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.775 [2024-11-26 19:18:37.555080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.775 [2024-11-26 19:18:37.555112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.775 qpair failed and we were unable to recover it. 00:32:20.775 [2024-11-26 19:18:37.555236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.775 [2024-11-26 19:18:37.555346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.775 [2024-11-26 19:18:37.555383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.775 qpair failed and we were unable to recover it. 00:32:20.775 [2024-11-26 19:18:37.555653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.775 [2024-11-26 19:18:37.555766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.775 [2024-11-26 19:18:37.555798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.775 qpair failed and we were unable to recover it. 00:32:20.775 [2024-11-26 19:18:37.555928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.775 [2024-11-26 19:18:37.556049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.775 [2024-11-26 19:18:37.556081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.775 qpair failed and we were unable to recover it. 00:32:20.775 [2024-11-26 19:18:37.556197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.775 [2024-11-26 19:18:37.556315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.775 [2024-11-26 19:18:37.556350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.775 qpair failed and we were unable to recover it. 00:32:20.775 [2024-11-26 19:18:37.556452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.775 [2024-11-26 19:18:37.556531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.775 [2024-11-26 19:18:37.556546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.775 qpair failed and we were unable to recover it. 00:32:20.775 [2024-11-26 19:18:37.556689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.775 [2024-11-26 19:18:37.556836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.775 [2024-11-26 19:18:37.556851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.775 qpair failed and we were unable to recover it. 00:32:20.775 [2024-11-26 19:18:37.556937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.775 [2024-11-26 19:18:37.557026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.775 [2024-11-26 19:18:37.557042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.775 qpair failed and we were unable to recover it. 00:32:20.775 [2024-11-26 19:18:37.557189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.775 [2024-11-26 19:18:37.557362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.775 [2024-11-26 19:18:37.557396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.775 qpair failed and we were unable to recover it. 00:32:20.775 [2024-11-26 19:18:37.557588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.775 [2024-11-26 19:18:37.557769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.775 [2024-11-26 19:18:37.557800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.775 qpair failed and we were unable to recover it. 00:32:20.775 [2024-11-26 19:18:37.558003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.775 [2024-11-26 19:18:37.558183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.775 [2024-11-26 19:18:37.558214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.775 qpair failed and we were unable to recover it. 00:32:20.775 [2024-11-26 19:18:37.558335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.775 [2024-11-26 19:18:37.558507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.775 [2024-11-26 19:18:37.558552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.775 qpair failed and we were unable to recover it. 00:32:20.775 [2024-11-26 19:18:37.558715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.775 [2024-11-26 19:18:37.558925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.775 [2024-11-26 19:18:37.558940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.775 qpair failed and we were unable to recover it. 00:32:20.775 [2024-11-26 19:18:37.559111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.775 [2024-11-26 19:18:37.559235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.776 [2024-11-26 19:18:37.559267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.776 qpair failed and we were unable to recover it. 00:32:20.776 [2024-11-26 19:18:37.559442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.776 [2024-11-26 19:18:37.559622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.776 [2024-11-26 19:18:37.559654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.776 qpair failed and we were unable to recover it. 00:32:20.776 [2024-11-26 19:18:37.559781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.776 [2024-11-26 19:18:37.559912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.776 [2024-11-26 19:18:37.559944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.776 qpair failed and we were unable to recover it. 00:32:20.776 [2024-11-26 19:18:37.560076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.776 [2024-11-26 19:18:37.560279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.776 [2024-11-26 19:18:37.560311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.776 qpair failed and we were unable to recover it. 00:32:20.776 [2024-11-26 19:18:37.560428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.776 [2024-11-26 19:18:37.560609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.776 [2024-11-26 19:18:37.560640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.776 qpair failed and we were unable to recover it. 00:32:20.776 [2024-11-26 19:18:37.560764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.776 [2024-11-26 19:18:37.561016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.776 [2024-11-26 19:18:37.561048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.776 qpair failed and we were unable to recover it. 00:32:20.776 [2024-11-26 19:18:37.561219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.776 [2024-11-26 19:18:37.561306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.776 [2024-11-26 19:18:37.561322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.776 qpair failed and we were unable to recover it. 00:32:20.776 [2024-11-26 19:18:37.561416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.776 [2024-11-26 19:18:37.561505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.776 [2024-11-26 19:18:37.561520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.776 qpair failed and we were unable to recover it. 00:32:20.776 [2024-11-26 19:18:37.561594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.776 [2024-11-26 19:18:37.561684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.776 [2024-11-26 19:18:37.561701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.776 qpair failed and we were unable to recover it. 00:32:20.776 [2024-11-26 19:18:37.561793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.776 [2024-11-26 19:18:37.561939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.776 [2024-11-26 19:18:37.561984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.776 qpair failed and we were unable to recover it. 00:32:20.776 [2024-11-26 19:18:37.562128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.776 [2024-11-26 19:18:37.562277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.776 [2024-11-26 19:18:37.562309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.776 qpair failed and we were unable to recover it. 00:32:20.776 [2024-11-26 19:18:37.562427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.776 [2024-11-26 19:18:37.562571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.776 [2024-11-26 19:18:37.562587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.776 qpair failed and we were unable to recover it. 00:32:20.776 [2024-11-26 19:18:37.562724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.776 [2024-11-26 19:18:37.562815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.776 [2024-11-26 19:18:37.562831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.776 qpair failed and we were unable to recover it. 00:32:20.776 [2024-11-26 19:18:37.563023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.776 [2024-11-26 19:18:37.563174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.776 [2024-11-26 19:18:37.563190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.776 qpair failed and we were unable to recover it. 00:32:20.776 [2024-11-26 19:18:37.563281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.776 [2024-11-26 19:18:37.563348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.776 [2024-11-26 19:18:37.563364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.776 qpair failed and we were unable to recover it. 00:32:20.776 [2024-11-26 19:18:37.563544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.776 [2024-11-26 19:18:37.563782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.776 [2024-11-26 19:18:37.563814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.776 qpair failed and we were unable to recover it. 00:32:20.776 [2024-11-26 19:18:37.564041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.776 [2024-11-26 19:18:37.564254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.776 [2024-11-26 19:18:37.564270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.776 qpair failed and we were unable to recover it. 00:32:20.776 [2024-11-26 19:18:37.564368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.776 [2024-11-26 19:18:37.564480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.776 [2024-11-26 19:18:37.564511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.776 qpair failed and we were unable to recover it. 00:32:20.776 [2024-11-26 19:18:37.564622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.776 [2024-11-26 19:18:37.564757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.776 [2024-11-26 19:18:37.564790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.776 qpair failed and we were unable to recover it. 00:32:20.777 [2024-11-26 19:18:37.564992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.777 [2024-11-26 19:18:37.565165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.777 [2024-11-26 19:18:37.565197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.777 qpair failed and we were unable to recover it. 00:32:20.777 [2024-11-26 19:18:37.565377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.777 [2024-11-26 19:18:37.565610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.777 [2024-11-26 19:18:37.565626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.777 qpair failed and we were unable to recover it. 00:32:20.777 [2024-11-26 19:18:37.565771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.777 [2024-11-26 19:18:37.565934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.777 [2024-11-26 19:18:37.566008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.777 qpair failed and we were unable to recover it. 00:32:20.777 [2024-11-26 19:18:37.566127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.777 [2024-11-26 19:18:37.566449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.777 [2024-11-26 19:18:37.566480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.777 qpair failed and we were unable to recover it. 00:32:20.777 [2024-11-26 19:18:37.566668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.777 [2024-11-26 19:18:37.566862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.777 [2024-11-26 19:18:37.566894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.777 qpair failed and we were unable to recover it. 00:32:20.777 [2024-11-26 19:18:37.567025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.777 [2024-11-26 19:18:37.567220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.777 [2024-11-26 19:18:37.567253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.777 qpair failed and we were unable to recover it. 00:32:20.777 [2024-11-26 19:18:37.567380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.777 [2024-11-26 19:18:37.567571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.777 [2024-11-26 19:18:37.567586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.777 qpair failed and we were unable to recover it. 00:32:20.777 [2024-11-26 19:18:37.567737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.777 [2024-11-26 19:18:37.567821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.777 [2024-11-26 19:18:37.567838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.777 qpair failed and we were unable to recover it. 00:32:20.777 [2024-11-26 19:18:37.568004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.777 [2024-11-26 19:18:37.568160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.777 [2024-11-26 19:18:37.568176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.777 qpair failed and we were unable to recover it. 00:32:20.777 [2024-11-26 19:18:37.568335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.777 [2024-11-26 19:18:37.568509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.777 [2024-11-26 19:18:37.568541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.777 qpair failed and we were unable to recover it. 00:32:20.777 [2024-11-26 19:18:37.568717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.777 [2024-11-26 19:18:37.568911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.777 [2024-11-26 19:18:37.568942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.778 qpair failed and we were unable to recover it. 00:32:20.778 [2024-11-26 19:18:37.569146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.778 [2024-11-26 19:18:37.569394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.778 [2024-11-26 19:18:37.569424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.778 qpair failed and we were unable to recover it. 00:32:20.778 [2024-11-26 19:18:37.569623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.778 [2024-11-26 19:18:37.569781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.778 [2024-11-26 19:18:37.569796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.778 qpair failed and we were unable to recover it. 00:32:20.778 [2024-11-26 19:18:37.569959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.778 [2024-11-26 19:18:37.570163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.778 [2024-11-26 19:18:37.570179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.778 qpair failed and we were unable to recover it. 00:32:20.778 [2024-11-26 19:18:37.570397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.778 [2024-11-26 19:18:37.570516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.778 [2024-11-26 19:18:37.570546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.778 qpair failed and we were unable to recover it. 00:32:20.778 [2024-11-26 19:18:37.570731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.778 [2024-11-26 19:18:37.570908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.778 [2024-11-26 19:18:37.570939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.778 qpair failed and we were unable to recover it. 00:32:20.778 [2024-11-26 19:18:37.571093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.778 [2024-11-26 19:18:37.571208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.778 [2024-11-26 19:18:37.571239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.778 qpair failed and we were unable to recover it. 00:32:20.778 [2024-11-26 19:18:37.571438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.779 [2024-11-26 19:18:37.571609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.779 [2024-11-26 19:18:37.571624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.779 qpair failed and we were unable to recover it. 00:32:20.779 [2024-11-26 19:18:37.571791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.779 [2024-11-26 19:18:37.571995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.779 [2024-11-26 19:18:37.572027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.779 qpair failed and we were unable to recover it. 00:32:20.779 [2024-11-26 19:18:37.572273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.779 [2024-11-26 19:18:37.572389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.779 [2024-11-26 19:18:37.572405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.779 qpair failed and we were unable to recover it. 00:32:20.779 [2024-11-26 19:18:37.572556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.779 [2024-11-26 19:18:37.572652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.779 [2024-11-26 19:18:37.572672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.779 qpair failed and we were unable to recover it. 00:32:20.779 [2024-11-26 19:18:37.572766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.779 [2024-11-26 19:18:37.572856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.779 [2024-11-26 19:18:37.572871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.779 qpair failed and we were unable to recover it. 00:32:20.779 [2024-11-26 19:18:37.573065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.779 [2024-11-26 19:18:37.573154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.779 [2024-11-26 19:18:37.573171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.779 qpair failed and we were unable to recover it. 00:32:20.779 [2024-11-26 19:18:37.573320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.779 [2024-11-26 19:18:37.573398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.779 [2024-11-26 19:18:37.573414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.779 qpair failed and we were unable to recover it. 00:32:20.779 [2024-11-26 19:18:37.573549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.780 [2024-11-26 19:18:37.573695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.780 [2024-11-26 19:18:37.573711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.780 qpair failed and we were unable to recover it. 00:32:20.780 [2024-11-26 19:18:37.573783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.780 [2024-11-26 19:18:37.573965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.780 [2024-11-26 19:18:37.573982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.780 qpair failed and we were unable to recover it. 00:32:20.780 [2024-11-26 19:18:37.574073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.780 [2024-11-26 19:18:37.574285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.780 [2024-11-26 19:18:37.574301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.780 qpair failed and we were unable to recover it. 00:32:20.780 [2024-11-26 19:18:37.574402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.780 [2024-11-26 19:18:37.574507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.780 [2024-11-26 19:18:37.574523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.780 qpair failed and we were unable to recover it. 00:32:20.780 [2024-11-26 19:18:37.574627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.780 [2024-11-26 19:18:37.574880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.780 [2024-11-26 19:18:37.574911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.780 qpair failed and we were unable to recover it. 00:32:20.780 [2024-11-26 19:18:37.575121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.780 [2024-11-26 19:18:37.575242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.780 [2024-11-26 19:18:37.575274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.780 qpair failed and we were unable to recover it. 00:32:20.780 [2024-11-26 19:18:37.575567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.780 [2024-11-26 19:18:37.575746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.780 [2024-11-26 19:18:37.575777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.780 qpair failed and we were unable to recover it. 00:32:20.780 [2024-11-26 19:18:37.575898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.780 [2024-11-26 19:18:37.576091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.780 [2024-11-26 19:18:37.576126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.780 qpair failed and we were unable to recover it. 00:32:20.780 [2024-11-26 19:18:37.576289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.780 [2024-11-26 19:18:37.576358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.781 [2024-11-26 19:18:37.576373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.781 qpair failed and we were unable to recover it. 00:32:20.781 [2024-11-26 19:18:37.576605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.781 [2024-11-26 19:18:37.576709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.781 [2024-11-26 19:18:37.576725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.781 qpair failed and we were unable to recover it. 00:32:20.781 [2024-11-26 19:18:37.576800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.781 [2024-11-26 19:18:37.577015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.781 [2024-11-26 19:18:37.577050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.781 qpair failed and we were unable to recover it. 00:32:20.781 [2024-11-26 19:18:37.577244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.781 [2024-11-26 19:18:37.577410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.781 [2024-11-26 19:18:37.577455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.781 qpair failed and we were unable to recover it. 00:32:20.781 [2024-11-26 19:18:37.577600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.781 [2024-11-26 19:18:37.577771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.781 [2024-11-26 19:18:37.577803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.781 qpair failed and we were unable to recover it. 00:32:20.781 [2024-11-26 19:18:37.577916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.781 [2024-11-26 19:18:37.578135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.781 [2024-11-26 19:18:37.578169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.781 qpair failed and we were unable to recover it. 00:32:20.781 [2024-11-26 19:18:37.578360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.781 [2024-11-26 19:18:37.578447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.781 [2024-11-26 19:18:37.578463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.781 qpair failed and we were unable to recover it. 00:32:20.781 [2024-11-26 19:18:37.578674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.781 [2024-11-26 19:18:37.578794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.781 [2024-11-26 19:18:37.578825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.781 qpair failed and we were unable to recover it. 00:32:20.781 [2024-11-26 19:18:37.579021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.781 [2024-11-26 19:18:37.579283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.781 [2024-11-26 19:18:37.579327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.781 qpair failed and we were unable to recover it. 00:32:20.781 [2024-11-26 19:18:37.579473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.781 [2024-11-26 19:18:37.579573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.781 [2024-11-26 19:18:37.579589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.781 qpair failed and we were unable to recover it. 00:32:20.781 [2024-11-26 19:18:37.579739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.781 [2024-11-26 19:18:37.579811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.781 [2024-11-26 19:18:37.579827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.781 qpair failed and we were unable to recover it. 00:32:20.781 [2024-11-26 19:18:37.579985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.781 [2024-11-26 19:18:37.580142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.781 [2024-11-26 19:18:37.580158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.781 qpair failed and we were unable to recover it. 00:32:20.781 [2024-11-26 19:18:37.580236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.782 [2024-11-26 19:18:37.580444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.782 [2024-11-26 19:18:37.580476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.782 qpair failed and we were unable to recover it. 00:32:20.782 [2024-11-26 19:18:37.580607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.782 [2024-11-26 19:18:37.580732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.782 [2024-11-26 19:18:37.580764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.782 qpair failed and we were unable to recover it. 00:32:20.782 [2024-11-26 19:18:37.580972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.782 [2024-11-26 19:18:37.581082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.782 [2024-11-26 19:18:37.581114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.782 qpair failed and we were unable to recover it. 00:32:20.782 [2024-11-26 19:18:37.581240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.782 [2024-11-26 19:18:37.581313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.782 [2024-11-26 19:18:37.581330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.782 qpair failed and we were unable to recover it. 00:32:20.782 [2024-11-26 19:18:37.581523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.782 [2024-11-26 19:18:37.581697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.782 [2024-11-26 19:18:37.581727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.782 qpair failed and we were unable to recover it. 00:32:20.782 [2024-11-26 19:18:37.581846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.782 [2024-11-26 19:18:37.582037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.782 [2024-11-26 19:18:37.582071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.782 qpair failed and we were unable to recover it. 00:32:20.782 [2024-11-26 19:18:37.582211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.782 [2024-11-26 19:18:37.582313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.782 [2024-11-26 19:18:37.582330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.782 qpair failed and we were unable to recover it. 00:32:20.782 [2024-11-26 19:18:37.582486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.782 [2024-11-26 19:18:37.582588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.782 [2024-11-26 19:18:37.582619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.782 qpair failed and we were unable to recover it. 00:32:20.782 [2024-11-26 19:18:37.582752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.782 [2024-11-26 19:18:37.582852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.782 [2024-11-26 19:18:37.582882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.782 qpair failed and we were unable to recover it. 00:32:20.782 [2024-11-26 19:18:37.583079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.782 [2024-11-26 19:18:37.583272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.782 [2024-11-26 19:18:37.583303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.782 qpair failed and we were unable to recover it. 00:32:20.782 [2024-11-26 19:18:37.583438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.782 [2024-11-26 19:18:37.583612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.782 [2024-11-26 19:18:37.583643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.782 qpair failed and we were unable to recover it. 00:32:20.782 [2024-11-26 19:18:37.583887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.782 [2024-11-26 19:18:37.584066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.782 [2024-11-26 19:18:37.584100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.782 qpair failed and we were unable to recover it. 00:32:20.782 [2024-11-26 19:18:37.584230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.782 [2024-11-26 19:18:37.584337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.782 [2024-11-26 19:18:37.584369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.782 qpair failed and we were unable to recover it. 00:32:20.782 [2024-11-26 19:18:37.584548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.783 [2024-11-26 19:18:37.584689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.783 [2024-11-26 19:18:37.584704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.783 qpair failed and we were unable to recover it. 00:32:20.783 [2024-11-26 19:18:37.584847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.783 [2024-11-26 19:18:37.584932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.783 [2024-11-26 19:18:37.584953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.783 qpair failed and we were unable to recover it. 00:32:20.783 [2024-11-26 19:18:37.585094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.783 [2024-11-26 19:18:37.585235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.783 [2024-11-26 19:18:37.585251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.783 qpair failed and we were unable to recover it. 00:32:20.783 [2024-11-26 19:18:37.585403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.783 [2024-11-26 19:18:37.585470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.783 [2024-11-26 19:18:37.585485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.783 qpair failed and we were unable to recover it. 00:32:20.783 [2024-11-26 19:18:37.585631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.783 [2024-11-26 19:18:37.585844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.783 [2024-11-26 19:18:37.585875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.783 qpair failed and we were unable to recover it. 00:32:20.783 [2024-11-26 19:18:37.586057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.783 [2024-11-26 19:18:37.586224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.783 [2024-11-26 19:18:37.586256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.783 qpair failed and we were unable to recover it. 00:32:20.783 [2024-11-26 19:18:37.586378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.783 [2024-11-26 19:18:37.586562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.783 [2024-11-26 19:18:37.586595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.783 qpair failed and we were unable to recover it. 00:32:20.783 [2024-11-26 19:18:37.586725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.783 [2024-11-26 19:18:37.586910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.783 [2024-11-26 19:18:37.586942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.783 qpair failed and we were unable to recover it. 00:32:20.783 [2024-11-26 19:18:37.587067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.783 [2024-11-26 19:18:37.587187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.783 [2024-11-26 19:18:37.587217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.783 qpair failed and we were unable to recover it. 00:32:20.783 [2024-11-26 19:18:37.587355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.783 [2024-11-26 19:18:37.587490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.783 [2024-11-26 19:18:37.587520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.783 qpair failed and we were unable to recover it. 00:32:20.783 [2024-11-26 19:18:37.587642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.783 [2024-11-26 19:18:37.587823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.783 [2024-11-26 19:18:37.587839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.783 qpair failed and we were unable to recover it. 00:32:20.783 [2024-11-26 19:18:37.587919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.783 [2024-11-26 19:18:37.588074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.783 [2024-11-26 19:18:37.588091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.783 qpair failed and we were unable to recover it. 00:32:20.783 [2024-11-26 19:18:37.588238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.783 [2024-11-26 19:18:37.588405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.783 [2024-11-26 19:18:37.588437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.783 qpair failed and we were unable to recover it. 00:32:20.783 [2024-11-26 19:18:37.588560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.784 [2024-11-26 19:18:37.588752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.784 [2024-11-26 19:18:37.588784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.784 qpair failed and we were unable to recover it. 00:32:20.784 [2024-11-26 19:18:37.588980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.784 [2024-11-26 19:18:37.589164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.784 [2024-11-26 19:18:37.589204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.784 qpair failed and we were unable to recover it. 00:32:20.784 [2024-11-26 19:18:37.589484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.784 [2024-11-26 19:18:37.589670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.784 [2024-11-26 19:18:37.589702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.784 qpair failed and we were unable to recover it. 00:32:20.784 [2024-11-26 19:18:37.589827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.784 [2024-11-26 19:18:37.589931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.784 [2024-11-26 19:18:37.589986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.784 qpair failed and we were unable to recover it. 00:32:20.784 [2024-11-26 19:18:37.590171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.784 [2024-11-26 19:18:37.590338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.784 [2024-11-26 19:18:37.590353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.784 qpair failed and we were unable to recover it. 00:32:20.784 [2024-11-26 19:18:37.590488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.784 [2024-11-26 19:18:37.590636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.784 [2024-11-26 19:18:37.590651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.784 qpair failed and we were unable to recover it. 00:32:20.784 [2024-11-26 19:18:37.590805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.784 [2024-11-26 19:18:37.591014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.784 [2024-11-26 19:18:37.591047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.784 qpair failed and we were unable to recover it. 00:32:20.784 [2024-11-26 19:18:37.591247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.784 [2024-11-26 19:18:37.591339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.784 [2024-11-26 19:18:37.591355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.784 qpair failed and we were unable to recover it. 00:32:20.784 [2024-11-26 19:18:37.591431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.784 [2024-11-26 19:18:37.591517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.784 [2024-11-26 19:18:37.591534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.784 qpair failed and we were unable to recover it. 00:32:20.784 [2024-11-26 19:18:37.591665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.784 [2024-11-26 19:18:37.591857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.784 [2024-11-26 19:18:37.591890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.784 qpair failed and we were unable to recover it. 00:32:20.784 [2024-11-26 19:18:37.592086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.784 [2024-11-26 19:18:37.592272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.784 [2024-11-26 19:18:37.592303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.784 qpair failed and we were unable to recover it. 00:32:20.784 [2024-11-26 19:18:37.592561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.784 [2024-11-26 19:18:37.592750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.784 [2024-11-26 19:18:37.592787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.784 qpair failed and we were unable to recover it. 00:32:20.785 [2024-11-26 19:18:37.592915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.785 [2024-11-26 19:18:37.593142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.785 [2024-11-26 19:18:37.593178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.785 qpair failed and we were unable to recover it. 00:32:20.785 [2024-11-26 19:18:37.593400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.785 [2024-11-26 19:18:37.593509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.785 [2024-11-26 19:18:37.593524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.785 qpair failed and we were unable to recover it. 00:32:20.785 [2024-11-26 19:18:37.593668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.785 [2024-11-26 19:18:37.593758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.785 [2024-11-26 19:18:37.593773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.785 qpair failed and we were unable to recover it. 00:32:20.785 [2024-11-26 19:18:37.593867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.785 [2024-11-26 19:18:37.593956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.785 [2024-11-26 19:18:37.593973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.785 qpair failed and we were unable to recover it. 00:32:20.785 [2024-11-26 19:18:37.594124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.785 [2024-11-26 19:18:37.594223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.785 [2024-11-26 19:18:37.594239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.785 qpair failed and we were unable to recover it. 00:32:20.785 [2024-11-26 19:18:37.594339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.785 [2024-11-26 19:18:37.594408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.785 [2024-11-26 19:18:37.594423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.785 qpair failed and we were unable to recover it. 00:32:20.785 [2024-11-26 19:18:37.594565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.785 [2024-11-26 19:18:37.594716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.785 [2024-11-26 19:18:37.594746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.785 qpair failed and we were unable to recover it. 00:32:20.785 [2024-11-26 19:18:37.594920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.785 [2024-11-26 19:18:37.595040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.785 [2024-11-26 19:18:37.595072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.785 qpair failed and we were unable to recover it. 00:32:20.785 [2024-11-26 19:18:37.595184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.785 [2024-11-26 19:18:37.595309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.785 [2024-11-26 19:18:37.595324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.785 qpair failed and we were unable to recover it. 00:32:20.785 [2024-11-26 19:18:37.595463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.785 [2024-11-26 19:18:37.595553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.785 [2024-11-26 19:18:37.595568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.785 qpair failed and we were unable to recover it. 00:32:20.785 [2024-11-26 19:18:37.595714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.785 [2024-11-26 19:18:37.595875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.785 [2024-11-26 19:18:37.595892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.785 qpair failed and we were unable to recover it. 00:32:20.785 [2024-11-26 19:18:37.595972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.785 [2024-11-26 19:18:37.596060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.785 [2024-11-26 19:18:37.596075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.785 qpair failed and we were unable to recover it. 00:32:20.785 [2024-11-26 19:18:37.596230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.785 [2024-11-26 19:18:37.596426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.785 [2024-11-26 19:18:37.596457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.785 qpair failed and we were unable to recover it. 00:32:20.785 [2024-11-26 19:18:37.596702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.785 [2024-11-26 19:18:37.596901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.786 [2024-11-26 19:18:37.596934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.786 qpair failed and we were unable to recover it. 00:32:20.786 [2024-11-26 19:18:37.597213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.786 [2024-11-26 19:18:37.597342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.786 [2024-11-26 19:18:37.597357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.786 qpair failed and we were unable to recover it. 00:32:20.786 [2024-11-26 19:18:37.597459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.786 [2024-11-26 19:18:37.597604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.786 [2024-11-26 19:18:37.597619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.786 qpair failed and we were unable to recover it. 00:32:20.786 [2024-11-26 19:18:37.597774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.786 [2024-11-26 19:18:37.597983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.786 [2024-11-26 19:18:37.598016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.786 qpair failed and we were unable to recover it. 00:32:20.786 [2024-11-26 19:18:37.598143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.786 [2024-11-26 19:18:37.598255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.786 [2024-11-26 19:18:37.598285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.786 qpair failed and we were unable to recover it. 00:32:20.786 [2024-11-26 19:18:37.598401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.786 [2024-11-26 19:18:37.598607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.786 [2024-11-26 19:18:37.598640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.786 qpair failed and we were unable to recover it. 00:32:20.786 [2024-11-26 19:18:37.598818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.786 [2024-11-26 19:18:37.599001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.786 [2024-11-26 19:18:37.599035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.786 qpair failed and we were unable to recover it. 00:32:20.786 [2024-11-26 19:18:37.599166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.786 [2024-11-26 19:18:37.599387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.786 [2024-11-26 19:18:37.599404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.786 qpair failed and we were unable to recover it. 00:32:20.786 [2024-11-26 19:18:37.599479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.786 [2024-11-26 19:18:37.599621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.786 [2024-11-26 19:18:37.599637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.786 qpair failed and we were unable to recover it. 00:32:20.786 [2024-11-26 19:18:37.599714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.786 [2024-11-26 19:18:37.599869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.786 [2024-11-26 19:18:37.599884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.786 qpair failed and we were unable to recover it. 00:32:20.787 [2024-11-26 19:18:37.599960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.787 [2024-11-26 19:18:37.600094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.787 [2024-11-26 19:18:37.600109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.787 qpair failed and we were unable to recover it. 00:32:20.787 [2024-11-26 19:18:37.600267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.787 [2024-11-26 19:18:37.600368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.787 [2024-11-26 19:18:37.600383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.787 qpair failed and we were unable to recover it. 00:32:20.787 [2024-11-26 19:18:37.600469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.787 [2024-11-26 19:18:37.600557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.787 [2024-11-26 19:18:37.600574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.787 qpair failed and we were unable to recover it. 00:32:20.787 [2024-11-26 19:18:37.600664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.787 [2024-11-26 19:18:37.600771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.787 [2024-11-26 19:18:37.600803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.787 qpair failed and we were unable to recover it. 00:32:20.787 [2024-11-26 19:18:37.600984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.787 [2024-11-26 19:18:37.601162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.787 [2024-11-26 19:18:37.601200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.787 qpair failed and we were unable to recover it. 00:32:20.787 [2024-11-26 19:18:37.601356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.787 [2024-11-26 19:18:37.601502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.787 [2024-11-26 19:18:37.601517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.787 qpair failed and we were unable to recover it. 00:32:20.787 [2024-11-26 19:18:37.601612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.787 [2024-11-26 19:18:37.601707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.787 [2024-11-26 19:18:37.601739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.787 qpair failed and we were unable to recover it. 00:32:20.787 [2024-11-26 19:18:37.601982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.787 [2024-11-26 19:18:37.602111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.787 [2024-11-26 19:18:37.602143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.787 qpair failed and we were unable to recover it. 00:32:20.787 [2024-11-26 19:18:37.602385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.787 [2024-11-26 19:18:37.602567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.787 [2024-11-26 19:18:37.602599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.787 qpair failed and we were unable to recover it. 00:32:20.788 [2024-11-26 19:18:37.602788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.788 [2024-11-26 19:18:37.602973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.788 [2024-11-26 19:18:37.603003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.788 qpair failed and we were unable to recover it. 00:32:20.788 [2024-11-26 19:18:37.603198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.788 [2024-11-26 19:18:37.603430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.788 [2024-11-26 19:18:37.603446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.788 qpair failed and we were unable to recover it. 00:32:20.788 [2024-11-26 19:18:37.603550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.788 [2024-11-26 19:18:37.603630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.788 [2024-11-26 19:18:37.603646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.788 qpair failed and we were unable to recover it. 00:32:20.788 [2024-11-26 19:18:37.603758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.788 [2024-11-26 19:18:37.603866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.788 [2024-11-26 19:18:37.603898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.788 qpair failed and we were unable to recover it. 00:32:20.788 [2024-11-26 19:18:37.604043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.788 [2024-11-26 19:18:37.604230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.788 [2024-11-26 19:18:37.604261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.788 qpair failed and we were unable to recover it. 00:32:20.788 [2024-11-26 19:18:37.604446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.788 [2024-11-26 19:18:37.604536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.788 [2024-11-26 19:18:37.604553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.788 qpair failed and we were unable to recover it. 00:32:20.788 [2024-11-26 19:18:37.604654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.788 [2024-11-26 19:18:37.604829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.788 [2024-11-26 19:18:37.604860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.788 qpair failed and we were unable to recover it. 00:32:20.788 [2024-11-26 19:18:37.604985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.788 [2024-11-26 19:18:37.605100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.788 [2024-11-26 19:18:37.605132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.788 qpair failed and we were unable to recover it. 00:32:20.788 [2024-11-26 19:18:37.605310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.788 [2024-11-26 19:18:37.605461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.788 [2024-11-26 19:18:37.605478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.788 qpair failed and we were unable to recover it. 00:32:20.788 [2024-11-26 19:18:37.605635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.789 [2024-11-26 19:18:37.605711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.789 [2024-11-26 19:18:37.605728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.789 qpair failed and we were unable to recover it. 00:32:20.789 [2024-11-26 19:18:37.605824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.789 [2024-11-26 19:18:37.605999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.789 [2024-11-26 19:18:37.606034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.789 qpair failed and we were unable to recover it. 00:32:20.789 [2024-11-26 19:18:37.606239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.789 [2024-11-26 19:18:37.606347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.789 [2024-11-26 19:18:37.606363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.789 qpair failed and we were unable to recover it. 00:32:20.789 [2024-11-26 19:18:37.606520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.789 [2024-11-26 19:18:37.606706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.789 [2024-11-26 19:18:37.606740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.789 qpair failed and we were unable to recover it. 00:32:20.789 [2024-11-26 19:18:37.606876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.789 [2024-11-26 19:18:37.606997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.789 [2024-11-26 19:18:37.607030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.789 qpair failed and we were unable to recover it. 00:32:20.789 [2024-11-26 19:18:37.607163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.789 [2024-11-26 19:18:37.607334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.789 [2024-11-26 19:18:37.607365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.789 qpair failed and we were unable to recover it. 00:32:20.789 [2024-11-26 19:18:37.607544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.790 [2024-11-26 19:18:37.607734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.790 [2024-11-26 19:18:37.607768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.790 qpair failed and we were unable to recover it. 00:32:20.790 [2024-11-26 19:18:37.607900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.790 [2024-11-26 19:18:37.608024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.790 [2024-11-26 19:18:37.608057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.790 qpair failed and we were unable to recover it. 00:32:20.790 [2024-11-26 19:18:37.608179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.790 [2024-11-26 19:18:37.608294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.790 [2024-11-26 19:18:37.608325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.790 qpair failed and we were unable to recover it. 00:32:20.790 [2024-11-26 19:18:37.608516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.790 [2024-11-26 19:18:37.608591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.790 [2024-11-26 19:18:37.608609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.790 qpair failed and we were unable to recover it. 00:32:20.790 [2024-11-26 19:18:37.608711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.790 [2024-11-26 19:18:37.608919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.790 [2024-11-26 19:18:37.608960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.790 qpair failed and we were unable to recover it. 00:32:20.791 [2024-11-26 19:18:37.609147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.791 [2024-11-26 19:18:37.609270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.791 [2024-11-26 19:18:37.609300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.791 qpair failed and we were unable to recover it. 00:32:20.791 [2024-11-26 19:18:37.609437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.791 [2024-11-26 19:18:37.609642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.791 [2024-11-26 19:18:37.609658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.791 qpair failed and we were unable to recover it. 00:32:20.791 [2024-11-26 19:18:37.609821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.791 [2024-11-26 19:18:37.609922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.791 [2024-11-26 19:18:37.609974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.791 qpair failed and we were unable to recover it. 00:32:20.791 [2024-11-26 19:18:37.610163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.791 [2024-11-26 19:18:37.610272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.791 [2024-11-26 19:18:37.610304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.791 qpair failed and we were unable to recover it. 00:32:20.791 [2024-11-26 19:18:37.610443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.791 [2024-11-26 19:18:37.610571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.791 [2024-11-26 19:18:37.610604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.791 qpair failed and we were unable to recover it. 00:32:20.792 [2024-11-26 19:18:37.610774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.792 [2024-11-26 19:18:37.610882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.792 [2024-11-26 19:18:37.610914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.792 qpair failed and we were unable to recover it. 00:32:20.792 [2024-11-26 19:18:37.611052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.792 [2024-11-26 19:18:37.611176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.792 [2024-11-26 19:18:37.611207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.792 qpair failed and we were unable to recover it. 00:32:20.792 [2024-11-26 19:18:37.611386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.792 [2024-11-26 19:18:37.611539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.792 [2024-11-26 19:18:37.611571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.792 qpair failed and we were unable to recover it. 00:32:20.792 [2024-11-26 19:18:37.611818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.792 [2024-11-26 19:18:37.611999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.792 [2024-11-26 19:18:37.612032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.792 qpair failed and we were unable to recover it. 00:32:20.792 [2024-11-26 19:18:37.612236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.792 [2024-11-26 19:18:37.612436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.792 [2024-11-26 19:18:37.612451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.792 qpair failed and we were unable to recover it. 00:32:20.792 [2024-11-26 19:18:37.612552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.792 [2024-11-26 19:18:37.612783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.792 [2024-11-26 19:18:37.612800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.792 qpair failed and we were unable to recover it. 00:32:20.792 [2024-11-26 19:18:37.612958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.792 [2024-11-26 19:18:37.613106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.792 [2024-11-26 19:18:37.613137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.793 qpair failed and we were unable to recover it. 00:32:20.793 [2024-11-26 19:18:37.613248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.793 [2024-11-26 19:18:37.613417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.793 [2024-11-26 19:18:37.613449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.793 qpair failed and we were unable to recover it. 00:32:20.793 [2024-11-26 19:18:37.613590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.793 [2024-11-26 19:18:37.613705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.794 [2024-11-26 19:18:37.613720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.794 qpair failed and we were unable to recover it. 00:32:20.794 [2024-11-26 19:18:37.613795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.794 [2024-11-26 19:18:37.614009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.794 [2024-11-26 19:18:37.614041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.794 qpair failed and we were unable to recover it. 00:32:20.794 [2024-11-26 19:18:37.614225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.794 [2024-11-26 19:18:37.614345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.794 [2024-11-26 19:18:37.614377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.794 qpair failed and we were unable to recover it. 00:32:20.794 [2024-11-26 19:18:37.614488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.794 [2024-11-26 19:18:37.614631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.794 [2024-11-26 19:18:37.614648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.794 qpair failed and we were unable to recover it. 00:32:20.794 [2024-11-26 19:18:37.614787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.794 [2024-11-26 19:18:37.614975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.794 [2024-11-26 19:18:37.615008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.794 qpair failed and we were unable to recover it. 00:32:20.794 [2024-11-26 19:18:37.615274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.794 [2024-11-26 19:18:37.615448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.794 [2024-11-26 19:18:37.615464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.794 qpair failed and we were unable to recover it. 00:32:20.794 [2024-11-26 19:18:37.615537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.795 [2024-11-26 19:18:37.615742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.795 [2024-11-26 19:18:37.615758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.795 qpair failed and we were unable to recover it. 00:32:20.795 [2024-11-26 19:18:37.615826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.795 [2024-11-26 19:18:37.615929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.795 [2024-11-26 19:18:37.615944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.795 qpair failed and we were unable to recover it. 00:32:20.795 [2024-11-26 19:18:37.616028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.795 [2024-11-26 19:18:37.616118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.795 [2024-11-26 19:18:37.616134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.795 qpair failed and we were unable to recover it. 00:32:20.795 [2024-11-26 19:18:37.616274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.795 [2024-11-26 19:18:37.616415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.795 [2024-11-26 19:18:37.616432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.795 qpair failed and we were unable to recover it. 00:32:20.795 [2024-11-26 19:18:37.616603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.795 [2024-11-26 19:18:37.616785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.795 [2024-11-26 19:18:37.616816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.795 qpair failed and we were unable to recover it. 00:32:20.795 [2024-11-26 19:18:37.616991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.795 [2024-11-26 19:18:37.617117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.795 [2024-11-26 19:18:37.617150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.795 qpair failed and we were unable to recover it. 00:32:20.795 [2024-11-26 19:18:37.617274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.795 [2024-11-26 19:18:37.617445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.795 [2024-11-26 19:18:37.617461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.795 qpair failed and we were unable to recover it. 00:32:20.795 [2024-11-26 19:18:37.617610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.795 [2024-11-26 19:18:37.617728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.796 [2024-11-26 19:18:37.617759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.796 qpair failed and we were unable to recover it. 00:32:20.796 [2024-11-26 19:18:37.618004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.796 [2024-11-26 19:18:37.618246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.796 [2024-11-26 19:18:37.618278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.796 qpair failed and we were unable to recover it. 00:32:20.796 [2024-11-26 19:18:37.618470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.796 [2024-11-26 19:18:37.618589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.796 [2024-11-26 19:18:37.618621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.796 qpair failed and we were unable to recover it. 00:32:20.796 [2024-11-26 19:18:37.618798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.796 [2024-11-26 19:18:37.618937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.796 [2024-11-26 19:18:37.618978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.796 qpair failed and we were unable to recover it. 00:32:20.796 [2024-11-26 19:18:37.619167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.796 [2024-11-26 19:18:37.619344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.796 [2024-11-26 19:18:37.619376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.796 qpair failed and we were unable to recover it. 00:32:20.796 [2024-11-26 19:18:37.619501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.796 [2024-11-26 19:18:37.619716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.796 [2024-11-26 19:18:37.619732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.796 qpair failed and we were unable to recover it. 00:32:20.796 [2024-11-26 19:18:37.619831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.796 [2024-11-26 19:18:37.619919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.797 [2024-11-26 19:18:37.619935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.797 qpair failed and we were unable to recover it. 00:32:20.797 [2024-11-26 19:18:37.620017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.797 [2024-11-26 19:18:37.620124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.797 [2024-11-26 19:18:37.620139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.797 qpair failed and we were unable to recover it. 00:32:20.797 [2024-11-26 19:18:37.620281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.797 [2024-11-26 19:18:37.620435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.797 [2024-11-26 19:18:37.620450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.797 qpair failed and we were unable to recover it. 00:32:20.797 [2024-11-26 19:18:37.620554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.797 [2024-11-26 19:18:37.620787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.797 [2024-11-26 19:18:37.620820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.797 qpair failed and we were unable to recover it. 00:32:20.797 [2024-11-26 19:18:37.621009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.797 [2024-11-26 19:18:37.621121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.797 [2024-11-26 19:18:37.621152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.797 qpair failed and we were unable to recover it. 00:32:20.797 [2024-11-26 19:18:37.621360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.797 [2024-11-26 19:18:37.621544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.797 [2024-11-26 19:18:37.621560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.797 qpair failed and we were unable to recover it. 00:32:20.798 [2024-11-26 19:18:37.621737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.798 [2024-11-26 19:18:37.621939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.798 [2024-11-26 19:18:37.621978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.798 qpair failed and we were unable to recover it. 00:32:20.798 [2024-11-26 19:18:37.622110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.798 [2024-11-26 19:18:37.622221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.798 [2024-11-26 19:18:37.622251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.798 qpair failed and we were unable to recover it. 00:32:20.798 [2024-11-26 19:18:37.622445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.798 [2024-11-26 19:18:37.622523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.798 [2024-11-26 19:18:37.622539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.798 qpair failed and we were unable to recover it. 00:32:20.798 [2024-11-26 19:18:37.622759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.798 [2024-11-26 19:18:37.622849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.798 [2024-11-26 19:18:37.622866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.798 qpair failed and we were unable to recover it. 00:32:20.798 [2024-11-26 19:18:37.623049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.798 [2024-11-26 19:18:37.623213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.798 [2024-11-26 19:18:37.623245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.798 qpair failed and we were unable to recover it. 00:32:20.798 [2024-11-26 19:18:37.623366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.798 [2024-11-26 19:18:37.623473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.798 [2024-11-26 19:18:37.623503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.798 qpair failed and we were unable to recover it. 00:32:20.799 [2024-11-26 19:18:37.623697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.799 [2024-11-26 19:18:37.623779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.799 [2024-11-26 19:18:37.623796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.799 qpair failed and we were unable to recover it. 00:32:20.799 [2024-11-26 19:18:37.623880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.799 [2024-11-26 19:18:37.623957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.799 [2024-11-26 19:18:37.623973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.799 qpair failed and we were unable to recover it. 00:32:20.799 [2024-11-26 19:18:37.624132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.799 [2024-11-26 19:18:37.624221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.799 [2024-11-26 19:18:37.624236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.799 qpair failed and we were unable to recover it. 00:32:20.799 [2024-11-26 19:18:37.624390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.799 [2024-11-26 19:18:37.624471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.799 [2024-11-26 19:18:37.624486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.799 qpair failed and we were unable to recover it. 00:32:20.799 [2024-11-26 19:18:37.624602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.799 [2024-11-26 19:18:37.624708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.799 [2024-11-26 19:18:37.624740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.799 qpair failed and we were unable to recover it. 00:32:20.799 [2024-11-26 19:18:37.625012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.799 [2024-11-26 19:18:37.625190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.799 [2024-11-26 19:18:37.625233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.799 qpair failed and we were unable to recover it. 00:32:20.800 [2024-11-26 19:18:37.625436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.800 [2024-11-26 19:18:37.625641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.800 [2024-11-26 19:18:37.625673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.800 qpair failed and we were unable to recover it. 00:32:20.800 [2024-11-26 19:18:37.625939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.800 [2024-11-26 19:18:37.626145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.800 [2024-11-26 19:18:37.626177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.800 qpair failed and we were unable to recover it. 00:32:20.800 [2024-11-26 19:18:37.626428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.800 [2024-11-26 19:18:37.626687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.800 [2024-11-26 19:18:37.626719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.800 qpair failed and we were unable to recover it. 00:32:20.800 [2024-11-26 19:18:37.626844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.800 [2024-11-26 19:18:37.627033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.800 [2024-11-26 19:18:37.627066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.800 qpair failed and we were unable to recover it. 00:32:20.800 [2024-11-26 19:18:37.627183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.800 [2024-11-26 19:18:37.627364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.800 [2024-11-26 19:18:37.627394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.800 qpair failed and we were unable to recover it. 00:32:20.800 [2024-11-26 19:18:37.627579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.800 [2024-11-26 19:18:37.627725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.800 [2024-11-26 19:18:37.627740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.800 qpair failed and we were unable to recover it. 00:32:20.800 [2024-11-26 19:18:37.627951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.800 [2024-11-26 19:18:37.628059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.800 [2024-11-26 19:18:37.628090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.800 qpair failed and we were unable to recover it. 00:32:20.800 [2024-11-26 19:18:37.628279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.800 [2024-11-26 19:18:37.628397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.800 [2024-11-26 19:18:37.628428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.800 qpair failed and we were unable to recover it. 00:32:20.800 [2024-11-26 19:18:37.628622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.800 [2024-11-26 19:18:37.628799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.800 [2024-11-26 19:18:37.628832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.800 qpair failed and we were unable to recover it. 00:32:20.800 [2024-11-26 19:18:37.628964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.800 [2024-11-26 19:18:37.629147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.800 [2024-11-26 19:18:37.629179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.800 qpair failed and we were unable to recover it. 00:32:20.800 [2024-11-26 19:18:37.629388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.800 [2024-11-26 19:18:37.629576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.800 [2024-11-26 19:18:37.629608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.800 qpair failed and we were unable to recover it. 00:32:20.800 [2024-11-26 19:18:37.629855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.800 [2024-11-26 19:18:37.630035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.800 [2024-11-26 19:18:37.630069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.800 qpair failed and we were unable to recover it. 00:32:20.800 [2024-11-26 19:18:37.630314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.800 [2024-11-26 19:18:37.630483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.801 [2024-11-26 19:18:37.630512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.801 qpair failed and we were unable to recover it. 00:32:20.801 [2024-11-26 19:18:37.630638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.801 [2024-11-26 19:18:37.630814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.801 [2024-11-26 19:18:37.630846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.801 qpair failed and we were unable to recover it. 00:32:20.801 [2024-11-26 19:18:37.631042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.801 [2024-11-26 19:18:37.631316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.801 [2024-11-26 19:18:37.631347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.801 qpair failed and we were unable to recover it. 00:32:20.801 [2024-11-26 19:18:37.631461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.801 [2024-11-26 19:18:37.631701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.801 [2024-11-26 19:18:37.631734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.801 qpair failed and we were unable to recover it. 00:32:20.801 [2024-11-26 19:18:37.631852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.801 [2024-11-26 19:18:37.631968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.801 [2024-11-26 19:18:37.631998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.801 qpair failed and we were unable to recover it. 00:32:20.801 [2024-11-26 19:18:37.632135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.801 [2024-11-26 19:18:37.632314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.801 [2024-11-26 19:18:37.632347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.801 qpair failed and we were unable to recover it. 00:32:20.801 [2024-11-26 19:18:37.632456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.801 [2024-11-26 19:18:37.632625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.801 [2024-11-26 19:18:37.632657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.801 qpair failed and we were unable to recover it. 00:32:20.801 [2024-11-26 19:18:37.632851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.801 [2024-11-26 19:18:37.633031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.801 [2024-11-26 19:18:37.633062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.801 qpair failed and we were unable to recover it. 00:32:20.801 [2024-11-26 19:18:37.633338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.801 [2024-11-26 19:18:37.633516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.801 [2024-11-26 19:18:37.633546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.801 qpair failed and we were unable to recover it. 00:32:20.801 [2024-11-26 19:18:37.633729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.801 [2024-11-26 19:18:37.633849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.801 [2024-11-26 19:18:37.633880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.801 qpair failed and we were unable to recover it. 00:32:20.801 [2024-11-26 19:18:37.633991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.801 [2024-11-26 19:18:37.634118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.801 [2024-11-26 19:18:37.634148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.801 qpair failed and we were unable to recover it. 00:32:20.801 [2024-11-26 19:18:37.634329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.801 [2024-11-26 19:18:37.634507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.801 [2024-11-26 19:18:37.634538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.801 qpair failed and we were unable to recover it. 00:32:20.801 [2024-11-26 19:18:37.634664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.801 [2024-11-26 19:18:37.634905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.801 [2024-11-26 19:18:37.634937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.801 qpair failed and we were unable to recover it. 00:32:20.801 [2024-11-26 19:18:37.635062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.801 [2024-11-26 19:18:37.635241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.801 [2024-11-26 19:18:37.635272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.801 qpair failed and we were unable to recover it. 00:32:20.801 [2024-11-26 19:18:37.635417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.801 [2024-11-26 19:18:37.635528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.801 [2024-11-26 19:18:37.635561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.801 qpair failed and we were unable to recover it. 00:32:20.801 [2024-11-26 19:18:37.635668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.801 [2024-11-26 19:18:37.635862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.801 [2024-11-26 19:18:37.635895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.801 qpair failed and we were unable to recover it. 00:32:20.801 [2024-11-26 19:18:37.636017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.801 [2024-11-26 19:18:37.636139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.801 [2024-11-26 19:18:37.636171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.801 qpair failed and we were unable to recover it. 00:32:20.801 [2024-11-26 19:18:37.636369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.802 [2024-11-26 19:18:37.636626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.802 [2024-11-26 19:18:37.636658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.802 qpair failed and we were unable to recover it. 00:32:20.802 [2024-11-26 19:18:37.636784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.802 [2024-11-26 19:18:37.636988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.802 [2024-11-26 19:18:37.637020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.802 qpair failed and we were unable to recover it. 00:32:20.802 [2024-11-26 19:18:37.637191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.802 [2024-11-26 19:18:37.637301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.802 [2024-11-26 19:18:37.637333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.802 qpair failed and we were unable to recover it. 00:32:20.802 [2024-11-26 19:18:37.637535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.802 [2024-11-26 19:18:37.637707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.802 [2024-11-26 19:18:37.637738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.802 qpair failed and we were unable to recover it. 00:32:20.802 [2024-11-26 19:18:37.637929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.802 [2024-11-26 19:18:37.638091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.802 [2024-11-26 19:18:37.638123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.802 qpair failed and we were unable to recover it. 00:32:20.802 [2024-11-26 19:18:37.638267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.802 [2024-11-26 19:18:37.638394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.802 [2024-11-26 19:18:37.638410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.802 qpair failed and we were unable to recover it. 00:32:20.802 [2024-11-26 19:18:37.638622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.802 [2024-11-26 19:18:37.638798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.802 [2024-11-26 19:18:37.638830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.802 qpair failed and we were unable to recover it. 00:32:20.802 [2024-11-26 19:18:37.638943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.802 [2024-11-26 19:18:37.639079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.802 [2024-11-26 19:18:37.639111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.802 qpair failed and we were unable to recover it. 00:32:20.802 [2024-11-26 19:18:37.639238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.802 [2024-11-26 19:18:37.639412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.802 [2024-11-26 19:18:37.639444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.802 qpair failed and we were unable to recover it. 00:32:20.802 [2024-11-26 19:18:37.639745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.802 [2024-11-26 19:18:37.639937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.802 [2024-11-26 19:18:37.639980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.802 qpair failed and we were unable to recover it. 00:32:20.802 [2024-11-26 19:18:37.640189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.802 [2024-11-26 19:18:37.640463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.802 [2024-11-26 19:18:37.640494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.802 qpair failed and we were unable to recover it. 00:32:20.802 [2024-11-26 19:18:37.640661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.802 [2024-11-26 19:18:37.640735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.802 [2024-11-26 19:18:37.640750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.802 qpair failed and we were unable to recover it. 00:32:20.802 [2024-11-26 19:18:37.640910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.802 [2024-11-26 19:18:37.641072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.802 [2024-11-26 19:18:37.641105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.802 qpair failed and we were unable to recover it. 00:32:20.802 [2024-11-26 19:18:37.641247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.802 [2024-11-26 19:18:37.641434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.802 [2024-11-26 19:18:37.641464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.802 qpair failed and we were unable to recover it. 00:32:20.802 [2024-11-26 19:18:37.641701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.802 [2024-11-26 19:18:37.641783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.802 [2024-11-26 19:18:37.641799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.802 qpair failed and we were unable to recover it. 00:32:20.802 [2024-11-26 19:18:37.641897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.802 [2024-11-26 19:18:37.642044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.802 [2024-11-26 19:18:37.642062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.802 qpair failed and we were unable to recover it. 00:32:20.802 [2024-11-26 19:18:37.642256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.802 [2024-11-26 19:18:37.642395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.802 [2024-11-26 19:18:37.642411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.802 qpair failed and we were unable to recover it. 00:32:20.802 [2024-11-26 19:18:37.642554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.802 [2024-11-26 19:18:37.642780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.802 [2024-11-26 19:18:37.642796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.802 qpair failed and we were unable to recover it. 00:32:20.802 [2024-11-26 19:18:37.642933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.802 [2024-11-26 19:18:37.643118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.802 [2024-11-26 19:18:37.643151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.802 qpair failed and we were unable to recover it. 00:32:20.802 [2024-11-26 19:18:37.643272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.802 [2024-11-26 19:18:37.643395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.802 [2024-11-26 19:18:37.643426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.802 qpair failed and we were unable to recover it. 00:32:20.802 [2024-11-26 19:18:37.643554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.802 [2024-11-26 19:18:37.643700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.802 [2024-11-26 19:18:37.643715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.802 qpair failed and we were unable to recover it. 00:32:20.802 [2024-11-26 19:18:37.643813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.802 [2024-11-26 19:18:37.643954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.802 [2024-11-26 19:18:37.643973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.802 qpair failed and we were unable to recover it. 00:32:20.802 [2024-11-26 19:18:37.644112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.802 [2024-11-26 19:18:37.644316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.802 [2024-11-26 19:18:37.644332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.802 qpair failed and we were unable to recover it. 00:32:20.802 [2024-11-26 19:18:37.644439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.802 [2024-11-26 19:18:37.644639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.802 [2024-11-26 19:18:37.644654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.802 qpair failed and we were unable to recover it. 00:32:20.802 [2024-11-26 19:18:37.644736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.802 [2024-11-26 19:18:37.644805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.802 [2024-11-26 19:18:37.644820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.802 qpair failed and we were unable to recover it. 00:32:20.802 [2024-11-26 19:18:37.644897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.802 [2024-11-26 19:18:37.644986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.802 [2024-11-26 19:18:37.645003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.802 qpair failed and we were unable to recover it. 00:32:20.802 [2024-11-26 19:18:37.645147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.802 [2024-11-26 19:18:37.645352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.802 [2024-11-26 19:18:37.645384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.802 qpair failed and we were unable to recover it. 00:32:20.802 [2024-11-26 19:18:37.645502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.802 [2024-11-26 19:18:37.645621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.802 [2024-11-26 19:18:37.645653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.802 qpair failed and we were unable to recover it. 00:32:20.802 [2024-11-26 19:18:37.645785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.802 [2024-11-26 19:18:37.645889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.802 [2024-11-26 19:18:37.645920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.802 qpair failed and we were unable to recover it. 00:32:20.802 [2024-11-26 19:18:37.646060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.802 [2024-11-26 19:18:37.646158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.802 [2024-11-26 19:18:37.646189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.802 qpair failed and we were unable to recover it. 00:32:20.802 [2024-11-26 19:18:37.646403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.802 [2024-11-26 19:18:37.646512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.802 [2024-11-26 19:18:37.646544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.802 qpair failed and we were unable to recover it. 00:32:20.802 [2024-11-26 19:18:37.646655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.802 [2024-11-26 19:18:37.646738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:20.802 [2024-11-26 19:18:37.646757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:20.802 qpair failed and we were unable to recover it. 00:32:21.090 [2024-11-26 19:18:37.646912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.090 [2024-11-26 19:18:37.647008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.090 [2024-11-26 19:18:37.647025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.090 qpair failed and we were unable to recover it. 00:32:21.090 [2024-11-26 19:18:37.647163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.090 [2024-11-26 19:18:37.647241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.090 [2024-11-26 19:18:37.647255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.090 qpair failed and we were unable to recover it. 00:32:21.090 [2024-11-26 19:18:37.647392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.090 [2024-11-26 19:18:37.647530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.090 [2024-11-26 19:18:37.647545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.090 qpair failed and we were unable to recover it. 00:32:21.090 [2024-11-26 19:18:37.647751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.090 [2024-11-26 19:18:37.647841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.090 [2024-11-26 19:18:37.647857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.090 qpair failed and we were unable to recover it. 00:32:21.090 [2024-11-26 19:18:37.647931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.090 [2024-11-26 19:18:37.648085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.090 [2024-11-26 19:18:37.648100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.090 qpair failed and we were unable to recover it. 00:32:21.091 [2024-11-26 19:18:37.648252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.648438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.648453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.091 qpair failed and we were unable to recover it. 00:32:21.091 [2024-11-26 19:18:37.648535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.648668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.648683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.091 qpair failed and we were unable to recover it. 00:32:21.091 [2024-11-26 19:18:37.648775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.648843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.648859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.091 qpair failed and we were unable to recover it. 00:32:21.091 [2024-11-26 19:18:37.649037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.649252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.649267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.091 qpair failed and we were unable to recover it. 00:32:21.091 [2024-11-26 19:18:37.649358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.649544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.649559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.091 qpair failed and we were unable to recover it. 00:32:21.091 [2024-11-26 19:18:37.649642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.649822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.649837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.091 qpair failed and we were unable to recover it. 00:32:21.091 [2024-11-26 19:18:37.650072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.650207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.650222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.091 qpair failed and we were unable to recover it. 00:32:21.091 [2024-11-26 19:18:37.650307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.650514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.650530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.091 qpair failed and we were unable to recover it. 00:32:21.091 [2024-11-26 19:18:37.650681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.650858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.650874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.091 qpair failed and we were unable to recover it. 00:32:21.091 [2024-11-26 19:18:37.651024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.651178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.651210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.091 qpair failed and we were unable to recover it. 00:32:21.091 [2024-11-26 19:18:37.651335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.651530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.651562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.091 qpair failed and we were unable to recover it. 00:32:21.091 [2024-11-26 19:18:37.651734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.651877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.651893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.091 qpair failed and we were unable to recover it. 00:32:21.091 [2024-11-26 19:18:37.652028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.652180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.652196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.091 qpair failed and we were unable to recover it. 00:32:21.091 [2024-11-26 19:18:37.652349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.652482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.652498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.091 qpair failed and we were unable to recover it. 00:32:21.091 [2024-11-26 19:18:37.652675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.652757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.652800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.091 qpair failed and we were unable to recover it. 00:32:21.091 [2024-11-26 19:18:37.652918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.653189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.653222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.091 qpair failed and we were unable to recover it. 00:32:21.091 [2024-11-26 19:18:37.653388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.653475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.653491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.091 qpair failed and we were unable to recover it. 00:32:21.091 [2024-11-26 19:18:37.653654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.653892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.653924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.091 qpair failed and we were unable to recover it. 00:32:21.091 [2024-11-26 19:18:37.654166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.654297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.654329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.091 qpair failed and we were unable to recover it. 00:32:21.091 [2024-11-26 19:18:37.654526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.654701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.654732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.091 qpair failed and we were unable to recover it. 00:32:21.091 [2024-11-26 19:18:37.654972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.655076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.655108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.091 qpair failed and we were unable to recover it. 00:32:21.091 [2024-11-26 19:18:37.655295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.655462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.655493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.091 qpair failed and we were unable to recover it. 00:32:21.091 [2024-11-26 19:18:37.655686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.655842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.655873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.091 qpair failed and we were unable to recover it. 00:32:21.091 [2024-11-26 19:18:37.656050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.656245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.656277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.091 qpair failed and we were unable to recover it. 00:32:21.091 [2024-11-26 19:18:37.656469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.656642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.656658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.091 qpair failed and we were unable to recover it. 00:32:21.091 [2024-11-26 19:18:37.656789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.656984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.657016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.091 qpair failed and we were unable to recover it. 00:32:21.091 [2024-11-26 19:18:37.657145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.657329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.657362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.091 qpair failed and we were unable to recover it. 00:32:21.091 [2024-11-26 19:18:37.657561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.657804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.657837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.091 qpair failed and we were unable to recover it. 00:32:21.091 [2024-11-26 19:18:37.657969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.658093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.658125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.091 qpair failed and we were unable to recover it. 00:32:21.091 [2024-11-26 19:18:37.658320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.658426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.658458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.091 qpair failed and we were unable to recover it. 00:32:21.091 [2024-11-26 19:18:37.658637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.658749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.658781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.091 qpair failed and we were unable to recover it. 00:32:21.091 [2024-11-26 19:18:37.659024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.659195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.659227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.091 qpair failed and we were unable to recover it. 00:32:21.091 [2024-11-26 19:18:37.659470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.659682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.659714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.091 qpair failed and we were unable to recover it. 00:32:21.091 [2024-11-26 19:18:37.659854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.659972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.660005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.091 qpair failed and we were unable to recover it. 00:32:21.091 [2024-11-26 19:18:37.660125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.091 [2024-11-26 19:18:37.660307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.092 [2024-11-26 19:18:37.660339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.092 qpair failed and we were unable to recover it. 00:32:21.092 [2024-11-26 19:18:37.660484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.092 [2024-11-26 19:18:37.660594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.092 [2024-11-26 19:18:37.660625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.092 qpair failed and we were unable to recover it. 00:32:21.092 [2024-11-26 19:18:37.660735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.092 [2024-11-26 19:18:37.660904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.092 [2024-11-26 19:18:37.660937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.092 qpair failed and we were unable to recover it. 00:32:21.092 [2024-11-26 19:18:37.661214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.092 [2024-11-26 19:18:37.661404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.092 [2024-11-26 19:18:37.661435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.092 qpair failed and we were unable to recover it. 00:32:21.092 [2024-11-26 19:18:37.661709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.092 [2024-11-26 19:18:37.661830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.092 [2024-11-26 19:18:37.661860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.092 qpair failed and we were unable to recover it. 00:32:21.092 [2024-11-26 19:18:37.662047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.092 [2024-11-26 19:18:37.662240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.092 [2024-11-26 19:18:37.662273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.092 qpair failed and we were unable to recover it. 00:32:21.092 [2024-11-26 19:18:37.662465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.092 [2024-11-26 19:18:37.662648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.092 [2024-11-26 19:18:37.662679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.092 qpair failed and we were unable to recover it. 00:32:21.092 [2024-11-26 19:18:37.662923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.092 [2024-11-26 19:18:37.663097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.092 [2024-11-26 19:18:37.663113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.092 qpair failed and we were unable to recover it. 00:32:21.092 [2024-11-26 19:18:37.663288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.092 [2024-11-26 19:18:37.663412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.092 [2024-11-26 19:18:37.663443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.092 qpair failed and we were unable to recover it. 00:32:21.092 [2024-11-26 19:18:37.663575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.092 [2024-11-26 19:18:37.663693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.092 [2024-11-26 19:18:37.663723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.092 qpair failed and we were unable to recover it. 00:32:21.092 [2024-11-26 19:18:37.663914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.092 [2024-11-26 19:18:37.664138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.092 [2024-11-26 19:18:37.664155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.092 qpair failed and we were unable to recover it. 00:32:21.092 [2024-11-26 19:18:37.664255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.092 [2024-11-26 19:18:37.664336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.092 [2024-11-26 19:18:37.664354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.092 qpair failed and we were unable to recover it. 00:32:21.092 [2024-11-26 19:18:37.664508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.092 [2024-11-26 19:18:37.664679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.092 [2024-11-26 19:18:37.664696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.092 qpair failed and we were unable to recover it. 00:32:21.092 [2024-11-26 19:18:37.664766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.092 [2024-11-26 19:18:37.664889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.092 [2024-11-26 19:18:37.664921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.092 qpair failed and we were unable to recover it. 00:32:21.092 [2024-11-26 19:18:37.665132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.092 [2024-11-26 19:18:37.665262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.092 [2024-11-26 19:18:37.665293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.092 qpair failed and we were unable to recover it. 00:32:21.092 [2024-11-26 19:18:37.665513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.092 [2024-11-26 19:18:37.665649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.092 [2024-11-26 19:18:37.665666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.092 qpair failed and we were unable to recover it. 00:32:21.092 [2024-11-26 19:18:37.665822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.092 [2024-11-26 19:18:37.665975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.092 [2024-11-26 19:18:37.665991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.092 qpair failed and we were unable to recover it. 00:32:21.092 [2024-11-26 19:18:37.666141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.092 [2024-11-26 19:18:37.666223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.092 [2024-11-26 19:18:37.666255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.092 qpair failed and we were unable to recover it. 00:32:21.092 [2024-11-26 19:18:37.666368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.092 [2024-11-26 19:18:37.666549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.092 [2024-11-26 19:18:37.666580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.092 qpair failed and we were unable to recover it. 00:32:21.092 [2024-11-26 19:18:37.666695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.092 [2024-11-26 19:18:37.666910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.092 [2024-11-26 19:18:37.666925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.092 qpair failed and we were unable to recover it. 00:32:21.092 [2024-11-26 19:18:37.667020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.092 [2024-11-26 19:18:37.667117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.092 [2024-11-26 19:18:37.667133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.092 qpair failed and we were unable to recover it. 00:32:21.092 [2024-11-26 19:18:37.667217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.092 [2024-11-26 19:18:37.667366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.092 [2024-11-26 19:18:37.667381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.092 qpair failed and we were unable to recover it. 00:32:21.092 [2024-11-26 19:18:37.667534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.092 [2024-11-26 19:18:37.667615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.093 [2024-11-26 19:18:37.667630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.093 qpair failed and we were unable to recover it. 00:32:21.093 [2024-11-26 19:18:37.667782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.093 [2024-11-26 19:18:37.667847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.093 [2024-11-26 19:18:37.667863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.093 qpair failed and we were unable to recover it. 00:32:21.093 [2024-11-26 19:18:37.667937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.093 [2024-11-26 19:18:37.668101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.093 [2024-11-26 19:18:37.668117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.093 qpair failed and we were unable to recover it. 00:32:21.093 [2024-11-26 19:18:37.668300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.093 [2024-11-26 19:18:37.668398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.093 [2024-11-26 19:18:37.668428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.093 qpair failed and we were unable to recover it. 00:32:21.093 [2024-11-26 19:18:37.668603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.093 [2024-11-26 19:18:37.668741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.093 [2024-11-26 19:18:37.668772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.093 qpair failed and we were unable to recover it. 00:32:21.093 [2024-11-26 19:18:37.668896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.093 [2024-11-26 19:18:37.669013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.093 [2024-11-26 19:18:37.669046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.093 qpair failed and we were unable to recover it. 00:32:21.093 [2024-11-26 19:18:37.669184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.093 [2024-11-26 19:18:37.669298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.093 [2024-11-26 19:18:37.669329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.093 qpair failed and we were unable to recover it. 00:32:21.093 [2024-11-26 19:18:37.669506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.093 [2024-11-26 19:18:37.669580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.093 [2024-11-26 19:18:37.669596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.093 qpair failed and we were unable to recover it. 00:32:21.093 [2024-11-26 19:18:37.669660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.093 [2024-11-26 19:18:37.669883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.093 [2024-11-26 19:18:37.669899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.093 qpair failed and we were unable to recover it. 00:32:21.093 [2024-11-26 19:18:37.670051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.093 [2024-11-26 19:18:37.670202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.093 [2024-11-26 19:18:37.670218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.093 qpair failed and we were unable to recover it. 00:32:21.093 [2024-11-26 19:18:37.670318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.093 [2024-11-26 19:18:37.670408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.093 [2024-11-26 19:18:37.670423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.093 qpair failed and we were unable to recover it. 00:32:21.093 [2024-11-26 19:18:37.670521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.093 [2024-11-26 19:18:37.670614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.093 [2024-11-26 19:18:37.670630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.093 qpair failed and we were unable to recover it. 00:32:21.093 [2024-11-26 19:18:37.670702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.093 [2024-11-26 19:18:37.670792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.093 [2024-11-26 19:18:37.670808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.093 qpair failed and we were unable to recover it. 00:32:21.093 [2024-11-26 19:18:37.670967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.093 [2024-11-26 19:18:37.671047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.093 [2024-11-26 19:18:37.671062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.093 qpair failed and we were unable to recover it. 00:32:21.093 [2024-11-26 19:18:37.671199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.093 [2024-11-26 19:18:37.671401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.093 [2024-11-26 19:18:37.671418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.093 qpair failed and we were unable to recover it. 00:32:21.093 [2024-11-26 19:18:37.671562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.093 [2024-11-26 19:18:37.671644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.093 [2024-11-26 19:18:37.671659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.093 qpair failed and we were unable to recover it. 00:32:21.093 [2024-11-26 19:18:37.671732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.093 [2024-11-26 19:18:37.671811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.093 [2024-11-26 19:18:37.671826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.093 qpair failed and we were unable to recover it. 00:32:21.093 [2024-11-26 19:18:37.671898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.093 [2024-11-26 19:18:37.671984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.093 [2024-11-26 19:18:37.672000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.093 qpair failed and we were unable to recover it. 00:32:21.093 [2024-11-26 19:18:37.672164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.093 [2024-11-26 19:18:37.672307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.093 [2024-11-26 19:18:37.672322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.093 qpair failed and we were unable to recover it. 00:32:21.093 [2024-11-26 19:18:37.672396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.093 [2024-11-26 19:18:37.672566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.093 [2024-11-26 19:18:37.672598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.093 qpair failed and we were unable to recover it. 00:32:21.093 [2024-11-26 19:18:37.672719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.093 [2024-11-26 19:18:37.672892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.093 [2024-11-26 19:18:37.672922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.093 qpair failed and we were unable to recover it. 00:32:21.093 [2024-11-26 19:18:37.673179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.093 [2024-11-26 19:18:37.673397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.093 [2024-11-26 19:18:37.673428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.093 qpair failed and we were unable to recover it. 00:32:21.093 [2024-11-26 19:18:37.673602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.093 [2024-11-26 19:18:37.673807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.093 [2024-11-26 19:18:37.673840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.093 qpair failed and we were unable to recover it. 00:32:21.093 [2024-11-26 19:18:37.674023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.093 [2024-11-26 19:18:37.674210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.093 [2024-11-26 19:18:37.674241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.093 qpair failed and we were unable to recover it. 00:32:21.093 [2024-11-26 19:18:37.674363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.093 [2024-11-26 19:18:37.674447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.093 [2024-11-26 19:18:37.674462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.093 qpair failed and we were unable to recover it. 00:32:21.094 [2024-11-26 19:18:37.674536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.094 [2024-11-26 19:18:37.674616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.094 [2024-11-26 19:18:37.674658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.094 qpair failed and we were unable to recover it. 00:32:21.094 [2024-11-26 19:18:37.674774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.094 [2024-11-26 19:18:37.674964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.094 [2024-11-26 19:18:37.674996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.094 qpair failed and we were unable to recover it. 00:32:21.094 [2024-11-26 19:18:37.675242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.094 [2024-11-26 19:18:37.675431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.094 [2024-11-26 19:18:37.675463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.094 qpair failed and we were unable to recover it. 00:32:21.094 [2024-11-26 19:18:37.675739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.094 [2024-11-26 19:18:37.675914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.094 [2024-11-26 19:18:37.675946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.094 qpair failed and we were unable to recover it. 00:32:21.094 [2024-11-26 19:18:37.676143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.094 [2024-11-26 19:18:37.676314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.094 [2024-11-26 19:18:37.676346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.094 qpair failed and we were unable to recover it. 00:32:21.094 [2024-11-26 19:18:37.676473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.094 [2024-11-26 19:18:37.676668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.094 [2024-11-26 19:18:37.676683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.094 qpair failed and we were unable to recover it. 00:32:21.094 [2024-11-26 19:18:37.676871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.094 [2024-11-26 19:18:37.677050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.094 [2024-11-26 19:18:37.677082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.094 qpair failed and we were unable to recover it. 00:32:21.094 [2024-11-26 19:18:37.677195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.094 [2024-11-26 19:18:37.677384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.094 [2024-11-26 19:18:37.677416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.094 qpair failed and we were unable to recover it. 00:32:21.094 [2024-11-26 19:18:37.677600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.094 [2024-11-26 19:18:37.677697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.094 [2024-11-26 19:18:37.677729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.094 qpair failed and we were unable to recover it. 00:32:21.094 [2024-11-26 19:18:37.677919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.094 [2024-11-26 19:18:37.678079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.094 [2024-11-26 19:18:37.678117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.094 qpair failed and we were unable to recover it. 00:32:21.094 [2024-11-26 19:18:37.678207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.094 [2024-11-26 19:18:37.678361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.094 [2024-11-26 19:18:37.678375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.094 qpair failed and we were unable to recover it. 00:32:21.094 [2024-11-26 19:18:37.678455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.094 [2024-11-26 19:18:37.678547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.094 [2024-11-26 19:18:37.678563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.094 qpair failed and we were unable to recover it. 00:32:21.094 [2024-11-26 19:18:37.678708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.094 [2024-11-26 19:18:37.678789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.094 [2024-11-26 19:18:37.678804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.094 qpair failed and we were unable to recover it. 00:32:21.094 [2024-11-26 19:18:37.678901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.094 [2024-11-26 19:18:37.679035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.094 [2024-11-26 19:18:37.679051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.094 qpair failed and we were unable to recover it. 00:32:21.094 [2024-11-26 19:18:37.679120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.094 [2024-11-26 19:18:37.679189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.094 [2024-11-26 19:18:37.679204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.094 qpair failed and we were unable to recover it. 00:32:21.094 [2024-11-26 19:18:37.679443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.094 [2024-11-26 19:18:37.679516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.094 [2024-11-26 19:18:37.679535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.094 qpair failed and we were unable to recover it. 00:32:21.094 [2024-11-26 19:18:37.679620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.094 [2024-11-26 19:18:37.679794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.094 [2024-11-26 19:18:37.679810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.094 qpair failed and we were unable to recover it. 00:32:21.094 [2024-11-26 19:18:37.680011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.094 [2024-11-26 19:18:37.680128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.094 [2024-11-26 19:18:37.680159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.094 qpair failed and we were unable to recover it. 00:32:21.094 [2024-11-26 19:18:37.680286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.094 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh: line 44: 3300994 Killed "${NVMF_APP[@]}" "$@" 00:32:21.094 [2024-11-26 19:18:37.680452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.094 [2024-11-26 19:18:37.680483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.094 qpair failed and we were unable to recover it. 00:32:21.094 [2024-11-26 19:18:37.680669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.094 [2024-11-26 19:18:37.680776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.094 [2024-11-26 19:18:37.680791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.094 qpair failed and we were unable to recover it. 00:32:21.094 [2024-11-26 19:18:37.680876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.094 [2024-11-26 19:18:37.681061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.094 [2024-11-26 19:18:37.681078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.094 qpair failed and we were unable to recover it. 00:32:21.094 19:18:37 -- host/target_disconnect.sh@56 -- # disconnect_init 10.0.0.2 00:32:21.094 [2024-11-26 19:18:37.681151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.094 [2024-11-26 19:18:37.681235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.094 [2024-11-26 19:18:37.681251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.094 qpair failed and we were unable to recover it. 00:32:21.094 [2024-11-26 19:18:37.681348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.095 19:18:37 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:32:21.095 [2024-11-26 19:18:37.681495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.095 [2024-11-26 19:18:37.681514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.095 qpair failed and we were unable to recover it. 00:32:21.095 [2024-11-26 19:18:37.681585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.095 [2024-11-26 19:18:37.681678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.095 [2024-11-26 19:18:37.681694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.095 qpair failed and we were unable to recover it. 00:32:21.095 19:18:37 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:32:21.095 [2024-11-26 19:18:37.681841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.095 [2024-11-26 19:18:37.681927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.095 [2024-11-26 19:18:37.681942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.095 qpair failed and we were unable to recover it. 00:32:21.095 19:18:37 -- common/autotest_common.sh@722 -- # xtrace_disable 00:32:21.095 [2024-11-26 19:18:37.682116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.095 [2024-11-26 19:18:37.682293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.095 [2024-11-26 19:18:37.682308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.095 qpair failed and we were unable to recover it. 00:32:21.095 19:18:37 -- common/autotest_common.sh@10 -- # set +x 00:32:21.095 [2024-11-26 19:18:37.682451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.095 [2024-11-26 19:18:37.682532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.095 [2024-11-26 19:18:37.682547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.095 qpair failed and we were unable to recover it. 00:32:21.095 [2024-11-26 19:18:37.682704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.095 [2024-11-26 19:18:37.682773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.095 [2024-11-26 19:18:37.682788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.095 qpair failed and we were unable to recover it. 00:32:21.095 [2024-11-26 19:18:37.682864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.095 [2024-11-26 19:18:37.682955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.095 [2024-11-26 19:18:37.682972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.095 qpair failed and we were unable to recover it. 00:32:21.095 [2024-11-26 19:18:37.683069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.095 [2024-11-26 19:18:37.683163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.095 [2024-11-26 19:18:37.683178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.095 qpair failed and we were unable to recover it. 00:32:21.095 [2024-11-26 19:18:37.683332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.095 [2024-11-26 19:18:37.683538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.095 [2024-11-26 19:18:37.683554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.095 qpair failed and we were unable to recover it. 00:32:21.095 [2024-11-26 19:18:37.683696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.095 [2024-11-26 19:18:37.683776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.095 [2024-11-26 19:18:37.683791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.095 qpair failed and we were unable to recover it. 00:32:21.095 [2024-11-26 19:18:37.683997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.095 [2024-11-26 19:18:37.684092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.095 [2024-11-26 19:18:37.684107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.095 qpair failed and we were unable to recover it. 00:32:21.095 [2024-11-26 19:18:37.684202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.095 [2024-11-26 19:18:37.684403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.095 [2024-11-26 19:18:37.684418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.095 qpair failed and we were unable to recover it. 00:32:21.095 [2024-11-26 19:18:37.684562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.095 [2024-11-26 19:18:37.684656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.095 [2024-11-26 19:18:37.684671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.095 qpair failed and we were unable to recover it. 00:32:21.095 [2024-11-26 19:18:37.684754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.095 [2024-11-26 19:18:37.684841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.095 [2024-11-26 19:18:37.684857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.095 qpair failed and we were unable to recover it. 00:32:21.095 [2024-11-26 19:18:37.684923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.095 [2024-11-26 19:18:37.685025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.095 [2024-11-26 19:18:37.685042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.095 qpair failed and we were unable to recover it. 00:32:21.095 [2024-11-26 19:18:37.685112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.095 [2024-11-26 19:18:37.685204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.095 [2024-11-26 19:18:37.685220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.095 qpair failed and we were unable to recover it. 00:32:21.095 [2024-11-26 19:18:37.685359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.095 [2024-11-26 19:18:37.685496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.095 [2024-11-26 19:18:37.685512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.095 qpair failed and we were unable to recover it. 00:32:21.095 [2024-11-26 19:18:37.685604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.095 [2024-11-26 19:18:37.685675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.095 [2024-11-26 19:18:37.685690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.095 qpair failed and we were unable to recover it. 00:32:21.095 [2024-11-26 19:18:37.685780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.095 [2024-11-26 19:18:37.685862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.095 [2024-11-26 19:18:37.685878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.095 qpair failed and we were unable to recover it. 00:32:21.095 [2024-11-26 19:18:37.685973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.095 [2024-11-26 19:18:37.686047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.095 [2024-11-26 19:18:37.686060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.095 qpair failed and we were unable to recover it. 00:32:21.095 [2024-11-26 19:18:37.686139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.096 [2024-11-26 19:18:37.686292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.096 [2024-11-26 19:18:37.686307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.096 qpair failed and we were unable to recover it. 00:32:21.096 [2024-11-26 19:18:37.686463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.096 [2024-11-26 19:18:37.686554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.096 [2024-11-26 19:18:37.686569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.096 qpair failed and we were unable to recover it. 00:32:21.096 [2024-11-26 19:18:37.686644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.096 [2024-11-26 19:18:37.686783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.096 [2024-11-26 19:18:37.686797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.096 qpair failed and we were unable to recover it. 00:32:21.096 [2024-11-26 19:18:37.686880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.096 [2024-11-26 19:18:37.687014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.096 [2024-11-26 19:18:37.687029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.096 qpair failed and we were unable to recover it. 00:32:21.096 [2024-11-26 19:18:37.687122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.096 [2024-11-26 19:18:37.687264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.096 [2024-11-26 19:18:37.687279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.096 qpair failed and we were unable to recover it. 00:32:21.096 [2024-11-26 19:18:37.687366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.096 [2024-11-26 19:18:37.687508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.096 [2024-11-26 19:18:37.687523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.096 qpair failed and we were unable to recover it. 00:32:21.096 [2024-11-26 19:18:37.687603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.096 [2024-11-26 19:18:37.687686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.096 [2024-11-26 19:18:37.687701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.096 qpair failed and we were unable to recover it. 00:32:21.096 [2024-11-26 19:18:37.687799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.096 [2024-11-26 19:18:37.687874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.096 [2024-11-26 19:18:37.687889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.096 qpair failed and we were unable to recover it. 00:32:21.096 [2024-11-26 19:18:37.688038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.096 [2024-11-26 19:18:37.688126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.096 [2024-11-26 19:18:37.688141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.096 qpair failed and we were unable to recover it. 00:32:21.096 [2024-11-26 19:18:37.688288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.096 [2024-11-26 19:18:37.688368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.096 [2024-11-26 19:18:37.688385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.096 qpair failed and we were unable to recover it. 00:32:21.096 [2024-11-26 19:18:37.688465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.096 19:18:37 -- nvmf/common.sh@469 -- # nvmfpid=3301733 00:32:21.096 [2024-11-26 19:18:37.688533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.096 [2024-11-26 19:18:37.688549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.096 qpair failed and we were unable to recover it. 00:32:21.096 [2024-11-26 19:18:37.688629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.096 [2024-11-26 19:18:37.688761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.096 [2024-11-26 19:18:37.688777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.096 qpair failed and we were unable to recover it. 00:32:21.096 19:18:37 -- nvmf/common.sh@470 -- # waitforlisten 3301733 00:32:21.096 19:18:37 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:32:21.096 [2024-11-26 19:18:37.688925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.096 [2024-11-26 19:18:37.689073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.096 [2024-11-26 19:18:37.689091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.096 qpair failed and we were unable to recover it. 00:32:21.096 [2024-11-26 19:18:37.689161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.096 19:18:37 -- common/autotest_common.sh@829 -- # '[' -z 3301733 ']' 00:32:21.096 [2024-11-26 19:18:37.689234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.096 [2024-11-26 19:18:37.689252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.096 qpair failed and we were unable to recover it. 00:32:21.096 [2024-11-26 19:18:37.689347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.096 [2024-11-26 19:18:37.689415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.096 [2024-11-26 19:18:37.689430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.096 qpair failed and we were unable to recover it. 00:32:21.096 19:18:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:32:21.096 [2024-11-26 19:18:37.689634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.096 [2024-11-26 19:18:37.689709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.096 [2024-11-26 19:18:37.689723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.096 qpair failed and we were unable to recover it. 00:32:21.096 [2024-11-26 19:18:37.689796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.096 19:18:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:32:21.096 [2024-11-26 19:18:37.689933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.096 [2024-11-26 19:18:37.689951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.096 qpair failed and we were unable to recover it. 00:32:21.096 [2024-11-26 19:18:37.690038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.096 19:18:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:32:21.096 [2024-11-26 19:18:37.690115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.096 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:32:21.096 [2024-11-26 19:18:37.690131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.096 qpair failed and we were unable to recover it. 00:32:21.096 [2024-11-26 19:18:37.690204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.096 [2024-11-26 19:18:37.690359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.096 [2024-11-26 19:18:37.690375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.096 19:18:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:32:21.096 qpair failed and we were unable to recover it. 00:32:21.096 [2024-11-26 19:18:37.690523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.096 [2024-11-26 19:18:37.690604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.096 [2024-11-26 19:18:37.690619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.096 qpair failed and we were unable to recover it. 00:32:21.096 19:18:37 -- common/autotest_common.sh@10 -- # set +x 00:32:21.096 [2024-11-26 19:18:37.690709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.096 [2024-11-26 19:18:37.690845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.096 [2024-11-26 19:18:37.690860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.096 qpair failed and we were unable to recover it. 00:32:21.096 [2024-11-26 19:18:37.690952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.096 [2024-11-26 19:18:37.691029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.097 [2024-11-26 19:18:37.691044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.097 qpair failed and we were unable to recover it. 00:32:21.097 [2024-11-26 19:18:37.691114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.097 [2024-11-26 19:18:37.691253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.097 [2024-11-26 19:18:37.691268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.097 qpair failed and we were unable to recover it. 00:32:21.097 [2024-11-26 19:18:37.691352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.097 [2024-11-26 19:18:37.691422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.097 [2024-11-26 19:18:37.691436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.097 qpair failed and we were unable to recover it. 00:32:21.097 [2024-11-26 19:18:37.691599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.097 [2024-11-26 19:18:37.691676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.097 [2024-11-26 19:18:37.691690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.097 qpair failed and we were unable to recover it. 00:32:21.097 [2024-11-26 19:18:37.691838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.097 [2024-11-26 19:18:37.691921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.097 [2024-11-26 19:18:37.691937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.097 qpair failed and we were unable to recover it. 00:32:21.097 [2024-11-26 19:18:37.692096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.097 [2024-11-26 19:18:37.692255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.097 [2024-11-26 19:18:37.692270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.097 qpair failed and we were unable to recover it. 00:32:21.097 [2024-11-26 19:18:37.692340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.097 [2024-11-26 19:18:37.692430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.097 [2024-11-26 19:18:37.692446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.097 qpair failed and we were unable to recover it. 00:32:21.097 [2024-11-26 19:18:37.692518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.097 [2024-11-26 19:18:37.692587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.097 [2024-11-26 19:18:37.692602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.097 qpair failed and we were unable to recover it. 00:32:21.097 [2024-11-26 19:18:37.692679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.097 [2024-11-26 19:18:37.692751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.097 [2024-11-26 19:18:37.692765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.097 qpair failed and we were unable to recover it. 00:32:21.097 [2024-11-26 19:18:37.692870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.097 [2024-11-26 19:18:37.692953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.097 [2024-11-26 19:18:37.692968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.097 qpair failed and we were unable to recover it. 00:32:21.097 [2024-11-26 19:18:37.693043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.097 [2024-11-26 19:18:37.693142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.097 [2024-11-26 19:18:37.693162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.097 qpair failed and we were unable to recover it. 00:32:21.097 [2024-11-26 19:18:37.693256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.097 [2024-11-26 19:18:37.693391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.097 [2024-11-26 19:18:37.693408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.097 qpair failed and we were unable to recover it. 00:32:21.097 [2024-11-26 19:18:37.693497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.097 [2024-11-26 19:18:37.693566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.097 [2024-11-26 19:18:37.693581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.097 qpair failed and we were unable to recover it. 00:32:21.097 [2024-11-26 19:18:37.693836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.097 [2024-11-26 19:18:37.693933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.097 [2024-11-26 19:18:37.693968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.097 qpair failed and we were unable to recover it. 00:32:21.097 [2024-11-26 19:18:37.694042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.097 [2024-11-26 19:18:37.694189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.097 [2024-11-26 19:18:37.694205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.097 qpair failed and we were unable to recover it. 00:32:21.097 [2024-11-26 19:18:37.694275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.097 [2024-11-26 19:18:37.694361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.097 [2024-11-26 19:18:37.694376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.097 qpair failed and we were unable to recover it. 00:32:21.097 [2024-11-26 19:18:37.694442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.097 [2024-11-26 19:18:37.694585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.097 [2024-11-26 19:18:37.694600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.097 qpair failed and we were unable to recover it. 00:32:21.097 [2024-11-26 19:18:37.694676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.097 [2024-11-26 19:18:37.694744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.097 [2024-11-26 19:18:37.694759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.097 qpair failed and we were unable to recover it. 00:32:21.097 [2024-11-26 19:18:37.694847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.097 [2024-11-26 19:18:37.694924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.097 [2024-11-26 19:18:37.694940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.097 qpair failed and we were unable to recover it. 00:32:21.097 [2024-11-26 19:18:37.695042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.097 [2024-11-26 19:18:37.695114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.097 [2024-11-26 19:18:37.695130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.097 qpair failed and we were unable to recover it. 00:32:21.097 [2024-11-26 19:18:37.695211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.097 [2024-11-26 19:18:37.695350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.097 [2024-11-26 19:18:37.695368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.097 qpair failed and we were unable to recover it. 00:32:21.097 [2024-11-26 19:18:37.695530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.097 [2024-11-26 19:18:37.695702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.097 [2024-11-26 19:18:37.695718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.098 qpair failed and we were unable to recover it. 00:32:21.098 [2024-11-26 19:18:37.695805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.098 [2024-11-26 19:18:37.696009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.098 [2024-11-26 19:18:37.696025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.098 qpair failed and we were unable to recover it. 00:32:21.098 [2024-11-26 19:18:37.696112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.098 [2024-11-26 19:18:37.696338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.098 [2024-11-26 19:18:37.696353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.098 qpair failed and we were unable to recover it. 00:32:21.098 [2024-11-26 19:18:37.696494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.098 [2024-11-26 19:18:37.696637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.098 [2024-11-26 19:18:37.696652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.098 qpair failed and we were unable to recover it. 00:32:21.098 [2024-11-26 19:18:37.696803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.098 [2024-11-26 19:18:37.696902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.098 [2024-11-26 19:18:37.696917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.098 qpair failed and we were unable to recover it. 00:32:21.098 [2024-11-26 19:18:37.697053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.098 [2024-11-26 19:18:37.697197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.098 [2024-11-26 19:18:37.697212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.098 qpair failed and we were unable to recover it. 00:32:21.098 [2024-11-26 19:18:37.697285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.098 [2024-11-26 19:18:37.697424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.098 [2024-11-26 19:18:37.697440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.098 qpair failed and we were unable to recover it. 00:32:21.098 [2024-11-26 19:18:37.697532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.098 [2024-11-26 19:18:37.697610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.098 [2024-11-26 19:18:37.697626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.098 qpair failed and we were unable to recover it. 00:32:21.098 [2024-11-26 19:18:37.697704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.098 [2024-11-26 19:18:37.697786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.098 [2024-11-26 19:18:37.697802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.098 qpair failed and we were unable to recover it. 00:32:21.098 [2024-11-26 19:18:37.697871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.098 [2024-11-26 19:18:37.697958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.098 [2024-11-26 19:18:37.697974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.098 qpair failed and we were unable to recover it. 00:32:21.098 [2024-11-26 19:18:37.698049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.098 [2024-11-26 19:18:37.698140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.098 [2024-11-26 19:18:37.698155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.098 qpair failed and we were unable to recover it. 00:32:21.098 [2024-11-26 19:18:37.698228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.098 [2024-11-26 19:18:37.698307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.098 [2024-11-26 19:18:37.698323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.098 qpair failed and we were unable to recover it. 00:32:21.098 [2024-11-26 19:18:37.698473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.098 [2024-11-26 19:18:37.698612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.098 [2024-11-26 19:18:37.698627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.098 qpair failed and we were unable to recover it. 00:32:21.098 [2024-11-26 19:18:37.698704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.098 [2024-11-26 19:18:37.698855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.098 [2024-11-26 19:18:37.698870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.098 qpair failed and we were unable to recover it. 00:32:21.098 [2024-11-26 19:18:37.698964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.098 [2024-11-26 19:18:37.699054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.098 [2024-11-26 19:18:37.699070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.098 qpair failed and we were unable to recover it. 00:32:21.098 [2024-11-26 19:18:37.699152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.098 [2024-11-26 19:18:37.699236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.098 [2024-11-26 19:18:37.699251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.098 qpair failed and we were unable to recover it. 00:32:21.098 [2024-11-26 19:18:37.699325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.098 [2024-11-26 19:18:37.699410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.098 [2024-11-26 19:18:37.699425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.098 qpair failed and we were unable to recover it. 00:32:21.098 [2024-11-26 19:18:37.699564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.098 [2024-11-26 19:18:37.699635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.098 [2024-11-26 19:18:37.699650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.098 qpair failed and we were unable to recover it. 00:32:21.098 [2024-11-26 19:18:37.699733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.098 [2024-11-26 19:18:37.699835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.098 [2024-11-26 19:18:37.699852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.098 qpair failed and we were unable to recover it. 00:32:21.098 [2024-11-26 19:18:37.700001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.098 [2024-11-26 19:18:37.700073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.098 [2024-11-26 19:18:37.700088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.098 qpair failed and we were unable to recover it. 00:32:21.098 [2024-11-26 19:18:37.700161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.098 [2024-11-26 19:18:37.700321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.098 [2024-11-26 19:18:37.700337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.098 qpair failed and we were unable to recover it. 00:32:21.098 [2024-11-26 19:18:37.700427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.098 [2024-11-26 19:18:37.700565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.098 [2024-11-26 19:18:37.700581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.098 qpair failed and we were unable to recover it. 00:32:21.098 [2024-11-26 19:18:37.700653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.098 [2024-11-26 19:18:37.700723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.099 [2024-11-26 19:18:37.700739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.099 qpair failed and we were unable to recover it. 00:32:21.099 [2024-11-26 19:18:37.700878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.099 [2024-11-26 19:18:37.701032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.099 [2024-11-26 19:18:37.701048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.099 qpair failed and we were unable to recover it. 00:32:21.099 [2024-11-26 19:18:37.701183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.099 [2024-11-26 19:18:37.701274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.099 [2024-11-26 19:18:37.701290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.099 qpair failed and we were unable to recover it. 00:32:21.099 [2024-11-26 19:18:37.701433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.099 [2024-11-26 19:18:37.701514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.099 [2024-11-26 19:18:37.701529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.099 qpair failed and we were unable to recover it. 00:32:21.099 [2024-11-26 19:18:37.701610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.099 [2024-11-26 19:18:37.701693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.099 [2024-11-26 19:18:37.701708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.099 qpair failed and we were unable to recover it. 00:32:21.099 [2024-11-26 19:18:37.701783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.099 [2024-11-26 19:18:37.701857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.099 [2024-11-26 19:18:37.701872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.099 qpair failed and we were unable to recover it. 00:32:21.099 [2024-11-26 19:18:37.702026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.099 [2024-11-26 19:18:37.702167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.099 [2024-11-26 19:18:37.702182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.099 qpair failed and we were unable to recover it. 00:32:21.099 [2024-11-26 19:18:37.702337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.099 [2024-11-26 19:18:37.702433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.099 [2024-11-26 19:18:37.702448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.099 qpair failed and we were unable to recover it. 00:32:21.099 [2024-11-26 19:18:37.702526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.099 [2024-11-26 19:18:37.702610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.099 [2024-11-26 19:18:37.702625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.099 qpair failed and we were unable to recover it. 00:32:21.099 [2024-11-26 19:18:37.702688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.099 [2024-11-26 19:18:37.702769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.099 [2024-11-26 19:18:37.702784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.099 qpair failed and we were unable to recover it. 00:32:21.099 [2024-11-26 19:18:37.702921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.099 [2024-11-26 19:18:37.702992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.099 [2024-11-26 19:18:37.703009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.099 qpair failed and we were unable to recover it. 00:32:21.099 [2024-11-26 19:18:37.703146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.099 [2024-11-26 19:18:37.703355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.099 [2024-11-26 19:18:37.703370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.099 qpair failed and we were unable to recover it. 00:32:21.099 [2024-11-26 19:18:37.703473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.099 [2024-11-26 19:18:37.703613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.099 [2024-11-26 19:18:37.703628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.099 qpair failed and we were unable to recover it. 00:32:21.099 [2024-11-26 19:18:37.703800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.099 [2024-11-26 19:18:37.703870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.099 [2024-11-26 19:18:37.703885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.099 qpair failed and we were unable to recover it. 00:32:21.099 [2024-11-26 19:18:37.703970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.099 [2024-11-26 19:18:37.704055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.099 [2024-11-26 19:18:37.704070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.099 qpair failed and we were unable to recover it. 00:32:21.099 [2024-11-26 19:18:37.704143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.099 [2024-11-26 19:18:37.704282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.099 [2024-11-26 19:18:37.704297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.099 qpair failed and we were unable to recover it. 00:32:21.099 [2024-11-26 19:18:37.704450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.099 [2024-11-26 19:18:37.704537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.099 [2024-11-26 19:18:37.704553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.099 qpair failed and we were unable to recover it. 00:32:21.099 [2024-11-26 19:18:37.704628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.099 [2024-11-26 19:18:37.704694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.099 [2024-11-26 19:18:37.704709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.099 qpair failed and we were unable to recover it. 00:32:21.099 [2024-11-26 19:18:37.704865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.099 [2024-11-26 19:18:37.704953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.099 [2024-11-26 19:18:37.704970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.099 qpair failed and we were unable to recover it. 00:32:21.099 [2024-11-26 19:18:37.705056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.099 [2024-11-26 19:18:37.705147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.099 [2024-11-26 19:18:37.705163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.099 qpair failed and we were unable to recover it. 00:32:21.099 [2024-11-26 19:18:37.705315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.099 [2024-11-26 19:18:37.705449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.099 [2024-11-26 19:18:37.705465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.099 qpair failed and we were unable to recover it. 00:32:21.099 [2024-11-26 19:18:37.705538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.099 [2024-11-26 19:18:37.705614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.099 [2024-11-26 19:18:37.705630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.099 qpair failed and we were unable to recover it. 00:32:21.099 [2024-11-26 19:18:37.705868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.099 [2024-11-26 19:18:37.706015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.099 [2024-11-26 19:18:37.706031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.099 qpair failed and we were unable to recover it. 00:32:21.099 [2024-11-26 19:18:37.706117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.099 [2024-11-26 19:18:37.706187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.099 [2024-11-26 19:18:37.706203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.099 qpair failed and we were unable to recover it. 00:32:21.099 [2024-11-26 19:18:37.706358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.099 [2024-11-26 19:18:37.706442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.099 [2024-11-26 19:18:37.706458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.099 qpair failed and we were unable to recover it. 00:32:21.100 [2024-11-26 19:18:37.706528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.100 [2024-11-26 19:18:37.706662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.100 [2024-11-26 19:18:37.706678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.100 qpair failed and we were unable to recover it. 00:32:21.100 [2024-11-26 19:18:37.706877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.100 [2024-11-26 19:18:37.706958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.100 [2024-11-26 19:18:37.706973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.100 qpair failed and we were unable to recover it. 00:32:21.100 [2024-11-26 19:18:37.707053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.100 [2024-11-26 19:18:37.707123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.100 [2024-11-26 19:18:37.707139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.100 qpair failed and we were unable to recover it. 00:32:21.100 [2024-11-26 19:18:37.707281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.100 [2024-11-26 19:18:37.707438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.100 [2024-11-26 19:18:37.707456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.100 qpair failed and we were unable to recover it. 00:32:21.100 [2024-11-26 19:18:37.707619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.100 [2024-11-26 19:18:37.707694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.100 [2024-11-26 19:18:37.707710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.100 qpair failed and we were unable to recover it. 00:32:21.100 [2024-11-26 19:18:37.707848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.100 [2024-11-26 19:18:37.707926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.100 [2024-11-26 19:18:37.707941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.100 qpair failed and we were unable to recover it. 00:32:21.100 [2024-11-26 19:18:37.708087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.100 [2024-11-26 19:18:37.708160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.100 [2024-11-26 19:18:37.708175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.100 qpair failed and we were unable to recover it. 00:32:21.100 [2024-11-26 19:18:37.708258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.100 [2024-11-26 19:18:37.708406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.100 [2024-11-26 19:18:37.708422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.100 qpair failed and we were unable to recover it. 00:32:21.100 [2024-11-26 19:18:37.708522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.100 [2024-11-26 19:18:37.708600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.100 [2024-11-26 19:18:37.708616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.100 qpair failed and we were unable to recover it. 00:32:21.100 [2024-11-26 19:18:37.708696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.100 [2024-11-26 19:18:37.708842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.100 [2024-11-26 19:18:37.708857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.100 qpair failed and we were unable to recover it. 00:32:21.100 [2024-11-26 19:18:37.708927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.100 [2024-11-26 19:18:37.709161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.100 [2024-11-26 19:18:37.709177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.100 qpair failed and we were unable to recover it. 00:32:21.100 [2024-11-26 19:18:37.709248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.100 [2024-11-26 19:18:37.709403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.100 [2024-11-26 19:18:37.709418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.100 qpair failed and we were unable to recover it. 00:32:21.100 [2024-11-26 19:18:37.709488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.100 [2024-11-26 19:18:37.709582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.100 [2024-11-26 19:18:37.709597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.100 qpair failed and we were unable to recover it. 00:32:21.100 [2024-11-26 19:18:37.709670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.100 [2024-11-26 19:18:37.709749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.100 [2024-11-26 19:18:37.709765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.100 qpair failed and we were unable to recover it. 00:32:21.100 [2024-11-26 19:18:37.709844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.100 [2024-11-26 19:18:37.709986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.100 [2024-11-26 19:18:37.710003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.100 qpair failed and we were unable to recover it. 00:32:21.100 [2024-11-26 19:18:37.710150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.100 [2024-11-26 19:18:37.710239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.100 [2024-11-26 19:18:37.710254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.100 qpair failed and we were unable to recover it. 00:32:21.100 [2024-11-26 19:18:37.710360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.100 [2024-11-26 19:18:37.710494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.100 [2024-11-26 19:18:37.710510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.100 qpair failed and we were unable to recover it. 00:32:21.100 [2024-11-26 19:18:37.710580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.100 [2024-11-26 19:18:37.710649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.100 [2024-11-26 19:18:37.710664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.100 qpair failed and we were unable to recover it. 00:32:21.100 [2024-11-26 19:18:37.710803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.100 [2024-11-26 19:18:37.710879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.100 [2024-11-26 19:18:37.710894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.100 qpair failed and we were unable to recover it. 00:32:21.100 [2024-11-26 19:18:37.710981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.100 [2024-11-26 19:18:37.711079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.100 [2024-11-26 19:18:37.711095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.100 qpair failed and we were unable to recover it. 00:32:21.100 [2024-11-26 19:18:37.711164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.100 [2024-11-26 19:18:37.711249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.100 [2024-11-26 19:18:37.711265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.100 qpair failed and we were unable to recover it. 00:32:21.100 [2024-11-26 19:18:37.711335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.100 [2024-11-26 19:18:37.711546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.100 [2024-11-26 19:18:37.711560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.100 qpair failed and we were unable to recover it. 00:32:21.100 [2024-11-26 19:18:37.711652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.100 [2024-11-26 19:18:37.711743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.101 [2024-11-26 19:18:37.711759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.101 qpair failed and we were unable to recover it. 00:32:21.101 [2024-11-26 19:18:37.711840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.101 [2024-11-26 19:18:37.711913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.101 [2024-11-26 19:18:37.711929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.101 qpair failed and we were unable to recover it. 00:32:21.101 [2024-11-26 19:18:37.712016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.101 [2024-11-26 19:18:37.712109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.101 [2024-11-26 19:18:37.712125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.101 qpair failed and we were unable to recover it. 00:32:21.101 [2024-11-26 19:18:37.712197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.101 [2024-11-26 19:18:37.712283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.101 [2024-11-26 19:18:37.712297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.101 qpair failed and we were unable to recover it. 00:32:21.101 [2024-11-26 19:18:37.712374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.101 [2024-11-26 19:18:37.712461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.101 [2024-11-26 19:18:37.712476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.101 qpair failed and we were unable to recover it. 00:32:21.101 [2024-11-26 19:18:37.712549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.101 [2024-11-26 19:18:37.712636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.101 [2024-11-26 19:18:37.712651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.101 qpair failed and we were unable to recover it. 00:32:21.101 [2024-11-26 19:18:37.712724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.101 [2024-11-26 19:18:37.712803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.101 [2024-11-26 19:18:37.712818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.101 qpair failed and we were unable to recover it. 00:32:21.101 [2024-11-26 19:18:37.712888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.101 [2024-11-26 19:18:37.712971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.101 [2024-11-26 19:18:37.712987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.101 qpair failed and we were unable to recover it. 00:32:21.101 [2024-11-26 19:18:37.713144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.101 [2024-11-26 19:18:37.713227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.101 [2024-11-26 19:18:37.713242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.101 qpair failed and we were unable to recover it. 00:32:21.101 [2024-11-26 19:18:37.713381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.101 [2024-11-26 19:18:37.713456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.101 [2024-11-26 19:18:37.713471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.101 qpair failed and we were unable to recover it. 00:32:21.101 [2024-11-26 19:18:37.713620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.101 [2024-11-26 19:18:37.713689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.101 [2024-11-26 19:18:37.713704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.101 qpair failed and we were unable to recover it. 00:32:21.101 [2024-11-26 19:18:37.713841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.101 [2024-11-26 19:18:37.713922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.101 [2024-11-26 19:18:37.713937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.101 qpair failed and we were unable to recover it. 00:32:21.101 [2024-11-26 19:18:37.714153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.101 [2024-11-26 19:18:37.714243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.101 [2024-11-26 19:18:37.714257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.101 qpair failed and we were unable to recover it. 00:32:21.101 [2024-11-26 19:18:37.714358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.101 [2024-11-26 19:18:37.714455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.101 [2024-11-26 19:18:37.714467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.101 qpair failed and we were unable to recover it. 00:32:21.101 [2024-11-26 19:18:37.714608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.101 [2024-11-26 19:18:37.714670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.101 [2024-11-26 19:18:37.714681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.101 qpair failed and we were unable to recover it. 00:32:21.101 [2024-11-26 19:18:37.714807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.101 [2024-11-26 19:18:37.714883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.101 [2024-11-26 19:18:37.714894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.101 qpair failed and we were unable to recover it. 00:32:21.101 [2024-11-26 19:18:37.714976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.101 [2024-11-26 19:18:37.715109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.101 [2024-11-26 19:18:37.715121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.101 qpair failed and we were unable to recover it. 00:32:21.101 [2024-11-26 19:18:37.715319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.101 [2024-11-26 19:18:37.715407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.101 [2024-11-26 19:18:37.715418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.101 qpair failed and we were unable to recover it. 00:32:21.101 [2024-11-26 19:18:37.715483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.101 [2024-11-26 19:18:37.715544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.101 [2024-11-26 19:18:37.715556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.101 qpair failed and we were unable to recover it. 00:32:21.101 [2024-11-26 19:18:37.715699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.101 [2024-11-26 19:18:37.715763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.102 [2024-11-26 19:18:37.715774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.102 qpair failed and we were unable to recover it. 00:32:21.102 [2024-11-26 19:18:37.715844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.102 [2024-11-26 19:18:37.715917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.102 [2024-11-26 19:18:37.715928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.102 qpair failed and we were unable to recover it. 00:32:21.102 [2024-11-26 19:18:37.716002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.102 [2024-11-26 19:18:37.716198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.102 [2024-11-26 19:18:37.716210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.102 qpair failed and we were unable to recover it. 00:32:21.102 [2024-11-26 19:18:37.716297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.102 [2024-11-26 19:18:37.716365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.102 [2024-11-26 19:18:37.716376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.102 qpair failed and we were unable to recover it. 00:32:21.102 [2024-11-26 19:18:37.716505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.102 [2024-11-26 19:18:37.716729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.102 [2024-11-26 19:18:37.716741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.102 qpair failed and we were unable to recover it. 00:32:21.102 [2024-11-26 19:18:37.716806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.102 [2024-11-26 19:18:37.716952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.102 [2024-11-26 19:18:37.716964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.102 qpair failed and we were unable to recover it. 00:32:21.102 [2024-11-26 19:18:37.717024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.102 [2024-11-26 19:18:37.717101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.102 [2024-11-26 19:18:37.717112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.102 qpair failed and we were unable to recover it. 00:32:21.102 [2024-11-26 19:18:37.717191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.102 [2024-11-26 19:18:37.717320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.102 [2024-11-26 19:18:37.717332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.102 qpair failed and we were unable to recover it. 00:32:21.102 [2024-11-26 19:18:37.717397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.102 [2024-11-26 19:18:37.717454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.102 [2024-11-26 19:18:37.717466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.102 qpair failed and we were unable to recover it. 00:32:21.102 [2024-11-26 19:18:37.717596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.102 [2024-11-26 19:18:37.717664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.102 [2024-11-26 19:18:37.717675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.102 qpair failed and we were unable to recover it. 00:32:21.102 [2024-11-26 19:18:37.717751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.102 [2024-11-26 19:18:37.717908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.102 [2024-11-26 19:18:37.717919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.102 qpair failed and we were unable to recover it. 00:32:21.102 [2024-11-26 19:18:37.717999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.102 [2024-11-26 19:18:37.718079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.102 [2024-11-26 19:18:37.718091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.102 qpair failed and we were unable to recover it. 00:32:21.102 [2024-11-26 19:18:37.718223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.102 [2024-11-26 19:18:37.718369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.102 [2024-11-26 19:18:37.718380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.102 qpair failed and we were unable to recover it. 00:32:21.102 [2024-11-26 19:18:37.718444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.102 [2024-11-26 19:18:37.718592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.102 [2024-11-26 19:18:37.718603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.102 qpair failed and we were unable to recover it. 00:32:21.102 [2024-11-26 19:18:37.718685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.102 [2024-11-26 19:18:37.718754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.102 [2024-11-26 19:18:37.718765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.102 qpair failed and we were unable to recover it. 00:32:21.102 [2024-11-26 19:18:37.718914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.102 [2024-11-26 19:18:37.719043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.102 [2024-11-26 19:18:37.719055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.102 qpair failed and we were unable to recover it. 00:32:21.102 [2024-11-26 19:18:37.719140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.102 [2024-11-26 19:18:37.719216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.102 [2024-11-26 19:18:37.719228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.102 qpair failed and we were unable to recover it. 00:32:21.102 [2024-11-26 19:18:37.719306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.102 [2024-11-26 19:18:37.719444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.102 [2024-11-26 19:18:37.719456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.102 qpair failed and we were unable to recover it. 00:32:21.102 [2024-11-26 19:18:37.719522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.102 [2024-11-26 19:18:37.719650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.102 [2024-11-26 19:18:37.719661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.102 qpair failed and we were unable to recover it. 00:32:21.102 [2024-11-26 19:18:37.719818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.102 [2024-11-26 19:18:37.719965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.102 [2024-11-26 19:18:37.719977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.102 qpair failed and we were unable to recover it. 00:32:21.102 [2024-11-26 19:18:37.720050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.102 [2024-11-26 19:18:37.720123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.102 [2024-11-26 19:18:37.720135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.102 qpair failed and we were unable to recover it. 00:32:21.102 [2024-11-26 19:18:37.720282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.102 [2024-11-26 19:18:37.720444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.102 [2024-11-26 19:18:37.720455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.102 qpair failed and we were unable to recover it. 00:32:21.102 [2024-11-26 19:18:37.720586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.102 [2024-11-26 19:18:37.720738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.102 [2024-11-26 19:18:37.720749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.102 qpair failed and we were unable to recover it. 00:32:21.102 [2024-11-26 19:18:37.720832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.102 [2024-11-26 19:18:37.720983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.102 [2024-11-26 19:18:37.720995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.102 qpair failed and we were unable to recover it. 00:32:21.102 [2024-11-26 19:18:37.721059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.102 [2024-11-26 19:18:37.721142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.102 [2024-11-26 19:18:37.721154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.103 qpair failed and we were unable to recover it. 00:32:21.103 [2024-11-26 19:18:37.721302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.103 [2024-11-26 19:18:37.721377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.103 [2024-11-26 19:18:37.721388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.103 qpair failed and we were unable to recover it. 00:32:21.103 [2024-11-26 19:18:37.721453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.103 [2024-11-26 19:18:37.721584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.103 [2024-11-26 19:18:37.721596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.103 qpair failed and we were unable to recover it. 00:32:21.103 [2024-11-26 19:18:37.721676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.103 [2024-11-26 19:18:37.721768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.103 [2024-11-26 19:18:37.721780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.103 qpair failed and we were unable to recover it. 00:32:21.103 [2024-11-26 19:18:37.721937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.103 [2024-11-26 19:18:37.722005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.103 [2024-11-26 19:18:37.722017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.103 qpair failed and we were unable to recover it. 00:32:21.103 [2024-11-26 19:18:37.722088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.103 [2024-11-26 19:18:37.722304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.103 [2024-11-26 19:18:37.722316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.103 qpair failed and we were unable to recover it. 00:32:21.103 [2024-11-26 19:18:37.722401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.103 [2024-11-26 19:18:37.722551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.103 [2024-11-26 19:18:37.722563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.103 qpair failed and we were unable to recover it. 00:32:21.103 [2024-11-26 19:18:37.722637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.103 [2024-11-26 19:18:37.722764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.103 [2024-11-26 19:18:37.722776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.103 qpair failed and we were unable to recover it. 00:32:21.103 [2024-11-26 19:18:37.723009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.103 [2024-11-26 19:18:37.723085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.103 [2024-11-26 19:18:37.723096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.103 qpair failed and we were unable to recover it. 00:32:21.103 [2024-11-26 19:18:37.723175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.103 [2024-11-26 19:18:37.723257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.103 [2024-11-26 19:18:37.723269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.103 qpair failed and we were unable to recover it. 00:32:21.103 [2024-11-26 19:18:37.723466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.103 [2024-11-26 19:18:37.723529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.103 [2024-11-26 19:18:37.723540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.103 qpair failed and we were unable to recover it. 00:32:21.103 [2024-11-26 19:18:37.723619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.103 [2024-11-26 19:18:37.723688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.103 [2024-11-26 19:18:37.723699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.103 qpair failed and we were unable to recover it. 00:32:21.103 [2024-11-26 19:18:37.723829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.103 [2024-11-26 19:18:37.723970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.103 [2024-11-26 19:18:37.723982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.103 qpair failed and we were unable to recover it. 00:32:21.103 [2024-11-26 19:18:37.724055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.103 [2024-11-26 19:18:37.724197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.103 [2024-11-26 19:18:37.724208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.103 qpair failed and we were unable to recover it. 00:32:21.103 [2024-11-26 19:18:37.724283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.103 [2024-11-26 19:18:37.724354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.103 [2024-11-26 19:18:37.724365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.103 qpair failed and we were unable to recover it. 00:32:21.103 [2024-11-26 19:18:37.724430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.103 [2024-11-26 19:18:37.724519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.103 [2024-11-26 19:18:37.724530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.103 qpair failed and we were unable to recover it. 00:32:21.103 [2024-11-26 19:18:37.724675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.103 [2024-11-26 19:18:37.724847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.103 [2024-11-26 19:18:37.724858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.103 qpair failed and we were unable to recover it. 00:32:21.103 [2024-11-26 19:18:37.724989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.103 [2024-11-26 19:18:37.725135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.103 [2024-11-26 19:18:37.725146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.103 qpair failed and we were unable to recover it. 00:32:21.103 [2024-11-26 19:18:37.725287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.103 [2024-11-26 19:18:37.725366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.103 [2024-11-26 19:18:37.725377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.103 qpair failed and we were unable to recover it. 00:32:21.103 [2024-11-26 19:18:37.725596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.103 [2024-11-26 19:18:37.725751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.103 [2024-11-26 19:18:37.725769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.103 qpair failed and we were unable to recover it. 00:32:21.103 [2024-11-26 19:18:37.725854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.103 [2024-11-26 19:18:37.725940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.103 [2024-11-26 19:18:37.725956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.103 qpair failed and we were unable to recover it. 00:32:21.103 [2024-11-26 19:18:37.726095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.103 [2024-11-26 19:18:37.726188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.103 [2024-11-26 19:18:37.726199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.103 qpair failed and we were unable to recover it. 00:32:21.103 [2024-11-26 19:18:37.726318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.103 [2024-11-26 19:18:37.726469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.103 [2024-11-26 19:18:37.726480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.103 qpair failed and we were unable to recover it. 00:32:21.103 [2024-11-26 19:18:37.726591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.103 [2024-11-26 19:18:37.726742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.103 [2024-11-26 19:18:37.726753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.103 qpair failed and we were unable to recover it. 00:32:21.104 [2024-11-26 19:18:37.726915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.104 [2024-11-26 19:18:37.727006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.104 [2024-11-26 19:18:37.727018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.104 qpair failed and we were unable to recover it. 00:32:21.104 [2024-11-26 19:18:37.727103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.104 [2024-11-26 19:18:37.727254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.104 [2024-11-26 19:18:37.727265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.104 qpair failed and we were unable to recover it. 00:32:21.104 [2024-11-26 19:18:37.727415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.104 [2024-11-26 19:18:37.727478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.104 [2024-11-26 19:18:37.727489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.104 qpair failed and we were unable to recover it. 00:32:21.104 [2024-11-26 19:18:37.727577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.104 [2024-11-26 19:18:37.727777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.104 [2024-11-26 19:18:37.727788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.104 qpair failed and we were unable to recover it. 00:32:21.104 [2024-11-26 19:18:37.727926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.104 [2024-11-26 19:18:37.728003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.104 [2024-11-26 19:18:37.728016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.104 qpair failed and we were unable to recover it. 00:32:21.104 [2024-11-26 19:18:37.728146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.104 [2024-11-26 19:18:37.728284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.104 [2024-11-26 19:18:37.728298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.104 qpair failed and we were unable to recover it. 00:32:21.104 [2024-11-26 19:18:37.728454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.104 [2024-11-26 19:18:37.728594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.104 [2024-11-26 19:18:37.728605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.104 qpair failed and we were unable to recover it. 00:32:21.104 [2024-11-26 19:18:37.728867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.104 [2024-11-26 19:18:37.728991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.104 [2024-11-26 19:18:37.729003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.104 qpair failed and we were unable to recover it. 00:32:21.104 [2024-11-26 19:18:37.729074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.104 [2024-11-26 19:18:37.729217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.104 [2024-11-26 19:18:37.729228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.104 qpair failed and we were unable to recover it. 00:32:21.104 [2024-11-26 19:18:37.729312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.104 [2024-11-26 19:18:37.729370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.104 [2024-11-26 19:18:37.729382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.104 qpair failed and we were unable to recover it. 00:32:21.104 [2024-11-26 19:18:37.729450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.104 [2024-11-26 19:18:37.729532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.104 [2024-11-26 19:18:37.729544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.104 qpair failed and we were unable to recover it. 00:32:21.104 [2024-11-26 19:18:37.729613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.104 [2024-11-26 19:18:37.729688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.104 [2024-11-26 19:18:37.729700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.104 qpair failed and we were unable to recover it. 00:32:21.104 [2024-11-26 19:18:37.729774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.104 [2024-11-26 19:18:37.729907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.104 [2024-11-26 19:18:37.729919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.104 qpair failed and we were unable to recover it. 00:32:21.104 [2024-11-26 19:18:37.729987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.104 [2024-11-26 19:18:37.730117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.104 [2024-11-26 19:18:37.730129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.104 qpair failed and we were unable to recover it. 00:32:21.104 [2024-11-26 19:18:37.730238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.104 [2024-11-26 19:18:37.730376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.104 [2024-11-26 19:18:37.730388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.104 qpair failed and we were unable to recover it. 00:32:21.104 [2024-11-26 19:18:37.730478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.104 [2024-11-26 19:18:37.730554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.104 [2024-11-26 19:18:37.730568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.104 qpair failed and we were unable to recover it. 00:32:21.104 [2024-11-26 19:18:37.730643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.104 [2024-11-26 19:18:37.730826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.104 [2024-11-26 19:18:37.730837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.104 qpair failed and we were unable to recover it. 00:32:21.104 [2024-11-26 19:18:37.730977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.104 [2024-11-26 19:18:37.731121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.104 [2024-11-26 19:18:37.731132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.104 qpair failed and we were unable to recover it. 00:32:21.104 [2024-11-26 19:18:37.731202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.104 [2024-11-26 19:18:37.731273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.104 [2024-11-26 19:18:37.731284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.104 qpair failed and we were unable to recover it. 00:32:21.104 [2024-11-26 19:18:37.731438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.104 [2024-11-26 19:18:37.731569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.104 [2024-11-26 19:18:37.731580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.104 qpair failed and we were unable to recover it. 00:32:21.104 [2024-11-26 19:18:37.731722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.104 [2024-11-26 19:18:37.731799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.104 [2024-11-26 19:18:37.731810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.104 qpair failed and we were unable to recover it. 00:32:21.104 [2024-11-26 19:18:37.731892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.104 [2024-11-26 19:18:37.732085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.105 [2024-11-26 19:18:37.732097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.105 qpair failed and we were unable to recover it. 00:32:21.105 [2024-11-26 19:18:37.732180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.105 [2024-11-26 19:18:37.732321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.105 [2024-11-26 19:18:37.732332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.105 qpair failed and we were unable to recover it. 00:32:21.105 [2024-11-26 19:18:37.732394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.105 [2024-11-26 19:18:37.732479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.105 [2024-11-26 19:18:37.732490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.105 qpair failed and we were unable to recover it. 00:32:21.105 [2024-11-26 19:18:37.732564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.105 [2024-11-26 19:18:37.732724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.105 [2024-11-26 19:18:37.732735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.105 qpair failed and we were unable to recover it. 00:32:21.105 [2024-11-26 19:18:37.732865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.105 [2024-11-26 19:18:37.732937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.105 [2024-11-26 19:18:37.732955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.105 qpair failed and we were unable to recover it. 00:32:21.105 [2024-11-26 19:18:37.733029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.105 [2024-11-26 19:18:37.733171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.105 [2024-11-26 19:18:37.733182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.105 qpair failed and we were unable to recover it. 00:32:21.105 [2024-11-26 19:18:37.733243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.105 [2024-11-26 19:18:37.733323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.105 [2024-11-26 19:18:37.733335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.105 qpair failed and we were unable to recover it. 00:32:21.105 [2024-11-26 19:18:37.733425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.105 [2024-11-26 19:18:37.733499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.105 [2024-11-26 19:18:37.733510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.105 qpair failed and we were unable to recover it. 00:32:21.105 [2024-11-26 19:18:37.733645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.105 [2024-11-26 19:18:37.733794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.105 [2024-11-26 19:18:37.733806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.105 qpair failed and we were unable to recover it. 00:32:21.105 [2024-11-26 19:18:37.733945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.105 [2024-11-26 19:18:37.734029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.105 [2024-11-26 19:18:37.734041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.105 qpair failed and we were unable to recover it. 00:32:21.105 [2024-11-26 19:18:37.734244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.105 [2024-11-26 19:18:37.734240] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:32:21.105 [2024-11-26 19:18:37.734281] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:32:21.105 [2024-11-26 19:18:37.734337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.105 [2024-11-26 19:18:37.734348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.105 qpair failed and we were unable to recover it. 00:32:21.105 [2024-11-26 19:18:37.734495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.105 [2024-11-26 19:18:37.734571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.105 [2024-11-26 19:18:37.734580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.105 qpair failed and we were unable to recover it. 00:32:21.105 [2024-11-26 19:18:37.734647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.105 [2024-11-26 19:18:37.734715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.105 [2024-11-26 19:18:37.734723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.105 qpair failed and we were unable to recover it. 00:32:21.105 [2024-11-26 19:18:37.734903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.105 [2024-11-26 19:18:37.734979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.105 [2024-11-26 19:18:37.734990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.105 qpair failed and we were unable to recover it. 00:32:21.105 [2024-11-26 19:18:37.735141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.105 [2024-11-26 19:18:37.735203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.105 [2024-11-26 19:18:37.735214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.105 qpair failed and we were unable to recover it. 00:32:21.105 [2024-11-26 19:18:37.735293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.105 [2024-11-26 19:18:37.735441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.105 [2024-11-26 19:18:37.735452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.105 qpair failed and we were unable to recover it. 00:32:21.105 [2024-11-26 19:18:37.735527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.105 [2024-11-26 19:18:37.735661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.105 [2024-11-26 19:18:37.735672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.105 qpair failed and we were unable to recover it. 00:32:21.105 [2024-11-26 19:18:37.735760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.105 [2024-11-26 19:18:37.735823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.105 [2024-11-26 19:18:37.735835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.105 qpair failed and we were unable to recover it. 00:32:21.105 [2024-11-26 19:18:37.736057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.105 [2024-11-26 19:18:37.736188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.105 [2024-11-26 19:18:37.736200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.105 qpair failed and we were unable to recover it. 00:32:21.105 [2024-11-26 19:18:37.736278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.105 [2024-11-26 19:18:37.736357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.105 [2024-11-26 19:18:37.736368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.105 qpair failed and we were unable to recover it. 00:32:21.105 [2024-11-26 19:18:37.736636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.105 [2024-11-26 19:18:37.736740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.105 [2024-11-26 19:18:37.736752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.105 qpair failed and we were unable to recover it. 00:32:21.105 [2024-11-26 19:18:37.736838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.105 [2024-11-26 19:18:37.736912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.105 [2024-11-26 19:18:37.736924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.105 qpair failed and we were unable to recover it. 00:32:21.105 [2024-11-26 19:18:37.737008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.105 [2024-11-26 19:18:37.737102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.105 [2024-11-26 19:18:37.737113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.105 qpair failed and we were unable to recover it. 00:32:21.106 [2024-11-26 19:18:37.737280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.106 [2024-11-26 19:18:37.737366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.106 [2024-11-26 19:18:37.737377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.106 qpair failed and we were unable to recover it. 00:32:21.106 [2024-11-26 19:18:37.737466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.106 [2024-11-26 19:18:37.737616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.106 [2024-11-26 19:18:37.737627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.106 qpair failed and we were unable to recover it. 00:32:21.106 [2024-11-26 19:18:37.737772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.106 [2024-11-26 19:18:37.737837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.106 [2024-11-26 19:18:37.737848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.106 qpair failed and we were unable to recover it. 00:32:21.106 [2024-11-26 19:18:37.738045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.106 [2024-11-26 19:18:37.738118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.106 [2024-11-26 19:18:37.738129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.106 qpair failed and we were unable to recover it. 00:32:21.106 [2024-11-26 19:18:37.738196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.106 [2024-11-26 19:18:37.738285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.106 [2024-11-26 19:18:37.738296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.106 qpair failed and we were unable to recover it. 00:32:21.106 [2024-11-26 19:18:37.738380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.106 [2024-11-26 19:18:37.738580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.106 [2024-11-26 19:18:37.738591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.106 qpair failed and we were unable to recover it. 00:32:21.106 [2024-11-26 19:18:37.738734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.106 [2024-11-26 19:18:37.738818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.106 [2024-11-26 19:18:37.738830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.106 qpair failed and we were unable to recover it. 00:32:21.106 [2024-11-26 19:18:37.738896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.106 [2024-11-26 19:18:37.738966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.106 [2024-11-26 19:18:37.738978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.106 qpair failed and we were unable to recover it. 00:32:21.106 [2024-11-26 19:18:37.739117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.106 [2024-11-26 19:18:37.739266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.106 [2024-11-26 19:18:37.739278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.106 qpair failed and we were unable to recover it. 00:32:21.106 [2024-11-26 19:18:37.739346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.106 [2024-11-26 19:18:37.739422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.106 [2024-11-26 19:18:37.739433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.106 qpair failed and we were unable to recover it. 00:32:21.106 [2024-11-26 19:18:37.739647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.106 [2024-11-26 19:18:37.739775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.106 [2024-11-26 19:18:37.739787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.106 qpair failed and we were unable to recover it. 00:32:21.106 [2024-11-26 19:18:37.739931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.106 [2024-11-26 19:18:37.740103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.106 [2024-11-26 19:18:37.740115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.106 qpair failed and we were unable to recover it. 00:32:21.106 [2024-11-26 19:18:37.740244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.106 [2024-11-26 19:18:37.740308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.106 [2024-11-26 19:18:37.740320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.106 qpair failed and we were unable to recover it. 00:32:21.106 [2024-11-26 19:18:37.740381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.106 [2024-11-26 19:18:37.740535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.106 [2024-11-26 19:18:37.740546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.106 qpair failed and we were unable to recover it. 00:32:21.106 [2024-11-26 19:18:37.740694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.106 [2024-11-26 19:18:37.740765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.106 [2024-11-26 19:18:37.740777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.106 qpair failed and we were unable to recover it. 00:32:21.106 [2024-11-26 19:18:37.740861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.106 [2024-11-26 19:18:37.741056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.106 [2024-11-26 19:18:37.741068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.106 qpair failed and we were unable to recover it. 00:32:21.106 [2024-11-26 19:18:37.741156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.106 [2024-11-26 19:18:37.741239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.106 [2024-11-26 19:18:37.741250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.106 qpair failed and we were unable to recover it. 00:32:21.106 [2024-11-26 19:18:37.741333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.106 [2024-11-26 19:18:37.741490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.106 [2024-11-26 19:18:37.741502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.106 qpair failed and we were unable to recover it. 00:32:21.106 [2024-11-26 19:18:37.741579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.106 [2024-11-26 19:18:37.741643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.106 [2024-11-26 19:18:37.741654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.106 qpair failed and we were unable to recover it. 00:32:21.106 [2024-11-26 19:18:37.741804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.106 [2024-11-26 19:18:37.741937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.106 [2024-11-26 19:18:37.741952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.106 qpair failed and we were unable to recover it. 00:32:21.106 [2024-11-26 19:18:37.742016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.106 [2024-11-26 19:18:37.742144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.106 [2024-11-26 19:18:37.742155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.106 qpair failed and we were unable to recover it. 00:32:21.106 [2024-11-26 19:18:37.742252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.106 [2024-11-26 19:18:37.742332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.106 [2024-11-26 19:18:37.742343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.106 qpair failed and we were unable to recover it. 00:32:21.107 [2024-11-26 19:18:37.742485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.107 [2024-11-26 19:18:37.742551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.107 [2024-11-26 19:18:37.742563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.107 qpair failed and we were unable to recover it. 00:32:21.107 [2024-11-26 19:18:37.742672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.107 [2024-11-26 19:18:37.742756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.107 [2024-11-26 19:18:37.742767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.107 qpair failed and we were unable to recover it. 00:32:21.107 [2024-11-26 19:18:37.742857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.107 [2024-11-26 19:18:37.743057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.107 [2024-11-26 19:18:37.743069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.107 qpair failed and we were unable to recover it. 00:32:21.107 [2024-11-26 19:18:37.743195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.107 [2024-11-26 19:18:37.743416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.107 [2024-11-26 19:18:37.743428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.107 qpair failed and we were unable to recover it. 00:32:21.107 [2024-11-26 19:18:37.743556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.107 [2024-11-26 19:18:37.743618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.107 [2024-11-26 19:18:37.743630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.107 qpair failed and we were unable to recover it. 00:32:21.107 [2024-11-26 19:18:37.743717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.107 [2024-11-26 19:18:37.743800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.107 [2024-11-26 19:18:37.743812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.107 qpair failed and we were unable to recover it. 00:32:21.107 [2024-11-26 19:18:37.744007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.107 [2024-11-26 19:18:37.744140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.107 [2024-11-26 19:18:37.744152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.107 qpair failed and we were unable to recover it. 00:32:21.107 [2024-11-26 19:18:37.744345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.107 [2024-11-26 19:18:37.744427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.107 [2024-11-26 19:18:37.744439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.107 qpair failed and we were unable to recover it. 00:32:21.107 [2024-11-26 19:18:37.744532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.107 [2024-11-26 19:18:37.744729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.107 [2024-11-26 19:18:37.744741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.107 qpair failed and we were unable to recover it. 00:32:21.107 [2024-11-26 19:18:37.744838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.107 [2024-11-26 19:18:37.744925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.107 [2024-11-26 19:18:37.744936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.107 qpair failed and we were unable to recover it. 00:32:21.107 [2024-11-26 19:18:37.745067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.107 [2024-11-26 19:18:37.745193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.107 [2024-11-26 19:18:37.745204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.107 qpair failed and we were unable to recover it. 00:32:21.107 [2024-11-26 19:18:37.745267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.107 [2024-11-26 19:18:37.745465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.107 [2024-11-26 19:18:37.745476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.107 qpair failed and we were unable to recover it. 00:32:21.107 [2024-11-26 19:18:37.745554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.107 [2024-11-26 19:18:37.745686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.107 [2024-11-26 19:18:37.745697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.107 qpair failed and we were unable to recover it. 00:32:21.107 [2024-11-26 19:18:37.745863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.107 [2024-11-26 19:18:37.745988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.107 [2024-11-26 19:18:37.746000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.107 qpair failed and we were unable to recover it. 00:32:21.107 [2024-11-26 19:18:37.746082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.107 [2024-11-26 19:18:37.746207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.107 [2024-11-26 19:18:37.746218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.107 qpair failed and we were unable to recover it. 00:32:21.107 [2024-11-26 19:18:37.746358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.107 [2024-11-26 19:18:37.746506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.107 [2024-11-26 19:18:37.746517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.107 qpair failed and we were unable to recover it. 00:32:21.107 [2024-11-26 19:18:37.746591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.107 [2024-11-26 19:18:37.746725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.107 [2024-11-26 19:18:37.746736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.107 qpair failed and we were unable to recover it. 00:32:21.107 [2024-11-26 19:18:37.746887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.107 [2024-11-26 19:18:37.747030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.107 [2024-11-26 19:18:37.747041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.107 qpair failed and we were unable to recover it. 00:32:21.107 [2024-11-26 19:18:37.747122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.107 [2024-11-26 19:18:37.747210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.107 [2024-11-26 19:18:37.747221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.107 qpair failed and we were unable to recover it. 00:32:21.107 [2024-11-26 19:18:37.747374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.107 [2024-11-26 19:18:37.747504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.107 [2024-11-26 19:18:37.747516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.107 qpair failed and we were unable to recover it. 00:32:21.108 [2024-11-26 19:18:37.747664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.108 [2024-11-26 19:18:37.747795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.108 [2024-11-26 19:18:37.747807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.108 qpair failed and we were unable to recover it. 00:32:21.108 [2024-11-26 19:18:37.747955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.108 [2024-11-26 19:18:37.748032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.108 [2024-11-26 19:18:37.748044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.108 qpair failed and we were unable to recover it. 00:32:21.108 [2024-11-26 19:18:37.748195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.108 [2024-11-26 19:18:37.748276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.108 [2024-11-26 19:18:37.748288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.108 qpair failed and we were unable to recover it. 00:32:21.108 [2024-11-26 19:18:37.748422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.108 [2024-11-26 19:18:37.748511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.108 [2024-11-26 19:18:37.748522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.108 qpair failed and we were unable to recover it. 00:32:21.108 [2024-11-26 19:18:37.748587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.108 [2024-11-26 19:18:37.748659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.108 [2024-11-26 19:18:37.748671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.108 qpair failed and we were unable to recover it. 00:32:21.108 [2024-11-26 19:18:37.748807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.108 [2024-11-26 19:18:37.748892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.108 [2024-11-26 19:18:37.748903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.108 qpair failed and we were unable to recover it. 00:32:21.108 [2024-11-26 19:18:37.748976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.108 [2024-11-26 19:18:37.749036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.108 [2024-11-26 19:18:37.749048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.108 qpair failed and we were unable to recover it. 00:32:21.108 [2024-11-26 19:18:37.749155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.108 [2024-11-26 19:18:37.749246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.108 [2024-11-26 19:18:37.749257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.108 qpair failed and we were unable to recover it. 00:32:21.108 [2024-11-26 19:18:37.749337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.108 [2024-11-26 19:18:37.749473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.108 [2024-11-26 19:18:37.749484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.108 qpair failed and we were unable to recover it. 00:32:21.108 [2024-11-26 19:18:37.749548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.108 [2024-11-26 19:18:37.749635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.108 [2024-11-26 19:18:37.749645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.108 qpair failed and we were unable to recover it. 00:32:21.108 [2024-11-26 19:18:37.749719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.108 [2024-11-26 19:18:37.749842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.108 [2024-11-26 19:18:37.749853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.108 qpair failed and we were unable to recover it. 00:32:21.108 [2024-11-26 19:18:37.749990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.108 [2024-11-26 19:18:37.750133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.108 [2024-11-26 19:18:37.750145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.108 qpair failed and we were unable to recover it. 00:32:21.108 [2024-11-26 19:18:37.750279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.108 [2024-11-26 19:18:37.750416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.108 [2024-11-26 19:18:37.750427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.108 qpair failed and we were unable to recover it. 00:32:21.108 [2024-11-26 19:18:37.750563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.108 [2024-11-26 19:18:37.750716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.108 [2024-11-26 19:18:37.750727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.108 qpair failed and we were unable to recover it. 00:32:21.108 [2024-11-26 19:18:37.750872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.108 [2024-11-26 19:18:37.750946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.108 [2024-11-26 19:18:37.750962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.108 qpair failed and we were unable to recover it. 00:32:21.108 [2024-11-26 19:18:37.751124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.108 [2024-11-26 19:18:37.751278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.108 [2024-11-26 19:18:37.751290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.108 qpair failed and we were unable to recover it. 00:32:21.108 [2024-11-26 19:18:37.751418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.108 [2024-11-26 19:18:37.751495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.108 [2024-11-26 19:18:37.751507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.108 qpair failed and we were unable to recover it. 00:32:21.108 [2024-11-26 19:18:37.751650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.108 [2024-11-26 19:18:37.751729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.108 [2024-11-26 19:18:37.751741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.108 qpair failed and we were unable to recover it. 00:32:21.108 [2024-11-26 19:18:37.751884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.108 [2024-11-26 19:18:37.752013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.108 [2024-11-26 19:18:37.752025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.108 qpair failed and we were unable to recover it. 00:32:21.108 [2024-11-26 19:18:37.752270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.108 [2024-11-26 19:18:37.752342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.108 [2024-11-26 19:18:37.752353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.108 qpair failed and we were unable to recover it. 00:32:21.108 [2024-11-26 19:18:37.752572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.108 [2024-11-26 19:18:37.752701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.108 [2024-11-26 19:18:37.752713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.108 qpair failed and we were unable to recover it. 00:32:21.108 [2024-11-26 19:18:37.752785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.108 [2024-11-26 19:18:37.752860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.109 [2024-11-26 19:18:37.752871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.109 qpair failed and we were unable to recover it. 00:32:21.109 [2024-11-26 19:18:37.753116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.109 [2024-11-26 19:18:37.753264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.109 [2024-11-26 19:18:37.753276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.109 qpair failed and we were unable to recover it. 00:32:21.109 [2024-11-26 19:18:37.753403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.109 [2024-11-26 19:18:37.753570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.109 [2024-11-26 19:18:37.753582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.109 qpair failed and we were unable to recover it. 00:32:21.109 [2024-11-26 19:18:37.753717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.109 [2024-11-26 19:18:37.753808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.109 [2024-11-26 19:18:37.753819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.109 qpair failed and we were unable to recover it. 00:32:21.109 [2024-11-26 19:18:37.753962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.109 [2024-11-26 19:18:37.754092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.109 [2024-11-26 19:18:37.754103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.109 qpair failed and we were unable to recover it. 00:32:21.109 [2024-11-26 19:18:37.754181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.109 [2024-11-26 19:18:37.754316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.109 [2024-11-26 19:18:37.754328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.109 qpair failed and we were unable to recover it. 00:32:21.109 [2024-11-26 19:18:37.754459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.109 [2024-11-26 19:18:37.754602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.109 [2024-11-26 19:18:37.754614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.109 qpair failed and we were unable to recover it. 00:32:21.109 [2024-11-26 19:18:37.754688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.109 [2024-11-26 19:18:37.754833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.109 [2024-11-26 19:18:37.754845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.109 qpair failed and we were unable to recover it. 00:32:21.109 [2024-11-26 19:18:37.754909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.109 [2024-11-26 19:18:37.755046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.109 [2024-11-26 19:18:37.755058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.109 qpair failed and we were unable to recover it. 00:32:21.109 [2024-11-26 19:18:37.755226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.109 [2024-11-26 19:18:37.755291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.109 [2024-11-26 19:18:37.755307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.109 qpair failed and we were unable to recover it. 00:32:21.109 [2024-11-26 19:18:37.755390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.109 [2024-11-26 19:18:37.755469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.109 [2024-11-26 19:18:37.755480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.109 qpair failed and we were unable to recover it. 00:32:21.109 [2024-11-26 19:18:37.755557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.109 [2024-11-26 19:18:37.755693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.109 [2024-11-26 19:18:37.755704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.109 qpair failed and we were unable to recover it. 00:32:21.109 [2024-11-26 19:18:37.755874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.109 [2024-11-26 19:18:37.755934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.109 [2024-11-26 19:18:37.755951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.109 qpair failed and we were unable to recover it. 00:32:21.109 [2024-11-26 19:18:37.756033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.109 [2024-11-26 19:18:37.756119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.109 [2024-11-26 19:18:37.756130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.109 qpair failed and we were unable to recover it. 00:32:21.109 [2024-11-26 19:18:37.756270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.109 [2024-11-26 19:18:37.756345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.109 [2024-11-26 19:18:37.756356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.109 qpair failed and we were unable to recover it. 00:32:21.109 [2024-11-26 19:18:37.756419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.109 [2024-11-26 19:18:37.756561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.109 [2024-11-26 19:18:37.756573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.109 qpair failed and we were unable to recover it. 00:32:21.109 [2024-11-26 19:18:37.756664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.109 [2024-11-26 19:18:37.756748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.109 [2024-11-26 19:18:37.756760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.109 qpair failed and we were unable to recover it. 00:32:21.109 [2024-11-26 19:18:37.756899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.109 [2024-11-26 19:18:37.757029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.109 [2024-11-26 19:18:37.757041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.109 qpair failed and we were unable to recover it. 00:32:21.109 [2024-11-26 19:18:37.757180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.109 [2024-11-26 19:18:37.757251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.109 [2024-11-26 19:18:37.757264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.109 qpair failed and we were unable to recover it. 00:32:21.109 [2024-11-26 19:18:37.757355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.109 [2024-11-26 19:18:37.757448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.109 [2024-11-26 19:18:37.757459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.109 qpair failed and we were unable to recover it. 00:32:21.109 [2024-11-26 19:18:37.757533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.109 [2024-11-26 19:18:37.757616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.109 [2024-11-26 19:18:37.757628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.109 qpair failed and we were unable to recover it. 00:32:21.109 [2024-11-26 19:18:37.757775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.109 [2024-11-26 19:18:37.757844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.109 [2024-11-26 19:18:37.757855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.109 qpair failed and we were unable to recover it. 00:32:21.109 [2024-11-26 19:18:37.757970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.109 [2024-11-26 19:18:37.758034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.109 [2024-11-26 19:18:37.758046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.109 qpair failed and we were unable to recover it. 00:32:21.109 [2024-11-26 19:18:37.758175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.109 [2024-11-26 19:18:37.758246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.109 [2024-11-26 19:18:37.758257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.109 qpair failed and we were unable to recover it. 00:32:21.109 [2024-11-26 19:18:37.758368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.109 [2024-11-26 19:18:37.758431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.109 [2024-11-26 19:18:37.758443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.109 qpair failed and we were unable to recover it. 00:32:21.110 [2024-11-26 19:18:37.758514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.110 [2024-11-26 19:18:37.758577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.110 [2024-11-26 19:18:37.758589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.110 qpair failed and we were unable to recover it. 00:32:21.110 [2024-11-26 19:18:37.758686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.110 [2024-11-26 19:18:37.758818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.110 [2024-11-26 19:18:37.758829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.110 qpair failed and we were unable to recover it. 00:32:21.110 [2024-11-26 19:18:37.758914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.110 [2024-11-26 19:18:37.759054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.110 [2024-11-26 19:18:37.759067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.110 qpair failed and we were unable to recover it. 00:32:21.110 [2024-11-26 19:18:37.759284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.110 [2024-11-26 19:18:37.759371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.110 [2024-11-26 19:18:37.759385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.110 qpair failed and we were unable to recover it. 00:32:21.110 [2024-11-26 19:18:37.759450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.110 [2024-11-26 19:18:37.759525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.110 [2024-11-26 19:18:37.759536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.110 qpair failed and we were unable to recover it. 00:32:21.110 [2024-11-26 19:18:37.759624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.110 [2024-11-26 19:18:37.759819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.110 [2024-11-26 19:18:37.759831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.110 qpair failed and we were unable to recover it. 00:32:21.110 [2024-11-26 19:18:37.759971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.110 [2024-11-26 19:18:37.760113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.110 [2024-11-26 19:18:37.760124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.110 qpair failed and we were unable to recover it. 00:32:21.110 [2024-11-26 19:18:37.760305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.110 [2024-11-26 19:18:37.760368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.110 [2024-11-26 19:18:37.760380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.110 qpair failed and we were unable to recover it. 00:32:21.110 [2024-11-26 19:18:37.760522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.110 [2024-11-26 19:18:37.760602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.110 [2024-11-26 19:18:37.760614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.110 qpair failed and we were unable to recover it. 00:32:21.110 [2024-11-26 19:18:37.760695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.110 [2024-11-26 19:18:37.760857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.110 [2024-11-26 19:18:37.760869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.110 qpair failed and we were unable to recover it. 00:32:21.110 [2024-11-26 19:18:37.760932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.110 [2024-11-26 19:18:37.761074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.110 [2024-11-26 19:18:37.761085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.110 qpair failed and we were unable to recover it. 00:32:21.110 [2024-11-26 19:18:37.761146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.110 [2024-11-26 19:18:37.761220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.110 [2024-11-26 19:18:37.761232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.110 qpair failed and we were unable to recover it. 00:32:21.110 [2024-11-26 19:18:37.761391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.110 [2024-11-26 19:18:37.761499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.110 [2024-11-26 19:18:37.761511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.110 qpair failed and we were unable to recover it. 00:32:21.110 [2024-11-26 19:18:37.761580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.110 [2024-11-26 19:18:37.761653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.110 [2024-11-26 19:18:37.761668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.110 qpair failed and we were unable to recover it. 00:32:21.110 [2024-11-26 19:18:37.761735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.110 [2024-11-26 19:18:37.761874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.110 [2024-11-26 19:18:37.761886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.110 qpair failed and we were unable to recover it. 00:32:21.110 [2024-11-26 19:18:37.762013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.110 [2024-11-26 19:18:37.762139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.110 [2024-11-26 19:18:37.762151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.110 qpair failed and we were unable to recover it. 00:32:21.110 [2024-11-26 19:18:37.762228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.110 EAL: No free 2048 kB hugepages reported on node 1 00:32:21.110 [2024-11-26 19:18:37.762309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.110 [2024-11-26 19:18:37.762320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.110 qpair failed and we were unable to recover it. 00:32:21.110 [2024-11-26 19:18:37.762475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.110 [2024-11-26 19:18:37.762537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.110 [2024-11-26 19:18:37.762548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.110 qpair failed and we were unable to recover it. 00:32:21.110 [2024-11-26 19:18:37.762617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.110 [2024-11-26 19:18:37.762758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.110 [2024-11-26 19:18:37.762769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.110 qpair failed and we were unable to recover it. 00:32:21.110 [2024-11-26 19:18:37.762845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.110 [2024-11-26 19:18:37.762972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.110 [2024-11-26 19:18:37.762983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.110 qpair failed and we were unable to recover it. 00:32:21.110 [2024-11-26 19:18:37.763117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.110 [2024-11-26 19:18:37.763249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.110 [2024-11-26 19:18:37.763261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.110 qpair failed and we were unable to recover it. 00:32:21.110 [2024-11-26 19:18:37.763332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.110 [2024-11-26 19:18:37.763398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.110 [2024-11-26 19:18:37.763409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.110 qpair failed and we were unable to recover it. 00:32:21.110 [2024-11-26 19:18:37.763541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.110 [2024-11-26 19:18:37.763670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.110 [2024-11-26 19:18:37.763681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.110 qpair failed and we were unable to recover it. 00:32:21.110 [2024-11-26 19:18:37.763790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.110 [2024-11-26 19:18:37.763852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.110 [2024-11-26 19:18:37.763866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.110 qpair failed and we were unable to recover it. 00:32:21.110 [2024-11-26 19:18:37.763998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.111 [2024-11-26 19:18:37.764082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.111 [2024-11-26 19:18:37.764093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.111 qpair failed and we were unable to recover it. 00:32:21.111 [2024-11-26 19:18:37.764225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.111 [2024-11-26 19:18:37.764356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.111 [2024-11-26 19:18:37.764368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.111 qpair failed and we were unable to recover it. 00:32:21.111 [2024-11-26 19:18:37.764431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.111 [2024-11-26 19:18:37.764508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.111 [2024-11-26 19:18:37.764519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.111 qpair failed and we were unable to recover it. 00:32:21.111 [2024-11-26 19:18:37.764588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.111 [2024-11-26 19:18:37.764734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.111 [2024-11-26 19:18:37.764746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.111 qpair failed and we were unable to recover it. 00:32:21.111 [2024-11-26 19:18:37.764831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.111 [2024-11-26 19:18:37.764903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.111 [2024-11-26 19:18:37.764914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.111 qpair failed and we were unable to recover it. 00:32:21.111 [2024-11-26 19:18:37.764985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.111 [2024-11-26 19:18:37.765049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.111 [2024-11-26 19:18:37.765061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.111 qpair failed and we were unable to recover it. 00:32:21.111 [2024-11-26 19:18:37.765210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.111 [2024-11-26 19:18:37.765277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.111 [2024-11-26 19:18:37.765289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.111 qpair failed and we were unable to recover it. 00:32:21.111 [2024-11-26 19:18:37.765420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.111 [2024-11-26 19:18:37.765496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.111 [2024-11-26 19:18:37.765507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.111 qpair failed and we were unable to recover it. 00:32:21.111 [2024-11-26 19:18:37.765652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.111 [2024-11-26 19:18:37.765797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.111 [2024-11-26 19:18:37.765808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.111 qpair failed and we were unable to recover it. 00:32:21.111 [2024-11-26 19:18:37.765997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.111 [2024-11-26 19:18:37.766069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.111 [2024-11-26 19:18:37.766082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.111 qpair failed and we were unable to recover it. 00:32:21.111 [2024-11-26 19:18:37.766251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.111 [2024-11-26 19:18:37.766382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.111 [2024-11-26 19:18:37.766393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.111 qpair failed and we were unable to recover it. 00:32:21.111 [2024-11-26 19:18:37.766553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.111 [2024-11-26 19:18:37.766690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.111 [2024-11-26 19:18:37.766702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.111 qpair failed and we were unable to recover it. 00:32:21.111 [2024-11-26 19:18:37.766788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.111 [2024-11-26 19:18:37.766921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.111 [2024-11-26 19:18:37.766933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.111 qpair failed and we were unable to recover it. 00:32:21.111 [2024-11-26 19:18:37.767160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.111 [2024-11-26 19:18:37.767383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.111 [2024-11-26 19:18:37.767396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.111 qpair failed and we were unable to recover it. 00:32:21.111 [2024-11-26 19:18:37.767486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.111 [2024-11-26 19:18:37.767624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.111 [2024-11-26 19:18:37.767636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.111 qpair failed and we were unable to recover it. 00:32:21.111 [2024-11-26 19:18:37.767765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.111 [2024-11-26 19:18:37.767855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.111 [2024-11-26 19:18:37.767866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.111 qpair failed and we were unable to recover it. 00:32:21.111 [2024-11-26 19:18:37.767946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.111 [2024-11-26 19:18:37.768079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.111 [2024-11-26 19:18:37.768091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.111 qpair failed and we were unable to recover it. 00:32:21.111 [2024-11-26 19:18:37.768225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.111 [2024-11-26 19:18:37.768357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.111 [2024-11-26 19:18:37.768369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.111 qpair failed and we were unable to recover it. 00:32:21.111 [2024-11-26 19:18:37.768432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.111 [2024-11-26 19:18:37.768513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.111 [2024-11-26 19:18:37.768525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.111 qpair failed and we were unable to recover it. 00:32:21.111 [2024-11-26 19:18:37.768731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.111 [2024-11-26 19:18:37.768804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.111 [2024-11-26 19:18:37.768817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.111 qpair failed and we were unable to recover it. 00:32:21.111 [2024-11-26 19:18:37.768945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.111 [2024-11-26 19:18:37.769081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.111 [2024-11-26 19:18:37.769093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.111 qpair failed and we were unable to recover it. 00:32:21.111 [2024-11-26 19:18:37.769169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.111 [2024-11-26 19:18:37.769259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.111 [2024-11-26 19:18:37.769271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.111 qpair failed and we were unable to recover it. 00:32:21.111 [2024-11-26 19:18:37.769403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.111 [2024-11-26 19:18:37.769484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.111 [2024-11-26 19:18:37.769495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.111 qpair failed and we were unable to recover it. 00:32:21.112 [2024-11-26 19:18:37.769627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.112 [2024-11-26 19:18:37.769694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.112 [2024-11-26 19:18:37.769705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.112 qpair failed and we were unable to recover it. 00:32:21.112 [2024-11-26 19:18:37.769919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.112 [2024-11-26 19:18:37.769997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.112 [2024-11-26 19:18:37.770009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.112 qpair failed and we were unable to recover it. 00:32:21.112 [2024-11-26 19:18:37.770137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.112 [2024-11-26 19:18:37.770206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.112 [2024-11-26 19:18:37.770218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.112 qpair failed and we were unable to recover it. 00:32:21.112 [2024-11-26 19:18:37.770283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.112 [2024-11-26 19:18:37.770368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.112 [2024-11-26 19:18:37.770381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.112 qpair failed and we were unable to recover it. 00:32:21.112 [2024-11-26 19:18:37.770444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.112 [2024-11-26 19:18:37.770522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.112 [2024-11-26 19:18:37.770533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.112 qpair failed and we were unable to recover it. 00:32:21.112 [2024-11-26 19:18:37.770662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.112 [2024-11-26 19:18:37.770735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.112 [2024-11-26 19:18:37.770747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.112 qpair failed and we were unable to recover it. 00:32:21.112 [2024-11-26 19:18:37.770824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.112 [2024-11-26 19:18:37.770911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.112 [2024-11-26 19:18:37.770923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.112 qpair failed and we were unable to recover it. 00:32:21.112 [2024-11-26 19:18:37.771035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.112 [2024-11-26 19:18:37.771172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.112 [2024-11-26 19:18:37.771184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.112 qpair failed and we were unable to recover it. 00:32:21.112 [2024-11-26 19:18:37.771266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.112 [2024-11-26 19:18:37.771351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.112 [2024-11-26 19:18:37.771363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.112 qpair failed and we were unable to recover it. 00:32:21.112 [2024-11-26 19:18:37.771520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.112 [2024-11-26 19:18:37.771600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.112 [2024-11-26 19:18:37.771611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.112 qpair failed and we were unable to recover it. 00:32:21.112 [2024-11-26 19:18:37.771677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.112 [2024-11-26 19:18:37.771742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.112 [2024-11-26 19:18:37.771753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.112 qpair failed and we were unable to recover it. 00:32:21.112 [2024-11-26 19:18:37.771945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.112 [2024-11-26 19:18:37.772030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.112 [2024-11-26 19:18:37.772042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.112 qpair failed and we were unable to recover it. 00:32:21.112 [2024-11-26 19:18:37.772192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.112 [2024-11-26 19:18:37.772389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.112 [2024-11-26 19:18:37.772401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.112 qpair failed and we were unable to recover it. 00:32:21.112 [2024-11-26 19:18:37.772543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.112 [2024-11-26 19:18:37.772607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.112 [2024-11-26 19:18:37.772619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.112 qpair failed and we were unable to recover it. 00:32:21.112 [2024-11-26 19:18:37.772730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.112 [2024-11-26 19:18:37.772871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.112 [2024-11-26 19:18:37.772882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.112 qpair failed and we were unable to recover it. 00:32:21.112 [2024-11-26 19:18:37.773045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.112 [2024-11-26 19:18:37.773120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.112 [2024-11-26 19:18:37.773132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.112 qpair failed and we were unable to recover it. 00:32:21.112 [2024-11-26 19:18:37.773342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.112 [2024-11-26 19:18:37.773426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.112 [2024-11-26 19:18:37.773437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.112 qpair failed and we were unable to recover it. 00:32:21.112 [2024-11-26 19:18:37.773514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.112 [2024-11-26 19:18:37.773715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.112 [2024-11-26 19:18:37.773727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.112 qpair failed and we were unable to recover it. 00:32:21.112 [2024-11-26 19:18:37.773802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.112 [2024-11-26 19:18:37.773878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.112 [2024-11-26 19:18:37.773890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.112 qpair failed and we were unable to recover it. 00:32:21.112 [2024-11-26 19:18:37.774014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.112 [2024-11-26 19:18:37.774096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.112 [2024-11-26 19:18:37.774107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.112 qpair failed and we were unable to recover it. 00:32:21.112 [2024-11-26 19:18:37.774252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.112 [2024-11-26 19:18:37.774397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.112 [2024-11-26 19:18:37.774409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.112 qpair failed and we were unable to recover it. 00:32:21.112 [2024-11-26 19:18:37.774564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.112 [2024-11-26 19:18:37.774700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.112 [2024-11-26 19:18:37.774712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.112 qpair failed and we were unable to recover it. 00:32:21.113 [2024-11-26 19:18:37.774785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.113 [2024-11-26 19:18:37.774857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.113 [2024-11-26 19:18:37.774868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.113 qpair failed and we were unable to recover it. 00:32:21.113 [2024-11-26 19:18:37.774932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.113 [2024-11-26 19:18:37.775003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.113 [2024-11-26 19:18:37.775015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.113 qpair failed and we were unable to recover it. 00:32:21.113 [2024-11-26 19:18:37.775087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.113 [2024-11-26 19:18:37.775226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.113 [2024-11-26 19:18:37.775238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.113 qpair failed and we were unable to recover it. 00:32:21.113 [2024-11-26 19:18:37.775295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.113 [2024-11-26 19:18:37.775356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.113 [2024-11-26 19:18:37.775368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.113 qpair failed and we were unable to recover it. 00:32:21.113 [2024-11-26 19:18:37.775446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.113 [2024-11-26 19:18:37.775603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.113 [2024-11-26 19:18:37.775614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.113 qpair failed and we were unable to recover it. 00:32:21.113 [2024-11-26 19:18:37.775818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.113 [2024-11-26 19:18:37.775896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.113 [2024-11-26 19:18:37.775908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.113 qpair failed and we were unable to recover it. 00:32:21.113 [2024-11-26 19:18:37.776105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.113 [2024-11-26 19:18:37.776183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.113 [2024-11-26 19:18:37.776195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.113 qpair failed and we were unable to recover it. 00:32:21.113 [2024-11-26 19:18:37.776277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.113 [2024-11-26 19:18:37.776407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.113 [2024-11-26 19:18:37.776419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.113 qpair failed and we were unable to recover it. 00:32:21.113 [2024-11-26 19:18:37.776548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.113 [2024-11-26 19:18:37.776609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.113 [2024-11-26 19:18:37.776621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.113 qpair failed and we were unable to recover it. 00:32:21.113 [2024-11-26 19:18:37.776785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.113 [2024-11-26 19:18:37.776868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.113 [2024-11-26 19:18:37.776880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.113 qpair failed and we were unable to recover it. 00:32:21.113 [2024-11-26 19:18:37.776969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.113 [2024-11-26 19:18:37.777104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.113 [2024-11-26 19:18:37.777115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.113 qpair failed and we were unable to recover it. 00:32:21.113 [2024-11-26 19:18:37.777187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.113 [2024-11-26 19:18:37.777252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.113 [2024-11-26 19:18:37.777264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.113 qpair failed and we were unable to recover it. 00:32:21.113 [2024-11-26 19:18:37.777419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.113 [2024-11-26 19:18:37.777576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.113 [2024-11-26 19:18:37.777588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.113 qpair failed and we were unable to recover it. 00:32:21.113 [2024-11-26 19:18:37.777757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.113 [2024-11-26 19:18:37.777887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.113 [2024-11-26 19:18:37.777899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.113 qpair failed and we were unable to recover it. 00:32:21.113 [2024-11-26 19:18:37.778057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.113 [2024-11-26 19:18:37.778204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.113 [2024-11-26 19:18:37.778216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.113 qpair failed and we were unable to recover it. 00:32:21.113 [2024-11-26 19:18:37.778295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.113 [2024-11-26 19:18:37.778438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.113 [2024-11-26 19:18:37.778450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.113 qpair failed and we were unable to recover it. 00:32:21.113 [2024-11-26 19:18:37.778519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.113 [2024-11-26 19:18:37.778598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.113 [2024-11-26 19:18:37.778609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.113 qpair failed and we were unable to recover it. 00:32:21.113 [2024-11-26 19:18:37.778665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.113 [2024-11-26 19:18:37.778747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.113 [2024-11-26 19:18:37.778759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.113 qpair failed and we were unable to recover it. 00:32:21.113 [2024-11-26 19:18:37.778903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.113 [2024-11-26 19:18:37.779041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.113 [2024-11-26 19:18:37.779053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.113 qpair failed and we were unable to recover it. 00:32:21.113 [2024-11-26 19:18:37.779185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.113 [2024-11-26 19:18:37.779239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.113 [2024-11-26 19:18:37.779250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.113 qpair failed and we were unable to recover it. 00:32:21.113 [2024-11-26 19:18:37.779312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.114 [2024-11-26 19:18:37.779386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.114 [2024-11-26 19:18:37.779397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.114 qpair failed and we were unable to recover it. 00:32:21.114 [2024-11-26 19:18:37.779643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.114 [2024-11-26 19:18:37.779718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.114 [2024-11-26 19:18:37.779729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.114 qpair failed and we were unable to recover it. 00:32:21.114 [2024-11-26 19:18:37.779809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.114 [2024-11-26 19:18:37.779940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.114 [2024-11-26 19:18:37.779954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.114 qpair failed and we were unable to recover it. 00:32:21.114 [2024-11-26 19:18:37.780100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.114 [2024-11-26 19:18:37.780161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.114 [2024-11-26 19:18:37.780172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.114 qpair failed and we were unable to recover it. 00:32:21.114 [2024-11-26 19:18:37.780248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.114 [2024-11-26 19:18:37.780316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.114 [2024-11-26 19:18:37.780327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.114 qpair failed and we were unable to recover it. 00:32:21.114 [2024-11-26 19:18:37.780490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.114 [2024-11-26 19:18:37.780551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.114 [2024-11-26 19:18:37.780562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.114 qpair failed and we were unable to recover it. 00:32:21.114 [2024-11-26 19:18:37.780703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.114 [2024-11-26 19:18:37.780793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.114 [2024-11-26 19:18:37.780804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.114 qpair failed and we were unable to recover it. 00:32:21.114 [2024-11-26 19:18:37.780894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.114 [2024-11-26 19:18:37.781044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.114 [2024-11-26 19:18:37.781056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.114 qpair failed and we were unable to recover it. 00:32:21.114 [2024-11-26 19:18:37.781132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.114 [2024-11-26 19:18:37.781276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.114 [2024-11-26 19:18:37.781287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.114 qpair failed and we were unable to recover it. 00:32:21.114 [2024-11-26 19:18:37.781352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.114 [2024-11-26 19:18:37.781430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.114 [2024-11-26 19:18:37.781441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.114 qpair failed and we were unable to recover it. 00:32:21.114 [2024-11-26 19:18:37.781514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.114 [2024-11-26 19:18:37.781733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.114 [2024-11-26 19:18:37.781743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.114 qpair failed and we were unable to recover it. 00:32:21.114 [2024-11-26 19:18:37.781820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.114 [2024-11-26 19:18:37.781896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.114 [2024-11-26 19:18:37.781908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.114 qpair failed and we were unable to recover it. 00:32:21.114 [2024-11-26 19:18:37.782058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.114 [2024-11-26 19:18:37.782216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.114 [2024-11-26 19:18:37.782227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.114 qpair failed and we were unable to recover it. 00:32:21.114 [2024-11-26 19:18:37.782312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.114 [2024-11-26 19:18:37.782470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.114 [2024-11-26 19:18:37.782483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.114 qpair failed and we were unable to recover it. 00:32:21.114 [2024-11-26 19:18:37.782567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.114 [2024-11-26 19:18:37.782659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.114 [2024-11-26 19:18:37.782671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.114 qpair failed and we were unable to recover it. 00:32:21.114 [2024-11-26 19:18:37.782762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.114 [2024-11-26 19:18:37.782846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.114 [2024-11-26 19:18:37.782857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.114 qpair failed and we were unable to recover it. 00:32:21.114 [2024-11-26 19:18:37.783001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.114 [2024-11-26 19:18:37.783149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.114 [2024-11-26 19:18:37.783160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.114 qpair failed and we were unable to recover it. 00:32:21.114 [2024-11-26 19:18:37.783231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.114 [2024-11-26 19:18:37.783298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.114 [2024-11-26 19:18:37.783309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.114 qpair failed and we were unable to recover it. 00:32:21.114 [2024-11-26 19:18:37.783451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.114 [2024-11-26 19:18:37.783616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.114 [2024-11-26 19:18:37.783627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.114 qpair failed and we were unable to recover it. 00:32:21.114 [2024-11-26 19:18:37.783779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.114 [2024-11-26 19:18:37.783903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.114 [2024-11-26 19:18:37.783915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.114 qpair failed and we were unable to recover it. 00:32:21.114 [2024-11-26 19:18:37.783992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.114 [2024-11-26 19:18:37.784123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.114 [2024-11-26 19:18:37.784135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.114 qpair failed and we were unable to recover it. 00:32:21.114 [2024-11-26 19:18:37.784330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.114 [2024-11-26 19:18:37.784397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.114 [2024-11-26 19:18:37.784409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.114 qpair failed and we were unable to recover it. 00:32:21.114 [2024-11-26 19:18:37.784493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.114 [2024-11-26 19:18:37.784586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.114 [2024-11-26 19:18:37.784597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.115 qpair failed and we were unable to recover it. 00:32:21.115 [2024-11-26 19:18:37.784676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.115 [2024-11-26 19:18:37.784764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.115 [2024-11-26 19:18:37.784775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.115 qpair failed and we were unable to recover it. 00:32:21.115 [2024-11-26 19:18:37.784853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.115 [2024-11-26 19:18:37.785048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.115 [2024-11-26 19:18:37.785059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.115 qpair failed and we were unable to recover it. 00:32:21.115 [2024-11-26 19:18:37.785189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.115 [2024-11-26 19:18:37.785251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.115 [2024-11-26 19:18:37.785262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.115 qpair failed and we were unable to recover it. 00:32:21.115 [2024-11-26 19:18:37.785339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.115 [2024-11-26 19:18:37.785487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.115 [2024-11-26 19:18:37.785498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.115 qpair failed and we were unable to recover it. 00:32:21.115 [2024-11-26 19:18:37.785578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.115 [2024-11-26 19:18:37.785642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.115 [2024-11-26 19:18:37.785653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.115 qpair failed and we were unable to recover it. 00:32:21.115 [2024-11-26 19:18:37.785858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.115 [2024-11-26 19:18:37.785922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.115 [2024-11-26 19:18:37.785934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.115 qpair failed and we were unable to recover it. 00:32:21.115 [2024-11-26 19:18:37.786014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.115 [2024-11-26 19:18:37.786123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.115 [2024-11-26 19:18:37.786134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.115 qpair failed and we were unable to recover it. 00:32:21.115 [2024-11-26 19:18:37.786273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.115 [2024-11-26 19:18:37.786339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.115 [2024-11-26 19:18:37.786350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.115 qpair failed and we were unable to recover it. 00:32:21.115 [2024-11-26 19:18:37.786424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.115 [2024-11-26 19:18:37.786492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.115 [2024-11-26 19:18:37.786504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.115 qpair failed and we were unable to recover it. 00:32:21.115 [2024-11-26 19:18:37.786641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.115 [2024-11-26 19:18:37.786702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.115 [2024-11-26 19:18:37.786714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.115 qpair failed and we were unable to recover it. 00:32:21.115 [2024-11-26 19:18:37.786781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.115 [2024-11-26 19:18:37.786874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.115 [2024-11-26 19:18:37.786886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.115 qpair failed and we were unable to recover it. 00:32:21.115 [2024-11-26 19:18:37.787024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.115 [2024-11-26 19:18:37.787239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.115 [2024-11-26 19:18:37.787250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.115 qpair failed and we were unable to recover it. 00:32:21.115 [2024-11-26 19:18:37.787423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.115 [2024-11-26 19:18:37.787589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.115 [2024-11-26 19:18:37.787609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.115 qpair failed and we were unable to recover it. 00:32:21.115 [2024-11-26 19:18:37.787791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.115 [2024-11-26 19:18:37.787989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.115 [2024-11-26 19:18:37.788007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.115 qpair failed and we were unable to recover it. 00:32:21.115 [2024-11-26 19:18:37.788152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.115 [2024-11-26 19:18:37.788385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.115 [2024-11-26 19:18:37.788399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.115 qpair failed and we were unable to recover it. 00:32:21.115 [2024-11-26 19:18:37.788485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.115 [2024-11-26 19:18:37.788691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.115 [2024-11-26 19:18:37.788706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.115 qpair failed and we were unable to recover it. 00:32:21.115 [2024-11-26 19:18:37.788797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.115 [2024-11-26 19:18:37.789008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.115 [2024-11-26 19:18:37.789025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.115 qpair failed and we were unable to recover it. 00:32:21.115 [2024-11-26 19:18:37.789174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.115 [2024-11-26 19:18:37.789397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.115 [2024-11-26 19:18:37.789412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.115 qpair failed and we were unable to recover it. 00:32:21.115 [2024-11-26 19:18:37.789616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.115 [2024-11-26 19:18:37.789706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.115 [2024-11-26 19:18:37.789721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.115 qpair failed and we were unable to recover it. 00:32:21.115 [2024-11-26 19:18:37.789820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.115 [2024-11-26 19:18:37.789967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.115 [2024-11-26 19:18:37.789984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.115 qpair failed and we were unable to recover it. 00:32:21.115 [2024-11-26 19:18:37.790134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.115 [2024-11-26 19:18:37.790280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.115 [2024-11-26 19:18:37.790296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.115 qpair failed and we were unable to recover it. 00:32:21.115 [2024-11-26 19:18:37.790444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.115 [2024-11-26 19:18:37.790542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.116 [2024-11-26 19:18:37.790558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.116 qpair failed and we were unable to recover it. 00:32:21.116 [2024-11-26 19:18:37.790633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.116 [2024-11-26 19:18:37.790727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.116 [2024-11-26 19:18:37.790743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.116 qpair failed and we were unable to recover it. 00:32:21.116 [2024-11-26 19:18:37.790840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.116 [2024-11-26 19:18:37.790922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.116 [2024-11-26 19:18:37.790938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.116 qpair failed and we were unable to recover it. 00:32:21.116 [2024-11-26 19:18:37.791051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.116 [2024-11-26 19:18:37.791253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.116 [2024-11-26 19:18:37.791269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.116 qpair failed and we were unable to recover it. 00:32:21.116 [2024-11-26 19:18:37.791347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.116 [2024-11-26 19:18:37.791488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.116 [2024-11-26 19:18:37.791504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.116 qpair failed and we were unable to recover it. 00:32:21.116 [2024-11-26 19:18:37.791579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.116 [2024-11-26 19:18:37.791716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.116 [2024-11-26 19:18:37.791732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.116 qpair failed and we were unable to recover it. 00:32:21.116 [2024-11-26 19:18:37.791968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.116 [2024-11-26 19:18:37.792108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.116 [2024-11-26 19:18:37.792123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.116 qpair failed and we were unable to recover it. 00:32:21.116 [2024-11-26 19:18:37.792295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.116 [2024-11-26 19:18:37.792385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.116 [2024-11-26 19:18:37.792400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.116 qpair failed and we were unable to recover it. 00:32:21.116 [2024-11-26 19:18:37.792556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.116 [2024-11-26 19:18:37.792643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.116 [2024-11-26 19:18:37.792658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.116 qpair failed and we were unable to recover it. 00:32:21.116 [2024-11-26 19:18:37.792827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.116 [2024-11-26 19:18:37.792914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.116 [2024-11-26 19:18:37.792929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.116 qpair failed and we were unable to recover it. 00:32:21.116 [2024-11-26 19:18:37.793022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.116 [2024-11-26 19:18:37.793105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.116 [2024-11-26 19:18:37.793120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.116 qpair failed and we were unable to recover it. 00:32:21.116 [2024-11-26 19:18:37.793209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.116 [2024-11-26 19:18:37.793356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.116 [2024-11-26 19:18:37.793375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.116 qpair failed and we were unable to recover it. 00:32:21.116 [2024-11-26 19:18:37.793531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.116 [2024-11-26 19:18:37.793615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.116 [2024-11-26 19:18:37.793631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.116 qpair failed and we were unable to recover it. 00:32:21.116 [2024-11-26 19:18:37.793724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.116 [2024-11-26 19:18:37.793818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.116 [2024-11-26 19:18:37.793833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.116 qpair failed and we were unable to recover it. 00:32:21.116 [2024-11-26 19:18:37.793907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.116 [2024-11-26 19:18:37.794052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.116 [2024-11-26 19:18:37.794069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.116 qpair failed and we were unable to recover it. 00:32:21.116 [2024-11-26 19:18:37.794223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.116 [2024-11-26 19:18:37.794380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.116 [2024-11-26 19:18:37.794395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.116 qpair failed and we were unable to recover it. 00:32:21.116 [2024-11-26 19:18:37.794473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.116 [2024-11-26 19:18:37.794558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.116 [2024-11-26 19:18:37.794573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.116 qpair failed and we were unable to recover it. 00:32:21.116 [2024-11-26 19:18:37.794665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.116 [2024-11-26 19:18:37.794738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.116 [2024-11-26 19:18:37.794753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.116 qpair failed and we were unable to recover it. 00:32:21.116 [2024-11-26 19:18:37.794928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.116 [2024-11-26 19:18:37.795026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.116 [2024-11-26 19:18:37.795042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.116 qpair failed and we were unable to recover it. 00:32:21.116 [2024-11-26 19:18:37.795131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.116 [2024-11-26 19:18:37.795292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.116 [2024-11-26 19:18:37.795307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.116 qpair failed and we were unable to recover it. 00:32:21.116 [2024-11-26 19:18:37.795413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.116 [2024-11-26 19:18:37.795489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.116 [2024-11-26 19:18:37.795504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.116 qpair failed and we were unable to recover it. 00:32:21.116 [2024-11-26 19:18:37.795598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.116 [2024-11-26 19:18:37.795676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.116 [2024-11-26 19:18:37.795691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.116 qpair failed and we were unable to recover it. 00:32:21.116 [2024-11-26 19:18:37.795791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.116 [2024-11-26 19:18:37.795927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.116 [2024-11-26 19:18:37.795943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.116 qpair failed and we were unable to recover it. 00:32:21.116 [2024-11-26 19:18:37.796042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.116 [2024-11-26 19:18:37.796130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.116 [2024-11-26 19:18:37.796145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.116 qpair failed and we were unable to recover it. 00:32:21.116 [2024-11-26 19:18:37.796296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.116 [2024-11-26 19:18:37.796434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.116 [2024-11-26 19:18:37.796449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.116 qpair failed and we were unable to recover it. 00:32:21.116 [2024-11-26 19:18:37.796531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.117 [2024-11-26 19:18:37.796600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.117 [2024-11-26 19:18:37.796615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.117 qpair failed and we were unable to recover it. 00:32:21.117 [2024-11-26 19:18:37.796693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.117 [2024-11-26 19:18:37.796781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.117 [2024-11-26 19:18:37.796796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.117 qpair failed and we were unable to recover it. 00:32:21.117 [2024-11-26 19:18:37.796872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.117 [2024-11-26 19:18:37.797066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.117 [2024-11-26 19:18:37.797082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.117 qpair failed and we were unable to recover it. 00:32:21.117 [2024-11-26 19:18:37.797189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.117 [2024-11-26 19:18:37.797360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.117 [2024-11-26 19:18:37.797376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.117 qpair failed and we were unable to recover it. 00:32:21.117 [2024-11-26 19:18:37.797548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.117 [2024-11-26 19:18:37.797780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.117 [2024-11-26 19:18:37.797794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.117 qpair failed and we were unable to recover it. 00:32:21.117 [2024-11-26 19:18:37.797967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.117 [2024-11-26 19:18:37.798064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.117 [2024-11-26 19:18:37.798080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.117 qpair failed and we were unable to recover it. 00:32:21.117 [2024-11-26 19:18:37.798162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.117 [2024-11-26 19:18:37.798430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.117 [2024-11-26 19:18:37.798445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.117 qpair failed and we were unable to recover it. 00:32:21.117 [2024-11-26 19:18:37.798537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.117 [2024-11-26 19:18:37.798762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.117 [2024-11-26 19:18:37.798778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.117 qpair failed and we were unable to recover it. 00:32:21.117 [2024-11-26 19:18:37.798849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.117 [2024-11-26 19:18:37.799076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.117 [2024-11-26 19:18:37.799092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.117 qpair failed and we were unable to recover it. 00:32:21.117 [2024-11-26 19:18:37.799249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.117 [2024-11-26 19:18:37.799401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.117 [2024-11-26 19:18:37.799416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.117 qpair failed and we were unable to recover it. 00:32:21.117 [2024-11-26 19:18:37.799569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.117 [2024-11-26 19:18:37.799714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.117 [2024-11-26 19:18:37.799729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.117 qpair failed and we were unable to recover it. 00:32:21.117 [2024-11-26 19:18:37.799890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.117 [2024-11-26 19:18:37.800021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.117 [2024-11-26 19:18:37.800038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.117 qpair failed and we were unable to recover it. 00:32:21.117 [2024-11-26 19:18:37.800132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.117 [2024-11-26 19:18:37.800224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.117 [2024-11-26 19:18:37.800240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.117 qpair failed and we were unable to recover it. 00:32:21.117 [2024-11-26 19:18:37.800335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.117 [2024-11-26 19:18:37.800484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.117 [2024-11-26 19:18:37.800500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.117 qpair failed and we were unable to recover it. 00:32:21.117 [2024-11-26 19:18:37.800645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.117 [2024-11-26 19:18:37.800727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.117 [2024-11-26 19:18:37.800742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.117 qpair failed and we were unable to recover it. 00:32:21.117 [2024-11-26 19:18:37.800879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.117 [2024-11-26 19:18:37.801024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.117 [2024-11-26 19:18:37.801040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.117 qpair failed and we were unable to recover it. 00:32:21.117 [2024-11-26 19:18:37.801185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.117 [2024-11-26 19:18:37.801270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.117 [2024-11-26 19:18:37.801285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.117 qpair failed and we were unable to recover it. 00:32:21.117 [2024-11-26 19:18:37.801384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.117 [2024-11-26 19:18:37.801520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.117 [2024-11-26 19:18:37.801536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.117 qpair failed and we were unable to recover it. 00:32:21.117 [2024-11-26 19:18:37.801609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.117 [2024-11-26 19:18:37.801746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.117 [2024-11-26 19:18:37.801762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.117 qpair failed and we were unable to recover it. 00:32:21.117 [2024-11-26 19:18:37.801942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.117 [2024-11-26 19:18:37.802022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.117 [2024-11-26 19:18:37.802037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.117 qpair failed and we were unable to recover it. 00:32:21.117 [2024-11-26 19:18:37.802127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.117 [2024-11-26 19:18:37.802201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.117 [2024-11-26 19:18:37.802217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.117 qpair failed and we were unable to recover it. 00:32:21.117 [2024-11-26 19:18:37.802372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.117 [2024-11-26 19:18:37.802543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.117 [2024-11-26 19:18:37.802559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.117 qpair failed and we were unable to recover it. 00:32:21.117 [2024-11-26 19:18:37.802794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.117 [2024-11-26 19:18:37.803000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.118 [2024-11-26 19:18:37.803017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.118 qpair failed and we were unable to recover it. 00:32:21.118 [2024-11-26 19:18:37.803100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.118 [2024-11-26 19:18:37.803344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.118 [2024-11-26 19:18:37.803360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.118 qpair failed and we were unable to recover it. 00:32:21.118 [2024-11-26 19:18:37.803515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.118 [2024-11-26 19:18:37.803666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.118 [2024-11-26 19:18:37.803682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.118 qpair failed and we were unable to recover it. 00:32:21.118 [2024-11-26 19:18:37.803755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.118 [2024-11-26 19:18:37.803923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.118 [2024-11-26 19:18:37.803938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.118 qpair failed and we were unable to recover it. 00:32:21.118 [2024-11-26 19:18:37.804079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.118 [2024-11-26 19:18:37.804218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.118 [2024-11-26 19:18:37.804233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.118 qpair failed and we were unable to recover it. 00:32:21.118 [2024-11-26 19:18:37.804402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.118 [2024-11-26 19:18:37.804540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.118 [2024-11-26 19:18:37.804555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.118 qpair failed and we were unable to recover it. 00:32:21.118 [2024-11-26 19:18:37.804631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.118 [2024-11-26 19:18:37.804775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.118 [2024-11-26 19:18:37.804790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.118 qpair failed and we were unable to recover it. 00:32:21.118 [2024-11-26 19:18:37.804994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.118 [2024-11-26 19:18:37.805199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.118 [2024-11-26 19:18:37.805215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.118 qpair failed and we were unable to recover it. 00:32:21.118 [2024-11-26 19:18:37.805365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.118 [2024-11-26 19:18:37.805540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.118 [2024-11-26 19:18:37.805555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.118 qpair failed and we were unable to recover it. 00:32:21.118 [2024-11-26 19:18:37.805637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.118 [2024-11-26 19:18:37.805792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.118 [2024-11-26 19:18:37.805807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.118 qpair failed and we were unable to recover it. 00:32:21.118 [2024-11-26 19:18:37.805904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.118 [2024-11-26 19:18:37.806005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.118 [2024-11-26 19:18:37.806023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.118 qpair failed and we were unable to recover it. 00:32:21.118 [2024-11-26 19:18:37.806111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.118 [2024-11-26 19:18:37.806251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.118 [2024-11-26 19:18:37.806267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.118 qpair failed and we were unable to recover it. 00:32:21.118 [2024-11-26 19:18:37.806360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.118 [2024-11-26 19:18:37.806508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.118 [2024-11-26 19:18:37.806524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.118 qpair failed and we were unable to recover it. 00:32:21.118 [2024-11-26 19:18:37.806662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.118 [2024-11-26 19:18:37.806806] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:32:21.118 [2024-11-26 19:18:37.806827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.118 [2024-11-26 19:18:37.806842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.118 qpair failed and we were unable to recover it. 00:32:21.118 [2024-11-26 19:18:37.806996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.118 [2024-11-26 19:18:37.807147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.118 [2024-11-26 19:18:37.807162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.118 qpair failed and we were unable to recover it. 00:32:21.118 [2024-11-26 19:18:37.807315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.118 [2024-11-26 19:18:37.807388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.118 [2024-11-26 19:18:37.807404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.118 qpair failed and we were unable to recover it. 00:32:21.118 [2024-11-26 19:18:37.807541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.118 [2024-11-26 19:18:37.807613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.118 [2024-11-26 19:18:37.807629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.118 qpair failed and we were unable to recover it. 00:32:21.118 [2024-11-26 19:18:37.807782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.118 [2024-11-26 19:18:37.808000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.118 [2024-11-26 19:18:37.808016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.119 qpair failed and we were unable to recover it. 00:32:21.119 [2024-11-26 19:18:37.808166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.119 [2024-11-26 19:18:37.808235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.119 [2024-11-26 19:18:37.808251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.119 qpair failed and we were unable to recover it. 00:32:21.119 [2024-11-26 19:18:37.808401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.119 [2024-11-26 19:18:37.808553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.119 [2024-11-26 19:18:37.808569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.119 qpair failed and we were unable to recover it. 00:32:21.119 [2024-11-26 19:18:37.808714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.119 [2024-11-26 19:18:37.808788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.119 [2024-11-26 19:18:37.808804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.119 qpair failed and we were unable to recover it. 00:32:21.119 [2024-11-26 19:18:37.809025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.119 [2024-11-26 19:18:37.809201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.119 [2024-11-26 19:18:37.809217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.119 qpair failed and we were unable to recover it. 00:32:21.119 [2024-11-26 19:18:37.809307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.119 [2024-11-26 19:18:37.809381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.119 [2024-11-26 19:18:37.809397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.119 qpair failed and we were unable to recover it. 00:32:21.119 [2024-11-26 19:18:37.809499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.119 [2024-11-26 19:18:37.809669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.119 [2024-11-26 19:18:37.809684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.119 qpair failed and we were unable to recover it. 00:32:21.119 [2024-11-26 19:18:37.809836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.119 [2024-11-26 19:18:37.810037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.119 [2024-11-26 19:18:37.810054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.119 qpair failed and we were unable to recover it. 00:32:21.119 [2024-11-26 19:18:37.810201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.119 [2024-11-26 19:18:37.810289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.119 [2024-11-26 19:18:37.810305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.119 qpair failed and we were unable to recover it. 00:32:21.119 [2024-11-26 19:18:37.810454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.119 [2024-11-26 19:18:37.810611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.119 [2024-11-26 19:18:37.810627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.119 qpair failed and we were unable to recover it. 00:32:21.119 [2024-11-26 19:18:37.810713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.119 [2024-11-26 19:18:37.810802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.119 [2024-11-26 19:18:37.810818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.119 qpair failed and we were unable to recover it. 00:32:21.119 [2024-11-26 19:18:37.810886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.119 [2024-11-26 19:18:37.811113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.119 [2024-11-26 19:18:37.811130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.119 qpair failed and we were unable to recover it. 00:32:21.119 [2024-11-26 19:18:37.811338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.119 [2024-11-26 19:18:37.811431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.119 [2024-11-26 19:18:37.811446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.119 qpair failed and we were unable to recover it. 00:32:21.119 [2024-11-26 19:18:37.811534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.119 [2024-11-26 19:18:37.811626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.119 [2024-11-26 19:18:37.811642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.119 qpair failed and we were unable to recover it. 00:32:21.119 [2024-11-26 19:18:37.811795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.119 [2024-11-26 19:18:37.811976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.119 [2024-11-26 19:18:37.811994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.119 qpair failed and we were unable to recover it. 00:32:21.119 [2024-11-26 19:18:37.812097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.119 [2024-11-26 19:18:37.812263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.119 [2024-11-26 19:18:37.812279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.119 qpair failed and we were unable to recover it. 00:32:21.119 [2024-11-26 19:18:37.812362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.119 [2024-11-26 19:18:37.812433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.119 [2024-11-26 19:18:37.812449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.119 qpair failed and we were unable to recover it. 00:32:21.119 [2024-11-26 19:18:37.812589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.119 [2024-11-26 19:18:37.812683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.119 [2024-11-26 19:18:37.812699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.119 qpair failed and we were unable to recover it. 00:32:21.119 [2024-11-26 19:18:37.812771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.119 [2024-11-26 19:18:37.812912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.119 [2024-11-26 19:18:37.812934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.119 qpair failed and we were unable to recover it. 00:32:21.119 [2024-11-26 19:18:37.813084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.119 [2024-11-26 19:18:37.813231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.119 [2024-11-26 19:18:37.813247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.119 qpair failed and we were unable to recover it. 00:32:21.119 [2024-11-26 19:18:37.813454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.119 [2024-11-26 19:18:37.813543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.119 [2024-11-26 19:18:37.813559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.119 qpair failed and we were unable to recover it. 00:32:21.119 [2024-11-26 19:18:37.813715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.119 [2024-11-26 19:18:37.813855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.119 [2024-11-26 19:18:37.813871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.119 qpair failed and we were unable to recover it. 00:32:21.119 [2024-11-26 19:18:37.814013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.119 [2024-11-26 19:18:37.814086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.119 [2024-11-26 19:18:37.814101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.119 qpair failed and we were unable to recover it. 00:32:21.119 [2024-11-26 19:18:37.814267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.120 [2024-11-26 19:18:37.814425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.120 [2024-11-26 19:18:37.814442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.120 qpair failed and we were unable to recover it. 00:32:21.120 [2024-11-26 19:18:37.814518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.120 [2024-11-26 19:18:37.814602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.120 [2024-11-26 19:18:37.814619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.120 qpair failed and we were unable to recover it. 00:32:21.120 [2024-11-26 19:18:37.814714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.120 [2024-11-26 19:18:37.814896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.120 [2024-11-26 19:18:37.814912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.120 qpair failed and we were unable to recover it. 00:32:21.120 [2024-11-26 19:18:37.815053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.120 [2024-11-26 19:18:37.815193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.120 [2024-11-26 19:18:37.815208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.120 qpair failed and we were unable to recover it. 00:32:21.120 [2024-11-26 19:18:37.815365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.120 [2024-11-26 19:18:37.815515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.120 [2024-11-26 19:18:37.815531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.120 qpair failed and we were unable to recover it. 00:32:21.120 [2024-11-26 19:18:37.815764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.120 [2024-11-26 19:18:37.815914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.120 [2024-11-26 19:18:37.815931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.120 qpair failed and we were unable to recover it. 00:32:21.120 [2024-11-26 19:18:37.816097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.120 [2024-11-26 19:18:37.816271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.120 [2024-11-26 19:18:37.816287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.120 qpair failed and we were unable to recover it. 00:32:21.120 [2024-11-26 19:18:37.816383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.120 [2024-11-26 19:18:37.816523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.120 [2024-11-26 19:18:37.816539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.120 qpair failed and we were unable to recover it. 00:32:21.120 [2024-11-26 19:18:37.816629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.120 [2024-11-26 19:18:37.816695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.120 [2024-11-26 19:18:37.816710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.120 qpair failed and we were unable to recover it. 00:32:21.120 [2024-11-26 19:18:37.816811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.120 [2024-11-26 19:18:37.816989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.120 [2024-11-26 19:18:37.817004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.120 qpair failed and we were unable to recover it. 00:32:21.120 [2024-11-26 19:18:37.817151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.120 [2024-11-26 19:18:37.817351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.120 [2024-11-26 19:18:37.817366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.120 qpair failed and we were unable to recover it. 00:32:21.120 [2024-11-26 19:18:37.817448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.120 [2024-11-26 19:18:37.817536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.120 [2024-11-26 19:18:37.817552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.120 qpair failed and we were unable to recover it. 00:32:21.120 [2024-11-26 19:18:37.817710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.120 [2024-11-26 19:18:37.817797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.120 [2024-11-26 19:18:37.817812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.120 qpair failed and we were unable to recover it. 00:32:21.120 [2024-11-26 19:18:37.817902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.120 [2024-11-26 19:18:37.818004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.120 [2024-11-26 19:18:37.818021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.120 qpair failed and we were unable to recover it. 00:32:21.120 [2024-11-26 19:18:37.818121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.120 [2024-11-26 19:18:37.818213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.120 [2024-11-26 19:18:37.818229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.120 qpair failed and we were unable to recover it. 00:32:21.120 [2024-11-26 19:18:37.818310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.120 [2024-11-26 19:18:37.818446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.120 [2024-11-26 19:18:37.818461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.120 qpair failed and we were unable to recover it. 00:32:21.120 [2024-11-26 19:18:37.818557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.120 [2024-11-26 19:18:37.818653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.120 [2024-11-26 19:18:37.818668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.120 qpair failed and we were unable to recover it. 00:32:21.120 [2024-11-26 19:18:37.818748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.120 [2024-11-26 19:18:37.818895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.120 [2024-11-26 19:18:37.818910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.120 qpair failed and we were unable to recover it. 00:32:21.120 [2024-11-26 19:18:37.819064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.120 [2024-11-26 19:18:37.819143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.120 [2024-11-26 19:18:37.819158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.120 qpair failed and we were unable to recover it. 00:32:21.120 [2024-11-26 19:18:37.819327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.120 [2024-11-26 19:18:37.819483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.120 [2024-11-26 19:18:37.819499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.120 qpair failed and we were unable to recover it. 00:32:21.120 [2024-11-26 19:18:37.819569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.120 [2024-11-26 19:18:37.819653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.120 [2024-11-26 19:18:37.819668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.120 qpair failed and we were unable to recover it. 00:32:21.120 [2024-11-26 19:18:37.819832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.120 [2024-11-26 19:18:37.819912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.120 [2024-11-26 19:18:37.819927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.120 qpair failed and we were unable to recover it. 00:32:21.120 [2024-11-26 19:18:37.820003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.120 [2024-11-26 19:18:37.820155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.120 [2024-11-26 19:18:37.820171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.120 qpair failed and we were unable to recover it. 00:32:21.120 [2024-11-26 19:18:37.820305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.120 [2024-11-26 19:18:37.820512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.120 [2024-11-26 19:18:37.820528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.120 qpair failed and we were unable to recover it. 00:32:21.121 [2024-11-26 19:18:37.820613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.121 [2024-11-26 19:18:37.820758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.121 [2024-11-26 19:18:37.820774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.121 qpair failed and we were unable to recover it. 00:32:21.121 [2024-11-26 19:18:37.820856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.121 [2024-11-26 19:18:37.820941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.121 [2024-11-26 19:18:37.820961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.121 qpair failed and we were unable to recover it. 00:32:21.121 [2024-11-26 19:18:37.821050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.121 [2024-11-26 19:18:37.821203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.121 [2024-11-26 19:18:37.821220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.121 qpair failed and we were unable to recover it. 00:32:21.121 [2024-11-26 19:18:37.821363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.121 [2024-11-26 19:18:37.821446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.121 [2024-11-26 19:18:37.821462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.121 qpair failed and we were unable to recover it. 00:32:21.121 [2024-11-26 19:18:37.821561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.121 [2024-11-26 19:18:37.821714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.121 [2024-11-26 19:18:37.821730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.121 qpair failed and we were unable to recover it. 00:32:21.121 [2024-11-26 19:18:37.821817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.121 [2024-11-26 19:18:37.821910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.121 [2024-11-26 19:18:37.821926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.121 qpair failed and we were unable to recover it. 00:32:21.121 [2024-11-26 19:18:37.822020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.121 [2024-11-26 19:18:37.822123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.121 [2024-11-26 19:18:37.822138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.121 qpair failed and we were unable to recover it. 00:32:21.121 [2024-11-26 19:18:37.822375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.121 [2024-11-26 19:18:37.822454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.121 [2024-11-26 19:18:37.822469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.121 qpair failed and we were unable to recover it. 00:32:21.121 [2024-11-26 19:18:37.822606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.121 [2024-11-26 19:18:37.822770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.121 [2024-11-26 19:18:37.822786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.121 qpair failed and we were unable to recover it. 00:32:21.121 [2024-11-26 19:18:37.822940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.121 [2024-11-26 19:18:37.823103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.121 [2024-11-26 19:18:37.823119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.121 qpair failed and we were unable to recover it. 00:32:21.121 [2024-11-26 19:18:37.823196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.121 [2024-11-26 19:18:37.823369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.121 [2024-11-26 19:18:37.823385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.121 qpair failed and we were unable to recover it. 00:32:21.121 [2024-11-26 19:18:37.823471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.121 [2024-11-26 19:18:37.823609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.121 [2024-11-26 19:18:37.823625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.121 qpair failed and we were unable to recover it. 00:32:21.121 [2024-11-26 19:18:37.823705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.121 [2024-11-26 19:18:37.823872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.121 [2024-11-26 19:18:37.823887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.121 qpair failed and we were unable to recover it. 00:32:21.121 [2024-11-26 19:18:37.824096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.121 [2024-11-26 19:18:37.824238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.121 [2024-11-26 19:18:37.824254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.121 qpair failed and we were unable to recover it. 00:32:21.121 [2024-11-26 19:18:37.824354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.121 [2024-11-26 19:18:37.824499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.121 [2024-11-26 19:18:37.824515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.121 qpair failed and we were unable to recover it. 00:32:21.121 [2024-11-26 19:18:37.824600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.121 [2024-11-26 19:18:37.824691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.121 [2024-11-26 19:18:37.824707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.121 qpair failed and we were unable to recover it. 00:32:21.121 [2024-11-26 19:18:37.824794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.121 [2024-11-26 19:18:37.824943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.121 [2024-11-26 19:18:37.824964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.121 qpair failed and we were unable to recover it. 00:32:21.121 [2024-11-26 19:18:37.825048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.121 [2024-11-26 19:18:37.825257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.121 [2024-11-26 19:18:37.825273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.121 qpair failed and we were unable to recover it. 00:32:21.121 [2024-11-26 19:18:37.825426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.121 [2024-11-26 19:18:37.825492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.121 [2024-11-26 19:18:37.825511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.121 qpair failed and we were unable to recover it. 00:32:21.121 [2024-11-26 19:18:37.825595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.121 [2024-11-26 19:18:37.825679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.121 [2024-11-26 19:18:37.825694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.121 qpair failed and we were unable to recover it. 00:32:21.121 [2024-11-26 19:18:37.825762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.121 [2024-11-26 19:18:37.825900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.121 [2024-11-26 19:18:37.825915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.121 qpair failed and we were unable to recover it. 00:32:21.121 [2024-11-26 19:18:37.825986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.121 [2024-11-26 19:18:37.826122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.121 [2024-11-26 19:18:37.826142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.121 qpair failed and we were unable to recover it. 00:32:21.121 [2024-11-26 19:18:37.826221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.121 [2024-11-26 19:18:37.826301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.121 [2024-11-26 19:18:37.826325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.121 qpair failed and we were unable to recover it. 00:32:21.121 [2024-11-26 19:18:37.826476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.122 [2024-11-26 19:18:37.826576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.122 [2024-11-26 19:18:37.826593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.122 qpair failed and we were unable to recover it. 00:32:21.122 [2024-11-26 19:18:37.826736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.122 [2024-11-26 19:18:37.826883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.122 [2024-11-26 19:18:37.826901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.122 qpair failed and we were unable to recover it. 00:32:21.122 [2024-11-26 19:18:37.827005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.122 [2024-11-26 19:18:37.827079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.122 [2024-11-26 19:18:37.827094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.122 qpair failed and we were unable to recover it. 00:32:21.122 [2024-11-26 19:18:37.827232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.122 [2024-11-26 19:18:37.827303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.122 [2024-11-26 19:18:37.827319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.122 qpair failed and we were unable to recover it. 00:32:21.122 [2024-11-26 19:18:37.827402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.122 [2024-11-26 19:18:37.827471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.122 [2024-11-26 19:18:37.827487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.122 qpair failed and we were unable to recover it. 00:32:21.122 [2024-11-26 19:18:37.827568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.122 [2024-11-26 19:18:37.827703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.122 [2024-11-26 19:18:37.827719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.122 qpair failed and we were unable to recover it. 00:32:21.122 [2024-11-26 19:18:37.827805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.122 [2024-11-26 19:18:37.827877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.122 [2024-11-26 19:18:37.827893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.122 qpair failed and we were unable to recover it. 00:32:21.122 [2024-11-26 19:18:37.828121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.122 [2024-11-26 19:18:37.828275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.122 [2024-11-26 19:18:37.828292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.122 qpair failed and we were unable to recover it. 00:32:21.122 [2024-11-26 19:18:37.828435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.122 [2024-11-26 19:18:37.828582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.122 [2024-11-26 19:18:37.828598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.122 qpair failed and we were unable to recover it. 00:32:21.122 [2024-11-26 19:18:37.828773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.122 [2024-11-26 19:18:37.828912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.122 [2024-11-26 19:18:37.828928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.122 qpair failed and we were unable to recover it. 00:32:21.122 [2024-11-26 19:18:37.829083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.122 [2024-11-26 19:18:37.829168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.122 [2024-11-26 19:18:37.829185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.122 qpair failed and we were unable to recover it. 00:32:21.122 [2024-11-26 19:18:37.829357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.122 [2024-11-26 19:18:37.829465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.122 [2024-11-26 19:18:37.829482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.122 qpair failed and we were unable to recover it. 00:32:21.122 [2024-11-26 19:18:37.829623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.122 [2024-11-26 19:18:37.829762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.122 [2024-11-26 19:18:37.829778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.122 qpair failed and we were unable to recover it. 00:32:21.122 [2024-11-26 19:18:37.829933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.122 [2024-11-26 19:18:37.830099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.122 [2024-11-26 19:18:37.830114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.122 qpair failed and we were unable to recover it. 00:32:21.122 [2024-11-26 19:18:37.830190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.122 [2024-11-26 19:18:37.830425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.122 [2024-11-26 19:18:37.830441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.122 qpair failed and we were unable to recover it. 00:32:21.122 [2024-11-26 19:18:37.830516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.122 [2024-11-26 19:18:37.830606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.122 [2024-11-26 19:18:37.830622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.122 qpair failed and we were unable to recover it. 00:32:21.122 [2024-11-26 19:18:37.830758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.122 [2024-11-26 19:18:37.830892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.122 [2024-11-26 19:18:37.830908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.122 qpair failed and we were unable to recover it. 00:32:21.122 [2024-11-26 19:18:37.831078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.122 [2024-11-26 19:18:37.831216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.122 [2024-11-26 19:18:37.831231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.122 qpair failed and we were unable to recover it. 00:32:21.122 [2024-11-26 19:18:37.831315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.122 [2024-11-26 19:18:37.831420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.122 [2024-11-26 19:18:37.831436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.122 qpair failed and we were unable to recover it. 00:32:21.122 [2024-11-26 19:18:37.831580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.122 [2024-11-26 19:18:37.831654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.122 [2024-11-26 19:18:37.831670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.122 qpair failed and we were unable to recover it. 00:32:21.122 [2024-11-26 19:18:37.831830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.122 [2024-11-26 19:18:37.831926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.122 [2024-11-26 19:18:37.831942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.122 qpair failed and we were unable to recover it. 00:32:21.122 [2024-11-26 19:18:37.832036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.122 [2024-11-26 19:18:37.832178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.122 [2024-11-26 19:18:37.832193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.122 qpair failed and we were unable to recover it. 00:32:21.122 [2024-11-26 19:18:37.832336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.122 [2024-11-26 19:18:37.832435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.122 [2024-11-26 19:18:37.832451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.123 qpair failed and we were unable to recover it. 00:32:21.123 [2024-11-26 19:18:37.832526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.123 [2024-11-26 19:18:37.832675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.123 [2024-11-26 19:18:37.832691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.123 qpair failed and we were unable to recover it. 00:32:21.123 [2024-11-26 19:18:37.832784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.123 [2024-11-26 19:18:37.832854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.123 [2024-11-26 19:18:37.832869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.123 qpair failed and we were unable to recover it. 00:32:21.123 [2024-11-26 19:18:37.832939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.123 [2024-11-26 19:18:37.833022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.123 [2024-11-26 19:18:37.833038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.123 qpair failed and we were unable to recover it. 00:32:21.123 [2024-11-26 19:18:37.833135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.123 [2024-11-26 19:18:37.833290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.123 [2024-11-26 19:18:37.833305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.123 qpair failed and we were unable to recover it. 00:32:21.123 [2024-11-26 19:18:37.833443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.123 [2024-11-26 19:18:37.833585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.123 [2024-11-26 19:18:37.833601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.123 qpair failed and we were unable to recover it. 00:32:21.123 [2024-11-26 19:18:37.833735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.123 [2024-11-26 19:18:37.833811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.123 [2024-11-26 19:18:37.833826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.123 qpair failed and we were unable to recover it. 00:32:21.123 [2024-11-26 19:18:37.833912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.123 [2024-11-26 19:18:37.834126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.123 [2024-11-26 19:18:37.834142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.123 qpair failed and we were unable to recover it. 00:32:21.123 [2024-11-26 19:18:37.834283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.123 [2024-11-26 19:18:37.834422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.123 [2024-11-26 19:18:37.834444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.123 qpair failed and we were unable to recover it. 00:32:21.123 [2024-11-26 19:18:37.834540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.123 [2024-11-26 19:18:37.834677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.123 [2024-11-26 19:18:37.834692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.123 qpair failed and we were unable to recover it. 00:32:21.123 [2024-11-26 19:18:37.834766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.123 [2024-11-26 19:18:37.834903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.123 [2024-11-26 19:18:37.834918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.123 qpair failed and we were unable to recover it. 00:32:21.123 [2024-11-26 19:18:37.835015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.123 [2024-11-26 19:18:37.835157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.123 [2024-11-26 19:18:37.835173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.123 qpair failed and we were unable to recover it. 00:32:21.123 [2024-11-26 19:18:37.835311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.123 [2024-11-26 19:18:37.835405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.123 [2024-11-26 19:18:37.835421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.123 qpair failed and we were unable to recover it. 00:32:21.123 [2024-11-26 19:18:37.835575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.123 [2024-11-26 19:18:37.835652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.123 [2024-11-26 19:18:37.835668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.123 qpair failed and we were unable to recover it. 00:32:21.123 [2024-11-26 19:18:37.835738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.123 [2024-11-26 19:18:37.835823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.123 [2024-11-26 19:18:37.835838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.123 qpair failed and we were unable to recover it. 00:32:21.123 [2024-11-26 19:18:37.835973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.123 [2024-11-26 19:18:37.836175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.123 [2024-11-26 19:18:37.836190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.123 qpair failed and we were unable to recover it. 00:32:21.123 [2024-11-26 19:18:37.836262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.123 [2024-11-26 19:18:37.836417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.123 [2024-11-26 19:18:37.836432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.123 qpair failed and we were unable to recover it. 00:32:21.123 [2024-11-26 19:18:37.836575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.123 [2024-11-26 19:18:37.836710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.123 [2024-11-26 19:18:37.836725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.123 qpair failed and we were unable to recover it. 00:32:21.123 [2024-11-26 19:18:37.836801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.123 [2024-11-26 19:18:37.836876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.123 [2024-11-26 19:18:37.836892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.123 qpair failed and we were unable to recover it. 00:32:21.123 [2024-11-26 19:18:37.837061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.123 [2024-11-26 19:18:37.837142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.123 [2024-11-26 19:18:37.837157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.123 qpair failed and we were unable to recover it. 00:32:21.123 [2024-11-26 19:18:37.837362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.123 [2024-11-26 19:18:37.837444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.123 [2024-11-26 19:18:37.837460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.123 qpair failed and we were unable to recover it. 00:32:21.123 [2024-11-26 19:18:37.837550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.123 [2024-11-26 19:18:37.837630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.123 [2024-11-26 19:18:37.837645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.123 qpair failed and we were unable to recover it. 00:32:21.123 [2024-11-26 19:18:37.837726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.123 [2024-11-26 19:18:37.837831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.123 [2024-11-26 19:18:37.837846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.123 qpair failed and we were unable to recover it. 00:32:21.124 [2024-11-26 19:18:37.838002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.124 [2024-11-26 19:18:37.838229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.124 [2024-11-26 19:18:37.838244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.124 qpair failed and we were unable to recover it. 00:32:21.124 [2024-11-26 19:18:37.838400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.124 [2024-11-26 19:18:37.838548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.124 [2024-11-26 19:18:37.838564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.124 qpair failed and we were unable to recover it. 00:32:21.124 [2024-11-26 19:18:37.838657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.124 [2024-11-26 19:18:37.838810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.124 [2024-11-26 19:18:37.838825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.124 qpair failed and we were unable to recover it. 00:32:21.124 [2024-11-26 19:18:37.838976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.124 [2024-11-26 19:18:37.839058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.124 [2024-11-26 19:18:37.839075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.124 qpair failed and we were unable to recover it. 00:32:21.124 [2024-11-26 19:18:37.839220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.124 [2024-11-26 19:18:37.839295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.124 [2024-11-26 19:18:37.839310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.124 qpair failed and we were unable to recover it. 00:32:21.124 [2024-11-26 19:18:37.839393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.124 [2024-11-26 19:18:37.839493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.124 [2024-11-26 19:18:37.839508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.124 qpair failed and we were unable to recover it. 00:32:21.124 [2024-11-26 19:18:37.839593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.124 [2024-11-26 19:18:37.839728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.124 [2024-11-26 19:18:37.839743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.124 qpair failed and we were unable to recover it. 00:32:21.124 [2024-11-26 19:18:37.839829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.124 [2024-11-26 19:18:37.839971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.124 [2024-11-26 19:18:37.839987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.124 qpair failed and we were unable to recover it. 00:32:21.124 [2024-11-26 19:18:37.840074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.124 [2024-11-26 19:18:37.840274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.124 [2024-11-26 19:18:37.840289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.124 qpair failed and we were unable to recover it. 00:32:21.124 [2024-11-26 19:18:37.840369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.124 [2024-11-26 19:18:37.840523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.124 [2024-11-26 19:18:37.840539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.124 qpair failed and we were unable to recover it. 00:32:21.124 [2024-11-26 19:18:37.840625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.124 [2024-11-26 19:18:37.840724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.124 [2024-11-26 19:18:37.840739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.124 qpair failed and we were unable to recover it. 00:32:21.124 [2024-11-26 19:18:37.840811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.124 [2024-11-26 19:18:37.840900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.124 [2024-11-26 19:18:37.840916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.124 qpair failed and we were unable to recover it. 00:32:21.124 [2024-11-26 19:18:37.840999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.124 [2024-11-26 19:18:37.841143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.124 [2024-11-26 19:18:37.841159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.124 qpair failed and we were unable to recover it. 00:32:21.124 [2024-11-26 19:18:37.841336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.124 [2024-11-26 19:18:37.841416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.124 [2024-11-26 19:18:37.841431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.124 qpair failed and we were unable to recover it. 00:32:21.124 [2024-11-26 19:18:37.841502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.124 [2024-11-26 19:18:37.841662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.124 [2024-11-26 19:18:37.841677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.124 qpair failed and we were unable to recover it. 00:32:21.124 [2024-11-26 19:18:37.841784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.124 [2024-11-26 19:18:37.841858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.124 [2024-11-26 19:18:37.841873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.124 qpair failed and we were unable to recover it. 00:32:21.124 [2024-11-26 19:18:37.841956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.124 [2024-11-26 19:18:37.842044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.124 [2024-11-26 19:18:37.842060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.124 qpair failed and we were unable to recover it. 00:32:21.124 [2024-11-26 19:18:37.842132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.124 [2024-11-26 19:18:37.842331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.124 [2024-11-26 19:18:37.842347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.124 qpair failed and we were unable to recover it. 00:32:21.124 [2024-11-26 19:18:37.842432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.124 [2024-11-26 19:18:37.842570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.125 [2024-11-26 19:18:37.842587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.125 qpair failed and we were unable to recover it. 00:32:21.125 [2024-11-26 19:18:37.842685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.125 [2024-11-26 19:18:37.842822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.125 [2024-11-26 19:18:37.842836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.125 qpair failed and we were unable to recover it. 00:32:21.125 [2024-11-26 19:18:37.842917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.125 [2024-11-26 19:18:37.842998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.125 [2024-11-26 19:18:37.843015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.125 qpair failed and we were unable to recover it. 00:32:21.125 [2024-11-26 19:18:37.843093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.125 [2024-11-26 19:18:37.843163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.125 [2024-11-26 19:18:37.843178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.125 qpair failed and we were unable to recover it. 00:32:21.125 [2024-11-26 19:18:37.843269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.125 [2024-11-26 19:18:37.843436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.125 [2024-11-26 19:18:37.843451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.125 qpair failed and we were unable to recover it. 00:32:21.125 [2024-11-26 19:18:37.843595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.125 [2024-11-26 19:18:37.843751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.125 [2024-11-26 19:18:37.843767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.125 qpair failed and we were unable to recover it. 00:32:21.125 [2024-11-26 19:18:37.843914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.125 [2024-11-26 19:18:37.844061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.125 [2024-11-26 19:18:37.844077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.125 qpair failed and we were unable to recover it. 00:32:21.125 [2024-11-26 19:18:37.844279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.125 [2024-11-26 19:18:37.844365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.125 [2024-11-26 19:18:37.844382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.125 qpair failed and we were unable to recover it. 00:32:21.125 [2024-11-26 19:18:37.844521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.125 [2024-11-26 19:18:37.844597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.125 [2024-11-26 19:18:37.844614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.125 qpair failed and we were unable to recover it. 00:32:21.125 [2024-11-26 19:18:37.844701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.125 [2024-11-26 19:18:37.844842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.125 [2024-11-26 19:18:37.844858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.125 qpair failed and we were unable to recover it. 00:32:21.125 [2024-11-26 19:18:37.845064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.125 [2024-11-26 19:18:37.845205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.125 [2024-11-26 19:18:37.845221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.125 qpair failed and we were unable to recover it. 00:32:21.125 [2024-11-26 19:18:37.845320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.125 [2024-11-26 19:18:37.845495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.125 [2024-11-26 19:18:37.845512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.125 qpair failed and we were unable to recover it. 00:32:21.125 [2024-11-26 19:18:37.845599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.125 [2024-11-26 19:18:37.845700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.125 [2024-11-26 19:18:37.845717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.125 qpair failed and we were unable to recover it. 00:32:21.125 [2024-11-26 19:18:37.845940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.125 [2024-11-26 19:18:37.846018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.125 [2024-11-26 19:18:37.846034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.125 qpair failed and we were unable to recover it. 00:32:21.125 [2024-11-26 19:18:37.846122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.125 [2024-11-26 19:18:37.846126] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:32:21.125 [2024-11-26 19:18:37.846224] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:32:21.125 [2024-11-26 19:18:37.846235] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:32:21.125 [2024-11-26 19:18:37.846243] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:32:21.125 [2024-11-26 19:18:37.846285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.125 [2024-11-26 19:18:37.846299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.125 qpair failed and we were unable to recover it. 00:32:21.125 [2024-11-26 19:18:37.846373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.125 [2024-11-26 19:18:37.846294] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:32:21.125 [2024-11-26 19:18:37.846440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.125 [2024-11-26 19:18:37.846454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.125 qpair failed and we were unable to recover it. 00:32:21.125 [2024-11-26 19:18:37.846402] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:32:21.125 [2024-11-26 19:18:37.846508] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:32:21.125 [2024-11-26 19:18:37.846535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.125 [2024-11-26 19:18:37.846510] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:32:21.125 [2024-11-26 19:18:37.846616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.125 [2024-11-26 19:18:37.846631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.125 qpair failed and we were unable to recover it. 00:32:21.125 [2024-11-26 19:18:37.846714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.125 [2024-11-26 19:18:37.846849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.125 [2024-11-26 19:18:37.846864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.125 qpair failed and we were unable to recover it. 00:32:21.125 [2024-11-26 19:18:37.847000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.125 [2024-11-26 19:18:37.847078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.125 [2024-11-26 19:18:37.847094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.125 qpair failed and we were unable to recover it. 00:32:21.125 [2024-11-26 19:18:37.847252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.125 [2024-11-26 19:18:37.847344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.125 [2024-11-26 19:18:37.847359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.125 qpair failed and we were unable to recover it. 00:32:21.125 [2024-11-26 19:18:37.847496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.125 [2024-11-26 19:18:37.847645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.125 [2024-11-26 19:18:37.847660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.125 qpair failed and we were unable to recover it. 00:32:21.125 [2024-11-26 19:18:37.847755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.125 [2024-11-26 19:18:37.847841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.126 [2024-11-26 19:18:37.847856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.126 qpair failed and we were unable to recover it. 00:32:21.126 [2024-11-26 19:18:37.847939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.126 [2024-11-26 19:18:37.848109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.126 [2024-11-26 19:18:37.848125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.126 qpair failed and we were unable to recover it. 00:32:21.126 [2024-11-26 19:18:37.848273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.126 [2024-11-26 19:18:37.848366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.126 [2024-11-26 19:18:37.848381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.126 qpair failed and we were unable to recover it. 00:32:21.126 [2024-11-26 19:18:37.848523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.126 [2024-11-26 19:18:37.848626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.126 [2024-11-26 19:18:37.848642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.126 qpair failed and we were unable to recover it. 00:32:21.126 [2024-11-26 19:18:37.848735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.126 [2024-11-26 19:18:37.848809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.126 [2024-11-26 19:18:37.848834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.126 qpair failed and we were unable to recover it. 00:32:21.126 [2024-11-26 19:18:37.848940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.126 [2024-11-26 19:18:37.849035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.126 [2024-11-26 19:18:37.849051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.126 qpair failed and we were unable to recover it. 00:32:21.126 [2024-11-26 19:18:37.849133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.126 [2024-11-26 19:18:37.849269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.126 [2024-11-26 19:18:37.849285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.126 qpair failed and we were unable to recover it. 00:32:21.126 [2024-11-26 19:18:37.849368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.126 [2024-11-26 19:18:37.849442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.126 [2024-11-26 19:18:37.849456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.126 qpair failed and we were unable to recover it. 00:32:21.126 [2024-11-26 19:18:37.849600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.126 [2024-11-26 19:18:37.849807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.126 [2024-11-26 19:18:37.849823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.126 qpair failed and we were unable to recover it. 00:32:21.126 [2024-11-26 19:18:37.849916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.126 [2024-11-26 19:18:37.850009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.126 [2024-11-26 19:18:37.850025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.126 qpair failed and we were unable to recover it. 00:32:21.126 [2024-11-26 19:18:37.850231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.126 [2024-11-26 19:18:37.850372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.126 [2024-11-26 19:18:37.850388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.126 qpair failed and we were unable to recover it. 00:32:21.126 [2024-11-26 19:18:37.850592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.126 [2024-11-26 19:18:37.850734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.126 [2024-11-26 19:18:37.850750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.126 qpair failed and we were unable to recover it. 00:32:21.126 [2024-11-26 19:18:37.850899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.126 [2024-11-26 19:18:37.850986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.126 [2024-11-26 19:18:37.851003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.126 qpair failed and we were unable to recover it. 00:32:21.126 [2024-11-26 19:18:37.851089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.126 [2024-11-26 19:18:37.851174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.126 [2024-11-26 19:18:37.851188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.126 qpair failed and we were unable to recover it. 00:32:21.126 [2024-11-26 19:18:37.851328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.126 [2024-11-26 19:18:37.851420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.126 [2024-11-26 19:18:37.851436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.126 qpair failed and we were unable to recover it. 00:32:21.126 [2024-11-26 19:18:37.851528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.126 [2024-11-26 19:18:37.851667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.126 [2024-11-26 19:18:37.851683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.126 qpair failed and we were unable to recover it. 00:32:21.126 [2024-11-26 19:18:37.851773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.126 [2024-11-26 19:18:37.851857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.126 [2024-11-26 19:18:37.851873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.126 qpair failed and we were unable to recover it. 00:32:21.126 [2024-11-26 19:18:37.851961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.126 [2024-11-26 19:18:37.852042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.126 [2024-11-26 19:18:37.852057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.126 qpair failed and we were unable to recover it. 00:32:21.126 [2024-11-26 19:18:37.852144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.126 [2024-11-26 19:18:37.852299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.126 [2024-11-26 19:18:37.852314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.126 qpair failed and we were unable to recover it. 00:32:21.126 [2024-11-26 19:18:37.852384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.126 [2024-11-26 19:18:37.852464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.126 [2024-11-26 19:18:37.852479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.126 qpair failed and we were unable to recover it. 00:32:21.126 [2024-11-26 19:18:37.852626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.126 [2024-11-26 19:18:37.852708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.126 [2024-11-26 19:18:37.852723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.126 qpair failed and we were unable to recover it. 00:32:21.126 [2024-11-26 19:18:37.852879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.126 [2024-11-26 19:18:37.852957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.126 [2024-11-26 19:18:37.852973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.126 qpair failed and we were unable to recover it. 00:32:21.126 [2024-11-26 19:18:37.853131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.127 [2024-11-26 19:18:37.853208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.127 [2024-11-26 19:18:37.853225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.127 qpair failed and we were unable to recover it. 00:32:21.127 [2024-11-26 19:18:37.853305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.127 [2024-11-26 19:18:37.853388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.127 [2024-11-26 19:18:37.853403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.127 qpair failed and we were unable to recover it. 00:32:21.127 [2024-11-26 19:18:37.853482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.127 [2024-11-26 19:18:37.853570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.127 [2024-11-26 19:18:37.853590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.127 qpair failed and we were unable to recover it. 00:32:21.127 [2024-11-26 19:18:37.853678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.127 [2024-11-26 19:18:37.853754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.127 [2024-11-26 19:18:37.853771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.127 qpair failed and we were unable to recover it. 00:32:21.127 [2024-11-26 19:18:37.853958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.127 [2024-11-26 19:18:37.854103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.127 [2024-11-26 19:18:37.854118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.127 qpair failed and we were unable to recover it. 00:32:21.127 [2024-11-26 19:18:37.854210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.127 [2024-11-26 19:18:37.854293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.127 [2024-11-26 19:18:37.854310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.127 qpair failed and we were unable to recover it. 00:32:21.127 [2024-11-26 19:18:37.854384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.127 [2024-11-26 19:18:37.854571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.127 [2024-11-26 19:18:37.854589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.127 qpair failed and we were unable to recover it. 00:32:21.127 [2024-11-26 19:18:37.854660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.127 [2024-11-26 19:18:37.854805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.127 [2024-11-26 19:18:37.854821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.127 qpair failed and we were unable to recover it. 00:32:21.127 [2024-11-26 19:18:37.854902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.127 [2024-11-26 19:18:37.854970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.127 [2024-11-26 19:18:37.854986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.127 qpair failed and we were unable to recover it. 00:32:21.127 [2024-11-26 19:18:37.855124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.127 [2024-11-26 19:18:37.855204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.127 [2024-11-26 19:18:37.855220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.127 qpair failed and we were unable to recover it. 00:32:21.127 [2024-11-26 19:18:37.855358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.127 [2024-11-26 19:18:37.855512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.127 [2024-11-26 19:18:37.855529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.127 qpair failed and we were unable to recover it. 00:32:21.127 [2024-11-26 19:18:37.855734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.127 [2024-11-26 19:18:37.855903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.127 [2024-11-26 19:18:37.855920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.127 qpair failed and we were unable to recover it. 00:32:21.127 [2024-11-26 19:18:37.856038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.127 [2024-11-26 19:18:37.856189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.127 [2024-11-26 19:18:37.856210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.127 qpair failed and we were unable to recover it. 00:32:21.127 [2024-11-26 19:18:37.856303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.127 [2024-11-26 19:18:37.856476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.127 [2024-11-26 19:18:37.856491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.127 qpair failed and we were unable to recover it. 00:32:21.127 [2024-11-26 19:18:37.856576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.127 [2024-11-26 19:18:37.856743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.127 [2024-11-26 19:18:37.856758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.127 qpair failed and we were unable to recover it. 00:32:21.127 [2024-11-26 19:18:37.856902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.127 [2024-11-26 19:18:37.857007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.127 [2024-11-26 19:18:37.857023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.127 qpair failed and we were unable to recover it. 00:32:21.127 [2024-11-26 19:18:37.857100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.127 [2024-11-26 19:18:37.857188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.127 [2024-11-26 19:18:37.857203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.127 qpair failed and we were unable to recover it. 00:32:21.127 [2024-11-26 19:18:37.857362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.127 [2024-11-26 19:18:37.857457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.127 [2024-11-26 19:18:37.857473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.127 qpair failed and we were unable to recover it. 00:32:21.127 [2024-11-26 19:18:37.857563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.127 [2024-11-26 19:18:37.857699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.127 [2024-11-26 19:18:37.857715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.127 qpair failed and we were unable to recover it. 00:32:21.127 [2024-11-26 19:18:37.857853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.127 [2024-11-26 19:18:37.857946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.127 [2024-11-26 19:18:37.857977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.127 qpair failed and we were unable to recover it. 00:32:21.127 [2024-11-26 19:18:37.858053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.127 [2024-11-26 19:18:37.858216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.127 [2024-11-26 19:18:37.858232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.127 qpair failed and we were unable to recover it. 00:32:21.127 [2024-11-26 19:18:37.858455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.127 [2024-11-26 19:18:37.858626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.128 [2024-11-26 19:18:37.858641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.128 qpair failed and we were unable to recover it. 00:32:21.128 [2024-11-26 19:18:37.858788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.128 [2024-11-26 19:18:37.858876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.128 [2024-11-26 19:18:37.858896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.128 qpair failed and we were unable to recover it. 00:32:21.128 [2024-11-26 19:18:37.859039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.128 [2024-11-26 19:18:37.859119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.128 [2024-11-26 19:18:37.859135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.128 qpair failed and we were unable to recover it. 00:32:21.128 [2024-11-26 19:18:37.859279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.128 [2024-11-26 19:18:37.859367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.128 [2024-11-26 19:18:37.859382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.128 qpair failed and we were unable to recover it. 00:32:21.128 [2024-11-26 19:18:37.859470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.128 [2024-11-26 19:18:37.859610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.128 [2024-11-26 19:18:37.859625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.128 qpair failed and we were unable to recover it. 00:32:21.128 [2024-11-26 19:18:37.859768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.128 [2024-11-26 19:18:37.859903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.128 [2024-11-26 19:18:37.859919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.128 qpair failed and we were unable to recover it. 00:32:21.128 [2024-11-26 19:18:37.860072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.128 [2024-11-26 19:18:37.860142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.128 [2024-11-26 19:18:37.860156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.128 qpair failed and we were unable to recover it. 00:32:21.128 [2024-11-26 19:18:37.860309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.128 [2024-11-26 19:18:37.860475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.128 [2024-11-26 19:18:37.860492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.128 qpair failed and we were unable to recover it. 00:32:21.128 [2024-11-26 19:18:37.860578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.128 [2024-11-26 19:18:37.860646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.128 [2024-11-26 19:18:37.860661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.128 qpair failed and we were unable to recover it. 00:32:21.128 [2024-11-26 19:18:37.860808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.128 [2024-11-26 19:18:37.860883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.128 [2024-11-26 19:18:37.860898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.128 qpair failed and we were unable to recover it. 00:32:21.128 [2024-11-26 19:18:37.861045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.128 [2024-11-26 19:18:37.861131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.128 [2024-11-26 19:18:37.861146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.128 qpair failed and we were unable to recover it. 00:32:21.128 [2024-11-26 19:18:37.861237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.128 [2024-11-26 19:18:37.861386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.128 [2024-11-26 19:18:37.861401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.128 qpair failed and we were unable to recover it. 00:32:21.128 [2024-11-26 19:18:37.861495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.128 [2024-11-26 19:18:37.861637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.128 [2024-11-26 19:18:37.861653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.128 qpair failed and we were unable to recover it. 00:32:21.128 [2024-11-26 19:18:37.861815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.128 [2024-11-26 19:18:37.861956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.128 [2024-11-26 19:18:37.861973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.128 qpair failed and we were unable to recover it. 00:32:21.128 [2024-11-26 19:18:37.862126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.128 [2024-11-26 19:18:37.862254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.128 [2024-11-26 19:18:37.862270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.128 qpair failed and we were unable to recover it. 00:32:21.128 [2024-11-26 19:18:37.862410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.128 [2024-11-26 19:18:37.862493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.128 [2024-11-26 19:18:37.862505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.128 qpair failed and we were unable to recover it. 00:32:21.128 [2024-11-26 19:18:37.862678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.128 [2024-11-26 19:18:37.862804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.128 [2024-11-26 19:18:37.862816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.128 qpair failed and we were unable to recover it. 00:32:21.128 [2024-11-26 19:18:37.862955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.128 [2024-11-26 19:18:37.863040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.128 [2024-11-26 19:18:37.863053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.128 qpair failed and we were unable to recover it. 00:32:21.128 [2024-11-26 19:18:37.863188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.128 [2024-11-26 19:18:37.863244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.128 [2024-11-26 19:18:37.863255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.128 qpair failed and we were unable to recover it. 00:32:21.128 [2024-11-26 19:18:37.863349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.128 [2024-11-26 19:18:37.863526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.128 [2024-11-26 19:18:37.863538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.128 qpair failed and we were unable to recover it. 00:32:21.128 [2024-11-26 19:18:37.863692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.128 [2024-11-26 19:18:37.863769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.128 [2024-11-26 19:18:37.863781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.128 qpair failed and we were unable to recover it. 00:32:21.128 [2024-11-26 19:18:37.863870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.128 [2024-11-26 19:18:37.863961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.128 [2024-11-26 19:18:37.863973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.128 qpair failed and we were unable to recover it. 00:32:21.128 [2024-11-26 19:18:37.864060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.128 [2024-11-26 19:18:37.864123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.128 [2024-11-26 19:18:37.864135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.129 qpair failed and we were unable to recover it. 00:32:21.129 [2024-11-26 19:18:37.864265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.129 [2024-11-26 19:18:37.864343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.129 [2024-11-26 19:18:37.864355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.129 qpair failed and we were unable to recover it. 00:32:21.129 [2024-11-26 19:18:37.864421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.129 [2024-11-26 19:18:37.864493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.129 [2024-11-26 19:18:37.864505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.129 qpair failed and we were unable to recover it. 00:32:21.129 [2024-11-26 19:18:37.864665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.129 [2024-11-26 19:18:37.864750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.129 [2024-11-26 19:18:37.864762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.129 qpair failed and we were unable to recover it. 00:32:21.129 [2024-11-26 19:18:37.864840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.129 [2024-11-26 19:18:37.865017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.129 [2024-11-26 19:18:37.865030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.129 qpair failed and we were unable to recover it. 00:32:21.129 [2024-11-26 19:18:37.865113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.129 [2024-11-26 19:18:37.865256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.129 [2024-11-26 19:18:37.865268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.129 qpair failed and we were unable to recover it. 00:32:21.129 [2024-11-26 19:18:37.865417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.129 [2024-11-26 19:18:37.865551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.129 [2024-11-26 19:18:37.865563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.129 qpair failed and we were unable to recover it. 00:32:21.129 [2024-11-26 19:18:37.865627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.129 [2024-11-26 19:18:37.865755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.129 [2024-11-26 19:18:37.865767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.129 qpair failed and we were unable to recover it. 00:32:21.129 [2024-11-26 19:18:37.865843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.129 [2024-11-26 19:18:37.865920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.129 [2024-11-26 19:18:37.865932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.129 qpair failed and we were unable to recover it. 00:32:21.129 [2024-11-26 19:18:37.865999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.129 [2024-11-26 19:18:37.866133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.129 [2024-11-26 19:18:37.866145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.129 qpair failed and we were unable to recover it. 00:32:21.129 [2024-11-26 19:18:37.866229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.129 [2024-11-26 19:18:37.866344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.129 [2024-11-26 19:18:37.866356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.129 qpair failed and we were unable to recover it. 00:32:21.129 [2024-11-26 19:18:37.866488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.129 [2024-11-26 19:18:37.866555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.129 [2024-11-26 19:18:37.866567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.129 qpair failed and we were unable to recover it. 00:32:21.129 [2024-11-26 19:18:37.866652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.129 [2024-11-26 19:18:37.866849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.129 [2024-11-26 19:18:37.866863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.129 qpair failed and we were unable to recover it. 00:32:21.129 [2024-11-26 19:18:37.867017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.129 [2024-11-26 19:18:37.867159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.129 [2024-11-26 19:18:37.867172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.129 qpair failed and we were unable to recover it. 00:32:21.129 [2024-11-26 19:18:37.867255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.129 [2024-11-26 19:18:37.867329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.129 [2024-11-26 19:18:37.867341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.129 qpair failed and we were unable to recover it. 00:32:21.129 [2024-11-26 19:18:37.867423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.129 [2024-11-26 19:18:37.867491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.129 [2024-11-26 19:18:37.867504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.129 qpair failed and we were unable to recover it. 00:32:21.129 [2024-11-26 19:18:37.867649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.129 [2024-11-26 19:18:37.867791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.129 [2024-11-26 19:18:37.867804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.129 qpair failed and we were unable to recover it. 00:32:21.129 [2024-11-26 19:18:37.868008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.129 [2024-11-26 19:18:37.868140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.129 [2024-11-26 19:18:37.868154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.129 qpair failed and we were unable to recover it. 00:32:21.129 [2024-11-26 19:18:37.868219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.129 [2024-11-26 19:18:37.868279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.129 [2024-11-26 19:18:37.868291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.129 qpair failed and we were unable to recover it. 00:32:21.129 [2024-11-26 19:18:37.868367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.129 [2024-11-26 19:18:37.868442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.129 [2024-11-26 19:18:37.868455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.129 qpair failed and we were unable to recover it. 00:32:21.129 [2024-11-26 19:18:37.868538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.129 [2024-11-26 19:18:37.868607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.129 [2024-11-26 19:18:37.868619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.129 qpair failed and we were unable to recover it. 00:32:21.129 [2024-11-26 19:18:37.868778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.129 [2024-11-26 19:18:37.868966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.129 [2024-11-26 19:18:37.868979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.129 qpair failed and we were unable to recover it. 00:32:21.129 [2024-11-26 19:18:37.869097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.129 [2024-11-26 19:18:37.869228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.129 [2024-11-26 19:18:37.869242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.129 qpair failed and we were unable to recover it. 00:32:21.129 [2024-11-26 19:18:37.869316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.129 [2024-11-26 19:18:37.869510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.129 [2024-11-26 19:18:37.869523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.130 qpair failed and we were unable to recover it. 00:32:21.130 [2024-11-26 19:18:37.869722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.130 [2024-11-26 19:18:37.869951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.130 [2024-11-26 19:18:37.869965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.130 qpair failed and we were unable to recover it. 00:32:21.130 [2024-11-26 19:18:37.870101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.130 [2024-11-26 19:18:37.870258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.130 [2024-11-26 19:18:37.870271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.130 qpair failed and we were unable to recover it. 00:32:21.130 [2024-11-26 19:18:37.870334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.130 [2024-11-26 19:18:37.870432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.130 [2024-11-26 19:18:37.870445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.130 qpair failed and we were unable to recover it. 00:32:21.130 [2024-11-26 19:18:37.870527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.130 [2024-11-26 19:18:37.870669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.130 [2024-11-26 19:18:37.870682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.130 qpair failed and we were unable to recover it. 00:32:21.130 [2024-11-26 19:18:37.870828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.130 [2024-11-26 19:18:37.870959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.130 [2024-11-26 19:18:37.870971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.130 qpair failed and we were unable to recover it. 00:32:21.130 [2024-11-26 19:18:37.871052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.130 [2024-11-26 19:18:37.871243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.130 [2024-11-26 19:18:37.871255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.130 qpair failed and we were unable to recover it. 00:32:21.130 [2024-11-26 19:18:37.871333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.130 [2024-11-26 19:18:37.871480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.130 [2024-11-26 19:18:37.871493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.130 qpair failed and we were unable to recover it. 00:32:21.130 [2024-11-26 19:18:37.871565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.130 [2024-11-26 19:18:37.871655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.130 [2024-11-26 19:18:37.871668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.130 qpair failed and we were unable to recover it. 00:32:21.130 [2024-11-26 19:18:37.871758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.130 [2024-11-26 19:18:37.871824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.130 [2024-11-26 19:18:37.871836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.130 qpair failed and we were unable to recover it. 00:32:21.130 [2024-11-26 19:18:37.871906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.130 [2024-11-26 19:18:37.871994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.130 [2024-11-26 19:18:37.872007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.130 qpair failed and we were unable to recover it. 00:32:21.130 [2024-11-26 19:18:37.872078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.130 [2024-11-26 19:18:37.872144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.130 [2024-11-26 19:18:37.872158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.130 qpair failed and we were unable to recover it. 00:32:21.130 [2024-11-26 19:18:37.872234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.130 [2024-11-26 19:18:37.872364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.130 [2024-11-26 19:18:37.872376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.130 qpair failed and we were unable to recover it. 00:32:21.130 [2024-11-26 19:18:37.872442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.130 [2024-11-26 19:18:37.872515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.130 [2024-11-26 19:18:37.872526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.130 qpair failed and we were unable to recover it. 00:32:21.130 [2024-11-26 19:18:37.872657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.130 [2024-11-26 19:18:37.872729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.130 [2024-11-26 19:18:37.872740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.130 qpair failed and we were unable to recover it. 00:32:21.130 [2024-11-26 19:18:37.872833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.130 [2024-11-26 19:18:37.872905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.130 [2024-11-26 19:18:37.872918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.130 qpair failed and we were unable to recover it. 00:32:21.130 [2024-11-26 19:18:37.872997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.130 [2024-11-26 19:18:37.873059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.130 [2024-11-26 19:18:37.873072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.130 qpair failed and we were unable to recover it. 00:32:21.130 [2024-11-26 19:18:37.873151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.130 [2024-11-26 19:18:37.873227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.130 [2024-11-26 19:18:37.873239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.130 qpair failed and we were unable to recover it. 00:32:21.130 [2024-11-26 19:18:37.873300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.130 [2024-11-26 19:18:37.873368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.130 [2024-11-26 19:18:37.873380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.130 qpair failed and we were unable to recover it. 00:32:21.130 [2024-11-26 19:18:37.873443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.130 [2024-11-26 19:18:37.873521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.130 [2024-11-26 19:18:37.873532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.130 qpair failed and we were unable to recover it. 00:32:21.130 [2024-11-26 19:18:37.873608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.130 [2024-11-26 19:18:37.873736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.130 [2024-11-26 19:18:37.873749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.130 qpair failed and we were unable to recover it. 00:32:21.130 [2024-11-26 19:18:37.873945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.131 [2024-11-26 19:18:37.874029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.131 [2024-11-26 19:18:37.874041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.131 qpair failed and we were unable to recover it. 00:32:21.131 [2024-11-26 19:18:37.874122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.131 [2024-11-26 19:18:37.874202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.131 [2024-11-26 19:18:37.874215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.131 qpair failed and we were unable to recover it. 00:32:21.131 [2024-11-26 19:18:37.874342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.131 [2024-11-26 19:18:37.874408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.131 [2024-11-26 19:18:37.874421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.131 qpair failed and we were unable to recover it. 00:32:21.131 [2024-11-26 19:18:37.874494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.131 [2024-11-26 19:18:37.874562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.131 [2024-11-26 19:18:37.874573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.131 qpair failed and we were unable to recover it. 00:32:21.131 [2024-11-26 19:18:37.874633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.131 [2024-11-26 19:18:37.874696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.131 [2024-11-26 19:18:37.874707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.131 qpair failed and we were unable to recover it. 00:32:21.131 [2024-11-26 19:18:37.874786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.131 [2024-11-26 19:18:37.874935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.131 [2024-11-26 19:18:37.874954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.131 qpair failed and we were unable to recover it. 00:32:21.131 [2024-11-26 19:18:37.875028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.131 [2024-11-26 19:18:37.875089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.131 [2024-11-26 19:18:37.875101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.131 qpair failed and we were unable to recover it. 00:32:21.131 [2024-11-26 19:18:37.875166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.131 [2024-11-26 19:18:37.875227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.131 [2024-11-26 19:18:37.875239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.131 qpair failed and we were unable to recover it. 00:32:21.131 [2024-11-26 19:18:37.875313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.131 [2024-11-26 19:18:37.875382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.131 [2024-11-26 19:18:37.875394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.131 qpair failed and we were unable to recover it. 00:32:21.131 [2024-11-26 19:18:37.875493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.131 [2024-11-26 19:18:37.875632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.131 [2024-11-26 19:18:37.875644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.131 qpair failed and we were unable to recover it. 00:32:21.131 [2024-11-26 19:18:37.875722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.131 [2024-11-26 19:18:37.875796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.131 [2024-11-26 19:18:37.875808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.131 qpair failed and we were unable to recover it. 00:32:21.131 [2024-11-26 19:18:37.875900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.131 [2024-11-26 19:18:37.875979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.131 [2024-11-26 19:18:37.875992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.131 qpair failed and we were unable to recover it. 00:32:21.131 [2024-11-26 19:18:37.876146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.131 [2024-11-26 19:18:37.876227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.131 [2024-11-26 19:18:37.876240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.131 qpair failed and we were unable to recover it. 00:32:21.131 [2024-11-26 19:18:37.876373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.131 [2024-11-26 19:18:37.876436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.131 [2024-11-26 19:18:37.876447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.131 qpair failed and we were unable to recover it. 00:32:21.131 [2024-11-26 19:18:37.876533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.131 [2024-11-26 19:18:37.876686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.131 [2024-11-26 19:18:37.876699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.131 qpair failed and we were unable to recover it. 00:32:21.131 [2024-11-26 19:18:37.876775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.131 [2024-11-26 19:18:37.876856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.131 [2024-11-26 19:18:37.876869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.131 qpair failed and we were unable to recover it. 00:32:21.131 [2024-11-26 19:18:37.876978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.131 [2024-11-26 19:18:37.877128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.131 [2024-11-26 19:18:37.877143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.131 qpair failed and we were unable to recover it. 00:32:21.131 [2024-11-26 19:18:37.877231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.131 [2024-11-26 19:18:37.877302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.131 [2024-11-26 19:18:37.877317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.131 qpair failed and we were unable to recover it. 00:32:21.131 [2024-11-26 19:18:37.877471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.131 [2024-11-26 19:18:37.877640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.131 [2024-11-26 19:18:37.877654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.131 qpair failed and we were unable to recover it. 00:32:21.131 [2024-11-26 19:18:37.877733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.131 [2024-11-26 19:18:37.877791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.131 [2024-11-26 19:18:37.877807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.131 qpair failed and we were unable to recover it. 00:32:21.131 [2024-11-26 19:18:37.877894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.131 [2024-11-26 19:18:37.877994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.131 [2024-11-26 19:18:37.878011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.131 qpair failed and we were unable to recover it. 00:32:21.131 [2024-11-26 19:18:37.878169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.131 [2024-11-26 19:18:37.878241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.131 [2024-11-26 19:18:37.878257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.131 qpair failed and we were unable to recover it. 00:32:21.131 [2024-11-26 19:18:37.878327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.131 [2024-11-26 19:18:37.878487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.131 [2024-11-26 19:18:37.878503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.131 qpair failed and we were unable to recover it. 00:32:21.131 [2024-11-26 19:18:37.878595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.131 [2024-11-26 19:18:37.878742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.131 [2024-11-26 19:18:37.878758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.131 qpair failed and we were unable to recover it. 00:32:21.131 [2024-11-26 19:18:37.878842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.132 [2024-11-26 19:18:37.878904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.132 [2024-11-26 19:18:37.878920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.132 qpair failed and we were unable to recover it. 00:32:21.132 [2024-11-26 19:18:37.879010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.132 [2024-11-26 19:18:37.879089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.132 [2024-11-26 19:18:37.879104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.132 qpair failed and we were unable to recover it. 00:32:21.132 [2024-11-26 19:18:37.879179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.132 [2024-11-26 19:18:37.879335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.132 [2024-11-26 19:18:37.879352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.132 qpair failed and we were unable to recover it. 00:32:21.132 [2024-11-26 19:18:37.879444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.132 [2024-11-26 19:18:37.879539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.132 [2024-11-26 19:18:37.879556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.132 qpair failed and we were unable to recover it. 00:32:21.132 [2024-11-26 19:18:37.879758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.132 [2024-11-26 19:18:37.879992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.132 [2024-11-26 19:18:37.880009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.132 qpair failed and we were unable to recover it. 00:32:21.132 [2024-11-26 19:18:37.880087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.132 [2024-11-26 19:18:37.880157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.132 [2024-11-26 19:18:37.880172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.132 qpair failed and we were unable to recover it. 00:32:21.132 [2024-11-26 19:18:37.880258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.132 [2024-11-26 19:18:37.880328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.132 [2024-11-26 19:18:37.880345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.132 qpair failed and we were unable to recover it. 00:32:21.132 [2024-11-26 19:18:37.880420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.132 [2024-11-26 19:18:37.880492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.132 [2024-11-26 19:18:37.880507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.132 qpair failed and we were unable to recover it. 00:32:21.132 [2024-11-26 19:18:37.880602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.132 [2024-11-26 19:18:37.880680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.132 [2024-11-26 19:18:37.880695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.132 qpair failed and we were unable to recover it. 00:32:21.132 [2024-11-26 19:18:37.880766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.132 [2024-11-26 19:18:37.880860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.132 [2024-11-26 19:18:37.880876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.132 qpair failed and we were unable to recover it. 00:32:21.132 [2024-11-26 19:18:37.880971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.132 [2024-11-26 19:18:37.881053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.132 [2024-11-26 19:18:37.881068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.132 qpair failed and we were unable to recover it. 00:32:21.132 [2024-11-26 19:18:37.881158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.132 [2024-11-26 19:18:37.881230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.132 [2024-11-26 19:18:37.881246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.132 qpair failed and we were unable to recover it. 00:32:21.132 [2024-11-26 19:18:37.881330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.132 [2024-11-26 19:18:37.881402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.132 [2024-11-26 19:18:37.881418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.132 qpair failed and we were unable to recover it. 00:32:21.132 [2024-11-26 19:18:37.881567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.132 [2024-11-26 19:18:37.881709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.132 [2024-11-26 19:18:37.881726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.132 qpair failed and we were unable to recover it. 00:32:21.132 [2024-11-26 19:18:37.881823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.132 [2024-11-26 19:18:37.881892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.132 [2024-11-26 19:18:37.881908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.132 qpair failed and we were unable to recover it. 00:32:21.132 [2024-11-26 19:18:37.881999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.132 [2024-11-26 19:18:37.882074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.132 [2024-11-26 19:18:37.882089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.132 qpair failed and we were unable to recover it. 00:32:21.132 [2024-11-26 19:18:37.882176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.132 [2024-11-26 19:18:37.882258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.132 [2024-11-26 19:18:37.882275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.132 qpair failed and we were unable to recover it. 00:32:21.132 [2024-11-26 19:18:37.882350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.132 [2024-11-26 19:18:37.882421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.132 [2024-11-26 19:18:37.882437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.132 qpair failed and we were unable to recover it. 00:32:21.132 [2024-11-26 19:18:37.882528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.132 [2024-11-26 19:18:37.882606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.132 [2024-11-26 19:18:37.882620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.132 qpair failed and we were unable to recover it. 00:32:21.132 [2024-11-26 19:18:37.882694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.132 [2024-11-26 19:18:37.882764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.132 [2024-11-26 19:18:37.882779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.132 qpair failed and we were unable to recover it. 00:32:21.132 [2024-11-26 19:18:37.882917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.132 [2024-11-26 19:18:37.882992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.132 [2024-11-26 19:18:37.883008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.132 qpair failed and we were unable to recover it. 00:32:21.132 [2024-11-26 19:18:37.883147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.132 [2024-11-26 19:18:37.883232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.132 [2024-11-26 19:18:37.883246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.132 qpair failed and we were unable to recover it. 00:32:21.132 [2024-11-26 19:18:37.883320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.132 [2024-11-26 19:18:37.883401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.132 [2024-11-26 19:18:37.883416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.132 qpair failed and we were unable to recover it. 00:32:21.132 [2024-11-26 19:18:37.883569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.132 [2024-11-26 19:18:37.883640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.132 [2024-11-26 19:18:37.883655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.132 qpair failed and we were unable to recover it. 00:32:21.133 [2024-11-26 19:18:37.883798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.133 [2024-11-26 19:18:37.883940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.133 [2024-11-26 19:18:37.883961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.133 qpair failed and we were unable to recover it. 00:32:21.133 [2024-11-26 19:18:37.884116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.133 [2024-11-26 19:18:37.884186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.133 [2024-11-26 19:18:37.884201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.133 qpair failed and we were unable to recover it. 00:32:21.133 [2024-11-26 19:18:37.884280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.133 [2024-11-26 19:18:37.884372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.133 [2024-11-26 19:18:37.884387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.133 qpair failed and we were unable to recover it. 00:32:21.133 [2024-11-26 19:18:37.884524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.133 [2024-11-26 19:18:37.884595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.133 [2024-11-26 19:18:37.884610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.133 qpair failed and we were unable to recover it. 00:32:21.133 [2024-11-26 19:18:37.884681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.133 [2024-11-26 19:18:37.884760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.133 [2024-11-26 19:18:37.884775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.133 qpair failed and we were unable to recover it. 00:32:21.133 [2024-11-26 19:18:37.884858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.133 [2024-11-26 19:18:37.885000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.133 [2024-11-26 19:18:37.885017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.133 qpair failed and we were unable to recover it. 00:32:21.133 [2024-11-26 19:18:37.885105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.133 [2024-11-26 19:18:37.885259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.133 [2024-11-26 19:18:37.885275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.133 qpair failed and we were unable to recover it. 00:32:21.133 [2024-11-26 19:18:37.885373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.133 [2024-11-26 19:18:37.885461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.133 [2024-11-26 19:18:37.885477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.133 qpair failed and we were unable to recover it. 00:32:21.133 [2024-11-26 19:18:37.885633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.133 [2024-11-26 19:18:37.885717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.133 [2024-11-26 19:18:37.885733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.133 qpair failed and we were unable to recover it. 00:32:21.133 [2024-11-26 19:18:37.885835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.133 [2024-11-26 19:18:37.885908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.133 [2024-11-26 19:18:37.885923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.133 qpair failed and we were unable to recover it. 00:32:21.133 [2024-11-26 19:18:37.886017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.133 [2024-11-26 19:18:37.886099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.133 [2024-11-26 19:18:37.886114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.133 qpair failed and we were unable to recover it. 00:32:21.133 [2024-11-26 19:18:37.886195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.133 [2024-11-26 19:18:37.886298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.133 [2024-11-26 19:18:37.886318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.133 qpair failed and we were unable to recover it. 00:32:21.133 [2024-11-26 19:18:37.886465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.133 [2024-11-26 19:18:37.886550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.133 [2024-11-26 19:18:37.886566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.133 qpair failed and we were unable to recover it. 00:32:21.133 [2024-11-26 19:18:37.886644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.133 [2024-11-26 19:18:37.886854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.133 [2024-11-26 19:18:37.886876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.133 qpair failed and we were unable to recover it. 00:32:21.133 [2024-11-26 19:18:37.886979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.133 [2024-11-26 19:18:37.887132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.133 [2024-11-26 19:18:37.887148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.133 qpair failed and we were unable to recover it. 00:32:21.133 [2024-11-26 19:18:37.887247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.133 [2024-11-26 19:18:37.887409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.133 [2024-11-26 19:18:37.887425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.133 qpair failed and we were unable to recover it. 00:32:21.133 [2024-11-26 19:18:37.887502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.133 [2024-11-26 19:18:37.887575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.133 [2024-11-26 19:18:37.887591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.133 qpair failed and we were unable to recover it. 00:32:21.133 [2024-11-26 19:18:37.887663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.133 [2024-11-26 19:18:37.887751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.133 [2024-11-26 19:18:37.887770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.133 qpair failed and we were unable to recover it. 00:32:21.133 [2024-11-26 19:18:37.887864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.133 [2024-11-26 19:18:37.888019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.133 [2024-11-26 19:18:37.888040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.133 qpair failed and we were unable to recover it. 00:32:21.133 [2024-11-26 19:18:37.888125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.133 [2024-11-26 19:18:37.888197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.133 [2024-11-26 19:18:37.888212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.133 qpair failed and we were unable to recover it. 00:32:21.133 [2024-11-26 19:18:37.888349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.133 [2024-11-26 19:18:37.888419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.133 [2024-11-26 19:18:37.888435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.133 qpair failed and we were unable to recover it. 00:32:21.133 [2024-11-26 19:18:37.888533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.133 [2024-11-26 19:18:37.888617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.133 [2024-11-26 19:18:37.888633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.133 qpair failed and we were unable to recover it. 00:32:21.133 [2024-11-26 19:18:37.888702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.133 [2024-11-26 19:18:37.888779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.133 [2024-11-26 19:18:37.888795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.133 qpair failed and we were unable to recover it. 00:32:21.133 [2024-11-26 19:18:37.888870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.133 [2024-11-26 19:18:37.888966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.133 [2024-11-26 19:18:37.888982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.133 qpair failed and we were unable to recover it. 00:32:21.133 [2024-11-26 19:18:37.889125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.133 [2024-11-26 19:18:37.889272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.133 [2024-11-26 19:18:37.889288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.133 qpair failed and we were unable to recover it. 00:32:21.133 [2024-11-26 19:18:37.889438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.133 [2024-11-26 19:18:37.889519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.133 [2024-11-26 19:18:37.889535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.133 qpair failed and we were unable to recover it. 00:32:21.133 [2024-11-26 19:18:37.889621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.133 [2024-11-26 19:18:37.889690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.133 [2024-11-26 19:18:37.889707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.133 qpair failed and we were unable to recover it. 00:32:21.133 [2024-11-26 19:18:37.889783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.134 [2024-11-26 19:18:37.889904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.134 [2024-11-26 19:18:37.889920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.134 qpair failed and we were unable to recover it. 00:32:21.134 [2024-11-26 19:18:37.890006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.134 [2024-11-26 19:18:37.890146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.134 [2024-11-26 19:18:37.890166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.134 qpair failed and we were unable to recover it. 00:32:21.134 [2024-11-26 19:18:37.890324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.134 [2024-11-26 19:18:37.890397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.134 [2024-11-26 19:18:37.890412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.134 qpair failed and we were unable to recover it. 00:32:21.134 [2024-11-26 19:18:37.890622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.134 [2024-11-26 19:18:37.890704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.134 [2024-11-26 19:18:37.890720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.134 qpair failed and we were unable to recover it. 00:32:21.134 [2024-11-26 19:18:37.890795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.134 [2024-11-26 19:18:37.890866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.134 [2024-11-26 19:18:37.890881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.134 qpair failed and we were unable to recover it. 00:32:21.134 [2024-11-26 19:18:37.891020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.134 [2024-11-26 19:18:37.891185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.134 [2024-11-26 19:18:37.891202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.134 qpair failed and we were unable to recover it. 00:32:21.134 [2024-11-26 19:18:37.891271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.134 [2024-11-26 19:18:37.891413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.134 [2024-11-26 19:18:37.891430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.134 qpair failed and we were unable to recover it. 00:32:21.134 [2024-11-26 19:18:37.891585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.134 [2024-11-26 19:18:37.891653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.134 [2024-11-26 19:18:37.891669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.134 qpair failed and we were unable to recover it. 00:32:21.134 [2024-11-26 19:18:37.891819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.134 [2024-11-26 19:18:37.891904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.134 [2024-11-26 19:18:37.891920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.134 qpair failed and we were unable to recover it. 00:32:21.134 [2024-11-26 19:18:37.891995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.134 [2024-11-26 19:18:37.892068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.134 [2024-11-26 19:18:37.892083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.134 qpair failed and we were unable to recover it. 00:32:21.134 [2024-11-26 19:18:37.892169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.134 [2024-11-26 19:18:37.892325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.134 [2024-11-26 19:18:37.892342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.134 qpair failed and we were unable to recover it. 00:32:21.134 [2024-11-26 19:18:37.892484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.134 [2024-11-26 19:18:37.892560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.134 [2024-11-26 19:18:37.892579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.134 qpair failed and we were unable to recover it. 00:32:21.134 [2024-11-26 19:18:37.892722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.134 [2024-11-26 19:18:37.892860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.134 [2024-11-26 19:18:37.892878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.134 qpair failed and we were unable to recover it. 00:32:21.134 [2024-11-26 19:18:37.892952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.134 [2024-11-26 19:18:37.893029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.134 [2024-11-26 19:18:37.893045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.134 qpair failed and we were unable to recover it. 00:32:21.134 [2024-11-26 19:18:37.893186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.134 [2024-11-26 19:18:37.893376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.134 [2024-11-26 19:18:37.893393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.134 qpair failed and we were unable to recover it. 00:32:21.134 [2024-11-26 19:18:37.893478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.134 [2024-11-26 19:18:37.893559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.134 [2024-11-26 19:18:37.893574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.134 qpair failed and we were unable to recover it. 00:32:21.134 [2024-11-26 19:18:37.893655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.134 [2024-11-26 19:18:37.893807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.134 [2024-11-26 19:18:37.893823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.134 qpair failed and we were unable to recover it. 00:32:21.134 [2024-11-26 19:18:37.893976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.134 [2024-11-26 19:18:37.894057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.134 [2024-11-26 19:18:37.894072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.134 qpair failed and we were unable to recover it. 00:32:21.134 [2024-11-26 19:18:37.894244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.134 [2024-11-26 19:18:37.894332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.134 [2024-11-26 19:18:37.894349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.134 qpair failed and we were unable to recover it. 00:32:21.134 [2024-11-26 19:18:37.894420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.134 [2024-11-26 19:18:37.894622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.134 [2024-11-26 19:18:37.894638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.134 qpair failed and we were unable to recover it. 00:32:21.134 [2024-11-26 19:18:37.894791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.134 [2024-11-26 19:18:37.894942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.134 [2024-11-26 19:18:37.894963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.134 qpair failed and we were unable to recover it. 00:32:21.134 [2024-11-26 19:18:37.895057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.134 [2024-11-26 19:18:37.895190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.134 [2024-11-26 19:18:37.895209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.134 qpair failed and we were unable to recover it. 00:32:21.134 [2024-11-26 19:18:37.895353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.134 [2024-11-26 19:18:37.895422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.134 [2024-11-26 19:18:37.895437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.134 qpair failed and we were unable to recover it. 00:32:21.134 [2024-11-26 19:18:37.895524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.134 [2024-11-26 19:18:37.895595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.134 [2024-11-26 19:18:37.895610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.134 qpair failed and we were unable to recover it. 00:32:21.134 [2024-11-26 19:18:37.895718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.134 [2024-11-26 19:18:37.895799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.134 [2024-11-26 19:18:37.895814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.134 qpair failed and we were unable to recover it. 00:32:21.134 [2024-11-26 19:18:37.895891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.134 [2024-11-26 19:18:37.895974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.134 [2024-11-26 19:18:37.895991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.134 qpair failed and we were unable to recover it. 00:32:21.135 [2024-11-26 19:18:37.896083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.135 [2024-11-26 19:18:37.896298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.135 [2024-11-26 19:18:37.896314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.135 qpair failed and we were unable to recover it. 00:32:21.135 [2024-11-26 19:18:37.896518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.135 [2024-11-26 19:18:37.896600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.135 [2024-11-26 19:18:37.896615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.135 qpair failed and we were unable to recover it. 00:32:21.135 [2024-11-26 19:18:37.896755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.135 [2024-11-26 19:18:37.896907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.135 [2024-11-26 19:18:37.896924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.135 qpair failed and we were unable to recover it. 00:32:21.135 [2024-11-26 19:18:37.897018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.135 [2024-11-26 19:18:37.897172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.135 [2024-11-26 19:18:37.897188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.135 qpair failed and we were unable to recover it. 00:32:21.135 [2024-11-26 19:18:37.897269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.135 [2024-11-26 19:18:37.897417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.135 [2024-11-26 19:18:37.897433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.135 qpair failed and we were unable to recover it. 00:32:21.135 [2024-11-26 19:18:37.897518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.135 [2024-11-26 19:18:37.897615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.135 [2024-11-26 19:18:37.897630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.135 qpair failed and we were unable to recover it. 00:32:21.135 [2024-11-26 19:18:37.897703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.135 [2024-11-26 19:18:37.897774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.135 [2024-11-26 19:18:37.897790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.135 qpair failed and we were unable to recover it. 00:32:21.135 [2024-11-26 19:18:37.897880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.135 [2024-11-26 19:18:37.898084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.135 [2024-11-26 19:18:37.898101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.135 qpair failed and we were unable to recover it. 00:32:21.135 [2024-11-26 19:18:37.898180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.135 [2024-11-26 19:18:37.898315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.135 [2024-11-26 19:18:37.898331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.135 qpair failed and we were unable to recover it. 00:32:21.135 [2024-11-26 19:18:37.898483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.135 [2024-11-26 19:18:37.898551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.135 [2024-11-26 19:18:37.898566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.135 qpair failed and we were unable to recover it. 00:32:21.135 [2024-11-26 19:18:37.898715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.135 [2024-11-26 19:18:37.898786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.135 [2024-11-26 19:18:37.898802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.135 qpair failed and we were unable to recover it. 00:32:21.135 [2024-11-26 19:18:37.898876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.135 [2024-11-26 19:18:37.899017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.135 [2024-11-26 19:18:37.899034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.135 qpair failed and we were unable to recover it. 00:32:21.135 [2024-11-26 19:18:37.899180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.135 [2024-11-26 19:18:37.899257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.135 [2024-11-26 19:18:37.899273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.135 qpair failed and we were unable to recover it. 00:32:21.135 [2024-11-26 19:18:37.899357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.135 [2024-11-26 19:18:37.899507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.135 [2024-11-26 19:18:37.899524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.135 qpair failed and we were unable to recover it. 00:32:21.135 [2024-11-26 19:18:37.899682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.135 [2024-11-26 19:18:37.899759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.135 [2024-11-26 19:18:37.899774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.135 qpair failed and we were unable to recover it. 00:32:21.135 [2024-11-26 19:18:37.899865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.135 [2024-11-26 19:18:37.899942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.135 [2024-11-26 19:18:37.899962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.135 qpair failed and we were unable to recover it. 00:32:21.135 [2024-11-26 19:18:37.900051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.135 [2024-11-26 19:18:37.900139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.135 [2024-11-26 19:18:37.900155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.135 qpair failed and we were unable to recover it. 00:32:21.135 [2024-11-26 19:18:37.900232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.135 [2024-11-26 19:18:37.900384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.135 [2024-11-26 19:18:37.900399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.135 qpair failed and we were unable to recover it. 00:32:21.135 [2024-11-26 19:18:37.900497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.135 [2024-11-26 19:18:37.900576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.135 [2024-11-26 19:18:37.900591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.135 qpair failed and we were unable to recover it. 00:32:21.135 [2024-11-26 19:18:37.900671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.135 [2024-11-26 19:18:37.900815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.135 [2024-11-26 19:18:37.900831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.135 qpair failed and we were unable to recover it. 00:32:21.135 [2024-11-26 19:18:37.900917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.135 [2024-11-26 19:18:37.900991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.135 [2024-11-26 19:18:37.901006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.135 qpair failed and we were unable to recover it. 00:32:21.135 [2024-11-26 19:18:37.901086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.135 [2024-11-26 19:18:37.901230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.136 [2024-11-26 19:18:37.901245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.136 qpair failed and we were unable to recover it. 00:32:21.136 [2024-11-26 19:18:37.901332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.136 [2024-11-26 19:18:37.901514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.136 [2024-11-26 19:18:37.901529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.136 qpair failed and we were unable to recover it. 00:32:21.136 [2024-11-26 19:18:37.901613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.136 [2024-11-26 19:18:37.901697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.136 [2024-11-26 19:18:37.901713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.136 qpair failed and we were unable to recover it. 00:32:21.136 [2024-11-26 19:18:37.901797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.136 [2024-11-26 19:18:37.901871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.136 [2024-11-26 19:18:37.901886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.136 qpair failed and we were unable to recover it. 00:32:21.136 [2024-11-26 19:18:37.901959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.136 [2024-11-26 19:18:37.902030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.136 [2024-11-26 19:18:37.902045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.136 qpair failed and we were unable to recover it. 00:32:21.136 [2024-11-26 19:18:37.902119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.136 [2024-11-26 19:18:37.902204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.136 [2024-11-26 19:18:37.902219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.136 qpair failed and we were unable to recover it. 00:32:21.136 [2024-11-26 19:18:37.902392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.136 [2024-11-26 19:18:37.902491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.136 [2024-11-26 19:18:37.902505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.136 qpair failed and we were unable to recover it. 00:32:21.136 [2024-11-26 19:18:37.902579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.136 [2024-11-26 19:18:37.902655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.136 [2024-11-26 19:18:37.902670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.136 qpair failed and we were unable to recover it. 00:32:21.136 [2024-11-26 19:18:37.902753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.136 [2024-11-26 19:18:37.902905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.136 [2024-11-26 19:18:37.902921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.136 qpair failed and we were unable to recover it. 00:32:21.136 [2024-11-26 19:18:37.903005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.136 [2024-11-26 19:18:37.903141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.136 [2024-11-26 19:18:37.903157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.136 qpair failed and we were unable to recover it. 00:32:21.136 [2024-11-26 19:18:37.903245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.136 [2024-11-26 19:18:37.903316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.136 [2024-11-26 19:18:37.903331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.136 qpair failed and we were unable to recover it. 00:32:21.136 [2024-11-26 19:18:37.903470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.136 [2024-11-26 19:18:37.903540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.136 [2024-11-26 19:18:37.903555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.136 qpair failed and we were unable to recover it. 00:32:21.136 [2024-11-26 19:18:37.903632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.136 [2024-11-26 19:18:37.903779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.136 [2024-11-26 19:18:37.903794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.136 qpair failed and we were unable to recover it. 00:32:21.136 [2024-11-26 19:18:37.903934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.136 [2024-11-26 19:18:37.904011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.136 [2024-11-26 19:18:37.904027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.136 qpair failed and we were unable to recover it. 00:32:21.136 [2024-11-26 19:18:37.904171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.136 [2024-11-26 19:18:37.904242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.136 [2024-11-26 19:18:37.904257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.136 qpair failed and we were unable to recover it. 00:32:21.136 [2024-11-26 19:18:37.904330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.136 [2024-11-26 19:18:37.904398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.136 [2024-11-26 19:18:37.904414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.136 qpair failed and we were unable to recover it. 00:32:21.136 [2024-11-26 19:18:37.904484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.136 [2024-11-26 19:18:37.904570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.136 [2024-11-26 19:18:37.904585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.136 qpair failed and we were unable to recover it. 00:32:21.136 [2024-11-26 19:18:37.904667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.136 [2024-11-26 19:18:37.904748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.136 [2024-11-26 19:18:37.904762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.136 qpair failed and we were unable to recover it. 00:32:21.136 [2024-11-26 19:18:37.904835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.136 [2024-11-26 19:18:37.904901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.136 [2024-11-26 19:18:37.904917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.136 qpair failed and we were unable to recover it. 00:32:21.136 [2024-11-26 19:18:37.905055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.136 [2024-11-26 19:18:37.905137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.136 [2024-11-26 19:18:37.905151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.136 qpair failed and we were unable to recover it. 00:32:21.136 [2024-11-26 19:18:37.905290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.136 [2024-11-26 19:18:37.905363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.136 [2024-11-26 19:18:37.905378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.136 qpair failed and we were unable to recover it. 00:32:21.136 [2024-11-26 19:18:37.905510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.136 [2024-11-26 19:18:37.905583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.136 [2024-11-26 19:18:37.905598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.136 qpair failed and we were unable to recover it. 00:32:21.136 [2024-11-26 19:18:37.905665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.136 [2024-11-26 19:18:37.905757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.136 [2024-11-26 19:18:37.905772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.136 qpair failed and we were unable to recover it. 00:32:21.136 [2024-11-26 19:18:37.905910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.136 [2024-11-26 19:18:37.906047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.136 [2024-11-26 19:18:37.906072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.136 qpair failed and we were unable to recover it. 00:32:21.136 [2024-11-26 19:18:37.906159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.136 [2024-11-26 19:18:37.906220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.136 [2024-11-26 19:18:37.906235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.136 qpair failed and we were unable to recover it. 00:32:21.136 [2024-11-26 19:18:37.906369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.136 [2024-11-26 19:18:37.906451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.136 [2024-11-26 19:18:37.906467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.136 qpair failed and we were unable to recover it. 00:32:21.136 [2024-11-26 19:18:37.906547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.136 [2024-11-26 19:18:37.906616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.136 [2024-11-26 19:18:37.906632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.136 qpair failed and we were unable to recover it. 00:32:21.136 [2024-11-26 19:18:37.906718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.137 [2024-11-26 19:18:37.906851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.137 [2024-11-26 19:18:37.906866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.137 qpair failed and we were unable to recover it. 00:32:21.137 [2024-11-26 19:18:37.906929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.137 [2024-11-26 19:18:37.907024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.137 [2024-11-26 19:18:37.907039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.137 qpair failed and we were unable to recover it. 00:32:21.137 [2024-11-26 19:18:37.907126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.137 [2024-11-26 19:18:37.907277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.137 [2024-11-26 19:18:37.907293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.137 qpair failed and we were unable to recover it. 00:32:21.137 [2024-11-26 19:18:37.907381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.137 [2024-11-26 19:18:37.907518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.137 [2024-11-26 19:18:37.907533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.137 qpair failed and we were unable to recover it. 00:32:21.137 [2024-11-26 19:18:37.907615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.137 [2024-11-26 19:18:37.907684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.137 [2024-11-26 19:18:37.907699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.137 qpair failed and we were unable to recover it. 00:32:21.137 [2024-11-26 19:18:37.907859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.137 [2024-11-26 19:18:37.907941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.137 [2024-11-26 19:18:37.907960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.137 qpair failed and we were unable to recover it. 00:32:21.137 [2024-11-26 19:18:37.908040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.137 [2024-11-26 19:18:37.908106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.137 [2024-11-26 19:18:37.908121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.137 qpair failed and we were unable to recover it. 00:32:21.137 [2024-11-26 19:18:37.908191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.137 [2024-11-26 19:18:37.908331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.137 [2024-11-26 19:18:37.908346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.137 qpair failed and we were unable to recover it. 00:32:21.137 [2024-11-26 19:18:37.908433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.137 [2024-11-26 19:18:37.908576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.137 [2024-11-26 19:18:37.908591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.137 qpair failed and we were unable to recover it. 00:32:21.137 [2024-11-26 19:18:37.908681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.137 [2024-11-26 19:18:37.908776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.137 [2024-11-26 19:18:37.908791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.137 qpair failed and we were unable to recover it. 00:32:21.137 [2024-11-26 19:18:37.908867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.137 [2024-11-26 19:18:37.908988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.137 [2024-11-26 19:18:37.909003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.137 qpair failed and we were unable to recover it. 00:32:21.137 [2024-11-26 19:18:37.909145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.137 [2024-11-26 19:18:37.909309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.137 [2024-11-26 19:18:37.909325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.137 qpair failed and we were unable to recover it. 00:32:21.137 [2024-11-26 19:18:37.909402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.137 [2024-11-26 19:18:37.909599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.137 [2024-11-26 19:18:37.909615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.137 qpair failed and we were unable to recover it. 00:32:21.137 [2024-11-26 19:18:37.909686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.137 [2024-11-26 19:18:37.909787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.137 [2024-11-26 19:18:37.909802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.137 qpair failed and we were unable to recover it. 00:32:21.137 [2024-11-26 19:18:37.909882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.137 [2024-11-26 19:18:37.910043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.137 [2024-11-26 19:18:37.910060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.137 qpair failed and we were unable to recover it. 00:32:21.137 [2024-11-26 19:18:37.910148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.137 [2024-11-26 19:18:37.910225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.137 [2024-11-26 19:18:37.910240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.137 qpair failed and we were unable to recover it. 00:32:21.137 [2024-11-26 19:18:37.910325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.137 [2024-11-26 19:18:37.910518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.137 [2024-11-26 19:18:37.910533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.137 qpair failed and we were unable to recover it. 00:32:21.137 [2024-11-26 19:18:37.910623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.137 [2024-11-26 19:18:37.910693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.137 [2024-11-26 19:18:37.910709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d4000b90 with addr=10.0.0.2, port=4420 00:32:21.137 qpair failed and we were unable to recover it. 00:32:21.137 [2024-11-26 19:18:37.910845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.137 [2024-11-26 19:18:37.910964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.137 [2024-11-26 19:18:37.910987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.137 qpair failed and we were unable to recover it. 00:32:21.137 [2024-11-26 19:18:37.911115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.137 [2024-11-26 19:18:37.911220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.137 [2024-11-26 19:18:37.911234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.137 qpair failed and we were unable to recover it. 00:32:21.137 [2024-11-26 19:18:37.911374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.137 [2024-11-26 19:18:37.911445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.137 [2024-11-26 19:18:37.911457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.137 qpair failed and we were unable to recover it. 00:32:21.137 [2024-11-26 19:18:37.911523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.137 [2024-11-26 19:18:37.911584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.137 [2024-11-26 19:18:37.911596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.137 qpair failed and we were unable to recover it. 00:32:21.137 [2024-11-26 19:18:37.911731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.137 [2024-11-26 19:18:37.911847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.137 [2024-11-26 19:18:37.911860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.137 qpair failed and we were unable to recover it. 00:32:21.137 [2024-11-26 19:18:37.911957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.137 [2024-11-26 19:18:37.912012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.137 [2024-11-26 19:18:37.912024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.137 qpair failed and we were unable to recover it. 00:32:21.137 [2024-11-26 19:18:37.912103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.137 [2024-11-26 19:18:37.912235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.137 [2024-11-26 19:18:37.912247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.137 qpair failed and we were unable to recover it. 00:32:21.137 [2024-11-26 19:18:37.912314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.137 [2024-11-26 19:18:37.912374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.137 [2024-11-26 19:18:37.912385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.137 qpair failed and we were unable to recover it. 00:32:21.137 [2024-11-26 19:18:37.912468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.137 [2024-11-26 19:18:37.912617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.137 [2024-11-26 19:18:37.912628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.137 qpair failed and we were unable to recover it. 00:32:21.137 [2024-11-26 19:18:37.912695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.137 [2024-11-26 19:18:37.912762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.137 [2024-11-26 19:18:37.912774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.137 qpair failed and we were unable to recover it. 00:32:21.137 [2024-11-26 19:18:37.912925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.137 [2024-11-26 19:18:37.913042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.137 [2024-11-26 19:18:37.913060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.138 qpair failed and we were unable to recover it. 00:32:21.138 [2024-11-26 19:18:37.913142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.138 [2024-11-26 19:18:37.913222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.138 [2024-11-26 19:18:37.913238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.138 qpair failed and we were unable to recover it. 00:32:21.138 [2024-11-26 19:18:37.913320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.138 [2024-11-26 19:18:37.913393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.138 [2024-11-26 19:18:37.913408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.138 qpair failed and we were unable to recover it. 00:32:21.138 [2024-11-26 19:18:37.913583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.138 [2024-11-26 19:18:37.913655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.138 [2024-11-26 19:18:37.913670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.138 qpair failed and we were unable to recover it. 00:32:21.138 [2024-11-26 19:18:37.913751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.138 [2024-11-26 19:18:37.913841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.138 [2024-11-26 19:18:37.913857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.138 qpair failed and we were unable to recover it. 00:32:21.138 [2024-11-26 19:18:37.913955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.138 [2024-11-26 19:18:37.914097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.138 [2024-11-26 19:18:37.914113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.138 qpair failed and we were unable to recover it. 00:32:21.138 [2024-11-26 19:18:37.914188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.138 [2024-11-26 19:18:37.914254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.138 [2024-11-26 19:18:37.914270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.138 qpair failed and we were unable to recover it. 00:32:21.138 [2024-11-26 19:18:37.914344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.138 [2024-11-26 19:18:37.914477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.138 [2024-11-26 19:18:37.914492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.138 qpair failed and we were unable to recover it. 00:32:21.138 [2024-11-26 19:18:37.914615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.138 [2024-11-26 19:18:37.914758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.138 [2024-11-26 19:18:37.914773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.138 qpair failed and we were unable to recover it. 00:32:21.138 [2024-11-26 19:18:37.914855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.138 [2024-11-26 19:18:37.914929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.138 [2024-11-26 19:18:37.914943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.138 qpair failed and we were unable to recover it. 00:32:21.138 [2024-11-26 19:18:37.915036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.138 [2024-11-26 19:18:37.915139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.138 [2024-11-26 19:18:37.915154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.138 qpair failed and we were unable to recover it. 00:32:21.138 [2024-11-26 19:18:37.915220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.138 [2024-11-26 19:18:37.915294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.138 [2024-11-26 19:18:37.915309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.138 qpair failed and we were unable to recover it. 00:32:21.138 [2024-11-26 19:18:37.915464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.138 [2024-11-26 19:18:37.915635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.138 [2024-11-26 19:18:37.915650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.138 qpair failed and we were unable to recover it. 00:32:21.138 [2024-11-26 19:18:37.915800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.138 [2024-11-26 19:18:37.916012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.138 [2024-11-26 19:18:37.916028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.138 qpair failed and we were unable to recover it. 00:32:21.138 [2024-11-26 19:18:37.916179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.138 [2024-11-26 19:18:37.916418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.138 [2024-11-26 19:18:37.916434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.138 qpair failed and we were unable to recover it. 00:32:21.138 [2024-11-26 19:18:37.916707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.138 [2024-11-26 19:18:37.916919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.138 [2024-11-26 19:18:37.916935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.138 qpair failed and we were unable to recover it. 00:32:21.138 [2024-11-26 19:18:37.917134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.138 [2024-11-26 19:18:37.917281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.138 [2024-11-26 19:18:37.917296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.138 qpair failed and we were unable to recover it. 00:32:21.138 [2024-11-26 19:18:37.917379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.138 [2024-11-26 19:18:37.917479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.138 [2024-11-26 19:18:37.917494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.138 qpair failed and we were unable to recover it. 00:32:21.138 [2024-11-26 19:18:37.917810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.138 [2024-11-26 19:18:37.918008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.138 [2024-11-26 19:18:37.918024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.138 qpair failed and we were unable to recover it. 00:32:21.138 [2024-11-26 19:18:37.918271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.138 [2024-11-26 19:18:37.918361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.138 [2024-11-26 19:18:37.918377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.138 qpair failed and we were unable to recover it. 00:32:21.138 [2024-11-26 19:18:37.918641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.138 [2024-11-26 19:18:37.918848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.138 [2024-11-26 19:18:37.918866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.138 qpair failed and we were unable to recover it. 00:32:21.138 [2024-11-26 19:18:37.918981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.138 [2024-11-26 19:18:37.919210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.138 [2024-11-26 19:18:37.919225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.138 qpair failed and we were unable to recover it. 00:32:21.138 [2024-11-26 19:18:37.919323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.138 [2024-11-26 19:18:37.919470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.138 [2024-11-26 19:18:37.919486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.138 qpair failed and we were unable to recover it. 00:32:21.138 [2024-11-26 19:18:37.919710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.138 [2024-11-26 19:18:37.919881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.138 [2024-11-26 19:18:37.919897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.138 qpair failed and we were unable to recover it. 00:32:21.138 [2024-11-26 19:18:37.919984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.138 [2024-11-26 19:18:37.920129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.138 [2024-11-26 19:18:37.920145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.138 qpair failed and we were unable to recover it. 00:32:21.138 [2024-11-26 19:18:37.920317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.138 [2024-11-26 19:18:37.920469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.138 [2024-11-26 19:18:37.920485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.138 qpair failed and we were unable to recover it. 00:32:21.138 [2024-11-26 19:18:37.920733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.138 [2024-11-26 19:18:37.920957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.138 [2024-11-26 19:18:37.920973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.138 qpair failed and we were unable to recover it. 00:32:21.138 [2024-11-26 19:18:37.921061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.138 [2024-11-26 19:18:37.921231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.138 [2024-11-26 19:18:37.921246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.138 qpair failed and we were unable to recover it. 00:32:21.138 [2024-11-26 19:18:37.921421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.138 [2024-11-26 19:18:37.921577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.138 [2024-11-26 19:18:37.921593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.138 qpair failed and we were unable to recover it. 00:32:21.138 [2024-11-26 19:18:37.921730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.138 [2024-11-26 19:18:37.921828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.138 [2024-11-26 19:18:37.921844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.138 qpair failed and we were unable to recover it. 00:32:21.138 [2024-11-26 19:18:37.921938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.138 [2024-11-26 19:18:37.922035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.138 [2024-11-26 19:18:37.922052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.138 qpair failed and we were unable to recover it. 00:32:21.138 [2024-11-26 19:18:37.922155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.138 [2024-11-26 19:18:37.922252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.138 [2024-11-26 19:18:37.922268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.138 qpair failed and we were unable to recover it. 00:32:21.138 [2024-11-26 19:18:37.922354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.138 [2024-11-26 19:18:37.922618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.138 [2024-11-26 19:18:37.922634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.138 qpair failed and we were unable to recover it. 00:32:21.138 [2024-11-26 19:18:37.922724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.138 [2024-11-26 19:18:37.922802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.138 [2024-11-26 19:18:37.922817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.138 qpair failed and we were unable to recover it. 00:32:21.138 [2024-11-26 19:18:37.923043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.138 [2024-11-26 19:18:37.923212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.138 [2024-11-26 19:18:37.923229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.138 qpair failed and we were unable to recover it. 00:32:21.138 [2024-11-26 19:18:37.923403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.139 [2024-11-26 19:18:37.923663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.139 [2024-11-26 19:18:37.923677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.139 qpair failed and we were unable to recover it. 00:32:21.139 [2024-11-26 19:18:37.923879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.139 [2024-11-26 19:18:37.924032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.139 [2024-11-26 19:18:37.924048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.139 qpair failed and we were unable to recover it. 00:32:21.139 [2024-11-26 19:18:37.924200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.139 [2024-11-26 19:18:37.924290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.139 [2024-11-26 19:18:37.924305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.139 qpair failed and we were unable to recover it. 00:32:21.139 [2024-11-26 19:18:37.924537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.139 [2024-11-26 19:18:37.924750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.139 [2024-11-26 19:18:37.924766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.139 qpair failed and we were unable to recover it. 00:32:21.139 [2024-11-26 19:18:37.924843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.139 [2024-11-26 19:18:37.925079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.139 [2024-11-26 19:18:37.925095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.139 qpair failed and we were unable to recover it. 00:32:21.139 [2024-11-26 19:18:37.925252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.139 [2024-11-26 19:18:37.925400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.139 [2024-11-26 19:18:37.925416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.139 qpair failed and we were unable to recover it. 00:32:21.139 [2024-11-26 19:18:37.925584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.139 [2024-11-26 19:18:37.925735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.139 [2024-11-26 19:18:37.925750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.139 qpair failed and we were unable to recover it. 00:32:21.139 [2024-11-26 19:18:37.925841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.139 [2024-11-26 19:18:37.926045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.139 [2024-11-26 19:18:37.926061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.139 qpair failed and we were unable to recover it. 00:32:21.139 [2024-11-26 19:18:37.926172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.139 [2024-11-26 19:18:37.926270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.139 [2024-11-26 19:18:37.926285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.139 qpair failed and we were unable to recover it. 00:32:21.139 [2024-11-26 19:18:37.926355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.139 [2024-11-26 19:18:37.926465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.139 [2024-11-26 19:18:37.926480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.139 qpair failed and we were unable to recover it. 00:32:21.139 [2024-11-26 19:18:37.926642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.139 [2024-11-26 19:18:37.926790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.139 [2024-11-26 19:18:37.926805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.139 qpair failed and we were unable to recover it. 00:32:21.139 [2024-11-26 19:18:37.926891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.139 [2024-11-26 19:18:37.926983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.139 [2024-11-26 19:18:37.926999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.139 qpair failed and we were unable to recover it. 00:32:21.139 [2024-11-26 19:18:37.927083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.139 [2024-11-26 19:18:37.927311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.139 [2024-11-26 19:18:37.927327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.139 qpair failed and we were unable to recover it. 00:32:21.139 [2024-11-26 19:18:37.927464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.139 [2024-11-26 19:18:37.927608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.139 [2024-11-26 19:18:37.927624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.139 qpair failed and we were unable to recover it. 00:32:21.139 [2024-11-26 19:18:37.927871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.139 [2024-11-26 19:18:37.928067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.139 [2024-11-26 19:18:37.928084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.139 qpair failed and we were unable to recover it. 00:32:21.139 [2024-11-26 19:18:37.928229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.139 [2024-11-26 19:18:37.928386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.139 [2024-11-26 19:18:37.928402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.139 qpair failed and we were unable to recover it. 00:32:21.139 [2024-11-26 19:18:37.928637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.139 [2024-11-26 19:18:37.928879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.139 [2024-11-26 19:18:37.928896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.139 qpair failed and we were unable to recover it. 00:32:21.139 [2024-11-26 19:18:37.929117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.139 [2024-11-26 19:18:37.929215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.139 [2024-11-26 19:18:37.929230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.139 qpair failed and we were unable to recover it. 00:32:21.139 [2024-11-26 19:18:37.929395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.139 [2024-11-26 19:18:37.929546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.139 [2024-11-26 19:18:37.929562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.139 qpair failed and we were unable to recover it. 00:32:21.139 [2024-11-26 19:18:37.929789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.139 [2024-11-26 19:18:37.929929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.139 [2024-11-26 19:18:37.929945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.139 qpair failed and we were unable to recover it. 00:32:21.139 [2024-11-26 19:18:37.930111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.139 [2024-11-26 19:18:37.930273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.139 [2024-11-26 19:18:37.930288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.139 qpair failed and we were unable to recover it. 00:32:21.139 [2024-11-26 19:18:37.930462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.139 [2024-11-26 19:18:37.930622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.139 [2024-11-26 19:18:37.930638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.139 qpair failed and we were unable to recover it. 00:32:21.139 [2024-11-26 19:18:37.930888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.139 [2024-11-26 19:18:37.931098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.139 [2024-11-26 19:18:37.931114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.139 qpair failed and we were unable to recover it. 00:32:21.139 [2024-11-26 19:18:37.931289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.139 [2024-11-26 19:18:37.931378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.139 [2024-11-26 19:18:37.931393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.139 qpair failed and we were unable to recover it. 00:32:21.139 [2024-11-26 19:18:37.931537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.139 [2024-11-26 19:18:37.931619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.139 [2024-11-26 19:18:37.931634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.139 qpair failed and we were unable to recover it. 00:32:21.139 [2024-11-26 19:18:37.931788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.139 [2024-11-26 19:18:37.931924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.139 [2024-11-26 19:18:37.931939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.139 qpair failed and we were unable to recover it. 00:32:21.139 [2024-11-26 19:18:37.932101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.139 [2024-11-26 19:18:37.932187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.139 [2024-11-26 19:18:37.932202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.139 qpair failed and we were unable to recover it. 00:32:21.139 [2024-11-26 19:18:37.932280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.139 [2024-11-26 19:18:37.932440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.139 [2024-11-26 19:18:37.932456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.139 qpair failed and we were unable to recover it. 00:32:21.139 [2024-11-26 19:18:37.932546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.139 [2024-11-26 19:18:37.932628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.139 [2024-11-26 19:18:37.932643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.139 qpair failed and we were unable to recover it. 00:32:21.139 [2024-11-26 19:18:37.932743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.139 [2024-11-26 19:18:37.932852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.139 [2024-11-26 19:18:37.932867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.139 qpair failed and we were unable to recover it. 00:32:21.139 [2024-11-26 19:18:37.933079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.139 [2024-11-26 19:18:37.933172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.139 [2024-11-26 19:18:37.933186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.139 qpair failed and we were unable to recover it. 00:32:21.139 [2024-11-26 19:18:37.933333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.139 [2024-11-26 19:18:37.933489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.139 [2024-11-26 19:18:37.933504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.139 qpair failed and we were unable to recover it. 00:32:21.139 [2024-11-26 19:18:37.933714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.139 [2024-11-26 19:18:37.933891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.933906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.140 qpair failed and we were unable to recover it. 00:32:21.140 [2024-11-26 19:18:37.934060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.934281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.934297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.140 qpair failed and we were unable to recover it. 00:32:21.140 [2024-11-26 19:18:37.934465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.934699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.934715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.140 qpair failed and we were unable to recover it. 00:32:21.140 [2024-11-26 19:18:37.934813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.935057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.935074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.140 qpair failed and we were unable to recover it. 00:32:21.140 [2024-11-26 19:18:37.935176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.935336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.935350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.140 qpair failed and we were unable to recover it. 00:32:21.140 [2024-11-26 19:18:37.935495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.935590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.935605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.140 qpair failed and we were unable to recover it. 00:32:21.140 [2024-11-26 19:18:37.935699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.935939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.935958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.140 qpair failed and we were unable to recover it. 00:32:21.140 [2024-11-26 19:18:37.936124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.936269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.936284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.140 qpair failed and we were unable to recover it. 00:32:21.140 [2024-11-26 19:18:37.936367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.936464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.936479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.140 qpair failed and we were unable to recover it. 00:32:21.140 [2024-11-26 19:18:37.936635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.936721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.936736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.140 qpair failed and we were unable to recover it. 00:32:21.140 [2024-11-26 19:18:37.936878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.937091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.937107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.140 qpair failed and we were unable to recover it. 00:32:21.140 [2024-11-26 19:18:37.937324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.937529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.937544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.140 qpair failed and we were unable to recover it. 00:32:21.140 [2024-11-26 19:18:37.937717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.937877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.937892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.140 qpair failed and we were unable to recover it. 00:32:21.140 [2024-11-26 19:18:37.938039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.938136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.938151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.140 qpair failed and we were unable to recover it. 00:32:21.140 [2024-11-26 19:18:37.938353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.938453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.938469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.140 qpair failed and we were unable to recover it. 00:32:21.140 [2024-11-26 19:18:37.938575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.938813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.938828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.140 qpair failed and we were unable to recover it. 00:32:21.140 [2024-11-26 19:18:37.939012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.939157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.939173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.140 qpair failed and we were unable to recover it. 00:32:21.140 [2024-11-26 19:18:37.939348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.939429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.939444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.140 qpair failed and we were unable to recover it. 00:32:21.140 [2024-11-26 19:18:37.939558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.939655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.939670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.140 qpair failed and we were unable to recover it. 00:32:21.140 [2024-11-26 19:18:37.939819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.939914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.939930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.140 qpair failed and we were unable to recover it. 00:32:21.140 [2024-11-26 19:18:37.940103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.940199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.940214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.140 qpair failed and we were unable to recover it. 00:32:21.140 [2024-11-26 19:18:37.940313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.940493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.940508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.140 qpair failed and we were unable to recover it. 00:32:21.140 [2024-11-26 19:18:37.940600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.940762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.940776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.140 qpair failed and we were unable to recover it. 00:32:21.140 [2024-11-26 19:18:37.941006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.941096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.941112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.140 qpair failed and we were unable to recover it. 00:32:21.140 [2024-11-26 19:18:37.941267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.941448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.941463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.140 qpair failed and we were unable to recover it. 00:32:21.140 [2024-11-26 19:18:37.941541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.941634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.941650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.140 qpair failed and we were unable to recover it. 00:32:21.140 [2024-11-26 19:18:37.941806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.941956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.941972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.140 qpair failed and we were unable to recover it. 00:32:21.140 [2024-11-26 19:18:37.942133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.942226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.942241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.140 qpair failed and we were unable to recover it. 00:32:21.140 [2024-11-26 19:18:37.942339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.942437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.942452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.140 qpair failed and we were unable to recover it. 00:32:21.140 [2024-11-26 19:18:37.942743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.942892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.942908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.140 qpair failed and we were unable to recover it. 00:32:21.140 [2024-11-26 19:18:37.943107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.943340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.943355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.140 qpair failed and we were unable to recover it. 00:32:21.140 [2024-11-26 19:18:37.943519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.943762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.943778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.140 qpair failed and we were unable to recover it. 00:32:21.140 [2024-11-26 19:18:37.943925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.944125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.944141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.140 qpair failed and we were unable to recover it. 00:32:21.140 [2024-11-26 19:18:37.944295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.944401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.944417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.140 qpair failed and we were unable to recover it. 00:32:21.140 [2024-11-26 19:18:37.944628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.944725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.140 [2024-11-26 19:18:37.944740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.141 qpair failed and we were unable to recover it. 00:32:21.141 [2024-11-26 19:18:37.944938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.945089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.945105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.141 qpair failed and we were unable to recover it. 00:32:21.141 [2024-11-26 19:18:37.945263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.945373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.945388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.141 qpair failed and we were unable to recover it. 00:32:21.141 [2024-11-26 19:18:37.945475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.945578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.945592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.141 qpair failed and we were unable to recover it. 00:32:21.141 [2024-11-26 19:18:37.945679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.945823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.945839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.141 qpair failed and we were unable to recover it. 00:32:21.141 [2024-11-26 19:18:37.945935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.946170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.946185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.141 qpair failed and we were unable to recover it. 00:32:21.141 [2024-11-26 19:18:37.946288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.946444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.946458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.141 qpair failed and we were unable to recover it. 00:32:21.141 [2024-11-26 19:18:37.946648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.946878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.946893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.141 qpair failed and we were unable to recover it. 00:32:21.141 [2024-11-26 19:18:37.946976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.947130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.947145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.141 qpair failed and we were unable to recover it. 00:32:21.141 [2024-11-26 19:18:37.947286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.947445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.947460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.141 qpair failed and we were unable to recover it. 00:32:21.141 [2024-11-26 19:18:37.947599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.947746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.947764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.141 qpair failed and we were unable to recover it. 00:32:21.141 [2024-11-26 19:18:37.947853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.947951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.947968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.141 qpair failed and we were unable to recover it. 00:32:21.141 [2024-11-26 19:18:37.948134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.948290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.948305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.141 qpair failed and we were unable to recover it. 00:32:21.141 [2024-11-26 19:18:37.948395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.948529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.948544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.141 qpair failed and we were unable to recover it. 00:32:21.141 [2024-11-26 19:18:37.948693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.948842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.948856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.141 qpair failed and we were unable to recover it. 00:32:21.141 [2024-11-26 19:18:37.949089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.949248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.949264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.141 qpair failed and we were unable to recover it. 00:32:21.141 [2024-11-26 19:18:37.949418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.949572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.949588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.141 qpair failed and we were unable to recover it. 00:32:21.141 [2024-11-26 19:18:37.949866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.949964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.949979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.141 qpair failed and we were unable to recover it. 00:32:21.141 [2024-11-26 19:18:37.950184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.950330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.950346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.141 qpair failed and we were unable to recover it. 00:32:21.141 [2024-11-26 19:18:37.950519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.950683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.950698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.141 qpair failed and we were unable to recover it. 00:32:21.141 [2024-11-26 19:18:37.950796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.950890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.950909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.141 qpair failed and we were unable to recover it. 00:32:21.141 [2024-11-26 19:18:37.951117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.951222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.951237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.141 qpair failed and we were unable to recover it. 00:32:21.141 [2024-11-26 19:18:37.951333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.951436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.951451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.141 qpair failed and we were unable to recover it. 00:32:21.141 [2024-11-26 19:18:37.951541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.951680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.951695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.141 qpair failed and we were unable to recover it. 00:32:21.141 [2024-11-26 19:18:37.951835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.951933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.951952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.141 qpair failed and we were unable to recover it. 00:32:21.141 [2024-11-26 19:18:37.952135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.952219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.952234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.141 qpair failed and we were unable to recover it. 00:32:21.141 [2024-11-26 19:18:37.952318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.952457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.952472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.141 qpair failed and we were unable to recover it. 00:32:21.141 [2024-11-26 19:18:37.952662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.952751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.952766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.141 qpair failed and we were unable to recover it. 00:32:21.141 [2024-11-26 19:18:37.952912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.953011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.953028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.141 qpair failed and we were unable to recover it. 00:32:21.141 [2024-11-26 19:18:37.953124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.953218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.953233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.141 qpair failed and we were unable to recover it. 00:32:21.141 [2024-11-26 19:18:37.953430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.953582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.953599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.141 qpair failed and we were unable to recover it. 00:32:21.141 [2024-11-26 19:18:37.953779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.953869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.953884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.141 qpair failed and we were unable to recover it. 00:32:21.141 [2024-11-26 19:18:37.953997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.954109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.954125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.141 qpair failed and we were unable to recover it. 00:32:21.141 [2024-11-26 19:18:37.954289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.954477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.954493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.141 qpair failed and we were unable to recover it. 00:32:21.141 [2024-11-26 19:18:37.954691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.954890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.954905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.141 qpair failed and we were unable to recover it. 00:32:21.141 [2024-11-26 19:18:37.955102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.955318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.955333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.141 qpair failed and we were unable to recover it. 00:32:21.141 [2024-11-26 19:18:37.955424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.955580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.955595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.141 qpair failed and we were unable to recover it. 00:32:21.141 [2024-11-26 19:18:37.955692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.955846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.955861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.141 qpair failed and we were unable to recover it. 00:32:21.141 [2024-11-26 19:18:37.956025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.141 [2024-11-26 19:18:37.956166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.956181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.142 qpair failed and we were unable to recover it. 00:32:21.142 [2024-11-26 19:18:37.956333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.956492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.956508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.142 qpair failed and we were unable to recover it. 00:32:21.142 [2024-11-26 19:18:37.956684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.956863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.956882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.142 qpair failed and we were unable to recover it. 00:32:21.142 [2024-11-26 19:18:37.957126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.957285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.957301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.142 qpair failed and we were unable to recover it. 00:32:21.142 [2024-11-26 19:18:37.957609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.957861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.957877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.142 qpair failed and we were unable to recover it. 00:32:21.142 [2024-11-26 19:18:37.958052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.958277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.958292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.142 qpair failed and we were unable to recover it. 00:32:21.142 [2024-11-26 19:18:37.958401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.958598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.958614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.142 qpair failed and we were unable to recover it. 00:32:21.142 [2024-11-26 19:18:37.958817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.959024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.959040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.142 qpair failed and we were unable to recover it. 00:32:21.142 [2024-11-26 19:18:37.959210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.959303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.959317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.142 qpair failed and we were unable to recover it. 00:32:21.142 [2024-11-26 19:18:37.959411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.959575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.959590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.142 qpair failed and we were unable to recover it. 00:32:21.142 [2024-11-26 19:18:37.959739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.959942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.959972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.142 qpair failed and we were unable to recover it. 00:32:21.142 [2024-11-26 19:18:37.960130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.960235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.960251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.142 qpair failed and we were unable to recover it. 00:32:21.142 [2024-11-26 19:18:37.960345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.960484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.960499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.142 qpair failed and we were unable to recover it. 00:32:21.142 [2024-11-26 19:18:37.960682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.960878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.960893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.142 qpair failed and we were unable to recover it. 00:32:21.142 [2024-11-26 19:18:37.961105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.961210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.961226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.142 qpair failed and we were unable to recover it. 00:32:21.142 [2024-11-26 19:18:37.961376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.961529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.961544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.142 qpair failed and we were unable to recover it. 00:32:21.142 [2024-11-26 19:18:37.961795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.961897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.961913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.142 qpair failed and we were unable to recover it. 00:32:21.142 [2024-11-26 19:18:37.962012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.962157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.962172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.142 qpair failed and we were unable to recover it. 00:32:21.142 [2024-11-26 19:18:37.962311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.962487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.962503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.142 qpair failed and we were unable to recover it. 00:32:21.142 [2024-11-26 19:18:37.962666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.962818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.962833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.142 qpair failed and we were unable to recover it. 00:32:21.142 [2024-11-26 19:18:37.963023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.963115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.963130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.142 qpair failed and we were unable to recover it. 00:32:21.142 [2024-11-26 19:18:37.963235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.963448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.963463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.142 qpair failed and we were unable to recover it. 00:32:21.142 [2024-11-26 19:18:37.963611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.963698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.963713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.142 qpair failed and we were unable to recover it. 00:32:21.142 [2024-11-26 19:18:37.963803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.963940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.963959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.142 qpair failed and we were unable to recover it. 00:32:21.142 [2024-11-26 19:18:37.964040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.964120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.964135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.142 qpair failed and we were unable to recover it. 00:32:21.142 [2024-11-26 19:18:37.964345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.964430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.964445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.142 qpair failed and we were unable to recover it. 00:32:21.142 [2024-11-26 19:18:37.964678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.964827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.964842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.142 qpair failed and we were unable to recover it. 00:32:21.142 [2024-11-26 19:18:37.964931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.965107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.965123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.142 qpair failed and we were unable to recover it. 00:32:21.142 [2024-11-26 19:18:37.965290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.965400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.965415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.142 qpair failed and we were unable to recover it. 00:32:21.142 [2024-11-26 19:18:37.965516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.965601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.965616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.142 qpair failed and we were unable to recover it. 00:32:21.142 [2024-11-26 19:18:37.965753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.965909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.965924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.142 qpair failed and we were unable to recover it. 00:32:21.142 [2024-11-26 19:18:37.966051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.966143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.966158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.142 qpair failed and we were unable to recover it. 00:32:21.142 [2024-11-26 19:18:37.966265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.966360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.966375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.142 qpair failed and we were unable to recover it. 00:32:21.142 [2024-11-26 19:18:37.966470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.966543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.966558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.142 qpair failed and we were unable to recover it. 00:32:21.142 [2024-11-26 19:18:37.966651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.966748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.966763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.142 qpair failed and we were unable to recover it. 00:32:21.142 [2024-11-26 19:18:37.966850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.966997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.967013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.142 qpair failed and we were unable to recover it. 00:32:21.142 [2024-11-26 19:18:37.967183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.967327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.967342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.142 qpair failed and we were unable to recover it. 00:32:21.142 [2024-11-26 19:18:37.967481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.967782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.967797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.142 qpair failed and we were unable to recover it. 00:32:21.142 [2024-11-26 19:18:37.967934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.142 [2024-11-26 19:18:37.968147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.968163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.143 qpair failed and we were unable to recover it. 00:32:21.143 [2024-11-26 19:18:37.968316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.968395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.968410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.143 qpair failed and we were unable to recover it. 00:32:21.143 [2024-11-26 19:18:37.968592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.968796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.968812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.143 qpair failed and we were unable to recover it. 00:32:21.143 [2024-11-26 19:18:37.968962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.969122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.969136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.143 qpair failed and we were unable to recover it. 00:32:21.143 [2024-11-26 19:18:37.969220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.969375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.969390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.143 qpair failed and we were unable to recover it. 00:32:21.143 [2024-11-26 19:18:37.969578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.969695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.969711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.143 qpair failed and we were unable to recover it. 00:32:21.143 [2024-11-26 19:18:37.969808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.969961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.969976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.143 qpair failed and we were unable to recover it. 00:32:21.143 [2024-11-26 19:18:37.970075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.970168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.970183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.143 qpair failed and we were unable to recover it. 00:32:21.143 [2024-11-26 19:18:37.970380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.970479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.970493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.143 qpair failed and we were unable to recover it. 00:32:21.143 [2024-11-26 19:18:37.970768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.970971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.970987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.143 qpair failed and we were unable to recover it. 00:32:21.143 [2024-11-26 19:18:37.971095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.971245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.971260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.143 qpair failed and we were unable to recover it. 00:32:21.143 [2024-11-26 19:18:37.971394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.971541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.971557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.143 qpair failed and we were unable to recover it. 00:32:21.143 [2024-11-26 19:18:37.971771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.971923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.971939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.143 qpair failed and we were unable to recover it. 00:32:21.143 [2024-11-26 19:18:37.972109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.972201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.972216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.143 qpair failed and we were unable to recover it. 00:32:21.143 [2024-11-26 19:18:37.972421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.972638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.972653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.143 qpair failed and we were unable to recover it. 00:32:21.143 [2024-11-26 19:18:37.972850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.973046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.973062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.143 qpair failed and we were unable to recover it. 00:32:21.143 [2024-11-26 19:18:37.973161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.973248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.973264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.143 qpair failed and we were unable to recover it. 00:32:21.143 [2024-11-26 19:18:37.973364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.973453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.973468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.143 qpair failed and we were unable to recover it. 00:32:21.143 [2024-11-26 19:18:37.973658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.973797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.973812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.143 qpair failed and we were unable to recover it. 00:32:21.143 [2024-11-26 19:18:37.973994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.974098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.974114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.143 qpair failed and we were unable to recover it. 00:32:21.143 [2024-11-26 19:18:37.974221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.974375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.974391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.143 qpair failed and we were unable to recover it. 00:32:21.143 [2024-11-26 19:18:37.974542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.974798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.974813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.143 qpair failed and we were unable to recover it. 00:32:21.143 [2024-11-26 19:18:37.974966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.975114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.975129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.143 qpair failed and we were unable to recover it. 00:32:21.143 [2024-11-26 19:18:37.975283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.975367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.975383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.143 qpair failed and we were unable to recover it. 00:32:21.143 [2024-11-26 19:18:37.975522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.975734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.975749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.143 qpair failed and we were unable to recover it. 00:32:21.143 [2024-11-26 19:18:37.975932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.976078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.976094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.143 qpair failed and we were unable to recover it. 00:32:21.143 [2024-11-26 19:18:37.976283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.976433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.976448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.143 qpair failed and we were unable to recover it. 00:32:21.143 [2024-11-26 19:18:37.976596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.976795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.976812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.143 qpair failed and we were unable to recover it. 00:32:21.143 [2024-11-26 19:18:37.976980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.977132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.977148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.143 qpair failed and we were unable to recover it. 00:32:21.143 [2024-11-26 19:18:37.977303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.977442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.977457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.143 qpair failed and we were unable to recover it. 00:32:21.143 [2024-11-26 19:18:37.977560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.977805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.977820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.143 qpair failed and we were unable to recover it. 00:32:21.143 [2024-11-26 19:18:37.978066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.978200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.978216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.143 qpair failed and we were unable to recover it. 00:32:21.143 [2024-11-26 19:18:37.978306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.978397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.978413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.143 qpair failed and we were unable to recover it. 00:32:21.143 [2024-11-26 19:18:37.978553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.978791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.978807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.143 qpair failed and we were unable to recover it. 00:32:21.143 [2024-11-26 19:18:37.978966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.979060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.143 [2024-11-26 19:18:37.979076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.143 qpair failed and we were unable to recover it. 00:32:21.143 [2024-11-26 19:18:37.979225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.144 [2024-11-26 19:18:37.979361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.144 [2024-11-26 19:18:37.979377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.144 qpair failed and we were unable to recover it. 00:32:21.144 [2024-11-26 19:18:37.979521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.144 [2024-11-26 19:18:37.979725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.144 [2024-11-26 19:18:37.979740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.144 qpair failed and we were unable to recover it. 00:32:21.144 [2024-11-26 19:18:37.979833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.144 [2024-11-26 19:18:37.979905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.144 [2024-11-26 19:18:37.979920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.144 qpair failed and we were unable to recover it. 00:32:21.144 [2024-11-26 19:18:37.980163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.144 [2024-11-26 19:18:37.980300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.144 [2024-11-26 19:18:37.980315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.144 qpair failed and we were unable to recover it. 00:32:21.144 [2024-11-26 19:18:37.980517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.144 [2024-11-26 19:18:37.980598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.144 [2024-11-26 19:18:37.980613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.144 qpair failed and we were unable to recover it. 00:32:21.144 [2024-11-26 19:18:37.980699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.144 [2024-11-26 19:18:37.980799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.144 [2024-11-26 19:18:37.980815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.144 qpair failed and we were unable to recover it. 00:32:21.144 [2024-11-26 19:18:37.981068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.144 [2024-11-26 19:18:37.981143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.144 [2024-11-26 19:18:37.981158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.144 qpair failed and we were unable to recover it. 00:32:21.144 [2024-11-26 19:18:37.981231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.144 [2024-11-26 19:18:37.981318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.144 [2024-11-26 19:18:37.981333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.144 qpair failed and we were unable to recover it. 00:32:21.144 [2024-11-26 19:18:37.981484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.144 [2024-11-26 19:18:37.981703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.144 [2024-11-26 19:18:37.981719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.144 qpair failed and we were unable to recover it. 00:32:21.144 [2024-11-26 19:18:37.981944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.144 [2024-11-26 19:18:37.982114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.144 [2024-11-26 19:18:37.982130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.144 qpair failed and we were unable to recover it. 00:32:21.144 [2024-11-26 19:18:37.982294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.144 [2024-11-26 19:18:37.982404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.144 [2024-11-26 19:18:37.982419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.144 qpair failed and we were unable to recover it. 00:32:21.144 [2024-11-26 19:18:37.982497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.144 [2024-11-26 19:18:37.982681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.144 [2024-11-26 19:18:37.982696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.144 qpair failed and we were unable to recover it. 00:32:21.144 [2024-11-26 19:18:37.982924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.144 [2024-11-26 19:18:37.983092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.144 [2024-11-26 19:18:37.983109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.144 qpair failed and we were unable to recover it. 00:32:21.144 [2024-11-26 19:18:37.983212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.144 [2024-11-26 19:18:37.983292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.144 [2024-11-26 19:18:37.983307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.144 qpair failed and we were unable to recover it. 00:32:21.144 [2024-11-26 19:18:37.983410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.144 [2024-11-26 19:18:37.983550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.144 [2024-11-26 19:18:37.983565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.144 qpair failed and we were unable to recover it. 00:32:21.144 [2024-11-26 19:18:37.983769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.144 [2024-11-26 19:18:37.983976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.144 [2024-11-26 19:18:37.983992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.144 qpair failed and we were unable to recover it. 00:32:21.144 [2024-11-26 19:18:37.984152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.144 [2024-11-26 19:18:37.984301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.144 [2024-11-26 19:18:37.984317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.144 qpair failed and we were unable to recover it. 00:32:21.144 [2024-11-26 19:18:37.984483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.144 [2024-11-26 19:18:37.984665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.144 [2024-11-26 19:18:37.984679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.144 qpair failed and we were unable to recover it. 00:32:21.145 [2024-11-26 19:18:37.984872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.145 [2024-11-26 19:18:37.985011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.145 [2024-11-26 19:18:37.985027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.145 qpair failed and we were unable to recover it. 00:32:21.145 [2024-11-26 19:18:37.985117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.145 [2024-11-26 19:18:37.985277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.145 [2024-11-26 19:18:37.985293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.145 qpair failed and we were unable to recover it. 00:32:21.145 [2024-11-26 19:18:37.985497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.145 [2024-11-26 19:18:37.985575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.145 [2024-11-26 19:18:37.985591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.145 qpair failed and we were unable to recover it. 00:32:21.145 [2024-11-26 19:18:37.985682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.145 [2024-11-26 19:18:37.985788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.145 [2024-11-26 19:18:37.985804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.145 qpair failed and we were unable to recover it. 00:32:21.145 [2024-11-26 19:18:37.986017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.145 [2024-11-26 19:18:37.986232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.145 [2024-11-26 19:18:37.986248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.145 qpair failed and we were unable to recover it. 00:32:21.145 [2024-11-26 19:18:37.986355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.418 [2024-11-26 19:18:37.986541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.418 [2024-11-26 19:18:37.986556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.418 qpair failed and we were unable to recover it. 00:32:21.418 [2024-11-26 19:18:37.986726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.418 [2024-11-26 19:18:37.986944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.418 [2024-11-26 19:18:37.986965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.418 qpair failed and we were unable to recover it. 00:32:21.418 [2024-11-26 19:18:37.987119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.418 [2024-11-26 19:18:37.987271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.418 [2024-11-26 19:18:37.987286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.418 qpair failed and we were unable to recover it. 00:32:21.418 [2024-11-26 19:18:37.987500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.418 [2024-11-26 19:18:37.987716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.418 [2024-11-26 19:18:37.987732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.418 qpair failed and we were unable to recover it. 00:32:21.418 [2024-11-26 19:18:37.987944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.418 [2024-11-26 19:18:37.988080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.418 [2024-11-26 19:18:37.988096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.418 qpair failed and we were unable to recover it. 00:32:21.418 [2024-11-26 19:18:37.988363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.418 [2024-11-26 19:18:37.988503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.418 [2024-11-26 19:18:37.988517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.418 qpair failed and we were unable to recover it. 00:32:21.418 [2024-11-26 19:18:37.988682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.418 [2024-11-26 19:18:37.988792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.418 [2024-11-26 19:18:37.988807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.418 qpair failed and we were unable to recover it. 00:32:21.418 [2024-11-26 19:18:37.989024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.418 [2024-11-26 19:18:37.989254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.418 [2024-11-26 19:18:37.989270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.418 qpair failed and we were unable to recover it. 00:32:21.418 [2024-11-26 19:18:37.989433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.418 [2024-11-26 19:18:37.989583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.418 [2024-11-26 19:18:37.989598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.418 qpair failed and we were unable to recover it. 00:32:21.418 [2024-11-26 19:18:37.989804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.418 [2024-11-26 19:18:37.989955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.418 [2024-11-26 19:18:37.989972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.418 qpair failed and we were unable to recover it. 00:32:21.418 [2024-11-26 19:18:37.990111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.418 [2024-11-26 19:18:37.990281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.418 [2024-11-26 19:18:37.990296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.418 qpair failed and we were unable to recover it. 00:32:21.418 [2024-11-26 19:18:37.990391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.418 [2024-11-26 19:18:37.990498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.418 [2024-11-26 19:18:37.990513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.418 qpair failed and we were unable to recover it. 00:32:21.418 [2024-11-26 19:18:37.990677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.418 [2024-11-26 19:18:37.990829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.418 [2024-11-26 19:18:37.990845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.418 qpair failed and we were unable to recover it. 00:32:21.418 [2024-11-26 19:18:37.991062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.418 [2024-11-26 19:18:37.991209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.418 [2024-11-26 19:18:37.991225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.418 qpair failed and we were unable to recover it. 00:32:21.418 [2024-11-26 19:18:37.991365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.418 [2024-11-26 19:18:37.991569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.418 [2024-11-26 19:18:37.991585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.418 qpair failed and we were unable to recover it. 00:32:21.418 [2024-11-26 19:18:37.991847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.418 [2024-11-26 19:18:37.992058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.419 [2024-11-26 19:18:37.992073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.419 qpair failed and we were unable to recover it. 00:32:21.419 [2024-11-26 19:18:37.992231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.419 [2024-11-26 19:18:37.992495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.419 [2024-11-26 19:18:37.992510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.419 qpair failed and we were unable to recover it. 00:32:21.419 [2024-11-26 19:18:37.992723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.419 [2024-11-26 19:18:37.992939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.419 [2024-11-26 19:18:37.992960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.419 qpair failed and we were unable to recover it. 00:32:21.419 [2024-11-26 19:18:37.993123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.419 [2024-11-26 19:18:37.993202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.419 [2024-11-26 19:18:37.993217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.419 qpair failed and we were unable to recover it. 00:32:21.419 [2024-11-26 19:18:37.993317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.419 [2024-11-26 19:18:37.993420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.419 [2024-11-26 19:18:37.993436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.419 qpair failed and we were unable to recover it. 00:32:21.419 [2024-11-26 19:18:37.993639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.419 [2024-11-26 19:18:37.993785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.419 [2024-11-26 19:18:37.993800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.419 qpair failed and we were unable to recover it. 00:32:21.419 [2024-11-26 19:18:37.993897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.419 [2024-11-26 19:18:37.994031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.419 [2024-11-26 19:18:37.994047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.419 qpair failed and we were unable to recover it. 00:32:21.419 [2024-11-26 19:18:37.994201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.419 [2024-11-26 19:18:37.994348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.419 [2024-11-26 19:18:37.994363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.419 qpair failed and we were unable to recover it. 00:32:21.419 [2024-11-26 19:18:37.994452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.419 [2024-11-26 19:18:37.994684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.419 [2024-11-26 19:18:37.994699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.419 qpair failed and we were unable to recover it. 00:32:21.419 [2024-11-26 19:18:37.994875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.419 [2024-11-26 19:18:37.995123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.419 [2024-11-26 19:18:37.995139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.419 qpair failed and we were unable to recover it. 00:32:21.419 [2024-11-26 19:18:37.995283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.419 [2024-11-26 19:18:37.995369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.419 [2024-11-26 19:18:37.995385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.419 qpair failed and we were unable to recover it. 00:32:21.419 [2024-11-26 19:18:37.995541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.419 [2024-11-26 19:18:37.995627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.419 [2024-11-26 19:18:37.995643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.419 qpair failed and we were unable to recover it. 00:32:21.419 [2024-11-26 19:18:37.995794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.419 [2024-11-26 19:18:37.995958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.419 [2024-11-26 19:18:37.995977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.419 qpair failed and we were unable to recover it. 00:32:21.419 [2024-11-26 19:18:37.996130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.419 [2024-11-26 19:18:37.996304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.419 [2024-11-26 19:18:37.996319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.419 qpair failed and we were unable to recover it. 00:32:21.419 [2024-11-26 19:18:37.996419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.419 [2024-11-26 19:18:37.996669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.419 [2024-11-26 19:18:37.996684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.419 qpair failed and we were unable to recover it. 00:32:21.419 [2024-11-26 19:18:37.996755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.419 [2024-11-26 19:18:37.996860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.419 [2024-11-26 19:18:37.996876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.419 qpair failed and we were unable to recover it. 00:32:21.419 [2024-11-26 19:18:37.996989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.419 [2024-11-26 19:18:37.997159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.419 [2024-11-26 19:18:37.997174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.419 qpair failed and we were unable to recover it. 00:32:21.419 [2024-11-26 19:18:37.997247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.419 [2024-11-26 19:18:37.997332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.419 [2024-11-26 19:18:37.997347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.419 qpair failed and we were unable to recover it. 00:32:21.419 [2024-11-26 19:18:37.997458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.419 [2024-11-26 19:18:37.997700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.419 [2024-11-26 19:18:37.997716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.419 qpair failed and we were unable to recover it. 00:32:21.419 [2024-11-26 19:18:37.997916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.419 [2024-11-26 19:18:37.998117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.419 [2024-11-26 19:18:37.998134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.419 qpair failed and we were unable to recover it. 00:32:21.419 [2024-11-26 19:18:37.998363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.419 [2024-11-26 19:18:37.998527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.419 [2024-11-26 19:18:37.998542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.419 qpair failed and we were unable to recover it. 00:32:21.419 [2024-11-26 19:18:37.998630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.419 [2024-11-26 19:18:37.998775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.419 [2024-11-26 19:18:37.998789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.419 qpair failed and we were unable to recover it. 00:32:21.419 [2024-11-26 19:18:37.998885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.419 [2024-11-26 19:18:37.999114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.419 [2024-11-26 19:18:37.999134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.419 qpair failed and we were unable to recover it. 00:32:21.419 [2024-11-26 19:18:37.999273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.419 [2024-11-26 19:18:37.999422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.419 [2024-11-26 19:18:37.999437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.419 qpair failed and we were unable to recover it. 00:32:21.419 [2024-11-26 19:18:37.999601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.419 [2024-11-26 19:18:37.999880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.419 [2024-11-26 19:18:37.999895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.419 qpair failed and we were unable to recover it. 00:32:21.419 [2024-11-26 19:18:38.000104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.419 [2024-11-26 19:18:38.000188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.419 [2024-11-26 19:18:38.000202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.419 qpair failed and we were unable to recover it. 00:32:21.419 [2024-11-26 19:18:38.000364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.419 [2024-11-26 19:18:38.000447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.419 [2024-11-26 19:18:38.000462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.419 qpair failed and we were unable to recover it. 00:32:21.419 [2024-11-26 19:18:38.000605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.419 [2024-11-26 19:18:38.000757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.419 [2024-11-26 19:18:38.000772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.419 qpair failed and we were unable to recover it. 00:32:21.419 [2024-11-26 19:18:38.000985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.419 [2024-11-26 19:18:38.001076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.420 [2024-11-26 19:18:38.001091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.420 qpair failed and we were unable to recover it. 00:32:21.420 [2024-11-26 19:18:38.001227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.420 [2024-11-26 19:18:38.001366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.420 [2024-11-26 19:18:38.001381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.420 qpair failed and we were unable to recover it. 00:32:21.420 [2024-11-26 19:18:38.001624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.420 [2024-11-26 19:18:38.001835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.420 [2024-11-26 19:18:38.001851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.420 qpair failed and we were unable to recover it. 00:32:21.420 [2024-11-26 19:18:38.002032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.420 [2024-11-26 19:18:38.002109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.420 [2024-11-26 19:18:38.002124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.420 qpair failed and we were unable to recover it. 00:32:21.420 [2024-11-26 19:18:38.002276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.420 [2024-11-26 19:18:38.002382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.420 [2024-11-26 19:18:38.002399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.420 qpair failed and we were unable to recover it. 00:32:21.420 [2024-11-26 19:18:38.002569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.420 [2024-11-26 19:18:38.002670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.420 [2024-11-26 19:18:38.002686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.420 qpair failed and we were unable to recover it. 00:32:21.420 [2024-11-26 19:18:38.002892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.420 [2024-11-26 19:18:38.003044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.420 [2024-11-26 19:18:38.003061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.420 qpair failed and we were unable to recover it. 00:32:21.420 [2024-11-26 19:18:38.003299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.420 [2024-11-26 19:18:38.003456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.420 [2024-11-26 19:18:38.003472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.420 qpair failed and we were unable to recover it. 00:32:21.420 [2024-11-26 19:18:38.003629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.420 [2024-11-26 19:18:38.003703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.420 [2024-11-26 19:18:38.003719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.420 qpair failed and we were unable to recover it. 00:32:21.420 [2024-11-26 19:18:38.003923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.420 [2024-11-26 19:18:38.004026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.420 [2024-11-26 19:18:38.004042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.420 qpair failed and we were unable to recover it. 00:32:21.420 [2024-11-26 19:18:38.004279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.420 [2024-11-26 19:18:38.004376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.420 [2024-11-26 19:18:38.004392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.420 qpair failed and we were unable to recover it. 00:32:21.420 [2024-11-26 19:18:38.004482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.420 [2024-11-26 19:18:38.004659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.420 [2024-11-26 19:18:38.004674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.420 qpair failed and we were unable to recover it. 00:32:21.420 [2024-11-26 19:18:38.004776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.420 [2024-11-26 19:18:38.004873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.420 [2024-11-26 19:18:38.004888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.420 qpair failed and we were unable to recover it. 00:32:21.420 [2024-11-26 19:18:38.005001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.420 [2024-11-26 19:18:38.005105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.420 [2024-11-26 19:18:38.005120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.420 qpair failed and we were unable to recover it. 00:32:21.420 [2024-11-26 19:18:38.005198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.420 [2024-11-26 19:18:38.005337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.420 [2024-11-26 19:18:38.005354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.420 qpair failed and we were unable to recover it. 00:32:21.420 [2024-11-26 19:18:38.005566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.420 [2024-11-26 19:18:38.005733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.420 [2024-11-26 19:18:38.005749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.420 qpair failed and we were unable to recover it. 00:32:21.420 [2024-11-26 19:18:38.005887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.420 [2024-11-26 19:18:38.006055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.420 [2024-11-26 19:18:38.006072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.420 qpair failed and we were unable to recover it. 00:32:21.420 [2024-11-26 19:18:38.006294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.420 [2024-11-26 19:18:38.006497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.420 [2024-11-26 19:18:38.006512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.420 qpair failed and we were unable to recover it. 00:32:21.420 [2024-11-26 19:18:38.006612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.420 [2024-11-26 19:18:38.006776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.420 [2024-11-26 19:18:38.006791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.420 qpair failed and we were unable to recover it. 00:32:21.420 [2024-11-26 19:18:38.006971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.420 [2024-11-26 19:18:38.007130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.420 [2024-11-26 19:18:38.007145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.420 qpair failed and we were unable to recover it. 00:32:21.420 [2024-11-26 19:18:38.007300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.420 [2024-11-26 19:18:38.007456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.420 [2024-11-26 19:18:38.007471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.420 qpair failed and we were unable to recover it. 00:32:21.420 [2024-11-26 19:18:38.007621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.420 [2024-11-26 19:18:38.007789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.420 [2024-11-26 19:18:38.007804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.420 qpair failed and we were unable to recover it. 00:32:21.420 [2024-11-26 19:18:38.008031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.420 [2024-11-26 19:18:38.008259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.420 [2024-11-26 19:18:38.008274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.420 qpair failed and we were unable to recover it. 00:32:21.420 [2024-11-26 19:18:38.008360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.420 [2024-11-26 19:18:38.008447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.420 [2024-11-26 19:18:38.008462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.420 qpair failed and we were unable to recover it. 00:32:21.420 [2024-11-26 19:18:38.008564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.420 [2024-11-26 19:18:38.008727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.420 [2024-11-26 19:18:38.008742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.420 qpair failed and we were unable to recover it. 00:32:21.420 [2024-11-26 19:18:38.008906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.420 [2024-11-26 19:18:38.009090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.420 [2024-11-26 19:18:38.009105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.420 qpair failed and we were unable to recover it. 00:32:21.420 [2024-11-26 19:18:38.009280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.420 [2024-11-26 19:18:38.009449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.420 [2024-11-26 19:18:38.009465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.420 qpair failed and we were unable to recover it. 00:32:21.420 [2024-11-26 19:18:38.009639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.420 [2024-11-26 19:18:38.009790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.420 [2024-11-26 19:18:38.009805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.420 qpair failed and we were unable to recover it. 00:32:21.420 [2024-11-26 19:18:38.009912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.420 [2024-11-26 19:18:38.010073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.421 [2024-11-26 19:18:38.010090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.421 qpair failed and we were unable to recover it. 00:32:21.421 [2024-11-26 19:18:38.010247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.421 [2024-11-26 19:18:38.010410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.421 [2024-11-26 19:18:38.010425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.421 qpair failed and we were unable to recover it. 00:32:21.421 [2024-11-26 19:18:38.010637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.421 [2024-11-26 19:18:38.010829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.421 [2024-11-26 19:18:38.010844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.421 qpair failed and we were unable to recover it. 00:32:21.421 [2024-11-26 19:18:38.011027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.421 [2024-11-26 19:18:38.011113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.421 [2024-11-26 19:18:38.011130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.421 qpair failed and we were unable to recover it. 00:32:21.421 [2024-11-26 19:18:38.011373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.421 [2024-11-26 19:18:38.011572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.421 [2024-11-26 19:18:38.011587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.421 qpair failed and we were unable to recover it. 00:32:21.421 [2024-11-26 19:18:38.011762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.421 [2024-11-26 19:18:38.011859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.421 [2024-11-26 19:18:38.011873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.421 qpair failed and we were unable to recover it. 00:32:21.421 [2024-11-26 19:18:38.012031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.421 [2024-11-26 19:18:38.012104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.421 [2024-11-26 19:18:38.012118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.421 qpair failed and we were unable to recover it. 00:32:21.421 [2024-11-26 19:18:38.012335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.421 [2024-11-26 19:18:38.012431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.421 [2024-11-26 19:18:38.012446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.421 qpair failed and we were unable to recover it. 00:32:21.421 [2024-11-26 19:18:38.012536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.421 [2024-11-26 19:18:38.012707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.421 [2024-11-26 19:18:38.012724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.421 qpair failed and we were unable to recover it. 00:32:21.421 [2024-11-26 19:18:38.012938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.421 [2024-11-26 19:18:38.013078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.421 [2024-11-26 19:18:38.013093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.421 qpair failed and we were unable to recover it. 00:32:21.421 [2024-11-26 19:18:38.013304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.421 [2024-11-26 19:18:38.013467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.421 [2024-11-26 19:18:38.013483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.421 qpair failed and we were unable to recover it. 00:32:21.421 [2024-11-26 19:18:38.013676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.421 [2024-11-26 19:18:38.013816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.421 [2024-11-26 19:18:38.013831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.421 qpair failed and we were unable to recover it. 00:32:21.421 [2024-11-26 19:18:38.014035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.421 [2024-11-26 19:18:38.014129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.421 [2024-11-26 19:18:38.014144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.421 qpair failed and we were unable to recover it. 00:32:21.421 [2024-11-26 19:18:38.014330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.421 [2024-11-26 19:18:38.014493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.421 [2024-11-26 19:18:38.014508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.421 qpair failed and we were unable to recover it. 00:32:21.421 [2024-11-26 19:18:38.014687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.421 [2024-11-26 19:18:38.014942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.421 [2024-11-26 19:18:38.014961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.421 qpair failed and we were unable to recover it. 00:32:21.421 [2024-11-26 19:18:38.015190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.421 [2024-11-26 19:18:38.015338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.421 [2024-11-26 19:18:38.015354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.421 qpair failed and we were unable to recover it. 00:32:21.421 [2024-11-26 19:18:38.015473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.421 [2024-11-26 19:18:38.015608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.421 [2024-11-26 19:18:38.015624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.421 qpair failed and we were unable to recover it. 00:32:21.421 [2024-11-26 19:18:38.015831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.421 [2024-11-26 19:18:38.015981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.421 [2024-11-26 19:18:38.015997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.421 qpair failed and we were unable to recover it. 00:32:21.421 [2024-11-26 19:18:38.016098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.421 [2024-11-26 19:18:38.016198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.421 [2024-11-26 19:18:38.016213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.421 qpair failed and we were unable to recover it. 00:32:21.421 [2024-11-26 19:18:38.016315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.421 [2024-11-26 19:18:38.016413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.421 [2024-11-26 19:18:38.016429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.421 qpair failed and we were unable to recover it. 00:32:21.421 [2024-11-26 19:18:38.016636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.421 [2024-11-26 19:18:38.016721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.421 [2024-11-26 19:18:38.016736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.421 qpair failed and we were unable to recover it. 00:32:21.421 [2024-11-26 19:18:38.016816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.421 [2024-11-26 19:18:38.016958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.421 [2024-11-26 19:18:38.016975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.421 qpair failed and we were unable to recover it. 00:32:21.421 [2024-11-26 19:18:38.017060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.421 [2024-11-26 19:18:38.017204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.421 [2024-11-26 19:18:38.017221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.421 qpair failed and we were unable to recover it. 00:32:21.421 [2024-11-26 19:18:38.017376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.421 [2024-11-26 19:18:38.017586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.421 [2024-11-26 19:18:38.017601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.421 qpair failed and we were unable to recover it. 00:32:21.421 [2024-11-26 19:18:38.017808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.421 [2024-11-26 19:18:38.017966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.421 [2024-11-26 19:18:38.017983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.421 qpair failed and we were unable to recover it. 00:32:21.421 [2024-11-26 19:18:38.018095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.421 [2024-11-26 19:18:38.018194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.421 [2024-11-26 19:18:38.018209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.421 qpair failed and we were unable to recover it. 00:32:21.421 [2024-11-26 19:18:38.018375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.421 [2024-11-26 19:18:38.018528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.421 [2024-11-26 19:18:38.018544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.421 qpair failed and we were unable to recover it. 00:32:21.421 [2024-11-26 19:18:38.018651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.421 [2024-11-26 19:18:38.018844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.421 [2024-11-26 19:18:38.018859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.421 qpair failed and we were unable to recover it. 00:32:21.421 [2024-11-26 19:18:38.018953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.421 [2024-11-26 19:18:38.019134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.421 [2024-11-26 19:18:38.019150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.421 qpair failed and we were unable to recover it. 00:32:21.421 [2024-11-26 19:18:38.019359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.421 [2024-11-26 19:18:38.019515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.422 [2024-11-26 19:18:38.019530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.422 qpair failed and we were unable to recover it. 00:32:21.422 [2024-11-26 19:18:38.019813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.422 [2024-11-26 19:18:38.019950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.422 [2024-11-26 19:18:38.019966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.422 qpair failed and we were unable to recover it. 00:32:21.422 [2024-11-26 19:18:38.020087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.422 [2024-11-26 19:18:38.020289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.422 [2024-11-26 19:18:38.020304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.422 qpair failed and we were unable to recover it. 00:32:21.422 [2024-11-26 19:18:38.020448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.422 [2024-11-26 19:18:38.020623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.422 [2024-11-26 19:18:38.020639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.422 qpair failed and we were unable to recover it. 00:32:21.422 [2024-11-26 19:18:38.020864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.422 [2024-11-26 19:18:38.021043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.422 [2024-11-26 19:18:38.021059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.422 qpair failed and we were unable to recover it. 00:32:21.422 [2024-11-26 19:18:38.021169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.422 [2024-11-26 19:18:38.021315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.422 [2024-11-26 19:18:38.021330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.422 qpair failed and we were unable to recover it. 00:32:21.422 [2024-11-26 19:18:38.021438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.422 [2024-11-26 19:18:38.021705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.422 [2024-11-26 19:18:38.021721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.422 qpair failed and we were unable to recover it. 00:32:21.422 [2024-11-26 19:18:38.021872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.422 [2024-11-26 19:18:38.021970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.422 [2024-11-26 19:18:38.021986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.422 qpair failed and we were unable to recover it. 00:32:21.422 [2024-11-26 19:18:38.022098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.422 [2024-11-26 19:18:38.022286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.422 [2024-11-26 19:18:38.022301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.422 qpair failed and we were unable to recover it. 00:32:21.422 [2024-11-26 19:18:38.022395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.422 [2024-11-26 19:18:38.022470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.422 [2024-11-26 19:18:38.022484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.422 qpair failed and we were unable to recover it. 00:32:21.422 [2024-11-26 19:18:38.022569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.422 [2024-11-26 19:18:38.022656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.422 [2024-11-26 19:18:38.022671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.422 qpair failed and we were unable to recover it. 00:32:21.422 [2024-11-26 19:18:38.022773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.422 [2024-11-26 19:18:38.022963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.422 [2024-11-26 19:18:38.022979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.422 qpair failed and we were unable to recover it. 00:32:21.422 [2024-11-26 19:18:38.023118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.422 [2024-11-26 19:18:38.023255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.422 [2024-11-26 19:18:38.023270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.422 qpair failed and we were unable to recover it. 00:32:21.422 [2024-11-26 19:18:38.023421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.422 [2024-11-26 19:18:38.023497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.422 [2024-11-26 19:18:38.023512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.422 qpair failed and we were unable to recover it. 00:32:21.422 [2024-11-26 19:18:38.023616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.422 [2024-11-26 19:18:38.023819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.422 [2024-11-26 19:18:38.023834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.422 qpair failed and we were unable to recover it. 00:32:21.422 [2024-11-26 19:18:38.023936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.422 [2024-11-26 19:18:38.024031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.422 [2024-11-26 19:18:38.024046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.422 qpair failed and we were unable to recover it. 00:32:21.422 [2024-11-26 19:18:38.024155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.422 [2024-11-26 19:18:38.024242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.422 [2024-11-26 19:18:38.024258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.422 qpair failed and we were unable to recover it. 00:32:21.422 [2024-11-26 19:18:38.024463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.422 [2024-11-26 19:18:38.024683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.422 [2024-11-26 19:18:38.024698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.422 qpair failed and we were unable to recover it. 00:32:21.422 [2024-11-26 19:18:38.024936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.422 [2024-11-26 19:18:38.025145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.422 [2024-11-26 19:18:38.025162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.422 qpair failed and we were unable to recover it. 00:32:21.422 [2024-11-26 19:18:38.025254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.422 [2024-11-26 19:18:38.025389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.422 [2024-11-26 19:18:38.025404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.422 qpair failed and we were unable to recover it. 00:32:21.422 [2024-11-26 19:18:38.025617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.422 [2024-11-26 19:18:38.025818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.422 [2024-11-26 19:18:38.025833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.422 qpair failed and we were unable to recover it. 00:32:21.422 [2024-11-26 19:18:38.025927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.422 [2024-11-26 19:18:38.026025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.422 [2024-11-26 19:18:38.026041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.422 qpair failed and we were unable to recover it. 00:32:21.422 [2024-11-26 19:18:38.026214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.422 [2024-11-26 19:18:38.026288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.422 [2024-11-26 19:18:38.026303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.422 qpair failed and we were unable to recover it. 00:32:21.422 [2024-11-26 19:18:38.026399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.422 [2024-11-26 19:18:38.026612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.422 [2024-11-26 19:18:38.026627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.422 qpair failed and we were unable to recover it. 00:32:21.422 [2024-11-26 19:18:38.026859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.422 [2024-11-26 19:18:38.026954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.422 [2024-11-26 19:18:38.026971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.422 qpair failed and we were unable to recover it. 00:32:21.422 [2024-11-26 19:18:38.027174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.422 [2024-11-26 19:18:38.027328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.422 [2024-11-26 19:18:38.027343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.422 qpair failed and we were unable to recover it. 00:32:21.422 [2024-11-26 19:18:38.027479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.422 [2024-11-26 19:18:38.027698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.422 [2024-11-26 19:18:38.027713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.422 qpair failed and we were unable to recover it. 00:32:21.422 [2024-11-26 19:18:38.027969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.422 [2024-11-26 19:18:38.028056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.422 [2024-11-26 19:18:38.028071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76e0000b90 with addr=10.0.0.2, port=4420 00:32:21.423 qpair failed and we were unable to recover it. 00:32:21.423 [2024-11-26 19:18:38.028257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.423 [2024-11-26 19:18:38.028365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.423 [2024-11-26 19:18:38.028385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2422af0 with addr=10.0.0.2, port=4420 00:32:21.423 qpair failed and we were unable to recover it. 00:32:21.423 [2024-11-26 19:18:38.028691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.423 [2024-11-26 19:18:38.028966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.423 [2024-11-26 19:18:38.028982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.423 qpair failed and we were unable to recover it. 00:32:21.423 [2024-11-26 19:18:38.029127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.423 [2024-11-26 19:18:38.029223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.423 [2024-11-26 19:18:38.029234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.423 qpair failed and we were unable to recover it. 00:32:21.423 [2024-11-26 19:18:38.029461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.423 [2024-11-26 19:18:38.029636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.423 [2024-11-26 19:18:38.029647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.423 qpair failed and we were unable to recover it. 00:32:21.423 [2024-11-26 19:18:38.029873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.423 [2024-11-26 19:18:38.029939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.423 [2024-11-26 19:18:38.029955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.423 qpair failed and we were unable to recover it. 00:32:21.423 [2024-11-26 19:18:38.030099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.423 [2024-11-26 19:18:38.030191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.423 [2024-11-26 19:18:38.030203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.423 qpair failed and we were unable to recover it. 00:32:21.423 [2024-11-26 19:18:38.030366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.423 [2024-11-26 19:18:38.030463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.423 [2024-11-26 19:18:38.030474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.423 qpair failed and we were unable to recover it. 00:32:21.423 [2024-11-26 19:18:38.030661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.423 [2024-11-26 19:18:38.030866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.423 [2024-11-26 19:18:38.030878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.423 qpair failed and we were unable to recover it. 00:32:21.423 [2024-11-26 19:18:38.031034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.423 [2024-11-26 19:18:38.031120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.423 [2024-11-26 19:18:38.031133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.423 qpair failed and we were unable to recover it. 00:32:21.423 [2024-11-26 19:18:38.031208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.423 [2024-11-26 19:18:38.031350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.423 [2024-11-26 19:18:38.031361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.423 qpair failed and we were unable to recover it. 00:32:21.423 [2024-11-26 19:18:38.031512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.423 [2024-11-26 19:18:38.031593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.423 [2024-11-26 19:18:38.031605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.423 qpair failed and we were unable to recover it. 00:32:21.423 [2024-11-26 19:18:38.031685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.423 [2024-11-26 19:18:38.031879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.423 [2024-11-26 19:18:38.031891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.423 qpair failed and we were unable to recover it. 00:32:21.423 [2024-11-26 19:18:38.031980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.423 [2024-11-26 19:18:38.032074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.423 [2024-11-26 19:18:38.032086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.423 qpair failed and we were unable to recover it. 00:32:21.423 [2024-11-26 19:18:38.032216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.423 [2024-11-26 19:18:38.032295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.423 [2024-11-26 19:18:38.032307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.423 qpair failed and we were unable to recover it. 00:32:21.423 [2024-11-26 19:18:38.032396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.423 [2024-11-26 19:18:38.032481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.423 [2024-11-26 19:18:38.032493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.423 qpair failed and we were unable to recover it. 00:32:21.423 [2024-11-26 19:18:38.032579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.423 [2024-11-26 19:18:38.032657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.423 [2024-11-26 19:18:38.032668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.423 qpair failed and we were unable to recover it. 00:32:21.423 [2024-11-26 19:18:38.032751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.423 [2024-11-26 19:18:38.032864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.423 [2024-11-26 19:18:38.032875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.423 qpair failed and we were unable to recover it. 00:32:21.423 [2024-11-26 19:18:38.033019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.423 [2024-11-26 19:18:38.033115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.423 [2024-11-26 19:18:38.033127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.423 qpair failed and we were unable to recover it. 00:32:21.423 [2024-11-26 19:18:38.033211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.423 [2024-11-26 19:18:38.033277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.423 [2024-11-26 19:18:38.033289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.423 qpair failed and we were unable to recover it. 00:32:21.423 [2024-11-26 19:18:38.033397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.423 [2024-11-26 19:18:38.033533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.423 [2024-11-26 19:18:38.033544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.423 qpair failed and we were unable to recover it. 00:32:21.423 [2024-11-26 19:18:38.033669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.423 [2024-11-26 19:18:38.033889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.423 [2024-11-26 19:18:38.033900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.423 qpair failed and we were unable to recover it. 00:32:21.423 [2024-11-26 19:18:38.034052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.423 [2024-11-26 19:18:38.034192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.423 [2024-11-26 19:18:38.034204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.423 qpair failed and we were unable to recover it. 00:32:21.423 [2024-11-26 19:18:38.034287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.423 [2024-11-26 19:18:38.034429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.423 [2024-11-26 19:18:38.034441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.423 qpair failed and we were unable to recover it. 00:32:21.423 [2024-11-26 19:18:38.034632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.423 [2024-11-26 19:18:38.034785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.423 [2024-11-26 19:18:38.034797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.423 qpair failed and we were unable to recover it. 00:32:21.423 [2024-11-26 19:18:38.034934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.423 [2024-11-26 19:18:38.035086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.423 [2024-11-26 19:18:38.035098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.423 qpair failed and we were unable to recover it. 00:32:21.423 [2024-11-26 19:18:38.035193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.423 [2024-11-26 19:18:38.035394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.423 [2024-11-26 19:18:38.035405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.424 qpair failed and we were unable to recover it. 00:32:21.424 [2024-11-26 19:18:38.035508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.424 [2024-11-26 19:18:38.035675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.424 [2024-11-26 19:18:38.035687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.424 qpair failed and we were unable to recover it. 00:32:21.424 [2024-11-26 19:18:38.035827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.424 [2024-11-26 19:18:38.035974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.424 [2024-11-26 19:18:38.035986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.424 qpair failed and we were unable to recover it. 00:32:21.424 [2024-11-26 19:18:38.036134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.424 [2024-11-26 19:18:38.036216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.424 [2024-11-26 19:18:38.036228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.424 qpair failed and we were unable to recover it. 00:32:21.424 [2024-11-26 19:18:38.036376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.424 [2024-11-26 19:18:38.036442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.424 [2024-11-26 19:18:38.036454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.424 qpair failed and we were unable to recover it. 00:32:21.424 [2024-11-26 19:18:38.036615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.424 [2024-11-26 19:18:38.036755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.424 [2024-11-26 19:18:38.036766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.424 qpair failed and we were unable to recover it. 00:32:21.424 [2024-11-26 19:18:38.036850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.424 [2024-11-26 19:18:38.036980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.424 [2024-11-26 19:18:38.036992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.424 qpair failed and we were unable to recover it. 00:32:21.424 [2024-11-26 19:18:38.037093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.424 [2024-11-26 19:18:38.037224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.424 [2024-11-26 19:18:38.037235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.424 qpair failed and we were unable to recover it. 00:32:21.424 [2024-11-26 19:18:38.037374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.424 [2024-11-26 19:18:38.037454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.424 [2024-11-26 19:18:38.037465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.424 qpair failed and we were unable to recover it. 00:32:21.424 [2024-11-26 19:18:38.037622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.424 [2024-11-26 19:18:38.037803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.424 [2024-11-26 19:18:38.037814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.424 qpair failed and we were unable to recover it. 00:32:21.424 [2024-11-26 19:18:38.038051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.424 [2024-11-26 19:18:38.038197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.424 [2024-11-26 19:18:38.038208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.424 qpair failed and we were unable to recover it. 00:32:21.424 [2024-11-26 19:18:38.038301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.424 [2024-11-26 19:18:38.038456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.424 [2024-11-26 19:18:38.038468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.424 qpair failed and we were unable to recover it. 00:32:21.424 [2024-11-26 19:18:38.038697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.424 [2024-11-26 19:18:38.038787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.424 [2024-11-26 19:18:38.038800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.424 qpair failed and we were unable to recover it. 00:32:21.424 [2024-11-26 19:18:38.038944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.424 [2024-11-26 19:18:38.039028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.424 [2024-11-26 19:18:38.039040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.424 qpair failed and we were unable to recover it. 00:32:21.424 [2024-11-26 19:18:38.039174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.424 [2024-11-26 19:18:38.039373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.424 [2024-11-26 19:18:38.039385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.424 qpair failed and we were unable to recover it. 00:32:21.424 [2024-11-26 19:18:38.039568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.424 [2024-11-26 19:18:38.039806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.424 [2024-11-26 19:18:38.039818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.424 qpair failed and we were unable to recover it. 00:32:21.424 [2024-11-26 19:18:38.040001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.424 [2024-11-26 19:18:38.040213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.424 [2024-11-26 19:18:38.040224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.424 qpair failed and we were unable to recover it. 00:32:21.424 [2024-11-26 19:18:38.040316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.424 [2024-11-26 19:18:38.040459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.424 [2024-11-26 19:18:38.040471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.424 qpair failed and we were unable to recover it. 00:32:21.424 [2024-11-26 19:18:38.040640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.424 [2024-11-26 19:18:38.040786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.424 [2024-11-26 19:18:38.040797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.424 qpair failed and we were unable to recover it. 00:32:21.424 [2024-11-26 19:18:38.040942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.424 [2024-11-26 19:18:38.041091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.424 [2024-11-26 19:18:38.041103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.424 qpair failed and we were unable to recover it. 00:32:21.424 [2024-11-26 19:18:38.041181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.424 [2024-11-26 19:18:38.041379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.424 [2024-11-26 19:18:38.041392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.424 qpair failed and we were unable to recover it. 00:32:21.424 [2024-11-26 19:18:38.041572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.424 [2024-11-26 19:18:38.041720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.424 [2024-11-26 19:18:38.041731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.424 qpair failed and we were unable to recover it. 00:32:21.424 [2024-11-26 19:18:38.041926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.424 [2024-11-26 19:18:38.042106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.424 [2024-11-26 19:18:38.042118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.424 qpair failed and we were unable to recover it. 00:32:21.424 [2024-11-26 19:18:38.042261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.424 [2024-11-26 19:18:38.042361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.424 [2024-11-26 19:18:38.042373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.424 qpair failed and we were unable to recover it. 00:32:21.424 [2024-11-26 19:18:38.042512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.424 [2024-11-26 19:18:38.042718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.424 [2024-11-26 19:18:38.042729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.424 qpair failed and we were unable to recover it. 00:32:21.424 [2024-11-26 19:18:38.042804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.424 [2024-11-26 19:18:38.042982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.424 [2024-11-26 19:18:38.042995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.424 qpair failed and we were unable to recover it. 00:32:21.424 [2024-11-26 19:18:38.043142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.424 [2024-11-26 19:18:38.043283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.424 [2024-11-26 19:18:38.043295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.424 qpair failed and we were unable to recover it. 00:32:21.424 [2024-11-26 19:18:38.043444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.424 [2024-11-26 19:18:38.043582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.424 [2024-11-26 19:18:38.043594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.424 qpair failed and we were unable to recover it. 00:32:21.424 [2024-11-26 19:18:38.043738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.424 [2024-11-26 19:18:38.043829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.424 [2024-11-26 19:18:38.043841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.424 qpair failed and we were unable to recover it. 00:32:21.424 [2024-11-26 19:18:38.043999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.424 [2024-11-26 19:18:38.044150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.424 [2024-11-26 19:18:38.044163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.425 qpair failed and we were unable to recover it. 00:32:21.425 [2024-11-26 19:18:38.044252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.425 [2024-11-26 19:18:38.044338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.425 [2024-11-26 19:18:38.044350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.425 qpair failed and we were unable to recover it. 00:32:21.425 [2024-11-26 19:18:38.044489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.425 [2024-11-26 19:18:38.044558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.425 [2024-11-26 19:18:38.044571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.425 qpair failed and we were unable to recover it. 00:32:21.425 [2024-11-26 19:18:38.044708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.425 [2024-11-26 19:18:38.044857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.425 [2024-11-26 19:18:38.044869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.425 qpair failed and we were unable to recover it. 00:32:21.425 [2024-11-26 19:18:38.045033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.425 [2024-11-26 19:18:38.045132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.425 [2024-11-26 19:18:38.045143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.425 qpair failed and we were unable to recover it. 00:32:21.425 [2024-11-26 19:18:38.045297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.425 [2024-11-26 19:18:38.045429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.425 [2024-11-26 19:18:38.045441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.425 qpair failed and we were unable to recover it. 00:32:21.425 [2024-11-26 19:18:38.045605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.425 [2024-11-26 19:18:38.045806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.425 [2024-11-26 19:18:38.045820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.425 qpair failed and we were unable to recover it. 00:32:21.425 [2024-11-26 19:18:38.045970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.425 [2024-11-26 19:18:38.046151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.425 [2024-11-26 19:18:38.046162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.425 qpair failed and we were unable to recover it. 00:32:21.425 [2024-11-26 19:18:38.046290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.425 [2024-11-26 19:18:38.046387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.425 [2024-11-26 19:18:38.046399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.425 qpair failed and we were unable to recover it. 00:32:21.425 [2024-11-26 19:18:38.046486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.425 [2024-11-26 19:18:38.046709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.425 [2024-11-26 19:18:38.046721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.425 qpair failed and we were unable to recover it. 00:32:21.425 [2024-11-26 19:18:38.046904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.425 [2024-11-26 19:18:38.047065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.425 [2024-11-26 19:18:38.047078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.425 qpair failed and we were unable to recover it. 00:32:21.425 [2024-11-26 19:18:38.047274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.425 [2024-11-26 19:18:38.047357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.425 [2024-11-26 19:18:38.047369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.425 qpair failed and we were unable to recover it. 00:32:21.425 [2024-11-26 19:18:38.047450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.425 [2024-11-26 19:18:38.047616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.425 [2024-11-26 19:18:38.047628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.425 qpair failed and we were unable to recover it. 00:32:21.425 [2024-11-26 19:18:38.047845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.425 [2024-11-26 19:18:38.047933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.425 [2024-11-26 19:18:38.047945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.425 qpair failed and we were unable to recover it. 00:32:21.425 [2024-11-26 19:18:38.048090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.425 [2024-11-26 19:18:38.048245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.425 [2024-11-26 19:18:38.048256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.425 qpair failed and we were unable to recover it. 00:32:21.425 [2024-11-26 19:18:38.048473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.425 [2024-11-26 19:18:38.048656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.425 [2024-11-26 19:18:38.048668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.425 qpair failed and we were unable to recover it. 00:32:21.425 [2024-11-26 19:18:38.048807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.425 [2024-11-26 19:18:38.049035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.425 [2024-11-26 19:18:38.049049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.425 qpair failed and we were unable to recover it. 00:32:21.425 [2024-11-26 19:18:38.049198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.425 [2024-11-26 19:18:38.049298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.425 [2024-11-26 19:18:38.049310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.425 qpair failed and we were unable to recover it. 00:32:21.425 [2024-11-26 19:18:38.049514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.425 [2024-11-26 19:18:38.049660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.425 [2024-11-26 19:18:38.049672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.425 qpair failed and we were unable to recover it. 00:32:21.425 [2024-11-26 19:18:38.049911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.425 [2024-11-26 19:18:38.050003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.425 [2024-11-26 19:18:38.050016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.425 qpair failed and we were unable to recover it. 00:32:21.425 [2024-11-26 19:18:38.050155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.425 [2024-11-26 19:18:38.050296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.425 [2024-11-26 19:18:38.050308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.425 qpair failed and we were unable to recover it. 00:32:21.425 [2024-11-26 19:18:38.050467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.425 [2024-11-26 19:18:38.050643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.425 [2024-11-26 19:18:38.050656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.425 qpair failed and we were unable to recover it. 00:32:21.425 [2024-11-26 19:18:38.050736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.425 [2024-11-26 19:18:38.050832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.425 [2024-11-26 19:18:38.050844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.425 qpair failed and we were unable to recover it. 00:32:21.425 [2024-11-26 19:18:38.051091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.425 [2024-11-26 19:18:38.051244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.425 [2024-11-26 19:18:38.051256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.425 qpair failed and we were unable to recover it. 00:32:21.425 [2024-11-26 19:18:38.051463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.425 [2024-11-26 19:18:38.051524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.425 [2024-11-26 19:18:38.051536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.425 qpair failed and we were unable to recover it. 00:32:21.425 [2024-11-26 19:18:38.051802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.425 [2024-11-26 19:18:38.051940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.425 [2024-11-26 19:18:38.051956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.425 qpair failed and we were unable to recover it. 00:32:21.425 [2024-11-26 19:18:38.052052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.425 [2024-11-26 19:18:38.052149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.425 [2024-11-26 19:18:38.052163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.425 qpair failed and we were unable to recover it. 00:32:21.425 [2024-11-26 19:18:38.052308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.425 [2024-11-26 19:18:38.052389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.425 [2024-11-26 19:18:38.052400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.425 qpair failed and we were unable to recover it. 00:32:21.426 [2024-11-26 19:18:38.052482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.426 [2024-11-26 19:18:38.052700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.426 [2024-11-26 19:18:38.052712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.426 qpair failed and we were unable to recover it. 00:32:21.426 [2024-11-26 19:18:38.052789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.426 [2024-11-26 19:18:38.052858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.426 [2024-11-26 19:18:38.052870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.426 qpair failed and we were unable to recover it. 00:32:21.426 [2024-11-26 19:18:38.053050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.426 [2024-11-26 19:18:38.053148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.426 [2024-11-26 19:18:38.053160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.426 qpair failed and we were unable to recover it. 00:32:21.426 [2024-11-26 19:18:38.053257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.426 [2024-11-26 19:18:38.053364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.426 [2024-11-26 19:18:38.053376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.426 qpair failed and we were unable to recover it. 00:32:21.426 [2024-11-26 19:18:38.053533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.426 [2024-11-26 19:18:38.053615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.426 [2024-11-26 19:18:38.053626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.426 qpair failed and we were unable to recover it. 00:32:21.426 [2024-11-26 19:18:38.053713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.426 [2024-11-26 19:18:38.053955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.426 [2024-11-26 19:18:38.053967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.426 qpair failed and we were unable to recover it. 00:32:21.426 [2024-11-26 19:18:38.054118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.426 [2024-11-26 19:18:38.054341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.426 [2024-11-26 19:18:38.054353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.426 qpair failed and we were unable to recover it. 00:32:21.426 [2024-11-26 19:18:38.054515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.426 [2024-11-26 19:18:38.054607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.426 [2024-11-26 19:18:38.054620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.426 qpair failed and we were unable to recover it. 00:32:21.426 [2024-11-26 19:18:38.054770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.426 [2024-11-26 19:18:38.054866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.426 [2024-11-26 19:18:38.054880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.426 qpair failed and we were unable to recover it. 00:32:21.426 [2024-11-26 19:18:38.054973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.426 [2024-11-26 19:18:38.055221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.426 [2024-11-26 19:18:38.055232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.426 qpair failed and we were unable to recover it. 00:32:21.426 [2024-11-26 19:18:38.055317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.426 [2024-11-26 19:18:38.055464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.426 [2024-11-26 19:18:38.055476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.426 qpair failed and we were unable to recover it. 00:32:21.426 [2024-11-26 19:18:38.055625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.426 [2024-11-26 19:18:38.055755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.426 [2024-11-26 19:18:38.055766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.426 qpair failed and we were unable to recover it. 00:32:21.426 [2024-11-26 19:18:38.055831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.426 [2024-11-26 19:18:38.055904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.426 [2024-11-26 19:18:38.055915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.426 qpair failed and we were unable to recover it. 00:32:21.426 [2024-11-26 19:18:38.056061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.426 [2024-11-26 19:18:38.056278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.426 [2024-11-26 19:18:38.056290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.426 qpair failed and we were unable to recover it. 00:32:21.426 [2024-11-26 19:18:38.056351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.426 [2024-11-26 19:18:38.056427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.426 [2024-11-26 19:18:38.056439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.426 qpair failed and we were unable to recover it. 00:32:21.426 [2024-11-26 19:18:38.056688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.426 [2024-11-26 19:18:38.056829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.426 [2024-11-26 19:18:38.056840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.426 qpair failed and we were unable to recover it. 00:32:21.426 [2024-11-26 19:18:38.056975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.426 [2024-11-26 19:18:38.057060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.426 [2024-11-26 19:18:38.057072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.426 qpair failed and we were unable to recover it. 00:32:21.426 [2024-11-26 19:18:38.057234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.426 [2024-11-26 19:18:38.057457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.426 [2024-11-26 19:18:38.057469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.426 qpair failed and we were unable to recover it. 00:32:21.426 [2024-11-26 19:18:38.057561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.426 [2024-11-26 19:18:38.057717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.426 [2024-11-26 19:18:38.057728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.426 qpair failed and we were unable to recover it. 00:32:21.426 [2024-11-26 19:18:38.058005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.426 [2024-11-26 19:18:38.058093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.426 [2024-11-26 19:18:38.058105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.426 qpair failed and we were unable to recover it. 00:32:21.426 [2024-11-26 19:18:38.058187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.426 [2024-11-26 19:18:38.058367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.426 [2024-11-26 19:18:38.058378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.426 qpair failed and we were unable to recover it. 00:32:21.426 [2024-11-26 19:18:38.058460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.426 [2024-11-26 19:18:38.058540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.426 [2024-11-26 19:18:38.058553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.426 qpair failed and we were unable to recover it. 00:32:21.426 [2024-11-26 19:18:38.058786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.426 [2024-11-26 19:18:38.058983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.426 [2024-11-26 19:18:38.058995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.426 qpair failed and we were unable to recover it. 00:32:21.426 [2024-11-26 19:18:38.059171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.426 [2024-11-26 19:18:38.059319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.426 [2024-11-26 19:18:38.059331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.426 qpair failed and we were unable to recover it. 00:32:21.426 [2024-11-26 19:18:38.059408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.426 [2024-11-26 19:18:38.059492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.426 [2024-11-26 19:18:38.059505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.426 qpair failed and we were unable to recover it. 00:32:21.426 [2024-11-26 19:18:38.059652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.426 [2024-11-26 19:18:38.059737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.426 [2024-11-26 19:18:38.059748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.426 qpair failed and we were unable to recover it. 00:32:21.426 [2024-11-26 19:18:38.059920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.426 [2024-11-26 19:18:38.060079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.426 [2024-11-26 19:18:38.060092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.427 qpair failed and we were unable to recover it. 00:32:21.427 [2024-11-26 19:18:38.060203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.427 [2024-11-26 19:18:38.060341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.427 [2024-11-26 19:18:38.060353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.427 qpair failed and we were unable to recover it. 00:32:21.427 [2024-11-26 19:18:38.060422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.427 [2024-11-26 19:18:38.060589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.427 [2024-11-26 19:18:38.060601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.427 qpair failed and we were unable to recover it. 00:32:21.427 [2024-11-26 19:18:38.060739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.427 [2024-11-26 19:18:38.060935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.427 [2024-11-26 19:18:38.060960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.427 qpair failed and we were unable to recover it. 00:32:21.427 [2024-11-26 19:18:38.061187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.427 [2024-11-26 19:18:38.061261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.427 [2024-11-26 19:18:38.061273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.427 qpair failed and we were unable to recover it. 00:32:21.427 [2024-11-26 19:18:38.061429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.427 [2024-11-26 19:18:38.061498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.427 [2024-11-26 19:18:38.061510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.427 qpair failed and we were unable to recover it. 00:32:21.427 [2024-11-26 19:18:38.061618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.427 [2024-11-26 19:18:38.061770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.427 [2024-11-26 19:18:38.061782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.427 qpair failed and we were unable to recover it. 00:32:21.427 [2024-11-26 19:18:38.062000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.427 [2024-11-26 19:18:38.062086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.427 [2024-11-26 19:18:38.062098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.427 qpair failed and we were unable to recover it. 00:32:21.427 [2024-11-26 19:18:38.062257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.427 [2024-11-26 19:18:38.062459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.427 [2024-11-26 19:18:38.062472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.427 qpair failed and we were unable to recover it. 00:32:21.427 [2024-11-26 19:18:38.062563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.427 [2024-11-26 19:18:38.062714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.427 [2024-11-26 19:18:38.062726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.427 qpair failed and we were unable to recover it. 00:32:21.427 [2024-11-26 19:18:38.062866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.427 [2024-11-26 19:18:38.063019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.427 [2024-11-26 19:18:38.063031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.427 qpair failed and we were unable to recover it. 00:32:21.427 [2024-11-26 19:18:38.063122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.427 [2024-11-26 19:18:38.063268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.427 [2024-11-26 19:18:38.063280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.427 qpair failed and we were unable to recover it. 00:32:21.427 [2024-11-26 19:18:38.063496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.427 [2024-11-26 19:18:38.063687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.427 [2024-11-26 19:18:38.063699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.427 qpair failed and we were unable to recover it. 00:32:21.427 [2024-11-26 19:18:38.063921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.427 [2024-11-26 19:18:38.064072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.427 [2024-11-26 19:18:38.064083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.427 qpair failed and we were unable to recover it. 00:32:21.427 [2024-11-26 19:18:38.064191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.427 [2024-11-26 19:18:38.064285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.427 [2024-11-26 19:18:38.064297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.427 qpair failed and we were unable to recover it. 00:32:21.427 [2024-11-26 19:18:38.064385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.427 [2024-11-26 19:18:38.064468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.427 [2024-11-26 19:18:38.064479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.427 qpair failed and we were unable to recover it. 00:32:21.427 [2024-11-26 19:18:38.064680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.427 [2024-11-26 19:18:38.064819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.427 [2024-11-26 19:18:38.064831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.427 qpair failed and we were unable to recover it. 00:32:21.427 [2024-11-26 19:18:38.064976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.427 [2024-11-26 19:18:38.065171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.427 [2024-11-26 19:18:38.065183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.427 qpair failed and we were unable to recover it. 00:32:21.427 [2024-11-26 19:18:38.065320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.427 [2024-11-26 19:18:38.065394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.427 [2024-11-26 19:18:38.065406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.427 qpair failed and we were unable to recover it. 00:32:21.427 [2024-11-26 19:18:38.065478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.427 [2024-11-26 19:18:38.065565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.427 [2024-11-26 19:18:38.065577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.427 qpair failed and we were unable to recover it. 00:32:21.427 [2024-11-26 19:18:38.065815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.427 [2024-11-26 19:18:38.066019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.427 [2024-11-26 19:18:38.066032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.427 qpair failed and we were unable to recover it. 00:32:21.427 [2024-11-26 19:18:38.066123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.427 [2024-11-26 19:18:38.066271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.427 [2024-11-26 19:18:38.066283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.427 qpair failed and we were unable to recover it. 00:32:21.427 [2024-11-26 19:18:38.066439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.427 [2024-11-26 19:18:38.066597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.427 [2024-11-26 19:18:38.066609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.427 qpair failed and we were unable to recover it. 00:32:21.427 [2024-11-26 19:18:38.066683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.427 [2024-11-26 19:18:38.066742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.427 [2024-11-26 19:18:38.066753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.427 qpair failed and we were unable to recover it. 00:32:21.427 [2024-11-26 19:18:38.066954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.428 [2024-11-26 19:18:38.067030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.428 [2024-11-26 19:18:38.067041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.428 qpair failed and we were unable to recover it. 00:32:21.428 [2024-11-26 19:18:38.067206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.428 [2024-11-26 19:18:38.067282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.428 [2024-11-26 19:18:38.067294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.428 qpair failed and we were unable to recover it. 00:32:21.428 [2024-11-26 19:18:38.067438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.428 [2024-11-26 19:18:38.067685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.428 [2024-11-26 19:18:38.067697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.428 qpair failed and we were unable to recover it. 00:32:21.428 [2024-11-26 19:18:38.067864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.428 [2024-11-26 19:18:38.068073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.428 [2024-11-26 19:18:38.068085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.428 qpair failed and we were unable to recover it. 00:32:21.428 [2024-11-26 19:18:38.068172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.428 [2024-11-26 19:18:38.068250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.428 [2024-11-26 19:18:38.068262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.428 qpair failed and we were unable to recover it. 00:32:21.428 [2024-11-26 19:18:38.068417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.428 [2024-11-26 19:18:38.068515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.428 [2024-11-26 19:18:38.068527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.428 qpair failed and we were unable to recover it. 00:32:21.428 [2024-11-26 19:18:38.068599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.428 [2024-11-26 19:18:38.068822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.428 [2024-11-26 19:18:38.068834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.428 qpair failed and we were unable to recover it. 00:32:21.428 [2024-11-26 19:18:38.068910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.428 [2024-11-26 19:18:38.069061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.428 [2024-11-26 19:18:38.069073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.428 qpair failed and we were unable to recover it. 00:32:21.428 [2024-11-26 19:18:38.069233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.428 [2024-11-26 19:18:38.069368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.428 [2024-11-26 19:18:38.069380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.428 qpair failed and we were unable to recover it. 00:32:21.428 [2024-11-26 19:18:38.069478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.428 [2024-11-26 19:18:38.069712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.428 [2024-11-26 19:18:38.069724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.428 qpair failed and we were unable to recover it. 00:32:21.428 [2024-11-26 19:18:38.069880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.428 [2024-11-26 19:18:38.070092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.428 [2024-11-26 19:18:38.070105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.428 qpair failed and we were unable to recover it. 00:32:21.428 [2024-11-26 19:18:38.070240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.428 [2024-11-26 19:18:38.070333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.428 [2024-11-26 19:18:38.070346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.428 qpair failed and we were unable to recover it. 00:32:21.428 [2024-11-26 19:18:38.070514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.428 [2024-11-26 19:18:38.070688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.428 [2024-11-26 19:18:38.070699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.428 qpair failed and we were unable to recover it. 00:32:21.428 [2024-11-26 19:18:38.070886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.428 [2024-11-26 19:18:38.071110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.428 [2024-11-26 19:18:38.071123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.428 qpair failed and we were unable to recover it. 00:32:21.428 [2024-11-26 19:18:38.071224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.428 [2024-11-26 19:18:38.071383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.428 [2024-11-26 19:18:38.071394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.428 qpair failed and we were unable to recover it. 00:32:21.428 [2024-11-26 19:18:38.071541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.428 [2024-11-26 19:18:38.071679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.428 [2024-11-26 19:18:38.071691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.428 qpair failed and we were unable to recover it. 00:32:21.428 [2024-11-26 19:18:38.071907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.428 [2024-11-26 19:18:38.072072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.428 [2024-11-26 19:18:38.072084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.428 qpair failed and we were unable to recover it. 00:32:21.428 [2024-11-26 19:18:38.072246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.428 [2024-11-26 19:18:38.072322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.428 [2024-11-26 19:18:38.072333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.428 qpair failed and we were unable to recover it. 00:32:21.428 [2024-11-26 19:18:38.072506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.428 [2024-11-26 19:18:38.072742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.428 [2024-11-26 19:18:38.072754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.428 qpair failed and we were unable to recover it. 00:32:21.428 [2024-11-26 19:18:38.072997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.428 [2024-11-26 19:18:38.073213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.428 [2024-11-26 19:18:38.073224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.428 qpair failed and we were unable to recover it. 00:32:21.428 [2024-11-26 19:18:38.073374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.428 [2024-11-26 19:18:38.073528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.428 [2024-11-26 19:18:38.073540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.428 qpair failed and we were unable to recover it. 00:32:21.428 [2024-11-26 19:18:38.073677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.428 [2024-11-26 19:18:38.073821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.428 [2024-11-26 19:18:38.073833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.428 qpair failed and we were unable to recover it. 00:32:21.428 [2024-11-26 19:18:38.074037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.428 [2024-11-26 19:18:38.074187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.428 [2024-11-26 19:18:38.074199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.428 qpair failed and we were unable to recover it. 00:32:21.428 [2024-11-26 19:18:38.074294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.428 [2024-11-26 19:18:38.074442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.428 [2024-11-26 19:18:38.074454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.428 qpair failed and we were unable to recover it. 00:32:21.428 [2024-11-26 19:18:38.074518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.428 [2024-11-26 19:18:38.074778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.428 [2024-11-26 19:18:38.074789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.428 qpair failed and we were unable to recover it. 00:32:21.428 [2024-11-26 19:18:38.074934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.428 [2024-11-26 19:18:38.075034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.428 [2024-11-26 19:18:38.075047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.428 qpair failed and we were unable to recover it. 00:32:21.428 [2024-11-26 19:18:38.075194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.428 [2024-11-26 19:18:38.075288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.428 [2024-11-26 19:18:38.075299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.428 qpair failed and we were unable to recover it. 00:32:21.428 [2024-11-26 19:18:38.075428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.428 [2024-11-26 19:18:38.075509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.428 [2024-11-26 19:18:38.075520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.428 qpair failed and we were unable to recover it. 00:32:21.428 [2024-11-26 19:18:38.075686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.428 [2024-11-26 19:18:38.075859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.428 [2024-11-26 19:18:38.075870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.428 qpair failed and we were unable to recover it. 00:32:21.428 [2024-11-26 19:18:38.076004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.429 [2024-11-26 19:18:38.076140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.429 [2024-11-26 19:18:38.076151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.429 qpair failed and we were unable to recover it. 00:32:21.429 [2024-11-26 19:18:38.076298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.429 [2024-11-26 19:18:38.076465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.429 [2024-11-26 19:18:38.076477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.429 qpair failed and we were unable to recover it. 00:32:21.429 [2024-11-26 19:18:38.076543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.429 [2024-11-26 19:18:38.076737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.429 [2024-11-26 19:18:38.076749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.429 qpair failed and we were unable to recover it. 00:32:21.429 [2024-11-26 19:18:38.076835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.429 [2024-11-26 19:18:38.076913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.429 [2024-11-26 19:18:38.076924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.429 qpair failed and we were unable to recover it. 00:32:21.429 [2024-11-26 19:18:38.077042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.429 [2024-11-26 19:18:38.077273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.429 [2024-11-26 19:18:38.077284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.429 qpair failed and we were unable to recover it. 00:32:21.429 [2024-11-26 19:18:38.077435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.429 [2024-11-26 19:18:38.077512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.429 [2024-11-26 19:18:38.077524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.429 qpair failed and we were unable to recover it. 00:32:21.429 [2024-11-26 19:18:38.077691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.429 [2024-11-26 19:18:38.077793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.429 [2024-11-26 19:18:38.077804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.429 qpair failed and we were unable to recover it. 00:32:21.429 [2024-11-26 19:18:38.077897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.429 [2024-11-26 19:18:38.078135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.429 [2024-11-26 19:18:38.078148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.429 qpair failed and we were unable to recover it. 00:32:21.429 [2024-11-26 19:18:38.078390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.429 [2024-11-26 19:18:38.078579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.429 [2024-11-26 19:18:38.078591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.429 qpair failed and we were unable to recover it. 00:32:21.429 [2024-11-26 19:18:38.078667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.429 [2024-11-26 19:18:38.078796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.429 [2024-11-26 19:18:38.078808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.429 qpair failed and we were unable to recover it. 00:32:21.429 [2024-11-26 19:18:38.078951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.429 [2024-11-26 19:18:38.079062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.429 [2024-11-26 19:18:38.079074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.429 qpair failed and we were unable to recover it. 00:32:21.429 [2024-11-26 19:18:38.079281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.429 [2024-11-26 19:18:38.079419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.429 [2024-11-26 19:18:38.079431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.429 qpair failed and we were unable to recover it. 00:32:21.429 [2024-11-26 19:18:38.079516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.429 [2024-11-26 19:18:38.079787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.429 [2024-11-26 19:18:38.079799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.429 qpair failed and we were unable to recover it. 00:32:21.429 [2024-11-26 19:18:38.079942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.429 [2024-11-26 19:18:38.080033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.429 [2024-11-26 19:18:38.080046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.429 qpair failed and we were unable to recover it. 00:32:21.429 [2024-11-26 19:18:38.080219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.429 [2024-11-26 19:18:38.080417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.429 [2024-11-26 19:18:38.080428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.429 qpair failed and we were unable to recover it. 00:32:21.429 [2024-11-26 19:18:38.080587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.429 [2024-11-26 19:18:38.080715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.429 [2024-11-26 19:18:38.080727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.429 qpair failed and we were unable to recover it. 00:32:21.429 [2024-11-26 19:18:38.080876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.429 [2024-11-26 19:18:38.081041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.429 [2024-11-26 19:18:38.081053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.429 qpair failed and we were unable to recover it. 00:32:21.429 [2024-11-26 19:18:38.081148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.429 [2024-11-26 19:18:38.081230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.429 [2024-11-26 19:18:38.081241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.429 qpair failed and we were unable to recover it. 00:32:21.429 [2024-11-26 19:18:38.081303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.429 [2024-11-26 19:18:38.081441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.429 [2024-11-26 19:18:38.081453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.429 qpair failed and we were unable to recover it. 00:32:21.429 [2024-11-26 19:18:38.081563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.429 [2024-11-26 19:18:38.081731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.429 [2024-11-26 19:18:38.081742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.429 qpair failed and we were unable to recover it. 00:32:21.429 [2024-11-26 19:18:38.081958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.429 [2024-11-26 19:18:38.082182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.429 [2024-11-26 19:18:38.082194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.429 qpair failed and we were unable to recover it. 00:32:21.429 [2024-11-26 19:18:38.082266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.429 [2024-11-26 19:18:38.082426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.429 [2024-11-26 19:18:38.082437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.429 qpair failed and we were unable to recover it. 00:32:21.429 [2024-11-26 19:18:38.082610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.429 [2024-11-26 19:18:38.082807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.429 [2024-11-26 19:18:38.082819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.429 qpair failed and we were unable to recover it. 00:32:21.429 [2024-11-26 19:18:38.082892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.429 [2024-11-26 19:18:38.083086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.429 [2024-11-26 19:18:38.083098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.429 qpair failed and we were unable to recover it. 00:32:21.429 [2024-11-26 19:18:38.083192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.429 [2024-11-26 19:18:38.083322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.429 [2024-11-26 19:18:38.083334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.429 qpair failed and we were unable to recover it. 00:32:21.429 [2024-11-26 19:18:38.083423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.429 [2024-11-26 19:18:38.083582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.429 [2024-11-26 19:18:38.083594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.429 qpair failed and we were unable to recover it. 00:32:21.429 [2024-11-26 19:18:38.083735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.429 [2024-11-26 19:18:38.083933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.429 [2024-11-26 19:18:38.083944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.429 qpair failed and we were unable to recover it. 00:32:21.429 [2024-11-26 19:18:38.084132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.429 [2024-11-26 19:18:38.084275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.429 [2024-11-26 19:18:38.084287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.430 qpair failed and we were unable to recover it. 00:32:21.430 [2024-11-26 19:18:38.084354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.430 [2024-11-26 19:18:38.084500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.430 [2024-11-26 19:18:38.084512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.430 qpair failed and we were unable to recover it. 00:32:21.430 [2024-11-26 19:18:38.084606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.430 [2024-11-26 19:18:38.084742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.430 [2024-11-26 19:18:38.084754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.430 qpair failed and we were unable to recover it. 00:32:21.430 [2024-11-26 19:18:38.084902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.430 [2024-11-26 19:18:38.085048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.430 [2024-11-26 19:18:38.085060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.430 qpair failed and we were unable to recover it. 00:32:21.430 [2024-11-26 19:18:38.085230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.430 [2024-11-26 19:18:38.085438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.430 [2024-11-26 19:18:38.085451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.430 qpair failed and we were unable to recover it. 00:32:21.430 [2024-11-26 19:18:38.085531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.430 [2024-11-26 19:18:38.085773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.430 [2024-11-26 19:18:38.085785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.430 qpair failed and we were unable to recover it. 00:32:21.430 [2024-11-26 19:18:38.086051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.430 [2024-11-26 19:18:38.086186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.430 [2024-11-26 19:18:38.086197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.430 qpair failed and we were unable to recover it. 00:32:21.430 [2024-11-26 19:18:38.086281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.430 [2024-11-26 19:18:38.086372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.430 [2024-11-26 19:18:38.086383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.430 qpair failed and we were unable to recover it. 00:32:21.430 [2024-11-26 19:18:38.086455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.430 [2024-11-26 19:18:38.086542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.430 [2024-11-26 19:18:38.086554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.430 qpair failed and we were unable to recover it. 00:32:21.430 [2024-11-26 19:18:38.086629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.430 [2024-11-26 19:18:38.086716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.430 [2024-11-26 19:18:38.086727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.430 qpair failed and we were unable to recover it. 00:32:21.430 [2024-11-26 19:18:38.086895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.430 [2024-11-26 19:18:38.087107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.430 [2024-11-26 19:18:38.087119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.430 qpair failed and we were unable to recover it. 00:32:21.430 [2024-11-26 19:18:38.087200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.430 [2024-11-26 19:18:38.087337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.430 [2024-11-26 19:18:38.087348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.430 qpair failed and we were unable to recover it. 00:32:21.430 [2024-11-26 19:18:38.087492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.430 [2024-11-26 19:18:38.087656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.430 [2024-11-26 19:18:38.087667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.430 qpair failed and we were unable to recover it. 00:32:21.430 [2024-11-26 19:18:38.087807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.430 [2024-11-26 19:18:38.087938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.430 [2024-11-26 19:18:38.087953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.430 qpair failed and we were unable to recover it. 00:32:21.430 [2024-11-26 19:18:38.088109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.430 [2024-11-26 19:18:38.088256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.430 [2024-11-26 19:18:38.088267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.430 qpair failed and we were unable to recover it. 00:32:21.430 [2024-11-26 19:18:38.088406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.430 [2024-11-26 19:18:38.088491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.430 [2024-11-26 19:18:38.088503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.430 qpair failed and we were unable to recover it. 00:32:21.430 [2024-11-26 19:18:38.088773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.430 [2024-11-26 19:18:38.088925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.430 [2024-11-26 19:18:38.088937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.430 qpair failed and we were unable to recover it. 00:32:21.430 [2024-11-26 19:18:38.089121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.430 [2024-11-26 19:18:38.089342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.430 [2024-11-26 19:18:38.089355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.430 qpair failed and we were unable to recover it. 00:32:21.430 [2024-11-26 19:18:38.089573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.430 [2024-11-26 19:18:38.089731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.430 [2024-11-26 19:18:38.089743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.430 qpair failed and we were unable to recover it. 00:32:21.430 [2024-11-26 19:18:38.089985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.430 [2024-11-26 19:18:38.090144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.430 [2024-11-26 19:18:38.090155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.430 qpair failed and we were unable to recover it. 00:32:21.430 [2024-11-26 19:18:38.090263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.430 [2024-11-26 19:18:38.090409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.430 [2024-11-26 19:18:38.090421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.430 qpair failed and we were unable to recover it. 00:32:21.430 [2024-11-26 19:18:38.090662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.430 [2024-11-26 19:18:38.090743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.430 [2024-11-26 19:18:38.090754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.430 qpair failed and we were unable to recover it. 00:32:21.430 [2024-11-26 19:18:38.090952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.430 [2024-11-26 19:18:38.091099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.430 [2024-11-26 19:18:38.091111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.430 qpair failed and we were unable to recover it. 00:32:21.430 [2024-11-26 19:18:38.091252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.430 [2024-11-26 19:18:38.091384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.430 [2024-11-26 19:18:38.091399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.430 qpair failed and we were unable to recover it. 00:32:21.430 [2024-11-26 19:18:38.091648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.430 [2024-11-26 19:18:38.091775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.430 [2024-11-26 19:18:38.091786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.430 qpair failed and we were unable to recover it. 00:32:21.430 [2024-11-26 19:18:38.091874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.430 [2024-11-26 19:18:38.092097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.430 [2024-11-26 19:18:38.092110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.430 qpair failed and we were unable to recover it. 00:32:21.430 [2024-11-26 19:18:38.092210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.430 [2024-11-26 19:18:38.092306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.430 [2024-11-26 19:18:38.092318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.430 qpair failed and we were unable to recover it. 00:32:21.430 [2024-11-26 19:18:38.092386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.430 [2024-11-26 19:18:38.092534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.430 [2024-11-26 19:18:38.092547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.430 qpair failed and we were unable to recover it. 00:32:21.430 [2024-11-26 19:18:38.092650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.430 [2024-11-26 19:18:38.092801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.430 [2024-11-26 19:18:38.092813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.431 qpair failed and we were unable to recover it. 00:32:21.431 [2024-11-26 19:18:38.092975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.431 [2024-11-26 19:18:38.093175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.431 [2024-11-26 19:18:38.093186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.431 qpair failed and we were unable to recover it. 00:32:21.431 [2024-11-26 19:18:38.093330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.431 [2024-11-26 19:18:38.093471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.431 [2024-11-26 19:18:38.093482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.431 qpair failed and we were unable to recover it. 00:32:21.431 [2024-11-26 19:18:38.093658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.431 [2024-11-26 19:18:38.093859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.431 [2024-11-26 19:18:38.093871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.431 qpair failed and we were unable to recover it. 00:32:21.431 [2024-11-26 19:18:38.094023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.431 [2024-11-26 19:18:38.094122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.431 [2024-11-26 19:18:38.094134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.431 qpair failed and we were unable to recover it. 00:32:21.431 [2024-11-26 19:18:38.094330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.431 [2024-11-26 19:18:38.094408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.431 [2024-11-26 19:18:38.094422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.431 qpair failed and we were unable to recover it. 00:32:21.431 [2024-11-26 19:18:38.094552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.431 [2024-11-26 19:18:38.094678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.431 [2024-11-26 19:18:38.094689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.431 qpair failed and we were unable to recover it. 00:32:21.431 [2024-11-26 19:18:38.094817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.431 [2024-11-26 19:18:38.094962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.431 [2024-11-26 19:18:38.094974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.431 qpair failed and we were unable to recover it. 00:32:21.431 [2024-11-26 19:18:38.095085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.431 [2024-11-26 19:18:38.095181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.431 [2024-11-26 19:18:38.095192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.431 qpair failed and we were unable to recover it. 00:32:21.431 [2024-11-26 19:18:38.095387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.431 [2024-11-26 19:18:38.095468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.431 [2024-11-26 19:18:38.095480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.431 qpair failed and we were unable to recover it. 00:32:21.431 [2024-11-26 19:18:38.095567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.431 [2024-11-26 19:18:38.095704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.431 [2024-11-26 19:18:38.095716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.431 qpair failed and we were unable to recover it. 00:32:21.431 [2024-11-26 19:18:38.095864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.431 [2024-11-26 19:18:38.096038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.431 [2024-11-26 19:18:38.096051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.431 qpair failed and we were unable to recover it. 00:32:21.431 [2024-11-26 19:18:38.096182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.431 [2024-11-26 19:18:38.096308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.431 [2024-11-26 19:18:38.096319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.431 qpair failed and we were unable to recover it. 00:32:21.431 [2024-11-26 19:18:38.096454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.431 [2024-11-26 19:18:38.096611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.431 [2024-11-26 19:18:38.096623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.431 qpair failed and we were unable to recover it. 00:32:21.431 [2024-11-26 19:18:38.096761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.431 [2024-11-26 19:18:38.096984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.431 [2024-11-26 19:18:38.096995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.431 qpair failed and we were unable to recover it. 00:32:21.431 [2024-11-26 19:18:38.097145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.431 [2024-11-26 19:18:38.097217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.431 [2024-11-26 19:18:38.097230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.431 qpair failed and we were unable to recover it. 00:32:21.431 [2024-11-26 19:18:38.097329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.431 [2024-11-26 19:18:38.097408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.431 [2024-11-26 19:18:38.097419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.431 qpair failed and we were unable to recover it. 00:32:21.431 [2024-11-26 19:18:38.097555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.431 [2024-11-26 19:18:38.097687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.431 [2024-11-26 19:18:38.097699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.431 qpair failed and we were unable to recover it. 00:32:21.431 [2024-11-26 19:18:38.097810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.431 [2024-11-26 19:18:38.098004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.431 [2024-11-26 19:18:38.098016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.431 qpair failed and we were unable to recover it. 00:32:21.431 [2024-11-26 19:18:38.098167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.431 [2024-11-26 19:18:38.098312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.431 [2024-11-26 19:18:38.098325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.431 qpair failed and we were unable to recover it. 00:32:21.431 [2024-11-26 19:18:38.098461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.431 [2024-11-26 19:18:38.098704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.431 [2024-11-26 19:18:38.098715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.431 qpair failed and we were unable to recover it. 00:32:21.431 [2024-11-26 19:18:38.098990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.431 [2024-11-26 19:18:38.099086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.431 [2024-11-26 19:18:38.099098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.431 qpair failed and we were unable to recover it. 00:32:21.431 [2024-11-26 19:18:38.099245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.431 [2024-11-26 19:18:38.099331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.431 [2024-11-26 19:18:38.099342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.431 qpair failed and we were unable to recover it. 00:32:21.431 [2024-11-26 19:18:38.099419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.431 [2024-11-26 19:18:38.099502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.431 [2024-11-26 19:18:38.099514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.431 qpair failed and we were unable to recover it. 00:32:21.431 [2024-11-26 19:18:38.099596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.431 [2024-11-26 19:18:38.099871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.431 [2024-11-26 19:18:38.099882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.431 qpair failed and we were unable to recover it. 00:32:21.431 [2024-11-26 19:18:38.100029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.431 [2024-11-26 19:18:38.100184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.431 [2024-11-26 19:18:38.100199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.431 qpair failed and we were unable to recover it. 00:32:21.431 [2024-11-26 19:18:38.100347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.431 [2024-11-26 19:18:38.100456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.431 [2024-11-26 19:18:38.100468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.431 qpair failed and we were unable to recover it. 00:32:21.431 [2024-11-26 19:18:38.100544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.431 [2024-11-26 19:18:38.100689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.431 [2024-11-26 19:18:38.100700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.431 qpair failed and we were unable to recover it. 00:32:21.431 [2024-11-26 19:18:38.100842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.432 [2024-11-26 19:18:38.100976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.432 [2024-11-26 19:18:38.100989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.432 qpair failed and we were unable to recover it. 00:32:21.432 [2024-11-26 19:18:38.101124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.432 [2024-11-26 19:18:38.101272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.432 [2024-11-26 19:18:38.101285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.432 qpair failed and we were unable to recover it. 00:32:21.432 [2024-11-26 19:18:38.101375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.432 [2024-11-26 19:18:38.101482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.432 [2024-11-26 19:18:38.101493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.432 qpair failed and we were unable to recover it. 00:32:21.432 [2024-11-26 19:18:38.101622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.432 [2024-11-26 19:18:38.101765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.432 [2024-11-26 19:18:38.101776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.432 qpair failed and we were unable to recover it. 00:32:21.432 [2024-11-26 19:18:38.101918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.432 [2024-11-26 19:18:38.102144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.432 [2024-11-26 19:18:38.102155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.432 qpair failed and we were unable to recover it. 00:32:21.432 [2024-11-26 19:18:38.102378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.432 [2024-11-26 19:18:38.102514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.432 [2024-11-26 19:18:38.102526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.432 qpair failed and we were unable to recover it. 00:32:21.432 [2024-11-26 19:18:38.102723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.432 [2024-11-26 19:18:38.102861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.432 [2024-11-26 19:18:38.102872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.432 qpair failed and we were unable to recover it. 00:32:21.432 [2024-11-26 19:18:38.103054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.432 [2024-11-26 19:18:38.103200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.432 [2024-11-26 19:18:38.103211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.432 qpair failed and we were unable to recover it. 00:32:21.432 [2024-11-26 19:18:38.103454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.432 [2024-11-26 19:18:38.103527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.432 [2024-11-26 19:18:38.103539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.432 qpair failed and we were unable to recover it. 00:32:21.432 [2024-11-26 19:18:38.103697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.432 [2024-11-26 19:18:38.103912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.432 [2024-11-26 19:18:38.103924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.432 qpair failed and we were unable to recover it. 00:32:21.432 [2024-11-26 19:18:38.104003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.432 [2024-11-26 19:18:38.104153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.432 [2024-11-26 19:18:38.104165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.432 qpair failed and we were unable to recover it. 00:32:21.432 [2024-11-26 19:18:38.104306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.432 [2024-11-26 19:18:38.104381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.432 [2024-11-26 19:18:38.104392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.432 qpair failed and we were unable to recover it. 00:32:21.432 [2024-11-26 19:18:38.104539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.432 [2024-11-26 19:18:38.104628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.432 [2024-11-26 19:18:38.104640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.432 qpair failed and we were unable to recover it. 00:32:21.432 [2024-11-26 19:18:38.104836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.432 [2024-11-26 19:18:38.104916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.432 [2024-11-26 19:18:38.104929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.432 qpair failed and we were unable to recover it. 00:32:21.432 [2024-11-26 19:18:38.105101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.432 [2024-11-26 19:18:38.105300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.432 [2024-11-26 19:18:38.105312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.432 qpair failed and we were unable to recover it. 00:32:21.432 [2024-11-26 19:18:38.105452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.432 [2024-11-26 19:18:38.105659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.432 [2024-11-26 19:18:38.105671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.432 qpair failed and we were unable to recover it. 00:32:21.432 [2024-11-26 19:18:38.105810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.432 [2024-11-26 19:18:38.106006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.432 [2024-11-26 19:18:38.106019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.432 qpair failed and we were unable to recover it. 00:32:21.432 [2024-11-26 19:18:38.106213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.432 [2024-11-26 19:18:38.106382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.432 [2024-11-26 19:18:38.106393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.432 qpair failed and we were unable to recover it. 00:32:21.432 [2024-11-26 19:18:38.106597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.432 [2024-11-26 19:18:38.106794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.432 [2024-11-26 19:18:38.106806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.432 qpair failed and we were unable to recover it. 00:32:21.432 [2024-11-26 19:18:38.106976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.432 [2024-11-26 19:18:38.107174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.432 [2024-11-26 19:18:38.107186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.432 qpair failed and we were unable to recover it. 00:32:21.432 [2024-11-26 19:18:38.107351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.432 [2024-11-26 19:18:38.107431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.432 [2024-11-26 19:18:38.107444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.432 qpair failed and we were unable to recover it. 00:32:21.432 [2024-11-26 19:18:38.107588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.432 [2024-11-26 19:18:38.107822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.432 [2024-11-26 19:18:38.107834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.432 qpair failed and we were unable to recover it. 00:32:21.432 [2024-11-26 19:18:38.107979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.432 [2024-11-26 19:18:38.108203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.432 [2024-11-26 19:18:38.108215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.432 qpair failed and we were unable to recover it. 00:32:21.432 [2024-11-26 19:18:38.108312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.432 [2024-11-26 19:18:38.108398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.432 [2024-11-26 19:18:38.108409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.432 qpair failed and we were unable to recover it. 00:32:21.432 [2024-11-26 19:18:38.108507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.432 [2024-11-26 19:18:38.108652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.432 [2024-11-26 19:18:38.108664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.432 qpair failed and we were unable to recover it. 00:32:21.432 [2024-11-26 19:18:38.108823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.432 [2024-11-26 19:18:38.109035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.433 [2024-11-26 19:18:38.109047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.433 qpair failed and we were unable to recover it. 00:32:21.433 [2024-11-26 19:18:38.109189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.433 [2024-11-26 19:18:38.109323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.433 [2024-11-26 19:18:38.109335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.433 qpair failed and we were unable to recover it. 00:32:21.433 [2024-11-26 19:18:38.109578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.433 [2024-11-26 19:18:38.109664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.433 [2024-11-26 19:18:38.109675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.433 qpair failed and we were unable to recover it. 00:32:21.433 [2024-11-26 19:18:38.109758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.433 [2024-11-26 19:18:38.109836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.433 [2024-11-26 19:18:38.109847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.433 qpair failed and we were unable to recover it. 00:32:21.433 [2024-11-26 19:18:38.110073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.433 [2024-11-26 19:18:38.110156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.433 [2024-11-26 19:18:38.110168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.433 qpair failed and we were unable to recover it. 00:32:21.433 [2024-11-26 19:18:38.110300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.433 [2024-11-26 19:18:38.110376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.433 [2024-11-26 19:18:38.110388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.433 qpair failed and we were unable to recover it. 00:32:21.433 [2024-11-26 19:18:38.110530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.433 [2024-11-26 19:18:38.110602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.433 [2024-11-26 19:18:38.110613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.433 qpair failed and we were unable to recover it. 00:32:21.433 [2024-11-26 19:18:38.110703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.433 [2024-11-26 19:18:38.110900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.433 [2024-11-26 19:18:38.110912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.433 qpair failed and we were unable to recover it. 00:32:21.433 [2024-11-26 19:18:38.110976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.433 [2024-11-26 19:18:38.111041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.433 [2024-11-26 19:18:38.111053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.433 qpair failed and we were unable to recover it. 00:32:21.433 [2024-11-26 19:18:38.111195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.433 [2024-11-26 19:18:38.111298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.433 [2024-11-26 19:18:38.111309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.433 qpair failed and we were unable to recover it. 00:32:21.433 [2024-11-26 19:18:38.111459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.433 [2024-11-26 19:18:38.111640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.433 [2024-11-26 19:18:38.111651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.433 qpair failed and we were unable to recover it. 00:32:21.433 [2024-11-26 19:18:38.111847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.433 [2024-11-26 19:18:38.112068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.433 [2024-11-26 19:18:38.112080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.433 qpair failed and we were unable to recover it. 00:32:21.433 [2024-11-26 19:18:38.112180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.433 [2024-11-26 19:18:38.112381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.433 [2024-11-26 19:18:38.112392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.433 qpair failed and we were unable to recover it. 00:32:21.433 [2024-11-26 19:18:38.112529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.433 [2024-11-26 19:18:38.112669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.433 [2024-11-26 19:18:38.112681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.433 qpair failed and we were unable to recover it. 00:32:21.433 [2024-11-26 19:18:38.112819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.433 [2024-11-26 19:18:38.112999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.433 [2024-11-26 19:18:38.113011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.433 qpair failed and we were unable to recover it. 00:32:21.433 [2024-11-26 19:18:38.113176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.433 [2024-11-26 19:18:38.113313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.433 [2024-11-26 19:18:38.113325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.433 qpair failed and we were unable to recover it. 00:32:21.433 [2024-11-26 19:18:38.113394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.433 [2024-11-26 19:18:38.113596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.433 [2024-11-26 19:18:38.113608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.433 qpair failed and we were unable to recover it. 00:32:21.433 [2024-11-26 19:18:38.113718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.433 [2024-11-26 19:18:38.113788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.433 [2024-11-26 19:18:38.113799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.433 qpair failed and we were unable to recover it. 00:32:21.433 [2024-11-26 19:18:38.113891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.433 [2024-11-26 19:18:38.114029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.433 [2024-11-26 19:18:38.114041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.433 qpair failed and we were unable to recover it. 00:32:21.433 [2024-11-26 19:18:38.114180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.433 [2024-11-26 19:18:38.114347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.433 [2024-11-26 19:18:38.114359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.433 qpair failed and we were unable to recover it. 00:32:21.433 [2024-11-26 19:18:38.114502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.433 [2024-11-26 19:18:38.114663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.433 [2024-11-26 19:18:38.114674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.433 qpair failed and we were unable to recover it. 00:32:21.433 [2024-11-26 19:18:38.114889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.433 [2024-11-26 19:18:38.115149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.433 [2024-11-26 19:18:38.115160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.433 qpair failed and we were unable to recover it. 00:32:21.433 [2024-11-26 19:18:38.115425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.433 [2024-11-26 19:18:38.115522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.433 [2024-11-26 19:18:38.115534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.433 qpair failed and we were unable to recover it. 00:32:21.433 [2024-11-26 19:18:38.115619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.433 [2024-11-26 19:18:38.115823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.433 [2024-11-26 19:18:38.115832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.433 qpair failed and we were unable to recover it. 00:32:21.433 [2024-11-26 19:18:38.115977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.433 [2024-11-26 19:18:38.116132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.433 [2024-11-26 19:18:38.116141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.433 qpair failed and we were unable to recover it. 00:32:21.433 [2024-11-26 19:18:38.116307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.433 [2024-11-26 19:18:38.116470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.433 [2024-11-26 19:18:38.116480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.433 qpair failed and we were unable to recover it. 00:32:21.433 [2024-11-26 19:18:38.116635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.433 [2024-11-26 19:18:38.116818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.433 [2024-11-26 19:18:38.116829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.433 qpair failed and we were unable to recover it. 00:32:21.433 [2024-11-26 19:18:38.116986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.433 [2024-11-26 19:18:38.117061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.433 [2024-11-26 19:18:38.117070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.433 qpair failed and we were unable to recover it. 00:32:21.433 [2024-11-26 19:18:38.117197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.434 [2024-11-26 19:18:38.117342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.434 [2024-11-26 19:18:38.117352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.434 qpair failed and we were unable to recover it. 00:32:21.434 [2024-11-26 19:18:38.117433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.434 [2024-11-26 19:18:38.117619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.434 [2024-11-26 19:18:38.117629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.434 qpair failed and we were unable to recover it. 00:32:21.434 [2024-11-26 19:18:38.117764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.434 [2024-11-26 19:18:38.117850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.434 [2024-11-26 19:18:38.117860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.434 qpair failed and we were unable to recover it. 00:32:21.434 [2024-11-26 19:18:38.118063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.434 [2024-11-26 19:18:38.118191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.434 [2024-11-26 19:18:38.118201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.434 qpair failed and we were unable to recover it. 00:32:21.434 [2024-11-26 19:18:38.118329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.434 [2024-11-26 19:18:38.118529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.434 [2024-11-26 19:18:38.118538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.434 qpair failed and we were unable to recover it. 00:32:21.434 [2024-11-26 19:18:38.118619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.434 [2024-11-26 19:18:38.118800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.434 [2024-11-26 19:18:38.118810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.434 qpair failed and we were unable to recover it. 00:32:21.434 [2024-11-26 19:18:38.118970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.434 [2024-11-26 19:18:38.119115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.434 [2024-11-26 19:18:38.119124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.434 qpair failed and we were unable to recover it. 00:32:21.434 [2024-11-26 19:18:38.119220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.434 [2024-11-26 19:18:38.119308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.434 [2024-11-26 19:18:38.119317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.434 qpair failed and we were unable to recover it. 00:32:21.434 [2024-11-26 19:18:38.119419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.434 [2024-11-26 19:18:38.119574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.434 [2024-11-26 19:18:38.119584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.434 qpair failed and we were unable to recover it. 00:32:21.434 [2024-11-26 19:18:38.119674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.434 [2024-11-26 19:18:38.119757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.434 [2024-11-26 19:18:38.119767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.434 qpair failed and we were unable to recover it. 00:32:21.434 [2024-11-26 19:18:38.119985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.434 [2024-11-26 19:18:38.120070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.434 [2024-11-26 19:18:38.120079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.434 qpair failed and we were unable to recover it. 00:32:21.434 [2024-11-26 19:18:38.120227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.434 [2024-11-26 19:18:38.120316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.434 [2024-11-26 19:18:38.120326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.434 qpair failed and we were unable to recover it. 00:32:21.434 [2024-11-26 19:18:38.120560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.434 [2024-11-26 19:18:38.120728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.434 [2024-11-26 19:18:38.120739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.434 qpair failed and we were unable to recover it. 00:32:21.434 [2024-11-26 19:18:38.121011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.434 [2024-11-26 19:18:38.121114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.434 [2024-11-26 19:18:38.121125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.434 qpair failed and we were unable to recover it. 00:32:21.434 [2024-11-26 19:18:38.121290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.434 [2024-11-26 19:18:38.121387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.434 [2024-11-26 19:18:38.121396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.434 qpair failed and we were unable to recover it. 00:32:21.434 [2024-11-26 19:18:38.121567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.434 [2024-11-26 19:18:38.121661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.434 [2024-11-26 19:18:38.121671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.434 qpair failed and we were unable to recover it. 00:32:21.434 [2024-11-26 19:18:38.121830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.434 [2024-11-26 19:18:38.122021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.434 [2024-11-26 19:18:38.122031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.434 qpair failed and we were unable to recover it. 00:32:21.434 [2024-11-26 19:18:38.122113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.434 [2024-11-26 19:18:38.122257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.434 [2024-11-26 19:18:38.122267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.434 qpair failed and we were unable to recover it. 00:32:21.434 [2024-11-26 19:18:38.122421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.434 [2024-11-26 19:18:38.122494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.434 [2024-11-26 19:18:38.122503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.434 qpair failed and we were unable to recover it. 00:32:21.434 [2024-11-26 19:18:38.122582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.434 [2024-11-26 19:18:38.122754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.434 [2024-11-26 19:18:38.122764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.434 qpair failed and we were unable to recover it. 00:32:21.434 [2024-11-26 19:18:38.122961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.434 [2024-11-26 19:18:38.123098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.434 [2024-11-26 19:18:38.123108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.434 qpair failed and we were unable to recover it. 00:32:21.434 [2024-11-26 19:18:38.123300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.434 [2024-11-26 19:18:38.123444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.434 [2024-11-26 19:18:38.123454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.434 qpair failed and we were unable to recover it. 00:32:21.434 [2024-11-26 19:18:38.123611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.434 [2024-11-26 19:18:38.123695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.434 [2024-11-26 19:18:38.123705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.434 qpair failed and we were unable to recover it. 00:32:21.434 [2024-11-26 19:18:38.123885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.434 [2024-11-26 19:18:38.124029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.434 [2024-11-26 19:18:38.124039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.434 qpair failed and we were unable to recover it. 00:32:21.434 [2024-11-26 19:18:38.124139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.434 [2024-11-26 19:18:38.124283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.434 [2024-11-26 19:18:38.124293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.434 qpair failed and we were unable to recover it. 00:32:21.434 [2024-11-26 19:18:38.124440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.434 [2024-11-26 19:18:38.124527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.434 [2024-11-26 19:18:38.124538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.434 qpair failed and we were unable to recover it. 00:32:21.434 [2024-11-26 19:18:38.124701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.434 [2024-11-26 19:18:38.124790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.434 [2024-11-26 19:18:38.124800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.434 qpair failed and we were unable to recover it. 00:32:21.434 [2024-11-26 19:18:38.124893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.434 [2024-11-26 19:18:38.125036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.434 [2024-11-26 19:18:38.125047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.434 qpair failed and we were unable to recover it. 00:32:21.434 [2024-11-26 19:18:38.125185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.434 [2024-11-26 19:18:38.125321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.434 [2024-11-26 19:18:38.125332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.434 qpair failed and we were unable to recover it. 00:32:21.435 [2024-11-26 19:18:38.125406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.435 [2024-11-26 19:18:38.125495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.435 [2024-11-26 19:18:38.125505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.435 qpair failed and we were unable to recover it. 00:32:21.435 [2024-11-26 19:18:38.125585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.435 [2024-11-26 19:18:38.125768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.435 [2024-11-26 19:18:38.125778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.435 qpair failed and we were unable to recover it. 00:32:21.435 [2024-11-26 19:18:38.125940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.435 [2024-11-26 19:18:38.126122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.435 [2024-11-26 19:18:38.126133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.435 qpair failed and we were unable to recover it. 00:32:21.435 [2024-11-26 19:18:38.126303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.435 [2024-11-26 19:18:38.126569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.435 [2024-11-26 19:18:38.126579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.435 qpair failed and we were unable to recover it. 00:32:21.435 [2024-11-26 19:18:38.126798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.435 [2024-11-26 19:18:38.127017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.435 [2024-11-26 19:18:38.127028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.435 qpair failed and we were unable to recover it. 00:32:21.435 [2024-11-26 19:18:38.127179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.435 [2024-11-26 19:18:38.127266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.435 [2024-11-26 19:18:38.127276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.435 qpair failed and we were unable to recover it. 00:32:21.435 [2024-11-26 19:18:38.127429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.435 [2024-11-26 19:18:38.127612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.435 [2024-11-26 19:18:38.127622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.435 qpair failed and we were unable to recover it. 00:32:21.435 [2024-11-26 19:18:38.127815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.435 [2024-11-26 19:18:38.127975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.435 [2024-11-26 19:18:38.127985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.435 qpair failed and we were unable to recover it. 00:32:21.435 [2024-11-26 19:18:38.128069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.435 [2024-11-26 19:18:38.128167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.435 [2024-11-26 19:18:38.128176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.435 qpair failed and we were unable to recover it. 00:32:21.435 [2024-11-26 19:18:38.128379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.435 [2024-11-26 19:18:38.128472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.435 [2024-11-26 19:18:38.128482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.435 qpair failed and we were unable to recover it. 00:32:21.435 [2024-11-26 19:18:38.128567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.435 [2024-11-26 19:18:38.128732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.435 [2024-11-26 19:18:38.128742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.435 qpair failed and we were unable to recover it. 00:32:21.435 [2024-11-26 19:18:38.128885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.435 [2024-11-26 19:18:38.129032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.435 [2024-11-26 19:18:38.129043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.435 qpair failed and we were unable to recover it. 00:32:21.435 [2024-11-26 19:18:38.129116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.435 [2024-11-26 19:18:38.129207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.435 [2024-11-26 19:18:38.129217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.435 qpair failed and we were unable to recover it. 00:32:21.435 [2024-11-26 19:18:38.129379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.435 [2024-11-26 19:18:38.129464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.435 [2024-11-26 19:18:38.129474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.435 qpair failed and we were unable to recover it. 00:32:21.435 [2024-11-26 19:18:38.129620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.435 [2024-11-26 19:18:38.129719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.435 [2024-11-26 19:18:38.129729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.435 qpair failed and we were unable to recover it. 00:32:21.435 [2024-11-26 19:18:38.129924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.435 [2024-11-26 19:18:38.130015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.435 [2024-11-26 19:18:38.130025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.435 qpair failed and we were unable to recover it. 00:32:21.435 [2024-11-26 19:18:38.130106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.435 [2024-11-26 19:18:38.130251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.435 [2024-11-26 19:18:38.130261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.435 qpair failed and we were unable to recover it. 00:32:21.435 [2024-11-26 19:18:38.130365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.435 [2024-11-26 19:18:38.130441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.435 [2024-11-26 19:18:38.130451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.435 qpair failed and we were unable to recover it. 00:32:21.435 [2024-11-26 19:18:38.130560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.435 [2024-11-26 19:18:38.130705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.435 [2024-11-26 19:18:38.130714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.435 qpair failed and we were unable to recover it. 00:32:21.435 [2024-11-26 19:18:38.130863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.435 [2024-11-26 19:18:38.131042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.435 [2024-11-26 19:18:38.131052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.435 qpair failed and we were unable to recover it. 00:32:21.435 [2024-11-26 19:18:38.131252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.435 [2024-11-26 19:18:38.131361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.435 [2024-11-26 19:18:38.131371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.435 qpair failed and we were unable to recover it. 00:32:21.435 [2024-11-26 19:18:38.131565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.435 [2024-11-26 19:18:38.131807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.435 [2024-11-26 19:18:38.131817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.435 qpair failed and we were unable to recover it. 00:32:21.435 [2024-11-26 19:18:38.131974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.435 [2024-11-26 19:18:38.132112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.435 [2024-11-26 19:18:38.132122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.435 qpair failed and we were unable to recover it. 00:32:21.435 [2024-11-26 19:18:38.132320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.435 [2024-11-26 19:18:38.132418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.435 [2024-11-26 19:18:38.132428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.435 qpair failed and we were unable to recover it. 00:32:21.435 [2024-11-26 19:18:38.132508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.435 [2024-11-26 19:18:38.132588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.435 [2024-11-26 19:18:38.132598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.435 qpair failed and we were unable to recover it. 00:32:21.435 [2024-11-26 19:18:38.132760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.435 [2024-11-26 19:18:38.132847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.435 [2024-11-26 19:18:38.132856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.435 qpair failed and we were unable to recover it. 00:32:21.435 [2024-11-26 19:18:38.133000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.435 [2024-11-26 19:18:38.133171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.435 [2024-11-26 19:18:38.133181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.435 qpair failed and we were unable to recover it. 00:32:21.435 [2024-11-26 19:18:38.133275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.435 [2024-11-26 19:18:38.133358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.435 [2024-11-26 19:18:38.133367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.435 qpair failed and we were unable to recover it. 00:32:21.435 [2024-11-26 19:18:38.133449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.435 [2024-11-26 19:18:38.133532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.436 [2024-11-26 19:18:38.133542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.436 qpair failed and we were unable to recover it. 00:32:21.436 [2024-11-26 19:18:38.133696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.436 [2024-11-26 19:18:38.133917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.436 [2024-11-26 19:18:38.133927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.436 qpair failed and we were unable to recover it. 00:32:21.436 [2024-11-26 19:18:38.134109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.436 [2024-11-26 19:18:38.134186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.436 [2024-11-26 19:18:38.134196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.436 qpair failed and we were unable to recover it. 00:32:21.436 [2024-11-26 19:18:38.134296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.436 [2024-11-26 19:18:38.134375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.436 [2024-11-26 19:18:38.134386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.436 qpair failed and we were unable to recover it. 00:32:21.436 [2024-11-26 19:18:38.134514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.436 [2024-11-26 19:18:38.134584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.436 [2024-11-26 19:18:38.134594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.436 qpair failed and we were unable to recover it. 00:32:21.436 [2024-11-26 19:18:38.134732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.436 [2024-11-26 19:18:38.134885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.436 [2024-11-26 19:18:38.134895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.436 qpair failed and we were unable to recover it. 00:32:21.436 [2024-11-26 19:18:38.134992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.436 [2024-11-26 19:18:38.135057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.436 [2024-11-26 19:18:38.135067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.436 qpair failed and we were unable to recover it. 00:32:21.436 [2024-11-26 19:18:38.135207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.436 [2024-11-26 19:18:38.135288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.436 [2024-11-26 19:18:38.135298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.436 qpair failed and we were unable to recover it. 00:32:21.436 [2024-11-26 19:18:38.135430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.436 [2024-11-26 19:18:38.135507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.436 [2024-11-26 19:18:38.135517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.436 qpair failed and we were unable to recover it. 00:32:21.436 [2024-11-26 19:18:38.135584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.436 [2024-11-26 19:18:38.135653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.436 [2024-11-26 19:18:38.135664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.436 qpair failed and we were unable to recover it. 00:32:21.436 [2024-11-26 19:18:38.135729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.436 [2024-11-26 19:18:38.135908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.436 [2024-11-26 19:18:38.135918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.436 qpair failed and we were unable to recover it. 00:32:21.436 [2024-11-26 19:18:38.136059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.436 [2024-11-26 19:18:38.136144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.436 [2024-11-26 19:18:38.136154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.436 qpair failed and we were unable to recover it. 00:32:21.436 [2024-11-26 19:18:38.136315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.436 [2024-11-26 19:18:38.136485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.436 [2024-11-26 19:18:38.136496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.436 qpair failed and we were unable to recover it. 00:32:21.436 [2024-11-26 19:18:38.136634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.436 [2024-11-26 19:18:38.136799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.436 [2024-11-26 19:18:38.136809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.436 qpair failed and we were unable to recover it. 00:32:21.436 [2024-11-26 19:18:38.136970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.436 [2024-11-26 19:18:38.137149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.436 [2024-11-26 19:18:38.137159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.436 qpair failed and we were unable to recover it. 00:32:21.436 [2024-11-26 19:18:38.137293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.436 [2024-11-26 19:18:38.137399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.436 [2024-11-26 19:18:38.137409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.436 qpair failed and we were unable to recover it. 00:32:21.436 [2024-11-26 19:18:38.137540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.436 [2024-11-26 19:18:38.137614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.436 [2024-11-26 19:18:38.137624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.436 qpair failed and we were unable to recover it. 00:32:21.436 [2024-11-26 19:18:38.137723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.436 [2024-11-26 19:18:38.137850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.436 [2024-11-26 19:18:38.137860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.436 qpair failed and we were unable to recover it. 00:32:21.436 [2024-11-26 19:18:38.138036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.436 [2024-11-26 19:18:38.138194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.436 [2024-11-26 19:18:38.138207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.436 qpair failed and we were unable to recover it. 00:32:21.436 [2024-11-26 19:18:38.138306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.436 [2024-11-26 19:18:38.138403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.436 [2024-11-26 19:18:38.138413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.436 qpair failed and we were unable to recover it. 00:32:21.436 [2024-11-26 19:18:38.138508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.436 [2024-11-26 19:18:38.138732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.436 [2024-11-26 19:18:38.138743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.436 qpair failed and we were unable to recover it. 00:32:21.436 [2024-11-26 19:18:38.138919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.436 [2024-11-26 19:18:38.139071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.436 [2024-11-26 19:18:38.139082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.436 qpair failed and we were unable to recover it. 00:32:21.436 [2024-11-26 19:18:38.139156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.436 [2024-11-26 19:18:38.139255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.436 [2024-11-26 19:18:38.139265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.436 qpair failed and we were unable to recover it. 00:32:21.436 [2024-11-26 19:18:38.139406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.436 [2024-11-26 19:18:38.139490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.436 [2024-11-26 19:18:38.139500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.436 qpair failed and we were unable to recover it. 00:32:21.436 [2024-11-26 19:18:38.139637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.436 [2024-11-26 19:18:38.139783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.436 [2024-11-26 19:18:38.139793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.436 qpair failed and we were unable to recover it. 00:32:21.436 [2024-11-26 19:18:38.140010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.436 [2024-11-26 19:18:38.140118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.436 [2024-11-26 19:18:38.140128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.436 qpair failed and we were unable to recover it. 00:32:21.436 [2024-11-26 19:18:38.140213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.436 [2024-11-26 19:18:38.140316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.436 [2024-11-26 19:18:38.140326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.437 qpair failed and we were unable to recover it. 00:32:21.437 [2024-11-26 19:18:38.140465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.437 [2024-11-26 19:18:38.140606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.437 [2024-11-26 19:18:38.140616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.437 qpair failed and we were unable to recover it. 00:32:21.437 [2024-11-26 19:18:38.140764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.437 [2024-11-26 19:18:38.140852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.437 [2024-11-26 19:18:38.140864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.437 qpair failed and we were unable to recover it. 00:32:21.437 [2024-11-26 19:18:38.141007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.437 [2024-11-26 19:18:38.141075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.437 [2024-11-26 19:18:38.141085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.437 qpair failed and we were unable to recover it. 00:32:21.437 [2024-11-26 19:18:38.141145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.437 [2024-11-26 19:18:38.141239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.437 [2024-11-26 19:18:38.141249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.437 qpair failed and we were unable to recover it. 00:32:21.437 [2024-11-26 19:18:38.141407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.437 [2024-11-26 19:18:38.141486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.437 [2024-11-26 19:18:38.141497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.437 qpair failed and we were unable to recover it. 00:32:21.437 [2024-11-26 19:18:38.141663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.437 [2024-11-26 19:18:38.141835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.437 [2024-11-26 19:18:38.141845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.437 qpair failed and we were unable to recover it. 00:32:21.437 [2024-11-26 19:18:38.142014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.437 [2024-11-26 19:18:38.142106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.437 [2024-11-26 19:18:38.142116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.437 qpair failed and we were unable to recover it. 00:32:21.437 [2024-11-26 19:18:38.142343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.437 [2024-11-26 19:18:38.142537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.437 [2024-11-26 19:18:38.142548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.437 qpair failed and we were unable to recover it. 00:32:21.437 [2024-11-26 19:18:38.142625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.437 [2024-11-26 19:18:38.142706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.437 [2024-11-26 19:18:38.142716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.437 qpair failed and we were unable to recover it. 00:32:21.437 [2024-11-26 19:18:38.142876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.437 [2024-11-26 19:18:38.143071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.437 [2024-11-26 19:18:38.143082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.437 qpair failed and we were unable to recover it. 00:32:21.437 [2024-11-26 19:18:38.143252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.437 [2024-11-26 19:18:38.143383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.437 [2024-11-26 19:18:38.143393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.437 qpair failed and we were unable to recover it. 00:32:21.437 [2024-11-26 19:18:38.143536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.437 [2024-11-26 19:18:38.143623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.437 [2024-11-26 19:18:38.143635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.437 qpair failed and we were unable to recover it. 00:32:21.437 [2024-11-26 19:18:38.143771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.437 [2024-11-26 19:18:38.143831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.437 [2024-11-26 19:18:38.143841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.437 qpair failed and we were unable to recover it. 00:32:21.437 [2024-11-26 19:18:38.144043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.437 [2024-11-26 19:18:38.144139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.437 [2024-11-26 19:18:38.144149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.437 qpair failed and we were unable to recover it. 00:32:21.437 [2024-11-26 19:18:38.144292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.437 [2024-11-26 19:18:38.144421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.437 [2024-11-26 19:18:38.144431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.437 qpair failed and we were unable to recover it. 00:32:21.437 [2024-11-26 19:18:38.144576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.437 [2024-11-26 19:18:38.144697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.437 [2024-11-26 19:18:38.144706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.437 qpair failed and we were unable to recover it. 00:32:21.437 [2024-11-26 19:18:38.144922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.437 [2024-11-26 19:18:38.145096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.437 [2024-11-26 19:18:38.145106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.437 qpair failed and we were unable to recover it. 00:32:21.437 [2024-11-26 19:18:38.145261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.437 [2024-11-26 19:18:38.145465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.437 [2024-11-26 19:18:38.145475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.437 qpair failed and we were unable to recover it. 00:32:21.437 [2024-11-26 19:18:38.145616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.437 [2024-11-26 19:18:38.145855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.437 [2024-11-26 19:18:38.145865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.437 qpair failed and we were unable to recover it. 00:32:21.437 [2024-11-26 19:18:38.146089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.437 [2024-11-26 19:18:38.146327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.437 [2024-11-26 19:18:38.146338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.437 qpair failed and we were unable to recover it. 00:32:21.437 [2024-11-26 19:18:38.146500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.437 [2024-11-26 19:18:38.146650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.437 [2024-11-26 19:18:38.146660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.437 qpair failed and we were unable to recover it. 00:32:21.437 [2024-11-26 19:18:38.146806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.437 [2024-11-26 19:18:38.146978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.437 [2024-11-26 19:18:38.146991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.437 qpair failed and we were unable to recover it. 00:32:21.437 [2024-11-26 19:18:38.147158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.437 [2024-11-26 19:18:38.147241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.437 [2024-11-26 19:18:38.147251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.437 qpair failed and we were unable to recover it. 00:32:21.437 [2024-11-26 19:18:38.147391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.437 [2024-11-26 19:18:38.147486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.437 [2024-11-26 19:18:38.147496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.437 qpair failed and we were unable to recover it. 00:32:21.437 [2024-11-26 19:18:38.147633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.437 [2024-11-26 19:18:38.147762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.437 [2024-11-26 19:18:38.147772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.437 qpair failed and we were unable to recover it. 00:32:21.437 [2024-11-26 19:18:38.147915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.438 [2024-11-26 19:18:38.148002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.438 [2024-11-26 19:18:38.148012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.438 qpair failed and we were unable to recover it. 00:32:21.438 [2024-11-26 19:18:38.148103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.438 [2024-11-26 19:18:38.148191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.438 [2024-11-26 19:18:38.148200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.438 qpair failed and we were unable to recover it. 00:32:21.438 [2024-11-26 19:18:38.148335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.438 [2024-11-26 19:18:38.148480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.438 [2024-11-26 19:18:38.148490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.438 qpair failed and we were unable to recover it. 00:32:21.438 [2024-11-26 19:18:38.148565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.438 [2024-11-26 19:18:38.148652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.438 [2024-11-26 19:18:38.148663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.438 qpair failed and we were unable to recover it. 00:32:21.438 [2024-11-26 19:18:38.148747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.438 [2024-11-26 19:18:38.148821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.438 [2024-11-26 19:18:38.148830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.438 qpair failed and we were unable to recover it. 00:32:21.438 [2024-11-26 19:18:38.148980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.438 [2024-11-26 19:18:38.149148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.438 [2024-11-26 19:18:38.149157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.438 qpair failed and we were unable to recover it. 00:32:21.438 [2024-11-26 19:18:38.149308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.438 [2024-11-26 19:18:38.149380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.438 [2024-11-26 19:18:38.149390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.438 qpair failed and we were unable to recover it. 00:32:21.438 [2024-11-26 19:18:38.149471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.438 [2024-11-26 19:18:38.149549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.438 [2024-11-26 19:18:38.149559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.438 qpair failed and we were unable to recover it. 00:32:21.438 [2024-11-26 19:18:38.149695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.438 [2024-11-26 19:18:38.149827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.438 [2024-11-26 19:18:38.149838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.438 qpair failed and we were unable to recover it. 00:32:21.438 [2024-11-26 19:18:38.149907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.438 [2024-11-26 19:18:38.149983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.438 [2024-11-26 19:18:38.149994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.438 qpair failed and we were unable to recover it. 00:32:21.438 [2024-11-26 19:18:38.150075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.438 [2024-11-26 19:18:38.150155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.438 [2024-11-26 19:18:38.150166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.438 qpair failed and we were unable to recover it. 00:32:21.438 [2024-11-26 19:18:38.150242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.438 [2024-11-26 19:18:38.150302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.438 [2024-11-26 19:18:38.150312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.438 qpair failed and we were unable to recover it. 00:32:21.438 [2024-11-26 19:18:38.150386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.438 [2024-11-26 19:18:38.150454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.438 [2024-11-26 19:18:38.150463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.438 qpair failed and we were unable to recover it. 00:32:21.438 [2024-11-26 19:18:38.150530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.438 [2024-11-26 19:18:38.150600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.438 [2024-11-26 19:18:38.150609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.438 qpair failed and we were unable to recover it. 00:32:21.438 [2024-11-26 19:18:38.150682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.438 [2024-11-26 19:18:38.150875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.438 [2024-11-26 19:18:38.150885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.438 qpair failed and we were unable to recover it. 00:32:21.438 [2024-11-26 19:18:38.150941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.438 [2024-11-26 19:18:38.151024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.438 [2024-11-26 19:18:38.151034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.438 qpair failed and we were unable to recover it. 00:32:21.438 [2024-11-26 19:18:38.151107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.438 [2024-11-26 19:18:38.151184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.438 [2024-11-26 19:18:38.151194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.438 qpair failed and we were unable to recover it. 00:32:21.438 [2024-11-26 19:18:38.151273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.438 [2024-11-26 19:18:38.151408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.438 [2024-11-26 19:18:38.151418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.438 qpair failed and we were unable to recover it. 00:32:21.438 [2024-11-26 19:18:38.151484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.438 [2024-11-26 19:18:38.151559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.438 [2024-11-26 19:18:38.151568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.438 qpair failed and we were unable to recover it. 00:32:21.438 [2024-11-26 19:18:38.151733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.438 [2024-11-26 19:18:38.151799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.438 [2024-11-26 19:18:38.151808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.438 qpair failed and we were unable to recover it. 00:32:21.438 [2024-11-26 19:18:38.151872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.438 [2024-11-26 19:18:38.151938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.438 [2024-11-26 19:18:38.151952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.438 qpair failed and we were unable to recover it. 00:32:21.438 [2024-11-26 19:18:38.152100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.438 [2024-11-26 19:18:38.152168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.438 [2024-11-26 19:18:38.152179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.438 qpair failed and we were unable to recover it. 00:32:21.438 [2024-11-26 19:18:38.152238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.438 [2024-11-26 19:18:38.152320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.438 [2024-11-26 19:18:38.152331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.438 qpair failed and we were unable to recover it. 00:32:21.438 [2024-11-26 19:18:38.152394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.438 [2024-11-26 19:18:38.152463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.438 [2024-11-26 19:18:38.152472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.438 qpair failed and we were unable to recover it. 00:32:21.438 [2024-11-26 19:18:38.152553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.438 [2024-11-26 19:18:38.152623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.438 [2024-11-26 19:18:38.152632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.438 qpair failed and we were unable to recover it. 00:32:21.438 [2024-11-26 19:18:38.152712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.438 [2024-11-26 19:18:38.152788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.438 [2024-11-26 19:18:38.152798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.438 qpair failed and we were unable to recover it. 00:32:21.438 [2024-11-26 19:18:38.152861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.438 [2024-11-26 19:18:38.153018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.438 [2024-11-26 19:18:38.153029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.438 qpair failed and we were unable to recover it. 00:32:21.438 [2024-11-26 19:18:38.153113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.438 [2024-11-26 19:18:38.153179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.438 [2024-11-26 19:18:38.153189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.438 qpair failed and we were unable to recover it. 00:32:21.438 [2024-11-26 19:18:38.153256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.438 [2024-11-26 19:18:38.153314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.438 [2024-11-26 19:18:38.153323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.438 qpair failed and we were unable to recover it. 00:32:21.438 [2024-11-26 19:18:38.153459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.438 [2024-11-26 19:18:38.153532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.438 [2024-11-26 19:18:38.153542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.438 qpair failed and we were unable to recover it. 00:32:21.438 [2024-11-26 19:18:38.153616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.438 [2024-11-26 19:18:38.153680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.438 [2024-11-26 19:18:38.153690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.438 qpair failed and we were unable to recover it. 00:32:21.438 [2024-11-26 19:18:38.153751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.438 [2024-11-26 19:18:38.153814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.439 [2024-11-26 19:18:38.153824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.439 qpair failed and we were unable to recover it. 00:32:21.439 [2024-11-26 19:18:38.153918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.439 [2024-11-26 19:18:38.154002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.439 [2024-11-26 19:18:38.154013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.439 qpair failed and we were unable to recover it. 00:32:21.439 [2024-11-26 19:18:38.154090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.439 [2024-11-26 19:18:38.154215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.439 [2024-11-26 19:18:38.154225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.439 qpair failed and we were unable to recover it. 00:32:21.439 [2024-11-26 19:18:38.154304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.439 [2024-11-26 19:18:38.154374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.439 [2024-11-26 19:18:38.154384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.439 qpair failed and we were unable to recover it. 00:32:21.439 [2024-11-26 19:18:38.154450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.439 [2024-11-26 19:18:38.154524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.439 [2024-11-26 19:18:38.154534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.439 qpair failed and we were unable to recover it. 00:32:21.439 [2024-11-26 19:18:38.154596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.439 [2024-11-26 19:18:38.154679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.439 [2024-11-26 19:18:38.154689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.439 qpair failed and we were unable to recover it. 00:32:21.439 [2024-11-26 19:18:38.154826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.439 [2024-11-26 19:18:38.154885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.439 [2024-11-26 19:18:38.154895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.439 qpair failed and we were unable to recover it. 00:32:21.439 [2024-11-26 19:18:38.154956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.439 [2024-11-26 19:18:38.155022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.439 [2024-11-26 19:18:38.155031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.439 qpair failed and we were unable to recover it. 00:32:21.439 [2024-11-26 19:18:38.155108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.439 [2024-11-26 19:18:38.155177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.439 [2024-11-26 19:18:38.155187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.439 qpair failed and we were unable to recover it. 00:32:21.439 [2024-11-26 19:18:38.155265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.439 [2024-11-26 19:18:38.155329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.439 [2024-11-26 19:18:38.155339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.439 qpair failed and we were unable to recover it. 00:32:21.439 [2024-11-26 19:18:38.155470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.439 [2024-11-26 19:18:38.155527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.439 [2024-11-26 19:18:38.155537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.439 qpair failed and we were unable to recover it. 00:32:21.439 [2024-11-26 19:18:38.155605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.439 [2024-11-26 19:18:38.155687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.439 [2024-11-26 19:18:38.155697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.439 qpair failed and we were unable to recover it. 00:32:21.439 [2024-11-26 19:18:38.155758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.439 [2024-11-26 19:18:38.155825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.439 [2024-11-26 19:18:38.155836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.439 qpair failed and we were unable to recover it. 00:32:21.439 [2024-11-26 19:18:38.155907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.439 [2024-11-26 19:18:38.155987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.439 [2024-11-26 19:18:38.155998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.439 qpair failed and we were unable to recover it. 00:32:21.439 [2024-11-26 19:18:38.156077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.439 [2024-11-26 19:18:38.156149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.439 [2024-11-26 19:18:38.156160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.439 qpair failed and we were unable to recover it. 00:32:21.439 [2024-11-26 19:18:38.156301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.439 [2024-11-26 19:18:38.156372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.439 [2024-11-26 19:18:38.156382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.439 qpair failed and we were unable to recover it. 00:32:21.439 [2024-11-26 19:18:38.156447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.439 [2024-11-26 19:18:38.156509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.439 [2024-11-26 19:18:38.156520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.439 qpair failed and we were unable to recover it. 00:32:21.439 [2024-11-26 19:18:38.156718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.439 [2024-11-26 19:18:38.156802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.439 [2024-11-26 19:18:38.156812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.439 qpair failed and we were unable to recover it. 00:32:21.439 [2024-11-26 19:18:38.156892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.439 [2024-11-26 19:18:38.156952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.439 [2024-11-26 19:18:38.156963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.439 qpair failed and we were unable to recover it. 00:32:21.439 [2024-11-26 19:18:38.157035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.439 [2024-11-26 19:18:38.157107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.439 [2024-11-26 19:18:38.157118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.439 qpair failed and we were unable to recover it. 00:32:21.439 [2024-11-26 19:18:38.157182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.439 [2024-11-26 19:18:38.157254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.439 [2024-11-26 19:18:38.157264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.439 qpair failed and we were unable to recover it. 00:32:21.439 [2024-11-26 19:18:38.157333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.439 [2024-11-26 19:18:38.157403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.439 [2024-11-26 19:18:38.157413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.439 qpair failed and we were unable to recover it. 00:32:21.439 [2024-11-26 19:18:38.157474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.439 [2024-11-26 19:18:38.157551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.439 [2024-11-26 19:18:38.157560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.439 qpair failed and we were unable to recover it. 00:32:21.439 [2024-11-26 19:18:38.157644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.439 [2024-11-26 19:18:38.157709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.439 [2024-11-26 19:18:38.157719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.439 qpair failed and we were unable to recover it. 00:32:21.439 [2024-11-26 19:18:38.157808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.439 [2024-11-26 19:18:38.157886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.439 [2024-11-26 19:18:38.157896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.439 qpair failed and we were unable to recover it. 00:32:21.439 [2024-11-26 19:18:38.157961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.439 [2024-11-26 19:18:38.158024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.439 [2024-11-26 19:18:38.158034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.439 qpair failed and we were unable to recover it. 00:32:21.439 [2024-11-26 19:18:38.158100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.439 [2024-11-26 19:18:38.158158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.439 [2024-11-26 19:18:38.158168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.439 qpair failed and we were unable to recover it. 00:32:21.439 [2024-11-26 19:18:38.158232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.439 [2024-11-26 19:18:38.158295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.439 [2024-11-26 19:18:38.158315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.439 qpair failed and we were unable to recover it. 00:32:21.439 [2024-11-26 19:18:38.158527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.439 [2024-11-26 19:18:38.158585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.439 [2024-11-26 19:18:38.158594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.440 qpair failed and we were unable to recover it. 00:32:21.440 [2024-11-26 19:18:38.158670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.440 [2024-11-26 19:18:38.158737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.440 [2024-11-26 19:18:38.158747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.440 qpair failed and we were unable to recover it. 00:32:21.440 [2024-11-26 19:18:38.158880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.440 [2024-11-26 19:18:38.158943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.440 [2024-11-26 19:18:38.158956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.440 qpair failed and we were unable to recover it. 00:32:21.440 [2024-11-26 19:18:38.159023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.440 [2024-11-26 19:18:38.159101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.440 [2024-11-26 19:18:38.159110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.440 qpair failed and we were unable to recover it. 00:32:21.440 [2024-11-26 19:18:38.159192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.440 [2024-11-26 19:18:38.159253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.440 [2024-11-26 19:18:38.159263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.440 qpair failed and we were unable to recover it. 00:32:21.440 [2024-11-26 19:18:38.159325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.440 [2024-11-26 19:18:38.159396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.440 [2024-11-26 19:18:38.159405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.440 qpair failed and we were unable to recover it. 00:32:21.440 [2024-11-26 19:18:38.159485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.440 [2024-11-26 19:18:38.159552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.440 [2024-11-26 19:18:38.159562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.440 qpair failed and we were unable to recover it. 00:32:21.440 [2024-11-26 19:18:38.159692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.440 [2024-11-26 19:18:38.159754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.440 [2024-11-26 19:18:38.159763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.440 qpair failed and we were unable to recover it. 00:32:21.440 [2024-11-26 19:18:38.159827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.440 [2024-11-26 19:18:38.159896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.440 [2024-11-26 19:18:38.159905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.440 qpair failed and we were unable to recover it. 00:32:21.440 [2024-11-26 19:18:38.159974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.440 [2024-11-26 19:18:38.160039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.440 [2024-11-26 19:18:38.160049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.440 qpair failed and we were unable to recover it. 00:32:21.440 [2024-11-26 19:18:38.160134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.440 [2024-11-26 19:18:38.160209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.440 [2024-11-26 19:18:38.160218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.440 qpair failed and we were unable to recover it. 00:32:21.440 [2024-11-26 19:18:38.160275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.440 [2024-11-26 19:18:38.160357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.440 [2024-11-26 19:18:38.160366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.440 qpair failed and we were unable to recover it. 00:32:21.440 [2024-11-26 19:18:38.160428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.440 [2024-11-26 19:18:38.160488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.440 [2024-11-26 19:18:38.160497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.440 qpair failed and we were unable to recover it. 00:32:21.440 [2024-11-26 19:18:38.160640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.440 [2024-11-26 19:18:38.160781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.440 [2024-11-26 19:18:38.160790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.440 qpair failed and we were unable to recover it. 00:32:21.440 [2024-11-26 19:18:38.160912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.440 [2024-11-26 19:18:38.160979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.440 [2024-11-26 19:18:38.160989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.440 qpair failed and we were unable to recover it. 00:32:21.440 [2024-11-26 19:18:38.161050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.440 [2024-11-26 19:18:38.161110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.440 [2024-11-26 19:18:38.161119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.440 qpair failed and we were unable to recover it. 00:32:21.440 [2024-11-26 19:18:38.161203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.440 [2024-11-26 19:18:38.161273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.440 [2024-11-26 19:18:38.161283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.440 qpair failed and we were unable to recover it. 00:32:21.440 [2024-11-26 19:18:38.161345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.440 [2024-11-26 19:18:38.161428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.440 [2024-11-26 19:18:38.161437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.440 qpair failed and we were unable to recover it. 00:32:21.440 [2024-11-26 19:18:38.161505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.440 [2024-11-26 19:18:38.161569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.440 [2024-11-26 19:18:38.161579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.440 qpair failed and we were unable to recover it. 00:32:21.440 [2024-11-26 19:18:38.161649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.440 [2024-11-26 19:18:38.161720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.440 [2024-11-26 19:18:38.161729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.440 qpair failed and we were unable to recover it. 00:32:21.440 [2024-11-26 19:18:38.161790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.440 [2024-11-26 19:18:38.161970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.440 [2024-11-26 19:18:38.161980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.440 qpair failed and we were unable to recover it. 00:32:21.440 [2024-11-26 19:18:38.162058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.440 [2024-11-26 19:18:38.162188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.440 [2024-11-26 19:18:38.162198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.440 qpair failed and we were unable to recover it. 00:32:21.440 [2024-11-26 19:18:38.162265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.440 [2024-11-26 19:18:38.162349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.440 [2024-11-26 19:18:38.162359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.440 qpair failed and we were unable to recover it. 00:32:21.440 [2024-11-26 19:18:38.162424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.440 [2024-11-26 19:18:38.162491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.440 [2024-11-26 19:18:38.162500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.440 qpair failed and we were unable to recover it. 00:32:21.440 [2024-11-26 19:18:38.162632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.440 [2024-11-26 19:18:38.162705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.440 [2024-11-26 19:18:38.162715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.440 qpair failed and we were unable to recover it. 00:32:21.440 [2024-11-26 19:18:38.162802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.440 [2024-11-26 19:18:38.162863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.440 [2024-11-26 19:18:38.162874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.440 qpair failed and we were unable to recover it. 00:32:21.440 [2024-11-26 19:18:38.162936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.440 [2024-11-26 19:18:38.163099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.440 [2024-11-26 19:18:38.163110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.440 qpair failed and we were unable to recover it. 00:32:21.440 [2024-11-26 19:18:38.163254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.441 [2024-11-26 19:18:38.163314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.441 [2024-11-26 19:18:38.163323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.441 qpair failed and we were unable to recover it. 00:32:21.441 [2024-11-26 19:18:38.163389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.441 [2024-11-26 19:18:38.163451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.441 [2024-11-26 19:18:38.163460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.441 qpair failed and we were unable to recover it. 00:32:21.441 [2024-11-26 19:18:38.163595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.441 [2024-11-26 19:18:38.163673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.441 [2024-11-26 19:18:38.163683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.441 qpair failed and we were unable to recover it. 00:32:21.441 [2024-11-26 19:18:38.163810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.441 [2024-11-26 19:18:38.163880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.441 [2024-11-26 19:18:38.163889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.441 qpair failed and we were unable to recover it. 00:32:21.441 [2024-11-26 19:18:38.163957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.441 [2024-11-26 19:18:38.164020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.441 [2024-11-26 19:18:38.164029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.441 qpair failed and we were unable to recover it. 00:32:21.441 [2024-11-26 19:18:38.164171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.441 [2024-11-26 19:18:38.164296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.441 [2024-11-26 19:18:38.164305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.441 qpair failed and we were unable to recover it. 00:32:21.441 [2024-11-26 19:18:38.164369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.441 [2024-11-26 19:18:38.164449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.441 [2024-11-26 19:18:38.164458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.441 qpair failed and we were unable to recover it. 00:32:21.441 [2024-11-26 19:18:38.164524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.441 [2024-11-26 19:18:38.164681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.441 [2024-11-26 19:18:38.164691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.441 qpair failed and we were unable to recover it. 00:32:21.441 [2024-11-26 19:18:38.164754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.441 [2024-11-26 19:18:38.164827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.441 [2024-11-26 19:18:38.164836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.441 qpair failed and we were unable to recover it. 00:32:21.441 [2024-11-26 19:18:38.164895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.441 [2024-11-26 19:18:38.164971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.441 [2024-11-26 19:18:38.164982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.441 qpair failed and we were unable to recover it. 00:32:21.441 [2024-11-26 19:18:38.165051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.441 [2024-11-26 19:18:38.165129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.441 [2024-11-26 19:18:38.165139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.441 qpair failed and we were unable to recover it. 00:32:21.441 [2024-11-26 19:18:38.165216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.441 [2024-11-26 19:18:38.165295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.441 [2024-11-26 19:18:38.165305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.441 qpair failed and we were unable to recover it. 00:32:21.441 [2024-11-26 19:18:38.165366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.441 [2024-11-26 19:18:38.165426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.441 [2024-11-26 19:18:38.165435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.441 qpair failed and we were unable to recover it. 00:32:21.441 [2024-11-26 19:18:38.165512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.441 [2024-11-26 19:18:38.165585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.441 [2024-11-26 19:18:38.165594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.441 qpair failed and we were unable to recover it. 00:32:21.441 [2024-11-26 19:18:38.165729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.441 [2024-11-26 19:18:38.165793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.441 [2024-11-26 19:18:38.165803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.441 qpair failed and we were unable to recover it. 00:32:21.441 [2024-11-26 19:18:38.165881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.441 [2024-11-26 19:18:38.165954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.441 [2024-11-26 19:18:38.165965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.441 qpair failed and we were unable to recover it. 00:32:21.441 [2024-11-26 19:18:38.166024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.441 [2024-11-26 19:18:38.166096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.441 [2024-11-26 19:18:38.166105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.441 qpair failed and we were unable to recover it. 00:32:21.441 [2024-11-26 19:18:38.166186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.441 [2024-11-26 19:18:38.166316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.441 [2024-11-26 19:18:38.166325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.441 qpair failed and we were unable to recover it. 00:32:21.441 [2024-11-26 19:18:38.166461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.441 [2024-11-26 19:18:38.166592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.441 [2024-11-26 19:18:38.166601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.441 qpair failed and we were unable to recover it. 00:32:21.441 [2024-11-26 19:18:38.166663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.441 [2024-11-26 19:18:38.166729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.441 [2024-11-26 19:18:38.166739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.441 qpair failed and we were unable to recover it. 00:32:21.441 [2024-11-26 19:18:38.166804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.441 [2024-11-26 19:18:38.166867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.441 [2024-11-26 19:18:38.166876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.441 qpair failed and we were unable to recover it. 00:32:21.441 [2024-11-26 19:18:38.167019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.441 [2024-11-26 19:18:38.167100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.441 [2024-11-26 19:18:38.167110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.441 qpair failed and we were unable to recover it. 00:32:21.441 [2024-11-26 19:18:38.167182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.441 [2024-11-26 19:18:38.167248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.441 [2024-11-26 19:18:38.167258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.441 qpair failed and we were unable to recover it. 00:32:21.441 [2024-11-26 19:18:38.167426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.441 [2024-11-26 19:18:38.167487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.441 [2024-11-26 19:18:38.167497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.441 qpair failed and we were unable to recover it. 00:32:21.441 [2024-11-26 19:18:38.167558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.441 [2024-11-26 19:18:38.167617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.441 [2024-11-26 19:18:38.167625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.441 qpair failed and we were unable to recover it. 00:32:21.441 [2024-11-26 19:18:38.167685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.441 [2024-11-26 19:18:38.167817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.441 [2024-11-26 19:18:38.167828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.441 qpair failed and we were unable to recover it. 00:32:21.442 [2024-11-26 19:18:38.167914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.442 [2024-11-26 19:18:38.167975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.442 [2024-11-26 19:18:38.167985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.442 qpair failed and we were unable to recover it. 00:32:21.442 [2024-11-26 19:18:38.168048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.442 [2024-11-26 19:18:38.168181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.442 [2024-11-26 19:18:38.168190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.442 qpair failed and we were unable to recover it. 00:32:21.442 [2024-11-26 19:18:38.168261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.442 [2024-11-26 19:18:38.168339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.442 [2024-11-26 19:18:38.168349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.442 qpair failed and we were unable to recover it. 00:32:21.442 [2024-11-26 19:18:38.168423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.442 [2024-11-26 19:18:38.168484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.442 [2024-11-26 19:18:38.168493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.442 qpair failed and we were unable to recover it. 00:32:21.442 [2024-11-26 19:18:38.168563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.442 [2024-11-26 19:18:38.168616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.442 [2024-11-26 19:18:38.168626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.442 qpair failed and we were unable to recover it. 00:32:21.442 [2024-11-26 19:18:38.168682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.442 [2024-11-26 19:18:38.168750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.442 [2024-11-26 19:18:38.168759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.442 qpair failed and we were unable to recover it. 00:32:21.442 [2024-11-26 19:18:38.168834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.442 [2024-11-26 19:18:38.168907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.442 [2024-11-26 19:18:38.168916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.442 qpair failed and we were unable to recover it. 00:32:21.442 [2024-11-26 19:18:38.169042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.442 [2024-11-26 19:18:38.169118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.442 [2024-11-26 19:18:38.169128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.442 qpair failed and we were unable to recover it. 00:32:21.442 [2024-11-26 19:18:38.169307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.442 [2024-11-26 19:18:38.169367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.442 [2024-11-26 19:18:38.169377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.442 qpair failed and we were unable to recover it. 00:32:21.442 [2024-11-26 19:18:38.169459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.442 [2024-11-26 19:18:38.169545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.442 [2024-11-26 19:18:38.169554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.442 qpair failed and we were unable to recover it. 00:32:21.442 [2024-11-26 19:18:38.169634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.442 [2024-11-26 19:18:38.169711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.442 [2024-11-26 19:18:38.169720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.442 qpair failed and we were unable to recover it. 00:32:21.442 [2024-11-26 19:18:38.169863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.442 [2024-11-26 19:18:38.169926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.442 [2024-11-26 19:18:38.169935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.442 qpair failed and we were unable to recover it. 00:32:21.442 [2024-11-26 19:18:38.170020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.442 [2024-11-26 19:18:38.170147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.442 [2024-11-26 19:18:38.170156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.442 qpair failed and we were unable to recover it. 00:32:21.442 [2024-11-26 19:18:38.170221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.442 [2024-11-26 19:18:38.170383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.442 [2024-11-26 19:18:38.170393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.442 qpair failed and we were unable to recover it. 00:32:21.442 [2024-11-26 19:18:38.170476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.442 [2024-11-26 19:18:38.170544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.442 [2024-11-26 19:18:38.170553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.442 qpair failed and we were unable to recover it. 00:32:21.442 [2024-11-26 19:18:38.170618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.442 [2024-11-26 19:18:38.170786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.442 [2024-11-26 19:18:38.170800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.442 qpair failed and we were unable to recover it. 00:32:21.442 [2024-11-26 19:18:38.170863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.442 [2024-11-26 19:18:38.170932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.442 [2024-11-26 19:18:38.170942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.442 qpair failed and we were unable to recover it. 00:32:21.442 [2024-11-26 19:18:38.171031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.442 [2024-11-26 19:18:38.171152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.442 [2024-11-26 19:18:38.171162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.442 qpair failed and we were unable to recover it. 00:32:21.442 [2024-11-26 19:18:38.171291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.442 [2024-11-26 19:18:38.171340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.442 [2024-11-26 19:18:38.171349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.442 qpair failed and we were unable to recover it. 00:32:21.442 [2024-11-26 19:18:38.171417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.442 [2024-11-26 19:18:38.171499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.442 [2024-11-26 19:18:38.171508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.442 qpair failed and we were unable to recover it. 00:32:21.442 [2024-11-26 19:18:38.171559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.442 [2024-11-26 19:18:38.171634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.442 [2024-11-26 19:18:38.171643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.442 qpair failed and we were unable to recover it. 00:32:21.442 [2024-11-26 19:18:38.171729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.442 [2024-11-26 19:18:38.171798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.442 [2024-11-26 19:18:38.171808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.442 qpair failed and we were unable to recover it. 00:32:21.442 [2024-11-26 19:18:38.171875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.442 [2024-11-26 19:18:38.171940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.442 [2024-11-26 19:18:38.171953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.442 qpair failed and we were unable to recover it. 00:32:21.442 [2024-11-26 19:18:38.172089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.442 [2024-11-26 19:18:38.172144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.442 [2024-11-26 19:18:38.172153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.442 qpair failed and we were unable to recover it. 00:32:21.442 [2024-11-26 19:18:38.172221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.442 [2024-11-26 19:18:38.172284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.442 [2024-11-26 19:18:38.172293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.442 qpair failed and we were unable to recover it. 00:32:21.442 [2024-11-26 19:18:38.172345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.442 [2024-11-26 19:18:38.172401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.442 [2024-11-26 19:18:38.172412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.442 qpair failed and we were unable to recover it. 00:32:21.442 [2024-11-26 19:18:38.172480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.442 [2024-11-26 19:18:38.172533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.442 [2024-11-26 19:18:38.172542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.442 qpair failed and we were unable to recover it. 00:32:21.442 [2024-11-26 19:18:38.172606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.442 [2024-11-26 19:18:38.172678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.442 [2024-11-26 19:18:38.172688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.442 qpair failed and we were unable to recover it. 00:32:21.442 [2024-11-26 19:18:38.172763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.442 [2024-11-26 19:18:38.172829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.442 [2024-11-26 19:18:38.172839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.442 qpair failed and we were unable to recover it. 00:32:21.442 [2024-11-26 19:18:38.172916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.442 [2024-11-26 19:18:38.173052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.442 [2024-11-26 19:18:38.173063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.442 qpair failed and we were unable to recover it. 00:32:21.442 [2024-11-26 19:18:38.173124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.442 [2024-11-26 19:18:38.173195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.442 [2024-11-26 19:18:38.173204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.442 qpair failed and we were unable to recover it. 00:32:21.443 [2024-11-26 19:18:38.173265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.443 [2024-11-26 19:18:38.173329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.443 [2024-11-26 19:18:38.173339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.443 qpair failed and we were unable to recover it. 00:32:21.443 [2024-11-26 19:18:38.173410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.443 [2024-11-26 19:18:38.173485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.443 [2024-11-26 19:18:38.173494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.443 qpair failed and we were unable to recover it. 00:32:21.443 [2024-11-26 19:18:38.173585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.443 [2024-11-26 19:18:38.173650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.443 [2024-11-26 19:18:38.173660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.443 qpair failed and we were unable to recover it. 00:32:21.443 [2024-11-26 19:18:38.173793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.443 [2024-11-26 19:18:38.173864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.443 [2024-11-26 19:18:38.173874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.443 qpair failed and we were unable to recover it. 00:32:21.443 [2024-11-26 19:18:38.173944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.443 [2024-11-26 19:18:38.174048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.443 [2024-11-26 19:18:38.174060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.443 qpair failed and we were unable to recover it. 00:32:21.443 [2024-11-26 19:18:38.174120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.443 [2024-11-26 19:18:38.174188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.443 [2024-11-26 19:18:38.174197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.443 qpair failed and we were unable to recover it. 00:32:21.443 [2024-11-26 19:18:38.174259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.443 [2024-11-26 19:18:38.174317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.443 [2024-11-26 19:18:38.174326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.443 qpair failed and we were unable to recover it. 00:32:21.443 [2024-11-26 19:18:38.174391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.443 [2024-11-26 19:18:38.174545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.443 [2024-11-26 19:18:38.174554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.443 qpair failed and we were unable to recover it. 00:32:21.443 [2024-11-26 19:18:38.174614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.443 [2024-11-26 19:18:38.174678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.443 [2024-11-26 19:18:38.174687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.443 qpair failed and we were unable to recover it. 00:32:21.443 [2024-11-26 19:18:38.174748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.443 [2024-11-26 19:18:38.174805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.443 [2024-11-26 19:18:38.174815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.443 qpair failed and we were unable to recover it. 00:32:21.443 [2024-11-26 19:18:38.174893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.443 [2024-11-26 19:18:38.174959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.443 [2024-11-26 19:18:38.174969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.443 qpair failed and we were unable to recover it. 00:32:21.443 [2024-11-26 19:18:38.175029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.443 [2024-11-26 19:18:38.175160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.443 [2024-11-26 19:18:38.175170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.443 qpair failed and we were unable to recover it. 00:32:21.443 [2024-11-26 19:18:38.175233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.443 [2024-11-26 19:18:38.175317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.443 [2024-11-26 19:18:38.175326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.443 qpair failed and we were unable to recover it. 00:32:21.443 [2024-11-26 19:18:38.175464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.443 [2024-11-26 19:18:38.175602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.443 [2024-11-26 19:18:38.175612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.443 qpair failed and we were unable to recover it. 00:32:21.443 [2024-11-26 19:18:38.175685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.443 [2024-11-26 19:18:38.175748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.443 [2024-11-26 19:18:38.175761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.443 qpair failed and we were unable to recover it. 00:32:21.443 [2024-11-26 19:18:38.175823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.443 [2024-11-26 19:18:38.175889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.443 [2024-11-26 19:18:38.175898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.443 qpair failed and we were unable to recover it. 00:32:21.443 [2024-11-26 19:18:38.175989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.443 [2024-11-26 19:18:38.176047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.443 [2024-11-26 19:18:38.176056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.443 qpair failed and we were unable to recover it. 00:32:21.443 [2024-11-26 19:18:38.176183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.443 [2024-11-26 19:18:38.176320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.443 [2024-11-26 19:18:38.176330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.443 qpair failed and we were unable to recover it. 00:32:21.443 [2024-11-26 19:18:38.176400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.443 [2024-11-26 19:18:38.176472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.443 [2024-11-26 19:18:38.176481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.443 qpair failed and we were unable to recover it. 00:32:21.443 [2024-11-26 19:18:38.176558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.443 [2024-11-26 19:18:38.176623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.443 [2024-11-26 19:18:38.176632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.443 qpair failed and we were unable to recover it. 00:32:21.443 [2024-11-26 19:18:38.176690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.443 [2024-11-26 19:18:38.176756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.443 [2024-11-26 19:18:38.176766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.443 qpair failed and we were unable to recover it. 00:32:21.443 [2024-11-26 19:18:38.176832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.443 [2024-11-26 19:18:38.176999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.443 [2024-11-26 19:18:38.177009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.443 qpair failed and we were unable to recover it. 00:32:21.443 [2024-11-26 19:18:38.177090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.443 [2024-11-26 19:18:38.177225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.443 [2024-11-26 19:18:38.177235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.443 qpair failed and we were unable to recover it. 00:32:21.443 [2024-11-26 19:18:38.177418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.443 [2024-11-26 19:18:38.177477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.443 [2024-11-26 19:18:38.177487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.443 qpair failed and we were unable to recover it. 00:32:21.443 [2024-11-26 19:18:38.177618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.443 [2024-11-26 19:18:38.177694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.443 [2024-11-26 19:18:38.177704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.443 qpair failed and we were unable to recover it. 00:32:21.443 [2024-11-26 19:18:38.177784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.443 [2024-11-26 19:18:38.177909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.443 [2024-11-26 19:18:38.177918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.443 qpair failed and we were unable to recover it. 00:32:21.443 [2024-11-26 19:18:38.178096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.443 [2024-11-26 19:18:38.178239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.443 [2024-11-26 19:18:38.178249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.443 qpair failed and we were unable to recover it. 00:32:21.443 [2024-11-26 19:18:38.178312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.443 [2024-11-26 19:18:38.178375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.443 [2024-11-26 19:18:38.178384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.443 qpair failed and we were unable to recover it. 00:32:21.443 [2024-11-26 19:18:38.178476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.443 [2024-11-26 19:18:38.178539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.443 [2024-11-26 19:18:38.178549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.443 qpair failed and we were unable to recover it. 00:32:21.443 [2024-11-26 19:18:38.178662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.443 [2024-11-26 19:18:38.178903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.444 [2024-11-26 19:18:38.178914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.444 qpair failed and we were unable to recover it. 00:32:21.444 [2024-11-26 19:18:38.179063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.444 [2024-11-26 19:18:38.179141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.444 [2024-11-26 19:18:38.179150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.444 qpair failed and we were unable to recover it. 00:32:21.444 [2024-11-26 19:18:38.179230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.444 [2024-11-26 19:18:38.179326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.444 [2024-11-26 19:18:38.179336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.444 qpair failed and we were unable to recover it. 00:32:21.444 [2024-11-26 19:18:38.179410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.444 [2024-11-26 19:18:38.179553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.444 [2024-11-26 19:18:38.179563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.444 qpair failed and we were unable to recover it. 00:32:21.444 [2024-11-26 19:18:38.179769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.444 [2024-11-26 19:18:38.179899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.444 [2024-11-26 19:18:38.179908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.444 qpair failed and we were unable to recover it. 00:32:21.444 [2024-11-26 19:18:38.180089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.444 [2024-11-26 19:18:38.180177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.444 [2024-11-26 19:18:38.180187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.444 qpair failed and we were unable to recover it. 00:32:21.444 [2024-11-26 19:18:38.180282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.444 [2024-11-26 19:18:38.180423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.444 [2024-11-26 19:18:38.180433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.444 qpair failed and we were unable to recover it. 00:32:21.444 [2024-11-26 19:18:38.180627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.444 [2024-11-26 19:18:38.180764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.444 [2024-11-26 19:18:38.180774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.444 qpair failed and we were unable to recover it. 00:32:21.444 [2024-11-26 19:18:38.180907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.444 [2024-11-26 19:18:38.181049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.444 [2024-11-26 19:18:38.181060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.444 qpair failed and we were unable to recover it. 00:32:21.444 [2024-11-26 19:18:38.181139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.444 [2024-11-26 19:18:38.181290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.444 [2024-11-26 19:18:38.181300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.444 qpair failed and we were unable to recover it. 00:32:21.444 [2024-11-26 19:18:38.181389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.444 [2024-11-26 19:18:38.181551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.444 [2024-11-26 19:18:38.181561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.444 qpair failed and we were unable to recover it. 00:32:21.444 [2024-11-26 19:18:38.181715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.444 [2024-11-26 19:18:38.181788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.444 [2024-11-26 19:18:38.181798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.444 qpair failed and we were unable to recover it. 00:32:21.444 [2024-11-26 19:18:38.181955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.444 [2024-11-26 19:18:38.182075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.444 [2024-11-26 19:18:38.182084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.444 qpair failed and we were unable to recover it. 00:32:21.444 [2024-11-26 19:18:38.182293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.444 [2024-11-26 19:18:38.182421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.444 [2024-11-26 19:18:38.182430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.444 qpair failed and we were unable to recover it. 00:32:21.444 [2024-11-26 19:18:38.182645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.444 [2024-11-26 19:18:38.182860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.444 [2024-11-26 19:18:38.182869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.444 qpair failed and we were unable to recover it. 00:32:21.444 [2024-11-26 19:18:38.182951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.444 [2024-11-26 19:18:38.183103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.444 [2024-11-26 19:18:38.183113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.444 qpair failed and we were unable to recover it. 00:32:21.444 [2024-11-26 19:18:38.183251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.444 [2024-11-26 19:18:38.183392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.444 [2024-11-26 19:18:38.183401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.444 qpair failed and we were unable to recover it. 00:32:21.444 [2024-11-26 19:18:38.183628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.444 [2024-11-26 19:18:38.183796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.444 [2024-11-26 19:18:38.183806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.444 qpair failed and we were unable to recover it. 00:32:21.444 [2024-11-26 19:18:38.184019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.444 [2024-11-26 19:18:38.184097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.444 [2024-11-26 19:18:38.184107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.444 qpair failed and we were unable to recover it. 00:32:21.444 [2024-11-26 19:18:38.184189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.444 [2024-11-26 19:18:38.184349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.444 [2024-11-26 19:18:38.184359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.444 qpair failed and we were unable to recover it. 00:32:21.444 [2024-11-26 19:18:38.184497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.444 [2024-11-26 19:18:38.184639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.444 [2024-11-26 19:18:38.184649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.444 qpair failed and we were unable to recover it. 00:32:21.444 [2024-11-26 19:18:38.184844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.444 [2024-11-26 19:18:38.184924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.444 [2024-11-26 19:18:38.184934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.444 qpair failed and we were unable to recover it. 00:32:21.444 [2024-11-26 19:18:38.185042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.444 [2024-11-26 19:18:38.185237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.444 [2024-11-26 19:18:38.185246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.444 qpair failed and we were unable to recover it. 00:32:21.444 [2024-11-26 19:18:38.185412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.444 [2024-11-26 19:18:38.185603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.444 [2024-11-26 19:18:38.185614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.444 qpair failed and we were unable to recover it. 00:32:21.444 [2024-11-26 19:18:38.185784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.444 [2024-11-26 19:18:38.185957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.444 [2024-11-26 19:18:38.185969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.444 qpair failed and we were unable to recover it. 00:32:21.444 [2024-11-26 19:18:38.186137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.444 [2024-11-26 19:18:38.186370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.444 [2024-11-26 19:18:38.186379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.444 qpair failed and we were unable to recover it. 00:32:21.444 [2024-11-26 19:18:38.186581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.444 [2024-11-26 19:18:38.186745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.444 [2024-11-26 19:18:38.186755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.444 qpair failed and we were unable to recover it. 00:32:21.444 [2024-11-26 19:18:38.186944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.444 [2024-11-26 19:18:38.187154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.444 [2024-11-26 19:18:38.187164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.444 qpair failed and we were unable to recover it. 00:32:21.444 [2024-11-26 19:18:38.187310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.444 [2024-11-26 19:18:38.187465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.444 [2024-11-26 19:18:38.187475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.444 qpair failed and we were unable to recover it. 00:32:21.444 [2024-11-26 19:18:38.187584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.444 [2024-11-26 19:18:38.187662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.444 [2024-11-26 19:18:38.187672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.445 qpair failed and we were unable to recover it. 00:32:21.445 [2024-11-26 19:18:38.187895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.445 [2024-11-26 19:18:38.188117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.445 [2024-11-26 19:18:38.188127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.445 qpair failed and we were unable to recover it. 00:32:21.445 [2024-11-26 19:18:38.188218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.445 [2024-11-26 19:18:38.188396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.445 [2024-11-26 19:18:38.188408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.445 qpair failed and we were unable to recover it. 00:32:21.445 [2024-11-26 19:18:38.188557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.445 [2024-11-26 19:18:38.188691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.445 [2024-11-26 19:18:38.188701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.445 qpair failed and we were unable to recover it. 00:32:21.445 [2024-11-26 19:18:38.188796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.445 [2024-11-26 19:18:38.188992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.445 [2024-11-26 19:18:38.189004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.445 qpair failed and we were unable to recover it. 00:32:21.445 [2024-11-26 19:18:38.189082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.445 [2024-11-26 19:18:38.189230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.445 [2024-11-26 19:18:38.189241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.445 qpair failed and we were unable to recover it. 00:32:21.445 [2024-11-26 19:18:38.189314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.445 [2024-11-26 19:18:38.189437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.445 [2024-11-26 19:18:38.189447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.445 qpair failed and we were unable to recover it. 00:32:21.445 [2024-11-26 19:18:38.189703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.445 [2024-11-26 19:18:38.189831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.445 [2024-11-26 19:18:38.189841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.445 qpair failed and we were unable to recover it. 00:32:21.445 [2024-11-26 19:18:38.190014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.445 [2024-11-26 19:18:38.190094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.445 [2024-11-26 19:18:38.190104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.445 qpair failed and we were unable to recover it. 00:32:21.445 [2024-11-26 19:18:38.190188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.445 [2024-11-26 19:18:38.190429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.445 [2024-11-26 19:18:38.190440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.445 qpair failed and we were unable to recover it. 00:32:21.445 [2024-11-26 19:18:38.190597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.445 [2024-11-26 19:18:38.190839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.445 [2024-11-26 19:18:38.190850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.445 qpair failed and we were unable to recover it. 00:32:21.445 [2024-11-26 19:18:38.190950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.445 [2024-11-26 19:18:38.191195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.445 [2024-11-26 19:18:38.191204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.445 qpair failed and we were unable to recover it. 00:32:21.445 [2024-11-26 19:18:38.191361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.445 [2024-11-26 19:18:38.191454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.445 [2024-11-26 19:18:38.191464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.445 qpair failed and we were unable to recover it. 00:32:21.445 [2024-11-26 19:18:38.191554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.445 [2024-11-26 19:18:38.191772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.445 [2024-11-26 19:18:38.191782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.445 qpair failed and we were unable to recover it. 00:32:21.445 [2024-11-26 19:18:38.191988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.445 [2024-11-26 19:18:38.192081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.445 [2024-11-26 19:18:38.192091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.445 qpair failed and we were unable to recover it. 00:32:21.445 [2024-11-26 19:18:38.192183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.445 [2024-11-26 19:18:38.192401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.445 [2024-11-26 19:18:38.192410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.445 qpair failed and we were unable to recover it. 00:32:21.445 [2024-11-26 19:18:38.192490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.445 [2024-11-26 19:18:38.192715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.445 [2024-11-26 19:18:38.192725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.445 qpair failed and we were unable to recover it. 00:32:21.445 [2024-11-26 19:18:38.192804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.445 [2024-11-26 19:18:38.193026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.445 [2024-11-26 19:18:38.193037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.445 qpair failed and we were unable to recover it. 00:32:21.445 [2024-11-26 19:18:38.193137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.445 [2024-11-26 19:18:38.193280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.445 [2024-11-26 19:18:38.193289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.445 qpair failed and we were unable to recover it. 00:32:21.445 [2024-11-26 19:18:38.193380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.445 [2024-11-26 19:18:38.193521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.445 [2024-11-26 19:18:38.193530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.445 qpair failed and we were unable to recover it. 00:32:21.445 [2024-11-26 19:18:38.193684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.445 [2024-11-26 19:18:38.193756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.445 [2024-11-26 19:18:38.193766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.445 qpair failed and we were unable to recover it. 00:32:21.445 [2024-11-26 19:18:38.194024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.445 [2024-11-26 19:18:38.194151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.445 [2024-11-26 19:18:38.194160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.445 qpair failed and we were unable to recover it. 00:32:21.445 [2024-11-26 19:18:38.194261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.445 [2024-11-26 19:18:38.194474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.445 [2024-11-26 19:18:38.194484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.445 qpair failed and we were unable to recover it. 00:32:21.445 [2024-11-26 19:18:38.194716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.445 [2024-11-26 19:18:38.194995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.445 [2024-11-26 19:18:38.195005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.445 qpair failed and we were unable to recover it. 00:32:21.445 [2024-11-26 19:18:38.195137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.445 [2024-11-26 19:18:38.195213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.445 [2024-11-26 19:18:38.195223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.445 qpair failed and we were unable to recover it. 00:32:21.445 [2024-11-26 19:18:38.195378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.445 [2024-11-26 19:18:38.195526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.445 [2024-11-26 19:18:38.195535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.445 qpair failed and we were unable to recover it. 00:32:21.445 [2024-11-26 19:18:38.195607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.445 [2024-11-26 19:18:38.195682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.445 [2024-11-26 19:18:38.195692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.445 qpair failed and we were unable to recover it. 00:32:21.445 [2024-11-26 19:18:38.195842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.445 [2024-11-26 19:18:38.196091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.445 [2024-11-26 19:18:38.196102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.445 qpair failed and we were unable to recover it. 00:32:21.446 [2024-11-26 19:18:38.196239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.446 [2024-11-26 19:18:38.196338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.446 [2024-11-26 19:18:38.196348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.446 qpair failed and we were unable to recover it. 00:32:21.446 [2024-11-26 19:18:38.196423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.446 [2024-11-26 19:18:38.196637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.446 [2024-11-26 19:18:38.196646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.446 qpair failed and we were unable to recover it. 00:32:21.446 [2024-11-26 19:18:38.196784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.446 [2024-11-26 19:18:38.196945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.446 [2024-11-26 19:18:38.196963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.446 qpair failed and we were unable to recover it. 00:32:21.446 [2024-11-26 19:18:38.197109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.446 [2024-11-26 19:18:38.197193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.446 [2024-11-26 19:18:38.197202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.446 qpair failed and we were unable to recover it. 00:32:21.446 [2024-11-26 19:18:38.197281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.446 [2024-11-26 19:18:38.197476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.446 [2024-11-26 19:18:38.197486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.446 qpair failed and we were unable to recover it. 00:32:21.446 [2024-11-26 19:18:38.197638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.446 [2024-11-26 19:18:38.197782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.446 [2024-11-26 19:18:38.197792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.446 qpair failed and we were unable to recover it. 00:32:21.446 [2024-11-26 19:18:38.197928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.446 [2024-11-26 19:18:38.198097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.446 [2024-11-26 19:18:38.198108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.446 qpair failed and we were unable to recover it. 00:32:21.446 [2024-11-26 19:18:38.198189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.446 [2024-11-26 19:18:38.198396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.446 [2024-11-26 19:18:38.198406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.446 qpair failed and we were unable to recover it. 00:32:21.446 [2024-11-26 19:18:38.198542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.446 [2024-11-26 19:18:38.198636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.446 [2024-11-26 19:18:38.198645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.446 qpair failed and we were unable to recover it. 00:32:21.446 [2024-11-26 19:18:38.198810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.446 [2024-11-26 19:18:38.199052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.446 [2024-11-26 19:18:38.199063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.446 qpair failed and we were unable to recover it. 00:32:21.446 [2024-11-26 19:18:38.199150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.446 [2024-11-26 19:18:38.199291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.446 [2024-11-26 19:18:38.199300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.446 qpair failed and we were unable to recover it. 00:32:21.446 [2024-11-26 19:18:38.199393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.446 [2024-11-26 19:18:38.199482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.446 [2024-11-26 19:18:38.199492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.446 qpair failed and we were unable to recover it. 00:32:21.446 [2024-11-26 19:18:38.199693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.446 [2024-11-26 19:18:38.199908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.446 [2024-11-26 19:18:38.199918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.446 qpair failed and we were unable to recover it. 00:32:21.446 [2024-11-26 19:18:38.200046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.446 [2024-11-26 19:18:38.200288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.446 [2024-11-26 19:18:38.200298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.446 qpair failed and we were unable to recover it. 00:32:21.446 [2024-11-26 19:18:38.200379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.446 [2024-11-26 19:18:38.200462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.446 [2024-11-26 19:18:38.200472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.446 qpair failed and we were unable to recover it. 00:32:21.446 [2024-11-26 19:18:38.200545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.446 [2024-11-26 19:18:38.200633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.446 [2024-11-26 19:18:38.200643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.446 qpair failed and we were unable to recover it. 00:32:21.446 [2024-11-26 19:18:38.200866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.446 [2024-11-26 19:18:38.201009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.446 [2024-11-26 19:18:38.201019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.446 qpair failed and we were unable to recover it. 00:32:21.446 [2024-11-26 19:18:38.201117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.446 [2024-11-26 19:18:38.201212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.446 [2024-11-26 19:18:38.201221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.446 qpair failed and we were unable to recover it. 00:32:21.446 [2024-11-26 19:18:38.201358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.446 [2024-11-26 19:18:38.201448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.446 [2024-11-26 19:18:38.201458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.446 qpair failed and we were unable to recover it. 00:32:21.446 [2024-11-26 19:18:38.201688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.446 [2024-11-26 19:18:38.201830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.446 [2024-11-26 19:18:38.201840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.446 qpair failed and we were unable to recover it. 00:32:21.446 [2024-11-26 19:18:38.201983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.446 [2024-11-26 19:18:38.202060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.446 [2024-11-26 19:18:38.202069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.446 qpair failed and we were unable to recover it. 00:32:21.446 [2024-11-26 19:18:38.202148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.446 [2024-11-26 19:18:38.202290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.446 [2024-11-26 19:18:38.202299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.446 qpair failed and we were unable to recover it. 00:32:21.446 [2024-11-26 19:18:38.202401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.446 [2024-11-26 19:18:38.202536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.446 [2024-11-26 19:18:38.202545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.446 qpair failed and we were unable to recover it. 00:32:21.446 [2024-11-26 19:18:38.202711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.446 [2024-11-26 19:18:38.202769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.446 [2024-11-26 19:18:38.202779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.446 qpair failed and we were unable to recover it. 00:32:21.446 [2024-11-26 19:18:38.202845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.446 [2024-11-26 19:18:38.202991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.446 [2024-11-26 19:18:38.203002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.446 qpair failed and we were unable to recover it. 00:32:21.446 [2024-11-26 19:18:38.203090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.446 [2024-11-26 19:18:38.203161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.446 [2024-11-26 19:18:38.203170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.446 qpair failed and we were unable to recover it. 00:32:21.446 [2024-11-26 19:18:38.203267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.446 [2024-11-26 19:18:38.203341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.446 [2024-11-26 19:18:38.203352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.446 qpair failed and we were unable to recover it. 00:32:21.446 [2024-11-26 19:18:38.203413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.446 [2024-11-26 19:18:38.203487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.446 [2024-11-26 19:18:38.203496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.446 qpair failed and we were unable to recover it. 00:32:21.446 [2024-11-26 19:18:38.203663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.446 [2024-11-26 19:18:38.203791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.446 [2024-11-26 19:18:38.203801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.446 qpair failed and we were unable to recover it. 00:32:21.446 [2024-11-26 19:18:38.203972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.446 [2024-11-26 19:18:38.204065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.446 [2024-11-26 19:18:38.204075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.446 qpair failed and we were unable to recover it. 00:32:21.446 [2024-11-26 19:18:38.204167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.446 [2024-11-26 19:18:38.204245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.446 [2024-11-26 19:18:38.204255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.446 qpair failed and we were unable to recover it. 00:32:21.446 [2024-11-26 19:18:38.204322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.446 [2024-11-26 19:18:38.204469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.447 [2024-11-26 19:18:38.204480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.447 qpair failed and we were unable to recover it. 00:32:21.447 [2024-11-26 19:18:38.204704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.447 [2024-11-26 19:18:38.204840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.447 [2024-11-26 19:18:38.204849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.447 qpair failed and we were unable to recover it. 00:32:21.447 [2024-11-26 19:18:38.205092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.447 [2024-11-26 19:18:38.205226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.447 [2024-11-26 19:18:38.205235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.447 qpair failed and we were unable to recover it. 00:32:21.447 [2024-11-26 19:18:38.205374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.447 [2024-11-26 19:18:38.205514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.447 [2024-11-26 19:18:38.205524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.447 qpair failed and we were unable to recover it. 00:32:21.447 [2024-11-26 19:18:38.205682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.447 [2024-11-26 19:18:38.205828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.447 [2024-11-26 19:18:38.205838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.447 qpair failed and we were unable to recover it. 00:32:21.447 [2024-11-26 19:18:38.206062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.447 [2024-11-26 19:18:38.206257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.447 [2024-11-26 19:18:38.206266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.447 qpair failed and we were unable to recover it. 00:32:21.447 [2024-11-26 19:18:38.206403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.447 [2024-11-26 19:18:38.206543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.447 [2024-11-26 19:18:38.206554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.447 qpair failed and we were unable to recover it. 00:32:21.447 [2024-11-26 19:18:38.206797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.447 [2024-11-26 19:18:38.206927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.447 [2024-11-26 19:18:38.206936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.447 qpair failed and we were unable to recover it. 00:32:21.447 [2024-11-26 19:18:38.207078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.447 [2024-11-26 19:18:38.207156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.447 [2024-11-26 19:18:38.207165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.447 qpair failed and we were unable to recover it. 00:32:21.447 [2024-11-26 19:18:38.207365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.447 [2024-11-26 19:18:38.207430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.447 [2024-11-26 19:18:38.207439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.447 qpair failed and we were unable to recover it. 00:32:21.447 [2024-11-26 19:18:38.207611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.447 [2024-11-26 19:18:38.207819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.447 [2024-11-26 19:18:38.207829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.447 qpair failed and we were unable to recover it. 00:32:21.447 [2024-11-26 19:18:38.207888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.447 [2024-11-26 19:18:38.208100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.447 [2024-11-26 19:18:38.208111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.447 qpair failed and we were unable to recover it. 00:32:21.447 [2024-11-26 19:18:38.208258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.447 [2024-11-26 19:18:38.208356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.447 [2024-11-26 19:18:38.208365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.447 qpair failed and we were unable to recover it. 00:32:21.447 [2024-11-26 19:18:38.208472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.447 [2024-11-26 19:18:38.208556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.447 [2024-11-26 19:18:38.208566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.447 qpair failed and we were unable to recover it. 00:32:21.447 [2024-11-26 19:18:38.208646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.447 [2024-11-26 19:18:38.208786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.447 [2024-11-26 19:18:38.208797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.447 qpair failed and we were unable to recover it. 00:32:21.447 [2024-11-26 19:18:38.209015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.447 [2024-11-26 19:18:38.209158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.447 [2024-11-26 19:18:38.209168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.447 qpair failed and we were unable to recover it. 00:32:21.447 [2024-11-26 19:18:38.209300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.447 [2024-11-26 19:18:38.209437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.447 [2024-11-26 19:18:38.209446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.447 qpair failed and we were unable to recover it. 00:32:21.447 [2024-11-26 19:18:38.209672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.447 [2024-11-26 19:18:38.209780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.447 [2024-11-26 19:18:38.209790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.447 qpair failed and we were unable to recover it. 00:32:21.447 [2024-11-26 19:18:38.209883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.447 [2024-11-26 19:18:38.210078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.447 [2024-11-26 19:18:38.210091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.447 qpair failed and we were unable to recover it. 00:32:21.447 [2024-11-26 19:18:38.210177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.447 [2024-11-26 19:18:38.210248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.447 [2024-11-26 19:18:38.210258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.447 qpair failed and we were unable to recover it. 00:32:21.447 [2024-11-26 19:18:38.210480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.447 [2024-11-26 19:18:38.210579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.447 [2024-11-26 19:18:38.210589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.447 qpair failed and we were unable to recover it. 00:32:21.447 [2024-11-26 19:18:38.210752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.447 [2024-11-26 19:18:38.210972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.447 [2024-11-26 19:18:38.210982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.447 qpair failed and we were unable to recover it. 00:32:21.447 [2024-11-26 19:18:38.211138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.447 [2024-11-26 19:18:38.211264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.447 [2024-11-26 19:18:38.211274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.447 qpair failed and we were unable to recover it. 00:32:21.447 [2024-11-26 19:18:38.211362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.447 [2024-11-26 19:18:38.211445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.447 [2024-11-26 19:18:38.211455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.447 qpair failed and we were unable to recover it. 00:32:21.447 [2024-11-26 19:18:38.211649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.447 [2024-11-26 19:18:38.211883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.447 [2024-11-26 19:18:38.211892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.447 qpair failed and we were unable to recover it. 00:32:21.447 [2024-11-26 19:18:38.212036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.447 [2024-11-26 19:18:38.212260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.447 [2024-11-26 19:18:38.212270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.447 qpair failed and we were unable to recover it. 00:32:21.447 [2024-11-26 19:18:38.212355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.447 [2024-11-26 19:18:38.212494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.447 [2024-11-26 19:18:38.212503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.447 qpair failed and we were unable to recover it. 00:32:21.447 [2024-11-26 19:18:38.212657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.447 [2024-11-26 19:18:38.212889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.447 [2024-11-26 19:18:38.212898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.447 qpair failed and we were unable to recover it. 00:32:21.447 [2024-11-26 19:18:38.213052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.447 [2024-11-26 19:18:38.213142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.447 [2024-11-26 19:18:38.213155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.447 qpair failed and we were unable to recover it. 00:32:21.447 [2024-11-26 19:18:38.213297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.447 [2024-11-26 19:18:38.213389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.447 [2024-11-26 19:18:38.213399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.447 qpair failed and we were unable to recover it. 00:32:21.447 [2024-11-26 19:18:38.213547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.447 [2024-11-26 19:18:38.213630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.447 [2024-11-26 19:18:38.213640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.447 qpair failed and we were unable to recover it. 00:32:21.447 [2024-11-26 19:18:38.213722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.447 [2024-11-26 19:18:38.213966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.447 [2024-11-26 19:18:38.213976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.447 qpair failed and we were unable to recover it. 00:32:21.447 [2024-11-26 19:18:38.214073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.447 [2024-11-26 19:18:38.214220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.447 [2024-11-26 19:18:38.214230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.447 qpair failed and we were unable to recover it. 00:32:21.447 [2024-11-26 19:18:38.214300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.447 [2024-11-26 19:18:38.214493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.448 [2024-11-26 19:18:38.214503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.448 qpair failed and we were unable to recover it. 00:32:21.448 [2024-11-26 19:18:38.214716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.448 [2024-11-26 19:18:38.214879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.448 [2024-11-26 19:18:38.214889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.448 qpair failed and we were unable to recover it. 00:32:21.448 [2024-11-26 19:18:38.215087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.448 [2024-11-26 19:18:38.215149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.448 [2024-11-26 19:18:38.215158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.448 qpair failed and we were unable to recover it. 00:32:21.448 [2024-11-26 19:18:38.215292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.448 [2024-11-26 19:18:38.215431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.448 [2024-11-26 19:18:38.215442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.448 qpair failed and we were unable to recover it. 00:32:21.448 [2024-11-26 19:18:38.215718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.448 [2024-11-26 19:18:38.215805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.448 [2024-11-26 19:18:38.215814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.448 qpair failed and we were unable to recover it. 00:32:21.448 [2024-11-26 19:18:38.216011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.448 [2024-11-26 19:18:38.216162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.448 [2024-11-26 19:18:38.216174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.448 qpair failed and we were unable to recover it. 00:32:21.448 [2024-11-26 19:18:38.216267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.448 [2024-11-26 19:18:38.216458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.448 [2024-11-26 19:18:38.216468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.448 qpair failed and we were unable to recover it. 00:32:21.448 [2024-11-26 19:18:38.216618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.448 [2024-11-26 19:18:38.216778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.448 [2024-11-26 19:18:38.216788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.448 qpair failed and we were unable to recover it. 00:32:21.448 [2024-11-26 19:18:38.217032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.448 [2024-11-26 19:18:38.217118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.448 [2024-11-26 19:18:38.217127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.448 qpair failed and we were unable to recover it. 00:32:21.448 [2024-11-26 19:18:38.217272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.448 [2024-11-26 19:18:38.217364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.448 [2024-11-26 19:18:38.217373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.448 qpair failed and we were unable to recover it. 00:32:21.448 [2024-11-26 19:18:38.217532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.448 [2024-11-26 19:18:38.217713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.448 [2024-11-26 19:18:38.217722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.448 qpair failed and we were unable to recover it. 00:32:21.448 [2024-11-26 19:18:38.217810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.448 [2024-11-26 19:18:38.217967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.448 [2024-11-26 19:18:38.217977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.448 qpair failed and we were unable to recover it. 00:32:21.448 [2024-11-26 19:18:38.218203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.448 [2024-11-26 19:18:38.218349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.448 [2024-11-26 19:18:38.218359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.448 qpair failed and we were unable to recover it. 00:32:21.448 [2024-11-26 19:18:38.218507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.448 [2024-11-26 19:18:38.218735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.448 [2024-11-26 19:18:38.218744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.448 qpair failed and we were unable to recover it. 00:32:21.448 [2024-11-26 19:18:38.218886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.448 [2024-11-26 19:18:38.219084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.448 [2024-11-26 19:18:38.219095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.448 qpair failed and we were unable to recover it. 00:32:21.448 [2024-11-26 19:18:38.219220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.448 [2024-11-26 19:18:38.219382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.448 [2024-11-26 19:18:38.219397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.448 qpair failed and we were unable to recover it. 00:32:21.448 [2024-11-26 19:18:38.219609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.448 [2024-11-26 19:18:38.219713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.448 [2024-11-26 19:18:38.219722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.448 qpair failed and we were unable to recover it. 00:32:21.448 [2024-11-26 19:18:38.219800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.448 [2024-11-26 19:18:38.220012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.448 [2024-11-26 19:18:38.220022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.448 qpair failed and we were unable to recover it. 00:32:21.448 [2024-11-26 19:18:38.220151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.448 [2024-11-26 19:18:38.220384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.448 [2024-11-26 19:18:38.220395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.448 qpair failed and we were unable to recover it. 00:32:21.448 [2024-11-26 19:18:38.220533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.448 [2024-11-26 19:18:38.220830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.448 [2024-11-26 19:18:38.220840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.448 qpair failed and we were unable to recover it. 00:32:21.448 [2024-11-26 19:18:38.221006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.448 [2024-11-26 19:18:38.221236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.448 [2024-11-26 19:18:38.221246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.448 qpair failed and we were unable to recover it. 00:32:21.448 [2024-11-26 19:18:38.221399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.448 [2024-11-26 19:18:38.221494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.448 [2024-11-26 19:18:38.221504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.448 qpair failed and we were unable to recover it. 00:32:21.448 [2024-11-26 19:18:38.221670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.448 [2024-11-26 19:18:38.221861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.448 [2024-11-26 19:18:38.221870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.448 qpair failed and we were unable to recover it. 00:32:21.448 [2024-11-26 19:18:38.222062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.448 [2024-11-26 19:18:38.222197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.448 [2024-11-26 19:18:38.222207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.448 qpair failed and we were unable to recover it. 00:32:21.448 [2024-11-26 19:18:38.222407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.448 [2024-11-26 19:18:38.222552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.448 [2024-11-26 19:18:38.222562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.448 qpair failed and we were unable to recover it. 00:32:21.448 [2024-11-26 19:18:38.222787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.448 [2024-11-26 19:18:38.222925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.448 [2024-11-26 19:18:38.222935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.448 qpair failed and we were unable to recover it. 00:32:21.448 [2024-11-26 19:18:38.223110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.448 [2024-11-26 19:18:38.223200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.448 [2024-11-26 19:18:38.223210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.448 qpair failed and we were unable to recover it. 00:32:21.448 [2024-11-26 19:18:38.223289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.448 [2024-11-26 19:18:38.223372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.448 [2024-11-26 19:18:38.223381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.448 qpair failed and we were unable to recover it. 00:32:21.448 [2024-11-26 19:18:38.223619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.448 [2024-11-26 19:18:38.223813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.448 [2024-11-26 19:18:38.223823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.448 qpair failed and we were unable to recover it. 00:32:21.448 [2024-11-26 19:18:38.223967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.448 [2024-11-26 19:18:38.224064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.448 [2024-11-26 19:18:38.224074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.448 qpair failed and we were unable to recover it. 00:32:21.448 [2024-11-26 19:18:38.224219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.448 [2024-11-26 19:18:38.224359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.448 [2024-11-26 19:18:38.224370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.448 qpair failed and we were unable to recover it. 00:32:21.448 [2024-11-26 19:18:38.224512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.448 [2024-11-26 19:18:38.224667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.448 [2024-11-26 19:18:38.224677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.448 qpair failed and we were unable to recover it. 00:32:21.448 [2024-11-26 19:18:38.224764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.448 [2024-11-26 19:18:38.224958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.448 [2024-11-26 19:18:38.224968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.448 qpair failed and we were unable to recover it. 00:32:21.449 [2024-11-26 19:18:38.225094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.449 [2024-11-26 19:18:38.225174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.449 [2024-11-26 19:18:38.225183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.449 qpair failed and we were unable to recover it. 00:32:21.449 [2024-11-26 19:18:38.225387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.449 [2024-11-26 19:18:38.225610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.449 [2024-11-26 19:18:38.225620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.449 qpair failed and we were unable to recover it. 00:32:21.449 [2024-11-26 19:18:38.225763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.449 [2024-11-26 19:18:38.225962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.449 [2024-11-26 19:18:38.225973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.449 qpair failed and we were unable to recover it. 00:32:21.449 [2024-11-26 19:18:38.226065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.449 [2024-11-26 19:18:38.226148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.449 [2024-11-26 19:18:38.226157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.449 qpair failed and we were unable to recover it. 00:32:21.449 [2024-11-26 19:18:38.226235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.449 [2024-11-26 19:18:38.226411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.449 [2024-11-26 19:18:38.226421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.449 qpair failed and we were unable to recover it. 00:32:21.449 [2024-11-26 19:18:38.226517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.449 [2024-11-26 19:18:38.226747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.449 [2024-11-26 19:18:38.226757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.449 qpair failed and we were unable to recover it. 00:32:21.449 [2024-11-26 19:18:38.226955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.449 [2024-11-26 19:18:38.227031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.449 [2024-11-26 19:18:38.227040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.449 qpair failed and we were unable to recover it. 00:32:21.449 [2024-11-26 19:18:38.227181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.449 [2024-11-26 19:18:38.227246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.449 [2024-11-26 19:18:38.227255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.449 qpair failed and we were unable to recover it. 00:32:21.449 [2024-11-26 19:18:38.227343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.449 [2024-11-26 19:18:38.227574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.449 [2024-11-26 19:18:38.227584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.449 qpair failed and we were unable to recover it. 00:32:21.449 [2024-11-26 19:18:38.227776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.449 [2024-11-26 19:18:38.227971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.449 [2024-11-26 19:18:38.227982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.449 qpair failed and we were unable to recover it. 00:32:21.449 [2024-11-26 19:18:38.228072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.449 [2024-11-26 19:18:38.228316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.449 [2024-11-26 19:18:38.228326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.449 qpair failed and we were unable to recover it. 00:32:21.449 [2024-11-26 19:18:38.228467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.449 [2024-11-26 19:18:38.228537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.449 [2024-11-26 19:18:38.228546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.449 qpair failed and we were unable to recover it. 00:32:21.449 [2024-11-26 19:18:38.228769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.449 [2024-11-26 19:18:38.229017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.449 [2024-11-26 19:18:38.229028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.449 qpair failed and we were unable to recover it. 00:32:21.449 [2024-11-26 19:18:38.229233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.449 [2024-11-26 19:18:38.229309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.449 [2024-11-26 19:18:38.229319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.449 qpair failed and we were unable to recover it. 00:32:21.449 [2024-11-26 19:18:38.229463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.449 [2024-11-26 19:18:38.229669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.449 [2024-11-26 19:18:38.229679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.449 qpair failed and we were unable to recover it. 00:32:21.449 [2024-11-26 19:18:38.229863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.449 [2024-11-26 19:18:38.229942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.449 [2024-11-26 19:18:38.229955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.449 qpair failed and we were unable to recover it. 00:32:21.449 [2024-11-26 19:18:38.230161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.449 [2024-11-26 19:18:38.230308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.449 [2024-11-26 19:18:38.230318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.449 qpair failed and we were unable to recover it. 00:32:21.449 [2024-11-26 19:18:38.230400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.449 [2024-11-26 19:18:38.230480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.449 [2024-11-26 19:18:38.230491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.449 qpair failed and we were unable to recover it. 00:32:21.449 [2024-11-26 19:18:38.230618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.449 [2024-11-26 19:18:38.230772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.449 [2024-11-26 19:18:38.230781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.449 qpair failed and we were unable to recover it. 00:32:21.449 [2024-11-26 19:18:38.230877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.449 [2024-11-26 19:18:38.230980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.449 [2024-11-26 19:18:38.230990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.449 qpair failed and we were unable to recover it. 00:32:21.449 [2024-11-26 19:18:38.231087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.449 [2024-11-26 19:18:38.231301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.449 [2024-11-26 19:18:38.231310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.449 qpair failed and we were unable to recover it. 00:32:21.449 [2024-11-26 19:18:38.231453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.449 [2024-11-26 19:18:38.231712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.449 [2024-11-26 19:18:38.231721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.449 qpair failed and we were unable to recover it. 00:32:21.449 [2024-11-26 19:18:38.231929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.449 [2024-11-26 19:18:38.232110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.449 [2024-11-26 19:18:38.232122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.449 qpair failed and we were unable to recover it. 00:32:21.449 [2024-11-26 19:18:38.232224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.449 [2024-11-26 19:18:38.232305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.449 [2024-11-26 19:18:38.232315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.449 qpair failed and we were unable to recover it. 00:32:21.449 [2024-11-26 19:18:38.232555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.449 [2024-11-26 19:18:38.232692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.449 [2024-11-26 19:18:38.232702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.449 qpair failed and we were unable to recover it. 00:32:21.449 [2024-11-26 19:18:38.232853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.449 [2024-11-26 19:18:38.233075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.449 [2024-11-26 19:18:38.233086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.449 qpair failed and we were unable to recover it. 00:32:21.449 [2024-11-26 19:18:38.233226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.449 [2024-11-26 19:18:38.233308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.449 [2024-11-26 19:18:38.233318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.449 qpair failed and we were unable to recover it. 00:32:21.449 [2024-11-26 19:18:38.233421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.449 [2024-11-26 19:18:38.233615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.449 [2024-11-26 19:18:38.233624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.449 qpair failed and we were unable to recover it. 00:32:21.449 [2024-11-26 19:18:38.233714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.449 [2024-11-26 19:18:38.233812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.450 [2024-11-26 19:18:38.233821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.450 qpair failed and we were unable to recover it. 00:32:21.450 [2024-11-26 19:18:38.233904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.450 [2024-11-26 19:18:38.234078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.450 [2024-11-26 19:18:38.234089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.450 qpair failed and we were unable to recover it. 00:32:21.450 [2024-11-26 19:18:38.234175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.450 [2024-11-26 19:18:38.234259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.450 [2024-11-26 19:18:38.234268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.450 qpair failed and we were unable to recover it. 00:32:21.450 [2024-11-26 19:18:38.234412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.450 [2024-11-26 19:18:38.234548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.450 [2024-11-26 19:18:38.234558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.450 qpair failed and we were unable to recover it. 00:32:21.450 [2024-11-26 19:18:38.234635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.450 [2024-11-26 19:18:38.234856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.450 [2024-11-26 19:18:38.234866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.450 qpair failed and we were unable to recover it. 00:32:21.450 [2024-11-26 19:18:38.235027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.450 [2024-11-26 19:18:38.235115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.450 [2024-11-26 19:18:38.235125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.450 qpair failed and we were unable to recover it. 00:32:21.450 [2024-11-26 19:18:38.235213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.450 [2024-11-26 19:18:38.235303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.450 [2024-11-26 19:18:38.235313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.450 qpair failed and we were unable to recover it. 00:32:21.450 [2024-11-26 19:18:38.235397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.450 [2024-11-26 19:18:38.235599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.450 [2024-11-26 19:18:38.235608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.450 qpair failed and we were unable to recover it. 00:32:21.450 [2024-11-26 19:18:38.235743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.450 [2024-11-26 19:18:38.236001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.450 [2024-11-26 19:18:38.236011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.450 qpair failed and we were unable to recover it. 00:32:21.450 [2024-11-26 19:18:38.236220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.450 [2024-11-26 19:18:38.236425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.450 [2024-11-26 19:18:38.236435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.450 qpair failed and we were unable to recover it. 00:32:21.450 [2024-11-26 19:18:38.236518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.450 [2024-11-26 19:18:38.236600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.450 [2024-11-26 19:18:38.236609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.450 qpair failed and we were unable to recover it. 00:32:21.450 [2024-11-26 19:18:38.236698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.450 [2024-11-26 19:18:38.236890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.450 [2024-11-26 19:18:38.236900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.450 qpair failed and we were unable to recover it. 00:32:21.450 [2024-11-26 19:18:38.237124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.450 [2024-11-26 19:18:38.237259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.450 [2024-11-26 19:18:38.237268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.450 qpair failed and we were unable to recover it. 00:32:21.450 [2024-11-26 19:18:38.237397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.450 [2024-11-26 19:18:38.237631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.450 [2024-11-26 19:18:38.237641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.450 qpair failed and we were unable to recover it. 00:32:21.450 [2024-11-26 19:18:38.237883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.450 [2024-11-26 19:18:38.238097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.450 [2024-11-26 19:18:38.238108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.450 qpair failed and we were unable to recover it. 00:32:21.450 [2024-11-26 19:18:38.238259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.450 [2024-11-26 19:18:38.238454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.450 [2024-11-26 19:18:38.238464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.450 qpair failed and we were unable to recover it. 00:32:21.450 [2024-11-26 19:18:38.238632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.450 [2024-11-26 19:18:38.238696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.450 [2024-11-26 19:18:38.238706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.450 qpair failed and we were unable to recover it. 00:32:21.450 [2024-11-26 19:18:38.238927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.450 [2024-11-26 19:18:38.239170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.450 [2024-11-26 19:18:38.239180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.450 qpair failed and we were unable to recover it. 00:32:21.450 [2024-11-26 19:18:38.239397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.450 [2024-11-26 19:18:38.239493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.450 [2024-11-26 19:18:38.239502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.450 qpair failed and we were unable to recover it. 00:32:21.450 [2024-11-26 19:18:38.239779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.450 [2024-11-26 19:18:38.239972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.450 [2024-11-26 19:18:38.239982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.450 qpair failed and we were unable to recover it. 00:32:21.450 [2024-11-26 19:18:38.240076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.450 [2024-11-26 19:18:38.240240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.450 [2024-11-26 19:18:38.240249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.450 qpair failed and we were unable to recover it. 00:32:21.450 [2024-11-26 19:18:38.240332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.450 [2024-11-26 19:18:38.240504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.450 [2024-11-26 19:18:38.240514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.450 qpair failed and we were unable to recover it. 00:32:21.450 [2024-11-26 19:18:38.240710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.450 [2024-11-26 19:18:38.240902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.450 [2024-11-26 19:18:38.240912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.450 qpair failed and we were unable to recover it. 00:32:21.450 [2024-11-26 19:18:38.241115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.450 [2024-11-26 19:18:38.241311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.450 [2024-11-26 19:18:38.241321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.450 qpair failed and we were unable to recover it. 00:32:21.450 [2024-11-26 19:18:38.241548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.450 [2024-11-26 19:18:38.241786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.450 [2024-11-26 19:18:38.241796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.450 qpair failed and we were unable to recover it. 00:32:21.450 [2024-11-26 19:18:38.242007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.450 [2024-11-26 19:18:38.242104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.451 [2024-11-26 19:18:38.242113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.451 qpair failed and we were unable to recover it. 00:32:21.451 [2024-11-26 19:18:38.242310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.451 [2024-11-26 19:18:38.242474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.451 [2024-11-26 19:18:38.242483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.451 qpair failed and we were unable to recover it. 00:32:21.451 [2024-11-26 19:18:38.242736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.451 [2024-11-26 19:18:38.242955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.451 [2024-11-26 19:18:38.242965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.451 qpair failed and we were unable to recover it. 00:32:21.451 [2024-11-26 19:18:38.243090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.451 [2024-11-26 19:18:38.243311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.451 [2024-11-26 19:18:38.243321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.451 qpair failed and we were unable to recover it. 00:32:21.451 [2024-11-26 19:18:38.243527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.451 [2024-11-26 19:18:38.243611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.451 [2024-11-26 19:18:38.243620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.451 qpair failed and we were unable to recover it. 00:32:21.451 [2024-11-26 19:18:38.243850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.451 [2024-11-26 19:18:38.243997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.451 [2024-11-26 19:18:38.244007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.451 qpair failed and we were unable to recover it. 00:32:21.451 [2024-11-26 19:18:38.244101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.451 [2024-11-26 19:18:38.244337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.451 [2024-11-26 19:18:38.244346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.451 qpair failed and we were unable to recover it. 00:32:21.451 [2024-11-26 19:18:38.244540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.451 [2024-11-26 19:18:38.244685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.451 [2024-11-26 19:18:38.244694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.451 qpair failed and we were unable to recover it. 00:32:21.451 [2024-11-26 19:18:38.244778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.451 [2024-11-26 19:18:38.245003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.451 [2024-11-26 19:18:38.245014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.451 qpair failed and we were unable to recover it. 00:32:21.451 [2024-11-26 19:18:38.245206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.451 [2024-11-26 19:18:38.245302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.451 [2024-11-26 19:18:38.245312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.451 qpair failed and we were unable to recover it. 00:32:21.451 [2024-11-26 19:18:38.245462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.451 [2024-11-26 19:18:38.245546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.451 [2024-11-26 19:18:38.245556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.451 qpair failed and we were unable to recover it. 00:32:21.451 [2024-11-26 19:18:38.245692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.451 [2024-11-26 19:18:38.245848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.451 [2024-11-26 19:18:38.245858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.451 qpair failed and we were unable to recover it. 00:32:21.451 [2024-11-26 19:18:38.246057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.451 [2024-11-26 19:18:38.246199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.451 [2024-11-26 19:18:38.246209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.451 qpair failed and we were unable to recover it. 00:32:21.451 [2024-11-26 19:18:38.246373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.451 [2024-11-26 19:18:38.246501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.451 [2024-11-26 19:18:38.246510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.451 qpair failed and we were unable to recover it. 00:32:21.451 [2024-11-26 19:18:38.246682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.451 [2024-11-26 19:18:38.246829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.451 [2024-11-26 19:18:38.246839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.451 qpair failed and we were unable to recover it. 00:32:21.451 [2024-11-26 19:18:38.247032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.451 [2024-11-26 19:18:38.247217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.451 [2024-11-26 19:18:38.247227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.451 qpair failed and we were unable to recover it. 00:32:21.451 [2024-11-26 19:18:38.247397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.451 [2024-11-26 19:18:38.247494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.451 [2024-11-26 19:18:38.247503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.451 qpair failed and we were unable to recover it. 00:32:21.451 [2024-11-26 19:18:38.247707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.451 [2024-11-26 19:18:38.247926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.451 [2024-11-26 19:18:38.247936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.451 qpair failed and we were unable to recover it. 00:32:21.451 [2024-11-26 19:18:38.248111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.451 [2024-11-26 19:18:38.248275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.451 [2024-11-26 19:18:38.248284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.451 qpair failed and we were unable to recover it. 00:32:21.451 [2024-11-26 19:18:38.248467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.451 [2024-11-26 19:18:38.248633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.451 [2024-11-26 19:18:38.248643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.451 qpair failed and we were unable to recover it. 00:32:21.451 [2024-11-26 19:18:38.248785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.451 [2024-11-26 19:18:38.248853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.451 [2024-11-26 19:18:38.248863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.451 qpair failed and we were unable to recover it. 00:32:21.451 [2024-11-26 19:18:38.248995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.451 [2024-11-26 19:18:38.249077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.451 [2024-11-26 19:18:38.249086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.451 qpair failed and we were unable to recover it. 00:32:21.451 [2024-11-26 19:18:38.249234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.451 [2024-11-26 19:18:38.249438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.451 [2024-11-26 19:18:38.249448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.451 qpair failed and we were unable to recover it. 00:32:21.451 [2024-11-26 19:18:38.249708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.451 [2024-11-26 19:18:38.249855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.451 [2024-11-26 19:18:38.249864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.451 qpair failed and we were unable to recover it. 00:32:21.451 [2024-11-26 19:18:38.250074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.451 [2024-11-26 19:18:38.250266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.451 [2024-11-26 19:18:38.250276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.451 qpair failed and we were unable to recover it. 00:32:21.451 [2024-11-26 19:18:38.250368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.451 [2024-11-26 19:18:38.250455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.451 [2024-11-26 19:18:38.250465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.451 qpair failed and we were unable to recover it. 00:32:21.451 [2024-11-26 19:18:38.250704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.451 [2024-11-26 19:18:38.250840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.451 [2024-11-26 19:18:38.250849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.451 qpair failed and we were unable to recover it. 00:32:21.451 [2024-11-26 19:18:38.250988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.451 [2024-11-26 19:18:38.251184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.451 [2024-11-26 19:18:38.251194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.451 qpair failed and we were unable to recover it. 00:32:21.451 [2024-11-26 19:18:38.251342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.451 [2024-11-26 19:18:38.251571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.451 [2024-11-26 19:18:38.251581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.451 qpair failed and we were unable to recover it. 00:32:21.451 [2024-11-26 19:18:38.251753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.451 [2024-11-26 19:18:38.251951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.451 [2024-11-26 19:18:38.251961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.451 qpair failed and we were unable to recover it. 00:32:21.451 [2024-11-26 19:18:38.252145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.451 [2024-11-26 19:18:38.252224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.452 [2024-11-26 19:18:38.252235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.452 qpair failed and we were unable to recover it. 00:32:21.452 [2024-11-26 19:18:38.252372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.452 [2024-11-26 19:18:38.252516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.452 [2024-11-26 19:18:38.252526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.452 qpair failed and we were unable to recover it. 00:32:21.452 [2024-11-26 19:18:38.252744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.452 [2024-11-26 19:18:38.252905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.452 [2024-11-26 19:18:38.252915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.452 qpair failed and we were unable to recover it. 00:32:21.452 [2024-11-26 19:18:38.253189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.452 [2024-11-26 19:18:38.253427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.452 [2024-11-26 19:18:38.253437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.452 qpair failed and we were unable to recover it. 00:32:21.452 [2024-11-26 19:18:38.253592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.452 [2024-11-26 19:18:38.253835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.452 [2024-11-26 19:18:38.253845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.452 qpair failed and we were unable to recover it. 00:32:21.452 [2024-11-26 19:18:38.253989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.452 [2024-11-26 19:18:38.254172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.452 [2024-11-26 19:18:38.254182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.452 qpair failed and we were unable to recover it. 00:32:21.452 [2024-11-26 19:18:38.254312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.452 [2024-11-26 19:18:38.254410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.452 [2024-11-26 19:18:38.254420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.452 qpair failed and we were unable to recover it. 00:32:21.452 [2024-11-26 19:18:38.254498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.452 [2024-11-26 19:18:38.254713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.452 [2024-11-26 19:18:38.254724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.452 qpair failed and we were unable to recover it. 00:32:21.452 [2024-11-26 19:18:38.254888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.452 [2024-11-26 19:18:38.255053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.452 [2024-11-26 19:18:38.255064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.452 qpair failed and we were unable to recover it. 00:32:21.452 [2024-11-26 19:18:38.255156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.452 [2024-11-26 19:18:38.255349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.452 [2024-11-26 19:18:38.255359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.452 qpair failed and we were unable to recover it. 00:32:21.452 [2024-11-26 19:18:38.255449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.452 [2024-11-26 19:18:38.255716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.452 [2024-11-26 19:18:38.255725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.452 qpair failed and we were unable to recover it. 00:32:21.452 [2024-11-26 19:18:38.255911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.452 [2024-11-26 19:18:38.256131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.452 [2024-11-26 19:18:38.256142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.452 qpair failed and we were unable to recover it. 00:32:21.452 [2024-11-26 19:18:38.256290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.452 [2024-11-26 19:18:38.256510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.452 [2024-11-26 19:18:38.256520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.452 qpair failed and we were unable to recover it. 00:32:21.452 [2024-11-26 19:18:38.256663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.452 [2024-11-26 19:18:38.256852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.452 [2024-11-26 19:18:38.256861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.452 qpair failed and we were unable to recover it. 00:32:21.452 [2024-11-26 19:18:38.256998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.452 [2024-11-26 19:18:38.257161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.452 [2024-11-26 19:18:38.257172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.452 qpair failed and we were unable to recover it. 00:32:21.452 [2024-11-26 19:18:38.257316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.452 [2024-11-26 19:18:38.257395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.452 [2024-11-26 19:18:38.257404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.452 qpair failed and we were unable to recover it. 00:32:21.452 [2024-11-26 19:18:38.257622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.452 [2024-11-26 19:18:38.257767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.452 [2024-11-26 19:18:38.257777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.452 qpair failed and we were unable to recover it. 00:32:21.452 [2024-11-26 19:18:38.257976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.452 [2024-11-26 19:18:38.258135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.452 [2024-11-26 19:18:38.258144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.452 qpair failed and we were unable to recover it. 00:32:21.452 [2024-11-26 19:18:38.258284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.452 [2024-11-26 19:18:38.258451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.452 [2024-11-26 19:18:38.258461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.452 qpair failed and we were unable to recover it. 00:32:21.452 [2024-11-26 19:18:38.258663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.452 [2024-11-26 19:18:38.258906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.452 [2024-11-26 19:18:38.258917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.452 qpair failed and we were unable to recover it. 00:32:21.452 [2024-11-26 19:18:38.259070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.452 [2024-11-26 19:18:38.259143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.452 [2024-11-26 19:18:38.259153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.452 qpair failed and we were unable to recover it. 00:32:21.452 [2024-11-26 19:18:38.259224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.452 [2024-11-26 19:18:38.259367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.452 [2024-11-26 19:18:38.259377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.452 qpair failed and we were unable to recover it. 00:32:21.452 [2024-11-26 19:18:38.259463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.452 [2024-11-26 19:18:38.259619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.452 [2024-11-26 19:18:38.259629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.452 qpair failed and we were unable to recover it. 00:32:21.452 [2024-11-26 19:18:38.259851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.452 [2024-11-26 19:18:38.260091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.452 [2024-11-26 19:18:38.260101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.452 qpair failed and we were unable to recover it. 00:32:21.452 [2024-11-26 19:18:38.260200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.452 [2024-11-26 19:18:38.260298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.452 [2024-11-26 19:18:38.260308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.452 qpair failed and we were unable to recover it. 00:32:21.452 [2024-11-26 19:18:38.260403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.452 [2024-11-26 19:18:38.260491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.452 [2024-11-26 19:18:38.260500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.452 qpair failed and we were unable to recover it. 00:32:21.452 [2024-11-26 19:18:38.260644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.452 [2024-11-26 19:18:38.260725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.452 [2024-11-26 19:18:38.260735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.452 qpair failed and we were unable to recover it. 00:32:21.452 [2024-11-26 19:18:38.260936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.452 [2024-11-26 19:18:38.261012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.452 [2024-11-26 19:18:38.261022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.452 qpair failed and we were unable to recover it. 00:32:21.452 [2024-11-26 19:18:38.261155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.452 [2024-11-26 19:18:38.261284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.452 [2024-11-26 19:18:38.261293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.452 qpair failed and we were unable to recover it. 00:32:21.452 [2024-11-26 19:18:38.261377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.452 [2024-11-26 19:18:38.261453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.452 [2024-11-26 19:18:38.261463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.452 qpair failed and we were unable to recover it. 00:32:21.452 [2024-11-26 19:18:38.261659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.452 [2024-11-26 19:18:38.261820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.452 [2024-11-26 19:18:38.261832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.452 qpair failed and we were unable to recover it. 00:32:21.452 [2024-11-26 19:18:38.261994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.452 [2024-11-26 19:18:38.262123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.453 [2024-11-26 19:18:38.262133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.453 qpair failed and we were unable to recover it. 00:32:21.453 [2024-11-26 19:18:38.262223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.453 [2024-11-26 19:18:38.262316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.453 [2024-11-26 19:18:38.262326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.453 qpair failed and we were unable to recover it. 00:32:21.453 [2024-11-26 19:18:38.262396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.453 [2024-11-26 19:18:38.262523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.453 [2024-11-26 19:18:38.262533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.453 qpair failed and we were unable to recover it. 00:32:21.453 [2024-11-26 19:18:38.262602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.453 [2024-11-26 19:18:38.262826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.453 [2024-11-26 19:18:38.262836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.453 qpair failed and we were unable to recover it. 00:32:21.453 [2024-11-26 19:18:38.262921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.453 [2024-11-26 19:18:38.263082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.453 [2024-11-26 19:18:38.263093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.453 qpair failed and we were unable to recover it. 00:32:21.453 [2024-11-26 19:18:38.263235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.453 [2024-11-26 19:18:38.263403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.453 [2024-11-26 19:18:38.263413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.453 qpair failed and we were unable to recover it. 00:32:21.453 [2024-11-26 19:18:38.263561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.453 [2024-11-26 19:18:38.263709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.453 [2024-11-26 19:18:38.263718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.453 qpair failed and we were unable to recover it. 00:32:21.453 [2024-11-26 19:18:38.263859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.453 [2024-11-26 19:18:38.264007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.453 [2024-11-26 19:18:38.264017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.453 qpair failed and we were unable to recover it. 00:32:21.453 [2024-11-26 19:18:38.264101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.453 [2024-11-26 19:18:38.264340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.453 [2024-11-26 19:18:38.264350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.453 qpair failed and we were unable to recover it. 00:32:21.453 [2024-11-26 19:18:38.264492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.453 [2024-11-26 19:18:38.264571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.453 [2024-11-26 19:18:38.264582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.453 qpair failed and we were unable to recover it. 00:32:21.453 [2024-11-26 19:18:38.264678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.453 [2024-11-26 19:18:38.264817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.453 [2024-11-26 19:18:38.264827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.453 qpair failed and we were unable to recover it. 00:32:21.453 [2024-11-26 19:18:38.265052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.453 [2024-11-26 19:18:38.265270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.453 [2024-11-26 19:18:38.265281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.453 qpair failed and we were unable to recover it. 00:32:21.453 [2024-11-26 19:18:38.265423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.453 [2024-11-26 19:18:38.265657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.453 [2024-11-26 19:18:38.265667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.453 qpair failed and we were unable to recover it. 00:32:21.453 [2024-11-26 19:18:38.265796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.453 [2024-11-26 19:18:38.265933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.453 [2024-11-26 19:18:38.265942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.453 qpair failed and we were unable to recover it. 00:32:21.453 [2024-11-26 19:18:38.266055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.453 [2024-11-26 19:18:38.266206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.453 [2024-11-26 19:18:38.266216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.453 qpair failed and we were unable to recover it. 00:32:21.453 [2024-11-26 19:18:38.266358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.453 [2024-11-26 19:18:38.266454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.453 [2024-11-26 19:18:38.266463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.453 qpair failed and we were unable to recover it. 00:32:21.453 [2024-11-26 19:18:38.266558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.453 [2024-11-26 19:18:38.266776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.453 [2024-11-26 19:18:38.266786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.453 qpair failed and we were unable to recover it. 00:32:21.453 [2024-11-26 19:18:38.266860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.453 [2024-11-26 19:18:38.267076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.453 [2024-11-26 19:18:38.267087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.453 qpair failed and we were unable to recover it. 00:32:21.453 [2024-11-26 19:18:38.267231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.453 [2024-11-26 19:18:38.267455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.453 [2024-11-26 19:18:38.267465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.453 qpair failed and we were unable to recover it. 00:32:21.453 [2024-11-26 19:18:38.267559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.453 [2024-11-26 19:18:38.267750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.453 [2024-11-26 19:18:38.267764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.453 qpair failed and we were unable to recover it. 00:32:21.453 [2024-11-26 19:18:38.267973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.453 [2024-11-26 19:18:38.268079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.453 [2024-11-26 19:18:38.268089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.453 qpair failed and we were unable to recover it. 00:32:21.453 [2024-11-26 19:18:38.268174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.453 [2024-11-26 19:18:38.268320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.453 [2024-11-26 19:18:38.268330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.453 qpair failed and we were unable to recover it. 00:32:21.453 [2024-11-26 19:18:38.268467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.453 [2024-11-26 19:18:38.268734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.453 [2024-11-26 19:18:38.268744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.453 qpair failed and we were unable to recover it. 00:32:21.453 [2024-11-26 19:18:38.268950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.453 [2024-11-26 19:18:38.269146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.453 [2024-11-26 19:18:38.269156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.453 qpair failed and we were unable to recover it. 00:32:21.453 [2024-11-26 19:18:38.269291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.453 [2024-11-26 19:18:38.269384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.453 [2024-11-26 19:18:38.269394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.453 qpair failed and we were unable to recover it. 00:32:21.453 [2024-11-26 19:18:38.269557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.453 [2024-11-26 19:18:38.269830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.453 [2024-11-26 19:18:38.269840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.453 qpair failed and we were unable to recover it. 00:32:21.453 [2024-11-26 19:18:38.270007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.453 [2024-11-26 19:18:38.270148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.453 [2024-11-26 19:18:38.270157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.453 qpair failed and we were unable to recover it. 00:32:21.453 [2024-11-26 19:18:38.270305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.453 [2024-11-26 19:18:38.270450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.453 [2024-11-26 19:18:38.270460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.453 qpair failed and we were unable to recover it. 00:32:21.453 [2024-11-26 19:18:38.270649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.453 [2024-11-26 19:18:38.270830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.453 [2024-11-26 19:18:38.270839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.453 qpair failed and we were unable to recover it. 00:32:21.453 [2024-11-26 19:18:38.270995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.453 [2024-11-26 19:18:38.271099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.453 [2024-11-26 19:18:38.271111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.453 qpair failed and we were unable to recover it. 00:32:21.453 [2024-11-26 19:18:38.271260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.453 [2024-11-26 19:18:38.271399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.453 [2024-11-26 19:18:38.271409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.453 qpair failed and we were unable to recover it. 00:32:21.453 [2024-11-26 19:18:38.271633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.453 [2024-11-26 19:18:38.271772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.453 [2024-11-26 19:18:38.271782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.453 qpair failed and we were unable to recover it. 00:32:21.453 [2024-11-26 19:18:38.271926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.453 [2024-11-26 19:18:38.272161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.453 [2024-11-26 19:18:38.272172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.453 qpair failed and we were unable to recover it. 00:32:21.453 [2024-11-26 19:18:38.272324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.453 [2024-11-26 19:18:38.272452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.453 [2024-11-26 19:18:38.272462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.453 qpair failed and we were unable to recover it. 00:32:21.453 [2024-11-26 19:18:38.272699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.453 [2024-11-26 19:18:38.272782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.454 [2024-11-26 19:18:38.272791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.454 qpair failed and we were unable to recover it. 00:32:21.454 [2024-11-26 19:18:38.273006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.454 [2024-11-26 19:18:38.273204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.454 [2024-11-26 19:18:38.273214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.454 qpair failed and we were unable to recover it. 00:32:21.454 [2024-11-26 19:18:38.273353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.454 [2024-11-26 19:18:38.273503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.454 [2024-11-26 19:18:38.273513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.454 qpair failed and we were unable to recover it. 00:32:21.454 [2024-11-26 19:18:38.273741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.454 [2024-11-26 19:18:38.273987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.454 [2024-11-26 19:18:38.273997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.454 qpair failed and we were unable to recover it. 00:32:21.454 [2024-11-26 19:18:38.274091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.454 [2024-11-26 19:18:38.274179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.454 [2024-11-26 19:18:38.274189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.454 qpair failed and we were unable to recover it. 00:32:21.454 [2024-11-26 19:18:38.274288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.454 [2024-11-26 19:18:38.274414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.454 [2024-11-26 19:18:38.274424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.454 qpair failed and we were unable to recover it. 00:32:21.454 [2024-11-26 19:18:38.274580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.454 [2024-11-26 19:18:38.274820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.454 [2024-11-26 19:18:38.274830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.454 qpair failed and we were unable to recover it. 00:32:21.454 [2024-11-26 19:18:38.275044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.454 [2024-11-26 19:18:38.275262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.454 [2024-11-26 19:18:38.275271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.454 qpair failed and we were unable to recover it. 00:32:21.454 [2024-11-26 19:18:38.275351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.454 [2024-11-26 19:18:38.275455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.454 [2024-11-26 19:18:38.275465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.454 qpair failed and we were unable to recover it. 00:32:21.454 [2024-11-26 19:18:38.275681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.454 [2024-11-26 19:18:38.275825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.454 [2024-11-26 19:18:38.275835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.454 qpair failed and we were unable to recover it. 00:32:21.454 [2024-11-26 19:18:38.275975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.454 [2024-11-26 19:18:38.276120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.454 [2024-11-26 19:18:38.276129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.454 qpair failed and we were unable to recover it. 00:32:21.454 [2024-11-26 19:18:38.276260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.454 [2024-11-26 19:18:38.276357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.454 [2024-11-26 19:18:38.276367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.454 qpair failed and we were unable to recover it. 00:32:21.454 [2024-11-26 19:18:38.276462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.454 [2024-11-26 19:18:38.276675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.454 [2024-11-26 19:18:38.276685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.454 qpair failed and we were unable to recover it. 00:32:21.454 [2024-11-26 19:18:38.276777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.454 [2024-11-26 19:18:38.276848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.454 [2024-11-26 19:18:38.276858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.454 qpair failed and we were unable to recover it. 00:32:21.454 [2024-11-26 19:18:38.276995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.454 [2024-11-26 19:18:38.277075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.454 [2024-11-26 19:18:38.277085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.454 qpair failed and we were unable to recover it. 00:32:21.454 [2024-11-26 19:18:38.277285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.454 [2024-11-26 19:18:38.277451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.454 [2024-11-26 19:18:38.277461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.454 qpair failed and we were unable to recover it. 00:32:21.454 [2024-11-26 19:18:38.277769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.454 [2024-11-26 19:18:38.277972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.454 [2024-11-26 19:18:38.277982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.454 qpair failed and we were unable to recover it. 00:32:21.454 [2024-11-26 19:18:38.278081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.454 [2024-11-26 19:18:38.278227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.454 [2024-11-26 19:18:38.278237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.454 qpair failed and we were unable to recover it. 00:32:21.454 [2024-11-26 19:18:38.278370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.454 [2024-11-26 19:18:38.278517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.454 [2024-11-26 19:18:38.278527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.454 qpair failed and we were unable to recover it. 00:32:21.454 [2024-11-26 19:18:38.278744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.454 [2024-11-26 19:18:38.278973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.454 [2024-11-26 19:18:38.278984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.454 qpair failed and we were unable to recover it. 00:32:21.454 [2024-11-26 19:18:38.279089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.454 [2024-11-26 19:18:38.279244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.454 [2024-11-26 19:18:38.279253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.454 qpair failed and we were unable to recover it. 00:32:21.454 [2024-11-26 19:18:38.279350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.454 [2024-11-26 19:18:38.279435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.454 [2024-11-26 19:18:38.279445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.454 qpair failed and we were unable to recover it. 00:32:21.454 [2024-11-26 19:18:38.279711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.454 [2024-11-26 19:18:38.279798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.454 [2024-11-26 19:18:38.279808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.454 qpair failed and we were unable to recover it. 00:32:21.454 [2024-11-26 19:18:38.280004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.454 [2024-11-26 19:18:38.280159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.454 [2024-11-26 19:18:38.280169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.454 qpair failed and we were unable to recover it. 00:32:21.454 [2024-11-26 19:18:38.280257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.454 [2024-11-26 19:18:38.280402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.454 [2024-11-26 19:18:38.280411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.454 qpair failed and we were unable to recover it. 00:32:21.454 [2024-11-26 19:18:38.280590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.454 [2024-11-26 19:18:38.280784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.454 [2024-11-26 19:18:38.280794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.454 qpair failed and we were unable to recover it. 00:32:21.454 [2024-11-26 19:18:38.281007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.454 [2024-11-26 19:18:38.281077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.454 [2024-11-26 19:18:38.281086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.454 qpair failed and we were unable to recover it. 00:32:21.454 [2024-11-26 19:18:38.281173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.454 [2024-11-26 19:18:38.281272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.454 [2024-11-26 19:18:38.281281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.454 qpair failed and we were unable to recover it. 00:32:21.454 [2024-11-26 19:18:38.281352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.454 [2024-11-26 19:18:38.281485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.454 [2024-11-26 19:18:38.281494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.454 qpair failed and we were unable to recover it. 00:32:21.454 [2024-11-26 19:18:38.281585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.454 [2024-11-26 19:18:38.281727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.454 [2024-11-26 19:18:38.281737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.454 qpair failed and we were unable to recover it. 00:32:21.454 [2024-11-26 19:18:38.281972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.454 [2024-11-26 19:18:38.282107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.454 [2024-11-26 19:18:38.282117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.454 qpair failed and we were unable to recover it. 00:32:21.455 [2024-11-26 19:18:38.282210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.282301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.282311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.455 qpair failed and we were unable to recover it. 00:32:21.455 [2024-11-26 19:18:38.282458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.282621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.282630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.455 qpair failed and we were unable to recover it. 00:32:21.455 [2024-11-26 19:18:38.282791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.282938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.282960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.455 qpair failed and we were unable to recover it. 00:32:21.455 [2024-11-26 19:18:38.283099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.283334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.283344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.455 qpair failed and we were unable to recover it. 00:32:21.455 [2024-11-26 19:18:38.283434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.283644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.283654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.455 qpair failed and we were unable to recover it. 00:32:21.455 [2024-11-26 19:18:38.283735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.283955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.283966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.455 qpair failed and we were unable to recover it. 00:32:21.455 [2024-11-26 19:18:38.284050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.284198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.284208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.455 qpair failed and we were unable to recover it. 00:32:21.455 [2024-11-26 19:18:38.284468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.284555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.284564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.455 qpair failed and we were unable to recover it. 00:32:21.455 [2024-11-26 19:18:38.284764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.284912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.284921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.455 qpair failed and we were unable to recover it. 00:32:21.455 [2024-11-26 19:18:38.285005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.285140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.285150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.455 qpair failed and we were unable to recover it. 00:32:21.455 [2024-11-26 19:18:38.285287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.285432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.285442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.455 qpair failed and we were unable to recover it. 00:32:21.455 [2024-11-26 19:18:38.285541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.285713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.285723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.455 qpair failed and we were unable to recover it. 00:32:21.455 [2024-11-26 19:18:38.285919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.286069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.286080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.455 qpair failed and we were unable to recover it. 00:32:21.455 [2024-11-26 19:18:38.286250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.286474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.286485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.455 qpair failed and we were unable to recover it. 00:32:21.455 [2024-11-26 19:18:38.286677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.286834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.286844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.455 qpair failed and we were unable to recover it. 00:32:21.455 [2024-11-26 19:18:38.287023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.287164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.287173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.455 qpair failed and we were unable to recover it. 00:32:21.455 [2024-11-26 19:18:38.287409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.287502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.287512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.455 qpair failed and we were unable to recover it. 00:32:21.455 [2024-11-26 19:18:38.287658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.287878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.287887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.455 qpair failed and we were unable to recover it. 00:32:21.455 [2024-11-26 19:18:38.287977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.288059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.288069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.455 qpair failed and we were unable to recover it. 00:32:21.455 [2024-11-26 19:18:38.288169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.288325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.288335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.455 qpair failed and we were unable to recover it. 00:32:21.455 [2024-11-26 19:18:38.288429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.288510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.288519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.455 qpair failed and we were unable to recover it. 00:32:21.455 [2024-11-26 19:18:38.288704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.288847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.288856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.455 qpair failed and we were unable to recover it. 00:32:21.455 [2024-11-26 19:18:38.289042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.289183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.289194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.455 qpair failed and we were unable to recover it. 00:32:21.455 [2024-11-26 19:18:38.289267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.289412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.289421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.455 qpair failed and we were unable to recover it. 00:32:21.455 [2024-11-26 19:18:38.289581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.289707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.289717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.455 qpair failed and we were unable to recover it. 00:32:21.455 [2024-11-26 19:18:38.289784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.289920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.289932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.455 qpair failed and we were unable to recover it. 00:32:21.455 [2024-11-26 19:18:38.290027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.290103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.290113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.455 qpair failed and we were unable to recover it. 00:32:21.455 [2024-11-26 19:18:38.290209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.290360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.290369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.455 qpair failed and we were unable to recover it. 00:32:21.455 [2024-11-26 19:18:38.290647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.290785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.290796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.455 qpair failed and we were unable to recover it. 00:32:21.455 [2024-11-26 19:18:38.290991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.291143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.291153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.455 qpair failed and we were unable to recover it. 00:32:21.455 [2024-11-26 19:18:38.291386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.291466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.291476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.455 qpair failed and we were unable to recover it. 00:32:21.455 [2024-11-26 19:18:38.291575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.291658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.291668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.455 qpair failed and we were unable to recover it. 00:32:21.455 [2024-11-26 19:18:38.291752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.291946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.291960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.455 qpair failed and we were unable to recover it. 00:32:21.455 [2024-11-26 19:18:38.292112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.292207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.292216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.455 qpair failed and we were unable to recover it. 00:32:21.455 [2024-11-26 19:18:38.292416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.292655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.292665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.455 qpair failed and we were unable to recover it. 00:32:21.455 [2024-11-26 19:18:38.292829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.292981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.292992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.455 qpair failed and we were unable to recover it. 00:32:21.455 [2024-11-26 19:18:38.293150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.455 [2024-11-26 19:18:38.293344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.293354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.456 qpair failed and we were unable to recover it. 00:32:21.456 [2024-11-26 19:18:38.293518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.293734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.293743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.456 qpair failed and we were unable to recover it. 00:32:21.456 [2024-11-26 19:18:38.293912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.294061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.294070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.456 qpair failed and we were unable to recover it. 00:32:21.456 [2024-11-26 19:18:38.294152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.294322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.294332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.456 qpair failed and we were unable to recover it. 00:32:21.456 [2024-11-26 19:18:38.294530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.294775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.294785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.456 qpair failed and we were unable to recover it. 00:32:21.456 [2024-11-26 19:18:38.295005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.295150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.295160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.456 qpair failed and we were unable to recover it. 00:32:21.456 [2024-11-26 19:18:38.295309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.295524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.295534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.456 qpair failed and we were unable to recover it. 00:32:21.456 [2024-11-26 19:18:38.295687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.295767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.295777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.456 qpair failed and we were unable to recover it. 00:32:21.456 [2024-11-26 19:18:38.295861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.296046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.296056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.456 qpair failed and we were unable to recover it. 00:32:21.456 [2024-11-26 19:18:38.296197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.296349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.296359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.456 qpair failed and we were unable to recover it. 00:32:21.456 [2024-11-26 19:18:38.296508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.296768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.296778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.456 qpair failed and we were unable to recover it. 00:32:21.456 [2024-11-26 19:18:38.296990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.297185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.297194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.456 qpair failed and we were unable to recover it. 00:32:21.456 [2024-11-26 19:18:38.297295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.297456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.297466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.456 qpair failed and we were unable to recover it. 00:32:21.456 [2024-11-26 19:18:38.297684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.297845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.297855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.456 qpair failed and we were unable to recover it. 00:32:21.456 [2024-11-26 19:18:38.298021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.298159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.298169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.456 qpair failed and we were unable to recover it. 00:32:21.456 [2024-11-26 19:18:38.298309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.298452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.298462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.456 qpair failed and we were unable to recover it. 00:32:21.456 [2024-11-26 19:18:38.298632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.298705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.298715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.456 qpair failed and we were unable to recover it. 00:32:21.456 [2024-11-26 19:18:38.298791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.298937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.298955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.456 qpair failed and we were unable to recover it. 00:32:21.456 [2024-11-26 19:18:38.299106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.299248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.299258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.456 qpair failed and we were unable to recover it. 00:32:21.456 [2024-11-26 19:18:38.299348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.299583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.299593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.456 qpair failed and we were unable to recover it. 00:32:21.456 [2024-11-26 19:18:38.299722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.299885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.299895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.456 qpair failed and we were unable to recover it. 00:32:21.456 [2024-11-26 19:18:38.300070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.300263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.300273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.456 qpair failed and we were unable to recover it. 00:32:21.456 [2024-11-26 19:18:38.300513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.300743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.300753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.456 qpair failed and we were unable to recover it. 00:32:21.456 [2024-11-26 19:18:38.300828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.301032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.301042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.456 qpair failed and we were unable to recover it. 00:32:21.456 [2024-11-26 19:18:38.301195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.301288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.301297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.456 qpair failed and we were unable to recover it. 00:32:21.456 [2024-11-26 19:18:38.301460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.301684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.301694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.456 qpair failed and we were unable to recover it. 00:32:21.456 [2024-11-26 19:18:38.301950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.302199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.302209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.456 qpair failed and we were unable to recover it. 00:32:21.456 [2024-11-26 19:18:38.302403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.302611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.302621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.456 qpair failed and we were unable to recover it. 00:32:21.456 [2024-11-26 19:18:38.302696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.302891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.302901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.456 qpair failed and we were unable to recover it. 00:32:21.456 [2024-11-26 19:18:38.303136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.303355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.303365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.456 qpair failed and we were unable to recover it. 00:32:21.456 [2024-11-26 19:18:38.303516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.303657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.303667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.456 qpair failed and we were unable to recover it. 00:32:21.456 [2024-11-26 19:18:38.303867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.304084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.304095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.456 qpair failed and we were unable to recover it. 00:32:21.456 [2024-11-26 19:18:38.304244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.304487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.304497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.456 qpair failed and we were unable to recover it. 00:32:21.456 [2024-11-26 19:18:38.304644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.304780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.304790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.456 qpair failed and we were unable to recover it. 00:32:21.456 [2024-11-26 19:18:38.304983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.305225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.305235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.456 qpair failed and we were unable to recover it. 00:32:21.456 [2024-11-26 19:18:38.305325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.305479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.305488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.456 qpair failed and we were unable to recover it. 00:32:21.456 [2024-11-26 19:18:38.305672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.305829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.305839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.456 qpair failed and we were unable to recover it. 00:32:21.456 [2024-11-26 19:18:38.305997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.306076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.306085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.456 qpair failed and we were unable to recover it. 00:32:21.456 [2024-11-26 19:18:38.306226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.306355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.306365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.456 qpair failed and we were unable to recover it. 00:32:21.456 [2024-11-26 19:18:38.306512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.306728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.306738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.456 qpair failed and we were unable to recover it. 00:32:21.456 [2024-11-26 19:18:38.306872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.307062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.307073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.456 qpair failed and we were unable to recover it. 00:32:21.456 [2024-11-26 19:18:38.307267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.307402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.307412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.456 qpair failed and we were unable to recover it. 00:32:21.456 [2024-11-26 19:18:38.307622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.307757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.307767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.456 qpair failed and we were unable to recover it. 00:32:21.456 [2024-11-26 19:18:38.307900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.456 [2024-11-26 19:18:38.308116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.308127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.457 qpair failed and we were unable to recover it. 00:32:21.457 [2024-11-26 19:18:38.308326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.308461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.308471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.457 qpair failed and we were unable to recover it. 00:32:21.457 [2024-11-26 19:18:38.308668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.308857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.308866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.457 qpair failed and we were unable to recover it. 00:32:21.457 [2024-11-26 19:18:38.309062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.309203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.309213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.457 qpair failed and we were unable to recover it. 00:32:21.457 [2024-11-26 19:18:38.309419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.309664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.309674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.457 qpair failed and we were unable to recover it. 00:32:21.457 [2024-11-26 19:18:38.309826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.309895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.309905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.457 qpair failed and we were unable to recover it. 00:32:21.457 [2024-11-26 19:18:38.310104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.310252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.310261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.457 qpair failed and we were unable to recover it. 00:32:21.457 [2024-11-26 19:18:38.310344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.310534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.310544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.457 qpair failed and we were unable to recover it. 00:32:21.457 [2024-11-26 19:18:38.310749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.310963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.310974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.457 qpair failed and we were unable to recover it. 00:32:21.457 [2024-11-26 19:18:38.311112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.311251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.311260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.457 qpair failed and we were unable to recover it. 00:32:21.457 [2024-11-26 19:18:38.311342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.311483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.311492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.457 qpair failed and we were unable to recover it. 00:32:21.457 [2024-11-26 19:18:38.311635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.311772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.311781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.457 qpair failed and we were unable to recover it. 00:32:21.457 [2024-11-26 19:18:38.311921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.312153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.312164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.457 qpair failed and we were unable to recover it. 00:32:21.457 [2024-11-26 19:18:38.312371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.312563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.312573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.457 qpair failed and we were unable to recover it. 00:32:21.457 [2024-11-26 19:18:38.312743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.312867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.312877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.457 qpair failed and we were unable to recover it. 00:32:21.457 [2024-11-26 19:18:38.313108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.313351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.313361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.457 qpair failed and we were unable to recover it. 00:32:21.457 [2024-11-26 19:18:38.313527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.313733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.313745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.457 qpair failed and we were unable to recover it. 00:32:21.457 [2024-11-26 19:18:38.313946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.314147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.314157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.457 qpair failed and we were unable to recover it. 00:32:21.457 [2024-11-26 19:18:38.314246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.314444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.314454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.457 qpair failed and we were unable to recover it. 00:32:21.457 [2024-11-26 19:18:38.314653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.314871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.314880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.457 qpair failed and we were unable to recover it. 00:32:21.457 [2024-11-26 19:18:38.315049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.315269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.315278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.457 qpair failed and we were unable to recover it. 00:32:21.457 [2024-11-26 19:18:38.315409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.315473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.315482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.457 qpair failed and we were unable to recover it. 00:32:21.457 [2024-11-26 19:18:38.315623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.315704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.315714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.457 qpair failed and we were unable to recover it. 00:32:21.457 [2024-11-26 19:18:38.315937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.316091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.316100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.457 qpair failed and we were unable to recover it. 00:32:21.457 [2024-11-26 19:18:38.316297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.316501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.316511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.457 qpair failed and we were unable to recover it. 00:32:21.457 [2024-11-26 19:18:38.316679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.316775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.316784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.457 qpair failed and we were unable to recover it. 00:32:21.457 [2024-11-26 19:18:38.316920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.317162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.317176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.457 qpair failed and we were unable to recover it. 00:32:21.457 [2024-11-26 19:18:38.317333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.317427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.317436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.457 qpair failed and we were unable to recover it. 00:32:21.457 [2024-11-26 19:18:38.317523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.317679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.317689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.457 qpair failed and we were unable to recover it. 00:32:21.457 [2024-11-26 19:18:38.317888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.318144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.318154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.457 qpair failed and we were unable to recover it. 00:32:21.457 [2024-11-26 19:18:38.318348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.318485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.318495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.457 qpair failed and we were unable to recover it. 00:32:21.457 [2024-11-26 19:18:38.318759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.319005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.319016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.457 qpair failed and we were unable to recover it. 00:32:21.457 [2024-11-26 19:18:38.319186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.319390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.319400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.457 qpair failed and we were unable to recover it. 00:32:21.457 [2024-11-26 19:18:38.319645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.319860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.319870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.457 qpair failed and we were unable to recover it. 00:32:21.457 [2024-11-26 19:18:38.319999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.320145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.320154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.457 qpair failed and we were unable to recover it. 00:32:21.457 [2024-11-26 19:18:38.320297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.320436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.320445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.457 qpair failed and we were unable to recover it. 00:32:21.457 [2024-11-26 19:18:38.320639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.320792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.320804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.457 qpair failed and we were unable to recover it. 00:32:21.457 [2024-11-26 19:18:38.321032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.321124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.321134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.457 qpair failed and we were unable to recover it. 00:32:21.457 [2024-11-26 19:18:38.321274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.321424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.321433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.457 qpair failed and we were unable to recover it. 00:32:21.457 [2024-11-26 19:18:38.321571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.321715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.321725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.457 qpair failed and we were unable to recover it. 00:32:21.457 [2024-11-26 19:18:38.321862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.322045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.322056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.457 qpair failed and we were unable to recover it. 00:32:21.457 [2024-11-26 19:18:38.322252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.322386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.457 [2024-11-26 19:18:38.322396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.457 qpair failed and we were unable to recover it. 00:32:21.457 [2024-11-26 19:18:38.322533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.458 [2024-11-26 19:18:38.322671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.458 [2024-11-26 19:18:38.322680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.458 qpair failed and we were unable to recover it. 00:32:21.458 [2024-11-26 19:18:38.322829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.458 [2024-11-26 19:18:38.323022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.458 [2024-11-26 19:18:38.323033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.458 qpair failed and we were unable to recover it. 00:32:21.458 [2024-11-26 19:18:38.323126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.458 [2024-11-26 19:18:38.323269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.458 [2024-11-26 19:18:38.323279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.458 qpair failed and we were unable to recover it. 00:32:21.458 [2024-11-26 19:18:38.323502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.458 [2024-11-26 19:18:38.323693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.458 [2024-11-26 19:18:38.323703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.458 qpair failed and we were unable to recover it. 00:32:21.458 [2024-11-26 19:18:38.323841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.458 [2024-11-26 19:18:38.323981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.458 [2024-11-26 19:18:38.323993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.458 qpair failed and we were unable to recover it. 00:32:21.458 [2024-11-26 19:18:38.324149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.458 [2024-11-26 19:18:38.324232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.458 [2024-11-26 19:18:38.324241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.458 qpair failed and we were unable to recover it. 00:32:21.458 [2024-11-26 19:18:38.324368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.458 [2024-11-26 19:18:38.324522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.458 [2024-11-26 19:18:38.324532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.458 qpair failed and we were unable to recover it. 00:32:21.458 [2024-11-26 19:18:38.324681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.458 [2024-11-26 19:18:38.324775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.458 [2024-11-26 19:18:38.324786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.458 qpair failed and we were unable to recover it. 00:32:21.458 [2024-11-26 19:18:38.324999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.458 [2024-11-26 19:18:38.325191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.458 [2024-11-26 19:18:38.325200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.458 qpair failed and we were unable to recover it. 00:32:21.458 [2024-11-26 19:18:38.325279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.458 [2024-11-26 19:18:38.325446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.458 [2024-11-26 19:18:38.325455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.458 qpair failed and we were unable to recover it. 00:32:21.458 [2024-11-26 19:18:38.325654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.458 [2024-11-26 19:18:38.325897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.458 [2024-11-26 19:18:38.325907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.458 qpair failed and we were unable to recover it. 00:32:21.458 [2024-11-26 19:18:38.326009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.458 [2024-11-26 19:18:38.326208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.458 [2024-11-26 19:18:38.326218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.458 qpair failed and we were unable to recover it. 00:32:21.458 [2024-11-26 19:18:38.326291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.458 [2024-11-26 19:18:38.326417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.458 [2024-11-26 19:18:38.326426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.458 qpair failed and we were unable to recover it. 00:32:21.458 [2024-11-26 19:18:38.326550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.458 [2024-11-26 19:18:38.326697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.458 [2024-11-26 19:18:38.326706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.458 qpair failed and we were unable to recover it. 00:32:21.458 [2024-11-26 19:18:38.326912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.736 [2024-11-26 19:18:38.327175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.736 [2024-11-26 19:18:38.327186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.736 qpair failed and we were unable to recover it. 00:32:21.736 [2024-11-26 19:18:38.327336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.736 [2024-11-26 19:18:38.327553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.736 [2024-11-26 19:18:38.327563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.736 qpair failed and we were unable to recover it. 00:32:21.736 [2024-11-26 19:18:38.327644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.736 [2024-11-26 19:18:38.327802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.736 [2024-11-26 19:18:38.327812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.736 qpair failed and we were unable to recover it. 00:32:21.736 [2024-11-26 19:18:38.327953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.736 [2024-11-26 19:18:38.328031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.736 [2024-11-26 19:18:38.328041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.736 qpair failed and we were unable to recover it. 00:32:21.736 [2024-11-26 19:18:38.328189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.736 [2024-11-26 19:18:38.328328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.736 [2024-11-26 19:18:38.328338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.736 qpair failed and we were unable to recover it. 00:32:21.737 [2024-11-26 19:18:38.328568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.737 [2024-11-26 19:18:38.328789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.737 [2024-11-26 19:18:38.328799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.737 qpair failed and we were unable to recover it. 00:32:21.737 [2024-11-26 19:18:38.328950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.737 [2024-11-26 19:18:38.329162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.737 [2024-11-26 19:18:38.329172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.737 qpair failed and we were unable to recover it. 00:32:21.737 [2024-11-26 19:18:38.329405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.737 [2024-11-26 19:18:38.329622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.737 [2024-11-26 19:18:38.329631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.737 qpair failed and we were unable to recover it. 00:32:21.737 [2024-11-26 19:18:38.329792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.737 [2024-11-26 19:18:38.329940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.737 [2024-11-26 19:18:38.329953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.737 qpair failed and we were unable to recover it. 00:32:21.737 [2024-11-26 19:18:38.330095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.737 [2024-11-26 19:18:38.330288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.737 [2024-11-26 19:18:38.330298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.737 qpair failed and we were unable to recover it. 00:32:21.737 [2024-11-26 19:18:38.330441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.737 [2024-11-26 19:18:38.330592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.737 [2024-11-26 19:18:38.330602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.737 qpair failed and we were unable to recover it. 00:32:21.737 [2024-11-26 19:18:38.330831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.737 [2024-11-26 19:18:38.331027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.737 [2024-11-26 19:18:38.331038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.737 qpair failed and we were unable to recover it. 00:32:21.737 [2024-11-26 19:18:38.331260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.737 [2024-11-26 19:18:38.331502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.737 [2024-11-26 19:18:38.331512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.737 qpair failed and we were unable to recover it. 00:32:21.737 [2024-11-26 19:18:38.331765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.737 [2024-11-26 19:18:38.331966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.737 [2024-11-26 19:18:38.331976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.737 qpair failed and we were unable to recover it. 00:32:21.737 [2024-11-26 19:18:38.332103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.737 [2024-11-26 19:18:38.332313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.737 [2024-11-26 19:18:38.332322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.737 qpair failed and we were unable to recover it. 00:32:21.737 [2024-11-26 19:18:38.332450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.737 [2024-11-26 19:18:38.332595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.737 [2024-11-26 19:18:38.332605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.737 qpair failed and we were unable to recover it. 00:32:21.737 [2024-11-26 19:18:38.332834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.737 [2024-11-26 19:18:38.333053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.737 [2024-11-26 19:18:38.333063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.737 qpair failed and we were unable to recover it. 00:32:21.737 [2024-11-26 19:18:38.333348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.737 [2024-11-26 19:18:38.333511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.737 [2024-11-26 19:18:38.333521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.737 qpair failed and we were unable to recover it. 00:32:21.737 [2024-11-26 19:18:38.333689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.737 [2024-11-26 19:18:38.333884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.737 [2024-11-26 19:18:38.333894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.737 qpair failed and we were unable to recover it. 00:32:21.737 [2024-11-26 19:18:38.334129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.737 [2024-11-26 19:18:38.334218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.737 [2024-11-26 19:18:38.334228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.737 qpair failed and we were unable to recover it. 00:32:21.737 [2024-11-26 19:18:38.334381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.737 [2024-11-26 19:18:38.334614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.737 [2024-11-26 19:18:38.334625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.737 qpair failed and we were unable to recover it. 00:32:21.737 [2024-11-26 19:18:38.334827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.737 [2024-11-26 19:18:38.334988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.737 [2024-11-26 19:18:38.334999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.737 qpair failed and we were unable to recover it. 00:32:21.737 [2024-11-26 19:18:38.335133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.737 [2024-11-26 19:18:38.335356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.737 [2024-11-26 19:18:38.335365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.737 qpair failed and we were unable to recover it. 00:32:21.737 [2024-11-26 19:18:38.335554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.737 [2024-11-26 19:18:38.335782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.737 [2024-11-26 19:18:38.335792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.737 qpair failed and we were unable to recover it. 00:32:21.737 [2024-11-26 19:18:38.335870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.737 [2024-11-26 19:18:38.336047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.737 [2024-11-26 19:18:38.336057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.737 qpair failed and we were unable to recover it. 00:32:21.737 [2024-11-26 19:18:38.336279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.737 [2024-11-26 19:18:38.336498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.737 [2024-11-26 19:18:38.336508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.737 qpair failed and we were unable to recover it. 00:32:21.737 [2024-11-26 19:18:38.336601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.737 [2024-11-26 19:18:38.336683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.737 [2024-11-26 19:18:38.336693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.737 qpair failed and we were unable to recover it. 00:32:21.737 [2024-11-26 19:18:38.336905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.737 [2024-11-26 19:18:38.337094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.737 [2024-11-26 19:18:38.337104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.737 qpair failed and we were unable to recover it. 00:32:21.737 [2024-11-26 19:18:38.337292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.737 [2024-11-26 19:18:38.337551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.737 [2024-11-26 19:18:38.337561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.737 qpair failed and we were unable to recover it. 00:32:21.737 [2024-11-26 19:18:38.337709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.737 [2024-11-26 19:18:38.337794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.737 [2024-11-26 19:18:38.337804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.737 qpair failed and we were unable to recover it. 00:32:21.737 [2024-11-26 19:18:38.337976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.737 [2024-11-26 19:18:38.338118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.737 [2024-11-26 19:18:38.338129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.737 qpair failed and we were unable to recover it. 00:32:21.737 [2024-11-26 19:18:38.338259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.737 [2024-11-26 19:18:38.338421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.737 [2024-11-26 19:18:38.338430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.737 qpair failed and we were unable to recover it. 00:32:21.737 [2024-11-26 19:18:38.338604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.737 [2024-11-26 19:18:38.338767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.737 [2024-11-26 19:18:38.338777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.737 qpair failed and we were unable to recover it. 00:32:21.737 [2024-11-26 19:18:38.339002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.738 [2024-11-26 19:18:38.339132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.738 [2024-11-26 19:18:38.339142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.738 qpair failed and we were unable to recover it. 00:32:21.738 [2024-11-26 19:18:38.339387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.738 [2024-11-26 19:18:38.339620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.738 [2024-11-26 19:18:38.339629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.738 qpair failed and we were unable to recover it. 00:32:21.738 [2024-11-26 19:18:38.339870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.738 [2024-11-26 19:18:38.340012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.738 [2024-11-26 19:18:38.340022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.738 qpair failed and we were unable to recover it. 00:32:21.738 [2024-11-26 19:18:38.340112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.738 [2024-11-26 19:18:38.340271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.738 [2024-11-26 19:18:38.340281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.738 qpair failed and we were unable to recover it. 00:32:21.738 [2024-11-26 19:18:38.340525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.738 [2024-11-26 19:18:38.340735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.738 [2024-11-26 19:18:38.340745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.738 qpair failed and we were unable to recover it. 00:32:21.738 [2024-11-26 19:18:38.340961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.738 [2024-11-26 19:18:38.341124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.738 [2024-11-26 19:18:38.341134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.738 qpair failed and we were unable to recover it. 00:32:21.738 [2024-11-26 19:18:38.341359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.738 [2024-11-26 19:18:38.341429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.738 [2024-11-26 19:18:38.341438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.738 qpair failed and we were unable to recover it. 00:32:21.738 [2024-11-26 19:18:38.341602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.738 [2024-11-26 19:18:38.341851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.738 [2024-11-26 19:18:38.341861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.738 qpair failed and we were unable to recover it. 00:32:21.738 [2024-11-26 19:18:38.342031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.738 [2024-11-26 19:18:38.342228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.738 [2024-11-26 19:18:38.342237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.738 qpair failed and we were unable to recover it. 00:32:21.738 [2024-11-26 19:18:38.342433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.738 [2024-11-26 19:18:38.342605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.738 [2024-11-26 19:18:38.342615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.738 qpair failed and we were unable to recover it. 00:32:21.738 [2024-11-26 19:18:38.342851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.738 [2024-11-26 19:18:38.343067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.738 [2024-11-26 19:18:38.343077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.738 qpair failed and we were unable to recover it. 00:32:21.738 [2024-11-26 19:18:38.343270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.738 [2024-11-26 19:18:38.343348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.738 [2024-11-26 19:18:38.343358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.738 qpair failed and we were unable to recover it. 00:32:21.738 [2024-11-26 19:18:38.343592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.738 [2024-11-26 19:18:38.343760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.738 [2024-11-26 19:18:38.343770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.738 qpair failed and we were unable to recover it. 00:32:21.738 [2024-11-26 19:18:38.344003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.738 [2024-11-26 19:18:38.344214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.738 [2024-11-26 19:18:38.344224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.738 qpair failed and we were unable to recover it. 00:32:21.738 [2024-11-26 19:18:38.344476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.738 [2024-11-26 19:18:38.344716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.738 [2024-11-26 19:18:38.344726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.738 qpair failed and we were unable to recover it. 00:32:21.738 [2024-11-26 19:18:38.344812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.738 [2024-11-26 19:18:38.345031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.738 [2024-11-26 19:18:38.345041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.738 qpair failed and we were unable to recover it. 00:32:21.738 [2024-11-26 19:18:38.345259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.738 [2024-11-26 19:18:38.345452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.738 [2024-11-26 19:18:38.345462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.738 qpair failed and we were unable to recover it. 00:32:21.738 [2024-11-26 19:18:38.345610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.738 [2024-11-26 19:18:38.345824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.738 [2024-11-26 19:18:38.345834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.738 qpair failed and we were unable to recover it. 00:32:21.738 [2024-11-26 19:18:38.346080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.738 [2024-11-26 19:18:38.346235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.738 [2024-11-26 19:18:38.346244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.738 qpair failed and we were unable to recover it. 00:32:21.738 [2024-11-26 19:18:38.346449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.738 [2024-11-26 19:18:38.346694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.738 [2024-11-26 19:18:38.346704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.738 qpair failed and we were unable to recover it. 00:32:21.738 [2024-11-26 19:18:38.346779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.738 [2024-11-26 19:18:38.346943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.738 [2024-11-26 19:18:38.346961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.738 qpair failed and we were unable to recover it. 00:32:21.738 [2024-11-26 19:18:38.347188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.738 [2024-11-26 19:18:38.347344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.738 [2024-11-26 19:18:38.347354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.738 qpair failed and we were unable to recover it. 00:32:21.738 [2024-11-26 19:18:38.347499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.738 [2024-11-26 19:18:38.347697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.738 [2024-11-26 19:18:38.347707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.738 qpair failed and we were unable to recover it. 00:32:21.738 [2024-11-26 19:18:38.347899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.738 [2024-11-26 19:18:38.348023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.738 [2024-11-26 19:18:38.348034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.738 qpair failed and we were unable to recover it. 00:32:21.738 [2024-11-26 19:18:38.348223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.738 [2024-11-26 19:18:38.348417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.738 [2024-11-26 19:18:38.348427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.738 qpair failed and we were unable to recover it. 00:32:21.738 [2024-11-26 19:18:38.348559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.738 [2024-11-26 19:18:38.348706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.738 [2024-11-26 19:18:38.348716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.738 qpair failed and we were unable to recover it. 00:32:21.738 [2024-11-26 19:18:38.348809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.738 [2024-11-26 19:18:38.348978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.738 [2024-11-26 19:18:38.348989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.738 qpair failed and we were unable to recover it. 00:32:21.738 [2024-11-26 19:18:38.349186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.738 [2024-11-26 19:18:38.349403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.738 [2024-11-26 19:18:38.349414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.738 qpair failed and we were unable to recover it. 00:32:21.738 [2024-11-26 19:18:38.349633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.738 [2024-11-26 19:18:38.349853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.738 [2024-11-26 19:18:38.349863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.738 qpair failed and we were unable to recover it. 00:32:21.739 [2024-11-26 19:18:38.350065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.739 [2024-11-26 19:18:38.350209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.739 [2024-11-26 19:18:38.350219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.739 qpair failed and we were unable to recover it. 00:32:21.739 [2024-11-26 19:18:38.350426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.739 [2024-11-26 19:18:38.350668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.739 [2024-11-26 19:18:38.350678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.739 qpair failed and we were unable to recover it. 00:32:21.739 [2024-11-26 19:18:38.350909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.739 [2024-11-26 19:18:38.351071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.739 [2024-11-26 19:18:38.351081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.739 qpair failed and we were unable to recover it. 00:32:21.739 [2024-11-26 19:18:38.351297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.739 [2024-11-26 19:18:38.351519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.739 [2024-11-26 19:18:38.351529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.739 qpair failed and we were unable to recover it. 00:32:21.739 [2024-11-26 19:18:38.351677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.739 [2024-11-26 19:18:38.351917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.739 [2024-11-26 19:18:38.351927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.739 qpair failed and we were unable to recover it. 00:32:21.739 [2024-11-26 19:18:38.352072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.739 [2024-11-26 19:18:38.352162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.739 [2024-11-26 19:18:38.352172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.739 qpair failed and we were unable to recover it. 00:32:21.739 [2024-11-26 19:18:38.352310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.739 [2024-11-26 19:18:38.352465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.739 [2024-11-26 19:18:38.352474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.739 qpair failed and we were unable to recover it. 00:32:21.739 [2024-11-26 19:18:38.352700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.739 [2024-11-26 19:18:38.352834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.739 [2024-11-26 19:18:38.352844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.739 qpair failed and we were unable to recover it. 00:32:21.739 [2024-11-26 19:18:38.353061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.739 [2024-11-26 19:18:38.353279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.739 [2024-11-26 19:18:38.353289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.739 qpair failed and we were unable to recover it. 00:32:21.739 [2024-11-26 19:18:38.353437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.739 [2024-11-26 19:18:38.353675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.739 [2024-11-26 19:18:38.353685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.739 qpair failed and we were unable to recover it. 00:32:21.739 [2024-11-26 19:18:38.353903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.739 [2024-11-26 19:18:38.354107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.739 [2024-11-26 19:18:38.354117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.739 qpair failed and we were unable to recover it. 00:32:21.739 [2024-11-26 19:18:38.354327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.739 [2024-11-26 19:18:38.354419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.739 [2024-11-26 19:18:38.354429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.739 qpair failed and we were unable to recover it. 00:32:21.739 [2024-11-26 19:18:38.354642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.739 [2024-11-26 19:18:38.354778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.739 [2024-11-26 19:18:38.354787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.739 qpair failed and we were unable to recover it. 00:32:21.739 [2024-11-26 19:18:38.354988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.739 [2024-11-26 19:18:38.355117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.739 [2024-11-26 19:18:38.355127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.739 qpair failed and we were unable to recover it. 00:32:21.739 [2024-11-26 19:18:38.355271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.739 [2024-11-26 19:18:38.355448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.739 [2024-11-26 19:18:38.355458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.739 qpair failed and we were unable to recover it. 00:32:21.739 [2024-11-26 19:18:38.355612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.739 [2024-11-26 19:18:38.355767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.739 [2024-11-26 19:18:38.355777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.739 qpair failed and we were unable to recover it. 00:32:21.739 [2024-11-26 19:18:38.355914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.739 [2024-11-26 19:18:38.356147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.739 [2024-11-26 19:18:38.356157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.739 qpair failed and we were unable to recover it. 00:32:21.739 [2024-11-26 19:18:38.356381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.739 [2024-11-26 19:18:38.356566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.739 [2024-11-26 19:18:38.356576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.739 qpair failed and we were unable to recover it. 00:32:21.739 [2024-11-26 19:18:38.356778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.739 [2024-11-26 19:18:38.356912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.739 [2024-11-26 19:18:38.356922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.739 qpair failed and we were unable to recover it. 00:32:21.739 [2024-11-26 19:18:38.357056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.739 [2024-11-26 19:18:38.357273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.739 [2024-11-26 19:18:38.357283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.739 qpair failed and we were unable to recover it. 00:32:21.739 [2024-11-26 19:18:38.357421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.739 [2024-11-26 19:18:38.357567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.739 [2024-11-26 19:18:38.357577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.739 qpair failed and we were unable to recover it. 00:32:21.739 [2024-11-26 19:18:38.357714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.739 [2024-11-26 19:18:38.357875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.739 [2024-11-26 19:18:38.357885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.739 qpair failed and we were unable to recover it. 00:32:21.739 [2024-11-26 19:18:38.357960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.739 [2024-11-26 19:18:38.358173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.739 [2024-11-26 19:18:38.358182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.739 qpair failed and we were unable to recover it. 00:32:21.739 [2024-11-26 19:18:38.358390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.739 [2024-11-26 19:18:38.358621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.739 [2024-11-26 19:18:38.358631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.739 qpair failed and we were unable to recover it. 00:32:21.739 [2024-11-26 19:18:38.358849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.739 [2024-11-26 19:18:38.358991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.739 [2024-11-26 19:18:38.359001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.739 qpair failed and we were unable to recover it. 00:32:21.739 [2024-11-26 19:18:38.359148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.739 [2024-11-26 19:18:38.359364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.739 [2024-11-26 19:18:38.359374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.739 qpair failed and we were unable to recover it. 00:32:21.739 [2024-11-26 19:18:38.359607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.739 [2024-11-26 19:18:38.359826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.739 [2024-11-26 19:18:38.359836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.739 qpair failed and we were unable to recover it. 00:32:21.739 [2024-11-26 19:18:38.359924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.739 [2024-11-26 19:18:38.360131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.739 [2024-11-26 19:18:38.360141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.739 qpair failed and we were unable to recover it. 00:32:21.739 [2024-11-26 19:18:38.360338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.739 [2024-11-26 19:18:38.360505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.740 [2024-11-26 19:18:38.360514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.740 qpair failed and we were unable to recover it. 00:32:21.740 [2024-11-26 19:18:38.360730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.740 [2024-11-26 19:18:38.360975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.740 [2024-11-26 19:18:38.360985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.740 qpair failed and we were unable to recover it. 00:32:21.740 [2024-11-26 19:18:38.361181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.740 [2024-11-26 19:18:38.361395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.740 [2024-11-26 19:18:38.361404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.740 qpair failed and we were unable to recover it. 00:32:21.740 [2024-11-26 19:18:38.361594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.740 [2024-11-26 19:18:38.361828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.740 [2024-11-26 19:18:38.361838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.740 qpair failed and we were unable to recover it. 00:32:21.740 [2024-11-26 19:18:38.362084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.740 [2024-11-26 19:18:38.362225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.740 [2024-11-26 19:18:38.362234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.740 qpair failed and we were unable to recover it. 00:32:21.740 [2024-11-26 19:18:38.362435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.740 [2024-11-26 19:18:38.362573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.740 [2024-11-26 19:18:38.362583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.740 qpair failed and we were unable to recover it. 00:32:21.740 [2024-11-26 19:18:38.362790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.740 [2024-11-26 19:18:38.362862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.740 [2024-11-26 19:18:38.362872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.740 qpair failed and we were unable to recover it. 00:32:21.740 [2024-11-26 19:18:38.363094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.740 [2024-11-26 19:18:38.363220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.740 [2024-11-26 19:18:38.363230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.740 qpair failed and we were unable to recover it. 00:32:21.740 [2024-11-26 19:18:38.363309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.740 [2024-11-26 19:18:38.363520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.740 [2024-11-26 19:18:38.363530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.740 qpair failed and we were unable to recover it. 00:32:21.740 [2024-11-26 19:18:38.363722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.740 [2024-11-26 19:18:38.363916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.740 [2024-11-26 19:18:38.363926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.740 qpair failed and we were unable to recover it. 00:32:21.740 [2024-11-26 19:18:38.364149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.740 [2024-11-26 19:18:38.364342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.740 [2024-11-26 19:18:38.364352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.740 qpair failed and we were unable to recover it. 00:32:21.740 [2024-11-26 19:18:38.364573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.740 [2024-11-26 19:18:38.364795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.740 [2024-11-26 19:18:38.364804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.740 qpair failed and we were unable to recover it. 00:32:21.740 [2024-11-26 19:18:38.364955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.740 [2024-11-26 19:18:38.365180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.740 [2024-11-26 19:18:38.365189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.740 qpair failed and we were unable to recover it. 00:32:21.740 [2024-11-26 19:18:38.365386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.740 [2024-11-26 19:18:38.365524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.740 [2024-11-26 19:18:38.365534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.740 qpair failed and we were unable to recover it. 00:32:21.740 [2024-11-26 19:18:38.365728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.740 [2024-11-26 19:18:38.365916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.740 [2024-11-26 19:18:38.365925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.740 qpair failed and we were unable to recover it. 00:32:21.740 [2024-11-26 19:18:38.366085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.740 [2024-11-26 19:18:38.366299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.740 [2024-11-26 19:18:38.366309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.740 qpair failed and we were unable to recover it. 00:32:21.740 [2024-11-26 19:18:38.366503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.740 [2024-11-26 19:18:38.366649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.740 [2024-11-26 19:18:38.366659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.740 qpair failed and we were unable to recover it. 00:32:21.740 [2024-11-26 19:18:38.366797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.740 [2024-11-26 19:18:38.366958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.740 [2024-11-26 19:18:38.366968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.740 qpair failed and we were unable to recover it. 00:32:21.740 [2024-11-26 19:18:38.367165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.740 [2024-11-26 19:18:38.367310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.740 [2024-11-26 19:18:38.367319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.740 qpair failed and we were unable to recover it. 00:32:21.740 [2024-11-26 19:18:38.367463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.740 [2024-11-26 19:18:38.367560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.740 [2024-11-26 19:18:38.367569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.740 qpair failed and we were unable to recover it. 00:32:21.740 [2024-11-26 19:18:38.367793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.740 [2024-11-26 19:18:38.367887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.740 [2024-11-26 19:18:38.367896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.740 qpair failed and we were unable to recover it. 00:32:21.740 [2024-11-26 19:18:38.368073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.740 [2024-11-26 19:18:38.368289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.740 [2024-11-26 19:18:38.368301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.740 qpair failed and we were unable to recover it. 00:32:21.740 [2024-11-26 19:18:38.368430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.740 [2024-11-26 19:18:38.368691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.740 [2024-11-26 19:18:38.368701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.740 qpair failed and we were unable to recover it. 00:32:21.740 [2024-11-26 19:18:38.368917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.740 [2024-11-26 19:18:38.369084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.740 [2024-11-26 19:18:38.369094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.740 qpair failed and we were unable to recover it. 00:32:21.740 [2024-11-26 19:18:38.369339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.740 [2024-11-26 19:18:38.369553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.740 [2024-11-26 19:18:38.369562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.740 qpair failed and we were unable to recover it. 00:32:21.740 [2024-11-26 19:18:38.369712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.740 [2024-11-26 19:18:38.369958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.740 [2024-11-26 19:18:38.369969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.740 qpair failed and we were unable to recover it. 00:32:21.740 [2024-11-26 19:18:38.370113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.740 [2024-11-26 19:18:38.370309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.740 [2024-11-26 19:18:38.370318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.740 qpair failed and we were unable to recover it. 00:32:21.740 [2024-11-26 19:18:38.370490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.740 [2024-11-26 19:18:38.370731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.740 [2024-11-26 19:18:38.370741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.740 qpair failed and we were unable to recover it. 00:32:21.740 [2024-11-26 19:18:38.370885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.740 [2024-11-26 19:18:38.371014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.740 [2024-11-26 19:18:38.371025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.740 qpair failed and we were unable to recover it. 00:32:21.740 [2024-11-26 19:18:38.371221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.741 [2024-11-26 19:18:38.371448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.741 [2024-11-26 19:18:38.371458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.741 qpair failed and we were unable to recover it. 00:32:21.741 [2024-11-26 19:18:38.371653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.741 [2024-11-26 19:18:38.371864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.741 [2024-11-26 19:18:38.371874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.741 qpair failed and we were unable to recover it. 00:32:21.741 [2024-11-26 19:18:38.372114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.741 [2024-11-26 19:18:38.372333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.741 [2024-11-26 19:18:38.372347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.741 qpair failed and we were unable to recover it. 00:32:21.741 [2024-11-26 19:18:38.372572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.741 [2024-11-26 19:18:38.372762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.741 [2024-11-26 19:18:38.372772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.741 qpair failed and we were unable to recover it. 00:32:21.741 [2024-11-26 19:18:38.372910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.741 [2024-11-26 19:18:38.373121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.741 [2024-11-26 19:18:38.373132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.741 qpair failed and we were unable to recover it. 00:32:21.741 [2024-11-26 19:18:38.373218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.741 [2024-11-26 19:18:38.373436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.741 [2024-11-26 19:18:38.373446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.741 qpair failed and we were unable to recover it. 00:32:21.741 [2024-11-26 19:18:38.373588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.741 [2024-11-26 19:18:38.373780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.741 [2024-11-26 19:18:38.373791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.741 qpair failed and we were unable to recover it. 00:32:21.741 [2024-11-26 19:18:38.374012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.741 [2024-11-26 19:18:38.374218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.741 [2024-11-26 19:18:38.374229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.741 qpair failed and we were unable to recover it. 00:32:21.741 [2024-11-26 19:18:38.374404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.741 [2024-11-26 19:18:38.374558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.741 [2024-11-26 19:18:38.374568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.741 qpair failed and we were unable to recover it. 00:32:21.741 [2024-11-26 19:18:38.374710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.741 [2024-11-26 19:18:38.374926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.741 [2024-11-26 19:18:38.374936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.741 qpair failed and we were unable to recover it. 00:32:21.741 [2024-11-26 19:18:38.375073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.741 [2024-11-26 19:18:38.375271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.741 [2024-11-26 19:18:38.375281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.741 qpair failed and we were unable to recover it. 00:32:21.741 [2024-11-26 19:18:38.375443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.741 [2024-11-26 19:18:38.375604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.741 [2024-11-26 19:18:38.375614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.741 qpair failed and we were unable to recover it. 00:32:21.741 [2024-11-26 19:18:38.375815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.741 [2024-11-26 19:18:38.376008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.741 [2024-11-26 19:18:38.376021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.741 qpair failed and we were unable to recover it. 00:32:21.741 [2024-11-26 19:18:38.376233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.741 [2024-11-26 19:18:38.376400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.741 [2024-11-26 19:18:38.376409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.741 qpair failed and we were unable to recover it. 00:32:21.741 [2024-11-26 19:18:38.376505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.741 [2024-11-26 19:18:38.376697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.741 [2024-11-26 19:18:38.376706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.741 qpair failed and we were unable to recover it. 00:32:21.741 [2024-11-26 19:18:38.376916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.741 [2024-11-26 19:18:38.377054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.741 [2024-11-26 19:18:38.377065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.741 qpair failed and we were unable to recover it. 00:32:21.741 [2024-11-26 19:18:38.377282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.741 [2024-11-26 19:18:38.377477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.741 [2024-11-26 19:18:38.377487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.741 qpair failed and we were unable to recover it. 00:32:21.741 [2024-11-26 19:18:38.377684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.741 [2024-11-26 19:18:38.377906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.741 [2024-11-26 19:18:38.377916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.741 qpair failed and we were unable to recover it. 00:32:21.741 [2024-11-26 19:18:38.378062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.741 [2024-11-26 19:18:38.378255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.741 [2024-11-26 19:18:38.378265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.741 qpair failed and we were unable to recover it. 00:32:21.741 [2024-11-26 19:18:38.378479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.741 [2024-11-26 19:18:38.378696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.741 [2024-11-26 19:18:38.378706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.741 qpair failed and we were unable to recover it. 00:32:21.741 [2024-11-26 19:18:38.378880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.741 [2024-11-26 19:18:38.379136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.741 [2024-11-26 19:18:38.379146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.741 qpair failed and we were unable to recover it. 00:32:21.741 [2024-11-26 19:18:38.379319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.741 [2024-11-26 19:18:38.379534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.741 [2024-11-26 19:18:38.379544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.741 qpair failed and we were unable to recover it. 00:32:21.741 [2024-11-26 19:18:38.379761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.741 [2024-11-26 19:18:38.379972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.741 [2024-11-26 19:18:38.379984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.741 qpair failed and we were unable to recover it. 00:32:21.741 [2024-11-26 19:18:38.380192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.741 [2024-11-26 19:18:38.380393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.741 [2024-11-26 19:18:38.380403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.741 qpair failed and we were unable to recover it. 00:32:21.741 [2024-11-26 19:18:38.380568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.741 [2024-11-26 19:18:38.380706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.741 [2024-11-26 19:18:38.380716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.741 qpair failed and we were unable to recover it. 00:32:21.741 [2024-11-26 19:18:38.380935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.742 [2024-11-26 19:18:38.381030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.742 [2024-11-26 19:18:38.381040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.742 qpair failed and we were unable to recover it. 00:32:21.742 [2024-11-26 19:18:38.381221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.742 [2024-11-26 19:18:38.381442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.742 [2024-11-26 19:18:38.381453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.742 qpair failed and we were unable to recover it. 00:32:21.742 [2024-11-26 19:18:38.381676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.742 [2024-11-26 19:18:38.381889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.742 [2024-11-26 19:18:38.381899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.742 qpair failed and we were unable to recover it. 00:32:21.742 [2024-11-26 19:18:38.382070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.742 [2024-11-26 19:18:38.382217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.742 [2024-11-26 19:18:38.382226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.742 qpair failed and we were unable to recover it. 00:32:21.742 [2024-11-26 19:18:38.382321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.742 [2024-11-26 19:18:38.382537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.742 [2024-11-26 19:18:38.382547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.742 qpair failed and we were unable to recover it. 00:32:21.742 [2024-11-26 19:18:38.382755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.742 [2024-11-26 19:18:38.382937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.742 [2024-11-26 19:18:38.382950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.742 qpair failed and we were unable to recover it. 00:32:21.742 [2024-11-26 19:18:38.383192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.742 [2024-11-26 19:18:38.383380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.742 [2024-11-26 19:18:38.383390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.742 qpair failed and we were unable to recover it. 00:32:21.742 [2024-11-26 19:18:38.383521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.742 [2024-11-26 19:18:38.383670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.742 [2024-11-26 19:18:38.383680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.742 qpair failed and we were unable to recover it. 00:32:21.742 [2024-11-26 19:18:38.383902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.742 [2024-11-26 19:18:38.384062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.742 [2024-11-26 19:18:38.384073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.742 qpair failed and we were unable to recover it. 00:32:21.742 [2024-11-26 19:18:38.384172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.742 [2024-11-26 19:18:38.384311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.742 [2024-11-26 19:18:38.384321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.742 qpair failed and we were unable to recover it. 00:32:21.742 [2024-11-26 19:18:38.384531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.742 [2024-11-26 19:18:38.384752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.742 [2024-11-26 19:18:38.384762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.742 qpair failed and we were unable to recover it. 00:32:21.742 [2024-11-26 19:18:38.384904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.742 [2024-11-26 19:18:38.385053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.742 [2024-11-26 19:18:38.385063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.742 qpair failed and we were unable to recover it. 00:32:21.742 [2024-11-26 19:18:38.385262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.742 [2024-11-26 19:18:38.385404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.742 [2024-11-26 19:18:38.385415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.742 qpair failed and we were unable to recover it. 00:32:21.742 [2024-11-26 19:18:38.385662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.742 [2024-11-26 19:18:38.385799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.742 [2024-11-26 19:18:38.385809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.742 qpair failed and we were unable to recover it. 00:32:21.742 [2024-11-26 19:18:38.386006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.742 [2024-11-26 19:18:38.386153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.742 [2024-11-26 19:18:38.386163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.742 qpair failed and we were unable to recover it. 00:32:21.742 [2024-11-26 19:18:38.386310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.742 [2024-11-26 19:18:38.386461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.742 [2024-11-26 19:18:38.386470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.742 qpair failed and we were unable to recover it. 00:32:21.742 [2024-11-26 19:18:38.386734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.742 [2024-11-26 19:18:38.386936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.742 [2024-11-26 19:18:38.386946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.742 qpair failed and we were unable to recover it. 00:32:21.742 [2024-11-26 19:18:38.387217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.742 [2024-11-26 19:18:38.387384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.742 [2024-11-26 19:18:38.387395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.742 qpair failed and we were unable to recover it. 00:32:21.742 [2024-11-26 19:18:38.387592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.742 [2024-11-26 19:18:38.387733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.742 [2024-11-26 19:18:38.387744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.742 qpair failed and we were unable to recover it. 00:32:21.742 [2024-11-26 19:18:38.387880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.742 [2024-11-26 19:18:38.388038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.742 [2024-11-26 19:18:38.388049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.742 qpair failed and we were unable to recover it. 00:32:21.742 [2024-11-26 19:18:38.388194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.742 [2024-11-26 19:18:38.388344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.742 [2024-11-26 19:18:38.388354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.742 qpair failed and we were unable to recover it. 00:32:21.742 [2024-11-26 19:18:38.388610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.742 [2024-11-26 19:18:38.388816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.742 [2024-11-26 19:18:38.388826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.742 qpair failed and we were unable to recover it. 00:32:21.742 [2024-11-26 19:18:38.389044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.742 [2024-11-26 19:18:38.389201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.742 [2024-11-26 19:18:38.389211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.742 qpair failed and we were unable to recover it. 00:32:21.742 [2024-11-26 19:18:38.389398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.742 [2024-11-26 19:18:38.389629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.742 [2024-11-26 19:18:38.389639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.742 qpair failed and we were unable to recover it. 00:32:21.742 [2024-11-26 19:18:38.389846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.742 [2024-11-26 19:18:38.389985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.742 [2024-11-26 19:18:38.389995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.742 qpair failed and we were unable to recover it. 00:32:21.742 [2024-11-26 19:18:38.390212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.742 [2024-11-26 19:18:38.390426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.742 [2024-11-26 19:18:38.390436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.742 qpair failed and we were unable to recover it. 00:32:21.742 [2024-11-26 19:18:38.390630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.742 [2024-11-26 19:18:38.390731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.742 [2024-11-26 19:18:38.390741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.742 qpair failed and we were unable to recover it. 00:32:21.742 [2024-11-26 19:18:38.390897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.742 [2024-11-26 19:18:38.391028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.742 [2024-11-26 19:18:38.391037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.742 qpair failed and we were unable to recover it. 00:32:21.742 [2024-11-26 19:18:38.391220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.742 [2024-11-26 19:18:38.391428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.742 [2024-11-26 19:18:38.391438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.743 qpair failed and we were unable to recover it. 00:32:21.743 [2024-11-26 19:18:38.391579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.743 [2024-11-26 19:18:38.391807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.743 [2024-11-26 19:18:38.391817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.743 qpair failed and we were unable to recover it. 00:32:21.743 [2024-11-26 19:18:38.391963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.743 [2024-11-26 19:18:38.392202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.743 [2024-11-26 19:18:38.392212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.743 qpair failed and we were unable to recover it. 00:32:21.743 [2024-11-26 19:18:38.392406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.743 [2024-11-26 19:18:38.392596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.743 [2024-11-26 19:18:38.392605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.743 qpair failed and we were unable to recover it. 00:32:21.743 [2024-11-26 19:18:38.392751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.743 [2024-11-26 19:18:38.392946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.743 [2024-11-26 19:18:38.392958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.743 qpair failed and we were unable to recover it. 00:32:21.743 [2024-11-26 19:18:38.393131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.743 [2024-11-26 19:18:38.393346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.743 [2024-11-26 19:18:38.393355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.743 qpair failed and we were unable to recover it. 00:32:21.743 [2024-11-26 19:18:38.393439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.743 [2024-11-26 19:18:38.393528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.743 [2024-11-26 19:18:38.393538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.743 qpair failed and we were unable to recover it. 00:32:21.743 [2024-11-26 19:18:38.393690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.743 [2024-11-26 19:18:38.393816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.743 [2024-11-26 19:18:38.393826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.743 qpair failed and we were unable to recover it. 00:32:21.743 [2024-11-26 19:18:38.393971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.743 [2024-11-26 19:18:38.394062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.743 [2024-11-26 19:18:38.394071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.743 qpair failed and we were unable to recover it. 00:32:21.743 [2024-11-26 19:18:38.394269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.743 [2024-11-26 19:18:38.394328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.743 [2024-11-26 19:18:38.394338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.743 qpair failed and we were unable to recover it. 00:32:21.743 [2024-11-26 19:18:38.394477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.743 [2024-11-26 19:18:38.394556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.743 [2024-11-26 19:18:38.394566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.743 qpair failed and we were unable to recover it. 00:32:21.743 [2024-11-26 19:18:38.394760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.743 [2024-11-26 19:18:38.394900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.743 [2024-11-26 19:18:38.394909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.743 qpair failed and we were unable to recover it. 00:32:21.743 [2024-11-26 19:18:38.395053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.743 [2024-11-26 19:18:38.395210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.743 [2024-11-26 19:18:38.395220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.743 qpair failed and we were unable to recover it. 00:32:21.743 [2024-11-26 19:18:38.395311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.743 [2024-11-26 19:18:38.395381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.743 [2024-11-26 19:18:38.395391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.743 qpair failed and we were unable to recover it. 00:32:21.743 [2024-11-26 19:18:38.395521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.743 [2024-11-26 19:18:38.395592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.743 [2024-11-26 19:18:38.395602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.743 qpair failed and we were unable to recover it. 00:32:21.743 [2024-11-26 19:18:38.395673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.743 [2024-11-26 19:18:38.395798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.743 [2024-11-26 19:18:38.395808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.743 qpair failed and we were unable to recover it. 00:32:21.743 [2024-11-26 19:18:38.395955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.743 [2024-11-26 19:18:38.396123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.743 [2024-11-26 19:18:38.396133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.743 qpair failed and we were unable to recover it. 00:32:21.743 [2024-11-26 19:18:38.396218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.743 [2024-11-26 19:18:38.396295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.743 [2024-11-26 19:18:38.396305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.743 qpair failed and we were unable to recover it. 00:32:21.743 [2024-11-26 19:18:38.396396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.743 [2024-11-26 19:18:38.396483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.743 [2024-11-26 19:18:38.396493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.743 qpair failed and we were unable to recover it. 00:32:21.743 [2024-11-26 19:18:38.396660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.743 [2024-11-26 19:18:38.396814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.743 [2024-11-26 19:18:38.396824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.743 qpair failed and we were unable to recover it. 00:32:21.743 [2024-11-26 19:18:38.396990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.743 [2024-11-26 19:18:38.397141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.743 [2024-11-26 19:18:38.397160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.743 qpair failed and we were unable to recover it. 00:32:21.743 [2024-11-26 19:18:38.397254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.743 [2024-11-26 19:18:38.397314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.743 [2024-11-26 19:18:38.397324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.743 qpair failed and we were unable to recover it. 00:32:21.743 [2024-11-26 19:18:38.397411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.743 [2024-11-26 19:18:38.397538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.743 [2024-11-26 19:18:38.397547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.743 qpair failed and we were unable to recover it. 00:32:21.743 [2024-11-26 19:18:38.397634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.743 [2024-11-26 19:18:38.397769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.743 [2024-11-26 19:18:38.397778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.743 qpair failed and we were unable to recover it. 00:32:21.743 [2024-11-26 19:18:38.397863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.743 [2024-11-26 19:18:38.397992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.743 [2024-11-26 19:18:38.398003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.743 qpair failed and we were unable to recover it. 00:32:21.743 [2024-11-26 19:18:38.398148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.743 [2024-11-26 19:18:38.398226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.743 [2024-11-26 19:18:38.398237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.743 qpair failed and we were unable to recover it. 00:32:21.743 [2024-11-26 19:18:38.398308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.743 [2024-11-26 19:18:38.398383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.743 [2024-11-26 19:18:38.398392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.743 qpair failed and we were unable to recover it. 00:32:21.743 [2024-11-26 19:18:38.398521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.743 [2024-11-26 19:18:38.398612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.743 [2024-11-26 19:18:38.398621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.743 qpair failed and we were unable to recover it. 00:32:21.743 [2024-11-26 19:18:38.398691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.743 [2024-11-26 19:18:38.398837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.743 [2024-11-26 19:18:38.398847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.743 qpair failed and we were unable to recover it. 00:32:21.743 [2024-11-26 19:18:38.398981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.743 [2024-11-26 19:18:38.399065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.744 [2024-11-26 19:18:38.399076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.744 qpair failed and we were unable to recover it. 00:32:21.744 [2024-11-26 19:18:38.399207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.744 [2024-11-26 19:18:38.399284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.744 [2024-11-26 19:18:38.399294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.744 qpair failed and we were unable to recover it. 00:32:21.744 [2024-11-26 19:18:38.399436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.744 [2024-11-26 19:18:38.399582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.744 [2024-11-26 19:18:38.399592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.744 qpair failed and we were unable to recover it. 00:32:21.744 [2024-11-26 19:18:38.399722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.744 [2024-11-26 19:18:38.399793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.744 [2024-11-26 19:18:38.399803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.744 qpair failed and we were unable to recover it. 00:32:21.744 [2024-11-26 19:18:38.399881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.744 [2024-11-26 19:18:38.400010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.744 [2024-11-26 19:18:38.400020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.744 qpair failed and we were unable to recover it. 00:32:21.744 [2024-11-26 19:18:38.400097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.744 [2024-11-26 19:18:38.400262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.744 [2024-11-26 19:18:38.400272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.744 qpair failed and we were unable to recover it. 00:32:21.744 [2024-11-26 19:18:38.400401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.744 [2024-11-26 19:18:38.400542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.744 [2024-11-26 19:18:38.400552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.744 qpair failed and we were unable to recover it. 00:32:21.744 [2024-11-26 19:18:38.400801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.744 [2024-11-26 19:18:38.400877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.744 [2024-11-26 19:18:38.400887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.744 qpair failed and we were unable to recover it. 00:32:21.744 [2024-11-26 19:18:38.401054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.744 [2024-11-26 19:18:38.401135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.744 [2024-11-26 19:18:38.401145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.744 qpair failed and we were unable to recover it. 00:32:21.744 [2024-11-26 19:18:38.401345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.744 [2024-11-26 19:18:38.401561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.744 [2024-11-26 19:18:38.401571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.744 qpair failed and we were unable to recover it. 00:32:21.744 [2024-11-26 19:18:38.401660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.744 [2024-11-26 19:18:38.401823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.744 [2024-11-26 19:18:38.401833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.744 qpair failed and we were unable to recover it. 00:32:21.744 [2024-11-26 19:18:38.401918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.744 [2024-11-26 19:18:38.402022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.744 [2024-11-26 19:18:38.402033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.744 qpair failed and we were unable to recover it. 00:32:21.744 [2024-11-26 19:18:38.402115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.744 [2024-11-26 19:18:38.402200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.744 [2024-11-26 19:18:38.402211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.744 qpair failed and we were unable to recover it. 00:32:21.744 [2024-11-26 19:18:38.402309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.744 [2024-11-26 19:18:38.402422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.744 [2024-11-26 19:18:38.402432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.744 qpair failed and we were unable to recover it. 00:32:21.744 [2024-11-26 19:18:38.402519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.744 [2024-11-26 19:18:38.402648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.744 [2024-11-26 19:18:38.402658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.744 qpair failed and we were unable to recover it. 00:32:21.744 [2024-11-26 19:18:38.402743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.744 [2024-11-26 19:18:38.402905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.744 [2024-11-26 19:18:38.402915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.744 qpair failed and we were unable to recover it. 00:32:21.744 [2024-11-26 19:18:38.403050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.744 [2024-11-26 19:18:38.403211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.744 [2024-11-26 19:18:38.403221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.744 qpair failed and we were unable to recover it. 00:32:21.744 [2024-11-26 19:18:38.403376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.744 [2024-11-26 19:18:38.403440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.744 [2024-11-26 19:18:38.403450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.744 qpair failed and we were unable to recover it. 00:32:21.744 [2024-11-26 19:18:38.403520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.744 [2024-11-26 19:18:38.403646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.744 [2024-11-26 19:18:38.403656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.744 qpair failed and we were unable to recover it. 00:32:21.744 [2024-11-26 19:18:38.403826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.744 [2024-11-26 19:18:38.403994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.744 [2024-11-26 19:18:38.404005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.744 qpair failed and we were unable to recover it. 00:32:21.744 [2024-11-26 19:18:38.404149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.744 [2024-11-26 19:18:38.404348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.744 [2024-11-26 19:18:38.404358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.744 qpair failed and we were unable to recover it. 00:32:21.744 [2024-11-26 19:18:38.404548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.744 [2024-11-26 19:18:38.404676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.744 [2024-11-26 19:18:38.404685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.744 qpair failed and we were unable to recover it. 00:32:21.744 [2024-11-26 19:18:38.404773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.744 [2024-11-26 19:18:38.404910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.744 [2024-11-26 19:18:38.404920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.744 qpair failed and we were unable to recover it. 00:32:21.744 [2024-11-26 19:18:38.405015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.744 [2024-11-26 19:18:38.405161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.744 [2024-11-26 19:18:38.405171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.744 qpair failed and we were unable to recover it. 00:32:21.744 [2024-11-26 19:18:38.405332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.744 [2024-11-26 19:18:38.405532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.744 [2024-11-26 19:18:38.405542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.744 qpair failed and we were unable to recover it. 00:32:21.744 [2024-11-26 19:18:38.405607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.744 [2024-11-26 19:18:38.405678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.744 [2024-11-26 19:18:38.405687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.744 qpair failed and we were unable to recover it. 00:32:21.744 [2024-11-26 19:18:38.405923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.744 [2024-11-26 19:18:38.406000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.744 [2024-11-26 19:18:38.406011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.744 qpair failed and we were unable to recover it. 00:32:21.744 [2024-11-26 19:18:38.406139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.744 [2024-11-26 19:18:38.406198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.744 [2024-11-26 19:18:38.406208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.744 qpair failed and we were unable to recover it. 00:32:21.744 [2024-11-26 19:18:38.406272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.744 [2024-11-26 19:18:38.406340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.744 [2024-11-26 19:18:38.406350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.744 qpair failed and we were unable to recover it. 00:32:21.744 [2024-11-26 19:18:38.406482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.745 [2024-11-26 19:18:38.406616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.745 [2024-11-26 19:18:38.406625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.745 qpair failed and we were unable to recover it. 00:32:21.745 [2024-11-26 19:18:38.406762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.745 [2024-11-26 19:18:38.406901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.745 [2024-11-26 19:18:38.406911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.745 qpair failed and we were unable to recover it. 00:32:21.745 [2024-11-26 19:18:38.407054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.745 [2024-11-26 19:18:38.407134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.745 [2024-11-26 19:18:38.407144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.745 qpair failed and we were unable to recover it. 00:32:21.745 [2024-11-26 19:18:38.407297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.745 [2024-11-26 19:18:38.407369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.745 [2024-11-26 19:18:38.407378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.745 qpair failed and we were unable to recover it. 00:32:21.745 [2024-11-26 19:18:38.407511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.745 [2024-11-26 19:18:38.407587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.745 [2024-11-26 19:18:38.407597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.745 qpair failed and we were unable to recover it. 00:32:21.745 [2024-11-26 19:18:38.407689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.745 [2024-11-26 19:18:38.407814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.745 [2024-11-26 19:18:38.407824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.745 qpair failed and we were unable to recover it. 00:32:21.745 [2024-11-26 19:18:38.407959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.745 [2024-11-26 19:18:38.408152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.745 [2024-11-26 19:18:38.408162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.745 qpair failed and we were unable to recover it. 00:32:21.745 [2024-11-26 19:18:38.408381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.745 [2024-11-26 19:18:38.408575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.745 [2024-11-26 19:18:38.408585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.745 qpair failed and we were unable to recover it. 00:32:21.745 [2024-11-26 19:18:38.408658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.745 [2024-11-26 19:18:38.408730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.745 [2024-11-26 19:18:38.408740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.745 qpair failed and we were unable to recover it. 00:32:21.745 [2024-11-26 19:18:38.408906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.745 [2024-11-26 19:18:38.408981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.745 [2024-11-26 19:18:38.408992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.745 qpair failed and we were unable to recover it. 00:32:21.745 [2024-11-26 19:18:38.409078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.745 [2024-11-26 19:18:38.409144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.745 [2024-11-26 19:18:38.409153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.745 qpair failed and we were unable to recover it. 00:32:21.745 [2024-11-26 19:18:38.409222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.745 [2024-11-26 19:18:38.409288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.745 [2024-11-26 19:18:38.409297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.745 qpair failed and we were unable to recover it. 00:32:21.745 [2024-11-26 19:18:38.409492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.745 [2024-11-26 19:18:38.409632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.745 [2024-11-26 19:18:38.409642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.745 qpair failed and we were unable to recover it. 00:32:21.745 [2024-11-26 19:18:38.409720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.745 [2024-11-26 19:18:38.409859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.745 [2024-11-26 19:18:38.409869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.745 qpair failed and we were unable to recover it. 00:32:21.745 [2024-11-26 19:18:38.410091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.745 [2024-11-26 19:18:38.410153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.745 [2024-11-26 19:18:38.410162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.745 qpair failed and we were unable to recover it. 00:32:21.745 [2024-11-26 19:18:38.410332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.745 [2024-11-26 19:18:38.410402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.745 [2024-11-26 19:18:38.410412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.745 qpair failed and we were unable to recover it. 00:32:21.745 [2024-11-26 19:18:38.410500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.745 [2024-11-26 19:18:38.410650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.745 [2024-11-26 19:18:38.410660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.745 qpair failed and we were unable to recover it. 00:32:21.745 [2024-11-26 19:18:38.410815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.745 [2024-11-26 19:18:38.410919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.745 [2024-11-26 19:18:38.410928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.745 qpair failed and we were unable to recover it. 00:32:21.745 [2024-11-26 19:18:38.411211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.745 [2024-11-26 19:18:38.411284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.745 [2024-11-26 19:18:38.411294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.745 qpair failed and we were unable to recover it. 00:32:21.745 [2024-11-26 19:18:38.411371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.745 [2024-11-26 19:18:38.411517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.745 [2024-11-26 19:18:38.411527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.745 qpair failed and we were unable to recover it. 00:32:21.745 [2024-11-26 19:18:38.411718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.745 [2024-11-26 19:18:38.411853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.745 [2024-11-26 19:18:38.411863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.745 qpair failed and we were unable to recover it. 00:32:21.745 [2024-11-26 19:18:38.411954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.745 [2024-11-26 19:18:38.412092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.745 [2024-11-26 19:18:38.412102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.745 qpair failed and we were unable to recover it. 00:32:21.745 [2024-11-26 19:18:38.412246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.745 [2024-11-26 19:18:38.412392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.745 [2024-11-26 19:18:38.412403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.745 qpair failed and we were unable to recover it. 00:32:21.745 [2024-11-26 19:18:38.412538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.745 [2024-11-26 19:18:38.412668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.745 [2024-11-26 19:18:38.412677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.745 qpair failed and we were unable to recover it. 00:32:21.745 [2024-11-26 19:18:38.412759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.745 [2024-11-26 19:18:38.412836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.745 [2024-11-26 19:18:38.412846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.745 qpair failed and we were unable to recover it. 00:32:21.745 [2024-11-26 19:18:38.412904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.745 [2024-11-26 19:18:38.413070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.745 [2024-11-26 19:18:38.413080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.745 qpair failed and we were unable to recover it. 00:32:21.746 [2024-11-26 19:18:38.413283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.746 [2024-11-26 19:18:38.413432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.746 [2024-11-26 19:18:38.413441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.746 qpair failed and we were unable to recover it. 00:32:21.746 [2024-11-26 19:18:38.413639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.746 [2024-11-26 19:18:38.413804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.746 [2024-11-26 19:18:38.413814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.746 qpair failed and we were unable to recover it. 00:32:21.746 [2024-11-26 19:18:38.413982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.746 [2024-11-26 19:18:38.414071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.746 [2024-11-26 19:18:38.414087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.746 qpair failed and we were unable to recover it. 00:32:21.746 [2024-11-26 19:18:38.414163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.746 [2024-11-26 19:18:38.414247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.746 [2024-11-26 19:18:38.414257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.746 qpair failed and we were unable to recover it. 00:32:21.746 [2024-11-26 19:18:38.414315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.746 [2024-11-26 19:18:38.414401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.746 [2024-11-26 19:18:38.414411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.746 qpair failed and we were unable to recover it. 00:32:21.746 [2024-11-26 19:18:38.414472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.746 [2024-11-26 19:18:38.414551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.746 [2024-11-26 19:18:38.414561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.746 qpair failed and we were unable to recover it. 00:32:21.746 [2024-11-26 19:18:38.414699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.746 [2024-11-26 19:18:38.414826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.746 [2024-11-26 19:18:38.414836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.746 qpair failed and we were unable to recover it. 00:32:21.746 [2024-11-26 19:18:38.414908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.746 [2024-11-26 19:18:38.414969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.746 [2024-11-26 19:18:38.414979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.746 qpair failed and we were unable to recover it. 00:32:21.746 [2024-11-26 19:18:38.415109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.746 [2024-11-26 19:18:38.415270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.746 [2024-11-26 19:18:38.415280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.746 qpair failed and we were unable to recover it. 00:32:21.746 [2024-11-26 19:18:38.415367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.746 [2024-11-26 19:18:38.415487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.746 [2024-11-26 19:18:38.415497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.746 qpair failed and we were unable to recover it. 00:32:21.746 [2024-11-26 19:18:38.415626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.746 [2024-11-26 19:18:38.415771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.746 [2024-11-26 19:18:38.415781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.746 qpair failed and we were unable to recover it. 00:32:21.746 [2024-11-26 19:18:38.415920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.746 [2024-11-26 19:18:38.416004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.746 [2024-11-26 19:18:38.416014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.746 qpair failed and we were unable to recover it. 00:32:21.746 [2024-11-26 19:18:38.416230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.746 [2024-11-26 19:18:38.416485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.746 [2024-11-26 19:18:38.416495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.746 qpair failed and we were unable to recover it. 00:32:21.746 [2024-11-26 19:18:38.416634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.746 [2024-11-26 19:18:38.416782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.746 [2024-11-26 19:18:38.416791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.746 qpair failed and we were unable to recover it. 00:32:21.746 [2024-11-26 19:18:38.417001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.746 [2024-11-26 19:18:38.417085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.746 [2024-11-26 19:18:38.417094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.746 qpair failed and we were unable to recover it. 00:32:21.746 [2024-11-26 19:18:38.417321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.746 [2024-11-26 19:18:38.417451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.746 [2024-11-26 19:18:38.417461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.746 qpair failed and we were unable to recover it. 00:32:21.746 [2024-11-26 19:18:38.417600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.746 [2024-11-26 19:18:38.417670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.746 [2024-11-26 19:18:38.417683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.746 qpair failed and we were unable to recover it. 00:32:21.746 [2024-11-26 19:18:38.417761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.746 [2024-11-26 19:18:38.417951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.746 [2024-11-26 19:18:38.417961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.746 qpair failed and we were unable to recover it. 00:32:21.746 [2024-11-26 19:18:38.418112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.746 [2024-11-26 19:18:38.418198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.746 [2024-11-26 19:18:38.418208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.746 qpair failed and we were unable to recover it. 00:32:21.746 [2024-11-26 19:18:38.418282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.746 [2024-11-26 19:18:38.418420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.746 [2024-11-26 19:18:38.418429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.746 qpair failed and we were unable to recover it. 00:32:21.746 [2024-11-26 19:18:38.418533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.746 [2024-11-26 19:18:38.418677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.746 [2024-11-26 19:18:38.418687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.746 qpair failed and we were unable to recover it. 00:32:21.746 [2024-11-26 19:18:38.418826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.746 [2024-11-26 19:18:38.418915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.746 [2024-11-26 19:18:38.418924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.746 qpair failed and we were unable to recover it. 00:32:21.746 [2024-11-26 19:18:38.419010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.746 [2024-11-26 19:18:38.419082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.746 [2024-11-26 19:18:38.419092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.746 qpair failed and we were unable to recover it. 00:32:21.746 [2024-11-26 19:18:38.419218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.746 [2024-11-26 19:18:38.419283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.746 [2024-11-26 19:18:38.419293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.746 qpair failed and we were unable to recover it. 00:32:21.746 [2024-11-26 19:18:38.419376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.746 [2024-11-26 19:18:38.419508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.746 [2024-11-26 19:18:38.419517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.746 qpair failed and we were unable to recover it. 00:32:21.746 [2024-11-26 19:18:38.419592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.746 [2024-11-26 19:18:38.419652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.746 [2024-11-26 19:18:38.419662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.746 qpair failed and we were unable to recover it. 00:32:21.746 [2024-11-26 19:18:38.419810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.746 [2024-11-26 19:18:38.420056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.746 [2024-11-26 19:18:38.420069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.746 qpair failed and we were unable to recover it. 00:32:21.746 [2024-11-26 19:18:38.420145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.746 [2024-11-26 19:18:38.420392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.746 [2024-11-26 19:18:38.420402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.746 qpair failed and we were unable to recover it. 00:32:21.746 [2024-11-26 19:18:38.420545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.746 [2024-11-26 19:18:38.420697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.747 [2024-11-26 19:18:38.420706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.747 qpair failed and we were unable to recover it. 00:32:21.747 [2024-11-26 19:18:38.420810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.747 [2024-11-26 19:18:38.421007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.747 [2024-11-26 19:18:38.421018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.747 qpair failed and we were unable to recover it. 00:32:21.747 [2024-11-26 19:18:38.421101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.747 [2024-11-26 19:18:38.421175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.747 [2024-11-26 19:18:38.421184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.747 qpair failed and we were unable to recover it. 00:32:21.747 [2024-11-26 19:18:38.421328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.747 [2024-11-26 19:18:38.421518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.747 [2024-11-26 19:18:38.421527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.747 qpair failed and we were unable to recover it. 00:32:21.747 [2024-11-26 19:18:38.421674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.747 [2024-11-26 19:18:38.421815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.747 [2024-11-26 19:18:38.421825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.747 qpair failed and we were unable to recover it. 00:32:21.747 [2024-11-26 19:18:38.421969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.747 [2024-11-26 19:18:38.422056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.747 [2024-11-26 19:18:38.422066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.747 qpair failed and we were unable to recover it. 00:32:21.747 [2024-11-26 19:18:38.422156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.747 [2024-11-26 19:18:38.422219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.747 [2024-11-26 19:18:38.422229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.747 qpair failed and we were unable to recover it. 00:32:21.747 [2024-11-26 19:18:38.422357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.747 [2024-11-26 19:18:38.422571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.747 [2024-11-26 19:18:38.422581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.747 qpair failed and we were unable to recover it. 00:32:21.747 [2024-11-26 19:18:38.422656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.747 [2024-11-26 19:18:38.422811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.747 [2024-11-26 19:18:38.422824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.747 qpair failed and we were unable to recover it. 00:32:21.747 [2024-11-26 19:18:38.422894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.747 [2024-11-26 19:18:38.423113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.747 [2024-11-26 19:18:38.423123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.747 qpair failed and we were unable to recover it. 00:32:21.747 [2024-11-26 19:18:38.423202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.747 [2024-11-26 19:18:38.423264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.747 [2024-11-26 19:18:38.423274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.747 qpair failed and we were unable to recover it. 00:32:21.747 [2024-11-26 19:18:38.423361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.747 [2024-11-26 19:18:38.423465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.747 [2024-11-26 19:18:38.423474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.747 qpair failed and we were unable to recover it. 00:32:21.747 [2024-11-26 19:18:38.423565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.747 [2024-11-26 19:18:38.423704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.747 [2024-11-26 19:18:38.423714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.747 qpair failed and we were unable to recover it. 00:32:21.747 [2024-11-26 19:18:38.423843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.747 [2024-11-26 19:18:38.423991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.747 [2024-11-26 19:18:38.424001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.747 qpair failed and we were unable to recover it. 00:32:21.747 [2024-11-26 19:18:38.424074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.747 [2024-11-26 19:18:38.424214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.747 [2024-11-26 19:18:38.424224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.747 qpair failed and we were unable to recover it. 00:32:21.747 [2024-11-26 19:18:38.424361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.747 [2024-11-26 19:18:38.424419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.747 [2024-11-26 19:18:38.424429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.747 qpair failed and we were unable to recover it. 00:32:21.747 [2024-11-26 19:18:38.424596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.747 [2024-11-26 19:18:38.424740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.747 [2024-11-26 19:18:38.424750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.747 qpair failed and we were unable to recover it. 00:32:21.747 [2024-11-26 19:18:38.424821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.747 [2024-11-26 19:18:38.424915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.747 [2024-11-26 19:18:38.424924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.747 qpair failed and we were unable to recover it. 00:32:21.747 [2024-11-26 19:18:38.425124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.747 [2024-11-26 19:18:38.425188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.747 [2024-11-26 19:18:38.425200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.747 qpair failed and we were unable to recover it. 00:32:21.747 [2024-11-26 19:18:38.425332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.747 [2024-11-26 19:18:38.425473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.747 [2024-11-26 19:18:38.425483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.747 qpair failed and we were unable to recover it. 00:32:21.747 [2024-11-26 19:18:38.425569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.747 [2024-11-26 19:18:38.425711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.747 [2024-11-26 19:18:38.425721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.747 qpair failed and we were unable to recover it. 00:32:21.747 [2024-11-26 19:18:38.425863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.747 [2024-11-26 19:18:38.426058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.747 [2024-11-26 19:18:38.426068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.747 qpair failed and we were unable to recover it. 00:32:21.747 [2024-11-26 19:18:38.426165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.747 [2024-11-26 19:18:38.426296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.747 [2024-11-26 19:18:38.426306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.747 qpair failed and we were unable to recover it. 00:32:21.747 [2024-11-26 19:18:38.426444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.747 [2024-11-26 19:18:38.426527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.747 [2024-11-26 19:18:38.426537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.747 qpair failed and we were unable to recover it. 00:32:21.747 [2024-11-26 19:18:38.426677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.747 [2024-11-26 19:18:38.426890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.747 [2024-11-26 19:18:38.426900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.747 qpair failed and we were unable to recover it. 00:32:21.747 [2024-11-26 19:18:38.427043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.747 [2024-11-26 19:18:38.427207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.747 [2024-11-26 19:18:38.427217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.747 qpair failed and we were unable to recover it. 00:32:21.747 [2024-11-26 19:18:38.427282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.747 [2024-11-26 19:18:38.427441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.747 [2024-11-26 19:18:38.427451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.747 qpair failed and we were unable to recover it. 00:32:21.747 [2024-11-26 19:18:38.427619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.747 [2024-11-26 19:18:38.427677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.747 [2024-11-26 19:18:38.427687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.747 qpair failed and we were unable to recover it. 00:32:21.747 [2024-11-26 19:18:38.427780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.747 [2024-11-26 19:18:38.427909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.747 [2024-11-26 19:18:38.427919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.747 qpair failed and we were unable to recover it. 00:32:21.747 [2024-11-26 19:18:38.428018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.747 [2024-11-26 19:18:38.428159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.748 [2024-11-26 19:18:38.428168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.748 qpair failed and we were unable to recover it. 00:32:21.748 [2024-11-26 19:18:38.428254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.748 [2024-11-26 19:18:38.428329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.748 [2024-11-26 19:18:38.428339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.748 qpair failed and we were unable to recover it. 00:32:21.748 [2024-11-26 19:18:38.428412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.748 [2024-11-26 19:18:38.428577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.748 [2024-11-26 19:18:38.428586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.748 qpair failed and we were unable to recover it. 00:32:21.748 [2024-11-26 19:18:38.428740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.748 [2024-11-26 19:18:38.428824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.748 [2024-11-26 19:18:38.428833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.748 qpair failed and we were unable to recover it. 00:32:21.748 [2024-11-26 19:18:38.428912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.748 [2024-11-26 19:18:38.428971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.748 [2024-11-26 19:18:38.428981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.748 qpair failed and we were unable to recover it. 00:32:21.748 [2024-11-26 19:18:38.429107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.748 [2024-11-26 19:18:38.429177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.748 [2024-11-26 19:18:38.429186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.748 qpair failed and we were unable to recover it. 00:32:21.748 [2024-11-26 19:18:38.429276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.748 [2024-11-26 19:18:38.429344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.748 [2024-11-26 19:18:38.429355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.748 qpair failed and we were unable to recover it. 00:32:21.748 [2024-11-26 19:18:38.429487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.748 [2024-11-26 19:18:38.429555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.748 [2024-11-26 19:18:38.429564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.748 qpair failed and we were unable to recover it. 00:32:21.748 [2024-11-26 19:18:38.429654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.748 [2024-11-26 19:18:38.429855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.748 [2024-11-26 19:18:38.429864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.748 qpair failed and we were unable to recover it. 00:32:21.748 [2024-11-26 19:18:38.429993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.748 [2024-11-26 19:18:38.430072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.748 [2024-11-26 19:18:38.430082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.748 qpair failed and we were unable to recover it. 00:32:21.748 [2024-11-26 19:18:38.430220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.748 [2024-11-26 19:18:38.430286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.748 [2024-11-26 19:18:38.430295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.748 qpair failed and we were unable to recover it. 00:32:21.748 [2024-11-26 19:18:38.430489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.748 [2024-11-26 19:18:38.430649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.748 [2024-11-26 19:18:38.430659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.748 qpair failed and we were unable to recover it. 00:32:21.748 [2024-11-26 19:18:38.430738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.748 [2024-11-26 19:18:38.430929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.748 [2024-11-26 19:18:38.430939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.748 qpair failed and we were unable to recover it. 00:32:21.748 [2024-11-26 19:18:38.431088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.748 [2024-11-26 19:18:38.431213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.748 [2024-11-26 19:18:38.431223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.748 qpair failed and we were unable to recover it. 00:32:21.748 [2024-11-26 19:18:38.431358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.748 [2024-11-26 19:18:38.431428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.748 [2024-11-26 19:18:38.431438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.748 qpair failed and we were unable to recover it. 00:32:21.748 [2024-11-26 19:18:38.431522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.748 [2024-11-26 19:18:38.431600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.748 [2024-11-26 19:18:38.431610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.748 qpair failed and we were unable to recover it. 00:32:21.748 [2024-11-26 19:18:38.431751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.748 [2024-11-26 19:18:38.431898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.748 [2024-11-26 19:18:38.431908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.748 qpair failed and we were unable to recover it. 00:32:21.748 [2024-11-26 19:18:38.431988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.748 [2024-11-26 19:18:38.432064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.748 [2024-11-26 19:18:38.432074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.748 qpair failed and we were unable to recover it. 00:32:21.748 [2024-11-26 19:18:38.432213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.748 [2024-11-26 19:18:38.432298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.748 [2024-11-26 19:18:38.432308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.748 qpair failed and we were unable to recover it. 00:32:21.748 [2024-11-26 19:18:38.432439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.748 [2024-11-26 19:18:38.432496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.748 [2024-11-26 19:18:38.432505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.748 qpair failed and we were unable to recover it. 00:32:21.748 [2024-11-26 19:18:38.432583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.748 [2024-11-26 19:18:38.432775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.748 [2024-11-26 19:18:38.432785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.748 qpair failed and we were unable to recover it. 00:32:21.748 [2024-11-26 19:18:38.432925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.748 [2024-11-26 19:18:38.433001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.748 [2024-11-26 19:18:38.433011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.748 qpair failed and we were unable to recover it. 00:32:21.748 [2024-11-26 19:18:38.433094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.748 [2024-11-26 19:18:38.433175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.748 [2024-11-26 19:18:38.433185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.748 qpair failed and we were unable to recover it. 00:32:21.748 [2024-11-26 19:18:38.433259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.748 [2024-11-26 19:18:38.433470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.748 [2024-11-26 19:18:38.433480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.748 qpair failed and we were unable to recover it. 00:32:21.748 [2024-11-26 19:18:38.433623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.748 [2024-11-26 19:18:38.433767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.748 [2024-11-26 19:18:38.433777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.748 qpair failed and we were unable to recover it. 00:32:21.748 [2024-11-26 19:18:38.433837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.748 [2024-11-26 19:18:38.433914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.748 [2024-11-26 19:18:38.433924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.748 qpair failed and we were unable to recover it. 00:32:21.748 [2024-11-26 19:18:38.434028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.748 [2024-11-26 19:18:38.434154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.748 [2024-11-26 19:18:38.434163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.748 qpair failed and we were unable to recover it. 00:32:21.748 [2024-11-26 19:18:38.434229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.748 [2024-11-26 19:18:38.434289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.748 [2024-11-26 19:18:38.434300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.748 qpair failed and we were unable to recover it. 00:32:21.748 [2024-11-26 19:18:38.434525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.748 [2024-11-26 19:18:38.434588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.748 [2024-11-26 19:18:38.434597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.748 qpair failed and we were unable to recover it. 00:32:21.748 [2024-11-26 19:18:38.434739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.749 [2024-11-26 19:18:38.434799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.749 [2024-11-26 19:18:38.434808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.749 qpair failed and we were unable to recover it. 00:32:21.749 [2024-11-26 19:18:38.434896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.749 [2024-11-26 19:18:38.434957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.749 [2024-11-26 19:18:38.434967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.749 qpair failed and we were unable to recover it. 00:32:21.749 [2024-11-26 19:18:38.435101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.749 [2024-11-26 19:18:38.435182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.749 [2024-11-26 19:18:38.435192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.749 qpair failed and we were unable to recover it. 00:32:21.749 [2024-11-26 19:18:38.435333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.749 [2024-11-26 19:18:38.435404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.749 [2024-11-26 19:18:38.435414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.749 qpair failed and we were unable to recover it. 00:32:21.749 [2024-11-26 19:18:38.435564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.749 [2024-11-26 19:18:38.435636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.749 [2024-11-26 19:18:38.435645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.749 qpair failed and we were unable to recover it. 00:32:21.749 [2024-11-26 19:18:38.435778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.749 [2024-11-26 19:18:38.435855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.749 [2024-11-26 19:18:38.435864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.749 qpair failed and we were unable to recover it. 00:32:21.749 [2024-11-26 19:18:38.435994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.749 [2024-11-26 19:18:38.436057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.749 [2024-11-26 19:18:38.436067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.749 qpair failed and we were unable to recover it. 00:32:21.749 [2024-11-26 19:18:38.436202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.749 [2024-11-26 19:18:38.436332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.749 [2024-11-26 19:18:38.436342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.749 qpair failed and we were unable to recover it. 00:32:21.749 [2024-11-26 19:18:38.436538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.749 [2024-11-26 19:18:38.436592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.749 [2024-11-26 19:18:38.436601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.749 qpair failed and we were unable to recover it. 00:32:21.749 [2024-11-26 19:18:38.436670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.749 [2024-11-26 19:18:38.436862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.749 [2024-11-26 19:18:38.436871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.749 qpair failed and we were unable to recover it. 00:32:21.749 [2024-11-26 19:18:38.436942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.749 [2024-11-26 19:18:38.437046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.749 [2024-11-26 19:18:38.437056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.749 qpair failed and we were unable to recover it. 00:32:21.749 [2024-11-26 19:18:38.437133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.749 [2024-11-26 19:18:38.437385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.749 [2024-11-26 19:18:38.437394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.749 qpair failed and we were unable to recover it. 00:32:21.749 [2024-11-26 19:18:38.437486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.749 [2024-11-26 19:18:38.437694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.749 [2024-11-26 19:18:38.437704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.749 qpair failed and we were unable to recover it. 00:32:21.749 [2024-11-26 19:18:38.437843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.749 [2024-11-26 19:18:38.437997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.749 [2024-11-26 19:18:38.438008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.749 qpair failed and we were unable to recover it. 00:32:21.749 [2024-11-26 19:18:38.438152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.749 [2024-11-26 19:18:38.438357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.749 [2024-11-26 19:18:38.438366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.749 qpair failed and we were unable to recover it. 00:32:21.749 [2024-11-26 19:18:38.438516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.749 [2024-11-26 19:18:38.438711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.749 [2024-11-26 19:18:38.438721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.749 qpair failed and we were unable to recover it. 00:32:21.749 [2024-11-26 19:18:38.438871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.749 [2024-11-26 19:18:38.438963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.749 [2024-11-26 19:18:38.438974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.749 qpair failed and we were unable to recover it. 00:32:21.749 [2024-11-26 19:18:38.439051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.749 [2024-11-26 19:18:38.439130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.749 [2024-11-26 19:18:38.439140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.749 qpair failed and we were unable to recover it. 00:32:21.749 [2024-11-26 19:18:38.439273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.749 [2024-11-26 19:18:38.439357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.749 [2024-11-26 19:18:38.439368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.749 qpair failed and we were unable to recover it. 00:32:21.749 [2024-11-26 19:18:38.439434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.749 [2024-11-26 19:18:38.439522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.749 [2024-11-26 19:18:38.439532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.749 qpair failed and we were unable to recover it. 00:32:21.749 [2024-11-26 19:18:38.439679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.749 [2024-11-26 19:18:38.439758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.749 [2024-11-26 19:18:38.439768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.749 qpair failed and we were unable to recover it. 00:32:21.749 [2024-11-26 19:18:38.439857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.749 [2024-11-26 19:18:38.439932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.749 [2024-11-26 19:18:38.439941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.749 qpair failed and we were unable to recover it. 00:32:21.749 [2024-11-26 19:18:38.440031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.749 [2024-11-26 19:18:38.440109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.749 [2024-11-26 19:18:38.440119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.749 qpair failed and we were unable to recover it. 00:32:21.749 [2024-11-26 19:18:38.440202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.749 [2024-11-26 19:18:38.440265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.749 [2024-11-26 19:18:38.440275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.749 qpair failed and we were unable to recover it. 00:32:21.749 [2024-11-26 19:18:38.440347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.749 [2024-11-26 19:18:38.440484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.749 [2024-11-26 19:18:38.440494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.749 qpair failed and we were unable to recover it. 00:32:21.749 [2024-11-26 19:18:38.440628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.749 [2024-11-26 19:18:38.440700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.749 [2024-11-26 19:18:38.440709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.749 qpair failed and we were unable to recover it. 00:32:21.749 [2024-11-26 19:18:38.440840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.749 [2024-11-26 19:18:38.440917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.749 [2024-11-26 19:18:38.440927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.749 qpair failed and we were unable to recover it. 00:32:21.749 [2024-11-26 19:18:38.441073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.749 [2024-11-26 19:18:38.441169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.749 [2024-11-26 19:18:38.441180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.749 qpair failed and we were unable to recover it. 00:32:21.749 [2024-11-26 19:18:38.441311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.749 [2024-11-26 19:18:38.441386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.749 [2024-11-26 19:18:38.441396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.749 qpair failed and we were unable to recover it. 00:32:21.749 [2024-11-26 19:18:38.441555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.750 [2024-11-26 19:18:38.441617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.750 [2024-11-26 19:18:38.441627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.750 qpair failed and we were unable to recover it. 00:32:21.750 [2024-11-26 19:18:38.441713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.750 [2024-11-26 19:18:38.441874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.750 [2024-11-26 19:18:38.441884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.750 qpair failed and we were unable to recover it. 00:32:21.750 [2024-11-26 19:18:38.442017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.750 [2024-11-26 19:18:38.442092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.750 [2024-11-26 19:18:38.442102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.750 qpair failed and we were unable to recover it. 00:32:21.750 [2024-11-26 19:18:38.442188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.750 [2024-11-26 19:18:38.442248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.750 [2024-11-26 19:18:38.442258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.750 qpair failed and we were unable to recover it. 00:32:21.750 [2024-11-26 19:18:38.442339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.750 [2024-11-26 19:18:38.442418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.750 [2024-11-26 19:18:38.442428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.750 qpair failed and we were unable to recover it. 00:32:21.750 [2024-11-26 19:18:38.442578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.750 [2024-11-26 19:18:38.442638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.750 [2024-11-26 19:18:38.442647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.750 qpair failed and we were unable to recover it. 00:32:21.750 [2024-11-26 19:18:38.442788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.750 [2024-11-26 19:18:38.442861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.750 [2024-11-26 19:18:38.442871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.750 qpair failed and we were unable to recover it. 00:32:21.750 [2024-11-26 19:18:38.442953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.750 [2024-11-26 19:18:38.443021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.750 [2024-11-26 19:18:38.443031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.750 qpair failed and we were unable to recover it. 00:32:21.750 [2024-11-26 19:18:38.443112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.750 [2024-11-26 19:18:38.443241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.750 [2024-11-26 19:18:38.443251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.750 qpair failed and we were unable to recover it. 00:32:21.750 [2024-11-26 19:18:38.443325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.750 [2024-11-26 19:18:38.443397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.750 [2024-11-26 19:18:38.443406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.750 qpair failed and we were unable to recover it. 00:32:21.750 [2024-11-26 19:18:38.443483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.750 [2024-11-26 19:18:38.443543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.750 [2024-11-26 19:18:38.443553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.750 qpair failed and we were unable to recover it. 00:32:21.750 [2024-11-26 19:18:38.443682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.750 [2024-11-26 19:18:38.443842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.750 [2024-11-26 19:18:38.443851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.750 qpair failed and we were unable to recover it. 00:32:21.750 [2024-11-26 19:18:38.443930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.750 [2024-11-26 19:18:38.444016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.750 [2024-11-26 19:18:38.444027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.750 qpair failed and we were unable to recover it. 00:32:21.750 [2024-11-26 19:18:38.444121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.750 [2024-11-26 19:18:38.444198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.750 [2024-11-26 19:18:38.444208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.750 qpair failed and we were unable to recover it. 00:32:21.750 [2024-11-26 19:18:38.444378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.750 [2024-11-26 19:18:38.444456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.750 [2024-11-26 19:18:38.444465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.750 qpair failed and we were unable to recover it. 00:32:21.750 [2024-11-26 19:18:38.444604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.750 [2024-11-26 19:18:38.444756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.750 [2024-11-26 19:18:38.444766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.750 qpair failed and we were unable to recover it. 00:32:21.750 [2024-11-26 19:18:38.444828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.750 [2024-11-26 19:18:38.444898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.750 [2024-11-26 19:18:38.444907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.750 qpair failed and we were unable to recover it. 00:32:21.750 [2024-11-26 19:18:38.444972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.750 [2024-11-26 19:18:38.445031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.750 [2024-11-26 19:18:38.445041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.750 qpair failed and we were unable to recover it. 00:32:21.750 [2024-11-26 19:18:38.445105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.750 [2024-11-26 19:18:38.445261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.750 [2024-11-26 19:18:38.445271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.750 qpair failed and we were unable to recover it. 00:32:21.750 [2024-11-26 19:18:38.445422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.750 [2024-11-26 19:18:38.445500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.750 [2024-11-26 19:18:38.445510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.750 qpair failed and we were unable to recover it. 00:32:21.750 [2024-11-26 19:18:38.445571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.750 [2024-11-26 19:18:38.445653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.750 [2024-11-26 19:18:38.445663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.750 qpair failed and we were unable to recover it. 00:32:21.750 [2024-11-26 19:18:38.445728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.750 [2024-11-26 19:18:38.445923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.750 [2024-11-26 19:18:38.445932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.750 qpair failed and we were unable to recover it. 00:32:21.750 [2024-11-26 19:18:38.446080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.750 [2024-11-26 19:18:38.446164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.750 [2024-11-26 19:18:38.446174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.751 qpair failed and we were unable to recover it. 00:32:21.751 [2024-11-26 19:18:38.446319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.751 [2024-11-26 19:18:38.446450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.751 [2024-11-26 19:18:38.446459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.751 qpair failed and we were unable to recover it. 00:32:21.751 [2024-11-26 19:18:38.446542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.751 [2024-11-26 19:18:38.446696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.751 [2024-11-26 19:18:38.446706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.751 qpair failed and we were unable to recover it. 00:32:21.751 [2024-11-26 19:18:38.446839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.751 [2024-11-26 19:18:38.447076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.751 [2024-11-26 19:18:38.447086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.751 qpair failed and we were unable to recover it. 00:32:21.751 [2024-11-26 19:18:38.447152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.751 [2024-11-26 19:18:38.447242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.751 [2024-11-26 19:18:38.447252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.751 qpair failed and we were unable to recover it. 00:32:21.751 [2024-11-26 19:18:38.447394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.751 [2024-11-26 19:18:38.447530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.751 [2024-11-26 19:18:38.447540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.751 qpair failed and we were unable to recover it. 00:32:21.751 [2024-11-26 19:18:38.447616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.751 [2024-11-26 19:18:38.447753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.751 [2024-11-26 19:18:38.447762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.751 qpair failed and we were unable to recover it. 00:32:21.751 [2024-11-26 19:18:38.447907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.751 [2024-11-26 19:18:38.448038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.751 [2024-11-26 19:18:38.448049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.751 qpair failed and we were unable to recover it. 00:32:21.751 [2024-11-26 19:18:38.448266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.751 [2024-11-26 19:18:38.448395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.751 [2024-11-26 19:18:38.448405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.751 qpair failed and we were unable to recover it. 00:32:21.751 [2024-11-26 19:18:38.448475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.751 [2024-11-26 19:18:38.448657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.751 [2024-11-26 19:18:38.448666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.751 qpair failed and we were unable to recover it. 00:32:21.751 [2024-11-26 19:18:38.448724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.751 [2024-11-26 19:18:38.448885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.751 [2024-11-26 19:18:38.448895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.751 qpair failed and we were unable to recover it. 00:32:21.751 [2024-11-26 19:18:38.449136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.751 [2024-11-26 19:18:38.449210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.751 [2024-11-26 19:18:38.449220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.751 qpair failed and we were unable to recover it. 00:32:21.751 [2024-11-26 19:18:38.449359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.751 [2024-11-26 19:18:38.449428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.751 [2024-11-26 19:18:38.449438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.751 qpair failed and we were unable to recover it. 00:32:21.751 [2024-11-26 19:18:38.449604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.751 [2024-11-26 19:18:38.449695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.751 [2024-11-26 19:18:38.449705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.751 qpair failed and we were unable to recover it. 00:32:21.751 [2024-11-26 19:18:38.449834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.751 [2024-11-26 19:18:38.449908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.751 [2024-11-26 19:18:38.449918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.751 qpair failed and we were unable to recover it. 00:32:21.751 [2024-11-26 19:18:38.449994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.751 [2024-11-26 19:18:38.450129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.751 [2024-11-26 19:18:38.450139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.751 qpair failed and we were unable to recover it. 00:32:21.751 [2024-11-26 19:18:38.450223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.751 [2024-11-26 19:18:38.450385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.751 [2024-11-26 19:18:38.450395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.751 qpair failed and we were unable to recover it. 00:32:21.751 [2024-11-26 19:18:38.450460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.751 [2024-11-26 19:18:38.450538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.751 [2024-11-26 19:18:38.450547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.751 qpair failed and we were unable to recover it. 00:32:21.751 [2024-11-26 19:18:38.450634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.751 [2024-11-26 19:18:38.450829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.751 [2024-11-26 19:18:38.450838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.751 qpair failed and we were unable to recover it. 00:32:21.751 [2024-11-26 19:18:38.450985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.751 [2024-11-26 19:18:38.451149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.751 [2024-11-26 19:18:38.451159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.751 qpair failed and we were unable to recover it. 00:32:21.751 [2024-11-26 19:18:38.451235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.751 [2024-11-26 19:18:38.451311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.751 [2024-11-26 19:18:38.451320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.751 qpair failed and we were unable to recover it. 00:32:21.751 [2024-11-26 19:18:38.451384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.751 [2024-11-26 19:18:38.451453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.751 [2024-11-26 19:18:38.451469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.752 qpair failed and we were unable to recover it. 00:32:21.752 [2024-11-26 19:18:38.451553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.752 [2024-11-26 19:18:38.451786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.752 [2024-11-26 19:18:38.451796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.752 qpair failed and we were unable to recover it. 00:32:21.752 [2024-11-26 19:18:38.451945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.752 [2024-11-26 19:18:38.452019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.752 [2024-11-26 19:18:38.452029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.752 qpair failed and we were unable to recover it. 00:32:21.752 [2024-11-26 19:18:38.452168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.752 [2024-11-26 19:18:38.452307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.752 [2024-11-26 19:18:38.452316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.752 qpair failed and we were unable to recover it. 00:32:21.752 [2024-11-26 19:18:38.452483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.752 [2024-11-26 19:18:38.452620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.752 [2024-11-26 19:18:38.452630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.752 qpair failed and we were unable to recover it. 00:32:21.752 [2024-11-26 19:18:38.452771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.752 [2024-11-26 19:18:38.452861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.752 [2024-11-26 19:18:38.452871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.752 qpair failed and we were unable to recover it. 00:32:21.752 [2024-11-26 19:18:38.453031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.752 [2024-11-26 19:18:38.453158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.752 [2024-11-26 19:18:38.453168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.752 qpair failed and we were unable to recover it. 00:32:21.752 [2024-11-26 19:18:38.453366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.752 [2024-11-26 19:18:38.453503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.752 [2024-11-26 19:18:38.453512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.752 qpair failed and we were unable to recover it. 00:32:21.752 [2024-11-26 19:18:38.453590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.752 [2024-11-26 19:18:38.453726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.752 [2024-11-26 19:18:38.453735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.752 qpair failed and we were unable to recover it. 00:32:21.752 [2024-11-26 19:18:38.453873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.752 [2024-11-26 19:18:38.454040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.752 [2024-11-26 19:18:38.454050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.752 qpair failed and we were unable to recover it. 00:32:21.752 [2024-11-26 19:18:38.454192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.752 [2024-11-26 19:18:38.454269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.752 [2024-11-26 19:18:38.454279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.752 qpair failed and we were unable to recover it. 00:32:21.752 [2024-11-26 19:18:38.454425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.752 [2024-11-26 19:18:38.454482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.752 [2024-11-26 19:18:38.454491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.752 qpair failed and we were unable to recover it. 00:32:21.752 [2024-11-26 19:18:38.454582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.752 [2024-11-26 19:18:38.454728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.752 [2024-11-26 19:18:38.454737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.752 qpair failed and we were unable to recover it. 00:32:21.752 [2024-11-26 19:18:38.454816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.752 [2024-11-26 19:18:38.454944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.752 [2024-11-26 19:18:38.454957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.752 qpair failed and we were unable to recover it. 00:32:21.752 [2024-11-26 19:18:38.455090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.752 [2024-11-26 19:18:38.455149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.752 [2024-11-26 19:18:38.455159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.752 qpair failed and we were unable to recover it. 00:32:21.752 [2024-11-26 19:18:38.455238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.752 [2024-11-26 19:18:38.455379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.752 [2024-11-26 19:18:38.455389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.752 qpair failed and we were unable to recover it. 00:32:21.752 [2024-11-26 19:18:38.455533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.752 [2024-11-26 19:18:38.455607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.752 [2024-11-26 19:18:38.455617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.752 qpair failed and we were unable to recover it. 00:32:21.752 [2024-11-26 19:18:38.455811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.752 [2024-11-26 19:18:38.455939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.752 [2024-11-26 19:18:38.455966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.752 qpair failed and we were unable to recover it. 00:32:21.752 [2024-11-26 19:18:38.456119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.752 [2024-11-26 19:18:38.456191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.752 [2024-11-26 19:18:38.456200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.752 qpair failed and we were unable to recover it. 00:32:21.752 [2024-11-26 19:18:38.456273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.752 [2024-11-26 19:18:38.456354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.752 [2024-11-26 19:18:38.456365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.752 qpair failed and we were unable to recover it. 00:32:21.752 [2024-11-26 19:18:38.456441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.752 [2024-11-26 19:18:38.456659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.752 [2024-11-26 19:18:38.456669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.752 qpair failed and we were unable to recover it. 00:32:21.752 [2024-11-26 19:18:38.456744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.752 [2024-11-26 19:18:38.456804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.752 [2024-11-26 19:18:38.456814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.752 qpair failed and we were unable to recover it. 00:32:21.752 [2024-11-26 19:18:38.456900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.752 [2024-11-26 19:18:38.457027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.752 [2024-11-26 19:18:38.457037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.752 qpair failed and we were unable to recover it. 00:32:21.752 [2024-11-26 19:18:38.457125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.752 [2024-11-26 19:18:38.457256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.752 [2024-11-26 19:18:38.457266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.752 qpair failed and we were unable to recover it. 00:32:21.752 [2024-11-26 19:18:38.457338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.752 [2024-11-26 19:18:38.457476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.752 [2024-11-26 19:18:38.457486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.753 qpair failed and we were unable to recover it. 00:32:21.753 [2024-11-26 19:18:38.457678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.753 [2024-11-26 19:18:38.457807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.753 [2024-11-26 19:18:38.457817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.753 qpair failed and we were unable to recover it. 00:32:21.753 [2024-11-26 19:18:38.457895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.753 [2024-11-26 19:18:38.457974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.753 [2024-11-26 19:18:38.457985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.753 qpair failed and we were unable to recover it. 00:32:21.753 [2024-11-26 19:18:38.458119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.753 [2024-11-26 19:18:38.458271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.753 [2024-11-26 19:18:38.458281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.753 qpair failed and we were unable to recover it. 00:32:21.753 [2024-11-26 19:18:38.458436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.753 [2024-11-26 19:18:38.458609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.753 [2024-11-26 19:18:38.458618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.753 qpair failed and we were unable to recover it. 00:32:21.753 [2024-11-26 19:18:38.458762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.753 [2024-11-26 19:18:38.458888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.753 [2024-11-26 19:18:38.458901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.753 qpair failed and we were unable to recover it. 00:32:21.753 [2024-11-26 19:18:38.459051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.753 [2024-11-26 19:18:38.459214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.753 [2024-11-26 19:18:38.459224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.753 qpair failed and we were unable to recover it. 00:32:21.753 [2024-11-26 19:18:38.459377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.753 [2024-11-26 19:18:38.459524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.753 [2024-11-26 19:18:38.459534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.753 qpair failed and we were unable to recover it. 00:32:21.753 [2024-11-26 19:18:38.459760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.753 [2024-11-26 19:18:38.459849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.753 [2024-11-26 19:18:38.459858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.753 qpair failed and we were unable to recover it. 00:32:21.753 [2024-11-26 19:18:38.459988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.753 [2024-11-26 19:18:38.460147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.753 [2024-11-26 19:18:38.460157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.753 qpair failed and we were unable to recover it. 00:32:21.753 [2024-11-26 19:18:38.460309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.753 [2024-11-26 19:18:38.460439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.753 [2024-11-26 19:18:38.460448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.753 qpair failed and we were unable to recover it. 00:32:21.753 [2024-11-26 19:18:38.460604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.753 [2024-11-26 19:18:38.460680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.753 [2024-11-26 19:18:38.460690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.753 qpair failed and we were unable to recover it. 00:32:21.753 [2024-11-26 19:18:38.460820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.753 [2024-11-26 19:18:38.460952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.753 [2024-11-26 19:18:38.460962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.753 qpair failed and we were unable to recover it. 00:32:21.753 [2024-11-26 19:18:38.461036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.753 [2024-11-26 19:18:38.461176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.753 [2024-11-26 19:18:38.461186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.753 qpair failed and we were unable to recover it. 00:32:21.753 [2024-11-26 19:18:38.461256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.753 [2024-11-26 19:18:38.461381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.753 [2024-11-26 19:18:38.461390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.753 qpair failed and we were unable to recover it. 00:32:21.753 [2024-11-26 19:18:38.461451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.753 [2024-11-26 19:18:38.461517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.753 [2024-11-26 19:18:38.461529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.753 qpair failed and we were unable to recover it. 00:32:21.753 [2024-11-26 19:18:38.461682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.753 [2024-11-26 19:18:38.461743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.753 [2024-11-26 19:18:38.461752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.753 qpair failed and we were unable to recover it. 00:32:21.753 [2024-11-26 19:18:38.461843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.753 [2024-11-26 19:18:38.462066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.753 [2024-11-26 19:18:38.462076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.753 qpair failed and we were unable to recover it. 00:32:21.753 [2024-11-26 19:18:38.462174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.753 [2024-11-26 19:18:38.462313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.753 [2024-11-26 19:18:38.462323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.753 qpair failed and we were unable to recover it. 00:32:21.753 [2024-11-26 19:18:38.462412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.753 [2024-11-26 19:18:38.462499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.753 [2024-11-26 19:18:38.462509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.753 qpair failed and we were unable to recover it. 00:32:21.753 [2024-11-26 19:18:38.462579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.753 [2024-11-26 19:18:38.462704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.753 [2024-11-26 19:18:38.462714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.753 qpair failed and we were unable to recover it. 00:32:21.753 [2024-11-26 19:18:38.462862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.753 [2024-11-26 19:18:38.462931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.753 [2024-11-26 19:18:38.462941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.753 qpair failed and we were unable to recover it. 00:32:21.753 [2024-11-26 19:18:38.463075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.753 [2024-11-26 19:18:38.463224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.753 [2024-11-26 19:18:38.463234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.753 qpair failed and we were unable to recover it. 00:32:21.753 [2024-11-26 19:18:38.463374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.753 [2024-11-26 19:18:38.463566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.753 [2024-11-26 19:18:38.463576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.753 qpair failed and we were unable to recover it. 00:32:21.753 [2024-11-26 19:18:38.463734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.753 [2024-11-26 19:18:38.463821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.753 [2024-11-26 19:18:38.463830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.753 qpair failed and we were unable to recover it. 00:32:21.753 [2024-11-26 19:18:38.463918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.753 [2024-11-26 19:18:38.464002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.753 [2024-11-26 19:18:38.464015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.753 qpair failed and we were unable to recover it. 00:32:21.753 [2024-11-26 19:18:38.464091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.753 [2024-11-26 19:18:38.464283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.753 [2024-11-26 19:18:38.464293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.753 qpair failed and we were unable to recover it. 00:32:21.753 [2024-11-26 19:18:38.464441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.753 [2024-11-26 19:18:38.464520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.754 [2024-11-26 19:18:38.464530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.754 qpair failed and we were unable to recover it. 00:32:21.754 [2024-11-26 19:18:38.464661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.754 [2024-11-26 19:18:38.464797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.754 [2024-11-26 19:18:38.464807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.754 qpair failed and we were unable to recover it. 00:32:21.754 [2024-11-26 19:18:38.464866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.754 [2024-11-26 19:18:38.464941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.754 [2024-11-26 19:18:38.464955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.754 qpair failed and we were unable to recover it. 00:32:21.754 [2024-11-26 19:18:38.465024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.754 [2024-11-26 19:18:38.465156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.754 [2024-11-26 19:18:38.465165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.754 qpair failed and we were unable to recover it. 00:32:21.754 [2024-11-26 19:18:38.465229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.754 [2024-11-26 19:18:38.465358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.754 [2024-11-26 19:18:38.465368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.754 qpair failed and we were unable to recover it. 00:32:21.754 [2024-11-26 19:18:38.465441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.754 [2024-11-26 19:18:38.465578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.754 [2024-11-26 19:18:38.465588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.754 qpair failed and we were unable to recover it. 00:32:21.754 [2024-11-26 19:18:38.465804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.754 [2024-11-26 19:18:38.465943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.754 [2024-11-26 19:18:38.465961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.754 qpair failed and we were unable to recover it. 00:32:21.754 [2024-11-26 19:18:38.466109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.754 [2024-11-26 19:18:38.466174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.754 [2024-11-26 19:18:38.466184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.754 qpair failed and we were unable to recover it. 00:32:21.754 [2024-11-26 19:18:38.466325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.754 [2024-11-26 19:18:38.466410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.754 [2024-11-26 19:18:38.466420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.754 qpair failed and we were unable to recover it. 00:32:21.754 [2024-11-26 19:18:38.466512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.754 [2024-11-26 19:18:38.466570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.754 [2024-11-26 19:18:38.466579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.754 qpair failed and we were unable to recover it. 00:32:21.754 [2024-11-26 19:18:38.466657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.754 [2024-11-26 19:18:38.466798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.754 [2024-11-26 19:18:38.466808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.754 qpair failed and we were unable to recover it. 00:32:21.754 [2024-11-26 19:18:38.466880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.754 [2024-11-26 19:18:38.467016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.754 [2024-11-26 19:18:38.467027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.754 qpair failed and we were unable to recover it. 00:32:21.754 [2024-11-26 19:18:38.467096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.754 [2024-11-26 19:18:38.467257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.754 [2024-11-26 19:18:38.467267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.754 qpair failed and we were unable to recover it. 00:32:21.754 [2024-11-26 19:18:38.467337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.754 [2024-11-26 19:18:38.467474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.754 [2024-11-26 19:18:38.467485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.754 qpair failed and we were unable to recover it. 00:32:21.754 [2024-11-26 19:18:38.467569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.754 [2024-11-26 19:18:38.467640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.754 [2024-11-26 19:18:38.467649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.754 qpair failed and we were unable to recover it. 00:32:21.754 [2024-11-26 19:18:38.467788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.754 [2024-11-26 19:18:38.467937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.754 [2024-11-26 19:18:38.467962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.754 qpair failed and we were unable to recover it. 00:32:21.754 [2024-11-26 19:18:38.468049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.754 [2024-11-26 19:18:38.468182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.754 [2024-11-26 19:18:38.468191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.754 qpair failed and we were unable to recover it. 00:32:21.754 [2024-11-26 19:18:38.468265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.754 [2024-11-26 19:18:38.468500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.754 [2024-11-26 19:18:38.468509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.754 qpair failed and we were unable to recover it. 00:32:21.754 [2024-11-26 19:18:38.468580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.754 [2024-11-26 19:18:38.468817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.754 [2024-11-26 19:18:38.468827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.754 qpair failed and we were unable to recover it. 00:32:21.754 [2024-11-26 19:18:38.468980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.754 [2024-11-26 19:18:38.469068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.754 [2024-11-26 19:18:38.469078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.754 qpair failed and we were unable to recover it. 00:32:21.754 [2024-11-26 19:18:38.469146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.754 [2024-11-26 19:18:38.469224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.754 [2024-11-26 19:18:38.469234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.754 qpair failed and we were unable to recover it. 00:32:21.754 [2024-11-26 19:18:38.469328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.754 [2024-11-26 19:18:38.469412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.755 [2024-11-26 19:18:38.469421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.755 qpair failed and we were unable to recover it. 00:32:21.755 [2024-11-26 19:18:38.469618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.755 [2024-11-26 19:18:38.469691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.755 [2024-11-26 19:18:38.469701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.755 qpair failed and we were unable to recover it. 00:32:21.755 [2024-11-26 19:18:38.469773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.755 [2024-11-26 19:18:38.469856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.755 [2024-11-26 19:18:38.469865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.755 qpair failed and we were unable to recover it. 00:32:21.755 [2024-11-26 19:18:38.470072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.755 [2024-11-26 19:18:38.470152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.755 [2024-11-26 19:18:38.470161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.755 qpair failed and we were unable to recover it. 00:32:21.755 [2024-11-26 19:18:38.470225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.755 [2024-11-26 19:18:38.470429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.755 [2024-11-26 19:18:38.470439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.755 qpair failed and we were unable to recover it. 00:32:21.755 [2024-11-26 19:18:38.470589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.755 [2024-11-26 19:18:38.470658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.755 [2024-11-26 19:18:38.470668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.755 qpair failed and we were unable to recover it. 00:32:21.755 [2024-11-26 19:18:38.470813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.755 [2024-11-26 19:18:38.470956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.755 [2024-11-26 19:18:38.470966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.755 qpair failed and we were unable to recover it. 00:32:21.755 [2024-11-26 19:18:38.471188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.755 [2024-11-26 19:18:38.471267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.755 [2024-11-26 19:18:38.471277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.755 qpair failed and we were unable to recover it. 00:32:21.755 [2024-11-26 19:18:38.471352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.755 [2024-11-26 19:18:38.471415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.755 [2024-11-26 19:18:38.471424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.755 qpair failed and we were unable to recover it. 00:32:21.755 [2024-11-26 19:18:38.471497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.755 [2024-11-26 19:18:38.471631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.755 [2024-11-26 19:18:38.471641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.755 qpair failed and we were unable to recover it. 00:32:21.755 [2024-11-26 19:18:38.471810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.755 [2024-11-26 19:18:38.471872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.755 [2024-11-26 19:18:38.471881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.755 qpair failed and we were unable to recover it. 00:32:21.755 [2024-11-26 19:18:38.471976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.755 [2024-11-26 19:18:38.472121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.755 [2024-11-26 19:18:38.472131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.755 qpair failed and we were unable to recover it. 00:32:21.755 [2024-11-26 19:18:38.472195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.755 [2024-11-26 19:18:38.472272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.755 [2024-11-26 19:18:38.472281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.755 qpair failed and we were unable to recover it. 00:32:21.755 [2024-11-26 19:18:38.472460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.755 [2024-11-26 19:18:38.472524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.755 [2024-11-26 19:18:38.472533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.755 qpair failed and we were unable to recover it. 00:32:21.755 [2024-11-26 19:18:38.472701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.755 [2024-11-26 19:18:38.472772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.755 [2024-11-26 19:18:38.472781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.755 qpair failed and we were unable to recover it. 00:32:21.755 [2024-11-26 19:18:38.472913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.755 [2024-11-26 19:18:38.472975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.755 [2024-11-26 19:18:38.472985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.755 qpair failed and we were unable to recover it. 00:32:21.755 [2024-11-26 19:18:38.473124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.755 [2024-11-26 19:18:38.473254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.755 [2024-11-26 19:18:38.473264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.755 qpair failed and we were unable to recover it. 00:32:21.755 [2024-11-26 19:18:38.473333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.755 [2024-11-26 19:18:38.473487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.755 [2024-11-26 19:18:38.473497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.755 qpair failed and we were unable to recover it. 00:32:21.755 [2024-11-26 19:18:38.473598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.755 [2024-11-26 19:18:38.473728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.755 [2024-11-26 19:18:38.473737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.755 qpair failed and we were unable to recover it. 00:32:21.755 [2024-11-26 19:18:38.473868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.755 [2024-11-26 19:18:38.473964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.755 [2024-11-26 19:18:38.473973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.755 qpair failed and we were unable to recover it. 00:32:21.755 [2024-11-26 19:18:38.474117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.755 [2024-11-26 19:18:38.474197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.755 [2024-11-26 19:18:38.474208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.755 qpair failed and we were unable to recover it. 00:32:21.755 [2024-11-26 19:18:38.474291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.755 [2024-11-26 19:18:38.474435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.755 [2024-11-26 19:18:38.474444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.755 qpair failed and we were unable to recover it. 00:32:21.756 [2024-11-26 19:18:38.474514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.756 [2024-11-26 19:18:38.474650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.756 [2024-11-26 19:18:38.474660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.756 qpair failed and we were unable to recover it. 00:32:21.756 [2024-11-26 19:18:38.474803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.756 [2024-11-26 19:18:38.474955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.756 [2024-11-26 19:18:38.474965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.756 qpair failed and we were unable to recover it. 00:32:21.756 [2024-11-26 19:18:38.475116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.756 [2024-11-26 19:18:38.475258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.756 [2024-11-26 19:18:38.475269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.756 qpair failed and we were unable to recover it. 00:32:21.756 [2024-11-26 19:18:38.475398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.756 [2024-11-26 19:18:38.475473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.756 [2024-11-26 19:18:38.475482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.756 qpair failed and we were unable to recover it. 00:32:21.756 [2024-11-26 19:18:38.475543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.756 [2024-11-26 19:18:38.475708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.756 [2024-11-26 19:18:38.475718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.756 qpair failed and we were unable to recover it. 00:32:21.756 [2024-11-26 19:18:38.475856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.756 [2024-11-26 19:18:38.475998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.756 [2024-11-26 19:18:38.476009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.756 qpair failed and we were unable to recover it. 00:32:21.756 [2024-11-26 19:18:38.476084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.756 [2024-11-26 19:18:38.476226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.756 [2024-11-26 19:18:38.476236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.756 qpair failed and we were unable to recover it. 00:32:21.756 [2024-11-26 19:18:38.476484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.756 [2024-11-26 19:18:38.476702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.756 [2024-11-26 19:18:38.476712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.756 qpair failed and we were unable to recover it. 00:32:21.756 [2024-11-26 19:18:38.476840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.756 [2024-11-26 19:18:38.476988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.756 [2024-11-26 19:18:38.476999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.756 qpair failed and we were unable to recover it. 00:32:21.756 [2024-11-26 19:18:38.477080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.756 [2024-11-26 19:18:38.477153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.756 [2024-11-26 19:18:38.477162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.756 qpair failed and we were unable to recover it. 00:32:21.756 [2024-11-26 19:18:38.477263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.756 [2024-11-26 19:18:38.477472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.756 [2024-11-26 19:18:38.477482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.756 qpair failed and we were unable to recover it. 00:32:21.756 [2024-11-26 19:18:38.477646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.756 [2024-11-26 19:18:38.477773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.756 [2024-11-26 19:18:38.477784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.756 qpair failed and we were unable to recover it. 00:32:21.756 [2024-11-26 19:18:38.477858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.756 [2024-11-26 19:18:38.477939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.756 [2024-11-26 19:18:38.477952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.756 qpair failed and we were unable to recover it. 00:32:21.756 [2024-11-26 19:18:38.478098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.756 [2024-11-26 19:18:38.478258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.756 [2024-11-26 19:18:38.478268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.756 qpair failed and we were unable to recover it. 00:32:21.756 [2024-11-26 19:18:38.478404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.756 [2024-11-26 19:18:38.478553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.756 [2024-11-26 19:18:38.478563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.756 qpair failed and we were unable to recover it. 00:32:21.756 [2024-11-26 19:18:38.478650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.756 [2024-11-26 19:18:38.478751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.756 [2024-11-26 19:18:38.478761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.756 qpair failed and we were unable to recover it. 00:32:21.756 [2024-11-26 19:18:38.478852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.756 [2024-11-26 19:18:38.478943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.756 [2024-11-26 19:18:38.478956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.756 qpair failed and we were unable to recover it. 00:32:21.756 [2024-11-26 19:18:38.479192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.756 [2024-11-26 19:18:38.479345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.756 [2024-11-26 19:18:38.479354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.756 qpair failed and we were unable to recover it. 00:32:21.756 [2024-11-26 19:18:38.479487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.756 [2024-11-26 19:18:38.479577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.756 [2024-11-26 19:18:38.479586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.756 qpair failed and we were unable to recover it. 00:32:21.756 [2024-11-26 19:18:38.479671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.756 [2024-11-26 19:18:38.479804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.757 [2024-11-26 19:18:38.479814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.757 qpair failed and we were unable to recover it. 00:32:21.757 [2024-11-26 19:18:38.479945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.757 [2024-11-26 19:18:38.480030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.757 [2024-11-26 19:18:38.480040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.757 qpair failed and we were unable to recover it. 00:32:21.757 [2024-11-26 19:18:38.480174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.757 [2024-11-26 19:18:38.480236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.757 [2024-11-26 19:18:38.480246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.757 qpair failed and we were unable to recover it. 00:32:21.757 [2024-11-26 19:18:38.480328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.757 [2024-11-26 19:18:38.480404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.757 [2024-11-26 19:18:38.480413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.757 qpair failed and we were unable to recover it. 00:32:21.757 [2024-11-26 19:18:38.480552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.757 [2024-11-26 19:18:38.480696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.757 [2024-11-26 19:18:38.480706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.757 qpair failed and we were unable to recover it. 00:32:21.757 [2024-11-26 19:18:38.480834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.757 [2024-11-26 19:18:38.480901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.757 [2024-11-26 19:18:38.480910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.757 qpair failed and we were unable to recover it. 00:32:21.757 [2024-11-26 19:18:38.481080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.757 [2024-11-26 19:18:38.481146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.757 [2024-11-26 19:18:38.481156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.757 qpair failed and we were unable to recover it. 00:32:21.757 [2024-11-26 19:18:38.481307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.757 [2024-11-26 19:18:38.481393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.757 [2024-11-26 19:18:38.481402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.757 qpair failed and we were unable to recover it. 00:32:21.757 [2024-11-26 19:18:38.481535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.757 [2024-11-26 19:18:38.481614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.757 [2024-11-26 19:18:38.481623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.757 qpair failed and we were unable to recover it. 00:32:21.757 [2024-11-26 19:18:38.481767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.757 [2024-11-26 19:18:38.481895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.757 [2024-11-26 19:18:38.481906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.757 qpair failed and we were unable to recover it. 00:32:21.757 [2024-11-26 19:18:38.481995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.757 [2024-11-26 19:18:38.482127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.757 [2024-11-26 19:18:38.482138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.757 qpair failed and we were unable to recover it. 00:32:21.757 [2024-11-26 19:18:38.482224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.757 [2024-11-26 19:18:38.482359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.757 [2024-11-26 19:18:38.482368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.757 qpair failed and we were unable to recover it. 00:32:21.757 [2024-11-26 19:18:38.482565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.757 [2024-11-26 19:18:38.482640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.757 [2024-11-26 19:18:38.482650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.757 qpair failed and we were unable to recover it. 00:32:21.757 [2024-11-26 19:18:38.482733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.757 [2024-11-26 19:18:38.482866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.757 [2024-11-26 19:18:38.482876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.757 qpair failed and we were unable to recover it. 00:32:21.757 [2024-11-26 19:18:38.482969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.757 [2024-11-26 19:18:38.483106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.757 [2024-11-26 19:18:38.483115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.757 qpair failed and we were unable to recover it. 00:32:21.757 [2024-11-26 19:18:38.483248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.757 [2024-11-26 19:18:38.483320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.757 [2024-11-26 19:18:38.483329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.757 qpair failed and we were unable to recover it. 00:32:21.757 [2024-11-26 19:18:38.483403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.757 [2024-11-26 19:18:38.483598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.757 [2024-11-26 19:18:38.483608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.757 qpair failed and we were unable to recover it. 00:32:21.757 [2024-11-26 19:18:38.483825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.757 [2024-11-26 19:18:38.483910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.757 [2024-11-26 19:18:38.483920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.757 qpair failed and we were unable to recover it. 00:32:21.757 [2024-11-26 19:18:38.484000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.757 [2024-11-26 19:18:38.484077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.757 [2024-11-26 19:18:38.484087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.757 qpair failed and we were unable to recover it. 00:32:21.757 [2024-11-26 19:18:38.484219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.757 [2024-11-26 19:18:38.484359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.757 [2024-11-26 19:18:38.484368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.757 qpair failed and we were unable to recover it. 00:32:21.757 [2024-11-26 19:18:38.484496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.757 [2024-11-26 19:18:38.484690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.757 [2024-11-26 19:18:38.484700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.757 qpair failed and we were unable to recover it. 00:32:21.757 [2024-11-26 19:18:38.484900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.757 [2024-11-26 19:18:38.484972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.758 [2024-11-26 19:18:38.484983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.758 qpair failed and we were unable to recover it. 00:32:21.758 [2024-11-26 19:18:38.485128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.758 [2024-11-26 19:18:38.485204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.758 [2024-11-26 19:18:38.485214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.758 qpair failed and we were unable to recover it. 00:32:21.758 [2024-11-26 19:18:38.485384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.758 [2024-11-26 19:18:38.485512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.758 [2024-11-26 19:18:38.485523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.758 qpair failed and we were unable to recover it. 00:32:21.758 [2024-11-26 19:18:38.485673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.758 [2024-11-26 19:18:38.485812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.758 [2024-11-26 19:18:38.485822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.758 qpair failed and we were unable to recover it. 00:32:21.758 [2024-11-26 19:18:38.485972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.758 [2024-11-26 19:18:38.486033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.758 [2024-11-26 19:18:38.486043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.758 qpair failed and we were unable to recover it. 00:32:21.758 [2024-11-26 19:18:38.486127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.758 [2024-11-26 19:18:38.486276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.758 [2024-11-26 19:18:38.486286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.758 qpair failed and we were unable to recover it. 00:32:21.758 [2024-11-26 19:18:38.486362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.758 [2024-11-26 19:18:38.486448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.758 [2024-11-26 19:18:38.486458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.758 qpair failed and we were unable to recover it. 00:32:21.758 [2024-11-26 19:18:38.486535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.758 [2024-11-26 19:18:38.486609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.758 [2024-11-26 19:18:38.486619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.758 qpair failed and we were unable to recover it. 00:32:21.758 [2024-11-26 19:18:38.486766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.758 [2024-11-26 19:18:38.486912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.758 [2024-11-26 19:18:38.486922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.758 qpair failed and we were unable to recover it. 00:32:21.758 [2024-11-26 19:18:38.486988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.758 [2024-11-26 19:18:38.487063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.758 [2024-11-26 19:18:38.487073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.758 qpair failed and we were unable to recover it. 00:32:21.758 [2024-11-26 19:18:38.487177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.758 [2024-11-26 19:18:38.487313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.758 [2024-11-26 19:18:38.487322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.758 qpair failed and we were unable to recover it. 00:32:21.758 [2024-11-26 19:18:38.487391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.758 [2024-11-26 19:18:38.487477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.758 [2024-11-26 19:18:38.487487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.758 qpair failed and we were unable to recover it. 00:32:21.758 [2024-11-26 19:18:38.487565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.758 [2024-11-26 19:18:38.487648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.758 [2024-11-26 19:18:38.487657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.758 qpair failed and we were unable to recover it. 00:32:21.758 [2024-11-26 19:18:38.487733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.758 [2024-11-26 19:18:38.487805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.758 [2024-11-26 19:18:38.487815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.758 qpair failed and we were unable to recover it. 00:32:21.758 [2024-11-26 19:18:38.487878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.758 [2024-11-26 19:18:38.487943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.758 [2024-11-26 19:18:38.487956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.758 qpair failed and we were unable to recover it. 00:32:21.758 [2024-11-26 19:18:38.488087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.758 [2024-11-26 19:18:38.488147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.758 [2024-11-26 19:18:38.488156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.758 qpair failed and we were unable to recover it. 00:32:21.758 [2024-11-26 19:18:38.488230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.758 [2024-11-26 19:18:38.488394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.758 [2024-11-26 19:18:38.488404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.758 qpair failed and we were unable to recover it. 00:32:21.758 [2024-11-26 19:18:38.488465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.758 [2024-11-26 19:18:38.488602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.758 [2024-11-26 19:18:38.488612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.758 qpair failed and we were unable to recover it. 00:32:21.758 [2024-11-26 19:18:38.488744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.758 [2024-11-26 19:18:38.488870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.758 [2024-11-26 19:18:38.488880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.758 qpair failed and we were unable to recover it. 00:32:21.758 [2024-11-26 19:18:38.488960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.758 [2024-11-26 19:18:38.489108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.758 [2024-11-26 19:18:38.489118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.758 qpair failed and we were unable to recover it. 00:32:21.758 [2024-11-26 19:18:38.489243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.758 [2024-11-26 19:18:38.489334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.758 [2024-11-26 19:18:38.489343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.758 qpair failed and we were unable to recover it. 00:32:21.758 [2024-11-26 19:18:38.489437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.758 [2024-11-26 19:18:38.489500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.759 [2024-11-26 19:18:38.489509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.759 qpair failed and we were unable to recover it. 00:32:21.759 [2024-11-26 19:18:38.489671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.759 [2024-11-26 19:18:38.489733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.759 [2024-11-26 19:18:38.489742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.759 qpair failed and we were unable to recover it. 00:32:21.759 [2024-11-26 19:18:38.489880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.759 [2024-11-26 19:18:38.489941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.759 [2024-11-26 19:18:38.489954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.759 qpair failed and we were unable to recover it. 00:32:21.759 [2024-11-26 19:18:38.490047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.759 [2024-11-26 19:18:38.490120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.759 [2024-11-26 19:18:38.490129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.759 qpair failed and we were unable to recover it. 00:32:21.759 [2024-11-26 19:18:38.490235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.759 [2024-11-26 19:18:38.490300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.759 [2024-11-26 19:18:38.490310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.759 qpair failed and we were unable to recover it. 00:32:21.759 [2024-11-26 19:18:38.490375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.759 [2024-11-26 19:18:38.490447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.759 [2024-11-26 19:18:38.490457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.759 qpair failed and we were unable to recover it. 00:32:21.759 [2024-11-26 19:18:38.490553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.759 [2024-11-26 19:18:38.490617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.759 [2024-11-26 19:18:38.490626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.759 qpair failed and we were unable to recover it. 00:32:21.759 [2024-11-26 19:18:38.490763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.759 [2024-11-26 19:18:38.490898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.759 [2024-11-26 19:18:38.490908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.759 qpair failed and we were unable to recover it. 00:32:21.759 [2024-11-26 19:18:38.491042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.759 [2024-11-26 19:18:38.491170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.759 [2024-11-26 19:18:38.491180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.759 qpair failed and we were unable to recover it. 00:32:21.759 [2024-11-26 19:18:38.491312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.759 [2024-11-26 19:18:38.491389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.759 [2024-11-26 19:18:38.491400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.759 qpair failed and we were unable to recover it. 00:32:21.759 [2024-11-26 19:18:38.491527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.759 [2024-11-26 19:18:38.491614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.759 [2024-11-26 19:18:38.491624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.759 qpair failed and we were unable to recover it. 00:32:21.759 [2024-11-26 19:18:38.491707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.759 [2024-11-26 19:18:38.491768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.759 [2024-11-26 19:18:38.491778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.759 qpair failed and we were unable to recover it. 00:32:21.759 [2024-11-26 19:18:38.491863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.759 [2024-11-26 19:18:38.491923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.759 [2024-11-26 19:18:38.491933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.759 qpair failed and we were unable to recover it. 00:32:21.759 [2024-11-26 19:18:38.492067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.759 [2024-11-26 19:18:38.492192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.759 [2024-11-26 19:18:38.492202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.759 qpair failed and we were unable to recover it. 00:32:21.759 [2024-11-26 19:18:38.492276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.759 [2024-11-26 19:18:38.492379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.759 [2024-11-26 19:18:38.492389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.759 qpair failed and we were unable to recover it. 00:32:21.759 [2024-11-26 19:18:38.492467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.759 [2024-11-26 19:18:38.492545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.759 [2024-11-26 19:18:38.492558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.759 qpair failed and we were unable to recover it. 00:32:21.759 [2024-11-26 19:18:38.492700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.759 [2024-11-26 19:18:38.492892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.759 [2024-11-26 19:18:38.492903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.759 qpair failed and we were unable to recover it. 00:32:21.759 [2024-11-26 19:18:38.492994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.759 [2024-11-26 19:18:38.493067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.759 [2024-11-26 19:18:38.493077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.759 qpair failed and we were unable to recover it. 00:32:21.759 [2024-11-26 19:18:38.493139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.759 [2024-11-26 19:18:38.493208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.759 [2024-11-26 19:18:38.493218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.759 qpair failed and we were unable to recover it. 00:32:21.759 [2024-11-26 19:18:38.493279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.759 [2024-11-26 19:18:38.493417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.759 [2024-11-26 19:18:38.493427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.759 qpair failed and we were unable to recover it. 00:32:21.759 [2024-11-26 19:18:38.493518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.759 [2024-11-26 19:18:38.493649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.759 [2024-11-26 19:18:38.493659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.759 qpair failed and we were unable to recover it. 00:32:21.759 [2024-11-26 19:18:38.493736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.759 [2024-11-26 19:18:38.493824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.759 [2024-11-26 19:18:38.493834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.759 qpair failed and we were unable to recover it. 00:32:21.759 [2024-11-26 19:18:38.493899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.759 [2024-11-26 19:18:38.494012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.760 [2024-11-26 19:18:38.494023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.760 qpair failed and we were unable to recover it. 00:32:21.760 [2024-11-26 19:18:38.494169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.760 [2024-11-26 19:18:38.494318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.760 [2024-11-26 19:18:38.494329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.760 qpair failed and we were unable to recover it. 00:32:21.760 [2024-11-26 19:18:38.494501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.760 [2024-11-26 19:18:38.494646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.760 [2024-11-26 19:18:38.494656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.760 qpair failed and we were unable to recover it. 00:32:21.760 [2024-11-26 19:18:38.494804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.760 [2024-11-26 19:18:38.494966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.760 [2024-11-26 19:18:38.494980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.760 qpair failed and we were unable to recover it. 00:32:21.760 [2024-11-26 19:18:38.495116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.760 [2024-11-26 19:18:38.495252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.760 [2024-11-26 19:18:38.495262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.760 qpair failed and we were unable to recover it. 00:32:21.760 [2024-11-26 19:18:38.495398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.760 [2024-11-26 19:18:38.495539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.760 [2024-11-26 19:18:38.495550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.760 qpair failed and we were unable to recover it. 00:32:21.760 [2024-11-26 19:18:38.495695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.760 [2024-11-26 19:18:38.495846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.760 [2024-11-26 19:18:38.495857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.760 qpair failed and we were unable to recover it. 00:32:21.760 [2024-11-26 19:18:38.496017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.760 [2024-11-26 19:18:38.496219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.760 [2024-11-26 19:18:38.496230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.760 qpair failed and we were unable to recover it. 00:32:21.760 [2024-11-26 19:18:38.496329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.760 [2024-11-26 19:18:38.496406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.760 [2024-11-26 19:18:38.496416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.760 qpair failed and we were unable to recover it. 00:32:21.760 [2024-11-26 19:18:38.496509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.760 [2024-11-26 19:18:38.496645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.760 [2024-11-26 19:18:38.496655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.760 qpair failed and we were unable to recover it. 00:32:21.760 [2024-11-26 19:18:38.496783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.760 [2024-11-26 19:18:38.496925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.760 [2024-11-26 19:18:38.496935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.760 qpair failed and we were unable to recover it. 00:32:21.760 [2024-11-26 19:18:38.497165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.760 [2024-11-26 19:18:38.497246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.760 [2024-11-26 19:18:38.497256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.760 qpair failed and we were unable to recover it. 00:32:21.760 [2024-11-26 19:18:38.497453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.760 [2024-11-26 19:18:38.497613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.760 [2024-11-26 19:18:38.497624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.760 qpair failed and we were unable to recover it. 00:32:21.760 [2024-11-26 19:18:38.497756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.760 [2024-11-26 19:18:38.497859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.760 [2024-11-26 19:18:38.497871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.760 qpair failed and we were unable to recover it. 00:32:21.760 [2024-11-26 19:18:38.497998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.760 [2024-11-26 19:18:38.498196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.760 [2024-11-26 19:18:38.498206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.760 qpair failed and we were unable to recover it. 00:32:21.760 [2024-11-26 19:18:38.498353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.760 [2024-11-26 19:18:38.498509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.760 [2024-11-26 19:18:38.498520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.760 qpair failed and we were unable to recover it. 00:32:21.760 [2024-11-26 19:18:38.498666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.760 [2024-11-26 19:18:38.498857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.760 [2024-11-26 19:18:38.498867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.760 qpair failed and we were unable to recover it. 00:32:21.760 [2024-11-26 19:18:38.499048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.760 [2024-11-26 19:18:38.499144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.760 [2024-11-26 19:18:38.499154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.760 qpair failed and we were unable to recover it. 00:32:21.760 [2024-11-26 19:18:38.499281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.760 [2024-11-26 19:18:38.499414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.760 [2024-11-26 19:18:38.499424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.760 qpair failed and we were unable to recover it. 00:32:21.760 [2024-11-26 19:18:38.499571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.760 [2024-11-26 19:18:38.499644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.760 [2024-11-26 19:18:38.499654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.760 qpair failed and we were unable to recover it. 00:32:21.760 [2024-11-26 19:18:38.499852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.760 [2024-11-26 19:18:38.499944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.760 [2024-11-26 19:18:38.499957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.760 qpair failed and we were unable to recover it. 00:32:21.760 [2024-11-26 19:18:38.500159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.760 [2024-11-26 19:18:38.500305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.761 [2024-11-26 19:18:38.500316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.761 qpair failed and we were unable to recover it. 00:32:21.761 [2024-11-26 19:18:38.500491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.761 [2024-11-26 19:18:38.500619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.761 [2024-11-26 19:18:38.500630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.761 qpair failed and we were unable to recover it. 00:32:21.761 [2024-11-26 19:18:38.500805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.761 [2024-11-26 19:18:38.500904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.761 [2024-11-26 19:18:38.500916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.761 qpair failed and we were unable to recover it. 00:32:21.761 [2024-11-26 19:18:38.500985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.761 [2024-11-26 19:18:38.501125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.761 [2024-11-26 19:18:38.501134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.761 qpair failed and we were unable to recover it. 00:32:21.761 [2024-11-26 19:18:38.501203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.761 [2024-11-26 19:18:38.501333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.761 [2024-11-26 19:18:38.501342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.761 qpair failed and we were unable to recover it. 00:32:21.761 [2024-11-26 19:18:38.501487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.761 [2024-11-26 19:18:38.501562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.761 [2024-11-26 19:18:38.501574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.761 qpair failed and we were unable to recover it. 00:32:21.761 [2024-11-26 19:18:38.501648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.761 [2024-11-26 19:18:38.501720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.761 [2024-11-26 19:18:38.501729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.761 qpair failed and we were unable to recover it. 00:32:21.761 [2024-11-26 19:18:38.501878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.761 [2024-11-26 19:18:38.502006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.761 [2024-11-26 19:18:38.502016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.761 qpair failed and we were unable to recover it. 00:32:21.761 [2024-11-26 19:18:38.502079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.761 [2024-11-26 19:18:38.502220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.761 [2024-11-26 19:18:38.502231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.761 qpair failed and we were unable to recover it. 00:32:21.761 [2024-11-26 19:18:38.502312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.761 [2024-11-26 19:18:38.502381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.761 [2024-11-26 19:18:38.502391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.761 qpair failed and we were unable to recover it. 00:32:21.761 [2024-11-26 19:18:38.502520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.761 [2024-11-26 19:18:38.502726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.761 [2024-11-26 19:18:38.502736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.761 qpair failed and we were unable to recover it. 00:32:21.761 [2024-11-26 19:18:38.502803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.761 [2024-11-26 19:18:38.503036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.761 [2024-11-26 19:18:38.503047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.761 qpair failed and we were unable to recover it. 00:32:21.761 [2024-11-26 19:18:38.503189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.761 [2024-11-26 19:18:38.503327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.761 [2024-11-26 19:18:38.503337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.761 qpair failed and we were unable to recover it. 00:32:21.761 [2024-11-26 19:18:38.503474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.761 [2024-11-26 19:18:38.503555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.761 [2024-11-26 19:18:38.503566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.761 qpair failed and we were unable to recover it. 00:32:21.761 [2024-11-26 19:18:38.503705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.761 [2024-11-26 19:18:38.503839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.761 [2024-11-26 19:18:38.503849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.761 qpair failed and we were unable to recover it. 00:32:21.761 [2024-11-26 19:18:38.503909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.761 [2024-11-26 19:18:38.504129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.761 [2024-11-26 19:18:38.504140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.761 qpair failed and we were unable to recover it. 00:32:21.761 [2024-11-26 19:18:38.504268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.761 [2024-11-26 19:18:38.504412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.761 [2024-11-26 19:18:38.504422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.761 qpair failed and we were unable to recover it. 00:32:21.761 [2024-11-26 19:18:38.504574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.761 [2024-11-26 19:18:38.504703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.761 [2024-11-26 19:18:38.504713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.761 qpair failed and we were unable to recover it. 00:32:21.761 [2024-11-26 19:18:38.504839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.761 [2024-11-26 19:18:38.504973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.761 [2024-11-26 19:18:38.504984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.761 qpair failed and we were unable to recover it. 00:32:21.761 [2024-11-26 19:18:38.505124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.761 [2024-11-26 19:18:38.505200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.761 [2024-11-26 19:18:38.505210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.761 qpair failed and we were unable to recover it. 00:32:21.761 [2024-11-26 19:18:38.505284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.761 [2024-11-26 19:18:38.505443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.761 [2024-11-26 19:18:38.505453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.761 qpair failed and we were unable to recover it. 00:32:21.761 [2024-11-26 19:18:38.505587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.761 [2024-11-26 19:18:38.505719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.761 [2024-11-26 19:18:38.505729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.761 qpair failed and we were unable to recover it. 00:32:21.761 [2024-11-26 19:18:38.505803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.762 [2024-11-26 19:18:38.505959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.762 [2024-11-26 19:18:38.505970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.762 qpair failed and we were unable to recover it. 00:32:21.762 [2024-11-26 19:18:38.506123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.762 [2024-11-26 19:18:38.506268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.762 [2024-11-26 19:18:38.506279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.762 qpair failed and we were unable to recover it. 00:32:21.762 [2024-11-26 19:18:38.506440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.762 [2024-11-26 19:18:38.506580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.762 [2024-11-26 19:18:38.506591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.762 qpair failed and we were unable to recover it. 00:32:21.762 [2024-11-26 19:18:38.506677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.762 [2024-11-26 19:18:38.506856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.762 [2024-11-26 19:18:38.506866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.762 qpair failed and we were unable to recover it. 00:32:21.762 [2024-11-26 19:18:38.507022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.762 [2024-11-26 19:18:38.507083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.762 [2024-11-26 19:18:38.507093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.762 qpair failed and we were unable to recover it. 00:32:21.762 [2024-11-26 19:18:38.507174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.762 [2024-11-26 19:18:38.507301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.762 [2024-11-26 19:18:38.507323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.762 qpair failed and we were unable to recover it. 00:32:21.762 [2024-11-26 19:18:38.507407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.762 [2024-11-26 19:18:38.507548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.762 [2024-11-26 19:18:38.507559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.762 qpair failed and we were unable to recover it. 00:32:21.762 [2024-11-26 19:18:38.507698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.762 [2024-11-26 19:18:38.507827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.762 [2024-11-26 19:18:38.507837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.762 qpair failed and we were unable to recover it. 00:32:21.762 [2024-11-26 19:18:38.507983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.762 [2024-11-26 19:18:38.508134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.762 [2024-11-26 19:18:38.508145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.762 qpair failed and we were unable to recover it. 00:32:21.762 [2024-11-26 19:18:38.508351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.762 [2024-11-26 19:18:38.508413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.762 [2024-11-26 19:18:38.508422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.762 qpair failed and we were unable to recover it. 00:32:21.762 [2024-11-26 19:18:38.508548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.762 [2024-11-26 19:18:38.508690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.762 [2024-11-26 19:18:38.508701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.762 qpair failed and we were unable to recover it. 00:32:21.762 [2024-11-26 19:18:38.508835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.762 [2024-11-26 19:18:38.508976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.762 [2024-11-26 19:18:38.508987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.762 qpair failed and we were unable to recover it. 00:32:21.762 [2024-11-26 19:18:38.509065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.762 [2024-11-26 19:18:38.509135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.762 [2024-11-26 19:18:38.509145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.762 qpair failed and we were unable to recover it. 00:32:21.762 [2024-11-26 19:18:38.509211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.762 [2024-11-26 19:18:38.509286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.762 [2024-11-26 19:18:38.509296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.762 qpair failed and we were unable to recover it. 00:32:21.762 [2024-11-26 19:18:38.509448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.762 [2024-11-26 19:18:38.509512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.762 [2024-11-26 19:18:38.509522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.762 qpair failed and we were unable to recover it. 00:32:21.762 [2024-11-26 19:18:38.509611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.762 [2024-11-26 19:18:38.509748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.762 [2024-11-26 19:18:38.509759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.762 qpair failed and we were unable to recover it. 00:32:21.762 [2024-11-26 19:18:38.509931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.762 [2024-11-26 19:18:38.510074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.762 [2024-11-26 19:18:38.510085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.762 qpair failed and we were unable to recover it. 00:32:21.762 [2024-11-26 19:18:38.510223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.762 [2024-11-26 19:18:38.510304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.762 [2024-11-26 19:18:38.510314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.762 qpair failed and we were unable to recover it. 00:32:21.762 [2024-11-26 19:18:38.510446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.762 [2024-11-26 19:18:38.510571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.762 [2024-11-26 19:18:38.510581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.762 qpair failed and we were unable to recover it. 00:32:21.763 [2024-11-26 19:18:38.510666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.763 [2024-11-26 19:18:38.510858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.763 [2024-11-26 19:18:38.510868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.763 qpair failed and we were unable to recover it. 00:32:21.763 [2024-11-26 19:18:38.510954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.763 [2024-11-26 19:18:38.511091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.763 [2024-11-26 19:18:38.511102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.763 qpair failed and we were unable to recover it. 00:32:21.763 [2024-11-26 19:18:38.511175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.763 [2024-11-26 19:18:38.511314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.763 [2024-11-26 19:18:38.511325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.763 qpair failed and we were unable to recover it. 00:32:21.763 [2024-11-26 19:18:38.511406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.763 [2024-11-26 19:18:38.511476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.763 [2024-11-26 19:18:38.511486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.763 qpair failed and we were unable to recover it. 00:32:21.763 [2024-11-26 19:18:38.511578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.763 [2024-11-26 19:18:38.511735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.763 [2024-11-26 19:18:38.511745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.763 qpair failed and we were unable to recover it. 00:32:21.763 [2024-11-26 19:18:38.511806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.763 [2024-11-26 19:18:38.511935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.763 [2024-11-26 19:18:38.511944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.763 qpair failed and we were unable to recover it. 00:32:21.763 [2024-11-26 19:18:38.512041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.763 [2024-11-26 19:18:38.512114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.763 [2024-11-26 19:18:38.512124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.763 qpair failed and we were unable to recover it. 00:32:21.763 [2024-11-26 19:18:38.512205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.763 [2024-11-26 19:18:38.512413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.763 [2024-11-26 19:18:38.512424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.763 qpair failed and we were unable to recover it. 00:32:21.763 [2024-11-26 19:18:38.512487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.763 [2024-11-26 19:18:38.512583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.763 [2024-11-26 19:18:38.512593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.763 qpair failed and we were unable to recover it. 00:32:21.763 [2024-11-26 19:18:38.512727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.763 [2024-11-26 19:18:38.512794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.763 [2024-11-26 19:18:38.512804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.763 qpair failed and we were unable to recover it. 00:32:21.763 [2024-11-26 19:18:38.512931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.763 [2024-11-26 19:18:38.513071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.763 [2024-11-26 19:18:38.513082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.763 qpair failed and we were unable to recover it. 00:32:21.763 [2024-11-26 19:18:38.513146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.763 [2024-11-26 19:18:38.513273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.763 [2024-11-26 19:18:38.513283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.763 qpair failed and we were unable to recover it. 00:32:21.763 [2024-11-26 19:18:38.513444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.763 [2024-11-26 19:18:38.513527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.763 [2024-11-26 19:18:38.513537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.763 qpair failed and we were unable to recover it. 00:32:21.763 [2024-11-26 19:18:38.513677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.763 [2024-11-26 19:18:38.513805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.763 [2024-11-26 19:18:38.513814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.763 qpair failed and we were unable to recover it. 00:32:21.763 [2024-11-26 19:18:38.513901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.763 [2024-11-26 19:18:38.513970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.763 [2024-11-26 19:18:38.513979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.763 qpair failed and we were unable to recover it. 00:32:21.763 [2024-11-26 19:18:38.514039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.763 [2024-11-26 19:18:38.514165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.763 [2024-11-26 19:18:38.514175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.763 qpair failed and we were unable to recover it. 00:32:21.763 [2024-11-26 19:18:38.514313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.763 [2024-11-26 19:18:38.514376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.763 [2024-11-26 19:18:38.514386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.763 qpair failed and we were unable to recover it. 00:32:21.763 [2024-11-26 19:18:38.514514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.763 [2024-11-26 19:18:38.514598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.763 [2024-11-26 19:18:38.514607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.763 qpair failed and we were unable to recover it. 00:32:21.763 [2024-11-26 19:18:38.514746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.763 [2024-11-26 19:18:38.514943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.763 [2024-11-26 19:18:38.514965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.763 qpair failed and we were unable to recover it. 00:32:21.763 [2024-11-26 19:18:38.515047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.763 [2024-11-26 19:18:38.515133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.763 [2024-11-26 19:18:38.515143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.763 qpair failed and we were unable to recover it. 00:32:21.763 [2024-11-26 19:18:38.515203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.763 [2024-11-26 19:18:38.515264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.763 [2024-11-26 19:18:38.515274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.763 qpair failed and we were unable to recover it. 00:32:21.763 [2024-11-26 19:18:38.515365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.763 [2024-11-26 19:18:38.515509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.763 [2024-11-26 19:18:38.515522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.763 qpair failed and we were unable to recover it. 00:32:21.763 [2024-11-26 19:18:38.515597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.763 [2024-11-26 19:18:38.515676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.763 [2024-11-26 19:18:38.515687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.763 qpair failed and we were unable to recover it. 00:32:21.763 [2024-11-26 19:18:38.515771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.763 [2024-11-26 19:18:38.515846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.763 [2024-11-26 19:18:38.515855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.763 qpair failed and we were unable to recover it. 00:32:21.763 [2024-11-26 19:18:38.515985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.763 [2024-11-26 19:18:38.516063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.763 [2024-11-26 19:18:38.516074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.764 qpair failed and we were unable to recover it. 00:32:21.764 [2024-11-26 19:18:38.516158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.764 [2024-11-26 19:18:38.516288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.764 [2024-11-26 19:18:38.516298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.764 qpair failed and we were unable to recover it. 00:32:21.764 [2024-11-26 19:18:38.516425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.764 [2024-11-26 19:18:38.516570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.764 [2024-11-26 19:18:38.516580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.764 qpair failed and we were unable to recover it. 00:32:21.764 [2024-11-26 19:18:38.516666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.764 [2024-11-26 19:18:38.516725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.764 [2024-11-26 19:18:38.516734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.764 qpair failed and we were unable to recover it. 00:32:21.764 [2024-11-26 19:18:38.516972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.764 [2024-11-26 19:18:38.517111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.764 [2024-11-26 19:18:38.517122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.764 qpair failed and we were unable to recover it. 00:32:21.764 [2024-11-26 19:18:38.517265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.764 [2024-11-26 19:18:38.517327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.764 [2024-11-26 19:18:38.517337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.764 qpair failed and we were unable to recover it. 00:32:21.764 [2024-11-26 19:18:38.517534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.764 [2024-11-26 19:18:38.517663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.764 [2024-11-26 19:18:38.517673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.764 qpair failed and we were unable to recover it. 00:32:21.764 [2024-11-26 19:18:38.517812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.764 [2024-11-26 19:18:38.517970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.764 [2024-11-26 19:18:38.517980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.764 qpair failed and we were unable to recover it. 00:32:21.764 [2024-11-26 19:18:38.518115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.764 [2024-11-26 19:18:38.518201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.764 [2024-11-26 19:18:38.518211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.764 qpair failed and we were unable to recover it. 00:32:21.764 [2024-11-26 19:18:38.518388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.764 [2024-11-26 19:18:38.518469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.764 [2024-11-26 19:18:38.518479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.764 qpair failed and we were unable to recover it. 00:32:21.764 [2024-11-26 19:18:38.518623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.764 [2024-11-26 19:18:38.518694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.764 [2024-11-26 19:18:38.518704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.764 qpair failed and we were unable to recover it. 00:32:21.764 [2024-11-26 19:18:38.518859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.764 [2024-11-26 19:18:38.518925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.764 [2024-11-26 19:18:38.518935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.764 qpair failed and we were unable to recover it. 00:32:21.764 [2024-11-26 19:18:38.519072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.764 [2024-11-26 19:18:38.519206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.764 [2024-11-26 19:18:38.519216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.764 qpair failed and we were unable to recover it. 00:32:21.764 [2024-11-26 19:18:38.519356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.764 [2024-11-26 19:18:38.519484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.764 [2024-11-26 19:18:38.519494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.764 qpair failed and we were unable to recover it. 00:32:21.764 [2024-11-26 19:18:38.519567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.764 [2024-11-26 19:18:38.519641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.764 [2024-11-26 19:18:38.519652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.764 qpair failed and we were unable to recover it. 00:32:21.764 [2024-11-26 19:18:38.519738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.764 [2024-11-26 19:18:38.519885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.764 [2024-11-26 19:18:38.519895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.764 qpair failed and we were unable to recover it. 00:32:21.764 [2024-11-26 19:18:38.520076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.764 [2024-11-26 19:18:38.520162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.764 [2024-11-26 19:18:38.520173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.764 qpair failed and we were unable to recover it. 00:32:21.764 [2024-11-26 19:18:38.520341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.764 [2024-11-26 19:18:38.520415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.764 [2024-11-26 19:18:38.520425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.764 qpair failed and we were unable to recover it. 00:32:21.764 [2024-11-26 19:18:38.520496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.764 [2024-11-26 19:18:38.520636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.764 [2024-11-26 19:18:38.520653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.764 qpair failed and we were unable to recover it. 00:32:21.764 [2024-11-26 19:18:38.520855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.764 [2024-11-26 19:18:38.520996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.764 [2024-11-26 19:18:38.521008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.764 qpair failed and we were unable to recover it. 00:32:21.764 [2024-11-26 19:18:38.521156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.764 [2024-11-26 19:18:38.521322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.764 [2024-11-26 19:18:38.521333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.764 qpair failed and we were unable to recover it. 00:32:21.764 [2024-11-26 19:18:38.521542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.764 [2024-11-26 19:18:38.521686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.765 [2024-11-26 19:18:38.521697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.765 qpair failed and we were unable to recover it. 00:32:21.765 [2024-11-26 19:18:38.521823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.765 [2024-11-26 19:18:38.521962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.765 [2024-11-26 19:18:38.521974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.765 qpair failed and we were unable to recover it. 00:32:21.765 [2024-11-26 19:18:38.522109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.765 [2024-11-26 19:18:38.522188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.765 [2024-11-26 19:18:38.522198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.765 qpair failed and we were unable to recover it. 00:32:21.765 [2024-11-26 19:18:38.522276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.765 [2024-11-26 19:18:38.522468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.765 [2024-11-26 19:18:38.522479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.765 qpair failed and we were unable to recover it. 00:32:21.765 [2024-11-26 19:18:38.522535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.765 [2024-11-26 19:18:38.522679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.765 [2024-11-26 19:18:38.522689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.765 qpair failed and we were unable to recover it. 00:32:21.765 [2024-11-26 19:18:38.522758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.765 [2024-11-26 19:18:38.522896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.765 [2024-11-26 19:18:38.522905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.765 qpair failed and we were unable to recover it. 00:32:21.765 [2024-11-26 19:18:38.522968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.765 [2024-11-26 19:18:38.523093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.765 [2024-11-26 19:18:38.523117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.765 qpair failed and we were unable to recover it. 00:32:21.765 [2024-11-26 19:18:38.523185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.765 [2024-11-26 19:18:38.523325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.765 [2024-11-26 19:18:38.523336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.765 qpair failed and we were unable to recover it. 00:32:21.765 [2024-11-26 19:18:38.523492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.765 [2024-11-26 19:18:38.523576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.765 [2024-11-26 19:18:38.523587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.765 qpair failed and we were unable to recover it. 00:32:21.765 [2024-11-26 19:18:38.523742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.765 [2024-11-26 19:18:38.523822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.765 [2024-11-26 19:18:38.523833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.765 qpair failed and we were unable to recover it. 00:32:21.765 [2024-11-26 19:18:38.524001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.765 [2024-11-26 19:18:38.524086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.765 [2024-11-26 19:18:38.524096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.765 qpair failed and we were unable to recover it. 00:32:21.765 [2024-11-26 19:18:38.524233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.765 [2024-11-26 19:18:38.524380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.765 [2024-11-26 19:18:38.524390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.765 qpair failed and we were unable to recover it. 00:32:21.765 [2024-11-26 19:18:38.524520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.765 [2024-11-26 19:18:38.524734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.765 [2024-11-26 19:18:38.524744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.765 qpair failed and we were unable to recover it. 00:32:21.765 [2024-11-26 19:18:38.524822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.765 [2024-11-26 19:18:38.525028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.765 [2024-11-26 19:18:38.525039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.765 qpair failed and we were unable to recover it. 00:32:21.765 [2024-11-26 19:18:38.525180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.765 [2024-11-26 19:18:38.525241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.765 [2024-11-26 19:18:38.525251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.765 qpair failed and we were unable to recover it. 00:32:21.765 [2024-11-26 19:18:38.525415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.765 [2024-11-26 19:18:38.525489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.765 [2024-11-26 19:18:38.525499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.765 qpair failed and we were unable to recover it. 00:32:21.765 [2024-11-26 19:18:38.525727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.765 [2024-11-26 19:18:38.525865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.765 [2024-11-26 19:18:38.525875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.765 qpair failed and we were unable to recover it. 00:32:21.765 [2024-11-26 19:18:38.525962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.765 [2024-11-26 19:18:38.526109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.765 [2024-11-26 19:18:38.526120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.765 qpair failed and we were unable to recover it. 00:32:21.765 [2024-11-26 19:18:38.526318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.765 [2024-11-26 19:18:38.526377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.765 [2024-11-26 19:18:38.526388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.765 qpair failed and we were unable to recover it. 00:32:21.765 [2024-11-26 19:18:38.526537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.765 [2024-11-26 19:18:38.526686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.765 [2024-11-26 19:18:38.526696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.765 qpair failed and we were unable to recover it. 00:32:21.765 [2024-11-26 19:18:38.526895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.765 [2024-11-26 19:18:38.526964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.765 [2024-11-26 19:18:38.526975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.765 qpair failed and we were unable to recover it. 00:32:21.765 [2024-11-26 19:18:38.527112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.765 [2024-11-26 19:18:38.527249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.765 [2024-11-26 19:18:38.527259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.765 qpair failed and we were unable to recover it. 00:32:21.765 [2024-11-26 19:18:38.527404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.765 [2024-11-26 19:18:38.527487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.766 [2024-11-26 19:18:38.527497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.766 qpair failed and we were unable to recover it. 00:32:21.766 [2024-11-26 19:18:38.527698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.766 [2024-11-26 19:18:38.527863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.766 [2024-11-26 19:18:38.527873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.766 qpair failed and we were unable to recover it. 00:32:21.766 [2024-11-26 19:18:38.527943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.766 [2024-11-26 19:18:38.528031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.766 [2024-11-26 19:18:38.528042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.766 qpair failed and we were unable to recover it. 00:32:21.766 [2024-11-26 19:18:38.528127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.766 [2024-11-26 19:18:38.528283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.766 [2024-11-26 19:18:38.528293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.766 qpair failed and we were unable to recover it. 00:32:21.766 [2024-11-26 19:18:38.528360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.766 [2024-11-26 19:18:38.528555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.766 [2024-11-26 19:18:38.528564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.766 qpair failed and we were unable to recover it. 00:32:21.766 [2024-11-26 19:18:38.528697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.766 [2024-11-26 19:18:38.528848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.766 [2024-11-26 19:18:38.528859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.766 qpair failed and we were unable to recover it. 00:32:21.766 [2024-11-26 19:18:38.528939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.766 [2024-11-26 19:18:38.529084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.766 [2024-11-26 19:18:38.529095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.766 qpair failed and we were unable to recover it. 00:32:21.766 [2024-11-26 19:18:38.529231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.766 [2024-11-26 19:18:38.529302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.766 [2024-11-26 19:18:38.529312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.766 qpair failed and we were unable to recover it. 00:32:21.766 [2024-11-26 19:18:38.529452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.766 [2024-11-26 19:18:38.529517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.766 [2024-11-26 19:18:38.529534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.766 qpair failed and we were unable to recover it. 00:32:21.766 [2024-11-26 19:18:38.529737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.766 [2024-11-26 19:18:38.529889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.766 [2024-11-26 19:18:38.529899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.766 qpair failed and we were unable to recover it. 00:32:21.766 [2024-11-26 19:18:38.530048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.766 [2024-11-26 19:18:38.530122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.766 [2024-11-26 19:18:38.530132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.766 qpair failed and we were unable to recover it. 00:32:21.766 [2024-11-26 19:18:38.530207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.766 [2024-11-26 19:18:38.530293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.766 [2024-11-26 19:18:38.530303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.766 qpair failed and we were unable to recover it. 00:32:21.766 [2024-11-26 19:18:38.530367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.766 [2024-11-26 19:18:38.530497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.766 [2024-11-26 19:18:38.530507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.766 qpair failed and we were unable to recover it. 00:32:21.766 [2024-11-26 19:18:38.530643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.766 [2024-11-26 19:18:38.530723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.766 [2024-11-26 19:18:38.530733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.766 qpair failed and we were unable to recover it. 00:32:21.766 [2024-11-26 19:18:38.530891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.766 [2024-11-26 19:18:38.531036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.766 [2024-11-26 19:18:38.531046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.766 qpair failed and we were unable to recover it. 00:32:21.766 [2024-11-26 19:18:38.531129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.766 [2024-11-26 19:18:38.531299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.766 [2024-11-26 19:18:38.531309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.766 qpair failed and we were unable to recover it. 00:32:21.766 [2024-11-26 19:18:38.531440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.766 [2024-11-26 19:18:38.531638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.766 [2024-11-26 19:18:38.531649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.766 qpair failed and we were unable to recover it. 00:32:21.766 [2024-11-26 19:18:38.531782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.766 [2024-11-26 19:18:38.531845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.766 [2024-11-26 19:18:38.531855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.766 qpair failed and we were unable to recover it. 00:32:21.766 [2024-11-26 19:18:38.531930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.766 [2024-11-26 19:18:38.531993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.766 [2024-11-26 19:18:38.532003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.766 qpair failed and we were unable to recover it. 00:32:21.766 [2024-11-26 19:18:38.532081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.766 [2024-11-26 19:18:38.532168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.766 [2024-11-26 19:18:38.532179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.766 qpair failed and we were unable to recover it. 00:32:21.766 [2024-11-26 19:18:38.532246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.766 [2024-11-26 19:18:38.532407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.766 [2024-11-26 19:18:38.532418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.766 qpair failed and we were unable to recover it. 00:32:21.766 [2024-11-26 19:18:38.532564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.766 [2024-11-26 19:18:38.532651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.766 [2024-11-26 19:18:38.532660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.766 qpair failed and we were unable to recover it. 00:32:21.766 [2024-11-26 19:18:38.532809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.766 [2024-11-26 19:18:38.532871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.766 [2024-11-26 19:18:38.532893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.766 qpair failed and we were unable to recover it. 00:32:21.766 [2024-11-26 19:18:38.532966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.766 [2024-11-26 19:18:38.533104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.767 [2024-11-26 19:18:38.533117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.767 qpair failed and we were unable to recover it. 00:32:21.767 [2024-11-26 19:18:38.533208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.767 [2024-11-26 19:18:38.533285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.767 [2024-11-26 19:18:38.533295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.767 qpair failed and we were unable to recover it. 00:32:21.767 [2024-11-26 19:18:38.533371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.767 [2024-11-26 19:18:38.533589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.767 [2024-11-26 19:18:38.533602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.767 qpair failed and we were unable to recover it. 00:32:21.767 [2024-11-26 19:18:38.533732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.767 [2024-11-26 19:18:38.533812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.767 [2024-11-26 19:18:38.533822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.767 qpair failed and we were unable to recover it. 00:32:21.767 [2024-11-26 19:18:38.533969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.767 [2024-11-26 19:18:38.534054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.767 [2024-11-26 19:18:38.534065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.767 qpair failed and we were unable to recover it. 00:32:21.767 [2024-11-26 19:18:38.534142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.767 [2024-11-26 19:18:38.534345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.767 [2024-11-26 19:18:38.534355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.767 qpair failed and we were unable to recover it. 00:32:21.767 [2024-11-26 19:18:38.534510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.767 [2024-11-26 19:18:38.534587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.767 [2024-11-26 19:18:38.534597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.767 qpair failed and we were unable to recover it. 00:32:21.767 [2024-11-26 19:18:38.534660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.767 [2024-11-26 19:18:38.534764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.767 [2024-11-26 19:18:38.534774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.767 qpair failed and we were unable to recover it. 00:32:21.767 [2024-11-26 19:18:38.534922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.767 [2024-11-26 19:18:38.535072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.767 [2024-11-26 19:18:38.535084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.767 qpair failed and we were unable to recover it. 00:32:21.767 [2024-11-26 19:18:38.535236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.767 [2024-11-26 19:18:38.535311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.767 [2024-11-26 19:18:38.535321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.767 qpair failed and we were unable to recover it. 00:32:21.767 [2024-11-26 19:18:38.535464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.767 [2024-11-26 19:18:38.535592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.767 [2024-11-26 19:18:38.535603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.767 qpair failed and we were unable to recover it. 00:32:21.767 [2024-11-26 19:18:38.535802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.767 [2024-11-26 19:18:38.535938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.767 [2024-11-26 19:18:38.535953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.767 qpair failed and we were unable to recover it. 00:32:21.767 [2024-11-26 19:18:38.536087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.767 [2024-11-26 19:18:38.536157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.767 [2024-11-26 19:18:38.536169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.767 qpair failed and we were unable to recover it. 00:32:21.767 [2024-11-26 19:18:38.536257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.767 [2024-11-26 19:18:38.536388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.767 [2024-11-26 19:18:38.536398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.767 qpair failed and we were unable to recover it. 00:32:21.767 [2024-11-26 19:18:38.536543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.767 [2024-11-26 19:18:38.536629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.767 [2024-11-26 19:18:38.536639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.767 qpair failed and we were unable to recover it. 00:32:21.767 [2024-11-26 19:18:38.536707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.767 [2024-11-26 19:18:38.536848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.767 [2024-11-26 19:18:38.536858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.767 qpair failed and we were unable to recover it. 00:32:21.767 [2024-11-26 19:18:38.536934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.767 [2024-11-26 19:18:38.537018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.767 [2024-11-26 19:18:38.537040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.767 qpair failed and we were unable to recover it. 00:32:21.767 [2024-11-26 19:18:38.537116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.767 [2024-11-26 19:18:38.537199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.767 [2024-11-26 19:18:38.537219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.767 qpair failed and we were unable to recover it. 00:32:21.767 [2024-11-26 19:18:38.537282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.767 [2024-11-26 19:18:38.537360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.767 [2024-11-26 19:18:38.537370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.767 qpair failed and we were unable to recover it. 00:32:21.767 [2024-11-26 19:18:38.537522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.767 [2024-11-26 19:18:38.537647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.767 [2024-11-26 19:18:38.537657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.768 qpair failed and we were unable to recover it. 00:32:21.768 [2024-11-26 19:18:38.537733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.768 [2024-11-26 19:18:38.537859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.768 [2024-11-26 19:18:38.537869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.768 qpair failed and we were unable to recover it. 00:32:21.768 [2024-11-26 19:18:38.537956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.768 [2024-11-26 19:18:38.538098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.768 [2024-11-26 19:18:38.538108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.768 qpair failed and we were unable to recover it. 00:32:21.768 [2024-11-26 19:18:38.538202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.768 [2024-11-26 19:18:38.538274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.768 [2024-11-26 19:18:38.538286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.768 qpair failed and we were unable to recover it. 00:32:21.768 [2024-11-26 19:18:38.538409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.768 [2024-11-26 19:18:38.538481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.768 [2024-11-26 19:18:38.538491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.768 qpair failed and we were unable to recover it. 00:32:21.768 [2024-11-26 19:18:38.538636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.768 [2024-11-26 19:18:38.538703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.768 [2024-11-26 19:18:38.538713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.768 qpair failed and we were unable to recover it. 00:32:21.768 [2024-11-26 19:18:38.538781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.768 [2024-11-26 19:18:38.538860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.768 [2024-11-26 19:18:38.538870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.768 qpair failed and we were unable to recover it. 00:32:21.768 [2024-11-26 19:18:38.539025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.768 [2024-11-26 19:18:38.539108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.768 [2024-11-26 19:18:38.539118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.768 qpair failed and we were unable to recover it. 00:32:21.768 [2024-11-26 19:18:38.539182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.768 [2024-11-26 19:18:38.539325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.768 [2024-11-26 19:18:38.539336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.768 qpair failed and we were unable to recover it. 00:32:21.768 [2024-11-26 19:18:38.539480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.768 [2024-11-26 19:18:38.539560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.768 [2024-11-26 19:18:38.539571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.768 qpair failed and we were unable to recover it. 00:32:21.768 [2024-11-26 19:18:38.539701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.768 [2024-11-26 19:18:38.539760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.768 [2024-11-26 19:18:38.539770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.768 qpair failed and we were unable to recover it. 00:32:21.768 [2024-11-26 19:18:38.539862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.768 [2024-11-26 19:18:38.540093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.768 [2024-11-26 19:18:38.540104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.768 qpair failed and we were unable to recover it. 00:32:21.768 [2024-11-26 19:18:38.540171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.768 [2024-11-26 19:18:38.540257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.768 [2024-11-26 19:18:38.540268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.768 qpair failed and we were unable to recover it. 00:32:21.768 [2024-11-26 19:18:38.540407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.768 [2024-11-26 19:18:38.540473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.768 [2024-11-26 19:18:38.540485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.768 qpair failed and we were unable to recover it. 00:32:21.768 [2024-11-26 19:18:38.540613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.768 [2024-11-26 19:18:38.540809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.768 [2024-11-26 19:18:38.540820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.768 qpair failed and we were unable to recover it. 00:32:21.768 [2024-11-26 19:18:38.540967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.768 [2024-11-26 19:18:38.541103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.768 [2024-11-26 19:18:38.541113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.768 qpair failed and we were unable to recover it. 00:32:21.768 [2024-11-26 19:18:38.541194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.768 [2024-11-26 19:18:38.541270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.768 [2024-11-26 19:18:38.541280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.768 qpair failed and we were unable to recover it. 00:32:21.768 [2024-11-26 19:18:38.541364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.768 [2024-11-26 19:18:38.541520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.768 [2024-11-26 19:18:38.541531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.768 qpair failed and we were unable to recover it. 00:32:21.768 [2024-11-26 19:18:38.541664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.768 [2024-11-26 19:18:38.541808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.768 [2024-11-26 19:18:38.541818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.768 qpair failed and we were unable to recover it. 00:32:21.769 [2024-11-26 19:18:38.541898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.769 [2024-11-26 19:18:38.541979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.769 [2024-11-26 19:18:38.541990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.769 qpair failed and we were unable to recover it. 00:32:21.769 [2024-11-26 19:18:38.542187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.769 [2024-11-26 19:18:38.542333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.769 [2024-11-26 19:18:38.542343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.769 qpair failed and we were unable to recover it. 00:32:21.769 [2024-11-26 19:18:38.542483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.769 [2024-11-26 19:18:38.542609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.769 [2024-11-26 19:18:38.542619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.769 qpair failed and we were unable to recover it. 00:32:21.769 [2024-11-26 19:18:38.542766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.769 [2024-11-26 19:18:38.542899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.769 [2024-11-26 19:18:38.542910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.769 qpair failed and we were unable to recover it. 00:32:21.769 [2024-11-26 19:18:38.543053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.769 [2024-11-26 19:18:38.543214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.769 [2024-11-26 19:18:38.543224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.769 qpair failed and we were unable to recover it. 00:32:21.769 [2024-11-26 19:18:38.543371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.769 [2024-11-26 19:18:38.543454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.769 [2024-11-26 19:18:38.543468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.769 qpair failed and we were unable to recover it. 00:32:21.769 [2024-11-26 19:18:38.543698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.769 [2024-11-26 19:18:38.543754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.769 [2024-11-26 19:18:38.543764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.769 qpair failed and we were unable to recover it. 00:32:21.769 [2024-11-26 19:18:38.543841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.769 [2024-11-26 19:18:38.543901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.769 [2024-11-26 19:18:38.543912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.769 qpair failed and we were unable to recover it. 00:32:21.769 [2024-11-26 19:18:38.544001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.769 [2024-11-26 19:18:38.544127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.769 [2024-11-26 19:18:38.544137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.769 qpair failed and we were unable to recover it. 00:32:21.769 [2024-11-26 19:18:38.544278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.769 [2024-11-26 19:18:38.544472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.769 [2024-11-26 19:18:38.544482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.769 qpair failed and we were unable to recover it. 00:32:21.769 [2024-11-26 19:18:38.544560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.769 [2024-11-26 19:18:38.544701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.769 [2024-11-26 19:18:38.544712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.769 qpair failed and we were unable to recover it. 00:32:21.769 [2024-11-26 19:18:38.544941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.769 [2024-11-26 19:18:38.545014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.769 [2024-11-26 19:18:38.545025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.769 qpair failed and we were unable to recover it. 00:32:21.769 [2024-11-26 19:18:38.545255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.769 [2024-11-26 19:18:38.545399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.769 [2024-11-26 19:18:38.545409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.769 qpair failed and we were unable to recover it. 00:32:21.769 [2024-11-26 19:18:38.545478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.769 [2024-11-26 19:18:38.545554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.769 [2024-11-26 19:18:38.545565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.769 qpair failed and we were unable to recover it. 00:32:21.769 [2024-11-26 19:18:38.545640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.769 [2024-11-26 19:18:38.545786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.769 [2024-11-26 19:18:38.545797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.769 qpair failed and we were unable to recover it. 00:32:21.769 [2024-11-26 19:18:38.545870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.769 [2024-11-26 19:18:38.546087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.769 [2024-11-26 19:18:38.546098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.769 qpair failed and we were unable to recover it. 00:32:21.769 [2024-11-26 19:18:38.546156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.769 [2024-11-26 19:18:38.546292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.769 [2024-11-26 19:18:38.546302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.769 qpair failed and we were unable to recover it. 00:32:21.769 [2024-11-26 19:18:38.546439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.769 [2024-11-26 19:18:38.546521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.769 [2024-11-26 19:18:38.546530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.769 qpair failed and we were unable to recover it. 00:32:21.769 [2024-11-26 19:18:38.546661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.769 [2024-11-26 19:18:38.546743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.769 [2024-11-26 19:18:38.546753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.769 qpair failed and we were unable to recover it. 00:32:21.769 [2024-11-26 19:18:38.546832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.769 [2024-11-26 19:18:38.546959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.769 [2024-11-26 19:18:38.546970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.769 qpair failed and we were unable to recover it. 00:32:21.769 [2024-11-26 19:18:38.547057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.769 [2024-11-26 19:18:38.547184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.769 [2024-11-26 19:18:38.547194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.769 qpair failed and we were unable to recover it. 00:32:21.769 [2024-11-26 19:18:38.547277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.769 [2024-11-26 19:18:38.547345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.769 [2024-11-26 19:18:38.547355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.769 qpair failed and we were unable to recover it. 00:32:21.769 [2024-11-26 19:18:38.547512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.769 [2024-11-26 19:18:38.547591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.769 [2024-11-26 19:18:38.547601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.770 qpair failed and we were unable to recover it. 00:32:21.770 [2024-11-26 19:18:38.547730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.770 [2024-11-26 19:18:38.547852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.770 [2024-11-26 19:18:38.547863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.770 qpair failed and we were unable to recover it. 00:32:21.770 [2024-11-26 19:18:38.547942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.770 [2024-11-26 19:18:38.548018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.770 [2024-11-26 19:18:38.548029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.770 qpair failed and we were unable to recover it. 00:32:21.770 [2024-11-26 19:18:38.548171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.770 [2024-11-26 19:18:38.548304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.770 [2024-11-26 19:18:38.548314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.770 qpair failed and we were unable to recover it. 00:32:21.770 [2024-11-26 19:18:38.548441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.770 [2024-11-26 19:18:38.548633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.770 [2024-11-26 19:18:38.548643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.770 qpair failed and we were unable to recover it. 00:32:21.770 [2024-11-26 19:18:38.548723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.770 [2024-11-26 19:18:38.548862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.770 [2024-11-26 19:18:38.548873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.770 qpair failed and we were unable to recover it. 00:32:21.770 [2024-11-26 19:18:38.549008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.770 [2024-11-26 19:18:38.549183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.770 [2024-11-26 19:18:38.549193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.770 qpair failed and we were unable to recover it. 00:32:21.770 [2024-11-26 19:18:38.549321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.770 [2024-11-26 19:18:38.549463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.770 [2024-11-26 19:18:38.549473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.770 qpair failed and we were unable to recover it. 00:32:21.770 [2024-11-26 19:18:38.549536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.770 [2024-11-26 19:18:38.549660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.770 [2024-11-26 19:18:38.549670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.770 qpair failed and we were unable to recover it. 00:32:21.770 [2024-11-26 19:18:38.549737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.770 [2024-11-26 19:18:38.549822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.770 [2024-11-26 19:18:38.549832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.770 qpair failed and we were unable to recover it. 00:32:21.770 [2024-11-26 19:18:38.549912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.770 [2024-11-26 19:18:38.549987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.770 [2024-11-26 19:18:38.549998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.770 qpair failed and we were unable to recover it. 00:32:21.770 [2024-11-26 19:18:38.550137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.770 [2024-11-26 19:18:38.550263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.770 [2024-11-26 19:18:38.550272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.770 qpair failed and we were unable to recover it. 00:32:21.770 [2024-11-26 19:18:38.550357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.770 [2024-11-26 19:18:38.550505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.770 [2024-11-26 19:18:38.550515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.770 qpair failed and we were unable to recover it. 00:32:21.770 [2024-11-26 19:18:38.550605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.770 [2024-11-26 19:18:38.550727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.770 [2024-11-26 19:18:38.550738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.770 qpair failed and we were unable to recover it. 00:32:21.770 [2024-11-26 19:18:38.550879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.770 [2024-11-26 19:18:38.550962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.770 [2024-11-26 19:18:38.550973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.770 qpair failed and we were unable to recover it. 00:32:21.770 [2024-11-26 19:18:38.551030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.770 [2024-11-26 19:18:38.551155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.770 [2024-11-26 19:18:38.551165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.770 qpair failed and we were unable to recover it. 00:32:21.770 [2024-11-26 19:18:38.551291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.770 [2024-11-26 19:18:38.551360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.770 [2024-11-26 19:18:38.551370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.770 qpair failed and we were unable to recover it. 00:32:21.770 [2024-11-26 19:18:38.551609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.770 [2024-11-26 19:18:38.551689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.770 [2024-11-26 19:18:38.551699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.770 qpair failed and we were unable to recover it. 00:32:21.770 [2024-11-26 19:18:38.551844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.770 [2024-11-26 19:18:38.552010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.770 [2024-11-26 19:18:38.552021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.770 qpair failed and we were unable to recover it. 00:32:21.770 [2024-11-26 19:18:38.552165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.770 [2024-11-26 19:18:38.552238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.770 [2024-11-26 19:18:38.552248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.770 qpair failed and we were unable to recover it. 00:32:21.770 [2024-11-26 19:18:38.552331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.770 [2024-11-26 19:18:38.552420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.770 [2024-11-26 19:18:38.552430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.770 qpair failed and we were unable to recover it. 00:32:21.770 [2024-11-26 19:18:38.552647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.770 [2024-11-26 19:18:38.552723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.770 [2024-11-26 19:18:38.552732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.770 qpair failed and we were unable to recover it. 00:32:21.770 [2024-11-26 19:18:38.552794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.770 [2024-11-26 19:18:38.552945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.771 [2024-11-26 19:18:38.552957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.771 qpair failed and we were unable to recover it. 00:32:21.771 [2024-11-26 19:18:38.553036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.771 [2024-11-26 19:18:38.553244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.771 [2024-11-26 19:18:38.553253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.771 qpair failed and we were unable to recover it. 00:32:21.771 [2024-11-26 19:18:38.553356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.771 [2024-11-26 19:18:38.553494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.771 [2024-11-26 19:18:38.553503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.771 qpair failed and we were unable to recover it. 00:32:21.771 [2024-11-26 19:18:38.553703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.771 [2024-11-26 19:18:38.553861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.771 [2024-11-26 19:18:38.553871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.771 qpair failed and we were unable to recover it. 00:32:21.771 [2024-11-26 19:18:38.553997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.771 [2024-11-26 19:18:38.554131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.771 [2024-11-26 19:18:38.554141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.771 qpair failed and we were unable to recover it. 00:32:21.771 [2024-11-26 19:18:38.554331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.771 [2024-11-26 19:18:38.554467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.771 [2024-11-26 19:18:38.554476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.771 qpair failed and we were unable to recover it. 00:32:21.771 [2024-11-26 19:18:38.554606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.771 [2024-11-26 19:18:38.554664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.771 [2024-11-26 19:18:38.554674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.771 qpair failed and we were unable to recover it. 00:32:21.771 [2024-11-26 19:18:38.554751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.771 [2024-11-26 19:18:38.554812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.771 [2024-11-26 19:18:38.554821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.771 qpair failed and we were unable to recover it. 00:32:21.771 [2024-11-26 19:18:38.554973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.771 [2024-11-26 19:18:38.555123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.771 [2024-11-26 19:18:38.555133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.771 qpair failed and we were unable to recover it. 00:32:21.771 [2024-11-26 19:18:38.555202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.771 [2024-11-26 19:18:38.555287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.771 [2024-11-26 19:18:38.555297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.771 qpair failed and we were unable to recover it. 00:32:21.771 [2024-11-26 19:18:38.555387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.771 [2024-11-26 19:18:38.555549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.771 [2024-11-26 19:18:38.555558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.771 qpair failed and we were unable to recover it. 00:32:21.771 [2024-11-26 19:18:38.555652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.771 [2024-11-26 19:18:38.555732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.771 [2024-11-26 19:18:38.555742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.771 qpair failed and we were unable to recover it. 00:32:21.771 [2024-11-26 19:18:38.555880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.771 [2024-11-26 19:18:38.555955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.771 [2024-11-26 19:18:38.555965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.771 qpair failed and we were unable to recover it. 00:32:21.771 [2024-11-26 19:18:38.556022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.771 [2024-11-26 19:18:38.556100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.771 [2024-11-26 19:18:38.556109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.771 qpair failed and we were unable to recover it. 00:32:21.771 [2024-11-26 19:18:38.556237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.771 [2024-11-26 19:18:38.556354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.771 [2024-11-26 19:18:38.556364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.771 qpair failed and we were unable to recover it. 00:32:21.771 [2024-11-26 19:18:38.556496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.771 [2024-11-26 19:18:38.556708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.771 [2024-11-26 19:18:38.556718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.771 qpair failed and we were unable to recover it. 00:32:21.771 [2024-11-26 19:18:38.556785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.771 [2024-11-26 19:18:38.556860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.771 [2024-11-26 19:18:38.556870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.771 qpair failed and we were unable to recover it. 00:32:21.771 [2024-11-26 19:18:38.556939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.771 [2024-11-26 19:18:38.557077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.771 [2024-11-26 19:18:38.557087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.771 qpair failed and we were unable to recover it. 00:32:21.771 [2024-11-26 19:18:38.557177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.771 [2024-11-26 19:18:38.557318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.771 [2024-11-26 19:18:38.557328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.771 qpair failed and we were unable to recover it. 00:32:21.771 [2024-11-26 19:18:38.557398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.771 [2024-11-26 19:18:38.557537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.771 [2024-11-26 19:18:38.557546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.771 qpair failed and we were unable to recover it. 00:32:21.771 [2024-11-26 19:18:38.557609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.771 [2024-11-26 19:18:38.557677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.771 [2024-11-26 19:18:38.557687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.771 qpair failed and we were unable to recover it. 00:32:21.771 [2024-11-26 19:18:38.557773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.772 [2024-11-26 19:18:38.557935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.772 [2024-11-26 19:18:38.557945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.772 qpair failed and we were unable to recover it. 00:32:21.772 [2024-11-26 19:18:38.558085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.772 [2024-11-26 19:18:38.558254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.772 [2024-11-26 19:18:38.558264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.772 qpair failed and we were unable to recover it. 00:32:21.772 [2024-11-26 19:18:38.558396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.772 [2024-11-26 19:18:38.558559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.772 [2024-11-26 19:18:38.558569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.772 qpair failed and we were unable to recover it. 00:32:21.772 [2024-11-26 19:18:38.558861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.772 [2024-11-26 19:18:38.559089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.772 [2024-11-26 19:18:38.559100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.772 qpair failed and we were unable to recover it. 00:32:21.772 [2024-11-26 19:18:38.559242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.772 [2024-11-26 19:18:38.559382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.772 [2024-11-26 19:18:38.559391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.772 qpair failed and we were unable to recover it. 00:32:21.772 [2024-11-26 19:18:38.559584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.772 [2024-11-26 19:18:38.559805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.772 [2024-11-26 19:18:38.559815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.772 qpair failed and we were unable to recover it. 00:32:21.772 [2024-11-26 19:18:38.559941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.772 [2024-11-26 19:18:38.560166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.772 [2024-11-26 19:18:38.560175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.772 qpair failed and we were unable to recover it. 00:32:21.772 [2024-11-26 19:18:38.560263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.772 [2024-11-26 19:18:38.560397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.772 [2024-11-26 19:18:38.560407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.772 qpair failed and we were unable to recover it. 00:32:21.772 [2024-11-26 19:18:38.560625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.772 [2024-11-26 19:18:38.560774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.772 [2024-11-26 19:18:38.560784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.772 qpair failed and we were unable to recover it. 00:32:21.772 [2024-11-26 19:18:38.561009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.772 [2024-11-26 19:18:38.561249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.772 [2024-11-26 19:18:38.561259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.772 qpair failed and we were unable to recover it. 00:32:21.772 [2024-11-26 19:18:38.561513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.772 [2024-11-26 19:18:38.561664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.772 [2024-11-26 19:18:38.561673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.772 qpair failed and we were unable to recover it. 00:32:21.772 [2024-11-26 19:18:38.561923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.772 [2024-11-26 19:18:38.562064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.772 [2024-11-26 19:18:38.562074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.772 qpair failed and we were unable to recover it. 00:32:21.772 [2024-11-26 19:18:38.562217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.772 [2024-11-26 19:18:38.562433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.772 [2024-11-26 19:18:38.562443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.772 qpair failed and we were unable to recover it. 00:32:21.772 [2024-11-26 19:18:38.562570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.772 [2024-11-26 19:18:38.562717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.772 [2024-11-26 19:18:38.562726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.772 qpair failed and we were unable to recover it. 00:32:21.772 [2024-11-26 19:18:38.562869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.772 [2024-11-26 19:18:38.563084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.772 [2024-11-26 19:18:38.563094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.772 qpair failed and we were unable to recover it. 00:32:21.772 [2024-11-26 19:18:38.563333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.772 [2024-11-26 19:18:38.563593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.772 [2024-11-26 19:18:38.563603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.772 qpair failed and we were unable to recover it. 00:32:21.772 [2024-11-26 19:18:38.563831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.772 [2024-11-26 19:18:38.564070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.772 [2024-11-26 19:18:38.564080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.772 qpair failed and we were unable to recover it. 00:32:21.772 [2024-11-26 19:18:38.564329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.772 [2024-11-26 19:18:38.564563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.772 [2024-11-26 19:18:38.564573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.772 qpair failed and we were unable to recover it. 00:32:21.772 [2024-11-26 19:18:38.564728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.772 [2024-11-26 19:18:38.564927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.772 [2024-11-26 19:18:38.564937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.772 qpair failed and we were unable to recover it. 00:32:21.772 [2024-11-26 19:18:38.565182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.772 [2024-11-26 19:18:38.565320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.772 [2024-11-26 19:18:38.565329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.772 qpair failed and we were unable to recover it. 00:32:21.772 [2024-11-26 19:18:38.565518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.772 [2024-11-26 19:18:38.565676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.772 [2024-11-26 19:18:38.565686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.772 qpair failed and we were unable to recover it. 00:32:21.772 [2024-11-26 19:18:38.565848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.772 [2024-11-26 19:18:38.565997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.773 [2024-11-26 19:18:38.566007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.773 qpair failed and we were unable to recover it. 00:32:21.773 [2024-11-26 19:18:38.566145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.773 [2024-11-26 19:18:38.566204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.773 [2024-11-26 19:18:38.566213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.773 qpair failed and we were unable to recover it. 00:32:21.773 [2024-11-26 19:18:38.566412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.773 [2024-11-26 19:18:38.566585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.773 [2024-11-26 19:18:38.566595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.773 qpair failed and we were unable to recover it. 00:32:21.773 [2024-11-26 19:18:38.566778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.773 [2024-11-26 19:18:38.566908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.773 [2024-11-26 19:18:38.566917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.773 qpair failed and we were unable to recover it. 00:32:21.773 [2024-11-26 19:18:38.567057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.773 [2024-11-26 19:18:38.567196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.773 [2024-11-26 19:18:38.567206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.773 qpair failed and we were unable to recover it. 00:32:21.773 [2024-11-26 19:18:38.567348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.773 [2024-11-26 19:18:38.567562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.773 [2024-11-26 19:18:38.567572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.773 qpair failed and we were unable to recover it. 00:32:21.773 [2024-11-26 19:18:38.567819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.773 [2024-11-26 19:18:38.568036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.773 [2024-11-26 19:18:38.568046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.773 qpair failed and we were unable to recover it. 00:32:21.773 [2024-11-26 19:18:38.568240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.773 [2024-11-26 19:18:38.568446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.773 [2024-11-26 19:18:38.568455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.773 qpair failed and we were unable to recover it. 00:32:21.773 [2024-11-26 19:18:38.568677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.773 [2024-11-26 19:18:38.568907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.773 [2024-11-26 19:18:38.568917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.773 qpair failed and we were unable to recover it. 00:32:21.773 [2024-11-26 19:18:38.569181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.773 [2024-11-26 19:18:38.569399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.773 [2024-11-26 19:18:38.569409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.773 qpair failed and we were unable to recover it. 00:32:21.773 [2024-11-26 19:18:38.569553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.773 [2024-11-26 19:18:38.569744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.773 [2024-11-26 19:18:38.569754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.773 qpair failed and we were unable to recover it. 00:32:21.773 [2024-11-26 19:18:38.569975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.773 [2024-11-26 19:18:38.570189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.773 [2024-11-26 19:18:38.570198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.773 qpair failed and we were unable to recover it. 00:32:21.773 [2024-11-26 19:18:38.570289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.773 [2024-11-26 19:18:38.570431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.773 [2024-11-26 19:18:38.570441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.773 qpair failed and we were unable to recover it. 00:32:21.773 [2024-11-26 19:18:38.570611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.773 [2024-11-26 19:18:38.570802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.773 [2024-11-26 19:18:38.570812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.773 qpair failed and we were unable to recover it. 00:32:21.773 [2024-11-26 19:18:38.570955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.773 [2024-11-26 19:18:38.571081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.773 [2024-11-26 19:18:38.571090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.773 qpair failed and we were unable to recover it. 00:32:21.773 [2024-11-26 19:18:38.571233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.773 [2024-11-26 19:18:38.571475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.773 [2024-11-26 19:18:38.571485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.773 qpair failed and we were unable to recover it. 00:32:21.773 [2024-11-26 19:18:38.571636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.773 [2024-11-26 19:18:38.571826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.773 [2024-11-26 19:18:38.571836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.773 qpair failed and we were unable to recover it. 00:32:21.773 [2024-11-26 19:18:38.571993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.773 [2024-11-26 19:18:38.572186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.773 [2024-11-26 19:18:38.572195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.773 qpair failed and we were unable to recover it. 00:32:21.773 [2024-11-26 19:18:38.572410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.773 [2024-11-26 19:18:38.572620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.773 [2024-11-26 19:18:38.572629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.773 qpair failed and we were unable to recover it. 00:32:21.773 [2024-11-26 19:18:38.572822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.773 [2024-11-26 19:18:38.572985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.773 [2024-11-26 19:18:38.572995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.773 qpair failed and we were unable to recover it. 00:32:21.773 [2024-11-26 19:18:38.573079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.773 [2024-11-26 19:18:38.573217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.773 [2024-11-26 19:18:38.573227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.773 qpair failed and we were unable to recover it. 00:32:21.773 [2024-11-26 19:18:38.573315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.773 [2024-11-26 19:18:38.573477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.773 [2024-11-26 19:18:38.573487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.773 qpair failed and we were unable to recover it. 00:32:21.773 [2024-11-26 19:18:38.573737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.773 [2024-11-26 19:18:38.573881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.773 [2024-11-26 19:18:38.573890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.774 qpair failed and we were unable to recover it. 00:32:21.774 [2024-11-26 19:18:38.574105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.774 [2024-11-26 19:18:38.574254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.774 [2024-11-26 19:18:38.574264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.774 qpair failed and we were unable to recover it. 00:32:21.774 [2024-11-26 19:18:38.574476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.774 [2024-11-26 19:18:38.574626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.774 [2024-11-26 19:18:38.574636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.774 qpair failed and we were unable to recover it. 00:32:21.774 [2024-11-26 19:18:38.574781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.774 [2024-11-26 19:18:38.574923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.774 [2024-11-26 19:18:38.574932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.774 qpair failed and we were unable to recover it. 00:32:21.774 [2024-11-26 19:18:38.575082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.774 [2024-11-26 19:18:38.575212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.774 [2024-11-26 19:18:38.575222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.774 qpair failed and we were unable to recover it. 00:32:21.774 [2024-11-26 19:18:38.575381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.774 [2024-11-26 19:18:38.575505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.774 [2024-11-26 19:18:38.575515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.774 qpair failed and we were unable to recover it. 00:32:21.774 [2024-11-26 19:18:38.575666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.774 [2024-11-26 19:18:38.575881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.774 [2024-11-26 19:18:38.575890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.774 qpair failed and we were unable to recover it. 00:32:21.774 [2024-11-26 19:18:38.576027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.774 [2024-11-26 19:18:38.576250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.774 [2024-11-26 19:18:38.576260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.774 qpair failed and we were unable to recover it. 00:32:21.774 [2024-11-26 19:18:38.576352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.774 [2024-11-26 19:18:38.576569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.774 [2024-11-26 19:18:38.576579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.774 qpair failed and we were unable to recover it. 00:32:21.774 [2024-11-26 19:18:38.576709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.774 [2024-11-26 19:18:38.576851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.774 [2024-11-26 19:18:38.576860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.774 qpair failed and we were unable to recover it. 00:32:21.774 [2024-11-26 19:18:38.577085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.774 [2024-11-26 19:18:38.577220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.774 [2024-11-26 19:18:38.577230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.774 qpair failed and we were unable to recover it. 00:32:21.774 [2024-11-26 19:18:38.577397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.774 [2024-11-26 19:18:38.577609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.774 [2024-11-26 19:18:38.577619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.774 qpair failed and we were unable to recover it. 00:32:21.774 [2024-11-26 19:18:38.577760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.774 [2024-11-26 19:18:38.578008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.774 [2024-11-26 19:18:38.578019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.774 qpair failed and we were unable to recover it. 00:32:21.774 [2024-11-26 19:18:38.578165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.774 [2024-11-26 19:18:38.578326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.774 [2024-11-26 19:18:38.578336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.774 qpair failed and we were unable to recover it. 00:32:21.774 [2024-11-26 19:18:38.578470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.774 [2024-11-26 19:18:38.578703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.774 [2024-11-26 19:18:38.578713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.774 qpair failed and we were unable to recover it. 00:32:21.774 [2024-11-26 19:18:38.578854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.774 [2024-11-26 19:18:38.579045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.774 [2024-11-26 19:18:38.579055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.774 qpair failed and we were unable to recover it. 00:32:21.774 [2024-11-26 19:18:38.579216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.774 [2024-11-26 19:18:38.579344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.774 [2024-11-26 19:18:38.579355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.774 qpair failed and we were unable to recover it. 00:32:21.774 [2024-11-26 19:18:38.579497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.774 [2024-11-26 19:18:38.579631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.774 [2024-11-26 19:18:38.579643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.774 qpair failed and we were unable to recover it. 00:32:21.774 [2024-11-26 19:18:38.579844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.774 [2024-11-26 19:18:38.579984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.774 [2024-11-26 19:18:38.579994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.775 qpair failed and we were unable to recover it. 00:32:21.775 [2024-11-26 19:18:38.580228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.775 [2024-11-26 19:18:38.580382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.775 [2024-11-26 19:18:38.580392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.775 qpair failed and we were unable to recover it. 00:32:21.775 [2024-11-26 19:18:38.580606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.775 [2024-11-26 19:18:38.580736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.775 [2024-11-26 19:18:38.580746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.775 qpair failed and we were unable to recover it. 00:32:21.775 [2024-11-26 19:18:38.580889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.775 [2024-11-26 19:18:38.581017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.775 [2024-11-26 19:18:38.581026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.775 qpair failed and we were unable to recover it. 00:32:21.775 [2024-11-26 19:18:38.581192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.775 [2024-11-26 19:18:38.581334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.775 [2024-11-26 19:18:38.581344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.775 qpair failed and we were unable to recover it. 00:32:21.775 [2024-11-26 19:18:38.581587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.775 [2024-11-26 19:18:38.581800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.775 [2024-11-26 19:18:38.581809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.775 qpair failed and we were unable to recover it. 00:32:21.775 [2024-11-26 19:18:38.582057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.775 [2024-11-26 19:18:38.582203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.775 [2024-11-26 19:18:38.582212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.775 qpair failed and we were unable to recover it. 00:32:21.775 [2024-11-26 19:18:38.582373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.775 [2024-11-26 19:18:38.582536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.775 [2024-11-26 19:18:38.582546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.775 qpair failed and we were unable to recover it. 00:32:21.775 [2024-11-26 19:18:38.582813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.775 [2024-11-26 19:18:38.582949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.775 [2024-11-26 19:18:38.582959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.775 qpair failed and we were unable to recover it. 00:32:21.775 [2024-11-26 19:18:38.583113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.775 [2024-11-26 19:18:38.583330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.775 [2024-11-26 19:18:38.583342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.775 qpair failed and we were unable to recover it. 00:32:21.775 [2024-11-26 19:18:38.583498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.775 [2024-11-26 19:18:38.583697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.775 [2024-11-26 19:18:38.583706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.775 qpair failed and we were unable to recover it. 00:32:21.775 [2024-11-26 19:18:38.583870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.775 [2024-11-26 19:18:38.584088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.775 [2024-11-26 19:18:38.584099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.775 qpair failed and we were unable to recover it. 00:32:21.775 [2024-11-26 19:18:38.584293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.775 [2024-11-26 19:18:38.584495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.775 [2024-11-26 19:18:38.584505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.775 qpair failed and we were unable to recover it. 00:32:21.775 [2024-11-26 19:18:38.584668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.775 [2024-11-26 19:18:38.584911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.775 [2024-11-26 19:18:38.584921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.775 qpair failed and we were unable to recover it. 00:32:21.775 19:18:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:32:21.775 [2024-11-26 19:18:38.585140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.775 [2024-11-26 19:18:38.585313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.775 [2024-11-26 19:18:38.585322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.775 qpair failed and we were unable to recover it. 00:32:21.775 19:18:38 -- common/autotest_common.sh@862 -- # return 0 00:32:21.775 [2024-11-26 19:18:38.585537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.775 [2024-11-26 19:18:38.585754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.775 [2024-11-26 19:18:38.585764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.775 qpair failed and we were unable to recover it. 00:32:21.775 19:18:38 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:32:21.775 [2024-11-26 19:18:38.585984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.775 19:18:38 -- common/autotest_common.sh@728 -- # xtrace_disable 00:32:21.775 [2024-11-26 19:18:38.586159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.775 [2024-11-26 19:18:38.586170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.775 qpair failed and we were unable to recover it. 00:32:21.775 19:18:38 -- common/autotest_common.sh@10 -- # set +x 00:32:21.775 [2024-11-26 19:18:38.586385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.775 [2024-11-26 19:18:38.586464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.775 [2024-11-26 19:18:38.586473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.775 qpair failed and we were unable to recover it. 00:32:21.775 [2024-11-26 19:18:38.586723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.775 [2024-11-26 19:18:38.586819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.775 [2024-11-26 19:18:38.586829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.775 qpair failed and we were unable to recover it. 00:32:21.775 [2024-11-26 19:18:38.587059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.775 [2024-11-26 19:18:38.587226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.775 [2024-11-26 19:18:38.587237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.775 qpair failed and we were unable to recover it. 00:32:21.775 [2024-11-26 19:18:38.587399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.775 [2024-11-26 19:18:38.587616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.775 [2024-11-26 19:18:38.587626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.775 qpair failed and we were unable to recover it. 00:32:21.775 [2024-11-26 19:18:38.587808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.776 [2024-11-26 19:18:38.588030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.776 [2024-11-26 19:18:38.588040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.776 qpair failed and we were unable to recover it. 00:32:21.776 [2024-11-26 19:18:38.588241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.776 [2024-11-26 19:18:38.588323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.776 [2024-11-26 19:18:38.588332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.776 qpair failed and we were unable to recover it. 00:32:21.776 [2024-11-26 19:18:38.588541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.776 [2024-11-26 19:18:38.588765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.776 [2024-11-26 19:18:38.588774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.776 qpair failed and we were unable to recover it. 00:32:21.776 [2024-11-26 19:18:38.588850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.776 [2024-11-26 19:18:38.589063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.776 [2024-11-26 19:18:38.589073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.776 qpair failed and we were unable to recover it. 00:32:21.776 [2024-11-26 19:18:38.589279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.776 [2024-11-26 19:18:38.589500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.776 [2024-11-26 19:18:38.589511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.776 qpair failed and we were unable to recover it. 00:32:21.776 [2024-11-26 19:18:38.589600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.776 [2024-11-26 19:18:38.589816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.776 [2024-11-26 19:18:38.589826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.776 qpair failed and we were unable to recover it. 00:32:21.776 [2024-11-26 19:18:38.589963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.776 [2024-11-26 19:18:38.590196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.776 [2024-11-26 19:18:38.590207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.776 qpair failed and we were unable to recover it. 00:32:21.776 [2024-11-26 19:18:38.590337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.776 [2024-11-26 19:18:38.590494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.776 [2024-11-26 19:18:38.590504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.776 qpair failed and we were unable to recover it. 00:32:21.776 [2024-11-26 19:18:38.590715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.776 [2024-11-26 19:18:38.590961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.776 [2024-11-26 19:18:38.590971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.776 qpair failed and we were unable to recover it. 00:32:21.776 [2024-11-26 19:18:38.591060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.776 [2024-11-26 19:18:38.591228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.776 [2024-11-26 19:18:38.591238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.776 qpair failed and we were unable to recover it. 00:32:21.776 [2024-11-26 19:18:38.591455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.776 [2024-11-26 19:18:38.591683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.776 [2024-11-26 19:18:38.591693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.776 qpair failed and we were unable to recover it. 00:32:21.776 [2024-11-26 19:18:38.591918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.776 [2024-11-26 19:18:38.592055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.776 [2024-11-26 19:18:38.592066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.776 qpair failed and we were unable to recover it. 00:32:21.776 [2024-11-26 19:18:38.592229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.776 [2024-11-26 19:18:38.592473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.776 [2024-11-26 19:18:38.592483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.776 qpair failed and we were unable to recover it. 00:32:21.776 [2024-11-26 19:18:38.592614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.776 [2024-11-26 19:18:38.592804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.776 [2024-11-26 19:18:38.592814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.776 qpair failed and we were unable to recover it. 00:32:21.776 [2024-11-26 19:18:38.592980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.776 [2024-11-26 19:18:38.593235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.776 [2024-11-26 19:18:38.593246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.776 qpair failed and we were unable to recover it. 00:32:21.776 [2024-11-26 19:18:38.593411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.776 [2024-11-26 19:18:38.593629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.776 [2024-11-26 19:18:38.593639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.776 qpair failed and we were unable to recover it. 00:32:21.776 [2024-11-26 19:18:38.593854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.776 [2024-11-26 19:18:38.594044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.776 [2024-11-26 19:18:38.594055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.776 qpair failed and we were unable to recover it. 00:32:21.776 [2024-11-26 19:18:38.594261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.776 [2024-11-26 19:18:38.594422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.776 [2024-11-26 19:18:38.594432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.776 qpair failed and we were unable to recover it. 00:32:21.776 [2024-11-26 19:18:38.594571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.776 [2024-11-26 19:18:38.594795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.776 [2024-11-26 19:18:38.594805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.776 qpair failed and we were unable to recover it. 00:32:21.776 [2024-11-26 19:18:38.595013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.776 [2024-11-26 19:18:38.595254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.776 [2024-11-26 19:18:38.595264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.776 qpair failed and we were unable to recover it. 00:32:21.776 [2024-11-26 19:18:38.595499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.776 [2024-11-26 19:18:38.595753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.776 [2024-11-26 19:18:38.595762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.776 qpair failed and we were unable to recover it. 00:32:21.776 [2024-11-26 19:18:38.595924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.776 [2024-11-26 19:18:38.596013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.776 [2024-11-26 19:18:38.596024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.776 qpair failed and we were unable to recover it. 00:32:21.776 [2024-11-26 19:18:38.596175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.776 [2024-11-26 19:18:38.596323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.776 [2024-11-26 19:18:38.596332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.776 qpair failed and we were unable to recover it. 00:32:21.776 [2024-11-26 19:18:38.596429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.776 [2024-11-26 19:18:38.596515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.776 [2024-11-26 19:18:38.596524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.776 qpair failed and we were unable to recover it. 00:32:21.776 [2024-11-26 19:18:38.596670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.776 [2024-11-26 19:18:38.596827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.776 [2024-11-26 19:18:38.596836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.776 qpair failed and we were unable to recover it. 00:32:21.776 [2024-11-26 19:18:38.596921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.776 [2024-11-26 19:18:38.597143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.776 [2024-11-26 19:18:38.597154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.776 qpair failed and we were unable to recover it. 00:32:21.776 [2024-11-26 19:18:38.597320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.776 [2024-11-26 19:18:38.597473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.776 [2024-11-26 19:18:38.597483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.776 qpair failed and we were unable to recover it. 00:32:21.776 [2024-11-26 19:18:38.597620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.776 [2024-11-26 19:18:38.597766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.776 [2024-11-26 19:18:38.597777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.776 qpair failed and we were unable to recover it. 00:32:21.776 [2024-11-26 19:18:38.597950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.776 [2024-11-26 19:18:38.598116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.776 [2024-11-26 19:18:38.598126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.776 qpair failed and we were unable to recover it. 00:32:21.777 [2024-11-26 19:18:38.598272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.777 [2024-11-26 19:18:38.598409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.777 [2024-11-26 19:18:38.598418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.777 qpair failed and we were unable to recover it. 00:32:21.777 [2024-11-26 19:18:38.598576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.777 [2024-11-26 19:18:38.598654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.777 [2024-11-26 19:18:38.598664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.777 qpair failed and we were unable to recover it. 00:32:21.777 [2024-11-26 19:18:38.598722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.777 [2024-11-26 19:18:38.598924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.777 [2024-11-26 19:18:38.598935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.777 qpair failed and we were unable to recover it. 00:32:21.777 [2024-11-26 19:18:38.599032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.777 [2024-11-26 19:18:38.599202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.777 [2024-11-26 19:18:38.599212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.777 qpair failed and we were unable to recover it. 00:32:21.777 [2024-11-26 19:18:38.599371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.777 [2024-11-26 19:18:38.599449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.777 [2024-11-26 19:18:38.599458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.777 qpair failed and we were unable to recover it. 00:32:21.777 [2024-11-26 19:18:38.599668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.777 [2024-11-26 19:18:38.599831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.777 [2024-11-26 19:18:38.599840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.777 qpair failed and we were unable to recover it. 00:32:21.777 [2024-11-26 19:18:38.600033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.777 [2024-11-26 19:18:38.600253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.777 [2024-11-26 19:18:38.600264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.777 qpair failed and we were unable to recover it. 00:32:21.777 [2024-11-26 19:18:38.600349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.777 [2024-11-26 19:18:38.600482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.777 [2024-11-26 19:18:38.600492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.777 qpair failed and we were unable to recover it. 00:32:21.777 [2024-11-26 19:18:38.600624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.777 [2024-11-26 19:18:38.600846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.777 [2024-11-26 19:18:38.600857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.777 qpair failed and we were unable to recover it. 00:32:21.777 [2024-11-26 19:18:38.601078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.777 [2024-11-26 19:18:38.601307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.777 [2024-11-26 19:18:38.601316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.777 qpair failed and we were unable to recover it. 00:32:21.777 [2024-11-26 19:18:38.601408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.777 [2024-11-26 19:18:38.601603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.777 [2024-11-26 19:18:38.601613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.777 qpair failed and we were unable to recover it. 00:32:21.777 [2024-11-26 19:18:38.601756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.777 [2024-11-26 19:18:38.601992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.777 [2024-11-26 19:18:38.602003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.777 qpair failed and we were unable to recover it. 00:32:21.777 [2024-11-26 19:18:38.602080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.777 [2024-11-26 19:18:38.602275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.777 [2024-11-26 19:18:38.602285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.777 qpair failed and we were unable to recover it. 00:32:21.777 [2024-11-26 19:18:38.602517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.777 [2024-11-26 19:18:38.602663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.777 [2024-11-26 19:18:38.602673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.777 qpair failed and we were unable to recover it. 00:32:21.777 [2024-11-26 19:18:38.602802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.777 [2024-11-26 19:18:38.603000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.777 [2024-11-26 19:18:38.603011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.777 qpair failed and we were unable to recover it. 00:32:21.777 [2024-11-26 19:18:38.603101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.777 [2024-11-26 19:18:38.603275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.777 [2024-11-26 19:18:38.603285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.777 qpair failed and we were unable to recover it. 00:32:21.777 [2024-11-26 19:18:38.603539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.777 [2024-11-26 19:18:38.603784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.777 [2024-11-26 19:18:38.603794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.777 qpair failed and we were unable to recover it. 00:32:21.777 [2024-11-26 19:18:38.603991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.777 [2024-11-26 19:18:38.604133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.777 [2024-11-26 19:18:38.604142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.777 qpair failed and we were unable to recover it. 00:32:21.777 [2024-11-26 19:18:38.604236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.777 [2024-11-26 19:18:38.604337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.777 [2024-11-26 19:18:38.604347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.777 qpair failed and we were unable to recover it. 00:32:21.777 [2024-11-26 19:18:38.604497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.777 [2024-11-26 19:18:38.604679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.777 [2024-11-26 19:18:38.604690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.777 qpair failed and we were unable to recover it. 00:32:21.777 [2024-11-26 19:18:38.604936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.777 [2024-11-26 19:18:38.605129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.777 [2024-11-26 19:18:38.605139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.777 qpair failed and we were unable to recover it. 00:32:21.777 [2024-11-26 19:18:38.605339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.777 [2024-11-26 19:18:38.605499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.777 [2024-11-26 19:18:38.605509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.777 qpair failed and we were unable to recover it. 00:32:21.777 [2024-11-26 19:18:38.605702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.777 [2024-11-26 19:18:38.605840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.777 [2024-11-26 19:18:38.605849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.777 qpair failed and we were unable to recover it. 00:32:21.777 [2024-11-26 19:18:38.606070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.777 [2024-11-26 19:18:38.606201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.777 [2024-11-26 19:18:38.606212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.777 qpair failed and we were unable to recover it. 00:32:21.777 [2024-11-26 19:18:38.606358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.777 [2024-11-26 19:18:38.606441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.777 [2024-11-26 19:18:38.606451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.777 qpair failed and we were unable to recover it. 00:32:21.777 [2024-11-26 19:18:38.606548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.777 [2024-11-26 19:18:38.606701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.777 [2024-11-26 19:18:38.606712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.777 qpair failed and we were unable to recover it. 00:32:21.777 [2024-11-26 19:18:38.606916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.777 [2024-11-26 19:18:38.607058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.777 [2024-11-26 19:18:38.607069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.777 qpair failed and we were unable to recover it. 00:32:21.777 [2024-11-26 19:18:38.607206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.777 [2024-11-26 19:18:38.607288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.777 [2024-11-26 19:18:38.607298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.777 qpair failed and we were unable to recover it. 00:32:21.777 [2024-11-26 19:18:38.607493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.777 [2024-11-26 19:18:38.607568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.777 [2024-11-26 19:18:38.607577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.777 qpair failed and we were unable to recover it. 00:32:21.777 [2024-11-26 19:18:38.607664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.777 [2024-11-26 19:18:38.607814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.777 [2024-11-26 19:18:38.607825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.777 qpair failed and we were unable to recover it. 00:32:21.777 [2024-11-26 19:18:38.607915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.777 [2024-11-26 19:18:38.608116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.777 [2024-11-26 19:18:38.608126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.777 qpair failed and we were unable to recover it. 00:32:21.778 [2024-11-26 19:18:38.608208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.778 [2024-11-26 19:18:38.608384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.778 [2024-11-26 19:18:38.608394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.778 qpair failed and we were unable to recover it. 00:32:21.778 [2024-11-26 19:18:38.608476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.778 [2024-11-26 19:18:38.608545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.778 [2024-11-26 19:18:38.608555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.778 qpair failed and we were unable to recover it. 00:32:21.778 [2024-11-26 19:18:38.608770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.778 [2024-11-26 19:18:38.608914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.778 [2024-11-26 19:18:38.608924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.778 qpair failed and we were unable to recover it. 00:32:21.778 [2024-11-26 19:18:38.609096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.778 [2024-11-26 19:18:38.609258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.778 [2024-11-26 19:18:38.609267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.778 qpair failed and we were unable to recover it. 00:32:21.778 [2024-11-26 19:18:38.609422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.778 [2024-11-26 19:18:38.609636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.778 [2024-11-26 19:18:38.609646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.778 qpair failed and we were unable to recover it. 00:32:21.778 [2024-11-26 19:18:38.609737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.778 [2024-11-26 19:18:38.609977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.778 [2024-11-26 19:18:38.609988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.778 qpair failed and we were unable to recover it. 00:32:21.778 [2024-11-26 19:18:38.610135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.778 [2024-11-26 19:18:38.610277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.778 [2024-11-26 19:18:38.610287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.778 qpair failed and we were unable to recover it. 00:32:21.778 [2024-11-26 19:18:38.610374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.778 [2024-11-26 19:18:38.610517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.778 [2024-11-26 19:18:38.610526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.778 qpair failed and we were unable to recover it. 00:32:21.778 [2024-11-26 19:18:38.610770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.778 [2024-11-26 19:18:38.611002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.778 [2024-11-26 19:18:38.611012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.778 qpair failed and we were unable to recover it. 00:32:21.778 [2024-11-26 19:18:38.611180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.778 [2024-11-26 19:18:38.611371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.778 [2024-11-26 19:18:38.611382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.778 qpair failed and we were unable to recover it. 00:32:21.778 [2024-11-26 19:18:38.611537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.778 [2024-11-26 19:18:38.611731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.778 [2024-11-26 19:18:38.611741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.778 qpair failed and we were unable to recover it. 00:32:21.778 [2024-11-26 19:18:38.611892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.778 [2024-11-26 19:18:38.612069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.778 [2024-11-26 19:18:38.612080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.778 qpair failed and we were unable to recover it. 00:32:21.778 [2024-11-26 19:18:38.612231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.778 [2024-11-26 19:18:38.612398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.778 [2024-11-26 19:18:38.612408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.778 qpair failed and we were unable to recover it. 00:32:21.778 [2024-11-26 19:18:38.612541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.778 [2024-11-26 19:18:38.612725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.778 [2024-11-26 19:18:38.612736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.778 qpair failed and we were unable to recover it. 00:32:21.778 [2024-11-26 19:18:38.612827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.778 [2024-11-26 19:18:38.612902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.778 [2024-11-26 19:18:38.612913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.778 qpair failed and we were unable to recover it. 00:32:21.778 [2024-11-26 19:18:38.613042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.778 [2024-11-26 19:18:38.613234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.778 [2024-11-26 19:18:38.613244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.778 qpair failed and we were unable to recover it. 00:32:21.778 [2024-11-26 19:18:38.613464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.778 [2024-11-26 19:18:38.613525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.778 [2024-11-26 19:18:38.613535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.778 qpair failed and we were unable to recover it. 00:32:21.778 [2024-11-26 19:18:38.613782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.778 [2024-11-26 19:18:38.613979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.778 [2024-11-26 19:18:38.613988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.778 qpair failed and we were unable to recover it. 00:32:21.778 [2024-11-26 19:18:38.614140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.778 [2024-11-26 19:18:38.614216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.778 [2024-11-26 19:18:38.614227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.778 qpair failed and we were unable to recover it. 00:32:21.778 [2024-11-26 19:18:38.614395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.778 [2024-11-26 19:18:38.614471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.778 [2024-11-26 19:18:38.614481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.778 qpair failed and we were unable to recover it. 00:32:21.778 [2024-11-26 19:18:38.614728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.778 [2024-11-26 19:18:38.614866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.778 [2024-11-26 19:18:38.614875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.778 qpair failed and we were unable to recover it. 00:32:21.778 [2024-11-26 19:18:38.615018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.778 [2024-11-26 19:18:38.615212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.778 [2024-11-26 19:18:38.615222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.778 qpair failed and we were unable to recover it. 00:32:21.778 [2024-11-26 19:18:38.615468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.778 [2024-11-26 19:18:38.615701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.778 [2024-11-26 19:18:38.615710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.778 qpair failed and we were unable to recover it. 00:32:21.778 [2024-11-26 19:18:38.615919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.778 [2024-11-26 19:18:38.615979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.778 [2024-11-26 19:18:38.615989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.778 qpair failed and we were unable to recover it. 00:32:21.778 [2024-11-26 19:18:38.616138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.778 [2024-11-26 19:18:38.616273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.778 [2024-11-26 19:18:38.616283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.778 qpair failed and we were unable to recover it. 00:32:21.778 [2024-11-26 19:18:38.616480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.778 [2024-11-26 19:18:38.616660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.778 [2024-11-26 19:18:38.616670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.778 qpair failed and we were unable to recover it. 00:32:21.778 [2024-11-26 19:18:38.616812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.778 [2024-11-26 19:18:38.616985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.778 [2024-11-26 19:18:38.616996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.778 qpair failed and we were unable to recover it. 00:32:21.778 [2024-11-26 19:18:38.617126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.778 [2024-11-26 19:18:38.617395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.778 [2024-11-26 19:18:38.617405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.778 qpair failed and we were unable to recover it. 00:32:21.779 [2024-11-26 19:18:38.617650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.779 [2024-11-26 19:18:38.617791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.779 [2024-11-26 19:18:38.617803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.779 qpair failed and we were unable to recover it. 00:32:21.779 [2024-11-26 19:18:38.618010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.779 [2024-11-26 19:18:38.618179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.779 [2024-11-26 19:18:38.618191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.779 qpair failed and we were unable to recover it. 00:32:21.779 [2024-11-26 19:18:38.618290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.779 [2024-11-26 19:18:38.618378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.779 [2024-11-26 19:18:38.618387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.779 qpair failed and we were unable to recover it. 00:32:21.779 [2024-11-26 19:18:38.618482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.779 [2024-11-26 19:18:38.618698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.779 [2024-11-26 19:18:38.618708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.779 qpair failed and we were unable to recover it. 00:32:21.779 [2024-11-26 19:18:38.618839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.779 [2024-11-26 19:18:38.618994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.779 [2024-11-26 19:18:38.619003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.779 qpair failed and we were unable to recover it. 00:32:21.779 [2024-11-26 19:18:38.619087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.779 [2024-11-26 19:18:38.619164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.779 [2024-11-26 19:18:38.619174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.779 qpair failed and we were unable to recover it. 00:32:21.779 [2024-11-26 19:18:38.619272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.779 [2024-11-26 19:18:38.619347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.779 [2024-11-26 19:18:38.619357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.779 qpair failed and we were unable to recover it. 00:32:21.779 [2024-11-26 19:18:38.619450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.779 [2024-11-26 19:18:38.619534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.779 [2024-11-26 19:18:38.619544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.779 qpair failed and we were unable to recover it. 00:32:21.779 [2024-11-26 19:18:38.619701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.779 [2024-11-26 19:18:38.619859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.779 [2024-11-26 19:18:38.619868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.779 qpair failed and we were unable to recover it. 00:32:21.779 [2024-11-26 19:18:38.620021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.779 [2024-11-26 19:18:38.620173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.779 [2024-11-26 19:18:38.620182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.779 qpair failed and we were unable to recover it. 00:32:21.779 [2024-11-26 19:18:38.620400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.779 [2024-11-26 19:18:38.620482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.779 [2024-11-26 19:18:38.620496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.779 qpair failed and we were unable to recover it. 00:32:21.779 [2024-11-26 19:18:38.620715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.779 [2024-11-26 19:18:38.620851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.779 [2024-11-26 19:18:38.620862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.779 qpair failed and we were unable to recover it. 00:32:21.779 [2024-11-26 19:18:38.621086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.779 [2024-11-26 19:18:38.621185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.779 [2024-11-26 19:18:38.621195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.779 qpair failed and we were unable to recover it. 00:32:21.779 [2024-11-26 19:18:38.621335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.779 [2024-11-26 19:18:38.621505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.779 [2024-11-26 19:18:38.621518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.779 qpair failed and we were unable to recover it. 00:32:21.779 19:18:38 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:32:21.779 [2024-11-26 19:18:38.621725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.779 [2024-11-26 19:18:38.621863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.779 [2024-11-26 19:18:38.621873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.779 qpair failed and we were unable to recover it. 00:32:21.779 19:18:38 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:32:21.779 [2024-11-26 19:18:38.622044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.779 [2024-11-26 19:18:38.622191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.779 [2024-11-26 19:18:38.622200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.779 qpair failed and we were unable to recover it. 00:32:21.779 [2024-11-26 19:18:38.622347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.779 19:18:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:21.779 [2024-11-26 19:18:38.622519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.779 [2024-11-26 19:18:38.622530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.779 qpair failed and we were unable to recover it. 00:32:21.779 [2024-11-26 19:18:38.622628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.779 19:18:38 -- common/autotest_common.sh@10 -- # set +x 00:32:21.779 [2024-11-26 19:18:38.622817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.779 [2024-11-26 19:18:38.622828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.779 qpair failed and we were unable to recover it. 00:32:21.779 [2024-11-26 19:18:38.622965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.779 [2024-11-26 19:18:38.623077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.779 [2024-11-26 19:18:38.623086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.779 qpair failed and we were unable to recover it. 00:32:21.779 [2024-11-26 19:18:38.623162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.779 [2024-11-26 19:18:38.623309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.779 [2024-11-26 19:18:38.623319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.779 qpair failed and we were unable to recover it. 00:32:21.779 [2024-11-26 19:18:38.623471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.779 [2024-11-26 19:18:38.623704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.779 [2024-11-26 19:18:38.623714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.779 qpair failed and we were unable to recover it. 00:32:21.779 [2024-11-26 19:18:38.623798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.779 [2024-11-26 19:18:38.623939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.779 [2024-11-26 19:18:38.623952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.779 qpair failed and we were unable to recover it. 00:32:21.779 [2024-11-26 19:18:38.624054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.779 [2024-11-26 19:18:38.624202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.779 [2024-11-26 19:18:38.624212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.779 qpair failed and we were unable to recover it. 00:32:21.779 [2024-11-26 19:18:38.624420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.779 [2024-11-26 19:18:38.624637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.779 [2024-11-26 19:18:38.624648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.779 qpair failed and we were unable to recover it. 00:32:21.779 [2024-11-26 19:18:38.624869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.779 [2024-11-26 19:18:38.625095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.779 [2024-11-26 19:18:38.625105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.779 qpair failed and we were unable to recover it. 00:32:21.779 [2024-11-26 19:18:38.625254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.779 [2024-11-26 19:18:38.625393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.779 [2024-11-26 19:18:38.625403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.779 qpair failed and we were unable to recover it. 00:32:21.779 [2024-11-26 19:18:38.625612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.779 [2024-11-26 19:18:38.625735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.779 [2024-11-26 19:18:38.625744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.779 qpair failed and we were unable to recover it. 00:32:21.779 [2024-11-26 19:18:38.626000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.779 [2024-11-26 19:18:38.626147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.779 [2024-11-26 19:18:38.626156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.779 qpair failed and we were unable to recover it. 00:32:21.779 [2024-11-26 19:18:38.626312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.779 [2024-11-26 19:18:38.626456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.779 [2024-11-26 19:18:38.626466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.779 qpair failed and we were unable to recover it. 00:32:21.779 [2024-11-26 19:18:38.626697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.779 [2024-11-26 19:18:38.626886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.779 [2024-11-26 19:18:38.626895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.779 qpair failed and we were unable to recover it. 00:32:21.779 [2024-11-26 19:18:38.627083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.779 [2024-11-26 19:18:38.627232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.780 [2024-11-26 19:18:38.627241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.780 qpair failed and we were unable to recover it. 00:32:21.780 [2024-11-26 19:18:38.627401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.780 [2024-11-26 19:18:38.627547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.780 [2024-11-26 19:18:38.627557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.780 qpair failed and we were unable to recover it. 00:32:21.780 [2024-11-26 19:18:38.627792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.780 [2024-11-26 19:18:38.628003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.780 [2024-11-26 19:18:38.628013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.780 qpair failed and we were unable to recover it. 00:32:21.780 [2024-11-26 19:18:38.628161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.780 [2024-11-26 19:18:38.628251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.780 [2024-11-26 19:18:38.628260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.780 qpair failed and we were unable to recover it. 00:32:21.780 [2024-11-26 19:18:38.628346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.780 [2024-11-26 19:18:38.628515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.780 [2024-11-26 19:18:38.628525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.780 qpair failed and we were unable to recover it. 00:32:21.780 [2024-11-26 19:18:38.628702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.780 [2024-11-26 19:18:38.628846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.780 [2024-11-26 19:18:38.628856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.780 qpair failed and we were unable to recover it. 00:32:21.780 [2024-11-26 19:18:38.628996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.780 [2024-11-26 19:18:38.629144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.780 [2024-11-26 19:18:38.629154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.780 qpair failed and we were unable to recover it. 00:32:21.780 [2024-11-26 19:18:38.629361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.780 [2024-11-26 19:18:38.629579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.780 [2024-11-26 19:18:38.629588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.780 qpair failed and we were unable to recover it. 00:32:21.780 [2024-11-26 19:18:38.629721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.780 [2024-11-26 19:18:38.629936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.780 [2024-11-26 19:18:38.629945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.780 qpair failed and we were unable to recover it. 00:32:21.780 [2024-11-26 19:18:38.630127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.780 [2024-11-26 19:18:38.630222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.780 [2024-11-26 19:18:38.630232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.780 qpair failed and we were unable to recover it. 00:32:21.780 [2024-11-26 19:18:38.630381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.780 [2024-11-26 19:18:38.630471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.780 [2024-11-26 19:18:38.630481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.780 qpair failed and we were unable to recover it. 00:32:21.780 [2024-11-26 19:18:38.630559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.780 [2024-11-26 19:18:38.630691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.780 [2024-11-26 19:18:38.630701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.780 qpair failed and we were unable to recover it. 00:32:21.780 [2024-11-26 19:18:38.630779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.780 [2024-11-26 19:18:38.630916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.780 [2024-11-26 19:18:38.630926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.780 qpair failed and we were unable to recover it. 00:32:21.780 [2024-11-26 19:18:38.631068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.780 [2024-11-26 19:18:38.631265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.780 [2024-11-26 19:18:38.631275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.780 qpair failed and we were unable to recover it. 00:32:21.780 [2024-11-26 19:18:38.631356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.780 [2024-11-26 19:18:38.631503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.780 [2024-11-26 19:18:38.631513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.780 qpair failed and we were unable to recover it. 00:32:21.780 [2024-11-26 19:18:38.631588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.780 [2024-11-26 19:18:38.631758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.780 [2024-11-26 19:18:38.631768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.780 qpair failed and we were unable to recover it. 00:32:21.780 [2024-11-26 19:18:38.631934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.780 [2024-11-26 19:18:38.632120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.780 [2024-11-26 19:18:38.632130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.780 qpair failed and we were unable to recover it. 00:32:21.780 [2024-11-26 19:18:38.632374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.780 [2024-11-26 19:18:38.632523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.780 [2024-11-26 19:18:38.632533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.780 qpair failed and we were unable to recover it. 00:32:21.780 [2024-11-26 19:18:38.632672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.780 [2024-11-26 19:18:38.632888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.780 [2024-11-26 19:18:38.632898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.780 qpair failed and we were unable to recover it. 00:32:21.780 [2024-11-26 19:18:38.633102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.780 [2024-11-26 19:18:38.633308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.780 [2024-11-26 19:18:38.633319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.780 qpair failed and we were unable to recover it. 00:32:21.780 [2024-11-26 19:18:38.633543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.780 [2024-11-26 19:18:38.633759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.780 [2024-11-26 19:18:38.633769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.780 qpair failed and we were unable to recover it. 00:32:21.780 [2024-11-26 19:18:38.633860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.780 [2024-11-26 19:18:38.634064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.780 [2024-11-26 19:18:38.634075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.780 qpair failed and we were unable to recover it. 00:32:21.780 [2024-11-26 19:18:38.634203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.780 [2024-11-26 19:18:38.634329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.780 [2024-11-26 19:18:38.634340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.780 qpair failed and we were unable to recover it. 00:32:21.780 [2024-11-26 19:18:38.634437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.780 [2024-11-26 19:18:38.634598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.780 [2024-11-26 19:18:38.634609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.780 qpair failed and we were unable to recover it. 00:32:21.780 [2024-11-26 19:18:38.634758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.780 [2024-11-26 19:18:38.634911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.780 [2024-11-26 19:18:38.634922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.780 qpair failed and we were unable to recover it. 00:32:21.780 [2024-11-26 19:18:38.635170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.780 [2024-11-26 19:18:38.635252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.780 [2024-11-26 19:18:38.635263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.780 qpair failed and we were unable to recover it. 00:32:21.780 [2024-11-26 19:18:38.635410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.780 [2024-11-26 19:18:38.635566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.780 [2024-11-26 19:18:38.635577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.780 qpair failed and we were unable to recover it. 00:32:21.780 [2024-11-26 19:18:38.635821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.780 [2024-11-26 19:18:38.635960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.780 [2024-11-26 19:18:38.635971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.780 qpair failed and we were unable to recover it. 00:32:21.780 [2024-11-26 19:18:38.636054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.780 [2024-11-26 19:18:38.636194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.780 [2024-11-26 19:18:38.636204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.780 qpair failed and we were unable to recover it. 00:32:21.780 [2024-11-26 19:18:38.636352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.780 [2024-11-26 19:18:38.636423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.780 [2024-11-26 19:18:38.636433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.780 qpair failed and we were unable to recover it. 00:32:21.780 [2024-11-26 19:18:38.636510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.780 [2024-11-26 19:18:38.636728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.780 [2024-11-26 19:18:38.636739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.780 qpair failed and we were unable to recover it. 00:32:21.780 [2024-11-26 19:18:38.636938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.780 [2024-11-26 19:18:38.637091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.780 [2024-11-26 19:18:38.637102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.780 qpair failed and we were unable to recover it. 00:32:21.780 [2024-11-26 19:18:38.637348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.780 [2024-11-26 19:18:38.637527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.780 [2024-11-26 19:18:38.637538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.781 qpair failed and we were unable to recover it. 00:32:21.781 [2024-11-26 19:18:38.637785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.781 [2024-11-26 19:18:38.637990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.781 [2024-11-26 19:18:38.638001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.781 qpair failed and we were unable to recover it. 00:32:21.781 [2024-11-26 19:18:38.638095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.781 [2024-11-26 19:18:38.638313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.781 [2024-11-26 19:18:38.638324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.781 qpair failed and we were unable to recover it. 00:32:21.781 [2024-11-26 19:18:38.638542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.781 [2024-11-26 19:18:38.638678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.781 [2024-11-26 19:18:38.638687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.781 qpair failed and we were unable to recover it. 00:32:21.781 [2024-11-26 19:18:38.638891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.781 [2024-11-26 19:18:38.639103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.781 [2024-11-26 19:18:38.639114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.781 qpair failed and we were unable to recover it. 00:32:21.781 [2024-11-26 19:18:38.639195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.781 [2024-11-26 19:18:38.639358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.781 [2024-11-26 19:18:38.639368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.781 qpair failed and we were unable to recover it. 00:32:21.781 [2024-11-26 19:18:38.639502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.781 [2024-11-26 19:18:38.639686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:21.781 [2024-11-26 19:18:38.639697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:21.781 qpair failed and we were unable to recover it. 00:32:21.781 [2024-11-26 19:18:38.639847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.043 [2024-11-26 19:18:38.640088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.043 [2024-11-26 19:18:38.640099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.043 qpair failed and we were unable to recover it. 00:32:22.043 [2024-11-26 19:18:38.640316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.043 [2024-11-26 19:18:38.640413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.043 [2024-11-26 19:18:38.640423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.043 qpair failed and we were unable to recover it. 00:32:22.043 [2024-11-26 19:18:38.640620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.043 [2024-11-26 19:18:38.640758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.043 [2024-11-26 19:18:38.640768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.043 qpair failed and we were unable to recover it. 00:32:22.043 [2024-11-26 19:18:38.640908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.043 [2024-11-26 19:18:38.641044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.043 [2024-11-26 19:18:38.641054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.043 qpair failed and we were unable to recover it. 00:32:22.043 Malloc0 00:32:22.043 [2024-11-26 19:18:38.641276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.043 [2024-11-26 19:18:38.641446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.043 [2024-11-26 19:18:38.641456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.043 qpair failed and we were unable to recover it. 00:32:22.043 [2024-11-26 19:18:38.641674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.043 19:18:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:22.043 [2024-11-26 19:18:38.641834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.043 [2024-11-26 19:18:38.641847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.043 qpair failed and we were unable to recover it. 00:32:22.043 [2024-11-26 19:18:38.641994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.043 [2024-11-26 19:18:38.642188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.043 [2024-11-26 19:18:38.642198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.043 qpair failed and we were unable to recover it. 00:32:22.043 19:18:38 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:32:22.043 [2024-11-26 19:18:38.642290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.043 [2024-11-26 19:18:38.642533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.043 [2024-11-26 19:18:38.642543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.043 19:18:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:22.043 qpair failed and we were unable to recover it. 00:32:22.043 [2024-11-26 19:18:38.642766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.043 19:18:38 -- common/autotest_common.sh@10 -- # set +x 00:32:22.043 [2024-11-26 19:18:38.642968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.043 [2024-11-26 19:18:38.642979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.043 qpair failed and we were unable to recover it. 00:32:22.043 [2024-11-26 19:18:38.643072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.043 [2024-11-26 19:18:38.643207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.043 [2024-11-26 19:18:38.643216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.043 qpair failed and we were unable to recover it. 00:32:22.043 [2024-11-26 19:18:38.643355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.043 [2024-11-26 19:18:38.643549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.043 [2024-11-26 19:18:38.643561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.043 qpair failed and we were unable to recover it. 00:32:22.043 [2024-11-26 19:18:38.643721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.043 [2024-11-26 19:18:38.643933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.043 [2024-11-26 19:18:38.643942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.043 qpair failed and we were unable to recover it. 00:32:22.043 [2024-11-26 19:18:38.644143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.043 [2024-11-26 19:18:38.644297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.043 [2024-11-26 19:18:38.644306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.043 qpair failed and we were unable to recover it. 00:32:22.043 [2024-11-26 19:18:38.644449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.043 [2024-11-26 19:18:38.644606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.043 [2024-11-26 19:18:38.644616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.043 qpair failed and we were unable to recover it. 00:32:22.043 [2024-11-26 19:18:38.644761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.043 [2024-11-26 19:18:38.644908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.043 [2024-11-26 19:18:38.644918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.043 qpair failed and we were unable to recover it. 00:32:22.043 [2024-11-26 19:18:38.645116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.044 [2024-11-26 19:18:38.645255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.044 [2024-11-26 19:18:38.645264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.044 qpair failed and we were unable to recover it. 00:32:22.044 [2024-11-26 19:18:38.645418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.044 [2024-11-26 19:18:38.645563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.044 [2024-11-26 19:18:38.645572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.044 qpair failed and we were unable to recover it. 00:32:22.044 [2024-11-26 19:18:38.645796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.044 [2024-11-26 19:18:38.645931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.044 [2024-11-26 19:18:38.645941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.044 qpair failed and we were unable to recover it. 00:32:22.044 [2024-11-26 19:18:38.646189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.044 [2024-11-26 19:18:38.646328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.044 [2024-11-26 19:18:38.646339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.044 qpair failed and we were unable to recover it. 00:32:22.044 [2024-11-26 19:18:38.646581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.044 [2024-11-26 19:18:38.646785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.044 [2024-11-26 19:18:38.646795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.044 qpair failed and we were unable to recover it. 00:32:22.044 [2024-11-26 19:18:38.647041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.044 [2024-11-26 19:18:38.647199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.044 [2024-11-26 19:18:38.647211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.044 qpair failed and we were unable to recover it. 00:32:22.044 [2024-11-26 19:18:38.647284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.044 [2024-11-26 19:18:38.647494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.044 [2024-11-26 19:18:38.647503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.044 qpair failed and we were unable to recover it. 00:32:22.044 [2024-11-26 19:18:38.647579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.044 [2024-11-26 19:18:38.647662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.044 [2024-11-26 19:18:38.647671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.044 qpair failed and we were unable to recover it. 00:32:22.044 [2024-11-26 19:18:38.647868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.044 [2024-11-26 19:18:38.648012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.044 [2024-11-26 19:18:38.648023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.044 qpair failed and we were unable to recover it. 00:32:22.044 [2024-11-26 19:18:38.648153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.044 [2024-11-26 19:18:38.648329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.044 [2024-11-26 19:18:38.648338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.044 qpair failed and we were unable to recover it. 00:32:22.044 [2024-11-26 19:18:38.648468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.044 [2024-11-26 19:18:38.648689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.044 [2024-11-26 19:18:38.648699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.044 qpair failed and we were unable to recover it. 00:32:22.044 [2024-11-26 19:18:38.648708] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:32:22.044 [2024-11-26 19:18:38.648842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.044 [2024-11-26 19:18:38.649004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.044 [2024-11-26 19:18:38.649013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.044 qpair failed and we were unable to recover it. 00:32:22.044 [2024-11-26 19:18:38.649207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.044 [2024-11-26 19:18:38.649349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.044 [2024-11-26 19:18:38.649359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.044 qpair failed and we were unable to recover it. 00:32:22.044 [2024-11-26 19:18:38.649495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.044 [2024-11-26 19:18:38.649582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.044 [2024-11-26 19:18:38.649592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.044 qpair failed and we were unable to recover it. 00:32:22.044 [2024-11-26 19:18:38.649730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.044 [2024-11-26 19:18:38.649898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.044 [2024-11-26 19:18:38.649908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.044 qpair failed and we were unable to recover it. 00:32:22.044 [2024-11-26 19:18:38.649997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.044 [2024-11-26 19:18:38.650193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.044 [2024-11-26 19:18:38.650203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.044 qpair failed and we were unable to recover it. 00:32:22.044 [2024-11-26 19:18:38.650294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.044 [2024-11-26 19:18:38.650449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.044 [2024-11-26 19:18:38.650459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.044 qpair failed and we were unable to recover it. 00:32:22.044 [2024-11-26 19:18:38.650622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.044 [2024-11-26 19:18:38.650874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.044 [2024-11-26 19:18:38.650884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.044 qpair failed and we were unable to recover it. 00:32:22.044 [2024-11-26 19:18:38.651027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.044 [2024-11-26 19:18:38.651268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.044 [2024-11-26 19:18:38.651277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.044 qpair failed and we were unable to recover it. 00:32:22.044 [2024-11-26 19:18:38.651496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.044 [2024-11-26 19:18:38.651725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.044 [2024-11-26 19:18:38.651735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.044 qpair failed and we were unable to recover it. 00:32:22.044 [2024-11-26 19:18:38.651929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.044 [2024-11-26 19:18:38.652147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.044 [2024-11-26 19:18:38.652157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.044 qpair failed and we were unable to recover it. 00:32:22.044 [2024-11-26 19:18:38.652366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.044 [2024-11-26 19:18:38.652622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.044 [2024-11-26 19:18:38.652631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.044 qpair failed and we were unable to recover it. 00:32:22.044 [2024-11-26 19:18:38.652852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.044 [2024-11-26 19:18:38.652935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.044 [2024-11-26 19:18:38.652945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.044 qpair failed and we were unable to recover it. 00:32:22.044 [2024-11-26 19:18:38.653178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.045 [2024-11-26 19:18:38.653314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.045 [2024-11-26 19:18:38.653324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.045 qpair failed and we were unable to recover it. 00:32:22.045 [2024-11-26 19:18:38.653576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.045 [2024-11-26 19:18:38.653702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.045 [2024-11-26 19:18:38.653711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.045 qpair failed and we were unable to recover it. 00:32:22.045 [2024-11-26 19:18:38.653853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.045 [2024-11-26 19:18:38.654049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.045 [2024-11-26 19:18:38.654062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.045 qpair failed and we were unable to recover it. 00:32:22.045 [2024-11-26 19:18:38.654262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.045 [2024-11-26 19:18:38.654392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.045 [2024-11-26 19:18:38.654401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.045 qpair failed and we were unable to recover it. 00:32:22.045 [2024-11-26 19:18:38.654571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.045 [2024-11-26 19:18:38.654795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.045 [2024-11-26 19:18:38.654804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.045 qpair failed and we were unable to recover it. 00:32:22.045 [2024-11-26 19:18:38.655021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.045 [2024-11-26 19:18:38.655108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.045 [2024-11-26 19:18:38.655118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.045 qpair failed and we were unable to recover it. 00:32:22.045 [2024-11-26 19:18:38.655312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.045 [2024-11-26 19:18:38.655450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.045 [2024-11-26 19:18:38.655459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.045 qpair failed and we were unable to recover it. 00:32:22.045 [2024-11-26 19:18:38.655603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.045 [2024-11-26 19:18:38.655762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.045 [2024-11-26 19:18:38.655771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.045 qpair failed and we were unable to recover it. 00:32:22.045 [2024-11-26 19:18:38.655913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.045 [2024-11-26 19:18:38.656130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.045 [2024-11-26 19:18:38.656140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.045 qpair failed and we were unable to recover it. 00:32:22.045 [2024-11-26 19:18:38.656385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.045 [2024-11-26 19:18:38.656523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.045 [2024-11-26 19:18:38.656532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.045 qpair failed and we were unable to recover it. 00:32:22.045 [2024-11-26 19:18:38.656738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.045 [2024-11-26 19:18:38.656885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.045 [2024-11-26 19:18:38.656895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.045 qpair failed and we were unable to recover it. 00:32:22.045 [2024-11-26 19:18:38.657029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.045 [2024-11-26 19:18:38.657168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.045 [2024-11-26 19:18:38.657178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.045 qpair failed and we were unable to recover it. 00:32:22.045 [2024-11-26 19:18:38.657393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.045 19:18:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:22.045 [2024-11-26 19:18:38.657529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.045 [2024-11-26 19:18:38.657539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.045 qpair failed and we were unable to recover it. 00:32:22.045 [2024-11-26 19:18:38.657689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.045 19:18:38 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:32:22.045 [2024-11-26 19:18:38.657838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.045 [2024-11-26 19:18:38.657848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.045 qpair failed and we were unable to recover it. 00:32:22.045 [2024-11-26 19:18:38.658021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.045 19:18:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:22.045 [2024-11-26 19:18:38.658285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.045 [2024-11-26 19:18:38.658296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.045 qpair failed and we were unable to recover it. 00:32:22.045 19:18:38 -- common/autotest_common.sh@10 -- # set +x 00:32:22.045 [2024-11-26 19:18:38.658534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.045 [2024-11-26 19:18:38.658727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.045 [2024-11-26 19:18:38.658737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.045 qpair failed and we were unable to recover it. 00:32:22.045 [2024-11-26 19:18:38.658930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.045 [2024-11-26 19:18:38.659074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.045 [2024-11-26 19:18:38.659084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.045 qpair failed and we were unable to recover it. 00:32:22.045 [2024-11-26 19:18:38.659302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.045 [2024-11-26 19:18:38.659469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.045 [2024-11-26 19:18:38.659479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.045 qpair failed and we were unable to recover it. 00:32:22.045 [2024-11-26 19:18:38.659639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.045 [2024-11-26 19:18:38.659803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.045 [2024-11-26 19:18:38.659812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.045 qpair failed and we were unable to recover it. 00:32:22.045 [2024-11-26 19:18:38.659953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.045 [2024-11-26 19:18:38.660194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.045 [2024-11-26 19:18:38.660203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.045 qpair failed and we were unable to recover it. 00:32:22.045 [2024-11-26 19:18:38.660399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.045 [2024-11-26 19:18:38.660548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.045 [2024-11-26 19:18:38.660558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.046 qpair failed and we were unable to recover it. 00:32:22.046 [2024-11-26 19:18:38.660618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.046 [2024-11-26 19:18:38.660778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.046 [2024-11-26 19:18:38.660788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.046 qpair failed and we were unable to recover it. 00:32:22.046 [2024-11-26 19:18:38.660929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.046 [2024-11-26 19:18:38.661127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.046 [2024-11-26 19:18:38.661137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.046 qpair failed and we were unable to recover it. 00:32:22.046 [2024-11-26 19:18:38.661280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.046 [2024-11-26 19:18:38.661452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.046 [2024-11-26 19:18:38.661462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.046 qpair failed and we were unable to recover it. 00:32:22.046 [2024-11-26 19:18:38.661616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.046 [2024-11-26 19:18:38.661806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.046 [2024-11-26 19:18:38.661816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.046 qpair failed and we were unable to recover it. 00:32:22.046 [2024-11-26 19:18:38.661990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.046 [2024-11-26 19:18:38.662144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.046 [2024-11-26 19:18:38.662153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.046 qpair failed and we were unable to recover it. 00:32:22.046 [2024-11-26 19:18:38.662371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.046 [2024-11-26 19:18:38.662509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.046 [2024-11-26 19:18:38.662519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.046 qpair failed and we were unable to recover it. 00:32:22.046 [2024-11-26 19:18:38.662719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.046 [2024-11-26 19:18:38.662846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.046 [2024-11-26 19:18:38.662855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.046 qpair failed and we were unable to recover it. 00:32:22.046 [2024-11-26 19:18:38.663100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.046 [2024-11-26 19:18:38.663343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.046 [2024-11-26 19:18:38.663353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.046 qpair failed and we were unable to recover it. 00:32:22.046 [2024-11-26 19:18:38.663552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.046 [2024-11-26 19:18:38.663678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.046 [2024-11-26 19:18:38.663687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.046 qpair failed and we were unable to recover it. 00:32:22.046 [2024-11-26 19:18:38.663831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.046 [2024-11-26 19:18:38.663969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.046 [2024-11-26 19:18:38.663979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.046 qpair failed and we were unable to recover it. 00:32:22.046 [2024-11-26 19:18:38.664119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.046 [2024-11-26 19:18:38.664309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.046 [2024-11-26 19:18:38.664319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.046 qpair failed and we were unable to recover it. 00:32:22.046 [2024-11-26 19:18:38.664484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.046 [2024-11-26 19:18:38.664617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.046 [2024-11-26 19:18:38.664626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.046 qpair failed and we were unable to recover it. 00:32:22.046 [2024-11-26 19:18:38.664765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.046 [2024-11-26 19:18:38.664839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.046 [2024-11-26 19:18:38.664848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.046 qpair failed and we were unable to recover it. 00:32:22.046 [2024-11-26 19:18:38.664976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.046 [2024-11-26 19:18:38.665113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.046 [2024-11-26 19:18:38.665123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.046 qpair failed and we were unable to recover it. 00:32:22.046 [2024-11-26 19:18:38.665279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.046 19:18:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:22.046 [2024-11-26 19:18:38.665456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.046 [2024-11-26 19:18:38.665466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.046 qpair failed and we were unable to recover it. 00:32:22.046 [2024-11-26 19:18:38.665661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.046 19:18:38 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:32:22.046 [2024-11-26 19:18:38.665878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.046 [2024-11-26 19:18:38.665888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.046 qpair failed and we were unable to recover it. 00:32:22.046 [2024-11-26 19:18:38.666058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.046 19:18:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:22.046 [2024-11-26 19:18:38.666217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.046 [2024-11-26 19:18:38.666227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.046 qpair failed and we were unable to recover it. 00:32:22.046 [2024-11-26 19:18:38.666367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.046 19:18:38 -- common/autotest_common.sh@10 -- # set +x 00:32:22.046 [2024-11-26 19:18:38.666524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.046 [2024-11-26 19:18:38.666534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.046 qpair failed and we were unable to recover it. 00:32:22.046 [2024-11-26 19:18:38.666701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.046 [2024-11-26 19:18:38.666907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.046 [2024-11-26 19:18:38.666917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.046 qpair failed and we were unable to recover it. 00:32:22.046 [2024-11-26 19:18:38.667151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.046 [2024-11-26 19:18:38.667353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.046 [2024-11-26 19:18:38.667363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.046 qpair failed and we were unable to recover it. 00:32:22.046 [2024-11-26 19:18:38.667578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.046 [2024-11-26 19:18:38.667708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.046 [2024-11-26 19:18:38.667717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.046 qpair failed and we were unable to recover it. 00:32:22.046 [2024-11-26 19:18:38.667866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.046 [2024-11-26 19:18:38.668057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.046 [2024-11-26 19:18:38.668067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.047 qpair failed and we were unable to recover it. 00:32:22.047 [2024-11-26 19:18:38.668281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.047 [2024-11-26 19:18:38.668474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.047 [2024-11-26 19:18:38.668483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.047 qpair failed and we were unable to recover it. 00:32:22.047 [2024-11-26 19:18:38.668690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.047 [2024-11-26 19:18:38.668938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.047 [2024-11-26 19:18:38.668950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.047 qpair failed and we were unable to recover it. 00:32:22.047 [2024-11-26 19:18:38.669168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.047 [2024-11-26 19:18:38.669313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.047 [2024-11-26 19:18:38.669323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.047 qpair failed and we were unable to recover it. 00:32:22.047 [2024-11-26 19:18:38.669556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.047 [2024-11-26 19:18:38.669716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.047 [2024-11-26 19:18:38.669725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.047 qpair failed and we were unable to recover it. 00:32:22.047 [2024-11-26 19:18:38.669961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.047 [2024-11-26 19:18:38.670182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.047 [2024-11-26 19:18:38.670191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.047 qpair failed and we were unable to recover it. 00:32:22.047 [2024-11-26 19:18:38.670396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.047 [2024-11-26 19:18:38.670479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.047 [2024-11-26 19:18:38.670489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.047 qpair failed and we were unable to recover it. 00:32:22.047 [2024-11-26 19:18:38.670623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.047 [2024-11-26 19:18:38.670818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.047 [2024-11-26 19:18:38.670827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.047 qpair failed and we were unable to recover it. 00:32:22.047 [2024-11-26 19:18:38.670968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.047 [2024-11-26 19:18:38.671115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.047 [2024-11-26 19:18:38.671124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.047 qpair failed and we were unable to recover it. 00:32:22.047 [2024-11-26 19:18:38.671343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.047 [2024-11-26 19:18:38.671563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.047 [2024-11-26 19:18:38.671572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.047 qpair failed and we were unable to recover it. 00:32:22.047 [2024-11-26 19:18:38.671713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.047 [2024-11-26 19:18:38.671889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.047 [2024-11-26 19:18:38.671898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.047 qpair failed and we were unable to recover it. 00:32:22.047 [2024-11-26 19:18:38.672025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.047 [2024-11-26 19:18:38.672172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.047 [2024-11-26 19:18:38.672181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.047 qpair failed and we were unable to recover it. 00:32:22.047 [2024-11-26 19:18:38.672410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.047 [2024-11-26 19:18:38.672565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.047 [2024-11-26 19:18:38.672574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.047 qpair failed and we were unable to recover it. 00:32:22.047 [2024-11-26 19:18:38.672799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.047 [2024-11-26 19:18:38.672944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.047 [2024-11-26 19:18:38.672961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.047 qpair failed and we were unable to recover it. 00:32:22.047 [2024-11-26 19:18:38.673190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.047 [2024-11-26 19:18:38.673422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.047 [2024-11-26 19:18:38.673432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.047 qpair failed and we were unable to recover it. 00:32:22.047 19:18:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:22.047 [2024-11-26 19:18:38.673693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.047 19:18:38 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:32:22.047 [2024-11-26 19:18:38.673853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.047 [2024-11-26 19:18:38.673864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.047 qpair failed and we were unable to recover it. 00:32:22.047 [2024-11-26 19:18:38.674073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.047 19:18:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:22.047 [2024-11-26 19:18:38.674291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.047 [2024-11-26 19:18:38.674301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.047 qpair failed and we were unable to recover it. 00:32:22.047 [2024-11-26 19:18:38.674442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.047 19:18:38 -- common/autotest_common.sh@10 -- # set +x 00:32:22.047 [2024-11-26 19:18:38.674669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.047 [2024-11-26 19:18:38.674680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.047 qpair failed and we were unable to recover it. 00:32:22.047 [2024-11-26 19:18:38.674890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.047 [2024-11-26 19:18:38.675029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.047 [2024-11-26 19:18:38.675042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.047 qpair failed and we were unable to recover it. 00:32:22.047 [2024-11-26 19:18:38.675247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.047 [2024-11-26 19:18:38.675460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.047 [2024-11-26 19:18:38.675470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.047 qpair failed and we were unable to recover it. 00:32:22.047 [2024-11-26 19:18:38.675598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.047 [2024-11-26 19:18:38.675840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.047 [2024-11-26 19:18:38.675849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.047 qpair failed and we were unable to recover it. 00:32:22.047 [2024-11-26 19:18:38.676088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.047 [2024-11-26 19:18:38.676308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.047 [2024-11-26 19:18:38.676318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.047 qpair failed and we were unable to recover it. 00:32:22.047 [2024-11-26 19:18:38.676535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.047 [2024-11-26 19:18:38.676701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.047 [2024-11-26 19:18:38.676710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f76d8000b90 with addr=10.0.0.2, port=4420 00:32:22.047 qpair failed and we were unable to recover it. 00:32:22.047 [2024-11-26 19:18:38.676852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:32:22.048 [2024-11-26 19:18:38.676958] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:22.048 [2024-11-26 19:18:38.679068] posix.c: 670:posix_sock_psk_use_session_client_cb: *ERROR*: PSK is not set 00:32:22.048 [2024-11-26 19:18:38.679107] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7f76d8000b90 (107): Transport endpoint is not connected 00:32:22.048 [2024-11-26 19:18:38.679151] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.048 qpair failed and we were unable to recover it. 00:32:22.048 19:18:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:22.048 19:18:38 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:32:22.048 19:18:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:22.048 19:18:38 -- common/autotest_common.sh@10 -- # set +x 00:32:22.048 [2024-11-26 19:18:38.689239] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.048 [2024-11-26 19:18:38.689312] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.048 [2024-11-26 19:18:38.689334] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.048 [2024-11-26 19:18:38.689342] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.048 [2024-11-26 19:18:38.689348] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.048 [2024-11-26 19:18:38.689366] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.048 qpair failed and we were unable to recover it. 00:32:22.048 19:18:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:22.048 19:18:38 -- host/target_disconnect.sh@58 -- # wait 3301133 00:32:22.048 [2024-11-26 19:18:38.699283] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.048 [2024-11-26 19:18:38.699387] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.048 [2024-11-26 19:18:38.699405] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.048 [2024-11-26 19:18:38.699413] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.048 [2024-11-26 19:18:38.699419] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.048 [2024-11-26 19:18:38.699436] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.048 qpair failed and we were unable to recover it. 00:32:22.048 [2024-11-26 19:18:38.709239] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.048 [2024-11-26 19:18:38.709305] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.048 [2024-11-26 19:18:38.709319] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.048 [2024-11-26 19:18:38.709327] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.048 [2024-11-26 19:18:38.709334] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.048 [2024-11-26 19:18:38.709349] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.048 qpair failed and we were unable to recover it. 00:32:22.048 [2024-11-26 19:18:38.719284] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.048 [2024-11-26 19:18:38.719342] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.048 [2024-11-26 19:18:38.719356] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.048 [2024-11-26 19:18:38.719362] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.048 [2024-11-26 19:18:38.719368] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.048 [2024-11-26 19:18:38.719383] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.048 qpair failed and we were unable to recover it. 00:32:22.048 [2024-11-26 19:18:38.729259] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.048 [2024-11-26 19:18:38.729316] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.048 [2024-11-26 19:18:38.729329] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.048 [2024-11-26 19:18:38.729336] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.048 [2024-11-26 19:18:38.729342] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.048 [2024-11-26 19:18:38.729357] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.048 qpair failed and we were unable to recover it. 00:32:22.048 [2024-11-26 19:18:38.739289] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.048 [2024-11-26 19:18:38.739342] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.048 [2024-11-26 19:18:38.739357] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.048 [2024-11-26 19:18:38.739364] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.048 [2024-11-26 19:18:38.739370] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.048 [2024-11-26 19:18:38.739388] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.048 qpair failed and we were unable to recover it. 00:32:22.048 [2024-11-26 19:18:38.749329] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.048 [2024-11-26 19:18:38.749411] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.048 [2024-11-26 19:18:38.749426] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.048 [2024-11-26 19:18:38.749433] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.048 [2024-11-26 19:18:38.749439] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.048 [2024-11-26 19:18:38.749454] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.048 qpair failed and we were unable to recover it. 00:32:22.048 [2024-11-26 19:18:38.759338] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.048 [2024-11-26 19:18:38.759419] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.048 [2024-11-26 19:18:38.759433] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.048 [2024-11-26 19:18:38.759440] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.048 [2024-11-26 19:18:38.759446] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.048 [2024-11-26 19:18:38.759461] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.048 qpair failed and we were unable to recover it. 00:32:22.048 [2024-11-26 19:18:38.769344] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.048 [2024-11-26 19:18:38.769397] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.048 [2024-11-26 19:18:38.769411] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.048 [2024-11-26 19:18:38.769418] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.049 [2024-11-26 19:18:38.769423] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.049 [2024-11-26 19:18:38.769438] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.049 qpair failed and we were unable to recover it. 00:32:22.049 [2024-11-26 19:18:38.779411] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.049 [2024-11-26 19:18:38.779475] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.049 [2024-11-26 19:18:38.779489] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.049 [2024-11-26 19:18:38.779495] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.049 [2024-11-26 19:18:38.779501] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.049 [2024-11-26 19:18:38.779517] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.049 qpair failed and we were unable to recover it. 00:32:22.049 [2024-11-26 19:18:38.789398] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.049 [2024-11-26 19:18:38.789456] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.049 [2024-11-26 19:18:38.789472] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.049 [2024-11-26 19:18:38.789478] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.049 [2024-11-26 19:18:38.789484] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.049 [2024-11-26 19:18:38.789499] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.049 qpair failed and we were unable to recover it. 00:32:22.049 [2024-11-26 19:18:38.799439] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.049 [2024-11-26 19:18:38.799500] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.049 [2024-11-26 19:18:38.799514] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.049 [2024-11-26 19:18:38.799520] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.049 [2024-11-26 19:18:38.799526] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.049 [2024-11-26 19:18:38.799541] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.049 qpair failed and we were unable to recover it. 00:32:22.049 [2024-11-26 19:18:38.809463] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.049 [2024-11-26 19:18:38.809515] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.049 [2024-11-26 19:18:38.809529] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.049 [2024-11-26 19:18:38.809535] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.049 [2024-11-26 19:18:38.809541] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.049 [2024-11-26 19:18:38.809556] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.049 qpair failed and we were unable to recover it. 00:32:22.049 [2024-11-26 19:18:38.819475] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.049 [2024-11-26 19:18:38.819532] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.049 [2024-11-26 19:18:38.819546] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.049 [2024-11-26 19:18:38.819553] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.049 [2024-11-26 19:18:38.819559] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.049 [2024-11-26 19:18:38.819573] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.049 qpair failed and we were unable to recover it. 00:32:22.049 [2024-11-26 19:18:38.829514] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.049 [2024-11-26 19:18:38.829574] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.049 [2024-11-26 19:18:38.829588] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.049 [2024-11-26 19:18:38.829594] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.049 [2024-11-26 19:18:38.829604] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.049 [2024-11-26 19:18:38.829618] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.049 qpair failed and we were unable to recover it. 00:32:22.049 [2024-11-26 19:18:38.839562] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.049 [2024-11-26 19:18:38.839616] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.049 [2024-11-26 19:18:38.839630] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.049 [2024-11-26 19:18:38.839636] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.049 [2024-11-26 19:18:38.839642] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.049 [2024-11-26 19:18:38.839656] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.049 qpair failed and we were unable to recover it. 00:32:22.049 [2024-11-26 19:18:38.849615] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.049 [2024-11-26 19:18:38.849695] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.049 [2024-11-26 19:18:38.849709] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.049 [2024-11-26 19:18:38.849715] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.049 [2024-11-26 19:18:38.849722] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.049 [2024-11-26 19:18:38.849736] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.049 qpair failed and we were unable to recover it. 00:32:22.049 [2024-11-26 19:18:38.859691] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.049 [2024-11-26 19:18:38.859789] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.049 [2024-11-26 19:18:38.859804] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.049 [2024-11-26 19:18:38.859810] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.049 [2024-11-26 19:18:38.859817] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.049 [2024-11-26 19:18:38.859831] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.049 qpair failed and we were unable to recover it. 00:32:22.049 [2024-11-26 19:18:38.869657] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.049 [2024-11-26 19:18:38.869714] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.049 [2024-11-26 19:18:38.869727] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.049 [2024-11-26 19:18:38.869734] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.049 [2024-11-26 19:18:38.869740] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.049 [2024-11-26 19:18:38.869755] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.049 qpair failed and we were unable to recover it. 00:32:22.049 [2024-11-26 19:18:38.879729] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.049 [2024-11-26 19:18:38.879794] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.049 [2024-11-26 19:18:38.879808] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.049 [2024-11-26 19:18:38.879815] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.050 [2024-11-26 19:18:38.879821] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.050 [2024-11-26 19:18:38.879835] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.050 qpair failed and we were unable to recover it. 00:32:22.050 [2024-11-26 19:18:38.889712] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.050 [2024-11-26 19:18:38.889769] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.050 [2024-11-26 19:18:38.889783] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.050 [2024-11-26 19:18:38.889789] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.050 [2024-11-26 19:18:38.889795] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.050 [2024-11-26 19:18:38.889810] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.050 qpair failed and we were unable to recover it. 00:32:22.050 [2024-11-26 19:18:38.899712] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.050 [2024-11-26 19:18:38.899767] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.050 [2024-11-26 19:18:38.899780] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.050 [2024-11-26 19:18:38.899787] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.050 [2024-11-26 19:18:38.899793] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.050 [2024-11-26 19:18:38.899807] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.050 qpair failed and we were unable to recover it. 00:32:22.050 [2024-11-26 19:18:38.909745] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.050 [2024-11-26 19:18:38.909797] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.050 [2024-11-26 19:18:38.909811] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.050 [2024-11-26 19:18:38.909818] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.050 [2024-11-26 19:18:38.909823] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.050 [2024-11-26 19:18:38.909837] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.050 qpair failed and we were unable to recover it. 00:32:22.050 [2024-11-26 19:18:38.919804] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.050 [2024-11-26 19:18:38.919911] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.050 [2024-11-26 19:18:38.919925] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.050 [2024-11-26 19:18:38.919932] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.050 [2024-11-26 19:18:38.919941] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.050 [2024-11-26 19:18:38.919960] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.050 qpair failed and we were unable to recover it. 00:32:22.050 [2024-11-26 19:18:38.929791] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.050 [2024-11-26 19:18:38.929849] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.050 [2024-11-26 19:18:38.929863] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.050 [2024-11-26 19:18:38.929869] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.050 [2024-11-26 19:18:38.929876] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.050 [2024-11-26 19:18:38.929891] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.050 qpair failed and we were unable to recover it. 00:32:22.050 [2024-11-26 19:18:38.939758] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.050 [2024-11-26 19:18:38.939816] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.050 [2024-11-26 19:18:38.939829] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.050 [2024-11-26 19:18:38.939836] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.050 [2024-11-26 19:18:38.939842] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.050 [2024-11-26 19:18:38.939857] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.050 qpair failed and we were unable to recover it. 00:32:22.050 [2024-11-26 19:18:38.949887] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.050 [2024-11-26 19:18:38.949971] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.050 [2024-11-26 19:18:38.949987] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.050 [2024-11-26 19:18:38.949996] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.050 [2024-11-26 19:18:38.950004] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.050 [2024-11-26 19:18:38.950021] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.050 qpair failed and we were unable to recover it. 00:32:22.050 [2024-11-26 19:18:38.959919] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.050 [2024-11-26 19:18:38.959987] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.050 [2024-11-26 19:18:38.960001] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.050 [2024-11-26 19:18:38.960008] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.050 [2024-11-26 19:18:38.960014] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.050 [2024-11-26 19:18:38.960029] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.050 qpair failed and we were unable to recover it. 00:32:22.309 [2024-11-26 19:18:38.969876] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.310 [2024-11-26 19:18:38.969929] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.310 [2024-11-26 19:18:38.969943] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.310 [2024-11-26 19:18:38.969953] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.310 [2024-11-26 19:18:38.969959] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.310 [2024-11-26 19:18:38.969974] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.310 qpair failed and we were unable to recover it. 00:32:22.310 [2024-11-26 19:18:38.979979] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.310 [2024-11-26 19:18:38.980039] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.310 [2024-11-26 19:18:38.980053] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.310 [2024-11-26 19:18:38.980059] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.310 [2024-11-26 19:18:38.980065] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.310 [2024-11-26 19:18:38.980080] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.310 qpair failed and we were unable to recover it. 00:32:22.310 [2024-11-26 19:18:38.990006] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.310 [2024-11-26 19:18:38.990072] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.310 [2024-11-26 19:18:38.990085] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.310 [2024-11-26 19:18:38.990092] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.310 [2024-11-26 19:18:38.990098] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.310 [2024-11-26 19:18:38.990113] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.310 qpair failed and we were unable to recover it. 00:32:22.310 [2024-11-26 19:18:39.000033] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.310 [2024-11-26 19:18:39.000094] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.310 [2024-11-26 19:18:39.000108] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.310 [2024-11-26 19:18:39.000114] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.310 [2024-11-26 19:18:39.000120] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.310 [2024-11-26 19:18:39.000135] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.310 qpair failed and we were unable to recover it. 00:32:22.310 [2024-11-26 19:18:39.010085] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.310 [2024-11-26 19:18:39.010137] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.310 [2024-11-26 19:18:39.010151] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.310 [2024-11-26 19:18:39.010160] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.310 [2024-11-26 19:18:39.010166] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.310 [2024-11-26 19:18:39.010181] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.310 qpair failed and we were unable to recover it. 00:32:22.310 [2024-11-26 19:18:39.020078] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.310 [2024-11-26 19:18:39.020134] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.310 [2024-11-26 19:18:39.020147] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.310 [2024-11-26 19:18:39.020154] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.310 [2024-11-26 19:18:39.020160] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.310 [2024-11-26 19:18:39.020175] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.310 qpair failed and we were unable to recover it. 00:32:22.310 [2024-11-26 19:18:39.030113] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.310 [2024-11-26 19:18:39.030170] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.310 [2024-11-26 19:18:39.030183] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.310 [2024-11-26 19:18:39.030189] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.310 [2024-11-26 19:18:39.030195] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.310 [2024-11-26 19:18:39.030210] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.310 qpair failed and we were unable to recover it. 00:32:22.310 [2024-11-26 19:18:39.040147] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.310 [2024-11-26 19:18:39.040206] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.310 [2024-11-26 19:18:39.040220] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.310 [2024-11-26 19:18:39.040226] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.310 [2024-11-26 19:18:39.040232] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.310 [2024-11-26 19:18:39.040247] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.310 qpair failed and we were unable to recover it. 00:32:22.310 [2024-11-26 19:18:39.050203] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.310 [2024-11-26 19:18:39.050258] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.310 [2024-11-26 19:18:39.050271] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.310 [2024-11-26 19:18:39.050277] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.310 [2024-11-26 19:18:39.050283] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.310 [2024-11-26 19:18:39.050298] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.310 qpair failed and we were unable to recover it. 00:32:22.310 [2024-11-26 19:18:39.060204] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.310 [2024-11-26 19:18:39.060261] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.310 [2024-11-26 19:18:39.060274] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.310 [2024-11-26 19:18:39.060281] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.310 [2024-11-26 19:18:39.060287] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.310 [2024-11-26 19:18:39.060301] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.310 qpair failed and we were unable to recover it. 00:32:22.310 [2024-11-26 19:18:39.070245] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.310 [2024-11-26 19:18:39.070301] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.310 [2024-11-26 19:18:39.070314] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.310 [2024-11-26 19:18:39.070321] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.310 [2024-11-26 19:18:39.070327] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.310 [2024-11-26 19:18:39.070341] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.310 qpair failed and we were unable to recover it. 00:32:22.310 [2024-11-26 19:18:39.080269] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.310 [2024-11-26 19:18:39.080328] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.310 [2024-11-26 19:18:39.080342] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.310 [2024-11-26 19:18:39.080348] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.310 [2024-11-26 19:18:39.080354] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.310 [2024-11-26 19:18:39.080369] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.310 qpair failed and we were unable to recover it. 00:32:22.310 [2024-11-26 19:18:39.090289] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.310 [2024-11-26 19:18:39.090343] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.310 [2024-11-26 19:18:39.090357] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.310 [2024-11-26 19:18:39.090363] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.310 [2024-11-26 19:18:39.090369] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.310 [2024-11-26 19:18:39.090383] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.310 qpair failed and we were unable to recover it. 00:32:22.310 [2024-11-26 19:18:39.100352] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.310 [2024-11-26 19:18:39.100408] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.311 [2024-11-26 19:18:39.100426] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.311 [2024-11-26 19:18:39.100432] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.311 [2024-11-26 19:18:39.100439] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.311 [2024-11-26 19:18:39.100453] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.311 qpair failed and we were unable to recover it. 00:32:22.311 [2024-11-26 19:18:39.110359] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.311 [2024-11-26 19:18:39.110415] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.311 [2024-11-26 19:18:39.110429] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.311 [2024-11-26 19:18:39.110435] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.311 [2024-11-26 19:18:39.110442] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.311 [2024-11-26 19:18:39.110457] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.311 qpair failed and we were unable to recover it. 00:32:22.311 [2024-11-26 19:18:39.120372] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.311 [2024-11-26 19:18:39.120428] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.311 [2024-11-26 19:18:39.120441] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.311 [2024-11-26 19:18:39.120448] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.311 [2024-11-26 19:18:39.120454] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.311 [2024-11-26 19:18:39.120468] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.311 qpair failed and we were unable to recover it. 00:32:22.311 [2024-11-26 19:18:39.130382] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.311 [2024-11-26 19:18:39.130434] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.311 [2024-11-26 19:18:39.130447] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.311 [2024-11-26 19:18:39.130454] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.311 [2024-11-26 19:18:39.130460] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.311 [2024-11-26 19:18:39.130474] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.311 qpair failed and we were unable to recover it. 00:32:22.311 [2024-11-26 19:18:39.140470] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.311 [2024-11-26 19:18:39.140559] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.311 [2024-11-26 19:18:39.140573] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.311 [2024-11-26 19:18:39.140580] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.311 [2024-11-26 19:18:39.140586] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.311 [2024-11-26 19:18:39.140606] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.311 qpair failed and we were unable to recover it. 00:32:22.311 [2024-11-26 19:18:39.150487] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.311 [2024-11-26 19:18:39.150541] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.311 [2024-11-26 19:18:39.150554] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.311 [2024-11-26 19:18:39.150561] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.311 [2024-11-26 19:18:39.150566] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.311 [2024-11-26 19:18:39.150580] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.311 qpair failed and we were unable to recover it. 00:32:22.311 [2024-11-26 19:18:39.160476] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.311 [2024-11-26 19:18:39.160559] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.311 [2024-11-26 19:18:39.160573] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.311 [2024-11-26 19:18:39.160580] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.311 [2024-11-26 19:18:39.160586] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.311 [2024-11-26 19:18:39.160600] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.311 qpair failed and we were unable to recover it. 00:32:22.311 [2024-11-26 19:18:39.170508] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.311 [2024-11-26 19:18:39.170586] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.311 [2024-11-26 19:18:39.170599] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.311 [2024-11-26 19:18:39.170606] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.311 [2024-11-26 19:18:39.170612] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.311 [2024-11-26 19:18:39.170626] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.311 qpair failed and we were unable to recover it. 00:32:22.311 [2024-11-26 19:18:39.180543] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.311 [2024-11-26 19:18:39.180596] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.311 [2024-11-26 19:18:39.180609] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.311 [2024-11-26 19:18:39.180616] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.311 [2024-11-26 19:18:39.180621] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.311 [2024-11-26 19:18:39.180635] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.311 qpair failed and we were unable to recover it. 00:32:22.311 [2024-11-26 19:18:39.190586] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.311 [2024-11-26 19:18:39.190640] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.311 [2024-11-26 19:18:39.190656] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.311 [2024-11-26 19:18:39.190663] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.311 [2024-11-26 19:18:39.190668] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.311 [2024-11-26 19:18:39.190683] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.311 qpair failed and we were unable to recover it. 00:32:22.311 [2024-11-26 19:18:39.200605] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.311 [2024-11-26 19:18:39.200658] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.311 [2024-11-26 19:18:39.200671] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.311 [2024-11-26 19:18:39.200678] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.311 [2024-11-26 19:18:39.200684] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.311 [2024-11-26 19:18:39.200698] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.311 qpair failed and we were unable to recover it. 00:32:22.311 [2024-11-26 19:18:39.210623] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.311 [2024-11-26 19:18:39.210674] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.311 [2024-11-26 19:18:39.210687] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.311 [2024-11-26 19:18:39.210694] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.311 [2024-11-26 19:18:39.210700] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.311 [2024-11-26 19:18:39.210715] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.311 qpair failed and we were unable to recover it. 00:32:22.311 [2024-11-26 19:18:39.220661] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.311 [2024-11-26 19:18:39.220715] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.311 [2024-11-26 19:18:39.220728] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.311 [2024-11-26 19:18:39.220735] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.311 [2024-11-26 19:18:39.220741] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.311 [2024-11-26 19:18:39.220756] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.311 qpair failed and we were unable to recover it. 00:32:22.311 [2024-11-26 19:18:39.230698] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.311 [2024-11-26 19:18:39.230770] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.311 [2024-11-26 19:18:39.230784] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.312 [2024-11-26 19:18:39.230791] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.312 [2024-11-26 19:18:39.230797] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.312 [2024-11-26 19:18:39.230819] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.312 qpair failed and we were unable to recover it. 00:32:22.571 [2024-11-26 19:18:39.240728] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.571 [2024-11-26 19:18:39.240793] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.571 [2024-11-26 19:18:39.240806] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.571 [2024-11-26 19:18:39.240812] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.571 [2024-11-26 19:18:39.240818] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.571 [2024-11-26 19:18:39.240834] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.571 qpair failed and we were unable to recover it. 00:32:22.571 [2024-11-26 19:18:39.250788] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.571 [2024-11-26 19:18:39.250861] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.571 [2024-11-26 19:18:39.250876] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.571 [2024-11-26 19:18:39.250883] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.571 [2024-11-26 19:18:39.250889] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.571 [2024-11-26 19:18:39.250903] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.571 qpair failed and we were unable to recover it. 00:32:22.571 [2024-11-26 19:18:39.260774] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.571 [2024-11-26 19:18:39.260829] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.571 [2024-11-26 19:18:39.260842] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.571 [2024-11-26 19:18:39.260850] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.571 [2024-11-26 19:18:39.260856] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.571 [2024-11-26 19:18:39.260870] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.571 qpair failed and we were unable to recover it. 00:32:22.571 [2024-11-26 19:18:39.270795] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.571 [2024-11-26 19:18:39.270887] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.571 [2024-11-26 19:18:39.270902] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.571 [2024-11-26 19:18:39.270908] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.571 [2024-11-26 19:18:39.270914] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.571 [2024-11-26 19:18:39.270929] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.571 qpair failed and we were unable to recover it. 00:32:22.571 [2024-11-26 19:18:39.280857] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.571 [2024-11-26 19:18:39.280912] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.571 [2024-11-26 19:18:39.280929] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.571 [2024-11-26 19:18:39.280936] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.571 [2024-11-26 19:18:39.280942] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.571 [2024-11-26 19:18:39.280961] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.571 qpair failed and we were unable to recover it. 00:32:22.571 [2024-11-26 19:18:39.290862] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.571 [2024-11-26 19:18:39.290911] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.571 [2024-11-26 19:18:39.290924] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.571 [2024-11-26 19:18:39.290931] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.571 [2024-11-26 19:18:39.290937] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.571 [2024-11-26 19:18:39.290954] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.571 qpair failed and we were unable to recover it. 00:32:22.571 [2024-11-26 19:18:39.300906] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.571 [2024-11-26 19:18:39.300988] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.571 [2024-11-26 19:18:39.301002] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.571 [2024-11-26 19:18:39.301009] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.571 [2024-11-26 19:18:39.301015] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.571 [2024-11-26 19:18:39.301030] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.571 qpair failed and we were unable to recover it. 00:32:22.571 [2024-11-26 19:18:39.310914] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.571 [2024-11-26 19:18:39.310974] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.571 [2024-11-26 19:18:39.310987] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.571 [2024-11-26 19:18:39.310993] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.571 [2024-11-26 19:18:39.311000] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.571 [2024-11-26 19:18:39.311014] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.571 qpair failed and we were unable to recover it. 00:32:22.571 [2024-11-26 19:18:39.320889] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.571 [2024-11-26 19:18:39.320951] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.571 [2024-11-26 19:18:39.320964] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.571 [2024-11-26 19:18:39.320971] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.571 [2024-11-26 19:18:39.320980] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.571 [2024-11-26 19:18:39.320994] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.571 qpair failed and we were unable to recover it. 00:32:22.571 [2024-11-26 19:18:39.330972] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.571 [2024-11-26 19:18:39.331030] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.571 [2024-11-26 19:18:39.331044] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.571 [2024-11-26 19:18:39.331050] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.571 [2024-11-26 19:18:39.331057] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.571 [2024-11-26 19:18:39.331072] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.572 qpair failed and we were unable to recover it. 00:32:22.572 [2024-11-26 19:18:39.340956] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.572 [2024-11-26 19:18:39.341017] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.572 [2024-11-26 19:18:39.341032] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.572 [2024-11-26 19:18:39.341039] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.572 [2024-11-26 19:18:39.341045] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.572 [2024-11-26 19:18:39.341060] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.572 qpair failed and we were unable to recover it. 00:32:22.572 [2024-11-26 19:18:39.350975] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.572 [2024-11-26 19:18:39.351031] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.572 [2024-11-26 19:18:39.351044] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.572 [2024-11-26 19:18:39.351050] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.572 [2024-11-26 19:18:39.351056] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.572 [2024-11-26 19:18:39.351070] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.572 qpair failed and we were unable to recover it. 00:32:22.572 [2024-11-26 19:18:39.361066] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.572 [2024-11-26 19:18:39.361126] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.572 [2024-11-26 19:18:39.361139] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.572 [2024-11-26 19:18:39.361146] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.572 [2024-11-26 19:18:39.361151] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.572 [2024-11-26 19:18:39.361165] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.572 qpair failed and we were unable to recover it. 00:32:22.572 [2024-11-26 19:18:39.371079] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.572 [2024-11-26 19:18:39.371175] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.572 [2024-11-26 19:18:39.371189] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.572 [2024-11-26 19:18:39.371196] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.572 [2024-11-26 19:18:39.371202] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.572 [2024-11-26 19:18:39.371216] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.572 qpair failed and we were unable to recover it. 00:32:22.572 [2024-11-26 19:18:39.381080] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.572 [2024-11-26 19:18:39.381134] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.572 [2024-11-26 19:18:39.381147] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.572 [2024-11-26 19:18:39.381154] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.572 [2024-11-26 19:18:39.381160] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.572 [2024-11-26 19:18:39.381174] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.572 qpair failed and we were unable to recover it. 00:32:22.572 [2024-11-26 19:18:39.391094] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.572 [2024-11-26 19:18:39.391146] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.572 [2024-11-26 19:18:39.391159] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.572 [2024-11-26 19:18:39.391166] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.572 [2024-11-26 19:18:39.391171] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.572 [2024-11-26 19:18:39.391187] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.572 qpair failed and we were unable to recover it. 00:32:22.572 [2024-11-26 19:18:39.401223] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.572 [2024-11-26 19:18:39.401300] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.572 [2024-11-26 19:18:39.401314] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.572 [2024-11-26 19:18:39.401320] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.572 [2024-11-26 19:18:39.401327] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.572 [2024-11-26 19:18:39.401342] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.572 qpair failed and we were unable to recover it. 00:32:22.572 [2024-11-26 19:18:39.411162] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.572 [2024-11-26 19:18:39.411215] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.572 [2024-11-26 19:18:39.411227] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.572 [2024-11-26 19:18:39.411234] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.572 [2024-11-26 19:18:39.411243] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.572 [2024-11-26 19:18:39.411258] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.572 qpair failed and we were unable to recover it. 00:32:22.572 [2024-11-26 19:18:39.421278] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.572 [2024-11-26 19:18:39.421366] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.572 [2024-11-26 19:18:39.421380] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.572 [2024-11-26 19:18:39.421386] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.572 [2024-11-26 19:18:39.421392] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.572 [2024-11-26 19:18:39.421407] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.572 qpair failed and we were unable to recover it. 00:32:22.572 [2024-11-26 19:18:39.431242] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.572 [2024-11-26 19:18:39.431314] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.572 [2024-11-26 19:18:39.431331] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.572 [2024-11-26 19:18:39.431337] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.572 [2024-11-26 19:18:39.431343] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.572 [2024-11-26 19:18:39.431357] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.572 qpair failed and we were unable to recover it. 00:32:22.572 [2024-11-26 19:18:39.441233] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.572 [2024-11-26 19:18:39.441315] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.572 [2024-11-26 19:18:39.441329] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.572 [2024-11-26 19:18:39.441335] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.572 [2024-11-26 19:18:39.441341] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.572 [2024-11-26 19:18:39.441356] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.572 qpair failed and we were unable to recover it. 00:32:22.572 [2024-11-26 19:18:39.451327] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.572 [2024-11-26 19:18:39.451377] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.572 [2024-11-26 19:18:39.451390] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.572 [2024-11-26 19:18:39.451397] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.572 [2024-11-26 19:18:39.451403] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.572 [2024-11-26 19:18:39.451418] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.572 qpair failed and we were unable to recover it. 00:32:22.572 [2024-11-26 19:18:39.461281] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.572 [2024-11-26 19:18:39.461329] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.573 [2024-11-26 19:18:39.461343] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.573 [2024-11-26 19:18:39.461350] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.573 [2024-11-26 19:18:39.461355] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.573 [2024-11-26 19:18:39.461370] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.573 qpair failed and we were unable to recover it. 00:32:22.573 [2024-11-26 19:18:39.471388] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.573 [2024-11-26 19:18:39.471438] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.573 [2024-11-26 19:18:39.471451] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.573 [2024-11-26 19:18:39.471458] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.573 [2024-11-26 19:18:39.471464] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.573 [2024-11-26 19:18:39.471479] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.573 qpair failed and we were unable to recover it. 00:32:22.573 [2024-11-26 19:18:39.481348] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.573 [2024-11-26 19:18:39.481401] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.573 [2024-11-26 19:18:39.481415] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.573 [2024-11-26 19:18:39.481421] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.573 [2024-11-26 19:18:39.481427] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.573 [2024-11-26 19:18:39.481442] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.573 qpair failed and we were unable to recover it. 00:32:22.573 [2024-11-26 19:18:39.491384] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.573 [2024-11-26 19:18:39.491441] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.573 [2024-11-26 19:18:39.491455] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.573 [2024-11-26 19:18:39.491461] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.573 [2024-11-26 19:18:39.491467] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.573 [2024-11-26 19:18:39.491482] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.573 qpair failed and we were unable to recover it. 00:32:22.831 [2024-11-26 19:18:39.501474] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.831 [2024-11-26 19:18:39.501527] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.831 [2024-11-26 19:18:39.501541] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.831 [2024-11-26 19:18:39.501551] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.831 [2024-11-26 19:18:39.501557] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.831 [2024-11-26 19:18:39.501571] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.831 qpair failed and we were unable to recover it. 00:32:22.831 [2024-11-26 19:18:39.511443] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.831 [2024-11-26 19:18:39.511497] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.831 [2024-11-26 19:18:39.511510] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.831 [2024-11-26 19:18:39.511517] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.831 [2024-11-26 19:18:39.511522] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.831 [2024-11-26 19:18:39.511536] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.831 qpair failed and we were unable to recover it. 00:32:22.831 [2024-11-26 19:18:39.521572] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.831 [2024-11-26 19:18:39.521634] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.831 [2024-11-26 19:18:39.521647] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.831 [2024-11-26 19:18:39.521654] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.831 [2024-11-26 19:18:39.521659] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.831 [2024-11-26 19:18:39.521674] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.831 qpair failed and we were unable to recover it. 00:32:22.831 [2024-11-26 19:18:39.531494] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.831 [2024-11-26 19:18:39.531544] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.831 [2024-11-26 19:18:39.531557] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.831 [2024-11-26 19:18:39.531563] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.831 [2024-11-26 19:18:39.531569] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.831 [2024-11-26 19:18:39.531583] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.831 qpair failed and we were unable to recover it. 00:32:22.831 [2024-11-26 19:18:39.541639] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.831 [2024-11-26 19:18:39.541693] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.831 [2024-11-26 19:18:39.541706] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.831 [2024-11-26 19:18:39.541713] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.831 [2024-11-26 19:18:39.541718] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.831 [2024-11-26 19:18:39.541732] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.831 qpair failed and we were unable to recover it. 00:32:22.831 [2024-11-26 19:18:39.551655] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.831 [2024-11-26 19:18:39.551708] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.831 [2024-11-26 19:18:39.551722] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.831 [2024-11-26 19:18:39.551728] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.831 [2024-11-26 19:18:39.551734] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.831 [2024-11-26 19:18:39.551748] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.831 qpair failed and we were unable to recover it. 00:32:22.831 [2024-11-26 19:18:39.561643] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.831 [2024-11-26 19:18:39.561710] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.831 [2024-11-26 19:18:39.561724] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.831 [2024-11-26 19:18:39.561731] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.831 [2024-11-26 19:18:39.561737] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.831 [2024-11-26 19:18:39.561751] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.831 qpair failed and we were unable to recover it. 00:32:22.831 [2024-11-26 19:18:39.571677] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.831 [2024-11-26 19:18:39.571732] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.831 [2024-11-26 19:18:39.571746] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.831 [2024-11-26 19:18:39.571752] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.831 [2024-11-26 19:18:39.571758] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.831 [2024-11-26 19:18:39.571772] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.831 qpair failed and we were unable to recover it. 00:32:22.831 [2024-11-26 19:18:39.581721] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.831 [2024-11-26 19:18:39.581784] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.831 [2024-11-26 19:18:39.581798] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.831 [2024-11-26 19:18:39.581805] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.831 [2024-11-26 19:18:39.581811] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.831 [2024-11-26 19:18:39.581826] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.831 qpair failed and we were unable to recover it. 00:32:22.831 [2024-11-26 19:18:39.591733] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.832 [2024-11-26 19:18:39.591791] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.832 [2024-11-26 19:18:39.591804] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.832 [2024-11-26 19:18:39.591814] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.832 [2024-11-26 19:18:39.591820] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.832 [2024-11-26 19:18:39.591834] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.832 qpair failed and we were unable to recover it. 00:32:22.832 [2024-11-26 19:18:39.601809] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.832 [2024-11-26 19:18:39.601865] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.832 [2024-11-26 19:18:39.601879] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.832 [2024-11-26 19:18:39.601886] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.832 [2024-11-26 19:18:39.601892] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.832 [2024-11-26 19:18:39.601907] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.832 qpair failed and we were unable to recover it. 00:32:22.832 [2024-11-26 19:18:39.611810] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.832 [2024-11-26 19:18:39.611863] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.832 [2024-11-26 19:18:39.611877] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.832 [2024-11-26 19:18:39.611883] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.832 [2024-11-26 19:18:39.611889] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.832 [2024-11-26 19:18:39.611904] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.832 qpair failed and we were unable to recover it. 00:32:22.832 [2024-11-26 19:18:39.621804] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.832 [2024-11-26 19:18:39.621860] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.832 [2024-11-26 19:18:39.621873] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.832 [2024-11-26 19:18:39.621879] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.832 [2024-11-26 19:18:39.621885] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.832 [2024-11-26 19:18:39.621899] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.832 qpair failed and we were unable to recover it. 00:32:22.832 [2024-11-26 19:18:39.631789] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.832 [2024-11-26 19:18:39.631846] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.832 [2024-11-26 19:18:39.631859] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.832 [2024-11-26 19:18:39.631865] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.832 [2024-11-26 19:18:39.631871] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.832 [2024-11-26 19:18:39.631885] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.832 qpair failed and we were unable to recover it. 00:32:22.832 [2024-11-26 19:18:39.641879] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.832 [2024-11-26 19:18:39.641941] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.832 [2024-11-26 19:18:39.641988] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.832 [2024-11-26 19:18:39.641999] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.832 [2024-11-26 19:18:39.642006] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.832 [2024-11-26 19:18:39.642030] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.832 qpair failed and we were unable to recover it. 00:32:22.832 [2024-11-26 19:18:39.651836] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.832 [2024-11-26 19:18:39.651894] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.832 [2024-11-26 19:18:39.651909] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.832 [2024-11-26 19:18:39.651915] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.832 [2024-11-26 19:18:39.651921] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.832 [2024-11-26 19:18:39.651937] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.832 qpair failed and we were unable to recover it. 00:32:22.832 [2024-11-26 19:18:39.661926] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.832 [2024-11-26 19:18:39.662014] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.832 [2024-11-26 19:18:39.662029] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.832 [2024-11-26 19:18:39.662036] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.832 [2024-11-26 19:18:39.662042] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.832 [2024-11-26 19:18:39.662058] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.832 qpair failed and we were unable to recover it. 00:32:22.832 [2024-11-26 19:18:39.671912] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.832 [2024-11-26 19:18:39.671986] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.832 [2024-11-26 19:18:39.672000] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.832 [2024-11-26 19:18:39.672007] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.832 [2024-11-26 19:18:39.672013] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.832 [2024-11-26 19:18:39.672029] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.832 qpair failed and we were unable to recover it. 00:32:22.832 [2024-11-26 19:18:39.682032] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.832 [2024-11-26 19:18:39.682091] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.832 [2024-11-26 19:18:39.682107] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.832 [2024-11-26 19:18:39.682114] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.832 [2024-11-26 19:18:39.682120] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.832 [2024-11-26 19:18:39.682135] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.832 qpair failed and we were unable to recover it. 00:32:22.832 [2024-11-26 19:18:39.692060] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.832 [2024-11-26 19:18:39.692121] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.832 [2024-11-26 19:18:39.692134] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.832 [2024-11-26 19:18:39.692140] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.832 [2024-11-26 19:18:39.692146] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.832 [2024-11-26 19:18:39.692161] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.832 qpair failed and we were unable to recover it. 00:32:22.832 [2024-11-26 19:18:39.702087] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.833 [2024-11-26 19:18:39.702176] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.833 [2024-11-26 19:18:39.702190] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.833 [2024-11-26 19:18:39.702196] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.833 [2024-11-26 19:18:39.702203] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.833 [2024-11-26 19:18:39.702218] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.833 qpair failed and we were unable to recover it. 00:32:22.833 [2024-11-26 19:18:39.712068] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.833 [2024-11-26 19:18:39.712118] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.833 [2024-11-26 19:18:39.712131] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.833 [2024-11-26 19:18:39.712138] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.833 [2024-11-26 19:18:39.712143] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.833 [2024-11-26 19:18:39.712158] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.833 qpair failed and we were unable to recover it. 00:32:22.833 [2024-11-26 19:18:39.722101] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.833 [2024-11-26 19:18:39.722184] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.833 [2024-11-26 19:18:39.722198] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.833 [2024-11-26 19:18:39.722205] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.833 [2024-11-26 19:18:39.722211] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.833 [2024-11-26 19:18:39.722229] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.833 qpair failed and we were unable to recover it. 00:32:22.833 [2024-11-26 19:18:39.732136] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.833 [2024-11-26 19:18:39.732237] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.833 [2024-11-26 19:18:39.732251] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.833 [2024-11-26 19:18:39.732258] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.833 [2024-11-26 19:18:39.732264] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.833 [2024-11-26 19:18:39.732278] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.833 qpair failed and we were unable to recover it. 00:32:22.833 [2024-11-26 19:18:39.742215] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.833 [2024-11-26 19:18:39.742273] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.833 [2024-11-26 19:18:39.742286] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.833 [2024-11-26 19:18:39.742292] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.833 [2024-11-26 19:18:39.742298] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.833 [2024-11-26 19:18:39.742313] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.833 qpair failed and we were unable to recover it. 00:32:22.833 [2024-11-26 19:18:39.752182] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:22.833 [2024-11-26 19:18:39.752273] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:22.833 [2024-11-26 19:18:39.752287] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:22.833 [2024-11-26 19:18:39.752294] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:22.833 [2024-11-26 19:18:39.752300] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:22.833 [2024-11-26 19:18:39.752325] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:22.833 qpair failed and we were unable to recover it. 00:32:23.092 [2024-11-26 19:18:39.762218] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.092 [2024-11-26 19:18:39.762281] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.092 [2024-11-26 19:18:39.762294] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.092 [2024-11-26 19:18:39.762301] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.093 [2024-11-26 19:18:39.762307] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.093 [2024-11-26 19:18:39.762321] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.093 qpair failed and we were unable to recover it. 00:32:23.093 [2024-11-26 19:18:39.772275] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.093 [2024-11-26 19:18:39.772326] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.093 [2024-11-26 19:18:39.772342] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.093 [2024-11-26 19:18:39.772349] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.093 [2024-11-26 19:18:39.772354] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.093 [2024-11-26 19:18:39.772369] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.093 qpair failed and we were unable to recover it. 00:32:23.093 [2024-11-26 19:18:39.782302] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.093 [2024-11-26 19:18:39.782352] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.093 [2024-11-26 19:18:39.782366] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.093 [2024-11-26 19:18:39.782373] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.093 [2024-11-26 19:18:39.782378] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.093 [2024-11-26 19:18:39.782393] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.093 qpair failed and we were unable to recover it. 00:32:23.093 [2024-11-26 19:18:39.792340] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.093 [2024-11-26 19:18:39.792394] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.093 [2024-11-26 19:18:39.792407] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.093 [2024-11-26 19:18:39.792414] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.093 [2024-11-26 19:18:39.792420] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.093 [2024-11-26 19:18:39.792434] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.093 qpair failed and we were unable to recover it. 00:32:23.093 [2024-11-26 19:18:39.802365] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.093 [2024-11-26 19:18:39.802420] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.093 [2024-11-26 19:18:39.802432] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.093 [2024-11-26 19:18:39.802439] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.093 [2024-11-26 19:18:39.802444] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.093 [2024-11-26 19:18:39.802459] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.093 qpair failed and we were unable to recover it. 00:32:23.093 [2024-11-26 19:18:39.812326] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.093 [2024-11-26 19:18:39.812380] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.093 [2024-11-26 19:18:39.812393] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.093 [2024-11-26 19:18:39.812399] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.093 [2024-11-26 19:18:39.812408] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.093 [2024-11-26 19:18:39.812423] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.093 qpair failed and we were unable to recover it. 00:32:23.093 [2024-11-26 19:18:39.822412] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.093 [2024-11-26 19:18:39.822502] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.093 [2024-11-26 19:18:39.822516] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.093 [2024-11-26 19:18:39.822522] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.093 [2024-11-26 19:18:39.822528] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.093 [2024-11-26 19:18:39.822543] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.093 qpair failed and we were unable to recover it. 00:32:23.093 [2024-11-26 19:18:39.832445] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.093 [2024-11-26 19:18:39.832502] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.093 [2024-11-26 19:18:39.832516] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.093 [2024-11-26 19:18:39.832522] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.093 [2024-11-26 19:18:39.832528] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.093 [2024-11-26 19:18:39.832543] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.093 qpair failed and we were unable to recover it. 00:32:23.093 [2024-11-26 19:18:39.842469] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.093 [2024-11-26 19:18:39.842522] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.093 [2024-11-26 19:18:39.842536] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.093 [2024-11-26 19:18:39.842542] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.093 [2024-11-26 19:18:39.842548] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.093 [2024-11-26 19:18:39.842563] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.093 qpair failed and we were unable to recover it. 00:32:23.093 [2024-11-26 19:18:39.852495] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.093 [2024-11-26 19:18:39.852546] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.093 [2024-11-26 19:18:39.852559] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.093 [2024-11-26 19:18:39.852565] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.093 [2024-11-26 19:18:39.852571] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.093 [2024-11-26 19:18:39.852586] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.093 qpair failed and we were unable to recover it. 00:32:23.093 [2024-11-26 19:18:39.862496] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.093 [2024-11-26 19:18:39.862562] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.093 [2024-11-26 19:18:39.862575] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.093 [2024-11-26 19:18:39.862581] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.093 [2024-11-26 19:18:39.862587] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.093 [2024-11-26 19:18:39.862602] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.093 qpair failed and we were unable to recover it. 00:32:23.093 [2024-11-26 19:18:39.872490] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.093 [2024-11-26 19:18:39.872545] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.093 [2024-11-26 19:18:39.872558] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.093 [2024-11-26 19:18:39.872564] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.093 [2024-11-26 19:18:39.872570] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.093 [2024-11-26 19:18:39.872585] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.093 qpair failed and we were unable to recover it. 00:32:23.093 [2024-11-26 19:18:39.882628] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.093 [2024-11-26 19:18:39.882682] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.093 [2024-11-26 19:18:39.882695] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.093 [2024-11-26 19:18:39.882701] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.093 [2024-11-26 19:18:39.882707] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.093 [2024-11-26 19:18:39.882722] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.093 qpair failed and we were unable to recover it. 00:32:23.093 [2024-11-26 19:18:39.892560] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.093 [2024-11-26 19:18:39.892616] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.093 [2024-11-26 19:18:39.892630] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.093 [2024-11-26 19:18:39.892636] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.094 [2024-11-26 19:18:39.892642] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.094 [2024-11-26 19:18:39.892657] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.094 qpair failed and we were unable to recover it. 00:32:23.094 [2024-11-26 19:18:39.902645] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.094 [2024-11-26 19:18:39.902703] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.094 [2024-11-26 19:18:39.902716] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.094 [2024-11-26 19:18:39.902722] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.094 [2024-11-26 19:18:39.902731] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.094 [2024-11-26 19:18:39.902745] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.094 qpair failed and we were unable to recover it. 00:32:23.094 [2024-11-26 19:18:39.912673] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.094 [2024-11-26 19:18:39.912728] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.094 [2024-11-26 19:18:39.912741] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.094 [2024-11-26 19:18:39.912748] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.094 [2024-11-26 19:18:39.912754] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.094 [2024-11-26 19:18:39.912768] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.094 qpair failed and we were unable to recover it. 00:32:23.094 [2024-11-26 19:18:39.922695] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.094 [2024-11-26 19:18:39.922754] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.094 [2024-11-26 19:18:39.922768] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.094 [2024-11-26 19:18:39.922774] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.094 [2024-11-26 19:18:39.922780] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.094 [2024-11-26 19:18:39.922795] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.094 qpair failed and we were unable to recover it. 00:32:23.094 [2024-11-26 19:18:39.932731] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.094 [2024-11-26 19:18:39.932789] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.094 [2024-11-26 19:18:39.932802] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.094 [2024-11-26 19:18:39.932808] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.094 [2024-11-26 19:18:39.932814] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.094 [2024-11-26 19:18:39.932829] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.094 qpair failed and we were unable to recover it. 00:32:23.094 [2024-11-26 19:18:39.942760] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.094 [2024-11-26 19:18:39.942816] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.094 [2024-11-26 19:18:39.942829] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.094 [2024-11-26 19:18:39.942835] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.094 [2024-11-26 19:18:39.942841] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.094 [2024-11-26 19:18:39.942856] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.094 qpair failed and we were unable to recover it. 00:32:23.094 [2024-11-26 19:18:39.952801] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.094 [2024-11-26 19:18:39.952878] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.094 [2024-11-26 19:18:39.952893] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.094 [2024-11-26 19:18:39.952899] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.094 [2024-11-26 19:18:39.952905] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.094 [2024-11-26 19:18:39.952920] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.094 qpair failed and we were unable to recover it. 00:32:23.094 [2024-11-26 19:18:39.962823] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.094 [2024-11-26 19:18:39.962876] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.094 [2024-11-26 19:18:39.962889] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.094 [2024-11-26 19:18:39.962896] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.094 [2024-11-26 19:18:39.962902] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.094 [2024-11-26 19:18:39.962916] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.094 qpair failed and we were unable to recover it. 00:32:23.094 [2024-11-26 19:18:39.972848] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.094 [2024-11-26 19:18:39.972895] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.094 [2024-11-26 19:18:39.972908] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.094 [2024-11-26 19:18:39.972915] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.094 [2024-11-26 19:18:39.972920] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.094 [2024-11-26 19:18:39.972934] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.094 qpair failed and we were unable to recover it. 00:32:23.094 [2024-11-26 19:18:39.982879] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.094 [2024-11-26 19:18:39.982934] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.094 [2024-11-26 19:18:39.982950] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.094 [2024-11-26 19:18:39.982957] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.094 [2024-11-26 19:18:39.982963] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.094 [2024-11-26 19:18:39.982977] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.094 qpair failed and we were unable to recover it. 00:32:23.094 [2024-11-26 19:18:39.992903] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.094 [2024-11-26 19:18:39.992960] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.094 [2024-11-26 19:18:39.992974] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.094 [2024-11-26 19:18:39.992986] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.094 [2024-11-26 19:18:39.992993] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.094 [2024-11-26 19:18:39.993007] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.094 qpair failed and we were unable to recover it. 00:32:23.094 [2024-11-26 19:18:40.002866] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.094 [2024-11-26 19:18:40.002935] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.094 [2024-11-26 19:18:40.002952] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.094 [2024-11-26 19:18:40.002959] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.094 [2024-11-26 19:18:40.002965] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.094 [2024-11-26 19:18:40.002979] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.094 qpair failed and we were unable to recover it. 00:32:23.094 [2024-11-26 19:18:40.012993] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.094 [2024-11-26 19:18:40.013120] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.094 [2024-11-26 19:18:40.013154] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.094 [2024-11-26 19:18:40.013172] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.094 [2024-11-26 19:18:40.013185] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.094 [2024-11-26 19:18:40.013207] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.094 qpair failed and we were unable to recover it. 00:32:23.354 [2024-11-26 19:18:40.023028] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.354 [2024-11-26 19:18:40.023137] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.354 [2024-11-26 19:18:40.023153] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.354 [2024-11-26 19:18:40.023161] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.354 [2024-11-26 19:18:40.023167] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.354 [2024-11-26 19:18:40.023183] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.354 qpair failed and we were unable to recover it. 00:32:23.354 [2024-11-26 19:18:40.033053] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.354 [2024-11-26 19:18:40.033113] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.354 [2024-11-26 19:18:40.033127] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.354 [2024-11-26 19:18:40.033135] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.354 [2024-11-26 19:18:40.033140] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.354 [2024-11-26 19:18:40.033156] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.354 qpair failed and we were unable to recover it. 00:32:23.354 [2024-11-26 19:18:40.043090] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.354 [2024-11-26 19:18:40.043153] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.354 [2024-11-26 19:18:40.043171] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.354 [2024-11-26 19:18:40.043178] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.354 [2024-11-26 19:18:40.043184] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.354 [2024-11-26 19:18:40.043201] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.354 qpair failed and we were unable to recover it. 00:32:23.354 [2024-11-26 19:18:40.053121] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.354 [2024-11-26 19:18:40.053176] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.354 [2024-11-26 19:18:40.053190] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.354 [2024-11-26 19:18:40.053197] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.354 [2024-11-26 19:18:40.053204] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.354 [2024-11-26 19:18:40.053219] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.354 qpair failed and we were unable to recover it. 00:32:23.354 [2024-11-26 19:18:40.063134] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.354 [2024-11-26 19:18:40.063193] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.354 [2024-11-26 19:18:40.063208] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.354 [2024-11-26 19:18:40.063215] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.354 [2024-11-26 19:18:40.063221] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.354 [2024-11-26 19:18:40.063235] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.354 qpair failed and we were unable to recover it. 00:32:23.354 [2024-11-26 19:18:40.073176] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.354 [2024-11-26 19:18:40.073236] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.354 [2024-11-26 19:18:40.073250] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.354 [2024-11-26 19:18:40.073257] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.354 [2024-11-26 19:18:40.073263] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.354 [2024-11-26 19:18:40.073278] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.354 qpair failed and we were unable to recover it. 00:32:23.354 [2024-11-26 19:18:40.083218] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.354 [2024-11-26 19:18:40.083290] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.354 [2024-11-26 19:18:40.083304] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.354 [2024-11-26 19:18:40.083318] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.354 [2024-11-26 19:18:40.083325] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.354 [2024-11-26 19:18:40.083340] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.354 qpair failed and we were unable to recover it. 00:32:23.354 [2024-11-26 19:18:40.093297] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.354 [2024-11-26 19:18:40.093364] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.354 [2024-11-26 19:18:40.093381] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.354 [2024-11-26 19:18:40.093389] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.354 [2024-11-26 19:18:40.093395] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.354 [2024-11-26 19:18:40.093412] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.354 qpair failed and we were unable to recover it. 00:32:23.354 [2024-11-26 19:18:40.103262] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.354 [2024-11-26 19:18:40.103312] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.355 [2024-11-26 19:18:40.103327] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.355 [2024-11-26 19:18:40.103334] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.355 [2024-11-26 19:18:40.103340] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.355 [2024-11-26 19:18:40.103354] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.355 qpair failed and we were unable to recover it. 00:32:23.355 [2024-11-26 19:18:40.113228] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.355 [2024-11-26 19:18:40.113280] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.355 [2024-11-26 19:18:40.113294] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.355 [2024-11-26 19:18:40.113300] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.355 [2024-11-26 19:18:40.113306] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.355 [2024-11-26 19:18:40.113321] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.355 qpair failed and we were unable to recover it. 00:32:23.355 [2024-11-26 19:18:40.123333] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.355 [2024-11-26 19:18:40.123393] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.355 [2024-11-26 19:18:40.123407] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.355 [2024-11-26 19:18:40.123413] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.355 [2024-11-26 19:18:40.123419] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.355 [2024-11-26 19:18:40.123434] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.355 qpair failed and we were unable to recover it. 00:32:23.355 [2024-11-26 19:18:40.133348] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.355 [2024-11-26 19:18:40.133404] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.355 [2024-11-26 19:18:40.133418] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.355 [2024-11-26 19:18:40.133424] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.355 [2024-11-26 19:18:40.133430] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.355 [2024-11-26 19:18:40.133445] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.355 qpair failed and we were unable to recover it. 00:32:23.355 [2024-11-26 19:18:40.143381] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.355 [2024-11-26 19:18:40.143441] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.355 [2024-11-26 19:18:40.143455] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.355 [2024-11-26 19:18:40.143461] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.355 [2024-11-26 19:18:40.143467] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.355 [2024-11-26 19:18:40.143481] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.355 qpair failed and we were unable to recover it. 00:32:23.355 [2024-11-26 19:18:40.153468] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.355 [2024-11-26 19:18:40.153535] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.355 [2024-11-26 19:18:40.153549] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.355 [2024-11-26 19:18:40.153556] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.355 [2024-11-26 19:18:40.153562] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.355 [2024-11-26 19:18:40.153577] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.355 qpair failed and we were unable to recover it. 00:32:23.355 [2024-11-26 19:18:40.163456] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.355 [2024-11-26 19:18:40.163513] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.355 [2024-11-26 19:18:40.163527] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.355 [2024-11-26 19:18:40.163534] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.355 [2024-11-26 19:18:40.163540] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.355 [2024-11-26 19:18:40.163554] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.355 qpair failed and we were unable to recover it. 00:32:23.355 [2024-11-26 19:18:40.173515] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.355 [2024-11-26 19:18:40.173577] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.355 [2024-11-26 19:18:40.173593] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.355 [2024-11-26 19:18:40.173600] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.355 [2024-11-26 19:18:40.173606] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.355 [2024-11-26 19:18:40.173621] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.355 qpair failed and we were unable to recover it. 00:32:23.355 [2024-11-26 19:18:40.183548] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.355 [2024-11-26 19:18:40.183629] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.355 [2024-11-26 19:18:40.183642] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.355 [2024-11-26 19:18:40.183648] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.355 [2024-11-26 19:18:40.183654] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.355 [2024-11-26 19:18:40.183670] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.355 qpair failed and we were unable to recover it. 00:32:23.355 [2024-11-26 19:18:40.193548] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.355 [2024-11-26 19:18:40.193606] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.355 [2024-11-26 19:18:40.193619] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.355 [2024-11-26 19:18:40.193625] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.355 [2024-11-26 19:18:40.193631] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.355 [2024-11-26 19:18:40.193646] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.355 qpair failed and we were unable to recover it. 00:32:23.355 [2024-11-26 19:18:40.203567] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.355 [2024-11-26 19:18:40.203620] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.355 [2024-11-26 19:18:40.203634] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.355 [2024-11-26 19:18:40.203640] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.355 [2024-11-26 19:18:40.203646] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.355 [2024-11-26 19:18:40.203661] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.355 qpair failed and we were unable to recover it. 00:32:23.355 [2024-11-26 19:18:40.213600] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.355 [2024-11-26 19:18:40.213650] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.355 [2024-11-26 19:18:40.213663] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.355 [2024-11-26 19:18:40.213670] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.355 [2024-11-26 19:18:40.213676] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.355 [2024-11-26 19:18:40.213695] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.355 qpair failed and we were unable to recover it. 00:32:23.355 [2024-11-26 19:18:40.223657] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.355 [2024-11-26 19:18:40.223709] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.355 [2024-11-26 19:18:40.223723] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.355 [2024-11-26 19:18:40.223729] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.355 [2024-11-26 19:18:40.223735] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.355 [2024-11-26 19:18:40.223750] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.355 qpair failed and we were unable to recover it. 00:32:23.355 [2024-11-26 19:18:40.233661] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.355 [2024-11-26 19:18:40.233716] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.355 [2024-11-26 19:18:40.233730] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.355 [2024-11-26 19:18:40.233736] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.356 [2024-11-26 19:18:40.233742] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.356 [2024-11-26 19:18:40.233756] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.356 qpair failed and we were unable to recover it. 00:32:23.356 [2024-11-26 19:18:40.243678] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.356 [2024-11-26 19:18:40.243737] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.356 [2024-11-26 19:18:40.243750] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.356 [2024-11-26 19:18:40.243757] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.356 [2024-11-26 19:18:40.243763] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.356 [2024-11-26 19:18:40.243777] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.356 qpair failed and we were unable to recover it. 00:32:23.356 [2024-11-26 19:18:40.253752] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.356 [2024-11-26 19:18:40.253807] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.356 [2024-11-26 19:18:40.253821] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.356 [2024-11-26 19:18:40.253828] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.356 [2024-11-26 19:18:40.253834] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.356 [2024-11-26 19:18:40.253848] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.356 qpair failed and we were unable to recover it. 00:32:23.356 [2024-11-26 19:18:40.263740] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.356 [2024-11-26 19:18:40.263795] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.356 [2024-11-26 19:18:40.263811] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.356 [2024-11-26 19:18:40.263818] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.356 [2024-11-26 19:18:40.263824] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.356 [2024-11-26 19:18:40.263838] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.356 qpair failed and we were unable to recover it. 00:32:23.356 [2024-11-26 19:18:40.273824] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.356 [2024-11-26 19:18:40.273882] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.356 [2024-11-26 19:18:40.273896] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.356 [2024-11-26 19:18:40.273903] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.356 [2024-11-26 19:18:40.273909] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.356 [2024-11-26 19:18:40.273923] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.356 qpair failed and we were unable to recover it. 00:32:23.615 [2024-11-26 19:18:40.283868] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.615 [2024-11-26 19:18:40.283960] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.615 [2024-11-26 19:18:40.283975] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.615 [2024-11-26 19:18:40.283981] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.615 [2024-11-26 19:18:40.283988] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.615 [2024-11-26 19:18:40.284003] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.615 qpair failed and we were unable to recover it. 00:32:23.615 [2024-11-26 19:18:40.293853] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.615 [2024-11-26 19:18:40.293911] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.615 [2024-11-26 19:18:40.293924] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.615 [2024-11-26 19:18:40.293931] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.615 [2024-11-26 19:18:40.293937] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.615 [2024-11-26 19:18:40.293955] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.616 qpair failed and we were unable to recover it. 00:32:23.616 [2024-11-26 19:18:40.303842] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.616 [2024-11-26 19:18:40.303893] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.616 [2024-11-26 19:18:40.303907] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.616 [2024-11-26 19:18:40.303914] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.616 [2024-11-26 19:18:40.303920] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.616 [2024-11-26 19:18:40.303938] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.616 qpair failed and we were unable to recover it. 00:32:23.616 [2024-11-26 19:18:40.313897] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.616 [2024-11-26 19:18:40.313961] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.616 [2024-11-26 19:18:40.313975] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.616 [2024-11-26 19:18:40.313981] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.616 [2024-11-26 19:18:40.313987] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.616 [2024-11-26 19:18:40.314003] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.616 qpair failed and we were unable to recover it. 00:32:23.616 [2024-11-26 19:18:40.323926] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.616 [2024-11-26 19:18:40.324016] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.616 [2024-11-26 19:18:40.324031] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.616 [2024-11-26 19:18:40.324037] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.616 [2024-11-26 19:18:40.324044] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.616 [2024-11-26 19:18:40.324059] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.616 qpair failed and we were unable to recover it. 00:32:23.616 [2024-11-26 19:18:40.333951] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.616 [2024-11-26 19:18:40.334008] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.616 [2024-11-26 19:18:40.334022] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.616 [2024-11-26 19:18:40.334028] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.616 [2024-11-26 19:18:40.334034] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.616 [2024-11-26 19:18:40.334049] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.616 qpair failed and we were unable to recover it. 00:32:23.616 [2024-11-26 19:18:40.343908] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.616 [2024-11-26 19:18:40.343966] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.616 [2024-11-26 19:18:40.343979] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.616 [2024-11-26 19:18:40.343985] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.616 [2024-11-26 19:18:40.343992] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.616 [2024-11-26 19:18:40.344007] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.616 qpair failed and we were unable to recover it. 00:32:23.616 [2024-11-26 19:18:40.354008] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.616 [2024-11-26 19:18:40.354063] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.616 [2024-11-26 19:18:40.354082] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.616 [2024-11-26 19:18:40.354088] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.616 [2024-11-26 19:18:40.354094] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.616 [2024-11-26 19:18:40.354109] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.616 qpair failed and we were unable to recover it. 00:32:23.616 [2024-11-26 19:18:40.364075] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.616 [2024-11-26 19:18:40.364132] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.616 [2024-11-26 19:18:40.364146] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.616 [2024-11-26 19:18:40.364153] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.616 [2024-11-26 19:18:40.364159] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.616 [2024-11-26 19:18:40.364175] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.616 qpair failed and we were unable to recover it. 00:32:23.616 [2024-11-26 19:18:40.374061] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.616 [2024-11-26 19:18:40.374115] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.616 [2024-11-26 19:18:40.374130] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.616 [2024-11-26 19:18:40.374136] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.616 [2024-11-26 19:18:40.374142] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.616 [2024-11-26 19:18:40.374158] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.616 qpair failed and we were unable to recover it. 00:32:23.616 [2024-11-26 19:18:40.384117] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.616 [2024-11-26 19:18:40.384177] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.616 [2024-11-26 19:18:40.384192] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.616 [2024-11-26 19:18:40.384198] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.616 [2024-11-26 19:18:40.384205] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.616 [2024-11-26 19:18:40.384220] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.616 qpair failed and we were unable to recover it. 00:32:23.616 [2024-11-26 19:18:40.394078] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.616 [2024-11-26 19:18:40.394139] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.616 [2024-11-26 19:18:40.394152] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.617 [2024-11-26 19:18:40.394159] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.617 [2024-11-26 19:18:40.394168] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.617 [2024-11-26 19:18:40.394183] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.617 qpair failed and we were unable to recover it. 00:32:23.617 [2024-11-26 19:18:40.404165] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.617 [2024-11-26 19:18:40.404224] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.617 [2024-11-26 19:18:40.404237] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.617 [2024-11-26 19:18:40.404243] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.617 [2024-11-26 19:18:40.404249] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.617 [2024-11-26 19:18:40.404264] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.617 qpair failed and we were unable to recover it. 00:32:23.617 [2024-11-26 19:18:40.414230] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.617 [2024-11-26 19:18:40.414280] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.617 [2024-11-26 19:18:40.414293] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.617 [2024-11-26 19:18:40.414300] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.617 [2024-11-26 19:18:40.414306] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.617 [2024-11-26 19:18:40.414321] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.617 qpair failed and we were unable to recover it. 00:32:23.617 [2024-11-26 19:18:40.424206] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.617 [2024-11-26 19:18:40.424259] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.617 [2024-11-26 19:18:40.424273] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.617 [2024-11-26 19:18:40.424280] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.617 [2024-11-26 19:18:40.424285] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.617 [2024-11-26 19:18:40.424300] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.617 qpair failed and we were unable to recover it. 00:32:23.617 [2024-11-26 19:18:40.434244] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.617 [2024-11-26 19:18:40.434299] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.617 [2024-11-26 19:18:40.434312] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.617 [2024-11-26 19:18:40.434319] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.617 [2024-11-26 19:18:40.434324] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.617 [2024-11-26 19:18:40.434339] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.617 qpair failed and we were unable to recover it. 00:32:23.617 [2024-11-26 19:18:40.444323] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.617 [2024-11-26 19:18:40.444383] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.617 [2024-11-26 19:18:40.444397] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.617 [2024-11-26 19:18:40.444403] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.617 [2024-11-26 19:18:40.444409] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.617 [2024-11-26 19:18:40.444424] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.617 qpair failed and we were unable to recover it. 00:32:23.617 [2024-11-26 19:18:40.454309] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.617 [2024-11-26 19:18:40.454362] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.617 [2024-11-26 19:18:40.454375] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.617 [2024-11-26 19:18:40.454382] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.617 [2024-11-26 19:18:40.454388] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.617 [2024-11-26 19:18:40.454403] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.617 qpair failed and we were unable to recover it. 00:32:23.617 [2024-11-26 19:18:40.464359] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.617 [2024-11-26 19:18:40.464432] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.617 [2024-11-26 19:18:40.464446] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.617 [2024-11-26 19:18:40.464453] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.617 [2024-11-26 19:18:40.464459] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.617 [2024-11-26 19:18:40.464473] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.617 qpair failed and we were unable to recover it. 00:32:23.617 [2024-11-26 19:18:40.474367] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.617 [2024-11-26 19:18:40.474424] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.617 [2024-11-26 19:18:40.474437] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.617 [2024-11-26 19:18:40.474444] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.617 [2024-11-26 19:18:40.474450] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.617 [2024-11-26 19:18:40.474464] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.617 qpair failed and we were unable to recover it. 00:32:23.617 [2024-11-26 19:18:40.484387] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.617 [2024-11-26 19:18:40.484439] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.617 [2024-11-26 19:18:40.484452] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.617 [2024-11-26 19:18:40.484462] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.617 [2024-11-26 19:18:40.484468] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.617 [2024-11-26 19:18:40.484483] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.617 qpair failed and we were unable to recover it. 00:32:23.617 [2024-11-26 19:18:40.494421] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.617 [2024-11-26 19:18:40.494478] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.617 [2024-11-26 19:18:40.494492] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.617 [2024-11-26 19:18:40.494498] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.617 [2024-11-26 19:18:40.494504] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.617 [2024-11-26 19:18:40.494518] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.617 qpair failed and we were unable to recover it. 00:32:23.617 [2024-11-26 19:18:40.504448] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.617 [2024-11-26 19:18:40.504497] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.617 [2024-11-26 19:18:40.504510] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.617 [2024-11-26 19:18:40.504517] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.617 [2024-11-26 19:18:40.504523] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.617 [2024-11-26 19:18:40.504537] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.617 qpair failed and we were unable to recover it. 00:32:23.617 [2024-11-26 19:18:40.514526] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.618 [2024-11-26 19:18:40.514579] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.618 [2024-11-26 19:18:40.514593] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.618 [2024-11-26 19:18:40.514599] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.618 [2024-11-26 19:18:40.514605] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.618 [2024-11-26 19:18:40.514619] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.618 qpair failed and we were unable to recover it. 00:32:23.618 [2024-11-26 19:18:40.524516] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.618 [2024-11-26 19:18:40.524569] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.618 [2024-11-26 19:18:40.524582] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.618 [2024-11-26 19:18:40.524589] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.618 [2024-11-26 19:18:40.524595] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.618 [2024-11-26 19:18:40.524610] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.618 qpair failed and we were unable to recover it. 00:32:23.618 [2024-11-26 19:18:40.534534] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.618 [2024-11-26 19:18:40.534588] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.618 [2024-11-26 19:18:40.534602] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.618 [2024-11-26 19:18:40.534609] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.618 [2024-11-26 19:18:40.534615] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.618 [2024-11-26 19:18:40.534629] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.618 qpair failed and we were unable to recover it. 00:32:23.877 [2024-11-26 19:18:40.544602] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.877 [2024-11-26 19:18:40.544678] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.877 [2024-11-26 19:18:40.544692] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.877 [2024-11-26 19:18:40.544698] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.877 [2024-11-26 19:18:40.544704] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.877 [2024-11-26 19:18:40.544718] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.877 qpair failed and we were unable to recover it. 00:32:23.877 [2024-11-26 19:18:40.554583] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.877 [2024-11-26 19:18:40.554639] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.877 [2024-11-26 19:18:40.554651] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.877 [2024-11-26 19:18:40.554658] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.877 [2024-11-26 19:18:40.554664] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.877 [2024-11-26 19:18:40.554679] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.877 qpair failed and we were unable to recover it. 00:32:23.877 [2024-11-26 19:18:40.564620] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.877 [2024-11-26 19:18:40.564679] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.877 [2024-11-26 19:18:40.564692] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.877 [2024-11-26 19:18:40.564698] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.877 [2024-11-26 19:18:40.564704] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.877 [2024-11-26 19:18:40.564718] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.877 qpair failed and we were unable to recover it. 00:32:23.877 [2024-11-26 19:18:40.574668] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.877 [2024-11-26 19:18:40.574766] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.877 [2024-11-26 19:18:40.574780] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.877 [2024-11-26 19:18:40.574790] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.877 [2024-11-26 19:18:40.574796] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.877 [2024-11-26 19:18:40.574812] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.877 qpair failed and we were unable to recover it. 00:32:23.877 [2024-11-26 19:18:40.584693] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.877 [2024-11-26 19:18:40.584745] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.877 [2024-11-26 19:18:40.584759] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.877 [2024-11-26 19:18:40.584765] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.877 [2024-11-26 19:18:40.584771] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.877 [2024-11-26 19:18:40.584784] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.877 qpair failed and we were unable to recover it. 00:32:23.877 [2024-11-26 19:18:40.594724] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.877 [2024-11-26 19:18:40.594777] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.877 [2024-11-26 19:18:40.594791] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.877 [2024-11-26 19:18:40.594797] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.877 [2024-11-26 19:18:40.594803] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.877 [2024-11-26 19:18:40.594817] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.877 qpair failed and we were unable to recover it. 00:32:23.877 [2024-11-26 19:18:40.604784] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.877 [2024-11-26 19:18:40.604836] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.877 [2024-11-26 19:18:40.604849] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.877 [2024-11-26 19:18:40.604855] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.877 [2024-11-26 19:18:40.604861] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.877 [2024-11-26 19:18:40.604876] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.877 qpair failed and we were unable to recover it. 00:32:23.877 [2024-11-26 19:18:40.614773] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.878 [2024-11-26 19:18:40.614828] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.878 [2024-11-26 19:18:40.614841] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.878 [2024-11-26 19:18:40.614847] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.878 [2024-11-26 19:18:40.614853] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.878 [2024-11-26 19:18:40.614868] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.878 qpair failed and we were unable to recover it. 00:32:23.878 [2024-11-26 19:18:40.624807] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.878 [2024-11-26 19:18:40.624856] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.878 [2024-11-26 19:18:40.624870] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.878 [2024-11-26 19:18:40.624877] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.878 [2024-11-26 19:18:40.624883] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.878 [2024-11-26 19:18:40.624897] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.878 qpair failed and we were unable to recover it. 00:32:23.878 [2024-11-26 19:18:40.634829] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.878 [2024-11-26 19:18:40.634882] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.878 [2024-11-26 19:18:40.634895] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.878 [2024-11-26 19:18:40.634902] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.878 [2024-11-26 19:18:40.634907] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.878 [2024-11-26 19:18:40.634922] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.878 qpair failed and we were unable to recover it. 00:32:23.878 [2024-11-26 19:18:40.644849] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.878 [2024-11-26 19:18:40.644928] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.878 [2024-11-26 19:18:40.644942] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.878 [2024-11-26 19:18:40.644953] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.878 [2024-11-26 19:18:40.644959] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.878 [2024-11-26 19:18:40.644973] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.878 qpair failed and we were unable to recover it. 00:32:23.878 [2024-11-26 19:18:40.654869] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.878 [2024-11-26 19:18:40.654923] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.878 [2024-11-26 19:18:40.654936] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.878 [2024-11-26 19:18:40.654943] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.878 [2024-11-26 19:18:40.654953] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.878 [2024-11-26 19:18:40.654967] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.878 qpair failed and we were unable to recover it. 00:32:23.878 [2024-11-26 19:18:40.664941] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.878 [2024-11-26 19:18:40.665050] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.878 [2024-11-26 19:18:40.665067] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.878 [2024-11-26 19:18:40.665074] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.878 [2024-11-26 19:18:40.665079] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.878 [2024-11-26 19:18:40.665094] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.878 qpair failed and we were unable to recover it. 00:32:23.878 [2024-11-26 19:18:40.674943] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.878 [2024-11-26 19:18:40.675004] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.878 [2024-11-26 19:18:40.675018] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.878 [2024-11-26 19:18:40.675024] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.878 [2024-11-26 19:18:40.675030] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.878 [2024-11-26 19:18:40.675045] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.878 qpair failed and we were unable to recover it. 00:32:23.878 [2024-11-26 19:18:40.684963] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.878 [2024-11-26 19:18:40.685021] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.878 [2024-11-26 19:18:40.685035] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.878 [2024-11-26 19:18:40.685042] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.878 [2024-11-26 19:18:40.685047] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.878 [2024-11-26 19:18:40.685062] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.878 qpair failed and we were unable to recover it. 00:32:23.878 [2024-11-26 19:18:40.694993] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.878 [2024-11-26 19:18:40.695094] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.878 [2024-11-26 19:18:40.695108] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.878 [2024-11-26 19:18:40.695115] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.878 [2024-11-26 19:18:40.695120] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.878 [2024-11-26 19:18:40.695135] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.878 qpair failed and we were unable to recover it. 00:32:23.878 [2024-11-26 19:18:40.705026] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.878 [2024-11-26 19:18:40.705080] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.878 [2024-11-26 19:18:40.705094] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.878 [2024-11-26 19:18:40.705100] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.878 [2024-11-26 19:18:40.705107] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.878 [2024-11-26 19:18:40.705128] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.878 qpair failed and we were unable to recover it. 00:32:23.878 [2024-11-26 19:18:40.715042] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.878 [2024-11-26 19:18:40.715100] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.878 [2024-11-26 19:18:40.715113] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.878 [2024-11-26 19:18:40.715119] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.878 [2024-11-26 19:18:40.715125] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.878 [2024-11-26 19:18:40.715140] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.878 qpair failed and we were unable to recover it. 00:32:23.878 [2024-11-26 19:18:40.725089] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.878 [2024-11-26 19:18:40.725141] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.878 [2024-11-26 19:18:40.725155] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.878 [2024-11-26 19:18:40.725161] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.878 [2024-11-26 19:18:40.725168] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.878 [2024-11-26 19:18:40.725182] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.878 qpair failed and we were unable to recover it. 00:32:23.878 [2024-11-26 19:18:40.735126] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.878 [2024-11-26 19:18:40.735184] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.878 [2024-11-26 19:18:40.735198] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.878 [2024-11-26 19:18:40.735204] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.878 [2024-11-26 19:18:40.735210] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.878 [2024-11-26 19:18:40.735224] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.878 qpair failed and we were unable to recover it. 00:32:23.878 [2024-11-26 19:18:40.745142] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.878 [2024-11-26 19:18:40.745199] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.878 [2024-11-26 19:18:40.745213] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.879 [2024-11-26 19:18:40.745220] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.879 [2024-11-26 19:18:40.745226] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.879 [2024-11-26 19:18:40.745240] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.879 qpair failed and we were unable to recover it. 00:32:23.879 [2024-11-26 19:18:40.755149] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.879 [2024-11-26 19:18:40.755208] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.879 [2024-11-26 19:18:40.755226] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.879 [2024-11-26 19:18:40.755233] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.879 [2024-11-26 19:18:40.755239] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.879 [2024-11-26 19:18:40.755255] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.879 qpair failed and we were unable to recover it. 00:32:23.879 [2024-11-26 19:18:40.765195] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.879 [2024-11-26 19:18:40.765249] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.879 [2024-11-26 19:18:40.765262] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.879 [2024-11-26 19:18:40.765269] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.879 [2024-11-26 19:18:40.765275] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.879 [2024-11-26 19:18:40.765290] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.879 qpair failed and we were unable to recover it. 00:32:23.879 [2024-11-26 19:18:40.775215] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.879 [2024-11-26 19:18:40.775266] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.879 [2024-11-26 19:18:40.775279] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.879 [2024-11-26 19:18:40.775286] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.879 [2024-11-26 19:18:40.775292] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.879 [2024-11-26 19:18:40.775307] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.879 qpair failed and we were unable to recover it. 00:32:23.879 [2024-11-26 19:18:40.785269] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.879 [2024-11-26 19:18:40.785326] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.879 [2024-11-26 19:18:40.785339] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.879 [2024-11-26 19:18:40.785346] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.879 [2024-11-26 19:18:40.785352] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.879 [2024-11-26 19:18:40.785369] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.879 qpair failed and we were unable to recover it. 00:32:23.879 [2024-11-26 19:18:40.795339] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:23.879 [2024-11-26 19:18:40.795399] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:23.879 [2024-11-26 19:18:40.795413] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:23.879 [2024-11-26 19:18:40.795420] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:23.879 [2024-11-26 19:18:40.795426] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:23.879 [2024-11-26 19:18:40.795444] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:23.879 qpair failed and we were unable to recover it. 00:32:24.140 [2024-11-26 19:18:40.805256] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.140 [2024-11-26 19:18:40.805324] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.140 [2024-11-26 19:18:40.805339] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.140 [2024-11-26 19:18:40.805345] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.140 [2024-11-26 19:18:40.805352] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.140 [2024-11-26 19:18:40.805366] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.140 qpair failed and we were unable to recover it. 00:32:24.140 [2024-11-26 19:18:40.815388] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.140 [2024-11-26 19:18:40.815496] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.140 [2024-11-26 19:18:40.815510] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.140 [2024-11-26 19:18:40.815517] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.140 [2024-11-26 19:18:40.815524] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.140 [2024-11-26 19:18:40.815539] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.140 qpair failed and we were unable to recover it. 00:32:24.140 [2024-11-26 19:18:40.825374] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.140 [2024-11-26 19:18:40.825430] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.140 [2024-11-26 19:18:40.825443] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.140 [2024-11-26 19:18:40.825450] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.140 [2024-11-26 19:18:40.825456] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.140 [2024-11-26 19:18:40.825470] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.140 qpair failed and we were unable to recover it. 00:32:24.140 [2024-11-26 19:18:40.835389] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.140 [2024-11-26 19:18:40.835486] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.140 [2024-11-26 19:18:40.835499] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.140 [2024-11-26 19:18:40.835506] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.140 [2024-11-26 19:18:40.835512] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.140 [2024-11-26 19:18:40.835527] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.140 qpair failed and we were unable to recover it. 00:32:24.140 [2024-11-26 19:18:40.845487] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.140 [2024-11-26 19:18:40.845546] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.140 [2024-11-26 19:18:40.845562] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.140 [2024-11-26 19:18:40.845568] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.140 [2024-11-26 19:18:40.845574] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.140 [2024-11-26 19:18:40.845588] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.140 qpair failed and we were unable to recover it. 00:32:24.140 [2024-11-26 19:18:40.855405] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.140 [2024-11-26 19:18:40.855461] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.140 [2024-11-26 19:18:40.855474] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.140 [2024-11-26 19:18:40.855481] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.140 [2024-11-26 19:18:40.855487] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.140 [2024-11-26 19:18:40.855501] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.140 qpair failed and we were unable to recover it. 00:32:24.140 [2024-11-26 19:18:40.865503] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.140 [2024-11-26 19:18:40.865572] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.140 [2024-11-26 19:18:40.865586] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.140 [2024-11-26 19:18:40.865592] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.140 [2024-11-26 19:18:40.865598] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.140 [2024-11-26 19:18:40.865612] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.140 qpair failed and we were unable to recover it. 00:32:24.140 [2024-11-26 19:18:40.875592] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.140 [2024-11-26 19:18:40.875667] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.140 [2024-11-26 19:18:40.875680] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.140 [2024-11-26 19:18:40.875687] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.140 [2024-11-26 19:18:40.875694] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.140 [2024-11-26 19:18:40.875709] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.140 qpair failed and we were unable to recover it. 00:32:24.140 [2024-11-26 19:18:40.885530] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.140 [2024-11-26 19:18:40.885584] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.140 [2024-11-26 19:18:40.885598] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.140 [2024-11-26 19:18:40.885604] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.140 [2024-11-26 19:18:40.885613] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.140 [2024-11-26 19:18:40.885629] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.140 qpair failed and we were unable to recover it. 00:32:24.140 [2024-11-26 19:18:40.895651] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.140 [2024-11-26 19:18:40.895702] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.140 [2024-11-26 19:18:40.895716] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.140 [2024-11-26 19:18:40.895722] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.140 [2024-11-26 19:18:40.895728] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.140 [2024-11-26 19:18:40.895742] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.140 qpair failed and we were unable to recover it. 00:32:24.140 [2024-11-26 19:18:40.905631] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.140 [2024-11-26 19:18:40.905687] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.140 [2024-11-26 19:18:40.905701] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.140 [2024-11-26 19:18:40.905707] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.140 [2024-11-26 19:18:40.905713] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.140 [2024-11-26 19:18:40.905727] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.140 qpair failed and we were unable to recover it. 00:32:24.140 [2024-11-26 19:18:40.915667] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.140 [2024-11-26 19:18:40.915722] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.140 [2024-11-26 19:18:40.915736] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.140 [2024-11-26 19:18:40.915742] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.141 [2024-11-26 19:18:40.915748] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.141 [2024-11-26 19:18:40.915763] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.141 qpair failed and we were unable to recover it. 00:32:24.141 [2024-11-26 19:18:40.925706] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.141 [2024-11-26 19:18:40.925765] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.141 [2024-11-26 19:18:40.925780] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.141 [2024-11-26 19:18:40.925787] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.141 [2024-11-26 19:18:40.925793] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.141 [2024-11-26 19:18:40.925808] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.141 qpair failed and we were unable to recover it. 00:32:24.141 [2024-11-26 19:18:40.935726] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.141 [2024-11-26 19:18:40.935781] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.141 [2024-11-26 19:18:40.935794] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.141 [2024-11-26 19:18:40.935801] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.141 [2024-11-26 19:18:40.935807] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.141 [2024-11-26 19:18:40.935822] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.141 qpair failed and we were unable to recover it. 00:32:24.141 [2024-11-26 19:18:40.945737] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.141 [2024-11-26 19:18:40.945795] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.141 [2024-11-26 19:18:40.945809] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.141 [2024-11-26 19:18:40.945816] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.141 [2024-11-26 19:18:40.945822] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.141 [2024-11-26 19:18:40.945837] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.141 qpair failed and we were unable to recover it. 00:32:24.141 [2024-11-26 19:18:40.955720] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.141 [2024-11-26 19:18:40.955775] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.141 [2024-11-26 19:18:40.955789] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.141 [2024-11-26 19:18:40.955796] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.141 [2024-11-26 19:18:40.955801] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.141 [2024-11-26 19:18:40.955816] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.141 qpair failed and we were unable to recover it. 00:32:24.141 [2024-11-26 19:18:40.965788] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.141 [2024-11-26 19:18:40.965843] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.141 [2024-11-26 19:18:40.965857] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.141 [2024-11-26 19:18:40.965863] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.141 [2024-11-26 19:18:40.965869] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.141 [2024-11-26 19:18:40.965884] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.141 qpair failed and we were unable to recover it. 00:32:24.141 [2024-11-26 19:18:40.975848] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.141 [2024-11-26 19:18:40.975913] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.141 [2024-11-26 19:18:40.975927] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.141 [2024-11-26 19:18:40.975933] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.141 [2024-11-26 19:18:40.975943] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.141 [2024-11-26 19:18:40.975963] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.141 qpair failed and we were unable to recover it. 00:32:24.141 [2024-11-26 19:18:40.985855] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.141 [2024-11-26 19:18:40.985910] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.141 [2024-11-26 19:18:40.985923] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.141 [2024-11-26 19:18:40.985930] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.141 [2024-11-26 19:18:40.985935] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.141 [2024-11-26 19:18:40.985954] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.141 qpair failed and we were unable to recover it. 00:32:24.141 [2024-11-26 19:18:40.995925] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.141 [2024-11-26 19:18:40.995981] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.141 [2024-11-26 19:18:40.995995] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.141 [2024-11-26 19:18:40.996002] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.141 [2024-11-26 19:18:40.996008] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.141 [2024-11-26 19:18:40.996022] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.141 qpair failed and we were unable to recover it. 00:32:24.141 [2024-11-26 19:18:41.005934] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.141 [2024-11-26 19:18:41.006001] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.141 [2024-11-26 19:18:41.006014] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.141 [2024-11-26 19:18:41.006021] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.141 [2024-11-26 19:18:41.006027] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.141 [2024-11-26 19:18:41.006041] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.141 qpair failed and we were unable to recover it. 00:32:24.141 [2024-11-26 19:18:41.015961] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.141 [2024-11-26 19:18:41.016021] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.141 [2024-11-26 19:18:41.016034] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.141 [2024-11-26 19:18:41.016041] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.141 [2024-11-26 19:18:41.016047] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.141 [2024-11-26 19:18:41.016062] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.141 qpair failed and we were unable to recover it. 00:32:24.141 [2024-11-26 19:18:41.025964] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.141 [2024-11-26 19:18:41.026018] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.141 [2024-11-26 19:18:41.026031] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.141 [2024-11-26 19:18:41.026038] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.141 [2024-11-26 19:18:41.026044] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.141 [2024-11-26 19:18:41.026058] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.141 qpair failed and we were unable to recover it. 00:32:24.141 [2024-11-26 19:18:41.035991] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.141 [2024-11-26 19:18:41.036045] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.141 [2024-11-26 19:18:41.036058] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.141 [2024-11-26 19:18:41.036065] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.141 [2024-11-26 19:18:41.036070] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.141 [2024-11-26 19:18:41.036085] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.141 qpair failed and we were unable to recover it. 00:32:24.141 [2024-11-26 19:18:41.046024] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.141 [2024-11-26 19:18:41.046084] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.141 [2024-11-26 19:18:41.046097] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.141 [2024-11-26 19:18:41.046104] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.141 [2024-11-26 19:18:41.046110] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.141 [2024-11-26 19:18:41.046125] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.141 qpair failed and we were unable to recover it. 00:32:24.142 [2024-11-26 19:18:41.056061] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.142 [2024-11-26 19:18:41.056111] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.142 [2024-11-26 19:18:41.056124] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.142 [2024-11-26 19:18:41.056130] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.142 [2024-11-26 19:18:41.056136] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.142 [2024-11-26 19:18:41.056151] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.142 qpair failed and we were unable to recover it. 00:32:24.401 [2024-11-26 19:18:41.066121] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.401 [2024-11-26 19:18:41.066177] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.401 [2024-11-26 19:18:41.066190] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.401 [2024-11-26 19:18:41.066199] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.401 [2024-11-26 19:18:41.066205] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.401 [2024-11-26 19:18:41.066220] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.401 qpair failed and we were unable to recover it. 00:32:24.401 [2024-11-26 19:18:41.076119] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.401 [2024-11-26 19:18:41.076177] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.401 [2024-11-26 19:18:41.076190] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.401 [2024-11-26 19:18:41.076197] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.401 [2024-11-26 19:18:41.076202] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.401 [2024-11-26 19:18:41.076217] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.401 qpair failed and we were unable to recover it. 00:32:24.401 [2024-11-26 19:18:41.086171] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.401 [2024-11-26 19:18:41.086234] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.401 [2024-11-26 19:18:41.086249] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.401 [2024-11-26 19:18:41.086256] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.401 [2024-11-26 19:18:41.086262] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.401 [2024-11-26 19:18:41.086276] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.401 qpair failed and we were unable to recover it. 00:32:24.401 [2024-11-26 19:18:41.096143] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.401 [2024-11-26 19:18:41.096202] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.401 [2024-11-26 19:18:41.096214] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.401 [2024-11-26 19:18:41.096221] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.401 [2024-11-26 19:18:41.096227] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.401 [2024-11-26 19:18:41.096242] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.401 qpair failed and we were unable to recover it. 00:32:24.401 [2024-11-26 19:18:41.106205] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.401 [2024-11-26 19:18:41.106264] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.401 [2024-11-26 19:18:41.106277] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.401 [2024-11-26 19:18:41.106284] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.401 [2024-11-26 19:18:41.106290] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.401 [2024-11-26 19:18:41.106305] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.401 qpair failed and we were unable to recover it. 00:32:24.401 [2024-11-26 19:18:41.116160] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.401 [2024-11-26 19:18:41.116216] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.401 [2024-11-26 19:18:41.116229] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.401 [2024-11-26 19:18:41.116236] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.401 [2024-11-26 19:18:41.116242] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.401 [2024-11-26 19:18:41.116257] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.401 qpair failed and we were unable to recover it. 00:32:24.401 [2024-11-26 19:18:41.126272] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.401 [2024-11-26 19:18:41.126329] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.401 [2024-11-26 19:18:41.126342] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.401 [2024-11-26 19:18:41.126349] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.401 [2024-11-26 19:18:41.126355] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.401 [2024-11-26 19:18:41.126369] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.401 qpair failed and we were unable to recover it. 00:32:24.401 [2024-11-26 19:18:41.136280] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.401 [2024-11-26 19:18:41.136335] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.401 [2024-11-26 19:18:41.136349] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.401 [2024-11-26 19:18:41.136356] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.401 [2024-11-26 19:18:41.136362] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.401 [2024-11-26 19:18:41.136377] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.401 qpair failed and we were unable to recover it. 00:32:24.401 [2024-11-26 19:18:41.146350] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.401 [2024-11-26 19:18:41.146402] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.401 [2024-11-26 19:18:41.146415] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.401 [2024-11-26 19:18:41.146422] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.401 [2024-11-26 19:18:41.146427] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.401 [2024-11-26 19:18:41.146442] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.401 qpair failed and we were unable to recover it. 00:32:24.401 [2024-11-26 19:18:41.156273] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.401 [2024-11-26 19:18:41.156330] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.401 [2024-11-26 19:18:41.156344] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.401 [2024-11-26 19:18:41.156353] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.401 [2024-11-26 19:18:41.156360] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.401 [2024-11-26 19:18:41.156374] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.401 qpair failed and we were unable to recover it. 00:32:24.401 [2024-11-26 19:18:41.166296] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.401 [2024-11-26 19:18:41.166352] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.401 [2024-11-26 19:18:41.166366] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.401 [2024-11-26 19:18:41.166373] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.401 [2024-11-26 19:18:41.166379] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.401 [2024-11-26 19:18:41.166393] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.401 qpair failed and we were unable to recover it. 00:32:24.401 [2024-11-26 19:18:41.176392] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.401 [2024-11-26 19:18:41.176452] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.402 [2024-11-26 19:18:41.176465] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.402 [2024-11-26 19:18:41.176471] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.402 [2024-11-26 19:18:41.176477] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.402 [2024-11-26 19:18:41.176492] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.402 qpair failed and we were unable to recover it. 00:32:24.402 [2024-11-26 19:18:41.186448] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.402 [2024-11-26 19:18:41.186499] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.402 [2024-11-26 19:18:41.186512] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.402 [2024-11-26 19:18:41.186519] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.402 [2024-11-26 19:18:41.186524] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.402 [2024-11-26 19:18:41.186538] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.402 qpair failed and we were unable to recover it. 00:32:24.402 [2024-11-26 19:18:41.196471] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.402 [2024-11-26 19:18:41.196526] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.402 [2024-11-26 19:18:41.196540] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.402 [2024-11-26 19:18:41.196546] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.402 [2024-11-26 19:18:41.196552] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.402 [2024-11-26 19:18:41.196566] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.402 qpair failed and we were unable to recover it. 00:32:24.402 [2024-11-26 19:18:41.206490] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.402 [2024-11-26 19:18:41.206546] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.402 [2024-11-26 19:18:41.206559] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.402 [2024-11-26 19:18:41.206565] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.402 [2024-11-26 19:18:41.206571] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.402 [2024-11-26 19:18:41.206586] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.402 qpair failed and we were unable to recover it. 00:32:24.402 [2024-11-26 19:18:41.216523] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.402 [2024-11-26 19:18:41.216580] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.402 [2024-11-26 19:18:41.216593] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.402 [2024-11-26 19:18:41.216599] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.402 [2024-11-26 19:18:41.216605] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.402 [2024-11-26 19:18:41.216619] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.402 qpair failed and we were unable to recover it. 00:32:24.402 [2024-11-26 19:18:41.226579] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.402 [2024-11-26 19:18:41.226635] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.402 [2024-11-26 19:18:41.226648] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.402 [2024-11-26 19:18:41.226655] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.402 [2024-11-26 19:18:41.226661] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.402 [2024-11-26 19:18:41.226676] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.402 qpair failed and we were unable to recover it. 00:32:24.402 [2024-11-26 19:18:41.236583] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.402 [2024-11-26 19:18:41.236639] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.402 [2024-11-26 19:18:41.236653] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.402 [2024-11-26 19:18:41.236659] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.402 [2024-11-26 19:18:41.236666] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.402 [2024-11-26 19:18:41.236680] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.402 qpair failed and we were unable to recover it. 00:32:24.402 [2024-11-26 19:18:41.246609] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.402 [2024-11-26 19:18:41.246688] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.402 [2024-11-26 19:18:41.246705] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.402 [2024-11-26 19:18:41.246712] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.402 [2024-11-26 19:18:41.246718] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.402 [2024-11-26 19:18:41.246732] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.402 qpair failed and we were unable to recover it. 00:32:24.402 [2024-11-26 19:18:41.256586] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.402 [2024-11-26 19:18:41.256635] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.402 [2024-11-26 19:18:41.256648] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.402 [2024-11-26 19:18:41.256655] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.402 [2024-11-26 19:18:41.256660] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.402 [2024-11-26 19:18:41.256675] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.402 qpair failed and we were unable to recover it. 00:32:24.402 [2024-11-26 19:18:41.266676] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.402 [2024-11-26 19:18:41.266722] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.402 [2024-11-26 19:18:41.266735] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.402 [2024-11-26 19:18:41.266742] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.402 [2024-11-26 19:18:41.266748] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.402 [2024-11-26 19:18:41.266762] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.402 qpair failed and we were unable to recover it. 00:32:24.402 [2024-11-26 19:18:41.276702] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.402 [2024-11-26 19:18:41.276755] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.402 [2024-11-26 19:18:41.276768] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.402 [2024-11-26 19:18:41.276775] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.402 [2024-11-26 19:18:41.276781] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.402 [2024-11-26 19:18:41.276796] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.402 qpair failed and we were unable to recover it. 00:32:24.402 [2024-11-26 19:18:41.286734] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.402 [2024-11-26 19:18:41.286790] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.402 [2024-11-26 19:18:41.286804] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.402 [2024-11-26 19:18:41.286811] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.402 [2024-11-26 19:18:41.286816] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.402 [2024-11-26 19:18:41.286834] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.402 qpair failed and we were unable to recover it. 00:32:24.402 [2024-11-26 19:18:41.296765] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.402 [2024-11-26 19:18:41.296826] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.402 [2024-11-26 19:18:41.296839] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.402 [2024-11-26 19:18:41.296845] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.402 [2024-11-26 19:18:41.296852] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.402 [2024-11-26 19:18:41.296867] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.402 qpair failed and we were unable to recover it. 00:32:24.402 [2024-11-26 19:18:41.306787] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.402 [2024-11-26 19:18:41.306838] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.402 [2024-11-26 19:18:41.306852] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.402 [2024-11-26 19:18:41.306858] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.402 [2024-11-26 19:18:41.306865] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.402 [2024-11-26 19:18:41.306879] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.403 qpair failed and we were unable to recover it. 00:32:24.403 [2024-11-26 19:18:41.316817] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.403 [2024-11-26 19:18:41.316882] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.403 [2024-11-26 19:18:41.316895] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.403 [2024-11-26 19:18:41.316902] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.403 [2024-11-26 19:18:41.316908] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.403 [2024-11-26 19:18:41.316923] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.403 qpair failed and we were unable to recover it. 00:32:24.662 [2024-11-26 19:18:41.326862] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.662 [2024-11-26 19:18:41.326920] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.662 [2024-11-26 19:18:41.326934] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.662 [2024-11-26 19:18:41.326940] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.662 [2024-11-26 19:18:41.326946] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.662 [2024-11-26 19:18:41.326964] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.662 qpair failed and we were unable to recover it. 00:32:24.662 [2024-11-26 19:18:41.336877] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.662 [2024-11-26 19:18:41.336935] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.662 [2024-11-26 19:18:41.336955] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.662 [2024-11-26 19:18:41.336961] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.662 [2024-11-26 19:18:41.336967] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.662 [2024-11-26 19:18:41.336982] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.662 qpair failed and we were unable to recover it. 00:32:24.662 [2024-11-26 19:18:41.346835] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.663 [2024-11-26 19:18:41.346891] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.663 [2024-11-26 19:18:41.346904] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.663 [2024-11-26 19:18:41.346911] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.663 [2024-11-26 19:18:41.346917] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.663 [2024-11-26 19:18:41.346931] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.663 qpair failed and we were unable to recover it. 00:32:24.663 [2024-11-26 19:18:41.356984] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.663 [2024-11-26 19:18:41.357047] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.663 [2024-11-26 19:18:41.357061] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.663 [2024-11-26 19:18:41.357068] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.663 [2024-11-26 19:18:41.357074] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.663 [2024-11-26 19:18:41.357089] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.663 qpair failed and we were unable to recover it. 00:32:24.663 [2024-11-26 19:18:41.366959] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.663 [2024-11-26 19:18:41.367021] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.663 [2024-11-26 19:18:41.367036] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.663 [2024-11-26 19:18:41.367043] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.663 [2024-11-26 19:18:41.367051] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.663 [2024-11-26 19:18:41.367066] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.663 qpair failed and we were unable to recover it. 00:32:24.663 [2024-11-26 19:18:41.376979] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.663 [2024-11-26 19:18:41.377029] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.663 [2024-11-26 19:18:41.377043] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.663 [2024-11-26 19:18:41.377050] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.663 [2024-11-26 19:18:41.377060] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.663 [2024-11-26 19:18:41.377074] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.663 qpair failed and we were unable to recover it. 00:32:24.663 [2024-11-26 19:18:41.387045] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.663 [2024-11-26 19:18:41.387098] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.663 [2024-11-26 19:18:41.387112] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.663 [2024-11-26 19:18:41.387119] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.663 [2024-11-26 19:18:41.387125] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.663 [2024-11-26 19:18:41.387140] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.663 qpair failed and we were unable to recover it. 00:32:24.663 [2024-11-26 19:18:41.397069] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.663 [2024-11-26 19:18:41.397122] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.663 [2024-11-26 19:18:41.397136] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.663 [2024-11-26 19:18:41.397143] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.663 [2024-11-26 19:18:41.397149] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.663 [2024-11-26 19:18:41.397164] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.663 qpair failed and we were unable to recover it. 00:32:24.663 [2024-11-26 19:18:41.407084] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.663 [2024-11-26 19:18:41.407142] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.663 [2024-11-26 19:18:41.407155] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.663 [2024-11-26 19:18:41.407162] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.663 [2024-11-26 19:18:41.407168] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.663 [2024-11-26 19:18:41.407182] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.663 qpair failed and we were unable to recover it. 00:32:24.663 [2024-11-26 19:18:41.417104] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.663 [2024-11-26 19:18:41.417159] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.663 [2024-11-26 19:18:41.417172] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.663 [2024-11-26 19:18:41.417179] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.663 [2024-11-26 19:18:41.417184] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.663 [2024-11-26 19:18:41.417199] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.663 qpair failed and we were unable to recover it. 00:32:24.663 [2024-11-26 19:18:41.427127] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.663 [2024-11-26 19:18:41.427189] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.663 [2024-11-26 19:18:41.427202] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.663 [2024-11-26 19:18:41.427208] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.663 [2024-11-26 19:18:41.427214] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.663 [2024-11-26 19:18:41.427230] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.663 qpair failed and we were unable to recover it. 00:32:24.663 [2024-11-26 19:18:41.437100] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.663 [2024-11-26 19:18:41.437156] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.663 [2024-11-26 19:18:41.437169] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.663 [2024-11-26 19:18:41.437175] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.663 [2024-11-26 19:18:41.437182] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.663 [2024-11-26 19:18:41.437196] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.663 qpair failed and we were unable to recover it. 00:32:24.663 [2024-11-26 19:18:41.447189] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.663 [2024-11-26 19:18:41.447246] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.663 [2024-11-26 19:18:41.447259] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.663 [2024-11-26 19:18:41.447265] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.663 [2024-11-26 19:18:41.447271] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.663 [2024-11-26 19:18:41.447285] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.663 qpair failed and we were unable to recover it. 00:32:24.663 [2024-11-26 19:18:41.457211] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.663 [2024-11-26 19:18:41.457265] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.663 [2024-11-26 19:18:41.457279] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.663 [2024-11-26 19:18:41.457285] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.663 [2024-11-26 19:18:41.457291] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.663 [2024-11-26 19:18:41.457305] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.663 qpair failed and we were unable to recover it. 00:32:24.663 [2024-11-26 19:18:41.467197] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.663 [2024-11-26 19:18:41.467252] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.663 [2024-11-26 19:18:41.467266] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.663 [2024-11-26 19:18:41.467273] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.663 [2024-11-26 19:18:41.467283] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.663 [2024-11-26 19:18:41.467298] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.663 qpair failed and we were unable to recover it. 00:32:24.663 [2024-11-26 19:18:41.477331] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.663 [2024-11-26 19:18:41.477386] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.663 [2024-11-26 19:18:41.477399] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.663 [2024-11-26 19:18:41.477405] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.664 [2024-11-26 19:18:41.477411] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.664 [2024-11-26 19:18:41.477425] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.664 qpair failed and we were unable to recover it. 00:32:24.664 [2024-11-26 19:18:41.487354] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.664 [2024-11-26 19:18:41.487408] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.664 [2024-11-26 19:18:41.487422] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.664 [2024-11-26 19:18:41.487428] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.664 [2024-11-26 19:18:41.487434] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.664 [2024-11-26 19:18:41.487449] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.664 qpair failed and we were unable to recover it. 00:32:24.664 [2024-11-26 19:18:41.497347] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.664 [2024-11-26 19:18:41.497401] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.664 [2024-11-26 19:18:41.497415] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.664 [2024-11-26 19:18:41.497421] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.664 [2024-11-26 19:18:41.497427] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.664 [2024-11-26 19:18:41.497442] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.664 qpair failed and we were unable to recover it. 00:32:24.664 [2024-11-26 19:18:41.507373] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.664 [2024-11-26 19:18:41.507429] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.664 [2024-11-26 19:18:41.507442] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.664 [2024-11-26 19:18:41.507449] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.664 [2024-11-26 19:18:41.507455] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.664 [2024-11-26 19:18:41.507469] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.664 qpair failed and we were unable to recover it. 00:32:24.664 [2024-11-26 19:18:41.517399] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.664 [2024-11-26 19:18:41.517457] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.664 [2024-11-26 19:18:41.517470] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.664 [2024-11-26 19:18:41.517476] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.664 [2024-11-26 19:18:41.517482] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.664 [2024-11-26 19:18:41.517497] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.664 qpair failed and we were unable to recover it. 00:32:24.664 [2024-11-26 19:18:41.527466] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.664 [2024-11-26 19:18:41.527522] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.664 [2024-11-26 19:18:41.527535] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.664 [2024-11-26 19:18:41.527541] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.664 [2024-11-26 19:18:41.527547] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.664 [2024-11-26 19:18:41.527561] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.664 qpair failed and we were unable to recover it. 00:32:24.664 [2024-11-26 19:18:41.537458] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.664 [2024-11-26 19:18:41.537511] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.664 [2024-11-26 19:18:41.537524] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.664 [2024-11-26 19:18:41.537530] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.664 [2024-11-26 19:18:41.537536] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.664 [2024-11-26 19:18:41.537550] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.664 qpair failed and we were unable to recover it. 00:32:24.664 [2024-11-26 19:18:41.547519] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.664 [2024-11-26 19:18:41.547571] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.664 [2024-11-26 19:18:41.547585] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.664 [2024-11-26 19:18:41.547591] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.664 [2024-11-26 19:18:41.547597] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.664 [2024-11-26 19:18:41.547612] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.664 qpair failed and we were unable to recover it. 00:32:24.664 [2024-11-26 19:18:41.557521] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.664 [2024-11-26 19:18:41.557600] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.664 [2024-11-26 19:18:41.557614] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.664 [2024-11-26 19:18:41.557623] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.664 [2024-11-26 19:18:41.557629] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.664 [2024-11-26 19:18:41.557643] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.664 qpair failed and we were unable to recover it. 00:32:24.664 [2024-11-26 19:18:41.567473] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.664 [2024-11-26 19:18:41.567532] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.664 [2024-11-26 19:18:41.567545] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.664 [2024-11-26 19:18:41.567552] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.664 [2024-11-26 19:18:41.567558] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.664 [2024-11-26 19:18:41.567572] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.664 qpair failed and we were unable to recover it. 00:32:24.664 [2024-11-26 19:18:41.577564] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.664 [2024-11-26 19:18:41.577623] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.664 [2024-11-26 19:18:41.577636] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.664 [2024-11-26 19:18:41.577642] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.664 [2024-11-26 19:18:41.577648] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.664 [2024-11-26 19:18:41.577663] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.664 qpair failed and we were unable to recover it. 00:32:24.924 [2024-11-26 19:18:41.587604] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.924 [2024-11-26 19:18:41.587659] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.924 [2024-11-26 19:18:41.587673] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.924 [2024-11-26 19:18:41.587679] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.924 [2024-11-26 19:18:41.587685] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.924 [2024-11-26 19:18:41.587699] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.924 qpair failed and we were unable to recover it. 00:32:24.924 [2024-11-26 19:18:41.597668] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.924 [2024-11-26 19:18:41.597726] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.924 [2024-11-26 19:18:41.597739] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.924 [2024-11-26 19:18:41.597746] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.924 [2024-11-26 19:18:41.597752] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.924 [2024-11-26 19:18:41.597767] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.924 qpair failed and we were unable to recover it. 00:32:24.924 [2024-11-26 19:18:41.607660] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.924 [2024-11-26 19:18:41.607733] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.924 [2024-11-26 19:18:41.607750] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.924 [2024-11-26 19:18:41.607757] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.924 [2024-11-26 19:18:41.607762] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.924 [2024-11-26 19:18:41.607777] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.924 qpair failed and we were unable to recover it. 00:32:24.924 [2024-11-26 19:18:41.617747] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.924 [2024-11-26 19:18:41.617830] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.924 [2024-11-26 19:18:41.617844] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.924 [2024-11-26 19:18:41.617850] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.924 [2024-11-26 19:18:41.617856] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.924 [2024-11-26 19:18:41.617871] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.924 qpair failed and we were unable to recover it. 00:32:24.924 [2024-11-26 19:18:41.627707] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.924 [2024-11-26 19:18:41.627762] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.924 [2024-11-26 19:18:41.627775] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.924 [2024-11-26 19:18:41.627781] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.924 [2024-11-26 19:18:41.627787] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.924 [2024-11-26 19:18:41.627802] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.924 qpair failed and we were unable to recover it. 00:32:24.924 [2024-11-26 19:18:41.637741] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.924 [2024-11-26 19:18:41.637793] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.924 [2024-11-26 19:18:41.637806] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.924 [2024-11-26 19:18:41.637813] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.924 [2024-11-26 19:18:41.637818] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.924 [2024-11-26 19:18:41.637834] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.924 qpair failed and we were unable to recover it. 00:32:24.924 [2024-11-26 19:18:41.647777] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.924 [2024-11-26 19:18:41.647835] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.924 [2024-11-26 19:18:41.647848] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.924 [2024-11-26 19:18:41.647858] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.924 [2024-11-26 19:18:41.647864] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.924 [2024-11-26 19:18:41.647879] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.924 qpair failed and we were unable to recover it. 00:32:24.924 [2024-11-26 19:18:41.657805] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.924 [2024-11-26 19:18:41.657859] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.924 [2024-11-26 19:18:41.657872] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.924 [2024-11-26 19:18:41.657879] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.925 [2024-11-26 19:18:41.657885] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.925 [2024-11-26 19:18:41.657900] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.925 qpair failed and we were unable to recover it. 00:32:24.925 [2024-11-26 19:18:41.667834] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.925 [2024-11-26 19:18:41.667890] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.925 [2024-11-26 19:18:41.667904] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.925 [2024-11-26 19:18:41.667910] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.925 [2024-11-26 19:18:41.667916] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.925 [2024-11-26 19:18:41.667930] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.925 qpair failed and we were unable to recover it. 00:32:24.925 [2024-11-26 19:18:41.677860] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.925 [2024-11-26 19:18:41.677918] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.925 [2024-11-26 19:18:41.677931] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.925 [2024-11-26 19:18:41.677938] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.925 [2024-11-26 19:18:41.677944] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.925 [2024-11-26 19:18:41.677964] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.925 qpair failed and we were unable to recover it. 00:32:24.925 [2024-11-26 19:18:41.687895] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.925 [2024-11-26 19:18:41.687951] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.925 [2024-11-26 19:18:41.687975] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.925 [2024-11-26 19:18:41.687983] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.925 [2024-11-26 19:18:41.687989] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.925 [2024-11-26 19:18:41.688008] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.925 qpair failed and we were unable to recover it. 00:32:24.925 [2024-11-26 19:18:41.697928] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.925 [2024-11-26 19:18:41.697985] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.925 [2024-11-26 19:18:41.697999] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.925 [2024-11-26 19:18:41.698005] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.925 [2024-11-26 19:18:41.698011] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.925 [2024-11-26 19:18:41.698026] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.925 qpair failed and we were unable to recover it. 00:32:24.925 [2024-11-26 19:18:41.707987] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.925 [2024-11-26 19:18:41.708044] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.925 [2024-11-26 19:18:41.708058] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.925 [2024-11-26 19:18:41.708064] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.925 [2024-11-26 19:18:41.708070] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.925 [2024-11-26 19:18:41.708086] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.925 qpair failed and we were unable to recover it. 00:32:24.925 [2024-11-26 19:18:41.717986] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.925 [2024-11-26 19:18:41.718039] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.925 [2024-11-26 19:18:41.718053] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.925 [2024-11-26 19:18:41.718059] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.925 [2024-11-26 19:18:41.718065] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.925 [2024-11-26 19:18:41.718080] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.925 qpair failed and we were unable to recover it. 00:32:24.925 [2024-11-26 19:18:41.728005] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.925 [2024-11-26 19:18:41.728060] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.925 [2024-11-26 19:18:41.728074] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.925 [2024-11-26 19:18:41.728080] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.925 [2024-11-26 19:18:41.728086] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.925 [2024-11-26 19:18:41.728100] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.925 qpair failed and we were unable to recover it. 00:32:24.925 [2024-11-26 19:18:41.738021] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.925 [2024-11-26 19:18:41.738083] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.925 [2024-11-26 19:18:41.738099] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.925 [2024-11-26 19:18:41.738106] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.925 [2024-11-26 19:18:41.738112] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.925 [2024-11-26 19:18:41.738127] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.925 qpair failed and we were unable to recover it. 00:32:24.925 [2024-11-26 19:18:41.748069] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.925 [2024-11-26 19:18:41.748124] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.925 [2024-11-26 19:18:41.748137] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.925 [2024-11-26 19:18:41.748144] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.925 [2024-11-26 19:18:41.748150] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.925 [2024-11-26 19:18:41.748164] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.925 qpair failed and we were unable to recover it. 00:32:24.925 [2024-11-26 19:18:41.758102] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.925 [2024-11-26 19:18:41.758158] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.925 [2024-11-26 19:18:41.758172] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.925 [2024-11-26 19:18:41.758179] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.925 [2024-11-26 19:18:41.758185] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.925 [2024-11-26 19:18:41.758201] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.925 qpair failed and we were unable to recover it. 00:32:24.925 [2024-11-26 19:18:41.768054] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.925 [2024-11-26 19:18:41.768108] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.925 [2024-11-26 19:18:41.768122] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.925 [2024-11-26 19:18:41.768128] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.925 [2024-11-26 19:18:41.768134] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.925 [2024-11-26 19:18:41.768148] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.925 qpair failed and we were unable to recover it. 00:32:24.925 [2024-11-26 19:18:41.778203] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.925 [2024-11-26 19:18:41.778262] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.925 [2024-11-26 19:18:41.778276] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.925 [2024-11-26 19:18:41.778282] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.925 [2024-11-26 19:18:41.778288] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.925 [2024-11-26 19:18:41.778306] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.925 qpair failed and we were unable to recover it. 00:32:24.925 [2024-11-26 19:18:41.788152] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.925 [2024-11-26 19:18:41.788211] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.925 [2024-11-26 19:18:41.788224] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.925 [2024-11-26 19:18:41.788231] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.925 [2024-11-26 19:18:41.788237] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.925 [2024-11-26 19:18:41.788252] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.925 qpair failed and we were unable to recover it. 00:32:24.925 [2024-11-26 19:18:41.798138] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.926 [2024-11-26 19:18:41.798190] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.926 [2024-11-26 19:18:41.798203] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.926 [2024-11-26 19:18:41.798209] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.926 [2024-11-26 19:18:41.798215] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.926 [2024-11-26 19:18:41.798229] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.926 qpair failed and we were unable to recover it. 00:32:24.926 [2024-11-26 19:18:41.808270] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.926 [2024-11-26 19:18:41.808340] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.926 [2024-11-26 19:18:41.808356] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.926 [2024-11-26 19:18:41.808363] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.926 [2024-11-26 19:18:41.808369] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.926 [2024-11-26 19:18:41.808383] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.926 qpair failed and we were unable to recover it. 00:32:24.926 [2024-11-26 19:18:41.818301] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.926 [2024-11-26 19:18:41.818355] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.926 [2024-11-26 19:18:41.818367] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.926 [2024-11-26 19:18:41.818374] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.926 [2024-11-26 19:18:41.818379] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.926 [2024-11-26 19:18:41.818394] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.926 qpair failed and we were unable to recover it. 00:32:24.926 [2024-11-26 19:18:41.828289] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.926 [2024-11-26 19:18:41.828343] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.926 [2024-11-26 19:18:41.828359] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.926 [2024-11-26 19:18:41.828365] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.926 [2024-11-26 19:18:41.828371] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.926 [2024-11-26 19:18:41.828386] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.926 qpair failed and we were unable to recover it. 00:32:24.926 [2024-11-26 19:18:41.838329] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:24.926 [2024-11-26 19:18:41.838383] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:24.926 [2024-11-26 19:18:41.838396] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:24.926 [2024-11-26 19:18:41.838403] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:24.926 [2024-11-26 19:18:41.838409] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:24.926 [2024-11-26 19:18:41.838424] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:24.926 qpair failed and we were unable to recover it. 00:32:25.185 [2024-11-26 19:18:41.848412] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.185 [2024-11-26 19:18:41.848474] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.185 [2024-11-26 19:18:41.848487] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.185 [2024-11-26 19:18:41.848494] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.185 [2024-11-26 19:18:41.848500] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.185 [2024-11-26 19:18:41.848514] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.185 qpair failed and we were unable to recover it. 00:32:25.185 [2024-11-26 19:18:41.858383] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.185 [2024-11-26 19:18:41.858437] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.185 [2024-11-26 19:18:41.858450] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.185 [2024-11-26 19:18:41.858456] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.185 [2024-11-26 19:18:41.858462] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.185 [2024-11-26 19:18:41.858477] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.185 qpair failed and we were unable to recover it. 00:32:25.185 [2024-11-26 19:18:41.868328] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.185 [2024-11-26 19:18:41.868385] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.185 [2024-11-26 19:18:41.868398] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.185 [2024-11-26 19:18:41.868404] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.185 [2024-11-26 19:18:41.868410] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.185 [2024-11-26 19:18:41.868428] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.185 qpair failed and we were unable to recover it. 00:32:25.185 [2024-11-26 19:18:41.878482] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.185 [2024-11-26 19:18:41.878537] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.185 [2024-11-26 19:18:41.878551] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.185 [2024-11-26 19:18:41.878557] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.185 [2024-11-26 19:18:41.878563] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.185 [2024-11-26 19:18:41.878578] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.185 qpair failed and we were unable to recover it. 00:32:25.185 [2024-11-26 19:18:41.888480] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.185 [2024-11-26 19:18:41.888537] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.185 [2024-11-26 19:18:41.888550] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.185 [2024-11-26 19:18:41.888556] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.186 [2024-11-26 19:18:41.888562] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.186 [2024-11-26 19:18:41.888577] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.186 qpair failed and we were unable to recover it. 00:32:25.186 [2024-11-26 19:18:41.898509] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.186 [2024-11-26 19:18:41.898565] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.186 [2024-11-26 19:18:41.898578] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.186 [2024-11-26 19:18:41.898585] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.186 [2024-11-26 19:18:41.898591] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.186 [2024-11-26 19:18:41.898605] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.186 qpair failed and we were unable to recover it. 00:32:25.186 [2024-11-26 19:18:41.908554] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.186 [2024-11-26 19:18:41.908642] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.186 [2024-11-26 19:18:41.908656] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.186 [2024-11-26 19:18:41.908663] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.186 [2024-11-26 19:18:41.908669] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.186 [2024-11-26 19:18:41.908684] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.186 qpair failed and we were unable to recover it. 00:32:25.186 [2024-11-26 19:18:41.918586] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.186 [2024-11-26 19:18:41.918669] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.186 [2024-11-26 19:18:41.918683] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.186 [2024-11-26 19:18:41.918690] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.186 [2024-11-26 19:18:41.918696] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.186 [2024-11-26 19:18:41.918711] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.186 qpair failed and we were unable to recover it. 00:32:25.186 [2024-11-26 19:18:41.928587] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.186 [2024-11-26 19:18:41.928639] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.186 [2024-11-26 19:18:41.928652] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.186 [2024-11-26 19:18:41.928659] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.186 [2024-11-26 19:18:41.928664] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.186 [2024-11-26 19:18:41.928679] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.186 qpair failed and we were unable to recover it. 00:32:25.186 [2024-11-26 19:18:41.938600] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.186 [2024-11-26 19:18:41.938652] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.186 [2024-11-26 19:18:41.938665] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.186 [2024-11-26 19:18:41.938672] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.186 [2024-11-26 19:18:41.938677] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.186 [2024-11-26 19:18:41.938691] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.186 qpair failed and we were unable to recover it. 00:32:25.186 [2024-11-26 19:18:41.948646] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.186 [2024-11-26 19:18:41.948701] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.186 [2024-11-26 19:18:41.948714] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.186 [2024-11-26 19:18:41.948721] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.186 [2024-11-26 19:18:41.948726] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.186 [2024-11-26 19:18:41.948741] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.186 qpair failed and we were unable to recover it. 00:32:25.186 [2024-11-26 19:18:41.958721] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.186 [2024-11-26 19:18:41.958797] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.186 [2024-11-26 19:18:41.958811] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.186 [2024-11-26 19:18:41.958817] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.186 [2024-11-26 19:18:41.958827] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.186 [2024-11-26 19:18:41.958842] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.186 qpair failed and we were unable to recover it. 00:32:25.186 [2024-11-26 19:18:41.968704] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.186 [2024-11-26 19:18:41.968754] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.186 [2024-11-26 19:18:41.968767] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.186 [2024-11-26 19:18:41.968774] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.186 [2024-11-26 19:18:41.968780] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.186 [2024-11-26 19:18:41.968795] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.186 qpair failed and we were unable to recover it. 00:32:25.186 [2024-11-26 19:18:41.978727] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.186 [2024-11-26 19:18:41.978781] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.186 [2024-11-26 19:18:41.978794] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.186 [2024-11-26 19:18:41.978801] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.186 [2024-11-26 19:18:41.978807] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.186 [2024-11-26 19:18:41.978822] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.186 qpair failed and we were unable to recover it. 00:32:25.186 [2024-11-26 19:18:41.988755] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.186 [2024-11-26 19:18:41.988810] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.186 [2024-11-26 19:18:41.988824] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.186 [2024-11-26 19:18:41.988830] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.186 [2024-11-26 19:18:41.988836] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.186 [2024-11-26 19:18:41.988850] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.186 qpair failed and we were unable to recover it. 00:32:25.186 [2024-11-26 19:18:41.998791] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.186 [2024-11-26 19:18:41.998847] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.186 [2024-11-26 19:18:41.998860] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.186 [2024-11-26 19:18:41.998866] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.186 [2024-11-26 19:18:41.998872] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.186 [2024-11-26 19:18:41.998887] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.186 qpair failed and we were unable to recover it. 00:32:25.186 [2024-11-26 19:18:42.008816] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.186 [2024-11-26 19:18:42.008871] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.186 [2024-11-26 19:18:42.008885] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.186 [2024-11-26 19:18:42.008891] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.186 [2024-11-26 19:18:42.008897] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.186 [2024-11-26 19:18:42.008912] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.186 qpair failed and we were unable to recover it. 00:32:25.186 [2024-11-26 19:18:42.018852] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.186 [2024-11-26 19:18:42.018903] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.186 [2024-11-26 19:18:42.018917] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.187 [2024-11-26 19:18:42.018923] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.187 [2024-11-26 19:18:42.018929] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.187 [2024-11-26 19:18:42.018944] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.187 qpair failed and we were unable to recover it. 00:32:25.187 [2024-11-26 19:18:42.028879] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.187 [2024-11-26 19:18:42.028934] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.187 [2024-11-26 19:18:42.028950] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.187 [2024-11-26 19:18:42.028957] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.187 [2024-11-26 19:18:42.028963] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.187 [2024-11-26 19:18:42.028978] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.187 qpair failed and we were unable to recover it. 00:32:25.187 [2024-11-26 19:18:42.038959] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.187 [2024-11-26 19:18:42.039013] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.187 [2024-11-26 19:18:42.039027] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.187 [2024-11-26 19:18:42.039034] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.187 [2024-11-26 19:18:42.039039] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.187 [2024-11-26 19:18:42.039055] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.187 qpair failed and we were unable to recover it. 00:32:25.187 [2024-11-26 19:18:42.048877] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.187 [2024-11-26 19:18:42.048927] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.187 [2024-11-26 19:18:42.048941] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.187 [2024-11-26 19:18:42.048953] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.187 [2024-11-26 19:18:42.048960] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.187 [2024-11-26 19:18:42.048974] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.187 qpair failed and we were unable to recover it. 00:32:25.187 [2024-11-26 19:18:42.058988] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.187 [2024-11-26 19:18:42.059045] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.187 [2024-11-26 19:18:42.059058] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.187 [2024-11-26 19:18:42.059065] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.187 [2024-11-26 19:18:42.059071] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.187 [2024-11-26 19:18:42.059086] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.187 qpair failed and we were unable to recover it. 00:32:25.187 [2024-11-26 19:18:42.068996] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.187 [2024-11-26 19:18:42.069052] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.187 [2024-11-26 19:18:42.069066] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.187 [2024-11-26 19:18:42.069073] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.187 [2024-11-26 19:18:42.069078] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.187 [2024-11-26 19:18:42.069093] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.187 qpair failed and we were unable to recover it. 00:32:25.187 [2024-11-26 19:18:42.079032] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.187 [2024-11-26 19:18:42.079088] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.187 [2024-11-26 19:18:42.079102] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.187 [2024-11-26 19:18:42.079109] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.187 [2024-11-26 19:18:42.079114] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.187 [2024-11-26 19:18:42.079129] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.187 qpair failed and we were unable to recover it. 00:32:25.187 [2024-11-26 19:18:42.089082] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.187 [2024-11-26 19:18:42.089155] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.187 [2024-11-26 19:18:42.089170] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.187 [2024-11-26 19:18:42.089176] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.187 [2024-11-26 19:18:42.089182] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.187 [2024-11-26 19:18:42.089198] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.187 qpair failed and we were unable to recover it. 00:32:25.187 [2024-11-26 19:18:42.099081] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.187 [2024-11-26 19:18:42.099133] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.187 [2024-11-26 19:18:42.099146] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.187 [2024-11-26 19:18:42.099153] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.187 [2024-11-26 19:18:42.099159] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.187 [2024-11-26 19:18:42.099173] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.187 qpair failed and we were unable to recover it. 00:32:25.447 [2024-11-26 19:18:42.109105] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.447 [2024-11-26 19:18:42.109166] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.447 [2024-11-26 19:18:42.109180] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.447 [2024-11-26 19:18:42.109187] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.447 [2024-11-26 19:18:42.109193] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.447 [2024-11-26 19:18:42.109207] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.447 qpair failed and we were unable to recover it. 00:32:25.447 [2024-11-26 19:18:42.119083] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.447 [2024-11-26 19:18:42.119137] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.447 [2024-11-26 19:18:42.119151] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.447 [2024-11-26 19:18:42.119157] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.447 [2024-11-26 19:18:42.119163] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.447 [2024-11-26 19:18:42.119177] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.447 qpair failed and we were unable to recover it. 00:32:25.447 [2024-11-26 19:18:42.129217] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.447 [2024-11-26 19:18:42.129285] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.447 [2024-11-26 19:18:42.129299] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.447 [2024-11-26 19:18:42.129305] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.447 [2024-11-26 19:18:42.129311] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.447 [2024-11-26 19:18:42.129327] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.447 qpair failed and we were unable to recover it. 00:32:25.447 [2024-11-26 19:18:42.139206] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.447 [2024-11-26 19:18:42.139256] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.447 [2024-11-26 19:18:42.139269] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.447 [2024-11-26 19:18:42.139279] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.447 [2024-11-26 19:18:42.139285] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.447 [2024-11-26 19:18:42.139299] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.447 qpair failed and we were unable to recover it. 00:32:25.447 [2024-11-26 19:18:42.149223] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.447 [2024-11-26 19:18:42.149281] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.447 [2024-11-26 19:18:42.149294] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.447 [2024-11-26 19:18:42.149301] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.447 [2024-11-26 19:18:42.149307] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.447 [2024-11-26 19:18:42.149321] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.447 qpair failed and we were unable to recover it. 00:32:25.447 [2024-11-26 19:18:42.159305] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.447 [2024-11-26 19:18:42.159360] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.447 [2024-11-26 19:18:42.159373] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.447 [2024-11-26 19:18:42.159380] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.447 [2024-11-26 19:18:42.159385] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.447 [2024-11-26 19:18:42.159400] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.447 qpair failed and we were unable to recover it. 00:32:25.447 [2024-11-26 19:18:42.169304] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.447 [2024-11-26 19:18:42.169361] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.448 [2024-11-26 19:18:42.169374] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.448 [2024-11-26 19:18:42.169381] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.448 [2024-11-26 19:18:42.169387] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.448 [2024-11-26 19:18:42.169401] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.448 qpair failed and we were unable to recover it. 00:32:25.448 [2024-11-26 19:18:42.179320] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.448 [2024-11-26 19:18:42.179378] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.448 [2024-11-26 19:18:42.179391] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.448 [2024-11-26 19:18:42.179397] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.448 [2024-11-26 19:18:42.179403] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.448 [2024-11-26 19:18:42.179418] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.448 qpair failed and we were unable to recover it. 00:32:25.448 [2024-11-26 19:18:42.189294] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.448 [2024-11-26 19:18:42.189350] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.448 [2024-11-26 19:18:42.189364] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.448 [2024-11-26 19:18:42.189370] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.448 [2024-11-26 19:18:42.189376] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.448 [2024-11-26 19:18:42.189391] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.448 qpair failed and we were unable to recover it. 00:32:25.448 [2024-11-26 19:18:42.199324] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.448 [2024-11-26 19:18:42.199391] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.448 [2024-11-26 19:18:42.199405] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.448 [2024-11-26 19:18:42.199411] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.448 [2024-11-26 19:18:42.199417] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.448 [2024-11-26 19:18:42.199433] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.448 qpair failed and we were unable to recover it. 00:32:25.448 [2024-11-26 19:18:42.209402] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.448 [2024-11-26 19:18:42.209460] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.448 [2024-11-26 19:18:42.209474] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.448 [2024-11-26 19:18:42.209481] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.448 [2024-11-26 19:18:42.209486] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.448 [2024-11-26 19:18:42.209501] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.448 qpair failed and we were unable to recover it. 00:32:25.448 [2024-11-26 19:18:42.219375] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.448 [2024-11-26 19:18:42.219429] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.448 [2024-11-26 19:18:42.219443] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.448 [2024-11-26 19:18:42.219450] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.448 [2024-11-26 19:18:42.219456] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.448 [2024-11-26 19:18:42.219470] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.448 qpair failed and we were unable to recover it. 00:32:25.448 [2024-11-26 19:18:42.229477] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.448 [2024-11-26 19:18:42.229538] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.448 [2024-11-26 19:18:42.229557] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.448 [2024-11-26 19:18:42.229565] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.448 [2024-11-26 19:18:42.229571] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.448 [2024-11-26 19:18:42.229585] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.448 qpair failed and we were unable to recover it. 00:32:25.448 [2024-11-26 19:18:42.239422] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.448 [2024-11-26 19:18:42.239477] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.448 [2024-11-26 19:18:42.239490] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.448 [2024-11-26 19:18:42.239497] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.448 [2024-11-26 19:18:42.239502] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.448 [2024-11-26 19:18:42.239519] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.448 qpair failed and we were unable to recover it. 00:32:25.448 [2024-11-26 19:18:42.249482] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.448 [2024-11-26 19:18:42.249543] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.448 [2024-11-26 19:18:42.249556] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.448 [2024-11-26 19:18:42.249563] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.448 [2024-11-26 19:18:42.249569] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.448 [2024-11-26 19:18:42.249584] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.448 qpair failed and we were unable to recover it. 00:32:25.448 [2024-11-26 19:18:42.259474] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.448 [2024-11-26 19:18:42.259531] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.448 [2024-11-26 19:18:42.259544] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.448 [2024-11-26 19:18:42.259550] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.448 [2024-11-26 19:18:42.259556] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.448 [2024-11-26 19:18:42.259571] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.448 qpair failed and we were unable to recover it. 00:32:25.448 [2024-11-26 19:18:42.269512] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.448 [2024-11-26 19:18:42.269568] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.448 [2024-11-26 19:18:42.269582] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.448 [2024-11-26 19:18:42.269588] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.448 [2024-11-26 19:18:42.269594] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.448 [2024-11-26 19:18:42.269611] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.448 qpair failed and we were unable to recover it. 00:32:25.448 [2024-11-26 19:18:42.279674] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.448 [2024-11-26 19:18:42.279756] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.448 [2024-11-26 19:18:42.279771] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.448 [2024-11-26 19:18:42.279777] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.448 [2024-11-26 19:18:42.279784] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.448 [2024-11-26 19:18:42.279798] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.448 qpair failed and we were unable to recover it. 00:32:25.448 [2024-11-26 19:18:42.289685] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.448 [2024-11-26 19:18:42.289744] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.448 [2024-11-26 19:18:42.289757] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.448 [2024-11-26 19:18:42.289763] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.448 [2024-11-26 19:18:42.289769] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.448 [2024-11-26 19:18:42.289784] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.448 qpair failed and we were unable to recover it. 00:32:25.448 [2024-11-26 19:18:42.299595] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.448 [2024-11-26 19:18:42.299644] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.448 [2024-11-26 19:18:42.299657] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.449 [2024-11-26 19:18:42.299664] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.449 [2024-11-26 19:18:42.299670] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.449 [2024-11-26 19:18:42.299685] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.449 qpair failed and we were unable to recover it. 00:32:25.449 [2024-11-26 19:18:42.309645] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.449 [2024-11-26 19:18:42.309699] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.449 [2024-11-26 19:18:42.309712] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.449 [2024-11-26 19:18:42.309719] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.449 [2024-11-26 19:18:42.309725] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.449 [2024-11-26 19:18:42.309740] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.449 qpair failed and we were unable to recover it. 00:32:25.449 [2024-11-26 19:18:42.319728] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.449 [2024-11-26 19:18:42.319784] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.449 [2024-11-26 19:18:42.319800] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.449 [2024-11-26 19:18:42.319807] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.449 [2024-11-26 19:18:42.319813] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.449 [2024-11-26 19:18:42.319827] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.449 qpair failed and we were unable to recover it. 00:32:25.449 [2024-11-26 19:18:42.329691] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.449 [2024-11-26 19:18:42.329747] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.449 [2024-11-26 19:18:42.329760] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.449 [2024-11-26 19:18:42.329767] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.449 [2024-11-26 19:18:42.329773] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.449 [2024-11-26 19:18:42.329787] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.449 qpair failed and we were unable to recover it. 00:32:25.449 [2024-11-26 19:18:42.339854] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.449 [2024-11-26 19:18:42.339940] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.449 [2024-11-26 19:18:42.339960] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.449 [2024-11-26 19:18:42.339967] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.449 [2024-11-26 19:18:42.339973] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.449 [2024-11-26 19:18:42.339988] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.449 qpair failed and we were unable to recover it. 00:32:25.449 [2024-11-26 19:18:42.349812] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.449 [2024-11-26 19:18:42.349869] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.449 [2024-11-26 19:18:42.349882] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.449 [2024-11-26 19:18:42.349889] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.449 [2024-11-26 19:18:42.349895] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.449 [2024-11-26 19:18:42.349909] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.449 qpair failed and we were unable to recover it. 00:32:25.449 [2024-11-26 19:18:42.359826] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.449 [2024-11-26 19:18:42.359881] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.449 [2024-11-26 19:18:42.359894] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.449 [2024-11-26 19:18:42.359901] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.449 [2024-11-26 19:18:42.359907] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.449 [2024-11-26 19:18:42.359925] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.449 qpair failed and we were unable to recover it. 00:32:25.709 [2024-11-26 19:18:42.369898] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.709 [2024-11-26 19:18:42.369959] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.709 [2024-11-26 19:18:42.369972] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.709 [2024-11-26 19:18:42.369979] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.709 [2024-11-26 19:18:42.369985] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.709 [2024-11-26 19:18:42.369999] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.709 qpair failed and we were unable to recover it. 00:32:25.709 [2024-11-26 19:18:42.379883] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.709 [2024-11-26 19:18:42.379941] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.709 [2024-11-26 19:18:42.379961] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.709 [2024-11-26 19:18:42.379968] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.709 [2024-11-26 19:18:42.379973] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.709 [2024-11-26 19:18:42.379988] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.709 qpair failed and we were unable to recover it. 00:32:25.709 [2024-11-26 19:18:42.389931] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.709 [2024-11-26 19:18:42.389987] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.709 [2024-11-26 19:18:42.390000] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.709 [2024-11-26 19:18:42.390007] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.709 [2024-11-26 19:18:42.390013] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.709 [2024-11-26 19:18:42.390027] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.709 qpair failed and we were unable to recover it. 00:32:25.709 [2024-11-26 19:18:42.400008] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.709 [2024-11-26 19:18:42.400065] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.709 [2024-11-26 19:18:42.400078] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.709 [2024-11-26 19:18:42.400085] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.709 [2024-11-26 19:18:42.400090] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.709 [2024-11-26 19:18:42.400105] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.709 qpair failed and we were unable to recover it. 00:32:25.709 [2024-11-26 19:18:42.410002] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.709 [2024-11-26 19:18:42.410055] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.709 [2024-11-26 19:18:42.410072] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.709 [2024-11-26 19:18:42.410079] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.709 [2024-11-26 19:18:42.410084] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.709 [2024-11-26 19:18:42.410100] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.709 qpair failed and we were unable to recover it. 00:32:25.709 [2024-11-26 19:18:42.420035] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.709 [2024-11-26 19:18:42.420092] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.709 [2024-11-26 19:18:42.420105] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.709 [2024-11-26 19:18:42.420112] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.709 [2024-11-26 19:18:42.420117] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.709 [2024-11-26 19:18:42.420132] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.709 qpair failed and we were unable to recover it. 00:32:25.709 [2024-11-26 19:18:42.430031] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.709 [2024-11-26 19:18:42.430087] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.709 [2024-11-26 19:18:42.430101] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.709 [2024-11-26 19:18:42.430107] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.709 [2024-11-26 19:18:42.430113] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.709 [2024-11-26 19:18:42.430128] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.709 qpair failed and we were unable to recover it. 00:32:25.709 [2024-11-26 19:18:42.440044] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.709 [2024-11-26 19:18:42.440099] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.709 [2024-11-26 19:18:42.440113] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.709 [2024-11-26 19:18:42.440119] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.709 [2024-11-26 19:18:42.440126] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.709 [2024-11-26 19:18:42.440140] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.709 qpair failed and we were unable to recover it. 00:32:25.709 [2024-11-26 19:18:42.450086] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.709 [2024-11-26 19:18:42.450146] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.709 [2024-11-26 19:18:42.450159] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.709 [2024-11-26 19:18:42.450166] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.709 [2024-11-26 19:18:42.450175] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.709 [2024-11-26 19:18:42.450190] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.709 qpair failed and we were unable to recover it. 00:32:25.709 [2024-11-26 19:18:42.460134] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.709 [2024-11-26 19:18:42.460191] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.710 [2024-11-26 19:18:42.460204] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.710 [2024-11-26 19:18:42.460211] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.710 [2024-11-26 19:18:42.460217] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.710 [2024-11-26 19:18:42.460232] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.710 qpair failed and we were unable to recover it. 00:32:25.710 [2024-11-26 19:18:42.470102] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.710 [2024-11-26 19:18:42.470160] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.710 [2024-11-26 19:18:42.470174] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.710 [2024-11-26 19:18:42.470180] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.710 [2024-11-26 19:18:42.470187] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.710 [2024-11-26 19:18:42.470202] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.710 qpair failed and we were unable to recover it. 00:32:25.710 [2024-11-26 19:18:42.480125] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.710 [2024-11-26 19:18:42.480178] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.710 [2024-11-26 19:18:42.480192] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.710 [2024-11-26 19:18:42.480198] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.710 [2024-11-26 19:18:42.480204] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.710 [2024-11-26 19:18:42.480219] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.710 qpair failed and we were unable to recover it. 00:32:25.710 [2024-11-26 19:18:42.490192] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.710 [2024-11-26 19:18:42.490249] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.710 [2024-11-26 19:18:42.490263] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.710 [2024-11-26 19:18:42.490269] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.710 [2024-11-26 19:18:42.490275] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.710 [2024-11-26 19:18:42.490290] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.710 qpair failed and we were unable to recover it. 00:32:25.710 [2024-11-26 19:18:42.500252] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.710 [2024-11-26 19:18:42.500341] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.710 [2024-11-26 19:18:42.500355] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.710 [2024-11-26 19:18:42.500362] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.710 [2024-11-26 19:18:42.500368] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.710 [2024-11-26 19:18:42.500383] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.710 qpair failed and we were unable to recover it. 00:32:25.710 [2024-11-26 19:18:42.510313] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.710 [2024-11-26 19:18:42.510366] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.710 [2024-11-26 19:18:42.510379] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.710 [2024-11-26 19:18:42.510386] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.710 [2024-11-26 19:18:42.510391] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.710 [2024-11-26 19:18:42.510405] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.710 qpair failed and we were unable to recover it. 00:32:25.710 [2024-11-26 19:18:42.520298] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.710 [2024-11-26 19:18:42.520353] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.710 [2024-11-26 19:18:42.520367] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.710 [2024-11-26 19:18:42.520373] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.710 [2024-11-26 19:18:42.520379] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.710 [2024-11-26 19:18:42.520393] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.710 qpair failed and we were unable to recover it. 00:32:25.710 [2024-11-26 19:18:42.530266] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.710 [2024-11-26 19:18:42.530325] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.710 [2024-11-26 19:18:42.530338] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.710 [2024-11-26 19:18:42.530344] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.710 [2024-11-26 19:18:42.530350] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.710 [2024-11-26 19:18:42.530364] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.710 qpair failed and we were unable to recover it. 00:32:25.710 [2024-11-26 19:18:42.540290] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.710 [2024-11-26 19:18:42.540342] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.710 [2024-11-26 19:18:42.540355] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.710 [2024-11-26 19:18:42.540361] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.710 [2024-11-26 19:18:42.540370] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.710 [2024-11-26 19:18:42.540385] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.710 qpair failed and we were unable to recover it. 00:32:25.710 [2024-11-26 19:18:42.550390] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.710 [2024-11-26 19:18:42.550445] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.710 [2024-11-26 19:18:42.550458] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.710 [2024-11-26 19:18:42.550464] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.710 [2024-11-26 19:18:42.550470] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.710 [2024-11-26 19:18:42.550484] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.710 qpair failed and we were unable to recover it. 00:32:25.710 [2024-11-26 19:18:42.560379] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.710 [2024-11-26 19:18:42.560434] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.710 [2024-11-26 19:18:42.560446] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.710 [2024-11-26 19:18:42.560453] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.710 [2024-11-26 19:18:42.560459] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.710 [2024-11-26 19:18:42.560473] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.710 qpair failed and we were unable to recover it. 00:32:25.710 [2024-11-26 19:18:42.570389] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.710 [2024-11-26 19:18:42.570450] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.710 [2024-11-26 19:18:42.570463] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.710 [2024-11-26 19:18:42.570469] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.710 [2024-11-26 19:18:42.570475] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.710 [2024-11-26 19:18:42.570490] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.710 qpair failed and we were unable to recover it. 00:32:25.710 [2024-11-26 19:18:42.580449] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.710 [2024-11-26 19:18:42.580500] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.710 [2024-11-26 19:18:42.580514] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.710 [2024-11-26 19:18:42.580520] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.710 [2024-11-26 19:18:42.580526] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.710 [2024-11-26 19:18:42.580541] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.710 qpair failed and we were unable to recover it. 00:32:25.710 [2024-11-26 19:18:42.590448] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.710 [2024-11-26 19:18:42.590509] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.710 [2024-11-26 19:18:42.590522] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.710 [2024-11-26 19:18:42.590529] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.710 [2024-11-26 19:18:42.590535] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.711 [2024-11-26 19:18:42.590550] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.711 qpair failed and we were unable to recover it. 00:32:25.711 [2024-11-26 19:18:42.600600] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.711 [2024-11-26 19:18:42.600657] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.711 [2024-11-26 19:18:42.600670] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.711 [2024-11-26 19:18:42.600677] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.711 [2024-11-26 19:18:42.600682] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.711 [2024-11-26 19:18:42.600697] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.711 qpair failed and we were unable to recover it. 00:32:25.711 [2024-11-26 19:18:42.610515] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.711 [2024-11-26 19:18:42.610570] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.711 [2024-11-26 19:18:42.610583] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.711 [2024-11-26 19:18:42.610589] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.711 [2024-11-26 19:18:42.610595] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.711 [2024-11-26 19:18:42.610610] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.711 qpair failed and we were unable to recover it. 00:32:25.711 [2024-11-26 19:18:42.620638] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.711 [2024-11-26 19:18:42.620694] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.711 [2024-11-26 19:18:42.620707] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.711 [2024-11-26 19:18:42.620713] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.711 [2024-11-26 19:18:42.620719] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.711 [2024-11-26 19:18:42.620734] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.711 qpair failed and we were unable to recover it. 00:32:25.711 [2024-11-26 19:18:42.630592] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.711 [2024-11-26 19:18:42.630653] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.711 [2024-11-26 19:18:42.630666] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.711 [2024-11-26 19:18:42.630675] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.711 [2024-11-26 19:18:42.630681] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.711 [2024-11-26 19:18:42.630696] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.711 qpair failed and we were unable to recover it. 00:32:25.970 [2024-11-26 19:18:42.640671] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.970 [2024-11-26 19:18:42.640733] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.970 [2024-11-26 19:18:42.640746] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.970 [2024-11-26 19:18:42.640752] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.970 [2024-11-26 19:18:42.640758] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.970 [2024-11-26 19:18:42.640773] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.970 qpair failed and we were unable to recover it. 00:32:25.970 [2024-11-26 19:18:42.650695] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.970 [2024-11-26 19:18:42.650756] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.970 [2024-11-26 19:18:42.650769] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.970 [2024-11-26 19:18:42.650775] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.970 [2024-11-26 19:18:42.650781] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.970 [2024-11-26 19:18:42.650796] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.970 qpair failed and we were unable to recover it. 00:32:25.970 [2024-11-26 19:18:42.660748] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.970 [2024-11-26 19:18:42.660804] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.970 [2024-11-26 19:18:42.660817] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.970 [2024-11-26 19:18:42.660824] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.970 [2024-11-26 19:18:42.660829] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.970 [2024-11-26 19:18:42.660844] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.970 qpair failed and we were unable to recover it. 00:32:25.970 [2024-11-26 19:18:42.670722] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.970 [2024-11-26 19:18:42.670782] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.970 [2024-11-26 19:18:42.670795] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.970 [2024-11-26 19:18:42.670802] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.970 [2024-11-26 19:18:42.670808] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.970 [2024-11-26 19:18:42.670822] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.970 qpair failed and we were unable to recover it. 00:32:25.971 [2024-11-26 19:18:42.680782] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.971 [2024-11-26 19:18:42.680858] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.971 [2024-11-26 19:18:42.680872] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.971 [2024-11-26 19:18:42.680878] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.971 [2024-11-26 19:18:42.680884] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.971 [2024-11-26 19:18:42.680899] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.971 qpair failed and we were unable to recover it. 00:32:25.971 [2024-11-26 19:18:42.690795] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.971 [2024-11-26 19:18:42.690849] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.971 [2024-11-26 19:18:42.690863] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.971 [2024-11-26 19:18:42.690870] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.971 [2024-11-26 19:18:42.690875] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.971 [2024-11-26 19:18:42.690890] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.971 qpair failed and we were unable to recover it. 00:32:25.971 [2024-11-26 19:18:42.700818] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.971 [2024-11-26 19:18:42.700897] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.971 [2024-11-26 19:18:42.700911] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.971 [2024-11-26 19:18:42.700918] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.971 [2024-11-26 19:18:42.700924] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.971 [2024-11-26 19:18:42.700938] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.971 qpair failed and we were unable to recover it. 00:32:25.971 [2024-11-26 19:18:42.710855] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.971 [2024-11-26 19:18:42.710910] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.971 [2024-11-26 19:18:42.710924] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.971 [2024-11-26 19:18:42.710931] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.971 [2024-11-26 19:18:42.710937] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.971 [2024-11-26 19:18:42.710956] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.971 qpair failed and we were unable to recover it. 00:32:25.971 [2024-11-26 19:18:42.720888] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.971 [2024-11-26 19:18:42.720944] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.971 [2024-11-26 19:18:42.720961] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.971 [2024-11-26 19:18:42.720970] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.971 [2024-11-26 19:18:42.720975] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.971 [2024-11-26 19:18:42.720990] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.971 qpair failed and we were unable to recover it. 00:32:25.971 [2024-11-26 19:18:42.730907] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.971 [2024-11-26 19:18:42.730963] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.971 [2024-11-26 19:18:42.730977] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.971 [2024-11-26 19:18:42.730983] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.971 [2024-11-26 19:18:42.730989] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.971 [2024-11-26 19:18:42.731003] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.971 qpair failed and we were unable to recover it. 00:32:25.971 [2024-11-26 19:18:42.740974] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.971 [2024-11-26 19:18:42.741027] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.971 [2024-11-26 19:18:42.741041] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.971 [2024-11-26 19:18:42.741047] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.971 [2024-11-26 19:18:42.741053] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.971 [2024-11-26 19:18:42.741068] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.971 qpair failed and we were unable to recover it. 00:32:25.971 [2024-11-26 19:18:42.750985] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.971 [2024-11-26 19:18:42.751045] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.971 [2024-11-26 19:18:42.751058] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.971 [2024-11-26 19:18:42.751064] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.971 [2024-11-26 19:18:42.751071] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.971 [2024-11-26 19:18:42.751085] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.971 qpair failed and we were unable to recover it. 00:32:25.971 [2024-11-26 19:18:42.761013] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.971 [2024-11-26 19:18:42.761070] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.971 [2024-11-26 19:18:42.761084] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.971 [2024-11-26 19:18:42.761091] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.971 [2024-11-26 19:18:42.761097] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.971 [2024-11-26 19:18:42.761113] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.971 qpair failed and we were unable to recover it. 00:32:25.971 [2024-11-26 19:18:42.771029] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.971 [2024-11-26 19:18:42.771082] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.971 [2024-11-26 19:18:42.771096] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.971 [2024-11-26 19:18:42.771102] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.971 [2024-11-26 19:18:42.771108] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.971 [2024-11-26 19:18:42.771122] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.971 qpair failed and we were unable to recover it. 00:32:25.971 [2024-11-26 19:18:42.781095] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.971 [2024-11-26 19:18:42.781170] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.971 [2024-11-26 19:18:42.781184] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.971 [2024-11-26 19:18:42.781191] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.971 [2024-11-26 19:18:42.781197] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.971 [2024-11-26 19:18:42.781213] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.971 qpair failed and we were unable to recover it. 00:32:25.971 [2024-11-26 19:18:42.791039] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.971 [2024-11-26 19:18:42.791094] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.971 [2024-11-26 19:18:42.791107] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.971 [2024-11-26 19:18:42.791114] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.971 [2024-11-26 19:18:42.791120] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.971 [2024-11-26 19:18:42.791134] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.971 qpair failed and we were unable to recover it. 00:32:25.971 [2024-11-26 19:18:42.801118] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.971 [2024-11-26 19:18:42.801176] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.971 [2024-11-26 19:18:42.801191] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.971 [2024-11-26 19:18:42.801197] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.971 [2024-11-26 19:18:42.801203] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.971 [2024-11-26 19:18:42.801218] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.971 qpair failed and we were unable to recover it. 00:32:25.971 [2024-11-26 19:18:42.811155] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.971 [2024-11-26 19:18:42.811217] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.971 [2024-11-26 19:18:42.811234] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.972 [2024-11-26 19:18:42.811240] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.972 [2024-11-26 19:18:42.811246] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.972 [2024-11-26 19:18:42.811261] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.972 qpair failed and we were unable to recover it. 00:32:25.972 [2024-11-26 19:18:42.821222] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.972 [2024-11-26 19:18:42.821277] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.972 [2024-11-26 19:18:42.821290] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.972 [2024-11-26 19:18:42.821297] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.972 [2024-11-26 19:18:42.821303] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.972 [2024-11-26 19:18:42.821318] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.972 qpair failed and we were unable to recover it. 00:32:25.972 [2024-11-26 19:18:42.831206] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.972 [2024-11-26 19:18:42.831261] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.972 [2024-11-26 19:18:42.831273] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.972 [2024-11-26 19:18:42.831280] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.972 [2024-11-26 19:18:42.831285] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.972 [2024-11-26 19:18:42.831300] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.972 qpair failed and we were unable to recover it. 00:32:25.972 [2024-11-26 19:18:42.841281] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.972 [2024-11-26 19:18:42.841361] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.972 [2024-11-26 19:18:42.841375] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.972 [2024-11-26 19:18:42.841381] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.972 [2024-11-26 19:18:42.841387] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.972 [2024-11-26 19:18:42.841402] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.972 qpair failed and we were unable to recover it. 00:32:25.972 [2024-11-26 19:18:42.851269] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.972 [2024-11-26 19:18:42.851327] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.972 [2024-11-26 19:18:42.851340] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.972 [2024-11-26 19:18:42.851347] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.972 [2024-11-26 19:18:42.851353] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.972 [2024-11-26 19:18:42.851370] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.972 qpair failed and we were unable to recover it. 00:32:25.972 [2024-11-26 19:18:42.861295] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.972 [2024-11-26 19:18:42.861351] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.972 [2024-11-26 19:18:42.861365] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.972 [2024-11-26 19:18:42.861372] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.972 [2024-11-26 19:18:42.861378] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.972 [2024-11-26 19:18:42.861392] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.972 qpair failed and we were unable to recover it. 00:32:25.972 [2024-11-26 19:18:42.871322] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.972 [2024-11-26 19:18:42.871375] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.972 [2024-11-26 19:18:42.871389] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.972 [2024-11-26 19:18:42.871395] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.972 [2024-11-26 19:18:42.871401] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.972 [2024-11-26 19:18:42.871416] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.972 qpair failed and we were unable to recover it. 00:32:25.972 [2024-11-26 19:18:42.881362] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.972 [2024-11-26 19:18:42.881417] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.972 [2024-11-26 19:18:42.881430] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.972 [2024-11-26 19:18:42.881437] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.972 [2024-11-26 19:18:42.881443] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.972 [2024-11-26 19:18:42.881457] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.972 qpair failed and we were unable to recover it. 00:32:25.972 [2024-11-26 19:18:42.891436] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:25.972 [2024-11-26 19:18:42.891490] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:25.972 [2024-11-26 19:18:42.891503] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:25.972 [2024-11-26 19:18:42.891510] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:25.972 [2024-11-26 19:18:42.891515] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:25.972 [2024-11-26 19:18:42.891529] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:25.972 qpair failed and we were unable to recover it. 00:32:26.232 [2024-11-26 19:18:42.901413] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.232 [2024-11-26 19:18:42.901467] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.232 [2024-11-26 19:18:42.901483] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.232 [2024-11-26 19:18:42.901489] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.232 [2024-11-26 19:18:42.901495] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:26.232 [2024-11-26 19:18:42.901510] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:26.232 qpair failed and we were unable to recover it. 00:32:26.232 [2024-11-26 19:18:42.911449] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.232 [2024-11-26 19:18:42.911504] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.232 [2024-11-26 19:18:42.911517] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.232 [2024-11-26 19:18:42.911524] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.232 [2024-11-26 19:18:42.911530] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:26.232 [2024-11-26 19:18:42.911544] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:26.232 qpair failed and we were unable to recover it. 00:32:26.232 [2024-11-26 19:18:42.921477] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.232 [2024-11-26 19:18:42.921533] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.232 [2024-11-26 19:18:42.921546] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.232 [2024-11-26 19:18:42.921552] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.232 [2024-11-26 19:18:42.921558] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:26.232 [2024-11-26 19:18:42.921573] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:26.232 qpair failed and we were unable to recover it. 00:32:26.232 [2024-11-26 19:18:42.931501] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.232 [2024-11-26 19:18:42.931556] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.232 [2024-11-26 19:18:42.931570] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.232 [2024-11-26 19:18:42.931577] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.232 [2024-11-26 19:18:42.931582] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:26.232 [2024-11-26 19:18:42.931597] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:26.232 qpair failed and we were unable to recover it. 00:32:26.232 [2024-11-26 19:18:42.941570] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.232 [2024-11-26 19:18:42.941624] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.232 [2024-11-26 19:18:42.941637] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.232 [2024-11-26 19:18:42.941643] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.232 [2024-11-26 19:18:42.941654] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:26.232 [2024-11-26 19:18:42.941669] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:26.232 qpair failed and we were unable to recover it. 00:32:26.232 [2024-11-26 19:18:42.951557] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.232 [2024-11-26 19:18:42.951611] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.232 [2024-11-26 19:18:42.951625] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.232 [2024-11-26 19:18:42.951631] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.232 [2024-11-26 19:18:42.951637] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:26.232 [2024-11-26 19:18:42.951652] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:26.232 qpair failed and we were unable to recover it. 00:32:26.232 [2024-11-26 19:18:42.961520] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.232 [2024-11-26 19:18:42.961578] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.232 [2024-11-26 19:18:42.961591] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.232 [2024-11-26 19:18:42.961598] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.232 [2024-11-26 19:18:42.961603] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:26.232 [2024-11-26 19:18:42.961618] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:26.232 qpair failed and we were unable to recover it. 00:32:26.232 [2024-11-26 19:18:42.971620] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.233 [2024-11-26 19:18:42.971680] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.233 [2024-11-26 19:18:42.971693] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.233 [2024-11-26 19:18:42.971699] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.233 [2024-11-26 19:18:42.971705] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:26.233 [2024-11-26 19:18:42.971719] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:26.233 qpair failed and we were unable to recover it. 00:32:26.233 [2024-11-26 19:18:42.981641] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.233 [2024-11-26 19:18:42.981697] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.233 [2024-11-26 19:18:42.981711] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.233 [2024-11-26 19:18:42.981717] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.233 [2024-11-26 19:18:42.981723] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:26.233 [2024-11-26 19:18:42.981738] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:26.233 qpair failed and we were unable to recover it. 00:32:26.233 [2024-11-26 19:18:42.991679] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.233 [2024-11-26 19:18:42.991737] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.233 [2024-11-26 19:18:42.991750] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.233 [2024-11-26 19:18:42.991756] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.233 [2024-11-26 19:18:42.991762] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:26.233 [2024-11-26 19:18:42.991777] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:26.233 qpair failed and we were unable to recover it. 00:32:26.233 [2024-11-26 19:18:43.001711] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.233 [2024-11-26 19:18:43.001765] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.233 [2024-11-26 19:18:43.001779] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.233 [2024-11-26 19:18:43.001785] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.233 [2024-11-26 19:18:43.001791] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:26.233 [2024-11-26 19:18:43.001806] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:26.233 qpair failed and we were unable to recover it. 00:32:26.233 [2024-11-26 19:18:43.011743] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.233 [2024-11-26 19:18:43.011799] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.233 [2024-11-26 19:18:43.011812] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.233 [2024-11-26 19:18:43.011819] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.233 [2024-11-26 19:18:43.011825] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:26.233 [2024-11-26 19:18:43.011840] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:26.233 qpair failed and we were unable to recover it. 00:32:26.233 [2024-11-26 19:18:43.021774] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.233 [2024-11-26 19:18:43.021831] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.233 [2024-11-26 19:18:43.021845] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.233 [2024-11-26 19:18:43.021851] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.233 [2024-11-26 19:18:43.021857] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:26.233 [2024-11-26 19:18:43.021872] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:26.233 qpair failed and we were unable to recover it. 00:32:26.233 [2024-11-26 19:18:43.031804] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.233 [2024-11-26 19:18:43.031860] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.233 [2024-11-26 19:18:43.031874] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.233 [2024-11-26 19:18:43.031880] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.233 [2024-11-26 19:18:43.031889] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:26.233 [2024-11-26 19:18:43.031904] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:26.233 qpair failed and we were unable to recover it. 00:32:26.233 [2024-11-26 19:18:43.041839] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.233 [2024-11-26 19:18:43.041896] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.233 [2024-11-26 19:18:43.041909] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.233 [2024-11-26 19:18:43.041915] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.233 [2024-11-26 19:18:43.041921] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:26.233 [2024-11-26 19:18:43.041936] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:26.233 qpair failed and we were unable to recover it. 00:32:26.233 [2024-11-26 19:18:43.051863] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.233 [2024-11-26 19:18:43.051926] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.233 [2024-11-26 19:18:43.051939] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.233 [2024-11-26 19:18:43.051946] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.233 [2024-11-26 19:18:43.051955] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:26.233 [2024-11-26 19:18:43.051970] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:26.233 qpair failed and we were unable to recover it. 00:32:26.233 [2024-11-26 19:18:43.061915] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.233 [2024-11-26 19:18:43.061983] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.233 [2024-11-26 19:18:43.061997] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.233 [2024-11-26 19:18:43.062003] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.233 [2024-11-26 19:18:43.062008] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:26.233 [2024-11-26 19:18:43.062024] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:26.233 qpair failed and we were unable to recover it. 00:32:26.233 [2024-11-26 19:18:43.071965] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.233 [2024-11-26 19:18:43.072029] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.233 [2024-11-26 19:18:43.072043] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.233 [2024-11-26 19:18:43.072049] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.233 [2024-11-26 19:18:43.072055] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:26.233 [2024-11-26 19:18:43.072070] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:26.233 qpair failed and we were unable to recover it. 00:32:26.233 [2024-11-26 19:18:43.081966] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.233 [2024-11-26 19:18:43.082034] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.233 [2024-11-26 19:18:43.082063] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.233 [2024-11-26 19:18:43.082075] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.233 [2024-11-26 19:18:43.082086] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:26.233 [2024-11-26 19:18:43.082111] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:26.233 qpair failed and we were unable to recover it. 00:32:26.233 [2024-11-26 19:18:43.091985] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.233 [2024-11-26 19:18:43.092041] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.233 [2024-11-26 19:18:43.092056] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.233 [2024-11-26 19:18:43.092063] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.233 [2024-11-26 19:18:43.092070] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:26.233 [2024-11-26 19:18:43.092085] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:26.233 qpair failed and we were unable to recover it. 00:32:26.233 [2024-11-26 19:18:43.102012] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.233 [2024-11-26 19:18:43.102071] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.233 [2024-11-26 19:18:43.102088] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.233 [2024-11-26 19:18:43.102095] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.234 [2024-11-26 19:18:43.102101] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:26.234 [2024-11-26 19:18:43.102116] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:26.234 qpair failed and we were unable to recover it. 00:32:26.234 [2024-11-26 19:18:43.112025] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.234 [2024-11-26 19:18:43.112080] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.234 [2024-11-26 19:18:43.112095] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.234 [2024-11-26 19:18:43.112101] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.234 [2024-11-26 19:18:43.112108] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:26.234 [2024-11-26 19:18:43.112123] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:26.234 qpair failed and we were unable to recover it. 00:32:26.234 [2024-11-26 19:18:43.122063] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.234 [2024-11-26 19:18:43.122116] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.234 [2024-11-26 19:18:43.122131] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.234 [2024-11-26 19:18:43.122142] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.234 [2024-11-26 19:18:43.122148] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:26.234 [2024-11-26 19:18:43.122163] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:26.234 qpair failed and we were unable to recover it. 00:32:26.234 [2024-11-26 19:18:43.132090] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.234 [2024-11-26 19:18:43.132168] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.234 [2024-11-26 19:18:43.132183] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.234 [2024-11-26 19:18:43.132190] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.234 [2024-11-26 19:18:43.132197] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:26.234 [2024-11-26 19:18:43.132212] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:26.234 qpair failed and we were unable to recover it. 00:32:26.234 [2024-11-26 19:18:43.142116] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.234 [2024-11-26 19:18:43.142167] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.234 [2024-11-26 19:18:43.142182] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.234 [2024-11-26 19:18:43.142188] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.234 [2024-11-26 19:18:43.142194] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:26.234 [2024-11-26 19:18:43.142209] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:26.234 qpair failed and we were unable to recover it. 00:32:26.234 [2024-11-26 19:18:43.152143] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.234 [2024-11-26 19:18:43.152195] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.234 [2024-11-26 19:18:43.152210] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.234 [2024-11-26 19:18:43.152217] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.234 [2024-11-26 19:18:43.152223] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:26.234 [2024-11-26 19:18:43.152237] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:26.234 qpair failed and we were unable to recover it. 00:32:26.493 [2024-11-26 19:18:43.162229] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.493 [2024-11-26 19:18:43.162287] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.493 [2024-11-26 19:18:43.162302] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.493 [2024-11-26 19:18:43.162308] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.493 [2024-11-26 19:18:43.162314] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:26.493 [2024-11-26 19:18:43.162328] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:26.493 qpair failed and we were unable to recover it. 00:32:26.493 [2024-11-26 19:18:43.172205] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.493 [2024-11-26 19:18:43.172268] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.493 [2024-11-26 19:18:43.172282] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.493 [2024-11-26 19:18:43.172288] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.493 [2024-11-26 19:18:43.172294] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:26.493 [2024-11-26 19:18:43.172308] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:26.493 qpair failed and we were unable to recover it. 00:32:26.493 [2024-11-26 19:18:43.182219] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.493 [2024-11-26 19:18:43.182268] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.493 [2024-11-26 19:18:43.182283] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.493 [2024-11-26 19:18:43.182290] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.493 [2024-11-26 19:18:43.182296] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:26.493 [2024-11-26 19:18:43.182311] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:26.493 qpair failed and we were unable to recover it. 00:32:26.493 [2024-11-26 19:18:43.192261] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.493 [2024-11-26 19:18:43.192318] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.493 [2024-11-26 19:18:43.192332] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.493 [2024-11-26 19:18:43.192338] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.494 [2024-11-26 19:18:43.192344] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:26.494 [2024-11-26 19:18:43.192358] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:26.494 qpair failed and we were unable to recover it. 00:32:26.494 [2024-11-26 19:18:43.202334] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.494 [2024-11-26 19:18:43.202390] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.494 [2024-11-26 19:18:43.202405] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.494 [2024-11-26 19:18:43.202412] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.494 [2024-11-26 19:18:43.202418] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:26.494 [2024-11-26 19:18:43.202432] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:26.494 qpair failed and we were unable to recover it. 00:32:26.494 [2024-11-26 19:18:43.212308] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.494 [2024-11-26 19:18:43.212368] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.494 [2024-11-26 19:18:43.212382] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.494 [2024-11-26 19:18:43.212391] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.494 [2024-11-26 19:18:43.212398] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:26.494 [2024-11-26 19:18:43.212413] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:26.494 qpair failed and we were unable to recover it. 00:32:26.494 [2024-11-26 19:18:43.222352] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.494 [2024-11-26 19:18:43.222407] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.494 [2024-11-26 19:18:43.222422] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.494 [2024-11-26 19:18:43.222428] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.494 [2024-11-26 19:18:43.222435] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:26.494 [2024-11-26 19:18:43.222450] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:26.494 qpair failed and we were unable to recover it. 00:32:26.494 [2024-11-26 19:18:43.232373] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.494 [2024-11-26 19:18:43.232431] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.494 [2024-11-26 19:18:43.232446] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.494 [2024-11-26 19:18:43.232453] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.494 [2024-11-26 19:18:43.232459] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:26.494 [2024-11-26 19:18:43.232474] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:26.494 qpair failed and we were unable to recover it. 00:32:26.494 [2024-11-26 19:18:43.242409] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.494 [2024-11-26 19:18:43.242463] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.494 [2024-11-26 19:18:43.242477] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.494 [2024-11-26 19:18:43.242484] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.494 [2024-11-26 19:18:43.242490] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:26.494 [2024-11-26 19:18:43.242504] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:26.494 qpair failed and we were unable to recover it. 00:32:26.494 [2024-11-26 19:18:43.252373] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.494 [2024-11-26 19:18:43.252427] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.494 [2024-11-26 19:18:43.252441] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.494 [2024-11-26 19:18:43.252447] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.494 [2024-11-26 19:18:43.252453] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:26.494 [2024-11-26 19:18:43.252467] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:26.494 qpair failed and we were unable to recover it. 00:32:26.494 [2024-11-26 19:18:43.262514] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.494 [2024-11-26 19:18:43.262623] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.494 [2024-11-26 19:18:43.262640] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.494 [2024-11-26 19:18:43.262647] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.494 [2024-11-26 19:18:43.262653] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:26.494 [2024-11-26 19:18:43.262668] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:26.494 qpair failed and we were unable to recover it. 00:32:26.494 [2024-11-26 19:18:43.272529] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.494 [2024-11-26 19:18:43.272584] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.494 [2024-11-26 19:18:43.272598] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.494 [2024-11-26 19:18:43.272604] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.494 [2024-11-26 19:18:43.272610] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:26.494 [2024-11-26 19:18:43.272624] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:26.494 qpair failed and we were unable to recover it. 00:32:26.494 [2024-11-26 19:18:43.282535] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.494 [2024-11-26 19:18:43.282593] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.494 [2024-11-26 19:18:43.282607] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.494 [2024-11-26 19:18:43.282614] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.494 [2024-11-26 19:18:43.282621] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:26.494 [2024-11-26 19:18:43.282634] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:26.494 qpair failed and we were unable to recover it. 00:32:26.494 [2024-11-26 19:18:43.292553] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.494 [2024-11-26 19:18:43.292614] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.494 [2024-11-26 19:18:43.292628] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.494 [2024-11-26 19:18:43.292635] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.494 [2024-11-26 19:18:43.292641] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:26.494 [2024-11-26 19:18:43.292656] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:26.494 qpair failed and we were unable to recover it. 00:32:26.494 [2024-11-26 19:18:43.302576] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.494 [2024-11-26 19:18:43.302624] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.494 [2024-11-26 19:18:43.302638] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.494 [2024-11-26 19:18:43.302648] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.494 [2024-11-26 19:18:43.302654] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:26.494 [2024-11-26 19:18:43.302668] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:26.494 qpair failed and we were unable to recover it. 00:32:26.494 [2024-11-26 19:18:43.312629] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.494 [2024-11-26 19:18:43.312688] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.494 [2024-11-26 19:18:43.312702] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.494 [2024-11-26 19:18:43.312709] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.494 [2024-11-26 19:18:43.312715] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:26.494 [2024-11-26 19:18:43.312729] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:26.494 qpair failed and we were unable to recover it. 00:32:26.494 [2024-11-26 19:18:43.322648] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.494 [2024-11-26 19:18:43.322705] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.494 [2024-11-26 19:18:43.322721] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.494 [2024-11-26 19:18:43.322728] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.494 [2024-11-26 19:18:43.322734] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:26.495 [2024-11-26 19:18:43.322748] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:26.495 qpair failed and we were unable to recover it. 00:32:26.495 [2024-11-26 19:18:43.332707] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.495 [2024-11-26 19:18:43.332759] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.495 [2024-11-26 19:18:43.332774] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.495 [2024-11-26 19:18:43.332780] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.495 [2024-11-26 19:18:43.332786] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:26.495 [2024-11-26 19:18:43.332800] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:26.495 qpair failed and we were unable to recover it. 00:32:26.495 [2024-11-26 19:18:43.342703] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.495 [2024-11-26 19:18:43.342759] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.495 [2024-11-26 19:18:43.342774] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.495 [2024-11-26 19:18:43.342780] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.495 [2024-11-26 19:18:43.342786] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:26.495 [2024-11-26 19:18:43.342800] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:26.495 qpair failed and we were unable to recover it. 00:32:26.495 [2024-11-26 19:18:43.352733] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.495 [2024-11-26 19:18:43.352789] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.495 [2024-11-26 19:18:43.352803] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.495 [2024-11-26 19:18:43.352809] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.495 [2024-11-26 19:18:43.352815] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:26.495 [2024-11-26 19:18:43.352830] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:26.495 qpair failed and we were unable to recover it. 00:32:26.495 [2024-11-26 19:18:43.362742] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.495 [2024-11-26 19:18:43.362796] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.495 [2024-11-26 19:18:43.362811] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.495 [2024-11-26 19:18:43.362817] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.495 [2024-11-26 19:18:43.362823] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:26.495 [2024-11-26 19:18:43.362838] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:26.495 qpair failed and we were unable to recover it. 00:32:26.495 [2024-11-26 19:18:43.372774] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.495 [2024-11-26 19:18:43.372833] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.495 [2024-11-26 19:18:43.372847] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.495 [2024-11-26 19:18:43.372853] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.495 [2024-11-26 19:18:43.372859] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:26.495 [2024-11-26 19:18:43.372873] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:26.495 qpair failed and we were unable to recover it. 00:32:26.495 [2024-11-26 19:18:43.382813] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.495 [2024-11-26 19:18:43.382866] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.495 [2024-11-26 19:18:43.382882] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.495 [2024-11-26 19:18:43.382888] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.495 [2024-11-26 19:18:43.382895] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:26.495 [2024-11-26 19:18:43.382909] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:26.495 qpair failed and we were unable to recover it. 00:32:26.495 [2024-11-26 19:18:43.392894] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.495 [2024-11-26 19:18:43.392953] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.495 [2024-11-26 19:18:43.392967] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.495 [2024-11-26 19:18:43.392980] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.495 [2024-11-26 19:18:43.392986] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:26.495 [2024-11-26 19:18:43.393000] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:26.495 qpair failed and we were unable to recover it. 00:32:26.495 [2024-11-26 19:18:43.402930] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.495 [2024-11-26 19:18:43.402993] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.495 [2024-11-26 19:18:43.403008] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.495 [2024-11-26 19:18:43.403014] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.495 [2024-11-26 19:18:43.403020] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:26.495 [2024-11-26 19:18:43.403034] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:26.495 qpair failed and we were unable to recover it. 00:32:26.495 [2024-11-26 19:18:43.412916] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.495 [2024-11-26 19:18:43.413072] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.495 [2024-11-26 19:18:43.413130] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.495 [2024-11-26 19:18:43.413139] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.495 [2024-11-26 19:18:43.413145] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:26.495 [2024-11-26 19:18:43.413163] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:26.495 qpair failed and we were unable to recover it. 00:32:26.755 [2024-11-26 19:18:43.422937] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.755 [2024-11-26 19:18:43.422992] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.755 [2024-11-26 19:18:43.423008] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.755 [2024-11-26 19:18:43.423014] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.755 [2024-11-26 19:18:43.423020] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:26.755 [2024-11-26 19:18:43.423035] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:26.755 qpair failed and we were unable to recover it. 00:32:26.755 [2024-11-26 19:18:43.432972] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.755 [2024-11-26 19:18:43.433050] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.755 [2024-11-26 19:18:43.433065] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.755 [2024-11-26 19:18:43.433072] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.755 [2024-11-26 19:18:43.433079] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:26.755 [2024-11-26 19:18:43.433094] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:26.755 qpair failed and we were unable to recover it. 00:32:26.755 [2024-11-26 19:18:43.443042] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.755 [2024-11-26 19:18:43.443104] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.755 [2024-11-26 19:18:43.443119] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.755 [2024-11-26 19:18:43.443125] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.755 [2024-11-26 19:18:43.443131] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:26.755 [2024-11-26 19:18:43.443146] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:26.755 qpair failed and we were unable to recover it. 00:32:26.755 [2024-11-26 19:18:43.453076] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.755 [2024-11-26 19:18:43.453133] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.755 [2024-11-26 19:18:43.453148] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.755 [2024-11-26 19:18:43.453154] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.755 [2024-11-26 19:18:43.453160] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:26.755 [2024-11-26 19:18:43.453174] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:26.755 qpair failed and we were unable to recover it. 00:32:26.755 [2024-11-26 19:18:43.463064] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.755 [2024-11-26 19:18:43.463119] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.755 [2024-11-26 19:18:43.463134] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.755 [2024-11-26 19:18:43.463141] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.755 [2024-11-26 19:18:43.463146] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:26.755 [2024-11-26 19:18:43.463160] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:26.755 qpair failed and we were unable to recover it. 00:32:26.755 [2024-11-26 19:18:43.473090] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.755 [2024-11-26 19:18:43.473145] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.755 [2024-11-26 19:18:43.473159] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.755 [2024-11-26 19:18:43.473165] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.755 [2024-11-26 19:18:43.473171] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:26.755 [2024-11-26 19:18:43.473186] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:26.755 qpair failed and we were unable to recover it. 00:32:26.755 [2024-11-26 19:18:43.483064] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.755 [2024-11-26 19:18:43.483123] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.755 [2024-11-26 19:18:43.483141] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.755 [2024-11-26 19:18:43.483148] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.755 [2024-11-26 19:18:43.483154] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:26.755 [2024-11-26 19:18:43.483168] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:26.755 qpair failed and we were unable to recover it. 00:32:26.755 [2024-11-26 19:18:43.493151] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.755 [2024-11-26 19:18:43.493207] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.755 [2024-11-26 19:18:43.493222] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.755 [2024-11-26 19:18:43.493228] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.755 [2024-11-26 19:18:43.493234] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:26.755 [2024-11-26 19:18:43.493248] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:26.755 qpair failed and we were unable to recover it. 00:32:26.755 [2024-11-26 19:18:43.503184] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.755 [2024-11-26 19:18:43.503242] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.755 [2024-11-26 19:18:43.503257] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.755 [2024-11-26 19:18:43.503263] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.755 [2024-11-26 19:18:43.503270] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:26.755 [2024-11-26 19:18:43.503284] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:26.755 qpair failed and we were unable to recover it. 00:32:26.755 [2024-11-26 19:18:43.513187] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.755 [2024-11-26 19:18:43.513242] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.755 [2024-11-26 19:18:43.513256] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.755 [2024-11-26 19:18:43.513262] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.755 [2024-11-26 19:18:43.513268] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:26.755 [2024-11-26 19:18:43.513283] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:26.755 qpair failed and we were unable to recover it. 00:32:26.755 [2024-11-26 19:18:43.523176] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.755 [2024-11-26 19:18:43.523231] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.755 [2024-11-26 19:18:43.523245] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.755 [2024-11-26 19:18:43.523252] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.755 [2024-11-26 19:18:43.523258] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:26.755 [2024-11-26 19:18:43.523273] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:26.755 qpair failed and we were unable to recover it. 00:32:26.755 [2024-11-26 19:18:43.533256] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.756 [2024-11-26 19:18:43.533359] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.756 [2024-11-26 19:18:43.533375] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.756 [2024-11-26 19:18:43.533382] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.756 [2024-11-26 19:18:43.533388] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:26.756 [2024-11-26 19:18:43.533402] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:26.756 qpair failed and we were unable to recover it. 00:32:26.756 [2024-11-26 19:18:43.543304] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.756 [2024-11-26 19:18:43.543357] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.756 [2024-11-26 19:18:43.543370] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.756 [2024-11-26 19:18:43.543376] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.756 [2024-11-26 19:18:43.543382] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:26.756 [2024-11-26 19:18:43.543396] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:26.756 qpair failed and we were unable to recover it. 00:32:26.756 [2024-11-26 19:18:43.553296] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.756 [2024-11-26 19:18:43.553355] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.756 [2024-11-26 19:18:43.553369] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.756 [2024-11-26 19:18:43.553375] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.756 [2024-11-26 19:18:43.553381] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:26.756 [2024-11-26 19:18:43.553395] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:26.756 qpair failed and we were unable to recover it. 00:32:26.756 [2024-11-26 19:18:43.563357] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.756 [2024-11-26 19:18:43.563408] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.756 [2024-11-26 19:18:43.563423] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.756 [2024-11-26 19:18:43.563429] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.756 [2024-11-26 19:18:43.563435] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:26.756 [2024-11-26 19:18:43.563448] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:26.756 qpair failed and we were unable to recover it. 00:32:26.756 [2024-11-26 19:18:43.573393] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.756 [2024-11-26 19:18:43.573445] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.756 [2024-11-26 19:18:43.573462] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.756 [2024-11-26 19:18:43.573469] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.756 [2024-11-26 19:18:43.573475] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:26.756 [2024-11-26 19:18:43.573489] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:26.756 qpair failed and we were unable to recover it. 00:32:26.756 [2024-11-26 19:18:43.583413] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.756 [2024-11-26 19:18:43.583472] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.756 [2024-11-26 19:18:43.583487] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.756 [2024-11-26 19:18:43.583494] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.756 [2024-11-26 19:18:43.583500] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:26.756 [2024-11-26 19:18:43.583514] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:26.756 qpair failed and we were unable to recover it. 00:32:26.756 [2024-11-26 19:18:43.593439] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.756 [2024-11-26 19:18:43.593511] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.756 [2024-11-26 19:18:43.593526] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.756 [2024-11-26 19:18:43.593533] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.756 [2024-11-26 19:18:43.593539] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:26.756 [2024-11-26 19:18:43.593554] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:26.756 qpair failed and we were unable to recover it. 00:32:26.756 [2024-11-26 19:18:43.603492] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.756 [2024-11-26 19:18:43.603547] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.756 [2024-11-26 19:18:43.603562] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.756 [2024-11-26 19:18:43.603568] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.756 [2024-11-26 19:18:43.603575] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:26.756 [2024-11-26 19:18:43.603589] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:26.756 qpair failed and we were unable to recover it. 00:32:26.756 [2024-11-26 19:18:43.613534] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.756 [2024-11-26 19:18:43.613593] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.756 [2024-11-26 19:18:43.613607] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.756 [2024-11-26 19:18:43.613613] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.756 [2024-11-26 19:18:43.613619] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:26.756 [2024-11-26 19:18:43.613636] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:26.756 qpair failed and we were unable to recover it. 00:32:26.756 [2024-11-26 19:18:43.623524] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.756 [2024-11-26 19:18:43.623573] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.756 [2024-11-26 19:18:43.623588] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.756 [2024-11-26 19:18:43.623594] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.756 [2024-11-26 19:18:43.623600] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:26.756 [2024-11-26 19:18:43.623613] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:26.756 qpair failed and we were unable to recover it. 00:32:26.756 [2024-11-26 19:18:43.633613] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.756 [2024-11-26 19:18:43.633675] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.756 [2024-11-26 19:18:43.633690] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.756 [2024-11-26 19:18:43.633697] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.756 [2024-11-26 19:18:43.633703] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:26.756 [2024-11-26 19:18:43.633718] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:26.756 qpair failed and we were unable to recover it. 00:32:26.756 [2024-11-26 19:18:43.643610] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.756 [2024-11-26 19:18:43.643667] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.756 [2024-11-26 19:18:43.643682] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.756 [2024-11-26 19:18:43.643689] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.756 [2024-11-26 19:18:43.643696] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:26.756 [2024-11-26 19:18:43.643710] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:26.756 qpair failed and we were unable to recover it. 00:32:26.756 [2024-11-26 19:18:43.653612] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.756 [2024-11-26 19:18:43.653669] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.756 [2024-11-26 19:18:43.653684] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.756 [2024-11-26 19:18:43.653690] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.756 [2024-11-26 19:18:43.653696] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:26.756 [2024-11-26 19:18:43.653711] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:26.756 qpair failed and we were unable to recover it. 00:32:26.756 [2024-11-26 19:18:43.663663] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.756 [2024-11-26 19:18:43.663719] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.756 [2024-11-26 19:18:43.663738] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.756 [2024-11-26 19:18:43.663744] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.757 [2024-11-26 19:18:43.663751] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:26.757 [2024-11-26 19:18:43.663765] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:26.757 qpair failed and we were unable to recover it. 00:32:26.757 [2024-11-26 19:18:43.673675] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:26.757 [2024-11-26 19:18:43.673733] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:26.757 [2024-11-26 19:18:43.673747] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:26.757 [2024-11-26 19:18:43.673753] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:26.757 [2024-11-26 19:18:43.673760] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:26.757 [2024-11-26 19:18:43.673775] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:26.757 qpair failed and we were unable to recover it. 00:32:27.016 [2024-11-26 19:18:43.683660] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:27.016 [2024-11-26 19:18:43.683719] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:27.016 [2024-11-26 19:18:43.683733] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:27.016 [2024-11-26 19:18:43.683740] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:27.016 [2024-11-26 19:18:43.683746] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:27.016 [2024-11-26 19:18:43.683760] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:27.016 qpair failed and we were unable to recover it. 00:32:27.016 [2024-11-26 19:18:43.693693] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:27.016 [2024-11-26 19:18:43.693784] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:27.016 [2024-11-26 19:18:43.693799] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:27.016 [2024-11-26 19:18:43.693806] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:27.016 [2024-11-26 19:18:43.693813] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:27.017 [2024-11-26 19:18:43.693828] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:27.017 qpair failed and we were unable to recover it. 00:32:27.017 [2024-11-26 19:18:43.703788] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:27.017 [2024-11-26 19:18:43.703846] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:27.017 [2024-11-26 19:18:43.703861] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:27.017 [2024-11-26 19:18:43.703867] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:27.017 [2024-11-26 19:18:43.703874] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:27.017 [2024-11-26 19:18:43.703892] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:27.017 qpair failed and we were unable to recover it. 00:32:27.017 [2024-11-26 19:18:43.713863] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:27.017 [2024-11-26 19:18:43.713917] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:27.017 [2024-11-26 19:18:43.713931] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:27.017 [2024-11-26 19:18:43.713938] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:27.017 [2024-11-26 19:18:43.713945] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:27.017 [2024-11-26 19:18:43.713966] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:27.017 qpair failed and we were unable to recover it. 00:32:27.017 [2024-11-26 19:18:43.723798] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:27.017 [2024-11-26 19:18:43.723852] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:27.017 [2024-11-26 19:18:43.723867] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:27.017 [2024-11-26 19:18:43.723873] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:27.017 [2024-11-26 19:18:43.723879] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:27.017 [2024-11-26 19:18:43.723894] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:27.017 qpair failed and we were unable to recover it. 00:32:27.017 [2024-11-26 19:18:43.733802] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:27.017 [2024-11-26 19:18:43.733863] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:27.017 [2024-11-26 19:18:43.733877] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:27.017 [2024-11-26 19:18:43.733884] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:27.017 [2024-11-26 19:18:43.733890] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:27.017 [2024-11-26 19:18:43.733905] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:27.017 qpair failed and we were unable to recover it. 00:32:27.017 [2024-11-26 19:18:43.743903] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:27.017 [2024-11-26 19:18:43.743960] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:27.017 [2024-11-26 19:18:43.743975] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:27.017 [2024-11-26 19:18:43.743981] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:27.017 [2024-11-26 19:18:43.743987] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:27.017 [2024-11-26 19:18:43.744002] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:27.017 qpair failed and we were unable to recover it. 00:32:27.017 [2024-11-26 19:18:43.753931] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:27.017 [2024-11-26 19:18:43.753990] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:27.017 [2024-11-26 19:18:43.754008] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:27.017 [2024-11-26 19:18:43.754014] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:27.017 [2024-11-26 19:18:43.754020] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:27.017 [2024-11-26 19:18:43.754034] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:27.017 qpair failed and we were unable to recover it. 00:32:27.017 [2024-11-26 19:18:43.764001] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:27.017 [2024-11-26 19:18:43.764061] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:27.017 [2024-11-26 19:18:43.764077] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:27.017 [2024-11-26 19:18:43.764085] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:27.017 [2024-11-26 19:18:43.764091] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:27.017 [2024-11-26 19:18:43.764106] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:27.017 qpair failed and we were unable to recover it. 00:32:27.017 [2024-11-26 19:18:43.774026] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:27.017 [2024-11-26 19:18:43.774086] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:27.017 [2024-11-26 19:18:43.774100] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:27.017 [2024-11-26 19:18:43.774107] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:27.017 [2024-11-26 19:18:43.774112] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:27.017 [2024-11-26 19:18:43.774127] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:27.017 qpair failed and we were unable to recover it. 00:32:27.017 [2024-11-26 19:18:43.783942] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:27.017 [2024-11-26 19:18:43.784007] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:27.017 [2024-11-26 19:18:43.784020] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:27.017 [2024-11-26 19:18:43.784027] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:27.017 [2024-11-26 19:18:43.784033] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:27.017 [2024-11-26 19:18:43.784047] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:27.017 qpair failed and we were unable to recover it. 00:32:27.017 [2024-11-26 19:18:43.794012] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:27.017 [2024-11-26 19:18:43.794072] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:27.017 [2024-11-26 19:18:43.794086] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:27.017 [2024-11-26 19:18:43.794092] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:27.017 [2024-11-26 19:18:43.794098] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:27.017 [2024-11-26 19:18:43.794116] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:27.017 qpair failed and we were unable to recover it. 00:32:27.017 [2024-11-26 19:18:43.804088] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:27.017 [2024-11-26 19:18:43.804142] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:27.017 [2024-11-26 19:18:43.804157] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:27.017 [2024-11-26 19:18:43.804164] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:27.018 [2024-11-26 19:18:43.804169] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:27.018 [2024-11-26 19:18:43.804184] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:27.018 qpair failed and we were unable to recover it. 00:32:27.018 [2024-11-26 19:18:43.814048] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:27.018 [2024-11-26 19:18:43.814141] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:27.018 [2024-11-26 19:18:43.814156] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:27.018 [2024-11-26 19:18:43.814162] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:27.018 [2024-11-26 19:18:43.814168] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:27.018 [2024-11-26 19:18:43.814183] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:27.018 qpair failed and we were unable to recover it. 00:32:27.018 [2024-11-26 19:18:43.824085] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:27.018 [2024-11-26 19:18:43.824143] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:27.018 [2024-11-26 19:18:43.824159] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:27.018 [2024-11-26 19:18:43.824168] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:27.018 [2024-11-26 19:18:43.824177] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:27.018 [2024-11-26 19:18:43.824193] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:27.018 qpair failed and we were unable to recover it. 00:32:27.018 [2024-11-26 19:18:43.834214] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:27.018 [2024-11-26 19:18:43.834269] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:27.018 [2024-11-26 19:18:43.834284] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:27.018 [2024-11-26 19:18:43.834290] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:27.018 [2024-11-26 19:18:43.834296] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:27.018 [2024-11-26 19:18:43.834312] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:27.018 qpair failed and we were unable to recover it. 00:32:27.018 [2024-11-26 19:18:43.844214] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:27.018 [2024-11-26 19:18:43.844271] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:27.018 [2024-11-26 19:18:43.844289] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:27.018 [2024-11-26 19:18:43.844295] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:27.018 [2024-11-26 19:18:43.844301] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:27.018 [2024-11-26 19:18:43.844314] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:27.018 qpair failed and we were unable to recover it. 00:32:27.018 [2024-11-26 19:18:43.854230] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:27.018 [2024-11-26 19:18:43.854286] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:27.018 [2024-11-26 19:18:43.854300] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:27.018 [2024-11-26 19:18:43.854307] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:27.018 [2024-11-26 19:18:43.854314] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:27.018 [2024-11-26 19:18:43.854328] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:27.018 qpair failed and we were unable to recover it. 00:32:27.018 [2024-11-26 19:18:43.864243] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:27.018 [2024-11-26 19:18:43.864338] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:27.018 [2024-11-26 19:18:43.864353] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:27.018 [2024-11-26 19:18:43.864361] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:27.018 [2024-11-26 19:18:43.864367] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:27.018 [2024-11-26 19:18:43.864381] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:27.018 qpair failed and we were unable to recover it. 00:32:27.018 [2024-11-26 19:18:43.874277] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:27.018 [2024-11-26 19:18:43.874334] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:27.018 [2024-11-26 19:18:43.874348] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:27.018 [2024-11-26 19:18:43.874355] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:27.018 [2024-11-26 19:18:43.874361] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:27.018 [2024-11-26 19:18:43.874375] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:27.018 qpair failed and we were unable to recover it. 00:32:27.018 [2024-11-26 19:18:43.884353] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:27.018 [2024-11-26 19:18:43.884410] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:27.018 [2024-11-26 19:18:43.884424] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:27.018 [2024-11-26 19:18:43.884431] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:27.018 [2024-11-26 19:18:43.884438] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:27.018 [2024-11-26 19:18:43.884457] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:27.018 qpair failed and we were unable to recover it. 00:32:27.018 [2024-11-26 19:18:43.894272] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:27.018 [2024-11-26 19:18:43.894332] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:27.018 [2024-11-26 19:18:43.894347] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:27.018 [2024-11-26 19:18:43.894354] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:27.018 [2024-11-26 19:18:43.894360] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:27.018 [2024-11-26 19:18:43.894373] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:27.018 qpair failed and we were unable to recover it. 00:32:27.018 [2024-11-26 19:18:43.904362] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:27.018 [2024-11-26 19:18:43.904412] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:27.018 [2024-11-26 19:18:43.904426] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:27.018 [2024-11-26 19:18:43.904433] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:27.018 [2024-11-26 19:18:43.904439] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:27.018 [2024-11-26 19:18:43.904453] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:27.018 qpair failed and we were unable to recover it. 00:32:27.019 [2024-11-26 19:18:43.914438] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:27.019 [2024-11-26 19:18:43.914496] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:27.019 [2024-11-26 19:18:43.914510] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:27.019 [2024-11-26 19:18:43.914516] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:27.019 [2024-11-26 19:18:43.914522] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:27.019 [2024-11-26 19:18:43.914536] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:27.019 qpair failed and we were unable to recover it. 00:32:27.019 [2024-11-26 19:18:43.924410] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:27.019 [2024-11-26 19:18:43.924467] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:27.019 [2024-11-26 19:18:43.924481] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:27.019 [2024-11-26 19:18:43.924487] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:27.019 [2024-11-26 19:18:43.924493] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:27.019 [2024-11-26 19:18:43.924507] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:27.019 qpair failed and we were unable to recover it. 00:32:27.019 [2024-11-26 19:18:43.934503] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:27.019 [2024-11-26 19:18:43.934587] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:27.019 [2024-11-26 19:18:43.934605] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:27.019 [2024-11-26 19:18:43.934612] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:27.019 [2024-11-26 19:18:43.934618] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:27.019 [2024-11-26 19:18:43.934633] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:27.019 qpair failed and we were unable to recover it. 00:32:27.278 [2024-11-26 19:18:43.944412] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:27.278 [2024-11-26 19:18:43.944472] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:27.278 [2024-11-26 19:18:43.944486] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:27.278 [2024-11-26 19:18:43.944493] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:27.278 [2024-11-26 19:18:43.944498] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:27.278 [2024-11-26 19:18:43.944513] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:27.278 qpair failed and we were unable to recover it. 00:32:27.278 [2024-11-26 19:18:43.954482] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:27.278 [2024-11-26 19:18:43.954538] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:27.278 [2024-11-26 19:18:43.954552] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:27.278 [2024-11-26 19:18:43.954558] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:27.278 [2024-11-26 19:18:43.954564] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:27.278 [2024-11-26 19:18:43.954578] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:27.278 qpair failed and we were unable to recover it. 00:32:27.278 [2024-11-26 19:18:43.964568] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:27.278 [2024-11-26 19:18:43.964659] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:27.278 [2024-11-26 19:18:43.964674] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:27.278 [2024-11-26 19:18:43.964681] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:27.278 [2024-11-26 19:18:43.964687] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:27.278 [2024-11-26 19:18:43.964702] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:27.278 qpair failed and we were unable to recover it. 00:32:27.278 [2024-11-26 19:18:43.974509] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:27.278 [2024-11-26 19:18:43.974604] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:27.278 [2024-11-26 19:18:43.974619] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:27.278 [2024-11-26 19:18:43.974626] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:27.278 [2024-11-26 19:18:43.974635] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:27.278 [2024-11-26 19:18:43.974650] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:27.278 qpair failed and we were unable to recover it. 00:32:27.278 [2024-11-26 19:18:43.984519] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:27.278 [2024-11-26 19:18:43.984585] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:27.278 [2024-11-26 19:18:43.984600] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:27.278 [2024-11-26 19:18:43.984607] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:27.279 [2024-11-26 19:18:43.984613] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:27.279 [2024-11-26 19:18:43.984627] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:27.279 qpair failed and we were unable to recover it. 00:32:27.279 [2024-11-26 19:18:43.994628] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:27.279 [2024-11-26 19:18:43.994684] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:27.279 [2024-11-26 19:18:43.994698] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:27.279 [2024-11-26 19:18:43.994704] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:27.279 [2024-11-26 19:18:43.994710] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:27.279 [2024-11-26 19:18:43.994724] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:27.279 qpair failed and we were unable to recover it. 00:32:27.279 [2024-11-26 19:18:44.004630] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:27.279 [2024-11-26 19:18:44.004685] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:27.279 [2024-11-26 19:18:44.004700] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:27.279 [2024-11-26 19:18:44.004706] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:27.279 [2024-11-26 19:18:44.004713] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2422af0 00:32:27.279 [2024-11-26 19:18:44.004727] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:32:27.279 qpair failed and we were unable to recover it. 00:32:27.279 [2024-11-26 19:18:44.004832] nvme_ctrlr.c:4339:nvme_ctrlr_keep_alive: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Submitting Keep Alive failed 00:32:27.279 A controller has encountered a failure and is being reset. 00:32:27.279 [2024-11-26 19:18:44.014753] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:27.279 [2024-11-26 19:18:44.014827] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:27.279 [2024-11-26 19:18:44.014853] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:27.279 [2024-11-26 19:18:44.014865] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:27.279 [2024-11-26 19:18:44.014874] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d4000b90 00:32:27.279 [2024-11-26 19:18:44.014898] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:32:27.279 qpair failed and we were unable to recover it. 00:32:27.279 [2024-11-26 19:18:44.024689] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:27.279 [2024-11-26 19:18:44.024747] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:27.279 [2024-11-26 19:18:44.024762] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:27.279 [2024-11-26 19:18:44.024769] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:27.279 [2024-11-26 19:18:44.024775] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d4000b90 00:32:27.279 [2024-11-26 19:18:44.024791] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:32:27.279 qpair failed and we were unable to recover it. 00:32:27.279 [2024-11-26 19:18:44.034777] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:27.279 [2024-11-26 19:18:44.034846] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:27.279 [2024-11-26 19:18:44.034867] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:27.279 [2024-11-26 19:18:44.034875] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:27.279 [2024-11-26 19:18:44.034881] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:27.279 [2024-11-26 19:18:44.034899] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:27.279 qpair failed and we were unable to recover it. 00:32:27.279 [2024-11-26 19:18:44.044811] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:32:27.279 [2024-11-26 19:18:44.044866] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:32:27.279 [2024-11-26 19:18:44.044879] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:32:27.279 [2024-11-26 19:18:44.044886] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:32:27.279 [2024-11-26 19:18:44.044892] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f76d8000b90 00:32:27.279 [2024-11-26 19:18:44.044907] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:32:27.279 qpair failed and we were unable to recover it. 00:32:27.279 [2024-11-26 19:18:44.045074] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2430580 (9): Bad file descriptor 00:32:27.279 Controller properly reset. 00:32:27.279 Initializing NVMe Controllers 00:32:27.279 Attaching to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:32:27.279 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:32:27.279 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 0 00:32:27.279 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 1 00:32:27.279 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 2 00:32:27.279 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 3 00:32:27.279 Initialization complete. Launching workers. 00:32:27.279 Starting thread on core 1 00:32:27.279 Starting thread on core 2 00:32:27.279 Starting thread on core 3 00:32:27.279 Starting thread on core 0 00:32:27.279 19:18:44 -- host/target_disconnect.sh@59 -- # sync 00:32:27.279 00:32:27.279 real 0m11.441s 00:32:27.279 user 0m21.641s 00:32:27.279 sys 0m4.328s 00:32:27.279 19:18:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:27.279 19:18:44 -- common/autotest_common.sh@10 -- # set +x 00:32:27.279 ************************************ 00:32:27.279 END TEST nvmf_target_disconnect_tc2 00:32:27.279 ************************************ 00:32:27.279 19:18:44 -- host/target_disconnect.sh@80 -- # '[' -n '' ']' 00:32:27.279 19:18:44 -- host/target_disconnect.sh@84 -- # trap - SIGINT SIGTERM EXIT 00:32:27.279 19:18:44 -- host/target_disconnect.sh@85 -- # nvmftestfini 00:32:27.279 19:18:44 -- nvmf/common.sh@476 -- # nvmfcleanup 00:32:27.279 19:18:44 -- nvmf/common.sh@116 -- # sync 00:32:27.279 19:18:44 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:32:27.279 19:18:44 -- nvmf/common.sh@119 -- # set +e 00:32:27.279 19:18:44 -- nvmf/common.sh@120 -- # for i in {1..20} 00:32:27.279 19:18:44 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:32:27.279 rmmod nvme_tcp 00:32:27.279 rmmod nvme_fabrics 00:32:27.279 rmmod nvme_keyring 00:32:27.538 19:18:44 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:32:27.538 19:18:44 -- nvmf/common.sh@123 -- # set -e 00:32:27.538 19:18:44 -- nvmf/common.sh@124 -- # return 0 00:32:27.538 19:18:44 -- nvmf/common.sh@477 -- # '[' -n 3301733 ']' 00:32:27.538 19:18:44 -- nvmf/common.sh@478 -- # killprocess 3301733 00:32:27.538 19:18:44 -- common/autotest_common.sh@936 -- # '[' -z 3301733 ']' 00:32:27.538 19:18:44 -- common/autotest_common.sh@940 -- # kill -0 3301733 00:32:27.538 19:18:44 -- common/autotest_common.sh@941 -- # uname 00:32:27.538 19:18:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:32:27.538 19:18:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3301733 00:32:27.538 19:18:44 -- common/autotest_common.sh@942 -- # process_name=reactor_4 00:32:27.538 19:18:44 -- common/autotest_common.sh@946 -- # '[' reactor_4 = sudo ']' 00:32:27.538 19:18:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3301733' 00:32:27.538 killing process with pid 3301733 00:32:27.538 19:18:44 -- common/autotest_common.sh@955 -- # kill 3301733 00:32:27.538 19:18:44 -- common/autotest_common.sh@960 -- # wait 3301733 00:32:27.797 19:18:44 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:32:27.797 19:18:44 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:32:27.797 19:18:44 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:32:27.797 19:18:44 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:32:27.797 19:18:44 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:32:27.797 19:18:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:32:27.797 19:18:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:32:27.797 19:18:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:32:29.703 19:18:46 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:32:29.703 00:32:29.703 real 0m19.905s 00:32:29.703 user 0m49.465s 00:32:29.703 sys 0m9.029s 00:32:29.703 19:18:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:29.703 19:18:46 -- common/autotest_common.sh@10 -- # set +x 00:32:29.703 ************************************ 00:32:29.703 END TEST nvmf_target_disconnect 00:32:29.703 ************************************ 00:32:29.703 19:18:46 -- nvmf/nvmf.sh@127 -- # timing_exit host 00:32:29.703 19:18:46 -- common/autotest_common.sh@728 -- # xtrace_disable 00:32:29.703 19:18:46 -- common/autotest_common.sh@10 -- # set +x 00:32:29.703 19:18:46 -- nvmf/nvmf.sh@129 -- # trap - SIGINT SIGTERM EXIT 00:32:29.703 00:32:29.703 real 24m59.321s 00:32:29.703 user 67m39.404s 00:32:29.703 sys 6m51.776s 00:32:29.703 19:18:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:29.703 19:18:46 -- common/autotest_common.sh@10 -- # set +x 00:32:29.703 ************************************ 00:32:29.703 END TEST nvmf_tcp 00:32:29.703 ************************************ 00:32:29.962 19:18:46 -- spdk/autotest.sh@283 -- # [[ 0 -eq 0 ]] 00:32:29.962 19:18:46 -- spdk/autotest.sh@284 -- # run_test spdkcli_nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:32:29.962 19:18:46 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:32:29.962 19:18:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:29.962 19:18:46 -- common/autotest_common.sh@10 -- # set +x 00:32:29.962 ************************************ 00:32:29.962 START TEST spdkcli_nvmf_tcp 00:32:29.962 ************************************ 00:32:29.962 19:18:46 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:32:29.962 * Looking for test storage... 00:32:29.962 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:32:29.962 19:18:46 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:32:29.962 19:18:46 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:32:29.962 19:18:46 -- common/autotest_common.sh@1690 -- # lcov --version 00:32:29.962 19:18:46 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:32:29.962 19:18:46 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:32:29.962 19:18:46 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:32:29.962 19:18:46 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:32:29.962 19:18:46 -- scripts/common.sh@335 -- # IFS=.-: 00:32:29.962 19:18:46 -- scripts/common.sh@335 -- # read -ra ver1 00:32:29.962 19:18:46 -- scripts/common.sh@336 -- # IFS=.-: 00:32:29.962 19:18:46 -- scripts/common.sh@336 -- # read -ra ver2 00:32:29.962 19:18:46 -- scripts/common.sh@337 -- # local 'op=<' 00:32:29.962 19:18:46 -- scripts/common.sh@339 -- # ver1_l=2 00:32:29.962 19:18:46 -- scripts/common.sh@340 -- # ver2_l=1 00:32:29.962 19:18:46 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:32:29.962 19:18:46 -- scripts/common.sh@343 -- # case "$op" in 00:32:29.962 19:18:46 -- scripts/common.sh@344 -- # : 1 00:32:29.962 19:18:46 -- scripts/common.sh@363 -- # (( v = 0 )) 00:32:29.962 19:18:46 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:32:29.962 19:18:46 -- scripts/common.sh@364 -- # decimal 1 00:32:29.962 19:18:46 -- scripts/common.sh@352 -- # local d=1 00:32:29.962 19:18:46 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:32:29.962 19:18:46 -- scripts/common.sh@354 -- # echo 1 00:32:29.962 19:18:46 -- scripts/common.sh@364 -- # ver1[v]=1 00:32:29.962 19:18:46 -- scripts/common.sh@365 -- # decimal 2 00:32:29.962 19:18:46 -- scripts/common.sh@352 -- # local d=2 00:32:29.962 19:18:46 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:32:29.962 19:18:46 -- scripts/common.sh@354 -- # echo 2 00:32:29.962 19:18:46 -- scripts/common.sh@365 -- # ver2[v]=2 00:32:29.962 19:18:46 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:32:29.962 19:18:46 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:32:29.962 19:18:46 -- scripts/common.sh@367 -- # return 0 00:32:29.962 19:18:46 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:32:29.962 19:18:46 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:32:29.962 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:29.962 --rc genhtml_branch_coverage=1 00:32:29.962 --rc genhtml_function_coverage=1 00:32:29.962 --rc genhtml_legend=1 00:32:29.962 --rc geninfo_all_blocks=1 00:32:29.962 --rc geninfo_unexecuted_blocks=1 00:32:29.962 00:32:29.962 ' 00:32:29.962 19:18:46 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:32:29.962 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:29.962 --rc genhtml_branch_coverage=1 00:32:29.962 --rc genhtml_function_coverage=1 00:32:29.962 --rc genhtml_legend=1 00:32:29.962 --rc geninfo_all_blocks=1 00:32:29.962 --rc geninfo_unexecuted_blocks=1 00:32:29.962 00:32:29.962 ' 00:32:29.962 19:18:46 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:32:29.962 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:29.962 --rc genhtml_branch_coverage=1 00:32:29.963 --rc genhtml_function_coverage=1 00:32:29.963 --rc genhtml_legend=1 00:32:29.963 --rc geninfo_all_blocks=1 00:32:29.963 --rc geninfo_unexecuted_blocks=1 00:32:29.963 00:32:29.963 ' 00:32:29.963 19:18:46 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:32:29.963 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:29.963 --rc genhtml_branch_coverage=1 00:32:29.963 --rc genhtml_function_coverage=1 00:32:29.963 --rc genhtml_legend=1 00:32:29.963 --rc geninfo_all_blocks=1 00:32:29.963 --rc geninfo_unexecuted_blocks=1 00:32:29.963 00:32:29.963 ' 00:32:29.963 19:18:46 -- spdkcli/nvmf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:32:29.963 19:18:46 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:32:29.963 19:18:46 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:32:29.963 19:18:46 -- spdkcli/nvmf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:32:29.963 19:18:46 -- nvmf/common.sh@7 -- # uname -s 00:32:29.963 19:18:46 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:32:29.963 19:18:46 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:32:29.963 19:18:46 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:32:29.963 19:18:46 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:32:29.963 19:18:46 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:32:29.963 19:18:46 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:32:29.963 19:18:46 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:32:29.963 19:18:46 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:32:29.963 19:18:46 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:32:29.963 19:18:46 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:32:29.963 19:18:46 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:32:29.963 19:18:46 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:32:29.963 19:18:46 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:32:29.963 19:18:46 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:32:29.963 19:18:46 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:32:29.963 19:18:46 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:32:29.963 19:18:46 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:32:29.963 19:18:46 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:32:29.963 19:18:46 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:32:29.963 19:18:46 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:29.963 19:18:46 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:29.963 19:18:46 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:29.963 19:18:46 -- paths/export.sh@5 -- # export PATH 00:32:29.963 19:18:46 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:29.963 19:18:46 -- nvmf/common.sh@46 -- # : 0 00:32:29.963 19:18:46 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:32:29.963 19:18:46 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:32:29.963 19:18:46 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:32:29.963 19:18:46 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:32:29.963 19:18:46 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:32:29.963 19:18:46 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:32:29.963 19:18:46 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:32:29.963 19:18:46 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:32:29.963 19:18:46 -- spdkcli/nvmf.sh@12 -- # MATCH_FILE=spdkcli_nvmf.test 00:32:29.963 19:18:46 -- spdkcli/nvmf.sh@13 -- # SPDKCLI_BRANCH=/nvmf 00:32:29.963 19:18:46 -- spdkcli/nvmf.sh@15 -- # trap cleanup EXIT 00:32:29.963 19:18:46 -- spdkcli/nvmf.sh@17 -- # timing_enter run_nvmf_tgt 00:32:29.963 19:18:46 -- common/autotest_common.sh@722 -- # xtrace_disable 00:32:29.963 19:18:46 -- common/autotest_common.sh@10 -- # set +x 00:32:29.963 19:18:46 -- spdkcli/nvmf.sh@18 -- # run_nvmf_tgt 00:32:29.963 19:18:46 -- spdkcli/common.sh@33 -- # nvmf_tgt_pid=3303405 00:32:29.963 19:18:46 -- spdkcli/common.sh@34 -- # waitforlisten 3303405 00:32:29.963 19:18:46 -- common/autotest_common.sh@829 -- # '[' -z 3303405 ']' 00:32:29.963 19:18:46 -- spdkcli/common.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x3 -p 0 00:32:29.963 19:18:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:32:29.963 19:18:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:32:29.963 19:18:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:32:29.963 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:32:29.963 19:18:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:32:29.963 19:18:46 -- common/autotest_common.sh@10 -- # set +x 00:32:29.963 [2024-11-26 19:18:46.877173] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:32:29.963 [2024-11-26 19:18:46.877225] [ DPDK EAL parameters: nvmf --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3303405 ] 00:32:30.222 EAL: No free 2048 kB hugepages reported on node 1 00:32:30.222 [2024-11-26 19:18:46.932618] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:32:30.222 [2024-11-26 19:18:46.972881] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:32:30.222 [2024-11-26 19:18:46.973056] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:32:30.222 [2024-11-26 19:18:46.973060] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:32:30.788 19:18:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:32:30.788 19:18:47 -- common/autotest_common.sh@862 -- # return 0 00:32:30.788 19:18:47 -- spdkcli/nvmf.sh@19 -- # timing_exit run_nvmf_tgt 00:32:30.788 19:18:47 -- common/autotest_common.sh@728 -- # xtrace_disable 00:32:30.788 19:18:47 -- common/autotest_common.sh@10 -- # set +x 00:32:31.046 19:18:47 -- spdkcli/nvmf.sh@21 -- # NVMF_TARGET_IP=127.0.0.1 00:32:31.046 19:18:47 -- spdkcli/nvmf.sh@22 -- # [[ tcp == \r\d\m\a ]] 00:32:31.046 19:18:47 -- spdkcli/nvmf.sh@27 -- # timing_enter spdkcli_create_nvmf_config 00:32:31.046 19:18:47 -- common/autotest_common.sh@722 -- # xtrace_disable 00:32:31.046 19:18:47 -- common/autotest_common.sh@10 -- # set +x 00:32:31.046 19:18:47 -- spdkcli/nvmf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/bdevs/malloc create 32 512 Malloc1'\'' '\''Malloc1'\'' True 00:32:31.046 '\''/bdevs/malloc create 32 512 Malloc2'\'' '\''Malloc2'\'' True 00:32:31.046 '\''/bdevs/malloc create 32 512 Malloc3'\'' '\''Malloc3'\'' True 00:32:31.046 '\''/bdevs/malloc create 32 512 Malloc4'\'' '\''Malloc4'\'' True 00:32:31.046 '\''/bdevs/malloc create 32 512 Malloc5'\'' '\''Malloc5'\'' True 00:32:31.046 '\''/bdevs/malloc create 32 512 Malloc6'\'' '\''Malloc6'\'' True 00:32:31.046 '\''nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192'\'' '\'''\'' True 00:32:31.046 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:32:31.046 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1'\'' '\''Malloc3'\'' True 00:32:31.046 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2'\'' '\''Malloc4'\'' True 00:32:31.046 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:32:31.046 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:32:31.046 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2'\'' '\''Malloc2'\'' True 00:32:31.046 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:32:31.046 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:32:31.046 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1'\'' '\''Malloc1'\'' True 00:32:31.046 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:32:31.046 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:32:31.046 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:32:31.046 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:32:31.046 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True'\'' '\''Allow any host'\'' 00:32:31.046 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False'\'' '\''Allow any host'\'' True 00:32:31.046 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:32:31.046 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4'\'' '\''127.0.0.1:4262'\'' True 00:32:31.046 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:32:31.046 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5'\'' '\''Malloc5'\'' True 00:32:31.046 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6'\'' '\''Malloc6'\'' True 00:32:31.046 '\''/nvmf/referral create tcp 127.0.0.2 4030 IPv4'\'' 00:32:31.046 ' 00:32:31.304 [2024-11-26 19:18:48.091220] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:32:33.836 [2024-11-26 19:18:50.155664] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:32:34.772 [2024-11-26 19:18:51.343766] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4260 *** 00:32:36.673 [2024-11-26 19:18:53.538635] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4261 *** 00:32:38.576 [2024-11-26 19:18:55.420781] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4262 *** 00:32:39.975 Executing command: ['/bdevs/malloc create 32 512 Malloc1', 'Malloc1', True] 00:32:39.975 Executing command: ['/bdevs/malloc create 32 512 Malloc2', 'Malloc2', True] 00:32:39.975 Executing command: ['/bdevs/malloc create 32 512 Malloc3', 'Malloc3', True] 00:32:39.975 Executing command: ['/bdevs/malloc create 32 512 Malloc4', 'Malloc4', True] 00:32:39.975 Executing command: ['/bdevs/malloc create 32 512 Malloc5', 'Malloc5', True] 00:32:39.975 Executing command: ['/bdevs/malloc create 32 512 Malloc6', 'Malloc6', True] 00:32:39.975 Executing command: ['nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192', '', True] 00:32:39.975 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode1', True] 00:32:39.975 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1', 'Malloc3', True] 00:32:39.975 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2', 'Malloc4', True] 00:32:39.975 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:32:39.975 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:32:39.975 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2', 'Malloc2', True] 00:32:39.975 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:32:39.975 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:32:39.975 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1', 'Malloc1', True] 00:32:39.975 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:32:39.975 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:32:39.975 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1', 'nqn.2014-08.org.spdk:cnode1', True] 00:32:39.975 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:32:39.975 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True', 'Allow any host', False] 00:32:39.975 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False', 'Allow any host', True] 00:32:39.975 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:32:39.975 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4', '127.0.0.1:4262', True] 00:32:39.975 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:32:39.975 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5', 'Malloc5', True] 00:32:39.975 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6', 'Malloc6', True] 00:32:39.975 Executing command: ['/nvmf/referral create tcp 127.0.0.2 4030 IPv4', False] 00:32:40.233 19:18:56 -- spdkcli/nvmf.sh@66 -- # timing_exit spdkcli_create_nvmf_config 00:32:40.233 19:18:56 -- common/autotest_common.sh@728 -- # xtrace_disable 00:32:40.233 19:18:56 -- common/autotest_common.sh@10 -- # set +x 00:32:40.233 19:18:57 -- spdkcli/nvmf.sh@68 -- # timing_enter spdkcli_check_match 00:32:40.233 19:18:57 -- common/autotest_common.sh@722 -- # xtrace_disable 00:32:40.233 19:18:57 -- common/autotest_common.sh@10 -- # set +x 00:32:40.233 19:18:57 -- spdkcli/nvmf.sh@69 -- # check_match 00:32:40.233 19:18:57 -- spdkcli/common.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdkcli.py ll /nvmf 00:32:40.492 19:18:57 -- spdkcli/common.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/match/match /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test.match 00:32:40.751 19:18:57 -- spdkcli/common.sh@46 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test 00:32:40.751 19:18:57 -- spdkcli/nvmf.sh@70 -- # timing_exit spdkcli_check_match 00:32:40.751 19:18:57 -- common/autotest_common.sh@728 -- # xtrace_disable 00:32:40.751 19:18:57 -- common/autotest_common.sh@10 -- # set +x 00:32:40.751 19:18:57 -- spdkcli/nvmf.sh@72 -- # timing_enter spdkcli_clear_nvmf_config 00:32:40.751 19:18:57 -- common/autotest_common.sh@722 -- # xtrace_disable 00:32:40.751 19:18:57 -- common/autotest_common.sh@10 -- # set +x 00:32:40.751 19:18:57 -- spdkcli/nvmf.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1'\'' '\''Malloc3'\'' 00:32:40.751 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all'\'' '\''Malloc4'\'' 00:32:40.751 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:32:40.751 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' 00:32:40.751 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262'\'' '\''127.0.0.1:4262'\'' 00:32:40.751 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all'\'' '\''127.0.0.1:4261'\'' 00:32:40.751 '\''/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3'\'' '\''nqn.2014-08.org.spdk:cnode3'\'' 00:32:40.751 '\''/nvmf/subsystem delete_all'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:32:40.751 '\''/bdevs/malloc delete Malloc6'\'' '\''Malloc6'\'' 00:32:40.751 '\''/bdevs/malloc delete Malloc5'\'' '\''Malloc5'\'' 00:32:40.751 '\''/bdevs/malloc delete Malloc4'\'' '\''Malloc4'\'' 00:32:40.751 '\''/bdevs/malloc delete Malloc3'\'' '\''Malloc3'\'' 00:32:40.751 '\''/bdevs/malloc delete Malloc2'\'' '\''Malloc2'\'' 00:32:40.751 '\''/bdevs/malloc delete Malloc1'\'' '\''Malloc1'\'' 00:32:40.751 ' 00:32:46.018 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1', 'Malloc3', False] 00:32:46.018 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all', 'Malloc4', False] 00:32:46.018 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', False] 00:32:46.018 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all', 'nqn.2014-08.org.spdk:cnode1', False] 00:32:46.018 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262', '127.0.0.1:4262', False] 00:32:46.018 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all', '127.0.0.1:4261', False] 00:32:46.018 Executing command: ['/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3', 'nqn.2014-08.org.spdk:cnode3', False] 00:32:46.018 Executing command: ['/nvmf/subsystem delete_all', 'nqn.2014-08.org.spdk:cnode2', False] 00:32:46.018 Executing command: ['/bdevs/malloc delete Malloc6', 'Malloc6', False] 00:32:46.018 Executing command: ['/bdevs/malloc delete Malloc5', 'Malloc5', False] 00:32:46.018 Executing command: ['/bdevs/malloc delete Malloc4', 'Malloc4', False] 00:32:46.018 Executing command: ['/bdevs/malloc delete Malloc3', 'Malloc3', False] 00:32:46.018 Executing command: ['/bdevs/malloc delete Malloc2', 'Malloc2', False] 00:32:46.018 Executing command: ['/bdevs/malloc delete Malloc1', 'Malloc1', False] 00:32:46.018 19:19:02 -- spdkcli/nvmf.sh@88 -- # timing_exit spdkcli_clear_nvmf_config 00:32:46.018 19:19:02 -- common/autotest_common.sh@728 -- # xtrace_disable 00:32:46.018 19:19:02 -- common/autotest_common.sh@10 -- # set +x 00:32:46.018 19:19:02 -- spdkcli/nvmf.sh@90 -- # killprocess 3303405 00:32:46.018 19:19:02 -- common/autotest_common.sh@936 -- # '[' -z 3303405 ']' 00:32:46.018 19:19:02 -- common/autotest_common.sh@940 -- # kill -0 3303405 00:32:46.018 19:19:02 -- common/autotest_common.sh@941 -- # uname 00:32:46.018 19:19:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:32:46.018 19:19:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3303405 00:32:46.018 19:19:02 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:32:46.018 19:19:02 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:32:46.018 19:19:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3303405' 00:32:46.018 killing process with pid 3303405 00:32:46.018 19:19:02 -- common/autotest_common.sh@955 -- # kill 3303405 00:32:46.018 [2024-11-26 19:19:02.558803] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:32:46.018 19:19:02 -- common/autotest_common.sh@960 -- # wait 3303405 00:32:46.018 19:19:02 -- spdkcli/nvmf.sh@1 -- # cleanup 00:32:46.018 19:19:02 -- spdkcli/common.sh@10 -- # '[' -n '' ']' 00:32:46.018 19:19:02 -- spdkcli/common.sh@13 -- # '[' -n 3303405 ']' 00:32:46.018 19:19:02 -- spdkcli/common.sh@14 -- # killprocess 3303405 00:32:46.018 19:19:02 -- common/autotest_common.sh@936 -- # '[' -z 3303405 ']' 00:32:46.018 19:19:02 -- common/autotest_common.sh@940 -- # kill -0 3303405 00:32:46.018 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3303405) - No such process 00:32:46.018 19:19:02 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3303405 is not found' 00:32:46.018 Process with pid 3303405 is not found 00:32:46.018 19:19:02 -- spdkcli/common.sh@16 -- # '[' -n '' ']' 00:32:46.018 19:19:02 -- spdkcli/common.sh@19 -- # '[' -n '' ']' 00:32:46.018 19:19:02 -- spdkcli/common.sh@22 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_nvmf.test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_details_vhost.test /tmp/sample_aio 00:32:46.018 00:32:46.018 real 0m16.098s 00:32:46.018 user 0m33.568s 00:32:46.018 sys 0m0.691s 00:32:46.018 19:19:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:46.018 19:19:02 -- common/autotest_common.sh@10 -- # set +x 00:32:46.018 ************************************ 00:32:46.018 END TEST spdkcli_nvmf_tcp 00:32:46.018 ************************************ 00:32:46.018 19:19:02 -- spdk/autotest.sh@285 -- # run_test nvmf_identify_passthru /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:32:46.018 19:19:02 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:32:46.019 19:19:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:46.019 19:19:02 -- common/autotest_common.sh@10 -- # set +x 00:32:46.019 ************************************ 00:32:46.019 START TEST nvmf_identify_passthru 00:32:46.019 ************************************ 00:32:46.019 19:19:02 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:32:46.019 * Looking for test storage... 00:32:46.019 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:32:46.019 19:19:02 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:32:46.019 19:19:02 -- common/autotest_common.sh@1690 -- # lcov --version 00:32:46.019 19:19:02 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:32:46.019 19:19:02 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:32:46.019 19:19:02 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:32:46.019 19:19:02 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:32:46.019 19:19:02 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:32:46.019 19:19:02 -- scripts/common.sh@335 -- # IFS=.-: 00:32:46.019 19:19:02 -- scripts/common.sh@335 -- # read -ra ver1 00:32:46.019 19:19:02 -- scripts/common.sh@336 -- # IFS=.-: 00:32:46.019 19:19:02 -- scripts/common.sh@336 -- # read -ra ver2 00:32:46.019 19:19:02 -- scripts/common.sh@337 -- # local 'op=<' 00:32:46.019 19:19:02 -- scripts/common.sh@339 -- # ver1_l=2 00:32:46.019 19:19:02 -- scripts/common.sh@340 -- # ver2_l=1 00:32:46.019 19:19:02 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:32:46.019 19:19:02 -- scripts/common.sh@343 -- # case "$op" in 00:32:46.019 19:19:02 -- scripts/common.sh@344 -- # : 1 00:32:46.019 19:19:02 -- scripts/common.sh@363 -- # (( v = 0 )) 00:32:46.019 19:19:02 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:32:46.019 19:19:02 -- scripts/common.sh@364 -- # decimal 1 00:32:46.019 19:19:02 -- scripts/common.sh@352 -- # local d=1 00:32:46.019 19:19:02 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:32:46.019 19:19:02 -- scripts/common.sh@354 -- # echo 1 00:32:46.019 19:19:02 -- scripts/common.sh@364 -- # ver1[v]=1 00:32:46.019 19:19:02 -- scripts/common.sh@365 -- # decimal 2 00:32:46.019 19:19:02 -- scripts/common.sh@352 -- # local d=2 00:32:46.019 19:19:02 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:32:46.019 19:19:02 -- scripts/common.sh@354 -- # echo 2 00:32:46.019 19:19:02 -- scripts/common.sh@365 -- # ver2[v]=2 00:32:46.019 19:19:02 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:32:46.019 19:19:02 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:32:46.019 19:19:02 -- scripts/common.sh@367 -- # return 0 00:32:46.019 19:19:02 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:32:46.019 19:19:02 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:32:46.019 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:46.019 --rc genhtml_branch_coverage=1 00:32:46.019 --rc genhtml_function_coverage=1 00:32:46.019 --rc genhtml_legend=1 00:32:46.019 --rc geninfo_all_blocks=1 00:32:46.019 --rc geninfo_unexecuted_blocks=1 00:32:46.019 00:32:46.019 ' 00:32:46.019 19:19:02 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:32:46.019 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:46.019 --rc genhtml_branch_coverage=1 00:32:46.019 --rc genhtml_function_coverage=1 00:32:46.019 --rc genhtml_legend=1 00:32:46.019 --rc geninfo_all_blocks=1 00:32:46.019 --rc geninfo_unexecuted_blocks=1 00:32:46.019 00:32:46.019 ' 00:32:46.019 19:19:02 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:32:46.019 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:46.019 --rc genhtml_branch_coverage=1 00:32:46.019 --rc genhtml_function_coverage=1 00:32:46.019 --rc genhtml_legend=1 00:32:46.019 --rc geninfo_all_blocks=1 00:32:46.019 --rc geninfo_unexecuted_blocks=1 00:32:46.019 00:32:46.019 ' 00:32:46.019 19:19:02 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:32:46.019 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:46.019 --rc genhtml_branch_coverage=1 00:32:46.019 --rc genhtml_function_coverage=1 00:32:46.019 --rc genhtml_legend=1 00:32:46.019 --rc geninfo_all_blocks=1 00:32:46.019 --rc geninfo_unexecuted_blocks=1 00:32:46.019 00:32:46.019 ' 00:32:46.019 19:19:02 -- target/identify_passthru.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:32:46.019 19:19:02 -- nvmf/common.sh@7 -- # uname -s 00:32:46.279 19:19:02 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:32:46.279 19:19:02 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:32:46.279 19:19:02 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:32:46.279 19:19:02 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:32:46.279 19:19:02 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:32:46.279 19:19:02 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:32:46.279 19:19:02 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:32:46.279 19:19:02 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:32:46.279 19:19:02 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:32:46.279 19:19:02 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:32:46.279 19:19:02 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:32:46.279 19:19:02 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:32:46.279 19:19:02 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:32:46.279 19:19:02 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:32:46.279 19:19:02 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:32:46.279 19:19:02 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:32:46.279 19:19:02 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:32:46.279 19:19:02 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:32:46.279 19:19:02 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:32:46.279 19:19:02 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:46.279 19:19:02 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:46.279 19:19:02 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:46.279 19:19:02 -- paths/export.sh@5 -- # export PATH 00:32:46.279 19:19:02 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:46.279 19:19:02 -- nvmf/common.sh@46 -- # : 0 00:32:46.279 19:19:02 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:32:46.279 19:19:02 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:32:46.279 19:19:02 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:32:46.279 19:19:02 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:32:46.279 19:19:02 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:32:46.279 19:19:02 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:32:46.279 19:19:02 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:32:46.279 19:19:02 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:32:46.279 19:19:02 -- target/identify_passthru.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:32:46.279 19:19:02 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:32:46.279 19:19:02 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:32:46.279 19:19:02 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:32:46.279 19:19:02 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:46.279 19:19:02 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:46.279 19:19:02 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:46.279 19:19:02 -- paths/export.sh@5 -- # export PATH 00:32:46.279 19:19:02 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:46.279 19:19:02 -- target/identify_passthru.sh@12 -- # nvmftestinit 00:32:46.279 19:19:02 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:32:46.280 19:19:02 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:32:46.280 19:19:02 -- nvmf/common.sh@436 -- # prepare_net_devs 00:32:46.280 19:19:02 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:32:46.280 19:19:02 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:32:46.280 19:19:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:32:46.280 19:19:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:32:46.280 19:19:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:32:46.280 19:19:02 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:32:46.280 19:19:02 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:32:46.280 19:19:02 -- nvmf/common.sh@284 -- # xtrace_disable 00:32:46.280 19:19:02 -- common/autotest_common.sh@10 -- # set +x 00:32:51.639 19:19:08 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:32:51.639 19:19:08 -- nvmf/common.sh@290 -- # pci_devs=() 00:32:51.639 19:19:08 -- nvmf/common.sh@290 -- # local -a pci_devs 00:32:51.639 19:19:08 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:32:51.639 19:19:08 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:32:51.639 19:19:08 -- nvmf/common.sh@292 -- # pci_drivers=() 00:32:51.639 19:19:08 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:32:51.639 19:19:08 -- nvmf/common.sh@294 -- # net_devs=() 00:32:51.639 19:19:08 -- nvmf/common.sh@294 -- # local -ga net_devs 00:32:51.639 19:19:08 -- nvmf/common.sh@295 -- # e810=() 00:32:51.639 19:19:08 -- nvmf/common.sh@295 -- # local -ga e810 00:32:51.639 19:19:08 -- nvmf/common.sh@296 -- # x722=() 00:32:51.639 19:19:08 -- nvmf/common.sh@296 -- # local -ga x722 00:32:51.639 19:19:08 -- nvmf/common.sh@297 -- # mlx=() 00:32:51.639 19:19:08 -- nvmf/common.sh@297 -- # local -ga mlx 00:32:51.639 19:19:08 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:32:51.639 19:19:08 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:32:51.639 19:19:08 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:32:51.639 19:19:08 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:32:51.639 19:19:08 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:32:51.639 19:19:08 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:32:51.639 19:19:08 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:32:51.639 19:19:08 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:32:51.639 19:19:08 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:32:51.639 19:19:08 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:32:51.639 19:19:08 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:32:51.639 19:19:08 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:32:51.639 19:19:08 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:32:51.639 19:19:08 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:32:51.639 19:19:08 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:32:51.639 19:19:08 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:32:51.639 19:19:08 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:32:51.639 19:19:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:32:51.639 19:19:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:32:51.639 Found 0000:86:00.0 (0x8086 - 0x159b) 00:32:51.639 19:19:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:32:51.639 19:19:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:32:51.639 19:19:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:32:51.639 19:19:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:32:51.639 19:19:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:32:51.639 19:19:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:32:51.639 19:19:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:32:51.639 Found 0000:86:00.1 (0x8086 - 0x159b) 00:32:51.639 19:19:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:32:51.639 19:19:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:32:51.639 19:19:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:32:51.639 19:19:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:32:51.639 19:19:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:32:51.639 19:19:08 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:32:51.639 19:19:08 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:32:51.639 19:19:08 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:32:51.639 19:19:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:32:51.639 19:19:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:32:51.639 19:19:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:32:51.639 19:19:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:32:51.639 19:19:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:32:51.639 Found net devices under 0000:86:00.0: cvl_0_0 00:32:51.639 19:19:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:32:51.639 19:19:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:32:51.639 19:19:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:32:51.639 19:19:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:32:51.639 19:19:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:32:51.639 19:19:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:32:51.639 Found net devices under 0000:86:00.1: cvl_0_1 00:32:51.639 19:19:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:32:51.639 19:19:08 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:32:51.639 19:19:08 -- nvmf/common.sh@402 -- # is_hw=yes 00:32:51.639 19:19:08 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:32:51.639 19:19:08 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:32:51.639 19:19:08 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:32:51.639 19:19:08 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:32:51.639 19:19:08 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:32:51.639 19:19:08 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:32:51.639 19:19:08 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:32:51.639 19:19:08 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:32:51.639 19:19:08 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:32:51.639 19:19:08 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:32:51.639 19:19:08 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:32:51.639 19:19:08 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:32:51.639 19:19:08 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:32:51.639 19:19:08 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:32:51.639 19:19:08 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:32:51.639 19:19:08 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:32:51.639 19:19:08 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:32:51.639 19:19:08 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:32:51.639 19:19:08 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:32:51.639 19:19:08 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:32:51.639 19:19:08 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:32:51.639 19:19:08 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:32:51.639 19:19:08 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:32:51.639 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:32:51.639 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.365 ms 00:32:51.639 00:32:51.639 --- 10.0.0.2 ping statistics --- 00:32:51.639 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:32:51.639 rtt min/avg/max/mdev = 0.365/0.365/0.365/0.000 ms 00:32:51.639 19:19:08 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:32:51.639 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:32:51.639 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.068 ms 00:32:51.639 00:32:51.639 --- 10.0.0.1 ping statistics --- 00:32:51.639 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:32:51.639 rtt min/avg/max/mdev = 0.068/0.068/0.068/0.000 ms 00:32:51.639 19:19:08 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:32:51.639 19:19:08 -- nvmf/common.sh@410 -- # return 0 00:32:51.639 19:19:08 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:32:51.639 19:19:08 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:32:51.639 19:19:08 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:32:51.639 19:19:08 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:32:51.640 19:19:08 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:32:51.640 19:19:08 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:32:51.640 19:19:08 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:32:51.640 19:19:08 -- target/identify_passthru.sh@14 -- # timing_enter nvme_identify 00:32:51.640 19:19:08 -- common/autotest_common.sh@722 -- # xtrace_disable 00:32:51.640 19:19:08 -- common/autotest_common.sh@10 -- # set +x 00:32:51.640 19:19:08 -- target/identify_passthru.sh@16 -- # get_first_nvme_bdf 00:32:51.640 19:19:08 -- common/autotest_common.sh@1519 -- # bdfs=() 00:32:51.640 19:19:08 -- common/autotest_common.sh@1519 -- # local bdfs 00:32:51.640 19:19:08 -- common/autotest_common.sh@1520 -- # bdfs=($(get_nvme_bdfs)) 00:32:51.640 19:19:08 -- common/autotest_common.sh@1520 -- # get_nvme_bdfs 00:32:51.640 19:19:08 -- common/autotest_common.sh@1508 -- # bdfs=() 00:32:51.640 19:19:08 -- common/autotest_common.sh@1508 -- # local bdfs 00:32:51.640 19:19:08 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:32:51.640 19:19:08 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:32:51.640 19:19:08 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:32:51.898 19:19:08 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:32:51.898 19:19:08 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:5e:00.0 00:32:51.898 19:19:08 -- common/autotest_common.sh@1522 -- # echo 0000:5e:00.0 00:32:51.898 19:19:08 -- target/identify_passthru.sh@16 -- # bdf=0000:5e:00.0 00:32:51.898 19:19:08 -- target/identify_passthru.sh@17 -- # '[' -z 0000:5e:00.0 ']' 00:32:51.898 19:19:08 -- target/identify_passthru.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:5e:00.0' -i 0 00:32:51.898 19:19:08 -- target/identify_passthru.sh@23 -- # grep 'Serial Number:' 00:32:51.898 19:19:08 -- target/identify_passthru.sh@23 -- # awk '{print $3}' 00:32:51.898 EAL: No free 2048 kB hugepages reported on node 1 00:32:56.086 19:19:12 -- target/identify_passthru.sh@23 -- # nvme_serial_number=BTLJ72430F0E1P0FGN 00:32:56.086 19:19:12 -- target/identify_passthru.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:5e:00.0' -i 0 00:32:56.086 19:19:12 -- target/identify_passthru.sh@24 -- # grep 'Model Number:' 00:32:56.086 19:19:12 -- target/identify_passthru.sh@24 -- # awk '{print $3}' 00:32:56.086 EAL: No free 2048 kB hugepages reported on node 1 00:33:00.274 19:19:16 -- target/identify_passthru.sh@24 -- # nvme_model_number=INTEL 00:33:00.274 19:19:16 -- target/identify_passthru.sh@26 -- # timing_exit nvme_identify 00:33:00.274 19:19:16 -- common/autotest_common.sh@728 -- # xtrace_disable 00:33:00.274 19:19:16 -- common/autotest_common.sh@10 -- # set +x 00:33:00.274 19:19:16 -- target/identify_passthru.sh@28 -- # timing_enter start_nvmf_tgt 00:33:00.274 19:19:16 -- common/autotest_common.sh@722 -- # xtrace_disable 00:33:00.274 19:19:16 -- common/autotest_common.sh@10 -- # set +x 00:33:00.274 19:19:16 -- target/identify_passthru.sh@31 -- # nvmfpid=3310394 00:33:00.274 19:19:16 -- target/identify_passthru.sh@30 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:33:00.274 19:19:16 -- target/identify_passthru.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:33:00.274 19:19:16 -- target/identify_passthru.sh@35 -- # waitforlisten 3310394 00:33:00.274 19:19:16 -- common/autotest_common.sh@829 -- # '[' -z 3310394 ']' 00:33:00.274 19:19:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:33:00.274 19:19:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:33:00.274 19:19:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:33:00.274 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:33:00.274 19:19:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:33:00.274 19:19:16 -- common/autotest_common.sh@10 -- # set +x 00:33:00.274 [2024-11-26 19:19:16.917309] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:33:00.274 [2024-11-26 19:19:16.917355] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:33:00.274 EAL: No free 2048 kB hugepages reported on node 1 00:33:00.274 [2024-11-26 19:19:16.976243] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:33:00.274 [2024-11-26 19:19:17.016047] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:33:00.274 [2024-11-26 19:19:17.016163] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:33:00.274 [2024-11-26 19:19:17.016171] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:33:00.274 [2024-11-26 19:19:17.016181] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:33:00.274 [2024-11-26 19:19:17.018967] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:33:00.274 [2024-11-26 19:19:17.018986] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:33:00.274 [2024-11-26 19:19:17.019073] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:33:00.274 [2024-11-26 19:19:17.019074] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:33:00.274 19:19:17 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:33:00.274 19:19:17 -- common/autotest_common.sh@862 -- # return 0 00:33:00.274 19:19:17 -- target/identify_passthru.sh@36 -- # rpc_cmd -v nvmf_set_config --passthru-identify-ctrlr 00:33:00.274 19:19:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:00.274 19:19:17 -- common/autotest_common.sh@10 -- # set +x 00:33:00.274 INFO: Log level set to 20 00:33:00.274 INFO: Requests: 00:33:00.274 { 00:33:00.274 "jsonrpc": "2.0", 00:33:00.274 "method": "nvmf_set_config", 00:33:00.274 "id": 1, 00:33:00.274 "params": { 00:33:00.274 "admin_cmd_passthru": { 00:33:00.274 "identify_ctrlr": true 00:33:00.274 } 00:33:00.274 } 00:33:00.274 } 00:33:00.274 00:33:00.274 INFO: response: 00:33:00.274 { 00:33:00.274 "jsonrpc": "2.0", 00:33:00.274 "id": 1, 00:33:00.274 "result": true 00:33:00.274 } 00:33:00.274 00:33:00.274 19:19:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:00.274 19:19:17 -- target/identify_passthru.sh@37 -- # rpc_cmd -v framework_start_init 00:33:00.274 19:19:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:00.274 19:19:17 -- common/autotest_common.sh@10 -- # set +x 00:33:00.274 INFO: Setting log level to 20 00:33:00.274 INFO: Setting log level to 20 00:33:00.274 INFO: Log level set to 20 00:33:00.274 INFO: Log level set to 20 00:33:00.274 INFO: Requests: 00:33:00.274 { 00:33:00.274 "jsonrpc": "2.0", 00:33:00.274 "method": "framework_start_init", 00:33:00.274 "id": 1 00:33:00.274 } 00:33:00.274 00:33:00.274 INFO: Requests: 00:33:00.274 { 00:33:00.274 "jsonrpc": "2.0", 00:33:00.274 "method": "framework_start_init", 00:33:00.274 "id": 1 00:33:00.274 } 00:33:00.274 00:33:00.274 [2024-11-26 19:19:17.180864] nvmf_tgt.c: 423:nvmf_tgt_advance_state: *NOTICE*: Custom identify ctrlr handler enabled 00:33:00.274 INFO: response: 00:33:00.274 { 00:33:00.274 "jsonrpc": "2.0", 00:33:00.274 "id": 1, 00:33:00.274 "result": true 00:33:00.274 } 00:33:00.274 00:33:00.274 INFO: response: 00:33:00.274 { 00:33:00.274 "jsonrpc": "2.0", 00:33:00.274 "id": 1, 00:33:00.274 "result": true 00:33:00.274 } 00:33:00.274 00:33:00.274 19:19:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:00.274 19:19:17 -- target/identify_passthru.sh@38 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:33:00.274 19:19:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:00.274 19:19:17 -- common/autotest_common.sh@10 -- # set +x 00:33:00.274 INFO: Setting log level to 40 00:33:00.274 INFO: Setting log level to 40 00:33:00.274 INFO: Setting log level to 40 00:33:00.274 [2024-11-26 19:19:17.194314] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:33:00.533 19:19:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:00.533 19:19:17 -- target/identify_passthru.sh@39 -- # timing_exit start_nvmf_tgt 00:33:00.533 19:19:17 -- common/autotest_common.sh@728 -- # xtrace_disable 00:33:00.533 19:19:17 -- common/autotest_common.sh@10 -- # set +x 00:33:00.533 19:19:17 -- target/identify_passthru.sh@41 -- # rpc_cmd bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:5e:00.0 00:33:00.533 19:19:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:00.533 19:19:17 -- common/autotest_common.sh@10 -- # set +x 00:33:03.823 Nvme0n1 00:33:03.823 19:19:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:03.823 19:19:20 -- target/identify_passthru.sh@42 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 1 00:33:03.823 19:19:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:03.823 19:19:20 -- common/autotest_common.sh@10 -- # set +x 00:33:03.823 19:19:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:03.823 19:19:20 -- target/identify_passthru.sh@43 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:33:03.823 19:19:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:03.823 19:19:20 -- common/autotest_common.sh@10 -- # set +x 00:33:03.823 19:19:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:03.823 19:19:20 -- target/identify_passthru.sh@44 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:33:03.823 19:19:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:03.823 19:19:20 -- common/autotest_common.sh@10 -- # set +x 00:33:03.823 [2024-11-26 19:19:20.084519] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:33:03.823 19:19:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:03.823 19:19:20 -- target/identify_passthru.sh@46 -- # rpc_cmd nvmf_get_subsystems 00:33:03.823 19:19:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:03.823 19:19:20 -- common/autotest_common.sh@10 -- # set +x 00:33:03.823 [2024-11-26 19:19:20.092305] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:33:03.823 [ 00:33:03.823 { 00:33:03.823 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:33:03.823 "subtype": "Discovery", 00:33:03.823 "listen_addresses": [], 00:33:03.823 "allow_any_host": true, 00:33:03.823 "hosts": [] 00:33:03.823 }, 00:33:03.823 { 00:33:03.823 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:33:03.823 "subtype": "NVMe", 00:33:03.823 "listen_addresses": [ 00:33:03.823 { 00:33:03.823 "transport": "TCP", 00:33:03.823 "trtype": "TCP", 00:33:03.823 "adrfam": "IPv4", 00:33:03.823 "traddr": "10.0.0.2", 00:33:03.823 "trsvcid": "4420" 00:33:03.823 } 00:33:03.823 ], 00:33:03.823 "allow_any_host": true, 00:33:03.823 "hosts": [], 00:33:03.823 "serial_number": "SPDK00000000000001", 00:33:03.823 "model_number": "SPDK bdev Controller", 00:33:03.823 "max_namespaces": 1, 00:33:03.823 "min_cntlid": 1, 00:33:03.823 "max_cntlid": 65519, 00:33:03.823 "namespaces": [ 00:33:03.823 { 00:33:03.823 "nsid": 1, 00:33:03.823 "bdev_name": "Nvme0n1", 00:33:03.823 "name": "Nvme0n1", 00:33:03.823 "nguid": "FE35B6182D594C1783269213C7B02C1A", 00:33:03.823 "uuid": "fe35b618-2d59-4c17-8326-9213c7b02c1a" 00:33:03.823 } 00:33:03.823 ] 00:33:03.823 } 00:33:03.823 ] 00:33:03.823 19:19:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:03.823 19:19:20 -- target/identify_passthru.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:33:03.823 19:19:20 -- target/identify_passthru.sh@54 -- # grep 'Serial Number:' 00:33:03.823 19:19:20 -- target/identify_passthru.sh@54 -- # awk '{print $3}' 00:33:03.823 EAL: No free 2048 kB hugepages reported on node 1 00:33:03.823 19:19:20 -- target/identify_passthru.sh@54 -- # nvmf_serial_number=BTLJ72430F0E1P0FGN 00:33:03.823 19:19:20 -- target/identify_passthru.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:33:03.823 19:19:20 -- target/identify_passthru.sh@61 -- # grep 'Model Number:' 00:33:03.823 19:19:20 -- target/identify_passthru.sh@61 -- # awk '{print $3}' 00:33:03.823 EAL: No free 2048 kB hugepages reported on node 1 00:33:03.823 19:19:20 -- target/identify_passthru.sh@61 -- # nvmf_model_number=INTEL 00:33:03.823 19:19:20 -- target/identify_passthru.sh@63 -- # '[' BTLJ72430F0E1P0FGN '!=' BTLJ72430F0E1P0FGN ']' 00:33:03.824 19:19:20 -- target/identify_passthru.sh@68 -- # '[' INTEL '!=' INTEL ']' 00:33:03.824 19:19:20 -- target/identify_passthru.sh@73 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:33:03.824 19:19:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:03.824 19:19:20 -- common/autotest_common.sh@10 -- # set +x 00:33:03.824 19:19:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:03.824 19:19:20 -- target/identify_passthru.sh@75 -- # trap - SIGINT SIGTERM EXIT 00:33:03.824 19:19:20 -- target/identify_passthru.sh@77 -- # nvmftestfini 00:33:03.824 19:19:20 -- nvmf/common.sh@476 -- # nvmfcleanup 00:33:03.824 19:19:20 -- nvmf/common.sh@116 -- # sync 00:33:03.824 19:19:20 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:33:03.824 19:19:20 -- nvmf/common.sh@119 -- # set +e 00:33:03.824 19:19:20 -- nvmf/common.sh@120 -- # for i in {1..20} 00:33:03.824 19:19:20 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:33:03.824 rmmod nvme_tcp 00:33:03.824 rmmod nvme_fabrics 00:33:03.824 rmmod nvme_keyring 00:33:03.824 19:19:20 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:33:03.824 19:19:20 -- nvmf/common.sh@123 -- # set -e 00:33:03.824 19:19:20 -- nvmf/common.sh@124 -- # return 0 00:33:03.824 19:19:20 -- nvmf/common.sh@477 -- # '[' -n 3310394 ']' 00:33:03.824 19:19:20 -- nvmf/common.sh@478 -- # killprocess 3310394 00:33:03.824 19:19:20 -- common/autotest_common.sh@936 -- # '[' -z 3310394 ']' 00:33:03.824 19:19:20 -- common/autotest_common.sh@940 -- # kill -0 3310394 00:33:03.824 19:19:20 -- common/autotest_common.sh@941 -- # uname 00:33:03.824 19:19:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:33:03.824 19:19:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3310394 00:33:03.824 19:19:20 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:33:03.824 19:19:20 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:33:03.824 19:19:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3310394' 00:33:03.824 killing process with pid 3310394 00:33:03.824 19:19:20 -- common/autotest_common.sh@955 -- # kill 3310394 00:33:03.824 [2024-11-26 19:19:20.500881] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:33:03.824 19:19:20 -- common/autotest_common.sh@960 -- # wait 3310394 00:33:05.199 19:19:21 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:33:05.199 19:19:21 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:33:05.199 19:19:21 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:33:05.199 19:19:21 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:33:05.199 19:19:21 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:33:05.199 19:19:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:33:05.199 19:19:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:33:05.199 19:19:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:33:07.103 19:19:24 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:33:07.103 00:33:07.103 real 0m21.251s 00:33:07.103 user 0m27.086s 00:33:07.103 sys 0m4.914s 00:33:07.103 19:19:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:33:07.103 19:19:24 -- common/autotest_common.sh@10 -- # set +x 00:33:07.103 ************************************ 00:33:07.103 END TEST nvmf_identify_passthru 00:33:07.103 ************************************ 00:33:07.361 19:19:24 -- spdk/autotest.sh@287 -- # run_test nvmf_dif /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:33:07.361 19:19:24 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:33:07.361 19:19:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:33:07.361 19:19:24 -- common/autotest_common.sh@10 -- # set +x 00:33:07.361 ************************************ 00:33:07.361 START TEST nvmf_dif 00:33:07.361 ************************************ 00:33:07.361 19:19:24 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:33:07.361 * Looking for test storage... 00:33:07.361 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:33:07.361 19:19:24 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:33:07.361 19:19:24 -- common/autotest_common.sh@1690 -- # lcov --version 00:33:07.361 19:19:24 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:33:07.361 19:19:24 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:33:07.362 19:19:24 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:33:07.362 19:19:24 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:33:07.362 19:19:24 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:33:07.362 19:19:24 -- scripts/common.sh@335 -- # IFS=.-: 00:33:07.362 19:19:24 -- scripts/common.sh@335 -- # read -ra ver1 00:33:07.362 19:19:24 -- scripts/common.sh@336 -- # IFS=.-: 00:33:07.362 19:19:24 -- scripts/common.sh@336 -- # read -ra ver2 00:33:07.362 19:19:24 -- scripts/common.sh@337 -- # local 'op=<' 00:33:07.362 19:19:24 -- scripts/common.sh@339 -- # ver1_l=2 00:33:07.362 19:19:24 -- scripts/common.sh@340 -- # ver2_l=1 00:33:07.362 19:19:24 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:33:07.362 19:19:24 -- scripts/common.sh@343 -- # case "$op" in 00:33:07.362 19:19:24 -- scripts/common.sh@344 -- # : 1 00:33:07.362 19:19:24 -- scripts/common.sh@363 -- # (( v = 0 )) 00:33:07.362 19:19:24 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:33:07.362 19:19:24 -- scripts/common.sh@364 -- # decimal 1 00:33:07.362 19:19:24 -- scripts/common.sh@352 -- # local d=1 00:33:07.362 19:19:24 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:33:07.362 19:19:24 -- scripts/common.sh@354 -- # echo 1 00:33:07.362 19:19:24 -- scripts/common.sh@364 -- # ver1[v]=1 00:33:07.362 19:19:24 -- scripts/common.sh@365 -- # decimal 2 00:33:07.362 19:19:24 -- scripts/common.sh@352 -- # local d=2 00:33:07.362 19:19:24 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:33:07.362 19:19:24 -- scripts/common.sh@354 -- # echo 2 00:33:07.362 19:19:24 -- scripts/common.sh@365 -- # ver2[v]=2 00:33:07.362 19:19:24 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:33:07.362 19:19:24 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:33:07.362 19:19:24 -- scripts/common.sh@367 -- # return 0 00:33:07.362 19:19:24 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:33:07.362 19:19:24 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:33:07.362 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:33:07.362 --rc genhtml_branch_coverage=1 00:33:07.362 --rc genhtml_function_coverage=1 00:33:07.362 --rc genhtml_legend=1 00:33:07.362 --rc geninfo_all_blocks=1 00:33:07.362 --rc geninfo_unexecuted_blocks=1 00:33:07.362 00:33:07.362 ' 00:33:07.362 19:19:24 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:33:07.362 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:33:07.362 --rc genhtml_branch_coverage=1 00:33:07.362 --rc genhtml_function_coverage=1 00:33:07.362 --rc genhtml_legend=1 00:33:07.362 --rc geninfo_all_blocks=1 00:33:07.362 --rc geninfo_unexecuted_blocks=1 00:33:07.362 00:33:07.362 ' 00:33:07.362 19:19:24 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:33:07.362 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:33:07.362 --rc genhtml_branch_coverage=1 00:33:07.362 --rc genhtml_function_coverage=1 00:33:07.362 --rc genhtml_legend=1 00:33:07.362 --rc geninfo_all_blocks=1 00:33:07.362 --rc geninfo_unexecuted_blocks=1 00:33:07.362 00:33:07.362 ' 00:33:07.362 19:19:24 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:33:07.362 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:33:07.362 --rc genhtml_branch_coverage=1 00:33:07.362 --rc genhtml_function_coverage=1 00:33:07.362 --rc genhtml_legend=1 00:33:07.362 --rc geninfo_all_blocks=1 00:33:07.362 --rc geninfo_unexecuted_blocks=1 00:33:07.362 00:33:07.362 ' 00:33:07.362 19:19:24 -- target/dif.sh@13 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:33:07.362 19:19:24 -- nvmf/common.sh@7 -- # uname -s 00:33:07.362 19:19:24 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:33:07.362 19:19:24 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:33:07.362 19:19:24 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:33:07.362 19:19:24 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:33:07.362 19:19:24 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:33:07.362 19:19:24 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:33:07.362 19:19:24 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:33:07.362 19:19:24 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:33:07.362 19:19:24 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:33:07.362 19:19:24 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:33:07.362 19:19:24 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:33:07.362 19:19:24 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:33:07.362 19:19:24 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:33:07.362 19:19:24 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:33:07.362 19:19:24 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:33:07.362 19:19:24 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:33:07.362 19:19:24 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:33:07.362 19:19:24 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:33:07.362 19:19:24 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:33:07.362 19:19:24 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:33:07.362 19:19:24 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:33:07.362 19:19:24 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:33:07.362 19:19:24 -- paths/export.sh@5 -- # export PATH 00:33:07.362 19:19:24 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:33:07.362 19:19:24 -- nvmf/common.sh@46 -- # : 0 00:33:07.362 19:19:24 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:33:07.362 19:19:24 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:33:07.362 19:19:24 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:33:07.362 19:19:24 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:33:07.362 19:19:24 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:33:07.362 19:19:24 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:33:07.362 19:19:24 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:33:07.362 19:19:24 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:33:07.362 19:19:24 -- target/dif.sh@15 -- # NULL_META=16 00:33:07.362 19:19:24 -- target/dif.sh@15 -- # NULL_BLOCK_SIZE=512 00:33:07.362 19:19:24 -- target/dif.sh@15 -- # NULL_SIZE=64 00:33:07.362 19:19:24 -- target/dif.sh@15 -- # NULL_DIF=1 00:33:07.362 19:19:24 -- target/dif.sh@135 -- # nvmftestinit 00:33:07.362 19:19:24 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:33:07.362 19:19:24 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:33:07.362 19:19:24 -- nvmf/common.sh@436 -- # prepare_net_devs 00:33:07.362 19:19:24 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:33:07.362 19:19:24 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:33:07.362 19:19:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:33:07.362 19:19:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:33:07.362 19:19:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:33:07.362 19:19:24 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:33:07.362 19:19:24 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:33:07.362 19:19:24 -- nvmf/common.sh@284 -- # xtrace_disable 00:33:07.362 19:19:24 -- common/autotest_common.sh@10 -- # set +x 00:33:12.631 19:19:29 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:33:12.631 19:19:29 -- nvmf/common.sh@290 -- # pci_devs=() 00:33:12.631 19:19:29 -- nvmf/common.sh@290 -- # local -a pci_devs 00:33:12.631 19:19:29 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:33:12.631 19:19:29 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:33:12.631 19:19:29 -- nvmf/common.sh@292 -- # pci_drivers=() 00:33:12.631 19:19:29 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:33:12.631 19:19:29 -- nvmf/common.sh@294 -- # net_devs=() 00:33:12.631 19:19:29 -- nvmf/common.sh@294 -- # local -ga net_devs 00:33:12.631 19:19:29 -- nvmf/common.sh@295 -- # e810=() 00:33:12.631 19:19:29 -- nvmf/common.sh@295 -- # local -ga e810 00:33:12.631 19:19:29 -- nvmf/common.sh@296 -- # x722=() 00:33:12.631 19:19:29 -- nvmf/common.sh@296 -- # local -ga x722 00:33:12.631 19:19:29 -- nvmf/common.sh@297 -- # mlx=() 00:33:12.631 19:19:29 -- nvmf/common.sh@297 -- # local -ga mlx 00:33:12.631 19:19:29 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:33:12.631 19:19:29 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:33:12.631 19:19:29 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:33:12.631 19:19:29 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:33:12.631 19:19:29 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:33:12.631 19:19:29 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:33:12.631 19:19:29 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:33:12.631 19:19:29 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:33:12.631 19:19:29 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:33:12.631 19:19:29 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:33:12.631 19:19:29 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:33:12.631 19:19:29 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:33:12.631 19:19:29 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:33:12.631 19:19:29 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:33:12.631 19:19:29 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:33:12.631 19:19:29 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:33:12.631 19:19:29 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:33:12.631 19:19:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:33:12.631 19:19:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:33:12.631 Found 0000:86:00.0 (0x8086 - 0x159b) 00:33:12.631 19:19:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:33:12.631 19:19:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:33:12.631 19:19:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:33:12.631 19:19:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:33:12.631 19:19:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:33:12.631 19:19:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:33:12.631 19:19:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:33:12.631 Found 0000:86:00.1 (0x8086 - 0x159b) 00:33:12.631 19:19:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:33:12.631 19:19:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:33:12.631 19:19:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:33:12.631 19:19:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:33:12.631 19:19:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:33:12.631 19:19:29 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:33:12.631 19:19:29 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:33:12.631 19:19:29 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:33:12.631 19:19:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:33:12.631 19:19:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:33:12.631 19:19:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:33:12.631 19:19:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:33:12.631 19:19:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:33:12.631 Found net devices under 0000:86:00.0: cvl_0_0 00:33:12.631 19:19:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:33:12.631 19:19:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:33:12.631 19:19:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:33:12.631 19:19:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:33:12.631 19:19:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:33:12.631 19:19:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:33:12.631 Found net devices under 0000:86:00.1: cvl_0_1 00:33:12.631 19:19:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:33:12.631 19:19:29 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:33:12.631 19:19:29 -- nvmf/common.sh@402 -- # is_hw=yes 00:33:12.631 19:19:29 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:33:12.631 19:19:29 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:33:12.631 19:19:29 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:33:12.631 19:19:29 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:33:12.631 19:19:29 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:33:12.631 19:19:29 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:33:12.631 19:19:29 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:33:12.631 19:19:29 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:33:12.631 19:19:29 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:33:12.631 19:19:29 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:33:12.631 19:19:29 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:33:12.631 19:19:29 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:33:12.631 19:19:29 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:33:12.631 19:19:29 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:33:12.631 19:19:29 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:33:12.631 19:19:29 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:33:12.631 19:19:29 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:33:12.631 19:19:29 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:33:12.631 19:19:29 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:33:12.631 19:19:29 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:33:12.631 19:19:29 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:33:12.631 19:19:29 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:33:12.631 19:19:29 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:33:12.631 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:33:12.631 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.426 ms 00:33:12.631 00:33:12.631 --- 10.0.0.2 ping statistics --- 00:33:12.631 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:33:12.631 rtt min/avg/max/mdev = 0.426/0.426/0.426/0.000 ms 00:33:12.631 19:19:29 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:33:12.631 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:33:12.632 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.204 ms 00:33:12.632 00:33:12.632 --- 10.0.0.1 ping statistics --- 00:33:12.632 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:33:12.632 rtt min/avg/max/mdev = 0.204/0.204/0.204/0.000 ms 00:33:12.632 19:19:29 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:33:12.632 19:19:29 -- nvmf/common.sh@410 -- # return 0 00:33:12.632 19:19:29 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:33:12.632 19:19:29 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:33:15.163 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:33:15.163 0000:5e:00.0 (8086 0a54): Already using the vfio-pci driver 00:33:15.163 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:33:15.163 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:33:15.163 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:33:15.163 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:33:15.163 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:33:15.163 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:33:15.163 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:33:15.163 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:33:15.163 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:33:15.163 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:33:15.163 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:33:15.163 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:33:15.163 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:33:15.163 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:33:15.163 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:33:15.422 19:19:32 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:33:15.422 19:19:32 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:33:15.422 19:19:32 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:33:15.422 19:19:32 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:33:15.422 19:19:32 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:33:15.422 19:19:32 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:33:15.422 19:19:32 -- target/dif.sh@136 -- # NVMF_TRANSPORT_OPTS+=' --dif-insert-or-strip' 00:33:15.422 19:19:32 -- target/dif.sh@137 -- # nvmfappstart 00:33:15.422 19:19:32 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:33:15.422 19:19:32 -- common/autotest_common.sh@722 -- # xtrace_disable 00:33:15.422 19:19:32 -- common/autotest_common.sh@10 -- # set +x 00:33:15.422 19:19:32 -- nvmf/common.sh@469 -- # nvmfpid=3315910 00:33:15.422 19:19:32 -- nvmf/common.sh@470 -- # waitforlisten 3315910 00:33:15.422 19:19:32 -- common/autotest_common.sh@829 -- # '[' -z 3315910 ']' 00:33:15.422 19:19:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:33:15.422 19:19:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:33:15.422 19:19:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:33:15.422 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:33:15.422 19:19:32 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF 00:33:15.422 19:19:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:33:15.422 19:19:32 -- common/autotest_common.sh@10 -- # set +x 00:33:15.422 [2024-11-26 19:19:32.266539] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:33:15.422 [2024-11-26 19:19:32.266581] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:33:15.422 EAL: No free 2048 kB hugepages reported on node 1 00:33:15.422 [2024-11-26 19:19:32.323879] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:33:15.681 [2024-11-26 19:19:32.362942] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:33:15.681 [2024-11-26 19:19:32.363060] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:33:15.681 [2024-11-26 19:19:32.363068] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:33:15.681 [2024-11-26 19:19:32.363074] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:33:15.681 [2024-11-26 19:19:32.363091] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:33:16.248 19:19:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:33:16.248 19:19:33 -- common/autotest_common.sh@862 -- # return 0 00:33:16.248 19:19:33 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:33:16.248 19:19:33 -- common/autotest_common.sh@728 -- # xtrace_disable 00:33:16.248 19:19:33 -- common/autotest_common.sh@10 -- # set +x 00:33:16.248 19:19:33 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:33:16.248 19:19:33 -- target/dif.sh@139 -- # create_transport 00:33:16.248 19:19:33 -- target/dif.sh@50 -- # rpc_cmd nvmf_create_transport -t tcp -o --dif-insert-or-strip 00:33:16.248 19:19:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:16.248 19:19:33 -- common/autotest_common.sh@10 -- # set +x 00:33:16.248 [2024-11-26 19:19:33.109400] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:33:16.248 19:19:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:16.248 19:19:33 -- target/dif.sh@141 -- # run_test fio_dif_1_default fio_dif_1 00:33:16.248 19:19:33 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:33:16.248 19:19:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:33:16.248 19:19:33 -- common/autotest_common.sh@10 -- # set +x 00:33:16.248 ************************************ 00:33:16.248 START TEST fio_dif_1_default 00:33:16.248 ************************************ 00:33:16.248 19:19:33 -- common/autotest_common.sh@1114 -- # fio_dif_1 00:33:16.248 19:19:33 -- target/dif.sh@86 -- # create_subsystems 0 00:33:16.248 19:19:33 -- target/dif.sh@28 -- # local sub 00:33:16.248 19:19:33 -- target/dif.sh@30 -- # for sub in "$@" 00:33:16.248 19:19:33 -- target/dif.sh@31 -- # create_subsystem 0 00:33:16.248 19:19:33 -- target/dif.sh@18 -- # local sub_id=0 00:33:16.248 19:19:33 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:33:16.248 19:19:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:16.248 19:19:33 -- common/autotest_common.sh@10 -- # set +x 00:33:16.248 bdev_null0 00:33:16.248 19:19:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:16.248 19:19:33 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:33:16.248 19:19:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:16.248 19:19:33 -- common/autotest_common.sh@10 -- # set +x 00:33:16.248 19:19:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:16.248 19:19:33 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:33:16.248 19:19:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:16.248 19:19:33 -- common/autotest_common.sh@10 -- # set +x 00:33:16.248 19:19:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:16.248 19:19:33 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:33:16.248 19:19:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:16.248 19:19:33 -- common/autotest_common.sh@10 -- # set +x 00:33:16.248 [2024-11-26 19:19:33.149642] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:33:16.248 19:19:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:16.248 19:19:33 -- target/dif.sh@87 -- # fio /dev/fd/62 00:33:16.248 19:19:33 -- target/dif.sh@87 -- # create_json_sub_conf 0 00:33:16.248 19:19:33 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:33:16.248 19:19:33 -- nvmf/common.sh@520 -- # config=() 00:33:16.248 19:19:33 -- nvmf/common.sh@520 -- # local subsystem config 00:33:16.248 19:19:33 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:33:16.248 19:19:33 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:33:16.248 19:19:33 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:33:16.248 19:19:33 -- target/dif.sh@82 -- # gen_fio_conf 00:33:16.248 19:19:33 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:33:16.248 { 00:33:16.248 "params": { 00:33:16.248 "name": "Nvme$subsystem", 00:33:16.248 "trtype": "$TEST_TRANSPORT", 00:33:16.248 "traddr": "$NVMF_FIRST_TARGET_IP", 00:33:16.248 "adrfam": "ipv4", 00:33:16.248 "trsvcid": "$NVMF_PORT", 00:33:16.248 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:33:16.248 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:33:16.248 "hdgst": ${hdgst:-false}, 00:33:16.248 "ddgst": ${ddgst:-false} 00:33:16.248 }, 00:33:16.248 "method": "bdev_nvme_attach_controller" 00:33:16.248 } 00:33:16.248 EOF 00:33:16.248 )") 00:33:16.248 19:19:33 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:33:16.248 19:19:33 -- target/dif.sh@54 -- # local file 00:33:16.248 19:19:33 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:33:16.248 19:19:33 -- target/dif.sh@56 -- # cat 00:33:16.248 19:19:33 -- common/autotest_common.sh@1328 -- # local sanitizers 00:33:16.248 19:19:33 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:33:16.248 19:19:33 -- common/autotest_common.sh@1330 -- # shift 00:33:16.248 19:19:33 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:33:16.248 19:19:33 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:33:16.248 19:19:33 -- nvmf/common.sh@542 -- # cat 00:33:16.248 19:19:33 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:33:16.248 19:19:33 -- target/dif.sh@72 -- # (( file = 1 )) 00:33:16.248 19:19:33 -- target/dif.sh@72 -- # (( file <= files )) 00:33:16.248 19:19:33 -- common/autotest_common.sh@1334 -- # grep libasan 00:33:16.248 19:19:33 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:33:16.248 19:19:33 -- nvmf/common.sh@544 -- # jq . 00:33:16.248 19:19:33 -- nvmf/common.sh@545 -- # IFS=, 00:33:16.248 19:19:33 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:33:16.248 "params": { 00:33:16.248 "name": "Nvme0", 00:33:16.248 "trtype": "tcp", 00:33:16.248 "traddr": "10.0.0.2", 00:33:16.248 "adrfam": "ipv4", 00:33:16.248 "trsvcid": "4420", 00:33:16.248 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:33:16.248 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:33:16.248 "hdgst": false, 00:33:16.248 "ddgst": false 00:33:16.248 }, 00:33:16.248 "method": "bdev_nvme_attach_controller" 00:33:16.248 }' 00:33:16.525 19:19:33 -- common/autotest_common.sh@1334 -- # asan_lib= 00:33:16.525 19:19:33 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:33:16.525 19:19:33 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:33:16.525 19:19:33 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:33:16.525 19:19:33 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:33:16.525 19:19:33 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:33:16.525 19:19:33 -- common/autotest_common.sh@1334 -- # asan_lib= 00:33:16.525 19:19:33 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:33:16.525 19:19:33 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:33:16.525 19:19:33 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:33:16.784 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:33:16.784 fio-3.35 00:33:16.784 Starting 1 thread 00:33:16.784 EAL: No free 2048 kB hugepages reported on node 1 00:33:17.040 [2024-11-26 19:19:33.950139] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:33:17.040 [2024-11-26 19:19:33.950183] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:33:29.223 00:33:29.223 filename0: (groupid=0, jobs=1): err= 0: pid=3316288: Tue Nov 26 19:19:44 2024 00:33:29.223 read: IOPS=97, BW=390KiB/s (399kB/s)(3904KiB/10017msec) 00:33:29.223 slat (nsec): min=4253, max=42395, avg=6245.74, stdev=1469.90 00:33:29.223 clat (usec): min=40821, max=46104, avg=41031.92, stdev=366.10 00:33:29.223 lat (usec): min=40827, max=46122, avg=41038.16, stdev=366.18 00:33:29.223 clat percentiles (usec): 00:33:29.223 | 1.00th=[40633], 5.00th=[40633], 10.00th=[41157], 20.00th=[41157], 00:33:29.223 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:33:29.223 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:33:29.223 | 99.00th=[42206], 99.50th=[42206], 99.90th=[45876], 99.95th=[45876], 00:33:29.223 | 99.99th=[45876] 00:33:29.223 bw ( KiB/s): min= 384, max= 416, per=99.55%, avg=388.80, stdev=11.72, samples=20 00:33:29.223 iops : min= 96, max= 104, avg=97.20, stdev= 2.93, samples=20 00:33:29.223 lat (msec) : 50=100.00% 00:33:29.223 cpu : usr=93.20%, sys=6.54%, ctx=13, majf=0, minf=288 00:33:29.223 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:33:29.223 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:29.223 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:29.223 issued rwts: total=976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:33:29.223 latency : target=0, window=0, percentile=100.00%, depth=4 00:33:29.223 00:33:29.224 Run status group 0 (all jobs): 00:33:29.224 READ: bw=390KiB/s (399kB/s), 390KiB/s-390KiB/s (399kB/s-399kB/s), io=3904KiB (3998kB), run=10017-10017msec 00:33:29.224 19:19:44 -- target/dif.sh@88 -- # destroy_subsystems 0 00:33:29.224 19:19:44 -- target/dif.sh@43 -- # local sub 00:33:29.224 19:19:44 -- target/dif.sh@45 -- # for sub in "$@" 00:33:29.224 19:19:44 -- target/dif.sh@46 -- # destroy_subsystem 0 00:33:29.224 19:19:44 -- target/dif.sh@36 -- # local sub_id=0 00:33:29.224 19:19:44 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:33:29.224 19:19:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:29.224 19:19:44 -- common/autotest_common.sh@10 -- # set +x 00:33:29.224 19:19:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:29.224 19:19:44 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:33:29.224 19:19:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:29.224 19:19:44 -- common/autotest_common.sh@10 -- # set +x 00:33:29.224 19:19:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:29.224 00:33:29.224 real 0m11.134s 00:33:29.224 user 0m15.594s 00:33:29.224 sys 0m0.978s 00:33:29.224 19:19:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:33:29.224 19:19:44 -- common/autotest_common.sh@10 -- # set +x 00:33:29.224 ************************************ 00:33:29.224 END TEST fio_dif_1_default 00:33:29.224 ************************************ 00:33:29.224 19:19:44 -- target/dif.sh@142 -- # run_test fio_dif_1_multi_subsystems fio_dif_1_multi_subsystems 00:33:29.224 19:19:44 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:33:29.224 19:19:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:33:29.224 19:19:44 -- common/autotest_common.sh@10 -- # set +x 00:33:29.224 ************************************ 00:33:29.224 START TEST fio_dif_1_multi_subsystems 00:33:29.224 ************************************ 00:33:29.224 19:19:44 -- common/autotest_common.sh@1114 -- # fio_dif_1_multi_subsystems 00:33:29.224 19:19:44 -- target/dif.sh@92 -- # local files=1 00:33:29.224 19:19:44 -- target/dif.sh@94 -- # create_subsystems 0 1 00:33:29.224 19:19:44 -- target/dif.sh@28 -- # local sub 00:33:29.224 19:19:44 -- target/dif.sh@30 -- # for sub in "$@" 00:33:29.224 19:19:44 -- target/dif.sh@31 -- # create_subsystem 0 00:33:29.224 19:19:44 -- target/dif.sh@18 -- # local sub_id=0 00:33:29.224 19:19:44 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:33:29.224 19:19:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:29.224 19:19:44 -- common/autotest_common.sh@10 -- # set +x 00:33:29.224 bdev_null0 00:33:29.224 19:19:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:29.224 19:19:44 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:33:29.224 19:19:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:29.224 19:19:44 -- common/autotest_common.sh@10 -- # set +x 00:33:29.224 19:19:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:29.224 19:19:44 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:33:29.224 19:19:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:29.224 19:19:44 -- common/autotest_common.sh@10 -- # set +x 00:33:29.224 19:19:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:29.224 19:19:44 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:33:29.224 19:19:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:29.224 19:19:44 -- common/autotest_common.sh@10 -- # set +x 00:33:29.224 [2024-11-26 19:19:44.324665] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:33:29.224 19:19:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:29.224 19:19:44 -- target/dif.sh@30 -- # for sub in "$@" 00:33:29.224 19:19:44 -- target/dif.sh@31 -- # create_subsystem 1 00:33:29.224 19:19:44 -- target/dif.sh@18 -- # local sub_id=1 00:33:29.224 19:19:44 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:33:29.224 19:19:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:29.224 19:19:44 -- common/autotest_common.sh@10 -- # set +x 00:33:29.224 bdev_null1 00:33:29.224 19:19:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:29.224 19:19:44 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:33:29.224 19:19:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:29.224 19:19:44 -- common/autotest_common.sh@10 -- # set +x 00:33:29.224 19:19:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:29.224 19:19:44 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:33:29.224 19:19:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:29.224 19:19:44 -- common/autotest_common.sh@10 -- # set +x 00:33:29.224 19:19:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:29.224 19:19:44 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:33:29.224 19:19:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:29.224 19:19:44 -- common/autotest_common.sh@10 -- # set +x 00:33:29.224 19:19:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:29.224 19:19:44 -- target/dif.sh@95 -- # create_json_sub_conf 0 1 00:33:29.224 19:19:44 -- target/dif.sh@95 -- # fio /dev/fd/62 00:33:29.224 19:19:44 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:33:29.224 19:19:44 -- nvmf/common.sh@520 -- # config=() 00:33:29.224 19:19:44 -- nvmf/common.sh@520 -- # local subsystem config 00:33:29.224 19:19:44 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:33:29.224 19:19:44 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:33:29.224 { 00:33:29.224 "params": { 00:33:29.224 "name": "Nvme$subsystem", 00:33:29.224 "trtype": "$TEST_TRANSPORT", 00:33:29.224 "traddr": "$NVMF_FIRST_TARGET_IP", 00:33:29.224 "adrfam": "ipv4", 00:33:29.224 "trsvcid": "$NVMF_PORT", 00:33:29.224 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:33:29.224 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:33:29.224 "hdgst": ${hdgst:-false}, 00:33:29.224 "ddgst": ${ddgst:-false} 00:33:29.224 }, 00:33:29.224 "method": "bdev_nvme_attach_controller" 00:33:29.224 } 00:33:29.224 EOF 00:33:29.224 )") 00:33:29.224 19:19:44 -- target/dif.sh@82 -- # gen_fio_conf 00:33:29.224 19:19:44 -- target/dif.sh@54 -- # local file 00:33:29.224 19:19:44 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:33:29.224 19:19:44 -- target/dif.sh@56 -- # cat 00:33:29.224 19:19:44 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:33:29.224 19:19:44 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:33:29.224 19:19:44 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:33:29.224 19:19:44 -- common/autotest_common.sh@1328 -- # local sanitizers 00:33:29.224 19:19:44 -- nvmf/common.sh@542 -- # cat 00:33:29.224 19:19:44 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:33:29.224 19:19:44 -- common/autotest_common.sh@1330 -- # shift 00:33:29.224 19:19:44 -- target/dif.sh@72 -- # (( file = 1 )) 00:33:29.224 19:19:44 -- target/dif.sh@72 -- # (( file <= files )) 00:33:29.224 19:19:44 -- target/dif.sh@73 -- # cat 00:33:29.224 19:19:44 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:33:29.224 19:19:44 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:33:29.224 19:19:44 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:33:29.224 19:19:44 -- common/autotest_common.sh@1334 -- # grep libasan 00:33:29.224 19:19:44 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:33:29.224 19:19:44 -- target/dif.sh@72 -- # (( file++ )) 00:33:29.224 19:19:44 -- target/dif.sh@72 -- # (( file <= files )) 00:33:29.224 19:19:44 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:33:29.224 19:19:44 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:33:29.224 { 00:33:29.224 "params": { 00:33:29.224 "name": "Nvme$subsystem", 00:33:29.224 "trtype": "$TEST_TRANSPORT", 00:33:29.224 "traddr": "$NVMF_FIRST_TARGET_IP", 00:33:29.224 "adrfam": "ipv4", 00:33:29.224 "trsvcid": "$NVMF_PORT", 00:33:29.224 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:33:29.224 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:33:29.224 "hdgst": ${hdgst:-false}, 00:33:29.224 "ddgst": ${ddgst:-false} 00:33:29.224 }, 00:33:29.224 "method": "bdev_nvme_attach_controller" 00:33:29.224 } 00:33:29.224 EOF 00:33:29.224 )") 00:33:29.224 19:19:44 -- nvmf/common.sh@542 -- # cat 00:33:29.224 19:19:44 -- nvmf/common.sh@544 -- # jq . 00:33:29.224 19:19:44 -- nvmf/common.sh@545 -- # IFS=, 00:33:29.224 19:19:44 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:33:29.224 "params": { 00:33:29.224 "name": "Nvme0", 00:33:29.224 "trtype": "tcp", 00:33:29.224 "traddr": "10.0.0.2", 00:33:29.224 "adrfam": "ipv4", 00:33:29.224 "trsvcid": "4420", 00:33:29.224 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:33:29.224 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:33:29.224 "hdgst": false, 00:33:29.224 "ddgst": false 00:33:29.224 }, 00:33:29.224 "method": "bdev_nvme_attach_controller" 00:33:29.224 },{ 00:33:29.224 "params": { 00:33:29.224 "name": "Nvme1", 00:33:29.224 "trtype": "tcp", 00:33:29.224 "traddr": "10.0.0.2", 00:33:29.224 "adrfam": "ipv4", 00:33:29.224 "trsvcid": "4420", 00:33:29.224 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:33:29.224 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:33:29.224 "hdgst": false, 00:33:29.224 "ddgst": false 00:33:29.224 }, 00:33:29.224 "method": "bdev_nvme_attach_controller" 00:33:29.224 }' 00:33:29.224 19:19:44 -- common/autotest_common.sh@1334 -- # asan_lib= 00:33:29.224 19:19:44 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:33:29.225 19:19:44 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:33:29.225 19:19:44 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:33:29.225 19:19:44 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:33:29.225 19:19:44 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:33:29.225 19:19:44 -- common/autotest_common.sh@1334 -- # asan_lib= 00:33:29.225 19:19:44 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:33:29.225 19:19:44 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:33:29.225 19:19:44 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:33:29.225 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:33:29.225 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:33:29.225 fio-3.35 00:33:29.225 Starting 2 threads 00:33:29.225 EAL: No free 2048 kB hugepages reported on node 1 00:33:29.225 [2024-11-26 19:19:45.313261] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:33:29.225 [2024-11-26 19:19:45.313299] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:33:39.181 00:33:39.181 filename0: (groupid=0, jobs=1): err= 0: pid=3318351: Tue Nov 26 19:19:55 2024 00:33:39.181 read: IOPS=189, BW=756KiB/s (774kB/s)(7584KiB/10028msec) 00:33:39.181 slat (nsec): min=6134, max=26518, avg=7531.66, stdev=2382.27 00:33:39.181 clat (usec): min=419, max=42520, avg=21132.92, stdev=20460.45 00:33:39.181 lat (usec): min=425, max=42527, avg=21140.45, stdev=20459.58 00:33:39.181 clat percentiles (usec): 00:33:39.181 | 1.00th=[ 465], 5.00th=[ 486], 10.00th=[ 506], 20.00th=[ 603], 00:33:39.181 | 30.00th=[ 619], 40.00th=[ 627], 50.00th=[40633], 60.00th=[41157], 00:33:39.181 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41681], 95.00th=[42206], 00:33:39.181 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42730], 99.95th=[42730], 00:33:39.181 | 99.99th=[42730] 00:33:39.181 bw ( KiB/s): min= 672, max= 768, per=50.19%, avg=756.80, stdev=28.00, samples=20 00:33:39.181 iops : min= 168, max= 192, avg=189.20, stdev= 7.00, samples=20 00:33:39.181 lat (usec) : 500=9.34%, 750=39.61%, 1000=0.74% 00:33:39.181 lat (msec) : 2=0.11%, 50=50.21% 00:33:39.181 cpu : usr=97.12%, sys=2.59%, ctx=14, majf=0, minf=152 00:33:39.181 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:33:39.181 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:39.181 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:39.181 issued rwts: total=1896,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:33:39.181 latency : target=0, window=0, percentile=100.00%, depth=4 00:33:39.181 filename1: (groupid=0, jobs=1): err= 0: pid=3318352: Tue Nov 26 19:19:55 2024 00:33:39.181 read: IOPS=187, BW=751KiB/s (769kB/s)(7520KiB/10008msec) 00:33:39.181 slat (nsec): min=6128, max=34845, avg=7528.92, stdev=2382.23 00:33:39.181 clat (usec): min=388, max=42646, avg=21270.09, stdev=20574.99 00:33:39.181 lat (usec): min=395, max=42653, avg=21277.62, stdev=20574.19 00:33:39.181 clat percentiles (usec): 00:33:39.181 | 1.00th=[ 412], 5.00th=[ 441], 10.00th=[ 461], 20.00th=[ 482], 00:33:39.181 | 30.00th=[ 494], 40.00th=[ 586], 50.00th=[40633], 60.00th=[41157], 00:33:39.181 | 70.00th=[41681], 80.00th=[41681], 90.00th=[42206], 95.00th=[42730], 00:33:39.181 | 99.00th=[42730], 99.50th=[42730], 99.90th=[42730], 99.95th=[42730], 00:33:39.181 | 99.99th=[42730] 00:33:39.181 bw ( KiB/s): min= 672, max= 768, per=49.93%, avg=752.84, stdev=30.86, samples=19 00:33:39.181 iops : min= 168, max= 192, avg=188.21, stdev= 7.71, samples=19 00:33:39.181 lat (usec) : 500=33.78%, 750=13.62%, 1000=0.59% 00:33:39.181 lat (msec) : 2=1.60%, 50=50.43% 00:33:39.181 cpu : usr=97.19%, sys=2.53%, ctx=15, majf=0, minf=178 00:33:39.181 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:33:39.181 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:39.181 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:39.181 issued rwts: total=1880,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:33:39.181 latency : target=0, window=0, percentile=100.00%, depth=4 00:33:39.181 00:33:39.181 Run status group 0 (all jobs): 00:33:39.181 READ: bw=1506KiB/s (1542kB/s), 751KiB/s-756KiB/s (769kB/s-774kB/s), io=14.8MiB (15.5MB), run=10008-10028msec 00:33:39.181 19:19:55 -- target/dif.sh@96 -- # destroy_subsystems 0 1 00:33:39.181 19:19:55 -- target/dif.sh@43 -- # local sub 00:33:39.181 19:19:55 -- target/dif.sh@45 -- # for sub in "$@" 00:33:39.181 19:19:55 -- target/dif.sh@46 -- # destroy_subsystem 0 00:33:39.181 19:19:55 -- target/dif.sh@36 -- # local sub_id=0 00:33:39.181 19:19:55 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:33:39.181 19:19:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:39.181 19:19:55 -- common/autotest_common.sh@10 -- # set +x 00:33:39.181 19:19:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:39.181 19:19:55 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:33:39.181 19:19:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:39.181 19:19:55 -- common/autotest_common.sh@10 -- # set +x 00:33:39.181 19:19:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:39.182 19:19:55 -- target/dif.sh@45 -- # for sub in "$@" 00:33:39.182 19:19:55 -- target/dif.sh@46 -- # destroy_subsystem 1 00:33:39.182 19:19:55 -- target/dif.sh@36 -- # local sub_id=1 00:33:39.182 19:19:55 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:33:39.182 19:19:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:39.182 19:19:55 -- common/autotest_common.sh@10 -- # set +x 00:33:39.182 19:19:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:39.182 19:19:55 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:33:39.182 19:19:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:39.182 19:19:55 -- common/autotest_common.sh@10 -- # set +x 00:33:39.182 19:19:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:39.182 00:33:39.182 real 0m11.383s 00:33:39.182 user 0m26.356s 00:33:39.182 sys 0m0.877s 00:33:39.182 19:19:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:33:39.182 19:19:55 -- common/autotest_common.sh@10 -- # set +x 00:33:39.182 ************************************ 00:33:39.182 END TEST fio_dif_1_multi_subsystems 00:33:39.182 ************************************ 00:33:39.182 19:19:55 -- target/dif.sh@143 -- # run_test fio_dif_rand_params fio_dif_rand_params 00:33:39.182 19:19:55 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:33:39.182 19:19:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:33:39.182 19:19:55 -- common/autotest_common.sh@10 -- # set +x 00:33:39.182 ************************************ 00:33:39.182 START TEST fio_dif_rand_params 00:33:39.182 ************************************ 00:33:39.182 19:19:55 -- common/autotest_common.sh@1114 -- # fio_dif_rand_params 00:33:39.182 19:19:55 -- target/dif.sh@100 -- # local NULL_DIF 00:33:39.182 19:19:55 -- target/dif.sh@101 -- # local bs numjobs runtime iodepth files 00:33:39.182 19:19:55 -- target/dif.sh@103 -- # NULL_DIF=3 00:33:39.182 19:19:55 -- target/dif.sh@103 -- # bs=128k 00:33:39.182 19:19:55 -- target/dif.sh@103 -- # numjobs=3 00:33:39.182 19:19:55 -- target/dif.sh@103 -- # iodepth=3 00:33:39.182 19:19:55 -- target/dif.sh@103 -- # runtime=5 00:33:39.182 19:19:55 -- target/dif.sh@105 -- # create_subsystems 0 00:33:39.182 19:19:55 -- target/dif.sh@28 -- # local sub 00:33:39.182 19:19:55 -- target/dif.sh@30 -- # for sub in "$@" 00:33:39.182 19:19:55 -- target/dif.sh@31 -- # create_subsystem 0 00:33:39.182 19:19:55 -- target/dif.sh@18 -- # local sub_id=0 00:33:39.182 19:19:55 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:33:39.182 19:19:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:39.182 19:19:55 -- common/autotest_common.sh@10 -- # set +x 00:33:39.182 bdev_null0 00:33:39.182 19:19:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:39.182 19:19:55 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:33:39.182 19:19:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:39.182 19:19:55 -- common/autotest_common.sh@10 -- # set +x 00:33:39.182 19:19:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:39.182 19:19:55 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:33:39.182 19:19:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:39.182 19:19:55 -- common/autotest_common.sh@10 -- # set +x 00:33:39.182 19:19:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:39.182 19:19:55 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:33:39.182 19:19:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:39.182 19:19:55 -- common/autotest_common.sh@10 -- # set +x 00:33:39.182 [2024-11-26 19:19:55.748289] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:33:39.182 19:19:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:39.182 19:19:55 -- target/dif.sh@106 -- # fio /dev/fd/62 00:33:39.182 19:19:55 -- target/dif.sh@106 -- # create_json_sub_conf 0 00:33:39.182 19:19:55 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:33:39.182 19:19:55 -- nvmf/common.sh@520 -- # config=() 00:33:39.182 19:19:55 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:33:39.182 19:19:55 -- nvmf/common.sh@520 -- # local subsystem config 00:33:39.182 19:19:55 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:33:39.182 19:19:55 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:33:39.182 19:19:55 -- target/dif.sh@82 -- # gen_fio_conf 00:33:39.182 19:19:55 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:33:39.182 { 00:33:39.182 "params": { 00:33:39.182 "name": "Nvme$subsystem", 00:33:39.182 "trtype": "$TEST_TRANSPORT", 00:33:39.182 "traddr": "$NVMF_FIRST_TARGET_IP", 00:33:39.182 "adrfam": "ipv4", 00:33:39.182 "trsvcid": "$NVMF_PORT", 00:33:39.182 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:33:39.182 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:33:39.182 "hdgst": ${hdgst:-false}, 00:33:39.182 "ddgst": ${ddgst:-false} 00:33:39.182 }, 00:33:39.182 "method": "bdev_nvme_attach_controller" 00:33:39.182 } 00:33:39.182 EOF 00:33:39.182 )") 00:33:39.182 19:19:55 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:33:39.182 19:19:55 -- target/dif.sh@54 -- # local file 00:33:39.182 19:19:55 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:33:39.182 19:19:55 -- target/dif.sh@56 -- # cat 00:33:39.182 19:19:55 -- common/autotest_common.sh@1328 -- # local sanitizers 00:33:39.182 19:19:55 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:33:39.182 19:19:55 -- common/autotest_common.sh@1330 -- # shift 00:33:39.182 19:19:55 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:33:39.182 19:19:55 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:33:39.182 19:19:55 -- nvmf/common.sh@542 -- # cat 00:33:39.182 19:19:55 -- target/dif.sh@72 -- # (( file = 1 )) 00:33:39.182 19:19:55 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:33:39.182 19:19:55 -- target/dif.sh@72 -- # (( file <= files )) 00:33:39.182 19:19:55 -- common/autotest_common.sh@1334 -- # grep libasan 00:33:39.182 19:19:55 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:33:39.182 19:19:55 -- nvmf/common.sh@544 -- # jq . 00:33:39.182 19:19:55 -- nvmf/common.sh@545 -- # IFS=, 00:33:39.182 19:19:55 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:33:39.182 "params": { 00:33:39.182 "name": "Nvme0", 00:33:39.182 "trtype": "tcp", 00:33:39.182 "traddr": "10.0.0.2", 00:33:39.182 "adrfam": "ipv4", 00:33:39.182 "trsvcid": "4420", 00:33:39.182 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:33:39.182 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:33:39.182 "hdgst": false, 00:33:39.182 "ddgst": false 00:33:39.182 }, 00:33:39.182 "method": "bdev_nvme_attach_controller" 00:33:39.182 }' 00:33:39.182 19:19:55 -- common/autotest_common.sh@1334 -- # asan_lib= 00:33:39.182 19:19:55 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:33:39.182 19:19:55 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:33:39.182 19:19:55 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:33:39.182 19:19:55 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:33:39.182 19:19:55 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:33:39.182 19:19:55 -- common/autotest_common.sh@1334 -- # asan_lib= 00:33:39.182 19:19:55 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:33:39.182 19:19:55 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:33:39.182 19:19:55 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:33:39.182 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:33:39.182 ... 00:33:39.182 fio-3.35 00:33:39.182 Starting 3 threads 00:33:39.444 EAL: No free 2048 kB hugepages reported on node 1 00:33:39.701 [2024-11-26 19:19:56.521476] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:33:39.702 [2024-11-26 19:19:56.521526] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:33:44.957 00:33:44.957 filename0: (groupid=0, jobs=1): err= 0: pid=3320521: Tue Nov 26 19:20:01 2024 00:33:44.957 read: IOPS=310, BW=38.9MiB/s (40.7MB/s)(196MiB/5048msec) 00:33:44.957 slat (nsec): min=6339, max=25504, avg=10959.71, stdev=2234.88 00:33:44.957 clat (usec): min=3190, max=90577, avg=9609.91, stdev=8009.72 00:33:44.957 lat (usec): min=3196, max=90584, avg=9620.87, stdev=8009.81 00:33:44.957 clat percentiles (usec): 00:33:44.957 | 1.00th=[ 3589], 5.00th=[ 5473], 10.00th=[ 5997], 20.00th=[ 6587], 00:33:44.957 | 30.00th=[ 7504], 40.00th=[ 8029], 50.00th=[ 8455], 60.00th=[ 8848], 00:33:44.957 | 70.00th=[ 9372], 80.00th=[ 9765], 90.00th=[10290], 95.00th=[11207], 00:33:44.957 | 99.00th=[49546], 99.50th=[50594], 99.90th=[89654], 99.95th=[90702], 00:33:44.957 | 99.99th=[90702] 00:33:44.957 bw ( KiB/s): min=25088, max=51456, per=34.05%, avg=40089.60, stdev=8859.23, samples=10 00:33:44.957 iops : min= 196, max= 402, avg=313.20, stdev=69.21, samples=10 00:33:44.957 lat (msec) : 4=3.12%, 10=82.15%, 20=11.28%, 50=2.61%, 100=0.83% 00:33:44.957 cpu : usr=94.12%, sys=5.59%, ctx=9, majf=0, minf=46 00:33:44.957 IO depths : 1=0.3%, 2=99.7%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:33:44.957 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:44.957 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:44.957 issued rwts: total=1569,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:33:44.957 latency : target=0, window=0, percentile=100.00%, depth=3 00:33:44.957 filename0: (groupid=0, jobs=1): err= 0: pid=3320522: Tue Nov 26 19:20:01 2024 00:33:44.957 read: IOPS=321, BW=40.2MiB/s (42.2MB/s)(201MiB/5004msec) 00:33:44.957 slat (nsec): min=6362, max=32689, avg=11375.37, stdev=2168.93 00:33:44.957 clat (usec): min=3514, max=51494, avg=9309.31, stdev=5922.85 00:33:44.957 lat (usec): min=3522, max=51507, avg=9320.69, stdev=5922.98 00:33:44.957 clat percentiles (usec): 00:33:44.957 | 1.00th=[ 4178], 5.00th=[ 5604], 10.00th=[ 6063], 20.00th=[ 6521], 00:33:44.957 | 30.00th=[ 7308], 40.00th=[ 8160], 50.00th=[ 8848], 60.00th=[ 9372], 00:33:44.957 | 70.00th=[ 9765], 80.00th=[10290], 90.00th=[11076], 95.00th=[11600], 00:33:44.957 | 99.00th=[48497], 99.50th=[50070], 99.90th=[51119], 99.95th=[51643], 00:33:44.957 | 99.99th=[51643] 00:33:44.957 bw ( KiB/s): min=37376, max=46336, per=34.96%, avg=41164.80, stdev=2819.36, samples=10 00:33:44.957 iops : min= 292, max= 362, avg=321.60, stdev=22.03, samples=10 00:33:44.957 lat (msec) : 4=0.81%, 10=73.60%, 20=23.54%, 50=1.55%, 100=0.50% 00:33:44.958 cpu : usr=93.62%, sys=6.10%, ctx=9, majf=0, minf=141 00:33:44.958 IO depths : 1=0.2%, 2=99.8%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:33:44.958 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:44.958 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:44.958 issued rwts: total=1610,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:33:44.958 latency : target=0, window=0, percentile=100.00%, depth=3 00:33:44.958 filename0: (groupid=0, jobs=1): err= 0: pid=3320523: Tue Nov 26 19:20:01 2024 00:33:44.958 read: IOPS=290, BW=36.3MiB/s (38.0MB/s)(183MiB/5044msec) 00:33:44.958 slat (nsec): min=6313, max=25483, avg=10908.54, stdev=2287.29 00:33:44.958 clat (usec): min=3561, max=51152, avg=10293.04, stdev=8605.41 00:33:44.958 lat (usec): min=3568, max=51164, avg=10303.95, stdev=8605.39 00:33:44.958 clat percentiles (usec): 00:33:44.958 | 1.00th=[ 3851], 5.00th=[ 5669], 10.00th=[ 6259], 20.00th=[ 7046], 00:33:44.958 | 30.00th=[ 7963], 40.00th=[ 8455], 50.00th=[ 8717], 60.00th=[ 9110], 00:33:44.958 | 70.00th=[ 9503], 80.00th=[ 9896], 90.00th=[10683], 95.00th=[11994], 00:33:44.958 | 99.00th=[50070], 99.50th=[50070], 99.90th=[50594], 99.95th=[51119], 00:33:44.958 | 99.99th=[51119] 00:33:44.958 bw ( KiB/s): min=26624, max=47104, per=31.79%, avg=37427.20, stdev=6814.71, samples=10 00:33:44.958 iops : min= 208, max= 368, avg=292.40, stdev=53.24, samples=10 00:33:44.958 lat (msec) : 4=1.23%, 10=79.51%, 20=14.62%, 50=4.03%, 100=0.61% 00:33:44.958 cpu : usr=94.39%, sys=5.31%, ctx=11, majf=0, minf=89 00:33:44.958 IO depths : 1=0.2%, 2=99.8%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:33:44.958 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:44.958 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:44.958 issued rwts: total=1464,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:33:44.958 latency : target=0, window=0, percentile=100.00%, depth=3 00:33:44.958 00:33:44.958 Run status group 0 (all jobs): 00:33:44.958 READ: bw=115MiB/s (121MB/s), 36.3MiB/s-40.2MiB/s (38.0MB/s-42.2MB/s), io=580MiB (609MB), run=5004-5048msec 00:33:44.958 19:20:01 -- target/dif.sh@107 -- # destroy_subsystems 0 00:33:44.958 19:20:01 -- target/dif.sh@43 -- # local sub 00:33:44.958 19:20:01 -- target/dif.sh@45 -- # for sub in "$@" 00:33:44.958 19:20:01 -- target/dif.sh@46 -- # destroy_subsystem 0 00:33:44.958 19:20:01 -- target/dif.sh@36 -- # local sub_id=0 00:33:44.958 19:20:01 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:33:44.958 19:20:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:44.958 19:20:01 -- common/autotest_common.sh@10 -- # set +x 00:33:44.958 19:20:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:44.958 19:20:01 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:33:44.958 19:20:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:44.958 19:20:01 -- common/autotest_common.sh@10 -- # set +x 00:33:44.958 19:20:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:44.958 19:20:01 -- target/dif.sh@109 -- # NULL_DIF=2 00:33:44.958 19:20:01 -- target/dif.sh@109 -- # bs=4k 00:33:44.958 19:20:01 -- target/dif.sh@109 -- # numjobs=8 00:33:44.958 19:20:01 -- target/dif.sh@109 -- # iodepth=16 00:33:44.958 19:20:01 -- target/dif.sh@109 -- # runtime= 00:33:44.958 19:20:01 -- target/dif.sh@109 -- # files=2 00:33:44.958 19:20:01 -- target/dif.sh@111 -- # create_subsystems 0 1 2 00:33:44.958 19:20:01 -- target/dif.sh@28 -- # local sub 00:33:44.958 19:20:01 -- target/dif.sh@30 -- # for sub in "$@" 00:33:44.958 19:20:01 -- target/dif.sh@31 -- # create_subsystem 0 00:33:44.958 19:20:01 -- target/dif.sh@18 -- # local sub_id=0 00:33:44.958 19:20:01 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 2 00:33:44.958 19:20:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:44.958 19:20:01 -- common/autotest_common.sh@10 -- # set +x 00:33:44.958 bdev_null0 00:33:44.958 19:20:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:44.958 19:20:01 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:33:44.958 19:20:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:44.958 19:20:01 -- common/autotest_common.sh@10 -- # set +x 00:33:44.958 19:20:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:44.958 19:20:01 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:33:44.958 19:20:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:44.958 19:20:01 -- common/autotest_common.sh@10 -- # set +x 00:33:45.217 19:20:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:45.217 19:20:01 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:33:45.217 19:20:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:45.217 19:20:01 -- common/autotest_common.sh@10 -- # set +x 00:33:45.217 [2024-11-26 19:20:01.891249] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:33:45.217 19:20:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:45.217 19:20:01 -- target/dif.sh@30 -- # for sub in "$@" 00:33:45.217 19:20:01 -- target/dif.sh@31 -- # create_subsystem 1 00:33:45.217 19:20:01 -- target/dif.sh@18 -- # local sub_id=1 00:33:45.217 19:20:01 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 2 00:33:45.217 19:20:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:45.217 19:20:01 -- common/autotest_common.sh@10 -- # set +x 00:33:45.217 bdev_null1 00:33:45.217 19:20:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:45.217 19:20:01 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:33:45.217 19:20:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:45.217 19:20:01 -- common/autotest_common.sh@10 -- # set +x 00:33:45.217 19:20:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:45.217 19:20:01 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:33:45.217 19:20:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:45.217 19:20:01 -- common/autotest_common.sh@10 -- # set +x 00:33:45.217 19:20:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:45.217 19:20:01 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:33:45.217 19:20:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:45.217 19:20:01 -- common/autotest_common.sh@10 -- # set +x 00:33:45.217 19:20:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:45.217 19:20:01 -- target/dif.sh@30 -- # for sub in "$@" 00:33:45.217 19:20:01 -- target/dif.sh@31 -- # create_subsystem 2 00:33:45.217 19:20:01 -- target/dif.sh@18 -- # local sub_id=2 00:33:45.217 19:20:01 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null2 64 512 --md-size 16 --dif-type 2 00:33:45.217 19:20:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:45.217 19:20:01 -- common/autotest_common.sh@10 -- # set +x 00:33:45.217 bdev_null2 00:33:45.217 19:20:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:45.217 19:20:01 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 --serial-number 53313233-2 --allow-any-host 00:33:45.217 19:20:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:45.217 19:20:01 -- common/autotest_common.sh@10 -- # set +x 00:33:45.217 19:20:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:45.217 19:20:01 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 bdev_null2 00:33:45.217 19:20:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:45.217 19:20:01 -- common/autotest_common.sh@10 -- # set +x 00:33:45.217 19:20:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:45.217 19:20:01 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:33:45.217 19:20:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:45.217 19:20:01 -- common/autotest_common.sh@10 -- # set +x 00:33:45.217 19:20:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:45.217 19:20:01 -- target/dif.sh@112 -- # create_json_sub_conf 0 1 2 00:33:45.217 19:20:01 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 2 00:33:45.217 19:20:01 -- target/dif.sh@112 -- # fio /dev/fd/62 00:33:45.217 19:20:01 -- nvmf/common.sh@520 -- # config=() 00:33:45.217 19:20:01 -- nvmf/common.sh@520 -- # local subsystem config 00:33:45.217 19:20:01 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:33:45.217 19:20:01 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:33:45.217 { 00:33:45.217 "params": { 00:33:45.217 "name": "Nvme$subsystem", 00:33:45.217 "trtype": "$TEST_TRANSPORT", 00:33:45.217 "traddr": "$NVMF_FIRST_TARGET_IP", 00:33:45.217 "adrfam": "ipv4", 00:33:45.217 "trsvcid": "$NVMF_PORT", 00:33:45.217 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:33:45.217 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:33:45.217 "hdgst": ${hdgst:-false}, 00:33:45.217 "ddgst": ${ddgst:-false} 00:33:45.217 }, 00:33:45.217 "method": "bdev_nvme_attach_controller" 00:33:45.217 } 00:33:45.217 EOF 00:33:45.217 )") 00:33:45.217 19:20:01 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:33:45.217 19:20:01 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:33:45.217 19:20:01 -- target/dif.sh@82 -- # gen_fio_conf 00:33:45.217 19:20:01 -- nvmf/common.sh@542 -- # cat 00:33:45.217 19:20:01 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:33:45.217 19:20:01 -- target/dif.sh@54 -- # local file 00:33:45.217 19:20:01 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:33:45.217 19:20:01 -- target/dif.sh@56 -- # cat 00:33:45.217 19:20:01 -- common/autotest_common.sh@1328 -- # local sanitizers 00:33:45.217 19:20:01 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:33:45.217 19:20:01 -- common/autotest_common.sh@1330 -- # shift 00:33:45.217 19:20:01 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:33:45.217 19:20:01 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:33:45.217 19:20:01 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:33:45.217 19:20:01 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:33:45.217 { 00:33:45.217 "params": { 00:33:45.217 "name": "Nvme$subsystem", 00:33:45.217 "trtype": "$TEST_TRANSPORT", 00:33:45.217 "traddr": "$NVMF_FIRST_TARGET_IP", 00:33:45.217 "adrfam": "ipv4", 00:33:45.217 "trsvcid": "$NVMF_PORT", 00:33:45.217 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:33:45.217 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:33:45.217 "hdgst": ${hdgst:-false}, 00:33:45.217 "ddgst": ${ddgst:-false} 00:33:45.217 }, 00:33:45.217 "method": "bdev_nvme_attach_controller" 00:33:45.217 } 00:33:45.217 EOF 00:33:45.217 )") 00:33:45.217 19:20:01 -- target/dif.sh@72 -- # (( file = 1 )) 00:33:45.217 19:20:01 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:33:45.217 19:20:01 -- target/dif.sh@72 -- # (( file <= files )) 00:33:45.217 19:20:01 -- common/autotest_common.sh@1334 -- # grep libasan 00:33:45.217 19:20:01 -- target/dif.sh@73 -- # cat 00:33:45.217 19:20:01 -- nvmf/common.sh@542 -- # cat 00:33:45.217 19:20:01 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:33:45.217 19:20:01 -- target/dif.sh@72 -- # (( file++ )) 00:33:45.217 19:20:01 -- target/dif.sh@72 -- # (( file <= files )) 00:33:45.217 19:20:01 -- target/dif.sh@73 -- # cat 00:33:45.217 19:20:01 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:33:45.217 19:20:01 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:33:45.217 { 00:33:45.217 "params": { 00:33:45.217 "name": "Nvme$subsystem", 00:33:45.217 "trtype": "$TEST_TRANSPORT", 00:33:45.217 "traddr": "$NVMF_FIRST_TARGET_IP", 00:33:45.217 "adrfam": "ipv4", 00:33:45.217 "trsvcid": "$NVMF_PORT", 00:33:45.218 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:33:45.218 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:33:45.218 "hdgst": ${hdgst:-false}, 00:33:45.218 "ddgst": ${ddgst:-false} 00:33:45.218 }, 00:33:45.218 "method": "bdev_nvme_attach_controller" 00:33:45.218 } 00:33:45.218 EOF 00:33:45.218 )") 00:33:45.218 19:20:01 -- nvmf/common.sh@542 -- # cat 00:33:45.218 19:20:01 -- target/dif.sh@72 -- # (( file++ )) 00:33:45.218 19:20:01 -- target/dif.sh@72 -- # (( file <= files )) 00:33:45.218 19:20:01 -- nvmf/common.sh@544 -- # jq . 00:33:45.218 19:20:01 -- nvmf/common.sh@545 -- # IFS=, 00:33:45.218 19:20:01 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:33:45.218 "params": { 00:33:45.218 "name": "Nvme0", 00:33:45.218 "trtype": "tcp", 00:33:45.218 "traddr": "10.0.0.2", 00:33:45.218 "adrfam": "ipv4", 00:33:45.218 "trsvcid": "4420", 00:33:45.218 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:33:45.218 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:33:45.218 "hdgst": false, 00:33:45.218 "ddgst": false 00:33:45.218 }, 00:33:45.218 "method": "bdev_nvme_attach_controller" 00:33:45.218 },{ 00:33:45.218 "params": { 00:33:45.218 "name": "Nvme1", 00:33:45.218 "trtype": "tcp", 00:33:45.218 "traddr": "10.0.0.2", 00:33:45.218 "adrfam": "ipv4", 00:33:45.218 "trsvcid": "4420", 00:33:45.218 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:33:45.218 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:33:45.218 "hdgst": false, 00:33:45.218 "ddgst": false 00:33:45.218 }, 00:33:45.218 "method": "bdev_nvme_attach_controller" 00:33:45.218 },{ 00:33:45.218 "params": { 00:33:45.218 "name": "Nvme2", 00:33:45.218 "trtype": "tcp", 00:33:45.218 "traddr": "10.0.0.2", 00:33:45.218 "adrfam": "ipv4", 00:33:45.218 "trsvcid": "4420", 00:33:45.218 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:33:45.218 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:33:45.218 "hdgst": false, 00:33:45.218 "ddgst": false 00:33:45.218 }, 00:33:45.218 "method": "bdev_nvme_attach_controller" 00:33:45.218 }' 00:33:45.218 19:20:02 -- common/autotest_common.sh@1334 -- # asan_lib= 00:33:45.218 19:20:02 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:33:45.218 19:20:02 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:33:45.218 19:20:02 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:33:45.218 19:20:02 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:33:45.218 19:20:02 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:33:45.218 19:20:02 -- common/autotest_common.sh@1334 -- # asan_lib= 00:33:45.218 19:20:02 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:33:45.218 19:20:02 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:33:45.218 19:20:02 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:33:45.475 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:33:45.475 ... 00:33:45.475 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:33:45.475 ... 00:33:45.475 filename2: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:33:45.475 ... 00:33:45.475 fio-3.35 00:33:45.475 Starting 24 threads 00:33:45.475 EAL: No free 2048 kB hugepages reported on node 1 00:33:46.405 [2024-11-26 19:20:03.027551] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:33:46.406 [2024-11-26 19:20:03.027599] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:33:58.602 00:33:58.602 filename0: (groupid=0, jobs=1): err= 0: pid=3321604: Tue Nov 26 19:20:13 2024 00:33:58.602 read: IOPS=255, BW=1024KiB/s (1048kB/s)(10.1MiB/10153msec) 00:33:58.602 slat (usec): min=5, max=100, avg=24.17, stdev=15.89 00:33:58.602 clat (usec): min=1997, max=447220, avg=61940.86, stdev=109653.28 00:33:58.602 lat (msec): min=2, max=447, avg=61.97, stdev=109.65 00:33:58.602 clat percentiles (msec): 00:33:58.602 | 1.00th=[ 3], 5.00th=[ 22], 10.00th=[ 24], 20.00th=[ 24], 00:33:58.602 | 30.00th=[ 24], 40.00th=[ 24], 50.00th=[ 25], 60.00th=[ 25], 00:33:58.602 | 70.00th=[ 25], 80.00th=[ 26], 90.00th=[ 275], 95.00th=[ 380], 00:33:58.602 | 99.00th=[ 418], 99.50th=[ 418], 99.90th=[ 447], 99.95th=[ 447], 00:33:58.602 | 99.99th=[ 447] 00:33:58.602 bw ( KiB/s): min= 128, max= 3200, per=4.39%, avg=1032.80, stdev=1218.09, samples=20 00:33:58.602 iops : min= 32, max= 800, avg=258.20, stdev=304.52, samples=20 00:33:58.602 lat (msec) : 2=0.04%, 4=1.81%, 10=0.62%, 20=1.85%, 50=84.37% 00:33:58.602 lat (msec) : 250=0.54%, 500=10.78% 00:33:58.602 cpu : usr=98.53%, sys=0.93%, ctx=63, majf=0, minf=36 00:33:58.602 IO depths : 1=5.4%, 2=11.3%, 4=23.9%, 8=52.3%, 16=7.1%, 32=0.0%, >=64=0.0% 00:33:58.602 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:58.602 complete : 0=0.0%, 4=93.8%, 8=0.4%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:58.602 issued rwts: total=2598,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:33:58.602 latency : target=0, window=0, percentile=100.00%, depth=16 00:33:58.602 filename0: (groupid=0, jobs=1): err= 0: pid=3321605: Tue Nov 26 19:20:13 2024 00:33:58.603 read: IOPS=243, BW=975KiB/s (998kB/s)(9856KiB/10111msec) 00:33:58.603 slat (nsec): min=5098, max=87861, avg=39412.29, stdev=16916.14 00:33:58.603 clat (msec): min=21, max=625, avg=65.15, stdev=118.74 00:33:58.603 lat (msec): min=21, max=625, avg=65.19, stdev=118.74 00:33:58.603 clat percentiles (msec): 00:33:58.603 | 1.00th=[ 23], 5.00th=[ 23], 10.00th=[ 24], 20.00th=[ 24], 00:33:58.603 | 30.00th=[ 24], 40.00th=[ 24], 50.00th=[ 25], 60.00th=[ 25], 00:33:58.603 | 70.00th=[ 25], 80.00th=[ 26], 90.00th=[ 279], 95.00th=[ 384], 00:33:58.603 | 99.00th=[ 510], 99.50th=[ 542], 99.90th=[ 584], 99.95th=[ 625], 00:33:58.603 | 99.99th=[ 625] 00:33:58.603 bw ( KiB/s): min= 128, max= 2688, per=4.16%, avg=979.45, stdev=1159.30, samples=20 00:33:58.603 iops : min= 32, max= 672, avg=244.85, stdev=289.81, samples=20 00:33:58.603 lat (msec) : 50=88.96%, 250=0.41%, 500=8.93%, 750=1.70% 00:33:58.603 cpu : usr=98.65%, sys=0.76%, ctx=88, majf=0, minf=23 00:33:58.603 IO depths : 1=5.8%, 2=11.8%, 4=24.0%, 8=51.7%, 16=6.7%, 32=0.0%, >=64=0.0% 00:33:58.603 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:58.603 complete : 0=0.0%, 4=93.8%, 8=0.3%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:58.603 issued rwts: total=2464,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:33:58.603 latency : target=0, window=0, percentile=100.00%, depth=16 00:33:58.603 filename0: (groupid=0, jobs=1): err= 0: pid=3321606: Tue Nov 26 19:20:13 2024 00:33:58.603 read: IOPS=242, BW=970KiB/s (994kB/s)(9816KiB/10116msec) 00:33:58.603 slat (nsec): min=5066, max=85005, avg=29941.59, stdev=18650.90 00:33:58.603 clat (msec): min=15, max=784, avg=65.51, stdev=123.47 00:33:58.603 lat (msec): min=15, max=784, avg=65.54, stdev=123.47 00:33:58.603 clat percentiles (msec): 00:33:58.603 | 1.00th=[ 22], 5.00th=[ 24], 10.00th=[ 24], 20.00th=[ 24], 00:33:58.603 | 30.00th=[ 24], 40.00th=[ 24], 50.00th=[ 25], 60.00th=[ 25], 00:33:58.603 | 70.00th=[ 25], 80.00th=[ 26], 90.00th=[ 279], 95.00th=[ 393], 00:33:58.603 | 99.00th=[ 527], 99.50th=[ 542], 99.90th=[ 584], 99.95th=[ 785], 00:33:58.603 | 99.99th=[ 785] 00:33:58.603 bw ( KiB/s): min= 128, max= 2688, per=4.14%, avg=975.20, stdev=1167.25, samples=20 00:33:58.603 iops : min= 32, max= 672, avg=243.80, stdev=291.81, samples=20 00:33:58.603 lat (msec) : 20=0.57%, 50=89.00%, 250=0.08%, 500=7.74%, 750=2.53% 00:33:58.603 lat (msec) : 1000=0.08% 00:33:58.603 cpu : usr=98.84%, sys=0.79%, ctx=49, majf=0, minf=25 00:33:58.603 IO depths : 1=4.2%, 2=9.0%, 4=19.4%, 8=57.8%, 16=9.6%, 32=0.0%, >=64=0.0% 00:33:58.603 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:58.603 complete : 0=0.0%, 4=93.0%, 8=2.5%, 16=4.5%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:58.603 issued rwts: total=2454,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:33:58.603 latency : target=0, window=0, percentile=100.00%, depth=16 00:33:58.603 filename0: (groupid=0, jobs=1): err= 0: pid=3321607: Tue Nov 26 19:20:13 2024 00:33:58.603 read: IOPS=246, BW=986KiB/s (1009kB/s)(9992KiB/10137msec) 00:33:58.603 slat (usec): min=9, max=117, avg=36.41, stdev=16.21 00:33:58.603 clat (msec): min=16, max=578, avg=64.36, stdev=116.93 00:33:58.603 lat (msec): min=16, max=578, avg=64.39, stdev=116.93 00:33:58.603 clat percentiles (msec): 00:33:58.603 | 1.00th=[ 23], 5.00th=[ 23], 10.00th=[ 24], 20.00th=[ 24], 00:33:58.603 | 30.00th=[ 24], 40.00th=[ 24], 50.00th=[ 25], 60.00th=[ 25], 00:33:58.603 | 70.00th=[ 25], 80.00th=[ 26], 90.00th=[ 279], 95.00th=[ 384], 00:33:58.603 | 99.00th=[ 502], 99.50th=[ 542], 99.90th=[ 550], 99.95th=[ 584], 00:33:58.603 | 99.99th=[ 584] 00:33:58.603 bw ( KiB/s): min= 128, max= 2688, per=4.22%, avg=992.55, stdev=1173.10, samples=20 00:33:58.603 iops : min= 32, max= 672, avg=248.10, stdev=293.24, samples=20 00:33:58.603 lat (msec) : 20=0.64%, 50=88.39%, 500=10.09%, 750=0.88% 00:33:58.603 cpu : usr=98.84%, sys=0.74%, ctx=32, majf=0, minf=29 00:33:58.603 IO depths : 1=5.7%, 2=11.5%, 4=23.5%, 8=52.5%, 16=6.8%, 32=0.0%, >=64=0.0% 00:33:58.603 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:58.603 complete : 0=0.0%, 4=93.6%, 8=0.6%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:58.603 issued rwts: total=2498,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:33:58.603 latency : target=0, window=0, percentile=100.00%, depth=16 00:33:58.603 filename0: (groupid=0, jobs=1): err= 0: pid=3321608: Tue Nov 26 19:20:13 2024 00:33:58.603 read: IOPS=237, BW=949KiB/s (972kB/s)(9600KiB/10113msec) 00:33:58.603 slat (nsec): min=5191, max=84237, avg=39650.05, stdev=16590.89 00:33:58.603 clat (msec): min=17, max=759, avg=66.88, stdev=141.55 00:33:58.603 lat (msec): min=17, max=759, avg=66.92, stdev=141.55 00:33:58.603 clat percentiles (msec): 00:33:58.603 | 1.00th=[ 20], 5.00th=[ 23], 10.00th=[ 24], 20.00th=[ 24], 00:33:58.603 | 30.00th=[ 24], 40.00th=[ 24], 50.00th=[ 24], 60.00th=[ 25], 00:33:58.603 | 70.00th=[ 25], 80.00th=[ 26], 90.00th=[ 30], 95.00th=[ 518], 00:33:58.603 | 99.00th=[ 617], 99.50th=[ 693], 99.90th=[ 701], 99.95th=[ 760], 00:33:58.603 | 99.99th=[ 760] 00:33:58.603 bw ( KiB/s): min= 112, max= 2688, per=4.26%, avg=1003.79, stdev=1188.21, samples=19 00:33:58.603 iops : min= 28, max= 672, avg=250.95, stdev=297.05, samples=19 00:33:58.603 lat (msec) : 20=1.42%, 50=89.92%, 500=2.83%, 750=5.75%, 1000=0.08% 00:33:58.603 cpu : usr=99.12%, sys=0.53%, ctx=14, majf=0, minf=19 00:33:58.603 IO depths : 1=4.7%, 2=10.9%, 4=24.8%, 8=51.8%, 16=7.9%, 32=0.0%, >=64=0.0% 00:33:58.603 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:58.603 complete : 0=0.0%, 4=94.2%, 8=0.1%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:58.603 issued rwts: total=2400,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:33:58.603 latency : target=0, window=0, percentile=100.00%, depth=16 00:33:58.603 filename0: (groupid=0, jobs=1): err= 0: pid=3321609: Tue Nov 26 19:20:13 2024 00:33:58.603 read: IOPS=244, BW=977KiB/s (1000kB/s)(9856KiB/10089msec) 00:33:58.603 slat (nsec): min=6007, max=69841, avg=17371.22, stdev=6880.04 00:33:58.603 clat (msec): min=22, max=663, avg=65.36, stdev=121.92 00:33:58.603 lat (msec): min=22, max=663, avg=65.37, stdev=121.92 00:33:58.603 clat percentiles (msec): 00:33:58.603 | 1.00th=[ 23], 5.00th=[ 24], 10.00th=[ 24], 20.00th=[ 24], 00:33:58.603 | 30.00th=[ 24], 40.00th=[ 25], 50.00th=[ 25], 60.00th=[ 25], 00:33:58.603 | 70.00th=[ 25], 80.00th=[ 26], 90.00th=[ 368], 95.00th=[ 393], 00:33:58.603 | 99.00th=[ 510], 99.50th=[ 523], 99.90th=[ 659], 99.95th=[ 667], 00:33:58.603 | 99.99th=[ 667] 00:33:58.603 bw ( KiB/s): min= 127, max= 2688, per=4.16%, avg=978.85, stdev=1169.90, samples=20 00:33:58.603 iops : min= 31, max= 672, avg=244.65, stdev=292.46, samples=20 00:33:58.603 lat (msec) : 50=89.61%, 500=8.44%, 750=1.95% 00:33:58.603 cpu : usr=98.55%, sys=0.98%, ctx=88, majf=0, minf=30 00:33:58.603 IO depths : 1=5.9%, 2=12.2%, 4=25.0%, 8=50.3%, 16=6.6%, 32=0.0%, >=64=0.0% 00:33:58.603 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:58.603 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:58.603 issued rwts: total=2464,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:33:58.603 latency : target=0, window=0, percentile=100.00%, depth=16 00:33:58.603 filename0: (groupid=0, jobs=1): err= 0: pid=3321610: Tue Nov 26 19:20:13 2024 00:33:58.603 read: IOPS=247, BW=989KiB/s (1012kB/s)(9984KiB/10100msec) 00:33:58.603 slat (nsec): min=4848, max=69344, avg=16979.00, stdev=8383.51 00:33:58.603 clat (msec): min=18, max=506, avg=64.61, stdev=114.49 00:33:58.603 lat (msec): min=19, max=506, avg=64.62, stdev=114.49 00:33:58.603 clat percentiles (msec): 00:33:58.603 | 1.00th=[ 21], 5.00th=[ 24], 10.00th=[ 24], 20.00th=[ 24], 00:33:58.603 | 30.00th=[ 24], 40.00th=[ 25], 50.00th=[ 25], 60.00th=[ 25], 00:33:58.603 | 70.00th=[ 26], 80.00th=[ 26], 90.00th=[ 313], 95.00th=[ 384], 00:33:58.603 | 99.00th=[ 460], 99.50th=[ 506], 99.90th=[ 506], 99.95th=[ 506], 00:33:58.603 | 99.99th=[ 506] 00:33:58.603 bw ( KiB/s): min= 127, max= 2688, per=4.21%, avg=991.95, stdev=1172.35, samples=20 00:33:58.603 iops : min= 31, max= 672, avg=247.95, stdev=293.12, samples=20 00:33:58.603 lat (msec) : 20=0.88%, 50=87.58%, 250=0.64%, 500=10.26%, 750=0.64% 00:33:58.603 cpu : usr=98.93%, sys=0.73%, ctx=15, majf=0, minf=27 00:33:58.603 IO depths : 1=4.4%, 2=10.7%, 4=25.0%, 8=51.8%, 16=8.1%, 32=0.0%, >=64=0.0% 00:33:58.603 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:58.603 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:58.603 issued rwts: total=2496,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:33:58.603 latency : target=0, window=0, percentile=100.00%, depth=16 00:33:58.603 filename0: (groupid=0, jobs=1): err= 0: pid=3321611: Tue Nov 26 19:20:13 2024 00:33:58.603 read: IOPS=247, BW=989KiB/s (1013kB/s)(9984KiB/10097msec) 00:33:58.603 slat (nsec): min=5601, max=68921, avg=21016.57, stdev=10348.10 00:33:58.603 clat (msec): min=19, max=507, avg=64.55, stdev=114.51 00:33:58.603 lat (msec): min=19, max=507, avg=64.57, stdev=114.51 00:33:58.603 clat percentiles (msec): 00:33:58.603 | 1.00th=[ 22], 5.00th=[ 24], 10.00th=[ 24], 20.00th=[ 24], 00:33:58.603 | 30.00th=[ 24], 40.00th=[ 24], 50.00th=[ 25], 60.00th=[ 25], 00:33:58.603 | 70.00th=[ 26], 80.00th=[ 26], 90.00th=[ 313], 95.00th=[ 384], 00:33:58.603 | 99.00th=[ 460], 99.50th=[ 506], 99.90th=[ 506], 99.95th=[ 506], 00:33:58.603 | 99.99th=[ 506] 00:33:58.603 bw ( KiB/s): min= 127, max= 2688, per=4.22%, avg=992.20, stdev=1172.70, samples=20 00:33:58.603 iops : min= 31, max= 672, avg=248.00, stdev=293.19, samples=20 00:33:58.603 lat (msec) : 20=0.40%, 50=88.06%, 250=0.64%, 500=10.26%, 750=0.64% 00:33:58.603 cpu : usr=98.96%, sys=0.70%, ctx=10, majf=0, minf=27 00:33:58.603 IO depths : 1=5.2%, 2=11.5%, 4=25.0%, 8=51.0%, 16=7.3%, 32=0.0%, >=64=0.0% 00:33:58.603 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:58.603 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:58.603 issued rwts: total=2496,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:33:58.603 latency : target=0, window=0, percentile=100.00%, depth=16 00:33:58.603 filename1: (groupid=0, jobs=1): err= 0: pid=3321612: Tue Nov 26 19:20:13 2024 00:33:58.603 read: IOPS=246, BW=985KiB/s (1008kB/s)(9976KiB/10133msec) 00:33:58.603 slat (usec): min=5, max=163, avg=25.74, stdev=22.81 00:33:58.603 clat (msec): min=18, max=766, avg=64.72, stdev=122.35 00:33:58.603 lat (msec): min=18, max=766, avg=64.75, stdev=122.35 00:33:58.603 clat percentiles (msec): 00:33:58.603 | 1.00th=[ 22], 5.00th=[ 23], 10.00th=[ 24], 20.00th=[ 24], 00:33:58.603 | 30.00th=[ 24], 40.00th=[ 24], 50.00th=[ 25], 60.00th=[ 25], 00:33:58.603 | 70.00th=[ 26], 80.00th=[ 26], 90.00th=[ 182], 95.00th=[ 384], 00:33:58.604 | 99.00th=[ 584], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], 00:33:58.604 | 99.99th=[ 768] 00:33:58.604 bw ( KiB/s): min= 15, max= 2688, per=4.43%, avg=1043.58, stdev=1182.50, samples=19 00:33:58.604 iops : min= 3, max= 672, avg=260.84, stdev=295.64, samples=19 00:33:58.604 lat (msec) : 20=0.64%, 50=87.89%, 250=2.33%, 500=7.22%, 750=1.36% 00:33:58.604 lat (msec) : 1000=0.56% 00:33:58.604 cpu : usr=99.07%, sys=0.46%, ctx=48, majf=0, minf=31 00:33:58.604 IO depths : 1=4.3%, 2=10.6%, 4=25.0%, 8=51.9%, 16=8.1%, 32=0.0%, >=64=0.0% 00:33:58.604 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:58.604 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:58.604 issued rwts: total=2494,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:33:58.604 latency : target=0, window=0, percentile=100.00%, depth=16 00:33:58.604 filename1: (groupid=0, jobs=1): err= 0: pid=3321613: Tue Nov 26 19:20:13 2024 00:33:58.604 read: IOPS=254, BW=1017KiB/s (1042kB/s)(10.1MiB/10151msec) 00:33:58.604 slat (usec): min=6, max=106, avg=33.85, stdev=22.77 00:33:58.604 clat (msec): min=2, max=514, avg=62.22, stdev=110.12 00:33:58.604 lat (msec): min=2, max=514, avg=62.26, stdev=110.11 00:33:58.604 clat percentiles (msec): 00:33:58.604 | 1.00th=[ 5], 5.00th=[ 23], 10.00th=[ 24], 20.00th=[ 24], 00:33:58.604 | 30.00th=[ 24], 40.00th=[ 24], 50.00th=[ 24], 60.00th=[ 25], 00:33:58.604 | 70.00th=[ 25], 80.00th=[ 26], 90.00th=[ 275], 95.00th=[ 380], 00:33:58.604 | 99.00th=[ 418], 99.50th=[ 418], 99.90th=[ 481], 99.95th=[ 514], 00:33:58.604 | 99.99th=[ 514] 00:33:58.604 bw ( KiB/s): min= 128, max= 3072, per=4.36%, avg=1026.40, stdev=1206.38, samples=20 00:33:58.604 iops : min= 32, max= 768, avg=256.60, stdev=301.60, samples=20 00:33:58.604 lat (msec) : 4=0.89%, 10=0.97%, 20=2.01%, 50=84.74%, 250=0.54% 00:33:58.604 lat (msec) : 500=10.77%, 750=0.08% 00:33:58.604 cpu : usr=99.00%, sys=0.62%, ctx=25, majf=0, minf=23 00:33:58.604 IO depths : 1=4.5%, 2=10.3%, 4=23.5%, 8=53.7%, 16=8.0%, 32=0.0%, >=64=0.0% 00:33:58.604 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:58.604 complete : 0=0.0%, 4=93.7%, 8=0.5%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:58.604 issued rwts: total=2582,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:33:58.604 latency : target=0, window=0, percentile=100.00%, depth=16 00:33:58.604 filename1: (groupid=0, jobs=1): err= 0: pid=3321614: Tue Nov 26 19:20:13 2024 00:33:58.604 read: IOPS=245, BW=983KiB/s (1006kB/s)(9944KiB/10120msec) 00:33:58.604 slat (usec): min=6, max=103, avg=38.86, stdev=20.76 00:33:58.604 clat (msec): min=11, max=793, avg=64.66, stdev=124.35 00:33:58.604 lat (msec): min=11, max=793, avg=64.70, stdev=124.34 00:33:58.604 clat percentiles (msec): 00:33:58.604 | 1.00th=[ 16], 5.00th=[ 23], 10.00th=[ 23], 20.00th=[ 24], 00:33:58.604 | 30.00th=[ 24], 40.00th=[ 24], 50.00th=[ 24], 60.00th=[ 25], 00:33:58.604 | 70.00th=[ 25], 80.00th=[ 26], 90.00th=[ 207], 95.00th=[ 393], 00:33:58.604 | 99.00th=[ 542], 99.50th=[ 584], 99.90th=[ 592], 99.95th=[ 793], 00:33:58.604 | 99.99th=[ 793] 00:33:58.604 bw ( KiB/s): min= 128, max= 2736, per=4.20%, avg=987.70, stdev=1185.88, samples=20 00:33:58.604 iops : min= 32, max= 684, avg=246.90, stdev=296.43, samples=20 00:33:58.604 lat (msec) : 20=4.02%, 50=85.68%, 250=0.48%, 500=6.84%, 750=2.90% 00:33:58.604 lat (msec) : 1000=0.08% 00:33:58.604 cpu : usr=99.12%, sys=0.47%, ctx=30, majf=0, minf=27 00:33:58.604 IO depths : 1=5.2%, 2=11.1%, 4=23.7%, 8=52.7%, 16=7.3%, 32=0.0%, >=64=0.0% 00:33:58.604 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:58.604 complete : 0=0.0%, 4=93.7%, 8=0.4%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:58.604 issued rwts: total=2486,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:33:58.604 latency : target=0, window=0, percentile=100.00%, depth=16 00:33:58.604 filename1: (groupid=0, jobs=1): err= 0: pid=3321615: Tue Nov 26 19:20:13 2024 00:33:58.604 read: IOPS=246, BW=987KiB/s (1011kB/s)(9.77MiB/10137msec) 00:33:58.604 slat (usec): min=6, max=142, avg=12.64, stdev= 6.63 00:33:58.604 clat (msec): min=9, max=580, avg=64.36, stdev=114.35 00:33:58.604 lat (msec): min=9, max=581, avg=64.37, stdev=114.35 00:33:58.604 clat percentiles (msec): 00:33:58.604 | 1.00th=[ 23], 5.00th=[ 24], 10.00th=[ 24], 20.00th=[ 24], 00:33:58.604 | 30.00th=[ 24], 40.00th=[ 25], 50.00th=[ 25], 60.00th=[ 25], 00:33:58.604 | 70.00th=[ 26], 80.00th=[ 26], 90.00th=[ 342], 95.00th=[ 384], 00:33:58.604 | 99.00th=[ 460], 99.50th=[ 460], 99.90th=[ 510], 99.95th=[ 584], 00:33:58.604 | 99.99th=[ 584] 00:33:58.604 bw ( KiB/s): min= 128, max= 2688, per=4.23%, avg=994.40, stdev=1172.57, samples=20 00:33:58.604 iops : min= 32, max= 672, avg=248.55, stdev=293.09, samples=20 00:33:58.604 lat (msec) : 10=0.08%, 20=0.72%, 50=88.09%, 250=0.24%, 500=10.71% 00:33:58.604 lat (msec) : 750=0.16% 00:33:58.604 cpu : usr=98.88%, sys=0.67%, ctx=68, majf=0, minf=31 00:33:58.604 IO depths : 1=5.4%, 2=11.3%, 4=23.8%, 8=52.4%, 16=7.1%, 32=0.0%, >=64=0.0% 00:33:58.604 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:58.604 complete : 0=0.0%, 4=93.8%, 8=0.4%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:58.604 issued rwts: total=2502,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:33:58.604 latency : target=0, window=0, percentile=100.00%, depth=16 00:33:58.604 filename1: (groupid=0, jobs=1): err= 0: pid=3321616: Tue Nov 26 19:20:13 2024 00:33:58.604 read: IOPS=237, BW=949KiB/s (972kB/s)(9600KiB/10112msec) 00:33:58.604 slat (usec): min=5, max=102, avg=40.63, stdev=20.32 00:33:58.604 clat (msec): min=21, max=685, avg=67.02, stdev=142.18 00:33:58.604 lat (msec): min=21, max=685, avg=67.06, stdev=142.18 00:33:58.604 clat percentiles (msec): 00:33:58.604 | 1.00th=[ 23], 5.00th=[ 23], 10.00th=[ 24], 20.00th=[ 24], 00:33:58.604 | 30.00th=[ 24], 40.00th=[ 24], 50.00th=[ 24], 60.00th=[ 25], 00:33:58.604 | 70.00th=[ 25], 80.00th=[ 26], 90.00th=[ 27], 95.00th=[ 514], 00:33:58.604 | 99.00th=[ 651], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], 00:33:58.604 | 99.99th=[ 684] 00:33:58.604 bw ( KiB/s): min= 128, max= 2688, per=4.26%, avg=1003.79, stdev=1187.99, samples=19 00:33:58.604 iops : min= 32, max= 672, avg=250.95, stdev=297.00, samples=19 00:33:58.604 lat (msec) : 50=91.33%, 500=2.67%, 750=6.00% 00:33:58.604 cpu : usr=99.17%, sys=0.41%, ctx=39, majf=0, minf=22 00:33:58.604 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:33:58.604 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:58.604 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:58.604 issued rwts: total=2400,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:33:58.604 latency : target=0, window=0, percentile=100.00%, depth=16 00:33:58.604 filename1: (groupid=0, jobs=1): err= 0: pid=3321617: Tue Nov 26 19:20:13 2024 00:33:58.604 read: IOPS=239, BW=959KiB/s (982kB/s)(9696KiB/10113msec) 00:33:58.604 slat (nsec): min=5491, max=86289, avg=33094.92, stdev=18457.32 00:33:58.604 clat (msec): min=15, max=805, avg=66.47, stdev=144.67 00:33:58.604 lat (msec): min=15, max=805, avg=66.50, stdev=144.66 00:33:58.604 clat percentiles (msec): 00:33:58.604 | 1.00th=[ 17], 5.00th=[ 23], 10.00th=[ 23], 20.00th=[ 24], 00:33:58.604 | 30.00th=[ 24], 40.00th=[ 24], 50.00th=[ 25], 60.00th=[ 25], 00:33:58.604 | 70.00th=[ 25], 80.00th=[ 26], 90.00th=[ 32], 95.00th=[ 510], 00:33:58.604 | 99.00th=[ 684], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 802], 00:33:58.604 | 99.99th=[ 802] 00:33:58.604 bw ( KiB/s): min= 16, max= 2720, per=4.09%, avg=963.20, stdev=1186.96, samples=20 00:33:58.604 iops : min= 4, max= 680, avg=240.80, stdev=296.74, samples=20 00:33:58.604 lat (msec) : 20=2.23%, 50=88.94%, 250=1.32%, 500=2.31%, 750=4.29% 00:33:58.604 lat (msec) : 1000=0.91% 00:33:58.604 cpu : usr=98.72%, sys=0.82%, ctx=32, majf=0, minf=28 00:33:58.604 IO depths : 1=4.4%, 2=9.2%, 4=19.3%, 8=57.9%, 16=9.2%, 32=0.0%, >=64=0.0% 00:33:58.604 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:58.604 complete : 0=0.0%, 4=92.9%, 8=2.5%, 16=4.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:58.604 issued rwts: total=2424,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:33:58.604 latency : target=0, window=0, percentile=100.00%, depth=16 00:33:58.604 filename1: (groupid=0, jobs=1): err= 0: pid=3321618: Tue Nov 26 19:20:13 2024 00:33:58.604 read: IOPS=249, BW=997KiB/s (1021kB/s)(9.87MiB/10137msec) 00:33:58.604 slat (nsec): min=6210, max=94611, avg=33432.76, stdev=17844.09 00:33:58.604 clat (msec): min=16, max=508, avg=63.87, stdev=110.78 00:33:58.604 lat (msec): min=16, max=508, avg=63.90, stdev=110.77 00:33:58.604 clat percentiles (msec): 00:33:58.604 | 1.00th=[ 23], 5.00th=[ 23], 10.00th=[ 24], 20.00th=[ 24], 00:33:58.604 | 30.00th=[ 24], 40.00th=[ 24], 50.00th=[ 25], 60.00th=[ 25], 00:33:58.604 | 70.00th=[ 25], 80.00th=[ 26], 90.00th=[ 275], 95.00th=[ 384], 00:33:58.604 | 99.00th=[ 418], 99.50th=[ 418], 99.90th=[ 418], 99.95th=[ 510], 00:33:58.604 | 99.99th=[ 510] 00:33:58.604 bw ( KiB/s): min= 128, max= 2688, per=4.26%, avg=1003.75, stdev=1165.46, samples=20 00:33:58.604 iops : min= 32, max= 672, avg=250.90, stdev=291.33, samples=20 00:33:58.604 lat (msec) : 20=0.63%, 50=87.41%, 250=1.82%, 500=10.06%, 750=0.08% 00:33:58.604 cpu : usr=98.34%, sys=0.93%, ctx=221, majf=0, minf=33 00:33:58.604 IO depths : 1=6.1%, 2=12.3%, 4=25.0%, 8=50.2%, 16=6.4%, 32=0.0%, >=64=0.0% 00:33:58.604 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:58.604 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:58.604 issued rwts: total=2526,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:33:58.604 latency : target=0, window=0, percentile=100.00%, depth=16 00:33:58.604 filename1: (groupid=0, jobs=1): err= 0: pid=3321619: Tue Nov 26 19:20:13 2024 00:33:58.604 read: IOPS=244, BW=979KiB/s (1003kB/s)(9920KiB/10130msec) 00:33:58.604 slat (nsec): min=6308, max=73902, avg=16568.49, stdev=6534.28 00:33:58.604 clat (msec): min=11, max=578, avg=64.97, stdev=116.62 00:33:58.604 lat (msec): min=11, max=578, avg=64.98, stdev=116.62 00:33:58.604 clat percentiles (msec): 00:33:58.604 | 1.00th=[ 23], 5.00th=[ 24], 10.00th=[ 24], 20.00th=[ 24], 00:33:58.604 | 30.00th=[ 24], 40.00th=[ 25], 50.00th=[ 25], 60.00th=[ 25], 00:33:58.604 | 70.00th=[ 25], 80.00th=[ 26], 90.00th=[ 359], 95.00th=[ 384], 00:33:58.604 | 99.00th=[ 460], 99.50th=[ 506], 99.90th=[ 527], 99.95th=[ 575], 00:33:58.604 | 99.99th=[ 575] 00:33:58.604 bw ( KiB/s): min= 127, max= 2688, per=4.19%, avg=985.50, stdev=1165.61, samples=20 00:33:58.604 iops : min= 31, max= 672, avg=246.30, stdev=291.38, samples=20 00:33:58.604 lat (msec) : 20=0.08%, 50=88.95%, 500=10.24%, 750=0.73% 00:33:58.604 cpu : usr=98.96%, sys=0.69%, ctx=16, majf=0, minf=26 00:33:58.604 IO depths : 1=5.7%, 2=11.9%, 4=25.0%, 8=50.6%, 16=6.8%, 32=0.0%, >=64=0.0% 00:33:58.605 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:58.605 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:58.605 issued rwts: total=2480,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:33:58.605 latency : target=0, window=0, percentile=100.00%, depth=16 00:33:58.605 filename2: (groupid=0, jobs=1): err= 0: pid=3321620: Tue Nov 26 19:20:13 2024 00:33:58.605 read: IOPS=246, BW=985KiB/s (1008kB/s)(9984KiB/10138msec) 00:33:58.605 slat (nsec): min=6194, max=88343, avg=30189.30, stdev=14930.68 00:33:58.605 clat (msec): min=16, max=583, avg=64.57, stdev=117.67 00:33:58.605 lat (msec): min=16, max=583, avg=64.60, stdev=117.66 00:33:58.605 clat percentiles (msec): 00:33:58.605 | 1.00th=[ 20], 5.00th=[ 23], 10.00th=[ 24], 20.00th=[ 24], 00:33:58.605 | 30.00th=[ 24], 40.00th=[ 24], 50.00th=[ 25], 60.00th=[ 25], 00:33:58.605 | 70.00th=[ 25], 80.00th=[ 26], 90.00th=[ 279], 95.00th=[ 384], 00:33:58.605 | 99.00th=[ 506], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 584], 00:33:58.605 | 99.99th=[ 584] 00:33:58.605 bw ( KiB/s): min= 128, max= 2688, per=4.21%, avg=991.75, stdev=1173.86, samples=20 00:33:58.605 iops : min= 32, max= 672, avg=247.90, stdev=293.43, samples=20 00:33:58.605 lat (msec) : 20=1.12%, 50=87.98%, 500=9.54%, 750=1.36% 00:33:58.605 cpu : usr=99.02%, sys=0.59%, ctx=37, majf=0, minf=31 00:33:58.605 IO depths : 1=5.4%, 2=11.4%, 4=24.2%, 8=52.0%, 16=7.1%, 32=0.0%, >=64=0.0% 00:33:58.605 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:58.605 complete : 0=0.0%, 4=93.9%, 8=0.3%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:58.605 issued rwts: total=2496,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:33:58.605 latency : target=0, window=0, percentile=100.00%, depth=16 00:33:58.605 filename2: (groupid=0, jobs=1): err= 0: pid=3321621: Tue Nov 26 19:20:13 2024 00:33:58.605 read: IOPS=245, BW=982KiB/s (1006kB/s)(9920KiB/10098msec) 00:33:58.605 slat (nsec): min=4857, max=80864, avg=23004.55, stdev=12067.56 00:33:58.605 clat (msec): min=19, max=522, avg=64.95, stdev=119.58 00:33:58.605 lat (msec): min=19, max=522, avg=64.98, stdev=119.59 00:33:58.605 clat percentiles (msec): 00:33:58.605 | 1.00th=[ 21], 5.00th=[ 24], 10.00th=[ 24], 20.00th=[ 24], 00:33:58.605 | 30.00th=[ 24], 40.00th=[ 24], 50.00th=[ 25], 60.00th=[ 25], 00:33:58.605 | 70.00th=[ 26], 80.00th=[ 26], 90.00th=[ 279], 95.00th=[ 393], 00:33:58.605 | 99.00th=[ 510], 99.50th=[ 523], 99.90th=[ 523], 99.95th=[ 523], 00:33:58.605 | 99.99th=[ 523] 00:33:58.605 bw ( KiB/s): min= 127, max= 2688, per=4.19%, avg=985.55, stdev=1176.92, samples=20 00:33:58.605 iops : min= 31, max= 672, avg=246.35, stdev=294.26, samples=20 00:33:58.605 lat (msec) : 20=0.89%, 50=88.15%, 250=0.65%, 500=8.39%, 750=1.94% 00:33:58.605 cpu : usr=99.12%, sys=0.52%, ctx=15, majf=0, minf=20 00:33:58.605 IO depths : 1=4.9%, 2=11.1%, 4=25.0%, 8=51.4%, 16=7.6%, 32=0.0%, >=64=0.0% 00:33:58.605 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:58.605 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:58.605 issued rwts: total=2480,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:33:58.605 latency : target=0, window=0, percentile=100.00%, depth=16 00:33:58.605 filename2: (groupid=0, jobs=1): err= 0: pid=3321622: Tue Nov 26 19:20:13 2024 00:33:58.605 read: IOPS=245, BW=982KiB/s (1005kB/s)(9928KiB/10112msec) 00:33:58.605 slat (nsec): min=5665, max=92598, avg=31260.35, stdev=18629.26 00:33:58.605 clat (msec): min=8, max=601, avg=64.93, stdev=121.20 00:33:58.605 lat (msec): min=8, max=601, avg=64.96, stdev=121.19 00:33:58.605 clat percentiles (msec): 00:33:58.605 | 1.00th=[ 16], 5.00th=[ 23], 10.00th=[ 23], 20.00th=[ 24], 00:33:58.605 | 30.00th=[ 24], 40.00th=[ 24], 50.00th=[ 25], 60.00th=[ 25], 00:33:58.605 | 70.00th=[ 26], 80.00th=[ 26], 90.00th=[ 201], 95.00th=[ 384], 00:33:58.605 | 99.00th=[ 592], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], 00:33:58.605 | 99.99th=[ 600] 00:33:58.605 bw ( KiB/s): min= 128, max= 2736, per=4.19%, avg=986.40, stdev=1168.35, samples=20 00:33:58.605 iops : min= 32, max= 684, avg=246.60, stdev=292.09, samples=20 00:33:58.605 lat (msec) : 10=0.32%, 20=1.37%, 50=87.11%, 250=1.53%, 500=7.33% 00:33:58.605 lat (msec) : 750=2.34% 00:33:58.605 cpu : usr=98.79%, sys=0.80%, ctx=38, majf=0, minf=34 00:33:58.605 IO depths : 1=4.3%, 2=8.9%, 4=18.6%, 8=58.7%, 16=9.5%, 32=0.0%, >=64=0.0% 00:33:58.605 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:58.605 complete : 0=0.0%, 4=92.7%, 8=2.8%, 16=4.5%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:58.605 issued rwts: total=2482,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:33:58.605 latency : target=0, window=0, percentile=100.00%, depth=16 00:33:58.605 filename2: (groupid=0, jobs=1): err= 0: pid=3321623: Tue Nov 26 19:20:13 2024 00:33:58.605 read: IOPS=255, BW=1021KiB/s (1045kB/s)(10.1MiB/10151msec) 00:33:58.605 slat (nsec): min=6356, max=91706, avg=28143.80, stdev=15729.59 00:33:58.605 clat (msec): min=2, max=497, avg=62.42, stdev=109.60 00:33:58.605 lat (msec): min=2, max=497, avg=62.45, stdev=109.60 00:33:58.605 clat percentiles (msec): 00:33:58.605 | 1.00th=[ 5], 5.00th=[ 23], 10.00th=[ 24], 20.00th=[ 24], 00:33:58.605 | 30.00th=[ 24], 40.00th=[ 24], 50.00th=[ 25], 60.00th=[ 25], 00:33:58.605 | 70.00th=[ 25], 80.00th=[ 26], 90.00th=[ 275], 95.00th=[ 384], 00:33:58.605 | 99.00th=[ 418], 99.50th=[ 418], 99.90th=[ 422], 99.95th=[ 498], 00:33:58.605 | 99.99th=[ 498] 00:33:58.605 bw ( KiB/s): min= 128, max= 3072, per=4.37%, avg=1029.60, stdev=1204.35, samples=20 00:33:58.605 iops : min= 32, max= 768, avg=257.40, stdev=301.09, samples=20 00:33:58.605 lat (msec) : 4=0.97%, 10=0.89%, 20=1.93%, 50=84.56%, 250=1.62% 00:33:58.605 lat (msec) : 500=10.04% 00:33:58.605 cpu : usr=98.63%, sys=0.87%, ctx=54, majf=0, minf=31 00:33:58.605 IO depths : 1=5.4%, 2=11.5%, 4=24.7%, 8=51.3%, 16=7.1%, 32=0.0%, >=64=0.0% 00:33:58.605 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:58.605 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:58.605 issued rwts: total=2590,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:33:58.605 latency : target=0, window=0, percentile=100.00%, depth=16 00:33:58.605 filename2: (groupid=0, jobs=1): err= 0: pid=3321624: Tue Nov 26 19:20:13 2024 00:33:58.605 read: IOPS=246, BW=984KiB/s (1008kB/s)(9976KiB/10134msec) 00:33:58.605 slat (nsec): min=5451, max=87944, avg=22805.33, stdev=12503.73 00:33:58.605 clat (msec): min=17, max=507, avg=64.76, stdev=116.74 00:33:58.605 lat (msec): min=17, max=508, avg=64.78, stdev=116.74 00:33:58.605 clat percentiles (msec): 00:33:58.605 | 1.00th=[ 21], 5.00th=[ 24], 10.00th=[ 24], 20.00th=[ 24], 00:33:58.605 | 30.00th=[ 24], 40.00th=[ 24], 50.00th=[ 25], 60.00th=[ 25], 00:33:58.605 | 70.00th=[ 26], 80.00th=[ 26], 90.00th=[ 279], 95.00th=[ 388], 00:33:58.605 | 99.00th=[ 506], 99.50th=[ 506], 99.90th=[ 510], 99.95th=[ 510], 00:33:58.605 | 99.99th=[ 510] 00:33:58.605 bw ( KiB/s): min= 127, max= 2688, per=4.21%, avg=991.40, stdev=1173.24, samples=20 00:33:58.605 iops : min= 31, max= 672, avg=247.80, stdev=293.32, samples=20 00:33:58.605 lat (msec) : 20=0.64%, 50=87.89%, 250=1.20%, 500=8.90%, 750=1.36% 00:33:58.605 cpu : usr=98.96%, sys=0.64%, ctx=34, majf=0, minf=33 00:33:58.605 IO depths : 1=4.9%, 2=11.1%, 4=25.0%, 8=51.4%, 16=7.6%, 32=0.0%, >=64=0.0% 00:33:58.605 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:58.605 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:58.605 issued rwts: total=2494,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:33:58.605 latency : target=0, window=0, percentile=100.00%, depth=16 00:33:58.605 filename2: (groupid=0, jobs=1): err= 0: pid=3321625: Tue Nov 26 19:20:13 2024 00:33:58.605 read: IOPS=245, BW=983KiB/s (1007kB/s)(9968KiB/10138msec) 00:33:58.605 slat (usec): min=6, max=119, avg=38.33, stdev=18.73 00:33:58.605 clat (msec): min=16, max=669, avg=64.61, stdev=120.84 00:33:58.605 lat (msec): min=16, max=669, avg=64.64, stdev=120.83 00:33:58.605 clat percentiles (msec): 00:33:58.605 | 1.00th=[ 23], 5.00th=[ 23], 10.00th=[ 24], 20.00th=[ 24], 00:33:58.605 | 30.00th=[ 24], 40.00th=[ 24], 50.00th=[ 24], 60.00th=[ 25], 00:33:58.605 | 70.00th=[ 25], 80.00th=[ 26], 90.00th=[ 253], 95.00th=[ 384], 00:33:58.605 | 99.00th=[ 542], 99.50th=[ 592], 99.90th=[ 642], 99.95th=[ 667], 00:33:58.605 | 99.99th=[ 667] 00:33:58.605 bw ( KiB/s): min= 64, max= 2688, per=4.21%, avg=990.15, stdev=1175.40, samples=20 00:33:58.605 iops : min= 16, max= 672, avg=247.50, stdev=293.82, samples=20 00:33:58.605 lat (msec) : 20=0.64%, 50=88.60%, 250=0.40%, 500=8.35%, 750=2.01% 00:33:58.605 cpu : usr=98.76%, sys=0.73%, ctx=43, majf=0, minf=32 00:33:58.605 IO depths : 1=5.8%, 2=11.6%, 4=23.8%, 8=52.0%, 16=6.7%, 32=0.0%, >=64=0.0% 00:33:58.605 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:58.605 complete : 0=0.0%, 4=93.7%, 8=0.5%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:58.605 issued rwts: total=2492,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:33:58.605 latency : target=0, window=0, percentile=100.00%, depth=16 00:33:58.605 filename2: (groupid=0, jobs=1): err= 0: pid=3321626: Tue Nov 26 19:20:13 2024 00:33:58.605 read: IOPS=243, BW=974KiB/s (997kB/s)(9856KiB/10124msec) 00:33:58.605 slat (nsec): min=6576, max=83085, avg=18436.84, stdev=10394.26 00:33:58.605 clat (msec): min=20, max=617, avg=65.37, stdev=121.88 00:33:58.605 lat (msec): min=20, max=617, avg=65.39, stdev=121.88 00:33:58.605 clat percentiles (msec): 00:33:58.605 | 1.00th=[ 22], 5.00th=[ 24], 10.00th=[ 24], 20.00th=[ 24], 00:33:58.605 | 30.00th=[ 24], 40.00th=[ 25], 50.00th=[ 25], 60.00th=[ 25], 00:33:58.605 | 70.00th=[ 25], 80.00th=[ 26], 90.00th=[ 368], 95.00th=[ 393], 00:33:58.605 | 99.00th=[ 510], 99.50th=[ 523], 99.90th=[ 567], 99.95th=[ 617], 00:33:58.605 | 99.99th=[ 617] 00:33:58.605 bw ( KiB/s): min= 127, max= 2688, per=4.16%, avg=978.85, stdev=1169.90, samples=20 00:33:58.605 iops : min= 31, max= 672, avg=244.65, stdev=292.46, samples=20 00:33:58.605 lat (msec) : 50=89.61%, 250=0.08%, 500=8.28%, 750=2.03% 00:33:58.605 cpu : usr=98.84%, sys=0.76%, ctx=21, majf=0, minf=29 00:33:58.605 IO depths : 1=6.0%, 2=12.2%, 4=25.0%, 8=50.3%, 16=6.5%, 32=0.0%, >=64=0.0% 00:33:58.605 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:58.605 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:58.605 issued rwts: total=2464,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:33:58.605 latency : target=0, window=0, percentile=100.00%, depth=16 00:33:58.605 filename2: (groupid=0, jobs=1): err= 0: pid=3321627: Tue Nov 26 19:20:13 2024 00:33:58.605 read: IOPS=242, BW=971KiB/s (994kB/s)(9816KiB/10112msec) 00:33:58.605 slat (usec): min=6, max=157, avg=43.54, stdev=26.11 00:33:58.605 clat (msec): min=21, max=601, avg=65.37, stdev=122.65 00:33:58.605 lat (msec): min=21, max=601, avg=65.42, stdev=122.64 00:33:58.605 clat percentiles (msec): 00:33:58.605 | 1.00th=[ 23], 5.00th=[ 23], 10.00th=[ 24], 20.00th=[ 24], 00:33:58.606 | 30.00th=[ 24], 40.00th=[ 24], 50.00th=[ 24], 60.00th=[ 25], 00:33:58.606 | 70.00th=[ 25], 80.00th=[ 26], 90.00th=[ 275], 95.00th=[ 393], 00:33:58.606 | 99.00th=[ 542], 99.50th=[ 584], 99.90th=[ 592], 99.95th=[ 600], 00:33:58.606 | 99.99th=[ 600] 00:33:58.606 bw ( KiB/s): min= 128, max= 2688, per=4.14%, avg=975.45, stdev=1162.16, samples=20 00:33:58.606 iops : min= 32, max= 672, avg=243.85, stdev=290.52, samples=20 00:33:58.606 lat (msec) : 50=89.32%, 250=0.41%, 500=7.74%, 750=2.53% 00:33:58.606 cpu : usr=99.07%, sys=0.54%, ctx=48, majf=0, minf=27 00:33:58.606 IO depths : 1=5.7%, 2=11.8%, 4=24.3%, 8=51.4%, 16=6.8%, 32=0.0%, >=64=0.0% 00:33:58.606 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:58.606 complete : 0=0.0%, 4=93.9%, 8=0.3%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:58.606 issued rwts: total=2454,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:33:58.606 latency : target=0, window=0, percentile=100.00%, depth=16 00:33:58.606 00:33:58.606 Run status group 0 (all jobs): 00:33:58.606 READ: bw=23.0MiB/s (24.1MB/s), 949KiB/s-1024KiB/s (972kB/s-1048kB/s), io=233MiB (245MB), run=10089-10153msec 00:33:58.606 19:20:13 -- target/dif.sh@113 -- # destroy_subsystems 0 1 2 00:33:58.606 19:20:13 -- target/dif.sh@43 -- # local sub 00:33:58.606 19:20:13 -- target/dif.sh@45 -- # for sub in "$@" 00:33:58.606 19:20:13 -- target/dif.sh@46 -- # destroy_subsystem 0 00:33:58.606 19:20:13 -- target/dif.sh@36 -- # local sub_id=0 00:33:58.606 19:20:13 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:33:58.606 19:20:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:58.606 19:20:13 -- common/autotest_common.sh@10 -- # set +x 00:33:58.606 19:20:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:58.606 19:20:13 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:33:58.606 19:20:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:58.606 19:20:13 -- common/autotest_common.sh@10 -- # set +x 00:33:58.606 19:20:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:58.606 19:20:13 -- target/dif.sh@45 -- # for sub in "$@" 00:33:58.606 19:20:13 -- target/dif.sh@46 -- # destroy_subsystem 1 00:33:58.606 19:20:13 -- target/dif.sh@36 -- # local sub_id=1 00:33:58.606 19:20:13 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:33:58.606 19:20:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:58.606 19:20:13 -- common/autotest_common.sh@10 -- # set +x 00:33:58.606 19:20:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:58.606 19:20:13 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:33:58.606 19:20:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:58.606 19:20:13 -- common/autotest_common.sh@10 -- # set +x 00:33:58.606 19:20:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:58.606 19:20:13 -- target/dif.sh@45 -- # for sub in "$@" 00:33:58.606 19:20:13 -- target/dif.sh@46 -- # destroy_subsystem 2 00:33:58.606 19:20:13 -- target/dif.sh@36 -- # local sub_id=2 00:33:58.606 19:20:13 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:33:58.606 19:20:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:58.606 19:20:13 -- common/autotest_common.sh@10 -- # set +x 00:33:58.606 19:20:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:58.606 19:20:13 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null2 00:33:58.606 19:20:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:58.606 19:20:13 -- common/autotest_common.sh@10 -- # set +x 00:33:58.606 19:20:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:58.606 19:20:13 -- target/dif.sh@115 -- # NULL_DIF=1 00:33:58.606 19:20:13 -- target/dif.sh@115 -- # bs=8k,16k,128k 00:33:58.606 19:20:13 -- target/dif.sh@115 -- # numjobs=2 00:33:58.606 19:20:13 -- target/dif.sh@115 -- # iodepth=8 00:33:58.606 19:20:13 -- target/dif.sh@115 -- # runtime=5 00:33:58.606 19:20:13 -- target/dif.sh@115 -- # files=1 00:33:58.606 19:20:13 -- target/dif.sh@117 -- # create_subsystems 0 1 00:33:58.606 19:20:13 -- target/dif.sh@28 -- # local sub 00:33:58.606 19:20:13 -- target/dif.sh@30 -- # for sub in "$@" 00:33:58.606 19:20:13 -- target/dif.sh@31 -- # create_subsystem 0 00:33:58.606 19:20:13 -- target/dif.sh@18 -- # local sub_id=0 00:33:58.606 19:20:13 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:33:58.606 19:20:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:58.606 19:20:13 -- common/autotest_common.sh@10 -- # set +x 00:33:58.606 bdev_null0 00:33:58.606 19:20:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:58.606 19:20:13 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:33:58.606 19:20:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:58.606 19:20:13 -- common/autotest_common.sh@10 -- # set +x 00:33:58.606 19:20:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:58.606 19:20:13 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:33:58.606 19:20:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:58.606 19:20:13 -- common/autotest_common.sh@10 -- # set +x 00:33:58.606 19:20:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:58.606 19:20:13 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:33:58.606 19:20:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:58.606 19:20:13 -- common/autotest_common.sh@10 -- # set +x 00:33:58.606 [2024-11-26 19:20:13.607660] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:33:58.606 19:20:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:58.606 19:20:13 -- target/dif.sh@30 -- # for sub in "$@" 00:33:58.606 19:20:13 -- target/dif.sh@31 -- # create_subsystem 1 00:33:58.606 19:20:13 -- target/dif.sh@18 -- # local sub_id=1 00:33:58.606 19:20:13 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:33:58.606 19:20:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:58.606 19:20:13 -- common/autotest_common.sh@10 -- # set +x 00:33:58.606 bdev_null1 00:33:58.606 19:20:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:58.606 19:20:13 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:33:58.606 19:20:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:58.606 19:20:13 -- common/autotest_common.sh@10 -- # set +x 00:33:58.606 19:20:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:58.606 19:20:13 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:33:58.606 19:20:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:58.606 19:20:13 -- common/autotest_common.sh@10 -- # set +x 00:33:58.606 19:20:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:58.606 19:20:13 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:33:58.606 19:20:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:58.606 19:20:13 -- common/autotest_common.sh@10 -- # set +x 00:33:58.606 19:20:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:58.606 19:20:13 -- target/dif.sh@118 -- # fio /dev/fd/62 00:33:58.606 19:20:13 -- target/dif.sh@118 -- # create_json_sub_conf 0 1 00:33:58.606 19:20:13 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:33:58.606 19:20:13 -- nvmf/common.sh@520 -- # config=() 00:33:58.606 19:20:13 -- nvmf/common.sh@520 -- # local subsystem config 00:33:58.606 19:20:13 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:33:58.606 19:20:13 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:33:58.606 19:20:13 -- target/dif.sh@82 -- # gen_fio_conf 00:33:58.606 19:20:13 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:33:58.606 { 00:33:58.606 "params": { 00:33:58.606 "name": "Nvme$subsystem", 00:33:58.606 "trtype": "$TEST_TRANSPORT", 00:33:58.606 "traddr": "$NVMF_FIRST_TARGET_IP", 00:33:58.606 "adrfam": "ipv4", 00:33:58.606 "trsvcid": "$NVMF_PORT", 00:33:58.606 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:33:58.606 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:33:58.606 "hdgst": ${hdgst:-false}, 00:33:58.606 "ddgst": ${ddgst:-false} 00:33:58.606 }, 00:33:58.606 "method": "bdev_nvme_attach_controller" 00:33:58.606 } 00:33:58.606 EOF 00:33:58.606 )") 00:33:58.606 19:20:13 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:33:58.606 19:20:13 -- target/dif.sh@54 -- # local file 00:33:58.606 19:20:13 -- target/dif.sh@56 -- # cat 00:33:58.606 19:20:13 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:33:58.606 19:20:13 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:33:58.606 19:20:13 -- common/autotest_common.sh@1328 -- # local sanitizers 00:33:58.606 19:20:13 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:33:58.606 19:20:13 -- common/autotest_common.sh@1330 -- # shift 00:33:58.606 19:20:13 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:33:58.606 19:20:13 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:33:58.606 19:20:13 -- nvmf/common.sh@542 -- # cat 00:33:58.606 19:20:13 -- target/dif.sh@72 -- # (( file = 1 )) 00:33:58.606 19:20:13 -- target/dif.sh@72 -- # (( file <= files )) 00:33:58.606 19:20:13 -- target/dif.sh@73 -- # cat 00:33:58.606 19:20:13 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:33:58.606 19:20:13 -- common/autotest_common.sh@1334 -- # grep libasan 00:33:58.606 19:20:13 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:33:58.606 19:20:13 -- target/dif.sh@72 -- # (( file++ )) 00:33:58.606 19:20:13 -- target/dif.sh@72 -- # (( file <= files )) 00:33:58.606 19:20:13 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:33:58.606 19:20:13 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:33:58.606 { 00:33:58.606 "params": { 00:33:58.606 "name": "Nvme$subsystem", 00:33:58.606 "trtype": "$TEST_TRANSPORT", 00:33:58.606 "traddr": "$NVMF_FIRST_TARGET_IP", 00:33:58.606 "adrfam": "ipv4", 00:33:58.606 "trsvcid": "$NVMF_PORT", 00:33:58.606 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:33:58.606 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:33:58.606 "hdgst": ${hdgst:-false}, 00:33:58.606 "ddgst": ${ddgst:-false} 00:33:58.606 }, 00:33:58.606 "method": "bdev_nvme_attach_controller" 00:33:58.606 } 00:33:58.606 EOF 00:33:58.606 )") 00:33:58.606 19:20:13 -- nvmf/common.sh@542 -- # cat 00:33:58.606 19:20:13 -- nvmf/common.sh@544 -- # jq . 00:33:58.606 19:20:13 -- nvmf/common.sh@545 -- # IFS=, 00:33:58.606 19:20:13 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:33:58.606 "params": { 00:33:58.607 "name": "Nvme0", 00:33:58.607 "trtype": "tcp", 00:33:58.607 "traddr": "10.0.0.2", 00:33:58.607 "adrfam": "ipv4", 00:33:58.607 "trsvcid": "4420", 00:33:58.607 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:33:58.607 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:33:58.607 "hdgst": false, 00:33:58.607 "ddgst": false 00:33:58.607 }, 00:33:58.607 "method": "bdev_nvme_attach_controller" 00:33:58.607 },{ 00:33:58.607 "params": { 00:33:58.607 "name": "Nvme1", 00:33:58.607 "trtype": "tcp", 00:33:58.607 "traddr": "10.0.0.2", 00:33:58.607 "adrfam": "ipv4", 00:33:58.607 "trsvcid": "4420", 00:33:58.607 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:33:58.607 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:33:58.607 "hdgst": false, 00:33:58.607 "ddgst": false 00:33:58.607 }, 00:33:58.607 "method": "bdev_nvme_attach_controller" 00:33:58.607 }' 00:33:58.607 19:20:13 -- common/autotest_common.sh@1334 -- # asan_lib= 00:33:58.607 19:20:13 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:33:58.607 19:20:13 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:33:58.607 19:20:13 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:33:58.607 19:20:13 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:33:58.607 19:20:13 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:33:58.607 19:20:13 -- common/autotest_common.sh@1334 -- # asan_lib= 00:33:58.607 19:20:13 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:33:58.607 19:20:13 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:33:58.607 19:20:13 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:33:58.607 filename0: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:33:58.607 ... 00:33:58.607 filename1: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:33:58.607 ... 00:33:58.607 fio-3.35 00:33:58.607 Starting 4 threads 00:33:58.607 EAL: No free 2048 kB hugepages reported on node 1 00:33:58.607 [2024-11-26 19:20:14.679182] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:33:58.607 [2024-11-26 19:20:14.679243] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:34:03.871 00:34:03.871 filename0: (groupid=0, jobs=1): err= 0: pid=3323610: Tue Nov 26 19:20:19 2024 00:34:03.871 read: IOPS=2810, BW=22.0MiB/s (23.0MB/s)(110MiB/5002msec) 00:34:03.871 slat (nsec): min=6088, max=37632, avg=8923.63, stdev=3062.29 00:34:03.871 clat (usec): min=873, max=4987, avg=2819.52, stdev=483.29 00:34:03.871 lat (usec): min=885, max=4997, avg=2828.44, stdev=483.10 00:34:03.871 clat percentiles (usec): 00:34:03.871 | 1.00th=[ 1713], 5.00th=[ 2147], 10.00th=[ 2245], 20.00th=[ 2442], 00:34:03.871 | 30.00th=[ 2638], 40.00th=[ 2737], 50.00th=[ 2835], 60.00th=[ 2900], 00:34:03.871 | 70.00th=[ 2933], 80.00th=[ 3032], 90.00th=[ 3294], 95.00th=[ 3851], 00:34:03.871 | 99.00th=[ 4359], 99.50th=[ 4555], 99.90th=[ 4817], 99.95th=[ 4883], 00:34:03.871 | 99.99th=[ 4948] 00:34:03.871 bw ( KiB/s): min=21488, max=23728, per=25.74%, avg=22364.44, stdev=726.58, samples=9 00:34:03.871 iops : min= 2686, max= 2966, avg=2795.56, stdev=90.82, samples=9 00:34:03.871 lat (usec) : 1000=0.01% 00:34:03.871 lat (msec) : 2=2.86%, 4=92.90%, 10=4.23% 00:34:03.871 cpu : usr=95.24%, sys=4.42%, ctx=9, majf=0, minf=78 00:34:03.871 IO depths : 1=0.2%, 2=4.3%, 4=67.6%, 8=27.9%, 16=0.0%, 32=0.0%, >=64=0.0% 00:34:03.871 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:34:03.871 complete : 0=0.0%, 4=92.7%, 8=7.3%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:34:03.871 issued rwts: total=14058,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:34:03.871 latency : target=0, window=0, percentile=100.00%, depth=8 00:34:03.872 filename0: (groupid=0, jobs=1): err= 0: pid=3323611: Tue Nov 26 19:20:19 2024 00:34:03.872 read: IOPS=2682, BW=21.0MiB/s (22.0MB/s)(105MiB/5002msec) 00:34:03.872 slat (nsec): min=6146, max=54288, avg=9144.74, stdev=3267.37 00:34:03.872 clat (usec): min=695, max=5215, avg=2956.70, stdev=437.97 00:34:03.872 lat (usec): min=706, max=5222, avg=2965.85, stdev=437.80 00:34:03.872 clat percentiles (usec): 00:34:03.872 | 1.00th=[ 2057], 5.00th=[ 2343], 10.00th=[ 2540], 20.00th=[ 2704], 00:34:03.872 | 30.00th=[ 2769], 40.00th=[ 2868], 50.00th=[ 2900], 60.00th=[ 2933], 00:34:03.872 | 70.00th=[ 2999], 80.00th=[ 3195], 90.00th=[ 3458], 95.00th=[ 3884], 00:34:03.872 | 99.00th=[ 4555], 99.50th=[ 4686], 99.90th=[ 5014], 99.95th=[ 5145], 00:34:03.872 | 99.99th=[ 5211] 00:34:03.872 bw ( KiB/s): min=20752, max=22320, per=24.75%, avg=21503.33, stdev=474.06, samples=9 00:34:03.872 iops : min= 2594, max= 2790, avg=2687.89, stdev=59.28, samples=9 00:34:03.872 lat (usec) : 750=0.01% 00:34:03.872 lat (msec) : 2=0.75%, 4=95.17%, 10=4.07% 00:34:03.872 cpu : usr=95.26%, sys=4.42%, ctx=10, majf=0, minf=114 00:34:03.872 IO depths : 1=0.1%, 2=3.3%, 4=67.9%, 8=28.7%, 16=0.0%, 32=0.0%, >=64=0.0% 00:34:03.872 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:34:03.872 complete : 0=0.0%, 4=93.3%, 8=6.7%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:34:03.872 issued rwts: total=13416,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:34:03.872 latency : target=0, window=0, percentile=100.00%, depth=8 00:34:03.872 filename1: (groupid=0, jobs=1): err= 0: pid=3323612: Tue Nov 26 19:20:19 2024 00:34:03.872 read: IOPS=2647, BW=20.7MiB/s (21.7MB/s)(103MiB/5001msec) 00:34:03.872 slat (nsec): min=6158, max=55871, avg=9083.39, stdev=3158.26 00:34:03.872 clat (usec): min=1122, max=5290, avg=2997.71, stdev=391.10 00:34:03.872 lat (usec): min=1134, max=5296, avg=3006.79, stdev=390.92 00:34:03.872 clat percentiles (usec): 00:34:03.872 | 1.00th=[ 2212], 5.00th=[ 2540], 10.00th=[ 2671], 20.00th=[ 2737], 00:34:03.872 | 30.00th=[ 2835], 40.00th=[ 2900], 50.00th=[ 2933], 60.00th=[ 2966], 00:34:03.872 | 70.00th=[ 3032], 80.00th=[ 3195], 90.00th=[ 3458], 95.00th=[ 3720], 00:34:03.872 | 99.00th=[ 4490], 99.50th=[ 4686], 99.90th=[ 5080], 99.95th=[ 5145], 00:34:03.872 | 99.99th=[ 5276] 00:34:03.872 bw ( KiB/s): min=20528, max=22528, per=24.45%, avg=21242.67, stdev=761.26, samples=9 00:34:03.872 iops : min= 2566, max= 2816, avg=2655.33, stdev=95.16, samples=9 00:34:03.872 lat (msec) : 2=0.49%, 4=96.24%, 10=3.27% 00:34:03.872 cpu : usr=95.60%, sys=4.10%, ctx=7, majf=0, minf=72 00:34:03.872 IO depths : 1=0.1%, 2=1.4%, 4=67.2%, 8=31.4%, 16=0.0%, 32=0.0%, >=64=0.0% 00:34:03.872 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:34:03.872 complete : 0=0.0%, 4=95.4%, 8=4.6%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:34:03.872 issued rwts: total=13242,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:34:03.872 latency : target=0, window=0, percentile=100.00%, depth=8 00:34:03.872 filename1: (groupid=0, jobs=1): err= 0: pid=3323613: Tue Nov 26 19:20:19 2024 00:34:03.872 read: IOPS=2724, BW=21.3MiB/s (22.3MB/s)(107MiB/5004msec) 00:34:03.872 slat (nsec): min=6138, max=56634, avg=9162.59, stdev=3184.39 00:34:03.872 clat (usec): min=669, max=5374, avg=2909.02, stdev=485.74 00:34:03.872 lat (usec): min=680, max=5385, avg=2918.18, stdev=485.62 00:34:03.872 clat percentiles (usec): 00:34:03.872 | 1.00th=[ 1909], 5.00th=[ 2245], 10.00th=[ 2376], 20.00th=[ 2606], 00:34:03.872 | 30.00th=[ 2704], 40.00th=[ 2802], 50.00th=[ 2868], 60.00th=[ 2933], 00:34:03.872 | 70.00th=[ 2966], 80.00th=[ 3130], 90.00th=[ 3523], 95.00th=[ 3982], 00:34:03.872 | 99.00th=[ 4490], 99.50th=[ 4686], 99.90th=[ 5014], 99.95th=[ 5080], 00:34:03.872 | 99.99th=[ 5342] 00:34:03.872 bw ( KiB/s): min=21344, max=22720, per=25.22%, avg=21918.22, stdev=458.69, samples=9 00:34:03.872 iops : min= 2668, max= 2840, avg=2739.78, stdev=57.34, samples=9 00:34:03.872 lat (usec) : 750=0.01%, 1000=0.02% 00:34:03.872 lat (msec) : 2=1.58%, 4=93.78%, 10=4.61% 00:34:03.872 cpu : usr=96.04%, sys=3.62%, ctx=7, majf=0, minf=114 00:34:03.872 IO depths : 1=0.1%, 2=3.0%, 4=67.8%, 8=29.1%, 16=0.0%, 32=0.0%, >=64=0.0% 00:34:03.872 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:34:03.872 complete : 0=0.0%, 4=93.8%, 8=6.2%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:34:03.872 issued rwts: total=13635,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:34:03.872 latency : target=0, window=0, percentile=100.00%, depth=8 00:34:03.872 00:34:03.872 Run status group 0 (all jobs): 00:34:03.872 READ: bw=84.9MiB/s (89.0MB/s), 20.7MiB/s-22.0MiB/s (21.7MB/s-23.0MB/s), io=425MiB (445MB), run=5001-5004msec 00:34:03.872 19:20:19 -- target/dif.sh@119 -- # destroy_subsystems 0 1 00:34:03.872 19:20:19 -- target/dif.sh@43 -- # local sub 00:34:03.872 19:20:19 -- target/dif.sh@45 -- # for sub in "$@" 00:34:03.872 19:20:19 -- target/dif.sh@46 -- # destroy_subsystem 0 00:34:03.872 19:20:19 -- target/dif.sh@36 -- # local sub_id=0 00:34:03.872 19:20:19 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:34:03.872 19:20:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:34:03.872 19:20:19 -- common/autotest_common.sh@10 -- # set +x 00:34:03.872 19:20:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:34:03.872 19:20:19 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:34:03.872 19:20:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:34:03.872 19:20:19 -- common/autotest_common.sh@10 -- # set +x 00:34:03.872 19:20:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:34:03.872 19:20:19 -- target/dif.sh@45 -- # for sub in "$@" 00:34:03.872 19:20:19 -- target/dif.sh@46 -- # destroy_subsystem 1 00:34:03.872 19:20:19 -- target/dif.sh@36 -- # local sub_id=1 00:34:03.872 19:20:19 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:34:03.872 19:20:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:34:03.872 19:20:19 -- common/autotest_common.sh@10 -- # set +x 00:34:03.872 19:20:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:34:03.872 19:20:19 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:34:03.872 19:20:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:34:03.872 19:20:19 -- common/autotest_common.sh@10 -- # set +x 00:34:03.872 19:20:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:34:03.872 00:34:03.872 real 0m24.294s 00:34:03.872 user 4m55.002s 00:34:03.872 sys 0m4.338s 00:34:03.872 19:20:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:34:03.872 19:20:20 -- common/autotest_common.sh@10 -- # set +x 00:34:03.872 ************************************ 00:34:03.872 END TEST fio_dif_rand_params 00:34:03.872 ************************************ 00:34:03.872 19:20:20 -- target/dif.sh@144 -- # run_test fio_dif_digest fio_dif_digest 00:34:03.872 19:20:20 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:34:03.872 19:20:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:34:03.872 19:20:20 -- common/autotest_common.sh@10 -- # set +x 00:34:03.872 ************************************ 00:34:03.872 START TEST fio_dif_digest 00:34:03.872 ************************************ 00:34:03.872 19:20:20 -- common/autotest_common.sh@1114 -- # fio_dif_digest 00:34:03.872 19:20:20 -- target/dif.sh@123 -- # local NULL_DIF 00:34:03.872 19:20:20 -- target/dif.sh@124 -- # local bs numjobs runtime iodepth files 00:34:03.872 19:20:20 -- target/dif.sh@125 -- # local hdgst ddgst 00:34:03.872 19:20:20 -- target/dif.sh@127 -- # NULL_DIF=3 00:34:03.872 19:20:20 -- target/dif.sh@127 -- # bs=128k,128k,128k 00:34:03.872 19:20:20 -- target/dif.sh@127 -- # numjobs=3 00:34:03.872 19:20:20 -- target/dif.sh@127 -- # iodepth=3 00:34:03.872 19:20:20 -- target/dif.sh@127 -- # runtime=10 00:34:03.872 19:20:20 -- target/dif.sh@128 -- # hdgst=true 00:34:03.872 19:20:20 -- target/dif.sh@128 -- # ddgst=true 00:34:03.872 19:20:20 -- target/dif.sh@130 -- # create_subsystems 0 00:34:03.872 19:20:20 -- target/dif.sh@28 -- # local sub 00:34:03.872 19:20:20 -- target/dif.sh@30 -- # for sub in "$@" 00:34:03.872 19:20:20 -- target/dif.sh@31 -- # create_subsystem 0 00:34:03.872 19:20:20 -- target/dif.sh@18 -- # local sub_id=0 00:34:03.872 19:20:20 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:34:03.872 19:20:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:34:03.873 19:20:20 -- common/autotest_common.sh@10 -- # set +x 00:34:03.873 bdev_null0 00:34:03.873 19:20:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:34:03.873 19:20:20 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:34:03.873 19:20:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:34:03.873 19:20:20 -- common/autotest_common.sh@10 -- # set +x 00:34:03.873 19:20:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:34:03.873 19:20:20 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:34:03.873 19:20:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:34:03.873 19:20:20 -- common/autotest_common.sh@10 -- # set +x 00:34:03.873 19:20:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:34:03.873 19:20:20 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:34:03.873 19:20:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:34:03.873 19:20:20 -- common/autotest_common.sh@10 -- # set +x 00:34:03.873 [2024-11-26 19:20:20.087277] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:34:03.873 19:20:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:34:03.873 19:20:20 -- target/dif.sh@131 -- # fio /dev/fd/62 00:34:03.873 19:20:20 -- target/dif.sh@131 -- # create_json_sub_conf 0 00:34:03.873 19:20:20 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:34:03.873 19:20:20 -- nvmf/common.sh@520 -- # config=() 00:34:03.873 19:20:20 -- target/dif.sh@82 -- # gen_fio_conf 00:34:03.873 19:20:20 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:34:03.873 19:20:20 -- target/dif.sh@54 -- # local file 00:34:03.873 19:20:20 -- nvmf/common.sh@520 -- # local subsystem config 00:34:03.873 19:20:20 -- target/dif.sh@56 -- # cat 00:34:03.873 19:20:20 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:34:03.873 19:20:20 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:34:03.873 19:20:20 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:34:03.873 19:20:20 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:34:03.873 { 00:34:03.873 "params": { 00:34:03.873 "name": "Nvme$subsystem", 00:34:03.873 "trtype": "$TEST_TRANSPORT", 00:34:03.873 "traddr": "$NVMF_FIRST_TARGET_IP", 00:34:03.873 "adrfam": "ipv4", 00:34:03.873 "trsvcid": "$NVMF_PORT", 00:34:03.873 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:34:03.873 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:34:03.873 "hdgst": ${hdgst:-false}, 00:34:03.873 "ddgst": ${ddgst:-false} 00:34:03.873 }, 00:34:03.873 "method": "bdev_nvme_attach_controller" 00:34:03.873 } 00:34:03.873 EOF 00:34:03.873 )") 00:34:03.873 19:20:20 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:34:03.873 19:20:20 -- common/autotest_common.sh@1328 -- # local sanitizers 00:34:03.873 19:20:20 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:34:03.873 19:20:20 -- common/autotest_common.sh@1330 -- # shift 00:34:03.873 19:20:20 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:34:03.873 19:20:20 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:34:03.873 19:20:20 -- nvmf/common.sh@542 -- # cat 00:34:03.873 19:20:20 -- target/dif.sh@72 -- # (( file = 1 )) 00:34:03.873 19:20:20 -- target/dif.sh@72 -- # (( file <= files )) 00:34:03.873 19:20:20 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:34:03.873 19:20:20 -- common/autotest_common.sh@1334 -- # grep libasan 00:34:03.873 19:20:20 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:34:03.873 19:20:20 -- nvmf/common.sh@544 -- # jq . 00:34:03.873 19:20:20 -- nvmf/common.sh@545 -- # IFS=, 00:34:03.873 19:20:20 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:34:03.873 "params": { 00:34:03.873 "name": "Nvme0", 00:34:03.873 "trtype": "tcp", 00:34:03.873 "traddr": "10.0.0.2", 00:34:03.873 "adrfam": "ipv4", 00:34:03.873 "trsvcid": "4420", 00:34:03.873 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:34:03.873 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:34:03.873 "hdgst": true, 00:34:03.873 "ddgst": true 00:34:03.873 }, 00:34:03.873 "method": "bdev_nvme_attach_controller" 00:34:03.873 }' 00:34:03.873 19:20:20 -- common/autotest_common.sh@1334 -- # asan_lib= 00:34:03.873 19:20:20 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:34:03.873 19:20:20 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:34:03.873 19:20:20 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:34:03.873 19:20:20 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:34:03.873 19:20:20 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:34:03.873 19:20:20 -- common/autotest_common.sh@1334 -- # asan_lib= 00:34:03.873 19:20:20 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:34:03.873 19:20:20 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:34:03.873 19:20:20 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:34:03.873 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:34:03.873 ... 00:34:03.873 fio-3.35 00:34:03.873 Starting 3 threads 00:34:03.873 EAL: No free 2048 kB hugepages reported on node 1 00:34:04.132 [2024-11-26 19:20:20.841360] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:34:04.132 [2024-11-26 19:20:20.841422] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:34:14.104 00:34:14.104 filename0: (groupid=0, jobs=1): err= 0: pid=3324798: Tue Nov 26 19:20:31 2024 00:34:14.104 read: IOPS=292, BW=36.6MiB/s (38.4MB/s)(368MiB/10044msec) 00:34:14.105 slat (nsec): min=6535, max=24723, avg=12035.58, stdev=1927.79 00:34:14.105 clat (usec): min=7134, max=49187, avg=10213.97, stdev=1198.91 00:34:14.105 lat (usec): min=7142, max=49200, avg=10226.01, stdev=1198.91 00:34:14.105 clat percentiles (usec): 00:34:14.105 | 1.00th=[ 8586], 5.00th=[ 8979], 10.00th=[ 9372], 20.00th=[ 9634], 00:34:14.105 | 30.00th=[ 9896], 40.00th=[10028], 50.00th=[10159], 60.00th=[10421], 00:34:14.105 | 70.00th=[10552], 80.00th=[10683], 90.00th=[11076], 95.00th=[11338], 00:34:14.105 | 99.00th=[11863], 99.50th=[12125], 99.90th=[13173], 99.95th=[46400], 00:34:14.105 | 99.99th=[49021] 00:34:14.105 bw ( KiB/s): min=36608, max=38144, per=34.86%, avg=37632.00, stdev=352.38, samples=20 00:34:14.105 iops : min= 286, max= 298, avg=294.00, stdev= 2.75, samples=20 00:34:14.105 lat (msec) : 10=38.31%, 20=61.62%, 50=0.07% 00:34:14.105 cpu : usr=94.07%, sys=5.64%, ctx=32, majf=0, minf=98 00:34:14.105 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:34:14.105 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:34:14.105 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:34:14.105 issued rwts: total=2942,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:34:14.105 latency : target=0, window=0, percentile=100.00%, depth=3 00:34:14.105 filename0: (groupid=0, jobs=1): err= 0: pid=3324799: Tue Nov 26 19:20:31 2024 00:34:14.105 read: IOPS=271, BW=34.0MiB/s (35.6MB/s)(341MiB/10044msec) 00:34:14.105 slat (nsec): min=6519, max=33203, avg=12225.36, stdev=1738.55 00:34:14.105 clat (usec): min=8421, max=47472, avg=11011.36, stdev=1187.88 00:34:14.105 lat (usec): min=8434, max=47485, avg=11023.59, stdev=1187.89 00:34:14.105 clat percentiles (usec): 00:34:14.105 | 1.00th=[ 9372], 5.00th=[ 9896], 10.00th=[10159], 20.00th=[10421], 00:34:14.105 | 30.00th=[10552], 40.00th=[10814], 50.00th=[10945], 60.00th=[11076], 00:34:14.105 | 70.00th=[11338], 80.00th=[11600], 90.00th=[11863], 95.00th=[12256], 00:34:14.105 | 99.00th=[12780], 99.50th=[13042], 99.90th=[14615], 99.95th=[44303], 00:34:14.105 | 99.99th=[47449] 00:34:14.105 bw ( KiB/s): min=33792, max=35840, per=32.34%, avg=34909.00, stdev=501.23, samples=20 00:34:14.105 iops : min= 264, max= 280, avg=272.70, stdev= 3.96, samples=20 00:34:14.105 lat (msec) : 10=7.15%, 20=92.78%, 50=0.07% 00:34:14.105 cpu : usr=93.97%, sys=5.74%, ctx=24, majf=0, minf=171 00:34:14.105 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:34:14.105 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:34:14.105 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:34:14.105 issued rwts: total=2729,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:34:14.105 latency : target=0, window=0, percentile=100.00%, depth=3 00:34:14.105 filename0: (groupid=0, jobs=1): err= 0: pid=3324800: Tue Nov 26 19:20:31 2024 00:34:14.105 read: IOPS=278, BW=34.8MiB/s (36.5MB/s)(350MiB/10045msec) 00:34:14.105 slat (nsec): min=6570, max=26543, avg=11939.53, stdev=1861.21 00:34:14.105 clat (usec): min=8085, max=49010, avg=10733.30, stdev=1216.28 00:34:14.105 lat (usec): min=8098, max=49023, avg=10745.23, stdev=1216.30 00:34:14.105 clat percentiles (usec): 00:34:14.105 | 1.00th=[ 8979], 5.00th=[ 9503], 10.00th=[ 9765], 20.00th=[10159], 00:34:14.105 | 30.00th=[10290], 40.00th=[10552], 50.00th=[10683], 60.00th=[10814], 00:34:14.105 | 70.00th=[11076], 80.00th=[11338], 90.00th=[11600], 95.00th=[11994], 00:34:14.105 | 99.00th=[12518], 99.50th=[12780], 99.90th=[13829], 99.95th=[44827], 00:34:14.105 | 99.99th=[49021] 00:34:14.105 bw ( KiB/s): min=34560, max=36352, per=33.18%, avg=35814.40, stdev=438.71, samples=20 00:34:14.105 iops : min= 270, max= 284, avg=279.80, stdev= 3.43, samples=20 00:34:14.105 lat (msec) : 10=15.68%, 20=84.25%, 50=0.07% 00:34:14.105 cpu : usr=94.48%, sys=5.21%, ctx=28, majf=0, minf=109 00:34:14.105 IO depths : 1=0.1%, 2=100.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:34:14.105 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:34:14.105 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:34:14.105 issued rwts: total=2800,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:34:14.105 latency : target=0, window=0, percentile=100.00%, depth=3 00:34:14.105 00:34:14.105 Run status group 0 (all jobs): 00:34:14.105 READ: bw=105MiB/s (111MB/s), 34.0MiB/s-36.6MiB/s (35.6MB/s-38.4MB/s), io=1059MiB (1110MB), run=10044-10045msec 00:34:14.363 19:20:31 -- target/dif.sh@132 -- # destroy_subsystems 0 00:34:14.363 19:20:31 -- target/dif.sh@43 -- # local sub 00:34:14.363 19:20:31 -- target/dif.sh@45 -- # for sub in "$@" 00:34:14.363 19:20:31 -- target/dif.sh@46 -- # destroy_subsystem 0 00:34:14.363 19:20:31 -- target/dif.sh@36 -- # local sub_id=0 00:34:14.363 19:20:31 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:34:14.363 19:20:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:34:14.363 19:20:31 -- common/autotest_common.sh@10 -- # set +x 00:34:14.363 19:20:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:34:14.363 19:20:31 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:34:14.363 19:20:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:34:14.363 19:20:31 -- common/autotest_common.sh@10 -- # set +x 00:34:14.363 19:20:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:34:14.363 00:34:14.363 real 0m11.133s 00:34:14.363 user 0m34.726s 00:34:14.363 sys 0m1.967s 00:34:14.363 19:20:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:34:14.363 19:20:31 -- common/autotest_common.sh@10 -- # set +x 00:34:14.363 ************************************ 00:34:14.363 END TEST fio_dif_digest 00:34:14.363 ************************************ 00:34:14.363 19:20:31 -- target/dif.sh@146 -- # trap - SIGINT SIGTERM EXIT 00:34:14.363 19:20:31 -- target/dif.sh@147 -- # nvmftestfini 00:34:14.363 19:20:31 -- nvmf/common.sh@476 -- # nvmfcleanup 00:34:14.363 19:20:31 -- nvmf/common.sh@116 -- # sync 00:34:14.363 19:20:31 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:34:14.363 19:20:31 -- nvmf/common.sh@119 -- # set +e 00:34:14.363 19:20:31 -- nvmf/common.sh@120 -- # for i in {1..20} 00:34:14.363 19:20:31 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:34:14.363 rmmod nvme_tcp 00:34:14.363 rmmod nvme_fabrics 00:34:14.363 rmmod nvme_keyring 00:34:14.363 19:20:31 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:34:14.363 19:20:31 -- nvmf/common.sh@123 -- # set -e 00:34:14.363 19:20:31 -- nvmf/common.sh@124 -- # return 0 00:34:14.363 19:20:31 -- nvmf/common.sh@477 -- # '[' -n 3315910 ']' 00:34:14.363 19:20:31 -- nvmf/common.sh@478 -- # killprocess 3315910 00:34:14.363 19:20:31 -- common/autotest_common.sh@936 -- # '[' -z 3315910 ']' 00:34:14.363 19:20:31 -- common/autotest_common.sh@940 -- # kill -0 3315910 00:34:14.363 19:20:31 -- common/autotest_common.sh@941 -- # uname 00:34:14.363 19:20:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:34:14.622 19:20:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3315910 00:34:14.622 19:20:31 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:34:14.622 19:20:31 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:34:14.622 19:20:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3315910' 00:34:14.622 killing process with pid 3315910 00:34:14.622 19:20:31 -- common/autotest_common.sh@955 -- # kill 3315910 00:34:14.622 19:20:31 -- common/autotest_common.sh@960 -- # wait 3315910 00:34:14.622 19:20:31 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:34:14.622 19:20:31 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:34:17.154 Waiting for block devices as requested 00:34:17.413 0000:5e:00.0 (8086 0a54): vfio-pci -> nvme 00:34:17.413 0000:00:04.7 (8086 2021): vfio-pci -> ioatdma 00:34:17.413 0000:00:04.6 (8086 2021): vfio-pci -> ioatdma 00:34:17.672 0000:00:04.5 (8086 2021): vfio-pci -> ioatdma 00:34:17.672 0000:00:04.4 (8086 2021): vfio-pci -> ioatdma 00:34:17.672 0000:00:04.3 (8086 2021): vfio-pci -> ioatdma 00:34:17.672 0000:00:04.2 (8086 2021): vfio-pci -> ioatdma 00:34:17.931 0000:00:04.1 (8086 2021): vfio-pci -> ioatdma 00:34:17.931 0000:00:04.0 (8086 2021): vfio-pci -> ioatdma 00:34:17.931 0000:80:04.7 (8086 2021): vfio-pci -> ioatdma 00:34:18.188 0000:80:04.6 (8086 2021): vfio-pci -> ioatdma 00:34:18.188 0000:80:04.5 (8086 2021): vfio-pci -> ioatdma 00:34:18.188 0000:80:04.4 (8086 2021): vfio-pci -> ioatdma 00:34:18.188 0000:80:04.3 (8086 2021): vfio-pci -> ioatdma 00:34:18.445 0000:80:04.2 (8086 2021): vfio-pci -> ioatdma 00:34:18.445 0000:80:04.1 (8086 2021): vfio-pci -> ioatdma 00:34:18.445 0000:80:04.0 (8086 2021): vfio-pci -> ioatdma 00:34:18.703 19:20:35 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:34:18.703 19:20:35 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:34:18.703 19:20:35 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:34:18.703 19:20:35 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:34:18.703 19:20:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:34:18.703 19:20:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:34:18.703 19:20:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:34:20.604 19:20:37 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:34:20.604 00:34:20.604 real 1m13.413s 00:34:20.604 user 7m11.586s 00:34:20.604 sys 0m19.046s 00:34:20.604 19:20:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:34:20.604 19:20:37 -- common/autotest_common.sh@10 -- # set +x 00:34:20.604 ************************************ 00:34:20.604 END TEST nvmf_dif 00:34:20.604 ************************************ 00:34:20.604 19:20:37 -- spdk/autotest.sh@288 -- # run_test nvmf_abort_qd_sizes /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:34:20.604 19:20:37 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:34:20.604 19:20:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:34:20.604 19:20:37 -- common/autotest_common.sh@10 -- # set +x 00:34:20.604 ************************************ 00:34:20.604 START TEST nvmf_abort_qd_sizes 00:34:20.604 ************************************ 00:34:20.604 19:20:37 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:34:20.862 * Looking for test storage... 00:34:20.862 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:34:20.862 19:20:37 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:34:20.862 19:20:37 -- common/autotest_common.sh@1690 -- # lcov --version 00:34:20.862 19:20:37 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:34:20.862 19:20:37 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:34:20.862 19:20:37 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:34:20.862 19:20:37 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:34:20.862 19:20:37 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:34:20.862 19:20:37 -- scripts/common.sh@335 -- # IFS=.-: 00:34:20.862 19:20:37 -- scripts/common.sh@335 -- # read -ra ver1 00:34:20.862 19:20:37 -- scripts/common.sh@336 -- # IFS=.-: 00:34:20.862 19:20:37 -- scripts/common.sh@336 -- # read -ra ver2 00:34:20.862 19:20:37 -- scripts/common.sh@337 -- # local 'op=<' 00:34:20.862 19:20:37 -- scripts/common.sh@339 -- # ver1_l=2 00:34:20.862 19:20:37 -- scripts/common.sh@340 -- # ver2_l=1 00:34:20.862 19:20:37 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:34:20.862 19:20:37 -- scripts/common.sh@343 -- # case "$op" in 00:34:20.862 19:20:37 -- scripts/common.sh@344 -- # : 1 00:34:20.862 19:20:37 -- scripts/common.sh@363 -- # (( v = 0 )) 00:34:20.862 19:20:37 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:34:20.862 19:20:37 -- scripts/common.sh@364 -- # decimal 1 00:34:20.862 19:20:37 -- scripts/common.sh@352 -- # local d=1 00:34:20.862 19:20:37 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:34:20.862 19:20:37 -- scripts/common.sh@354 -- # echo 1 00:34:20.862 19:20:37 -- scripts/common.sh@364 -- # ver1[v]=1 00:34:20.862 19:20:37 -- scripts/common.sh@365 -- # decimal 2 00:34:20.862 19:20:37 -- scripts/common.sh@352 -- # local d=2 00:34:20.862 19:20:37 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:34:20.862 19:20:37 -- scripts/common.sh@354 -- # echo 2 00:34:20.862 19:20:37 -- scripts/common.sh@365 -- # ver2[v]=2 00:34:20.862 19:20:37 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:34:20.862 19:20:37 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:34:20.862 19:20:37 -- scripts/common.sh@367 -- # return 0 00:34:20.862 19:20:37 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:34:20.862 19:20:37 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:34:20.862 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:34:20.862 --rc genhtml_branch_coverage=1 00:34:20.862 --rc genhtml_function_coverage=1 00:34:20.862 --rc genhtml_legend=1 00:34:20.862 --rc geninfo_all_blocks=1 00:34:20.862 --rc geninfo_unexecuted_blocks=1 00:34:20.862 00:34:20.862 ' 00:34:20.862 19:20:37 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:34:20.862 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:34:20.862 --rc genhtml_branch_coverage=1 00:34:20.862 --rc genhtml_function_coverage=1 00:34:20.862 --rc genhtml_legend=1 00:34:20.862 --rc geninfo_all_blocks=1 00:34:20.862 --rc geninfo_unexecuted_blocks=1 00:34:20.862 00:34:20.862 ' 00:34:20.862 19:20:37 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:34:20.862 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:34:20.862 --rc genhtml_branch_coverage=1 00:34:20.862 --rc genhtml_function_coverage=1 00:34:20.862 --rc genhtml_legend=1 00:34:20.862 --rc geninfo_all_blocks=1 00:34:20.862 --rc geninfo_unexecuted_blocks=1 00:34:20.862 00:34:20.862 ' 00:34:20.862 19:20:37 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:34:20.862 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:34:20.862 --rc genhtml_branch_coverage=1 00:34:20.862 --rc genhtml_function_coverage=1 00:34:20.862 --rc genhtml_legend=1 00:34:20.862 --rc geninfo_all_blocks=1 00:34:20.862 --rc geninfo_unexecuted_blocks=1 00:34:20.862 00:34:20.862 ' 00:34:20.862 19:20:37 -- target/abort_qd_sizes.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:34:20.862 19:20:37 -- nvmf/common.sh@7 -- # uname -s 00:34:20.862 19:20:37 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:34:20.862 19:20:37 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:34:20.862 19:20:37 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:34:20.862 19:20:37 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:34:20.862 19:20:37 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:34:20.862 19:20:37 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:34:20.862 19:20:37 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:34:20.862 19:20:37 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:34:20.862 19:20:37 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:34:20.862 19:20:37 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:34:20.862 19:20:37 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:34:20.862 19:20:37 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:34:20.862 19:20:37 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:34:20.862 19:20:37 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:34:20.862 19:20:37 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:34:20.862 19:20:37 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:34:20.862 19:20:37 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:34:20.862 19:20:37 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:34:20.862 19:20:37 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:34:20.862 19:20:37 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:34:20.863 19:20:37 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:34:20.863 19:20:37 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:34:20.863 19:20:37 -- paths/export.sh@5 -- # export PATH 00:34:20.863 19:20:37 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:34:20.863 19:20:37 -- nvmf/common.sh@46 -- # : 0 00:34:20.863 19:20:37 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:34:20.863 19:20:37 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:34:20.863 19:20:37 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:34:20.863 19:20:37 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:34:20.863 19:20:37 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:34:20.863 19:20:37 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:34:20.863 19:20:37 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:34:20.863 19:20:37 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:34:20.863 19:20:37 -- target/abort_qd_sizes.sh@73 -- # nvmftestinit 00:34:20.863 19:20:37 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:34:20.863 19:20:37 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:34:20.863 19:20:37 -- nvmf/common.sh@436 -- # prepare_net_devs 00:34:20.863 19:20:37 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:34:20.863 19:20:37 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:34:20.863 19:20:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:34:20.863 19:20:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:34:20.863 19:20:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:34:20.863 19:20:37 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:34:20.863 19:20:37 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:34:20.863 19:20:37 -- nvmf/common.sh@284 -- # xtrace_disable 00:34:20.863 19:20:37 -- common/autotest_common.sh@10 -- # set +x 00:34:26.261 19:20:42 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:34:26.261 19:20:42 -- nvmf/common.sh@290 -- # pci_devs=() 00:34:26.261 19:20:42 -- nvmf/common.sh@290 -- # local -a pci_devs 00:34:26.261 19:20:42 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:34:26.261 19:20:42 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:34:26.261 19:20:42 -- nvmf/common.sh@292 -- # pci_drivers=() 00:34:26.261 19:20:42 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:34:26.261 19:20:42 -- nvmf/common.sh@294 -- # net_devs=() 00:34:26.261 19:20:42 -- nvmf/common.sh@294 -- # local -ga net_devs 00:34:26.261 19:20:42 -- nvmf/common.sh@295 -- # e810=() 00:34:26.261 19:20:42 -- nvmf/common.sh@295 -- # local -ga e810 00:34:26.261 19:20:42 -- nvmf/common.sh@296 -- # x722=() 00:34:26.261 19:20:42 -- nvmf/common.sh@296 -- # local -ga x722 00:34:26.261 19:20:42 -- nvmf/common.sh@297 -- # mlx=() 00:34:26.261 19:20:42 -- nvmf/common.sh@297 -- # local -ga mlx 00:34:26.261 19:20:42 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:34:26.261 19:20:42 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:34:26.261 19:20:42 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:34:26.261 19:20:42 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:34:26.261 19:20:42 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:34:26.261 19:20:42 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:34:26.261 19:20:42 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:34:26.261 19:20:42 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:34:26.261 19:20:42 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:34:26.261 19:20:42 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:34:26.261 19:20:42 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:34:26.261 19:20:42 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:34:26.261 19:20:42 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:34:26.261 19:20:42 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:34:26.261 19:20:42 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:34:26.261 19:20:42 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:34:26.261 19:20:42 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:34:26.261 19:20:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:34:26.261 19:20:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:34:26.261 Found 0000:86:00.0 (0x8086 - 0x159b) 00:34:26.261 19:20:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:34:26.261 19:20:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:34:26.261 19:20:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:34:26.261 19:20:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:34:26.261 19:20:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:34:26.261 19:20:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:34:26.261 19:20:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:34:26.261 Found 0000:86:00.1 (0x8086 - 0x159b) 00:34:26.261 19:20:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:34:26.261 19:20:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:34:26.261 19:20:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:34:26.261 19:20:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:34:26.261 19:20:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:34:26.261 19:20:42 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:34:26.261 19:20:42 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:34:26.261 19:20:42 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:34:26.261 19:20:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:34:26.261 19:20:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:34:26.261 19:20:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:34:26.261 19:20:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:34:26.261 19:20:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:34:26.261 Found net devices under 0000:86:00.0: cvl_0_0 00:34:26.261 19:20:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:34:26.261 19:20:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:34:26.261 19:20:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:34:26.261 19:20:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:34:26.261 19:20:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:34:26.261 19:20:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:34:26.261 Found net devices under 0000:86:00.1: cvl_0_1 00:34:26.261 19:20:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:34:26.261 19:20:42 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:34:26.261 19:20:42 -- nvmf/common.sh@402 -- # is_hw=yes 00:34:26.261 19:20:42 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:34:26.261 19:20:42 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:34:26.262 19:20:42 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:34:26.262 19:20:42 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:34:26.262 19:20:42 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:34:26.262 19:20:42 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:34:26.262 19:20:42 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:34:26.262 19:20:42 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:34:26.262 19:20:42 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:34:26.262 19:20:42 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:34:26.262 19:20:42 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:34:26.262 19:20:42 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:34:26.262 19:20:42 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:34:26.262 19:20:42 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:34:26.262 19:20:42 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:34:26.262 19:20:42 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:34:26.262 19:20:43 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:34:26.262 19:20:43 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:34:26.262 19:20:43 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:34:26.262 19:20:43 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:34:26.262 19:20:43 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:34:26.262 19:20:43 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:34:26.262 19:20:43 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:34:26.262 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:34:26.262 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.425 ms 00:34:26.262 00:34:26.262 --- 10.0.0.2 ping statistics --- 00:34:26.262 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:34:26.262 rtt min/avg/max/mdev = 0.425/0.425/0.425/0.000 ms 00:34:26.262 19:20:43 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:34:26.262 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:34:26.262 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.224 ms 00:34:26.262 00:34:26.262 --- 10.0.0.1 ping statistics --- 00:34:26.262 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:34:26.262 rtt min/avg/max/mdev = 0.224/0.224/0.224/0.000 ms 00:34:26.262 19:20:43 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:34:26.262 19:20:43 -- nvmf/common.sh@410 -- # return 0 00:34:26.262 19:20:43 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:34:26.262 19:20:43 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:34:29.538 0000:00:04.7 (8086 2021): ioatdma -> vfio-pci 00:34:29.538 0000:00:04.6 (8086 2021): ioatdma -> vfio-pci 00:34:29.538 0000:00:04.5 (8086 2021): ioatdma -> vfio-pci 00:34:29.538 0000:00:04.4 (8086 2021): ioatdma -> vfio-pci 00:34:29.538 0000:00:04.3 (8086 2021): ioatdma -> vfio-pci 00:34:29.538 0000:00:04.2 (8086 2021): ioatdma -> vfio-pci 00:34:29.538 0000:00:04.1 (8086 2021): ioatdma -> vfio-pci 00:34:29.538 0000:00:04.0 (8086 2021): ioatdma -> vfio-pci 00:34:29.538 0000:80:04.7 (8086 2021): ioatdma -> vfio-pci 00:34:29.538 0000:80:04.6 (8086 2021): ioatdma -> vfio-pci 00:34:29.538 0000:80:04.5 (8086 2021): ioatdma -> vfio-pci 00:34:29.538 0000:80:04.4 (8086 2021): ioatdma -> vfio-pci 00:34:29.538 0000:80:04.3 (8086 2021): ioatdma -> vfio-pci 00:34:29.538 0000:80:04.2 (8086 2021): ioatdma -> vfio-pci 00:34:29.538 0000:80:04.1 (8086 2021): ioatdma -> vfio-pci 00:34:29.538 0000:80:04.0 (8086 2021): ioatdma -> vfio-pci 00:34:30.104 0000:5e:00.0 (8086 0a54): nvme -> vfio-pci 00:34:30.104 19:20:46 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:34:30.104 19:20:46 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:34:30.104 19:20:46 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:34:30.104 19:20:46 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:34:30.104 19:20:46 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:34:30.104 19:20:46 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:34:30.104 19:20:46 -- target/abort_qd_sizes.sh@74 -- # nvmfappstart -m 0xf 00:34:30.104 19:20:46 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:34:30.104 19:20:46 -- common/autotest_common.sh@722 -- # xtrace_disable 00:34:30.104 19:20:46 -- common/autotest_common.sh@10 -- # set +x 00:34:30.104 19:20:46 -- nvmf/common.sh@469 -- # nvmfpid=3332734 00:34:30.104 19:20:46 -- nvmf/common.sh@470 -- # waitforlisten 3332734 00:34:30.104 19:20:46 -- common/autotest_common.sh@829 -- # '[' -z 3332734 ']' 00:34:30.104 19:20:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:34:30.104 19:20:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:34:30.104 19:20:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:34:30.104 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:34:30.104 19:20:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:34:30.104 19:20:46 -- common/autotest_common.sh@10 -- # set +x 00:34:30.104 19:20:46 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xf 00:34:30.104 [2024-11-26 19:20:46.949846] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:34:30.104 [2024-11-26 19:20:46.949891] [ DPDK EAL parameters: nvmf -c 0xf --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:34:30.104 EAL: No free 2048 kB hugepages reported on node 1 00:34:30.104 [2024-11-26 19:20:47.008294] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:34:30.363 [2024-11-26 19:20:47.048303] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:34:30.363 [2024-11-26 19:20:47.048418] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:34:30.363 [2024-11-26 19:20:47.048426] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:34:30.363 [2024-11-26 19:20:47.048435] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:34:30.363 [2024-11-26 19:20:47.048475] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:34:30.363 [2024-11-26 19:20:47.048573] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:34:30.363 [2024-11-26 19:20:47.048658] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:34:30.363 [2024-11-26 19:20:47.048659] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:34:30.930 19:20:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:34:30.930 19:20:47 -- common/autotest_common.sh@862 -- # return 0 00:34:30.930 19:20:47 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:34:30.930 19:20:47 -- common/autotest_common.sh@728 -- # xtrace_disable 00:34:30.930 19:20:47 -- common/autotest_common.sh@10 -- # set +x 00:34:30.930 19:20:47 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:34:30.930 19:20:47 -- target/abort_qd_sizes.sh@76 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini || :; clean_kernel_target' SIGINT SIGTERM EXIT 00:34:30.930 19:20:47 -- target/abort_qd_sizes.sh@78 -- # mapfile -t nvmes 00:34:30.930 19:20:47 -- target/abort_qd_sizes.sh@78 -- # nvme_in_userspace 00:34:30.930 19:20:47 -- scripts/common.sh@311 -- # local bdf bdfs 00:34:30.930 19:20:47 -- scripts/common.sh@312 -- # local nvmes 00:34:30.930 19:20:47 -- scripts/common.sh@314 -- # [[ -n 0000:5e:00.0 ]] 00:34:30.930 19:20:47 -- scripts/common.sh@315 -- # nvmes=(${pci_bus_cache["0x010802"]}) 00:34:30.930 19:20:47 -- scripts/common.sh@320 -- # for bdf in "${nvmes[@]}" 00:34:30.930 19:20:47 -- scripts/common.sh@321 -- # [[ -e /sys/bus/pci/drivers/nvme/0000:5e:00.0 ]] 00:34:30.930 19:20:47 -- scripts/common.sh@322 -- # uname -s 00:34:30.930 19:20:47 -- scripts/common.sh@322 -- # [[ Linux == FreeBSD ]] 00:34:30.930 19:20:47 -- scripts/common.sh@325 -- # bdfs+=("$bdf") 00:34:30.930 19:20:47 -- scripts/common.sh@327 -- # (( 1 )) 00:34:30.930 19:20:47 -- scripts/common.sh@328 -- # printf '%s\n' 0000:5e:00.0 00:34:30.930 19:20:47 -- target/abort_qd_sizes.sh@79 -- # (( 1 > 0 )) 00:34:30.930 19:20:47 -- target/abort_qd_sizes.sh@81 -- # nvme=0000:5e:00.0 00:34:30.930 19:20:47 -- target/abort_qd_sizes.sh@83 -- # run_test spdk_target_abort spdk_target 00:34:30.930 19:20:47 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:34:30.930 19:20:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:34:30.930 19:20:47 -- common/autotest_common.sh@10 -- # set +x 00:34:30.930 ************************************ 00:34:30.930 START TEST spdk_target_abort 00:34:30.930 ************************************ 00:34:30.930 19:20:47 -- common/autotest_common.sh@1114 -- # spdk_target 00:34:30.930 19:20:47 -- target/abort_qd_sizes.sh@43 -- # local name=spdk_target 00:34:30.930 19:20:47 -- target/abort_qd_sizes.sh@44 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:34:30.930 19:20:47 -- target/abort_qd_sizes.sh@46 -- # rpc_cmd bdev_nvme_attach_controller -t pcie -a 0000:5e:00.0 -b spdk_target 00:34:30.930 19:20:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:34:30.930 19:20:47 -- common/autotest_common.sh@10 -- # set +x 00:34:34.215 spdk_targetn1 00:34:34.215 19:20:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:34:34.215 19:20:50 -- target/abort_qd_sizes.sh@48 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:34:34.215 19:20:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:34:34.215 19:20:50 -- common/autotest_common.sh@10 -- # set +x 00:34:34.215 [2024-11-26 19:20:50.656565] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:34:34.215 19:20:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:34:34.215 19:20:50 -- target/abort_qd_sizes.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:spdk_target -a -s SPDKISFASTANDAWESOME 00:34:34.215 19:20:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:34:34.215 19:20:50 -- common/autotest_common.sh@10 -- # set +x 00:34:34.215 19:20:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:34:34.215 19:20:50 -- target/abort_qd_sizes.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:spdk_target spdk_targetn1 00:34:34.215 19:20:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:34:34.215 19:20:50 -- common/autotest_common.sh@10 -- # set +x 00:34:34.215 19:20:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:34:34.215 19:20:50 -- target/abort_qd_sizes.sh@51 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:spdk_target -t tcp -a 10.0.0.2 -s 4420 00:34:34.215 19:20:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:34:34.215 19:20:50 -- common/autotest_common.sh@10 -- # set +x 00:34:34.215 [2024-11-26 19:20:50.689718] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:34:34.215 19:20:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:34:34.215 19:20:50 -- target/abort_qd_sizes.sh@53 -- # rabort tcp IPv4 10.0.0.2 4420 nqn.2016-06.io.spdk:spdk_target 00:34:34.215 19:20:50 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:34:34.215 19:20:50 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:34:34.215 19:20:50 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.2 00:34:34.215 19:20:50 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:34:34.215 19:20:50 -- target/abort_qd_sizes.sh@21 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:34:34.215 19:20:50 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:34:34.215 19:20:50 -- target/abort_qd_sizes.sh@24 -- # local target r 00:34:34.215 19:20:50 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:34:34.216 19:20:50 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:34:34.216 19:20:50 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:34:34.216 19:20:50 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:34:34.216 19:20:50 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:34:34.216 19:20:50 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:34:34.216 19:20:50 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2' 00:34:34.216 19:20:50 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:34:34.216 19:20:50 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:34:34.216 19:20:50 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:34:34.216 19:20:50 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:34:34.216 19:20:50 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:34:34.216 19:20:50 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:34:34.216 EAL: No free 2048 kB hugepages reported on node 1 00:34:37.500 Initializing NVMe Controllers 00:34:37.500 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:34:37.500 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:34:37.501 Initialization complete. Launching workers. 00:34:37.501 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 15488, failed: 0 00:34:37.501 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1415, failed to submit 14073 00:34:37.501 success 713, unsuccess 702, failed 0 00:34:37.501 19:20:53 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:34:37.501 19:20:53 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:34:37.501 EAL: No free 2048 kB hugepages reported on node 1 00:34:40.786 [2024-11-26 19:20:57.157065] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c71f0 is same with the state(5) to be set 00:34:40.787 [2024-11-26 19:20:57.157099] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c71f0 is same with the state(5) to be set 00:34:40.787 [2024-11-26 19:20:57.157106] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c71f0 is same with the state(5) to be set 00:34:40.787 [2024-11-26 19:20:57.157113] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c71f0 is same with the state(5) to be set 00:34:40.787 [2024-11-26 19:20:57.157119] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c71f0 is same with the state(5) to be set 00:34:40.787 [2024-11-26 19:20:57.157125] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c71f0 is same with the state(5) to be set 00:34:40.787 [2024-11-26 19:20:57.157133] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c71f0 is same with the state(5) to be set 00:34:40.787 [2024-11-26 19:20:57.157147] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c71f0 is same with the state(5) to be set 00:34:40.787 [2024-11-26 19:20:57.157153] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c71f0 is same with the state(5) to be set 00:34:40.787 [2024-11-26 19:20:57.157160] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c71f0 is same with the state(5) to be set 00:34:40.787 [2024-11-26 19:20:57.157166] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c71f0 is same with the state(5) to be set 00:34:40.787 [2024-11-26 19:20:57.157172] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c71f0 is same with the state(5) to be set 00:34:40.787 [2024-11-26 19:20:57.157178] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c71f0 is same with the state(5) to be set 00:34:40.787 [2024-11-26 19:20:57.157183] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c71f0 is same with the state(5) to be set 00:34:40.787 Initializing NVMe Controllers 00:34:40.787 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:34:40.787 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:34:40.787 Initialization complete. Launching workers. 00:34:40.787 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 8482, failed: 0 00:34:40.787 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1244, failed to submit 7238 00:34:40.787 success 318, unsuccess 926, failed 0 00:34:40.787 19:20:57 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:34:40.787 19:20:57 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:34:40.787 EAL: No free 2048 kB hugepages reported on node 1 00:34:44.074 Initializing NVMe Controllers 00:34:44.074 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:34:44.074 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:34:44.074 Initialization complete. Launching workers. 00:34:44.074 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 38855, failed: 0 00:34:44.074 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 2699, failed to submit 36156 00:34:44.074 success 597, unsuccess 2102, failed 0 00:34:44.074 19:21:00 -- target/abort_qd_sizes.sh@55 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:spdk_target 00:34:44.074 19:21:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:34:44.074 19:21:00 -- common/autotest_common.sh@10 -- # set +x 00:34:44.074 19:21:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:34:44.074 19:21:00 -- target/abort_qd_sizes.sh@56 -- # rpc_cmd bdev_nvme_detach_controller spdk_target 00:34:44.074 19:21:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:34:44.074 19:21:00 -- common/autotest_common.sh@10 -- # set +x 00:34:45.010 19:21:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:34:45.010 19:21:01 -- target/abort_qd_sizes.sh@62 -- # killprocess 3332734 00:34:45.010 19:21:01 -- common/autotest_common.sh@936 -- # '[' -z 3332734 ']' 00:34:45.010 19:21:01 -- common/autotest_common.sh@940 -- # kill -0 3332734 00:34:45.010 19:21:01 -- common/autotest_common.sh@941 -- # uname 00:34:45.010 19:21:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:34:45.010 19:21:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3332734 00:34:45.010 19:21:01 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:34:45.010 19:21:01 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:34:45.010 19:21:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3332734' 00:34:45.010 killing process with pid 3332734 00:34:45.010 19:21:01 -- common/autotest_common.sh@955 -- # kill 3332734 00:34:45.010 19:21:01 -- common/autotest_common.sh@960 -- # wait 3332734 00:34:45.269 00:34:45.269 real 0m14.142s 00:34:45.269 user 0m56.446s 00:34:45.269 sys 0m2.302s 00:34:45.269 19:21:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:34:45.269 19:21:01 -- common/autotest_common.sh@10 -- # set +x 00:34:45.269 ************************************ 00:34:45.269 END TEST spdk_target_abort 00:34:45.269 ************************************ 00:34:45.269 19:21:01 -- target/abort_qd_sizes.sh@84 -- # run_test kernel_target_abort kernel_target 00:34:45.269 19:21:01 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:34:45.269 19:21:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:34:45.269 19:21:01 -- common/autotest_common.sh@10 -- # set +x 00:34:45.269 ************************************ 00:34:45.269 START TEST kernel_target_abort 00:34:45.269 ************************************ 00:34:45.269 19:21:02 -- common/autotest_common.sh@1114 -- # kernel_target 00:34:45.269 19:21:02 -- target/abort_qd_sizes.sh@66 -- # local name=kernel_target 00:34:45.269 19:21:02 -- target/abort_qd_sizes.sh@68 -- # configure_kernel_target kernel_target 00:34:45.269 19:21:02 -- nvmf/common.sh@621 -- # kernel_name=kernel_target 00:34:45.269 19:21:02 -- nvmf/common.sh@622 -- # nvmet=/sys/kernel/config/nvmet 00:34:45.269 19:21:02 -- nvmf/common.sh@623 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/kernel_target 00:34:45.269 19:21:02 -- nvmf/common.sh@624 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:34:45.269 19:21:02 -- nvmf/common.sh@625 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:34:45.269 19:21:02 -- nvmf/common.sh@627 -- # local block nvme 00:34:45.269 19:21:02 -- nvmf/common.sh@629 -- # [[ ! -e /sys/module/nvmet ]] 00:34:45.269 19:21:02 -- nvmf/common.sh@630 -- # modprobe nvmet 00:34:45.269 19:21:02 -- nvmf/common.sh@633 -- # [[ -e /sys/kernel/config/nvmet ]] 00:34:45.269 19:21:02 -- nvmf/common.sh@635 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:34:47.802 Waiting for block devices as requested 00:34:47.802 0000:5e:00.0 (8086 0a54): vfio-pci -> nvme 00:34:48.061 0000:00:04.7 (8086 2021): vfio-pci -> ioatdma 00:34:48.061 0000:00:04.6 (8086 2021): vfio-pci -> ioatdma 00:34:48.061 0000:00:04.5 (8086 2021): vfio-pci -> ioatdma 00:34:48.061 0000:00:04.4 (8086 2021): vfio-pci -> ioatdma 00:34:48.321 0000:00:04.3 (8086 2021): vfio-pci -> ioatdma 00:34:48.321 0000:00:04.2 (8086 2021): vfio-pci -> ioatdma 00:34:48.321 0000:00:04.1 (8086 2021): vfio-pci -> ioatdma 00:34:48.321 0000:00:04.0 (8086 2021): vfio-pci -> ioatdma 00:34:48.579 0000:80:04.7 (8086 2021): vfio-pci -> ioatdma 00:34:48.579 0000:80:04.6 (8086 2021): vfio-pci -> ioatdma 00:34:48.579 0000:80:04.5 (8086 2021): vfio-pci -> ioatdma 00:34:48.838 0000:80:04.4 (8086 2021): vfio-pci -> ioatdma 00:34:48.838 0000:80:04.3 (8086 2021): vfio-pci -> ioatdma 00:34:48.838 0000:80:04.2 (8086 2021): vfio-pci -> ioatdma 00:34:48.838 0000:80:04.1 (8086 2021): vfio-pci -> ioatdma 00:34:49.097 0000:80:04.0 (8086 2021): vfio-pci -> ioatdma 00:34:49.097 19:21:05 -- nvmf/common.sh@638 -- # for block in /sys/block/nvme* 00:34:49.097 19:21:05 -- nvmf/common.sh@639 -- # [[ -e /sys/block/nvme0n1 ]] 00:34:49.097 19:21:05 -- nvmf/common.sh@640 -- # block_in_use nvme0n1 00:34:49.097 19:21:05 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:34:49.097 19:21:05 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:34:49.097 No valid GPT data, bailing 00:34:49.097 19:21:05 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:34:49.097 19:21:05 -- scripts/common.sh@393 -- # pt= 00:34:49.097 19:21:05 -- scripts/common.sh@394 -- # return 1 00:34:49.097 19:21:05 -- nvmf/common.sh@640 -- # nvme=/dev/nvme0n1 00:34:49.097 19:21:05 -- nvmf/common.sh@643 -- # [[ -b /dev/nvme0n1 ]] 00:34:49.097 19:21:05 -- nvmf/common.sh@645 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:34:49.097 19:21:05 -- nvmf/common.sh@646 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:34:49.097 19:21:05 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:34:49.097 19:21:05 -- nvmf/common.sh@652 -- # echo SPDK-kernel_target 00:34:49.097 19:21:05 -- nvmf/common.sh@654 -- # echo 1 00:34:49.097 19:21:05 -- nvmf/common.sh@655 -- # echo /dev/nvme0n1 00:34:49.097 19:21:05 -- nvmf/common.sh@656 -- # echo 1 00:34:49.097 19:21:05 -- nvmf/common.sh@662 -- # echo 10.0.0.1 00:34:49.097 19:21:05 -- nvmf/common.sh@663 -- # echo tcp 00:34:49.097 19:21:05 -- nvmf/common.sh@664 -- # echo 4420 00:34:49.097 19:21:05 -- nvmf/common.sh@665 -- # echo ipv4 00:34:49.097 19:21:05 -- nvmf/common.sh@668 -- # ln -s /sys/kernel/config/nvmet/subsystems/kernel_target /sys/kernel/config/nvmet/ports/1/subsystems/ 00:34:49.097 19:21:05 -- nvmf/common.sh@671 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -a 10.0.0.1 -t tcp -s 4420 00:34:49.355 00:34:49.355 Discovery Log Number of Records 2, Generation counter 2 00:34:49.355 =====Discovery Log Entry 0====== 00:34:49.355 trtype: tcp 00:34:49.355 adrfam: ipv4 00:34:49.355 subtype: current discovery subsystem 00:34:49.355 treq: not specified, sq flow control disable supported 00:34:49.355 portid: 1 00:34:49.355 trsvcid: 4420 00:34:49.355 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:34:49.355 traddr: 10.0.0.1 00:34:49.355 eflags: none 00:34:49.355 sectype: none 00:34:49.355 =====Discovery Log Entry 1====== 00:34:49.355 trtype: tcp 00:34:49.355 adrfam: ipv4 00:34:49.355 subtype: nvme subsystem 00:34:49.355 treq: not specified, sq flow control disable supported 00:34:49.355 portid: 1 00:34:49.355 trsvcid: 4420 00:34:49.355 subnqn: kernel_target 00:34:49.355 traddr: 10.0.0.1 00:34:49.355 eflags: none 00:34:49.355 sectype: none 00:34:49.355 19:21:06 -- target/abort_qd_sizes.sh@69 -- # rabort tcp IPv4 10.0.0.1 4420 kernel_target 00:34:49.355 19:21:06 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:34:49.355 19:21:06 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:34:49.355 19:21:06 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.1 00:34:49.355 19:21:06 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:34:49.355 19:21:06 -- target/abort_qd_sizes.sh@21 -- # local subnqn=kernel_target 00:34:49.355 19:21:06 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:34:49.355 19:21:06 -- target/abort_qd_sizes.sh@24 -- # local target r 00:34:49.355 19:21:06 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:34:49.355 19:21:06 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:34:49.355 19:21:06 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:34:49.355 19:21:06 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:34:49.355 19:21:06 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:34:49.355 19:21:06 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:34:49.355 19:21:06 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1' 00:34:49.355 19:21:06 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:34:49.355 19:21:06 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420' 00:34:49.355 19:21:06 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:34:49.355 19:21:06 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:34:49.355 19:21:06 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:34:49.355 19:21:06 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:34:49.355 EAL: No free 2048 kB hugepages reported on node 1 00:34:52.640 Initializing NVMe Controllers 00:34:52.640 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:34:52.640 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:34:52.640 Initialization complete. Launching workers. 00:34:52.640 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 89046, failed: 0 00:34:52.640 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 89046, failed to submit 0 00:34:52.640 success 0, unsuccess 89046, failed 0 00:34:52.640 19:21:09 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:34:52.640 19:21:09 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:34:52.640 EAL: No free 2048 kB hugepages reported on node 1 00:34:55.932 Initializing NVMe Controllers 00:34:55.932 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:34:55.932 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:34:55.932 Initialization complete. Launching workers. 00:34:55.932 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 145857, failed: 0 00:34:55.932 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 36586, failed to submit 109271 00:34:55.932 success 0, unsuccess 36586, failed 0 00:34:55.932 19:21:12 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:34:55.932 19:21:12 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:34:55.932 EAL: No free 2048 kB hugepages reported on node 1 00:34:58.463 Initializing NVMe Controllers 00:34:58.463 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:34:58.463 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:34:58.463 Initialization complete. Launching workers. 00:34:58.463 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 140534, failed: 0 00:34:58.463 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 35190, failed to submit 105344 00:34:58.463 success 0, unsuccess 35190, failed 0 00:34:58.463 19:21:15 -- target/abort_qd_sizes.sh@70 -- # clean_kernel_target 00:34:58.463 19:21:15 -- nvmf/common.sh@675 -- # [[ -e /sys/kernel/config/nvmet/subsystems/kernel_target ]] 00:34:58.463 19:21:15 -- nvmf/common.sh@677 -- # echo 0 00:34:58.463 19:21:15 -- nvmf/common.sh@679 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/kernel_target 00:34:58.463 19:21:15 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:34:58.463 19:21:15 -- nvmf/common.sh@681 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:34:58.463 19:21:15 -- nvmf/common.sh@682 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:34:58.463 19:21:15 -- nvmf/common.sh@684 -- # modules=(/sys/module/nvmet/holders/*) 00:34:58.464 19:21:15 -- nvmf/common.sh@686 -- # modprobe -r nvmet_tcp nvmet 00:34:58.464 00:34:58.464 real 0m13.351s 00:34:58.464 user 0m7.766s 00:34:58.464 sys 0m3.008s 00:34:58.464 19:21:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:34:58.464 19:21:15 -- common/autotest_common.sh@10 -- # set +x 00:34:58.464 ************************************ 00:34:58.464 END TEST kernel_target_abort 00:34:58.464 ************************************ 00:34:58.722 19:21:15 -- target/abort_qd_sizes.sh@86 -- # trap - SIGINT SIGTERM EXIT 00:34:58.722 19:21:15 -- target/abort_qd_sizes.sh@87 -- # nvmftestfini 00:34:58.722 19:21:15 -- nvmf/common.sh@476 -- # nvmfcleanup 00:34:58.722 19:21:15 -- nvmf/common.sh@116 -- # sync 00:34:58.722 19:21:15 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:34:58.722 19:21:15 -- nvmf/common.sh@119 -- # set +e 00:34:58.722 19:21:15 -- nvmf/common.sh@120 -- # for i in {1..20} 00:34:58.722 19:21:15 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:34:58.722 rmmod nvme_tcp 00:34:58.722 rmmod nvme_fabrics 00:34:58.722 rmmod nvme_keyring 00:34:58.722 19:21:15 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:34:58.722 19:21:15 -- nvmf/common.sh@123 -- # set -e 00:34:58.722 19:21:15 -- nvmf/common.sh@124 -- # return 0 00:34:58.722 19:21:15 -- nvmf/common.sh@477 -- # '[' -n 3332734 ']' 00:34:58.722 19:21:15 -- nvmf/common.sh@478 -- # killprocess 3332734 00:34:58.722 19:21:15 -- common/autotest_common.sh@936 -- # '[' -z 3332734 ']' 00:34:58.722 19:21:15 -- common/autotest_common.sh@940 -- # kill -0 3332734 00:34:58.722 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3332734) - No such process 00:34:58.722 19:21:15 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3332734 is not found' 00:34:58.722 Process with pid 3332734 is not found 00:34:58.722 19:21:15 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:34:58.722 19:21:15 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:35:01.254 0000:5e:00.0 (8086 0a54): Already using the nvme driver 00:35:01.254 0000:00:04.7 (8086 2021): Already using the ioatdma driver 00:35:01.254 0000:00:04.6 (8086 2021): Already using the ioatdma driver 00:35:01.254 0000:00:04.5 (8086 2021): Already using the ioatdma driver 00:35:01.254 0000:00:04.4 (8086 2021): Already using the ioatdma driver 00:35:01.254 0000:00:04.3 (8086 2021): Already using the ioatdma driver 00:35:01.254 0000:00:04.2 (8086 2021): Already using the ioatdma driver 00:35:01.254 0000:00:04.1 (8086 2021): Already using the ioatdma driver 00:35:01.254 0000:00:04.0 (8086 2021): Already using the ioatdma driver 00:35:01.254 0000:80:04.7 (8086 2021): Already using the ioatdma driver 00:35:01.511 0000:80:04.6 (8086 2021): Already using the ioatdma driver 00:35:01.511 0000:80:04.5 (8086 2021): Already using the ioatdma driver 00:35:01.511 0000:80:04.4 (8086 2021): Already using the ioatdma driver 00:35:01.511 0000:80:04.3 (8086 2021): Already using the ioatdma driver 00:35:01.511 0000:80:04.2 (8086 2021): Already using the ioatdma driver 00:35:01.511 0000:80:04.1 (8086 2021): Already using the ioatdma driver 00:35:01.511 0000:80:04.0 (8086 2021): Already using the ioatdma driver 00:35:01.511 19:21:18 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:35:01.511 19:21:18 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:35:01.511 19:21:18 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:35:01.511 19:21:18 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:35:01.511 19:21:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:35:01.511 19:21:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:35:01.511 19:21:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:35:04.042 19:21:20 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:35:04.042 00:35:04.042 real 0m42.931s 00:35:04.042 user 1m8.424s 00:35:04.042 sys 0m13.425s 00:35:04.042 19:21:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:35:04.042 19:21:20 -- common/autotest_common.sh@10 -- # set +x 00:35:04.042 ************************************ 00:35:04.042 END TEST nvmf_abort_qd_sizes 00:35:04.042 ************************************ 00:35:04.042 19:21:20 -- spdk/autotest.sh@298 -- # '[' 0 -eq 1 ']' 00:35:04.042 19:21:20 -- spdk/autotest.sh@302 -- # '[' 0 -eq 1 ']' 00:35:04.042 19:21:20 -- spdk/autotest.sh@306 -- # '[' 0 -eq 1 ']' 00:35:04.042 19:21:20 -- spdk/autotest.sh@311 -- # '[' 0 -eq 1 ']' 00:35:04.042 19:21:20 -- spdk/autotest.sh@320 -- # '[' 0 -eq 1 ']' 00:35:04.042 19:21:20 -- spdk/autotest.sh@325 -- # '[' 0 -eq 1 ']' 00:35:04.042 19:21:20 -- spdk/autotest.sh@329 -- # '[' 0 -eq 1 ']' 00:35:04.042 19:21:20 -- spdk/autotest.sh@333 -- # '[' 0 -eq 1 ']' 00:35:04.042 19:21:20 -- spdk/autotest.sh@337 -- # '[' 0 -eq 1 ']' 00:35:04.042 19:21:20 -- spdk/autotest.sh@342 -- # '[' 0 -eq 1 ']' 00:35:04.042 19:21:20 -- spdk/autotest.sh@346 -- # '[' 0 -eq 1 ']' 00:35:04.042 19:21:20 -- spdk/autotest.sh@353 -- # [[ 0 -eq 1 ]] 00:35:04.042 19:21:20 -- spdk/autotest.sh@357 -- # [[ 0 -eq 1 ]] 00:35:04.042 19:21:20 -- spdk/autotest.sh@361 -- # [[ 0 -eq 1 ]] 00:35:04.042 19:21:20 -- spdk/autotest.sh@365 -- # [[ 0 -eq 1 ]] 00:35:04.042 19:21:20 -- spdk/autotest.sh@370 -- # trap - SIGINT SIGTERM EXIT 00:35:04.042 19:21:20 -- spdk/autotest.sh@372 -- # timing_enter post_cleanup 00:35:04.042 19:21:20 -- common/autotest_common.sh@722 -- # xtrace_disable 00:35:04.042 19:21:20 -- common/autotest_common.sh@10 -- # set +x 00:35:04.042 19:21:20 -- spdk/autotest.sh@373 -- # autotest_cleanup 00:35:04.042 19:21:20 -- common/autotest_common.sh@1381 -- # local autotest_es=0 00:35:04.042 19:21:20 -- common/autotest_common.sh@1382 -- # xtrace_disable 00:35:04.042 19:21:20 -- common/autotest_common.sh@10 -- # set +x 00:35:09.312 INFO: APP EXITING 00:35:09.312 INFO: killing all VMs 00:35:09.312 INFO: killing vhost app 00:35:09.312 INFO: EXIT DONE 00:35:11.207 0000:5e:00.0 (8086 0a54): Already using the nvme driver 00:35:11.207 0000:00:04.7 (8086 2021): Already using the ioatdma driver 00:35:11.207 0000:00:04.6 (8086 2021): Already using the ioatdma driver 00:35:11.207 0000:00:04.5 (8086 2021): Already using the ioatdma driver 00:35:11.207 0000:00:04.4 (8086 2021): Already using the ioatdma driver 00:35:11.207 0000:00:04.3 (8086 2021): Already using the ioatdma driver 00:35:11.207 0000:00:04.2 (8086 2021): Already using the ioatdma driver 00:35:11.207 0000:00:04.1 (8086 2021): Already using the ioatdma driver 00:35:11.207 0000:00:04.0 (8086 2021): Already using the ioatdma driver 00:35:11.207 0000:80:04.7 (8086 2021): Already using the ioatdma driver 00:35:11.207 0000:80:04.6 (8086 2021): Already using the ioatdma driver 00:35:11.207 0000:80:04.5 (8086 2021): Already using the ioatdma driver 00:35:11.207 0000:80:04.4 (8086 2021): Already using the ioatdma driver 00:35:11.207 0000:80:04.3 (8086 2021): Already using the ioatdma driver 00:35:11.207 0000:80:04.2 (8086 2021): Already using the ioatdma driver 00:35:11.207 0000:80:04.1 (8086 2021): Already using the ioatdma driver 00:35:11.465 0000:80:04.0 (8086 2021): Already using the ioatdma driver 00:35:13.990 Cleaning 00:35:13.990 Removing: /var/run/dpdk/spdk0/config 00:35:13.990 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-0 00:35:13.990 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-1 00:35:13.990 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-2 00:35:13.990 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-3 00:35:13.990 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-0 00:35:13.990 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-1 00:35:13.990 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-2 00:35:13.990 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-3 00:35:13.990 Removing: /var/run/dpdk/spdk0/fbarray_memzone 00:35:13.990 Removing: /var/run/dpdk/spdk0/hugepage_info 00:35:13.990 Removing: /var/run/dpdk/spdk1/config 00:35:13.990 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-0 00:35:13.990 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-1 00:35:13.990 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-2 00:35:13.990 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-3 00:35:13.990 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-0 00:35:14.248 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-1 00:35:14.248 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-2 00:35:14.248 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-3 00:35:14.248 Removing: /var/run/dpdk/spdk1/fbarray_memzone 00:35:14.248 Removing: /var/run/dpdk/spdk1/hugepage_info 00:35:14.248 Removing: /var/run/dpdk/spdk1/mp_socket 00:35:14.248 Removing: /var/run/dpdk/spdk2/config 00:35:14.248 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-0 00:35:14.248 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-1 00:35:14.248 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-2 00:35:14.248 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-3 00:35:14.248 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-0 00:35:14.248 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-1 00:35:14.248 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-2 00:35:14.248 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-3 00:35:14.248 Removing: /var/run/dpdk/spdk2/fbarray_memzone 00:35:14.248 Removing: /var/run/dpdk/spdk2/hugepage_info 00:35:14.248 Removing: /var/run/dpdk/spdk3/config 00:35:14.248 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-0 00:35:14.248 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-1 00:35:14.248 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-2 00:35:14.248 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-3 00:35:14.248 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-0 00:35:14.248 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-1 00:35:14.248 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-2 00:35:14.248 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-3 00:35:14.248 Removing: /var/run/dpdk/spdk3/fbarray_memzone 00:35:14.248 Removing: /var/run/dpdk/spdk3/hugepage_info 00:35:14.248 Removing: /var/run/dpdk/spdk4/config 00:35:14.248 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-0 00:35:14.248 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-1 00:35:14.248 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-2 00:35:14.248 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-3 00:35:14.248 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-0 00:35:14.248 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-1 00:35:14.248 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-2 00:35:14.248 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-3 00:35:14.248 Removing: /var/run/dpdk/spdk4/fbarray_memzone 00:35:14.248 Removing: /var/run/dpdk/spdk4/hugepage_info 00:35:14.248 Removing: /dev/shm/bdev_svc_trace.1 00:35:14.248 Removing: /dev/shm/nvmf_trace.0 00:35:14.248 Removing: /dev/shm/spdk_tgt_trace.pid2920999 00:35:14.248 Removing: /var/run/dpdk/spdk0 00:35:14.248 Removing: /var/run/dpdk/spdk1 00:35:14.248 Removing: /var/run/dpdk/spdk2 00:35:14.248 Removing: /var/run/dpdk/spdk3 00:35:14.248 Removing: /var/run/dpdk/spdk4 00:35:14.248 Removing: /var/run/dpdk/spdk_pid2918843 00:35:14.248 Removing: /var/run/dpdk/spdk_pid2919918 00:35:14.248 Removing: /var/run/dpdk/spdk_pid2920999 00:35:14.248 Removing: /var/run/dpdk/spdk_pid2921685 00:35:14.248 Removing: /var/run/dpdk/spdk_pid2923215 00:35:14.248 Removing: /var/run/dpdk/spdk_pid2924502 00:35:14.248 Removing: /var/run/dpdk/spdk_pid2924798 00:35:14.248 Removing: /var/run/dpdk/spdk_pid2925093 00:35:14.248 Removing: /var/run/dpdk/spdk_pid2925408 00:35:14.248 Removing: /var/run/dpdk/spdk_pid2925795 00:35:14.248 Removing: /var/run/dpdk/spdk_pid2925967 00:35:14.249 Removing: /var/run/dpdk/spdk_pid2926212 00:35:14.249 Removing: /var/run/dpdk/spdk_pid2926493 00:35:14.249 Removing: /var/run/dpdk/spdk_pid2927259 00:35:14.249 Removing: /var/run/dpdk/spdk_pid2930296 00:35:14.249 Removing: /var/run/dpdk/spdk_pid2930643 00:35:14.249 Removing: /var/run/dpdk/spdk_pid2930942 00:35:14.249 Removing: /var/run/dpdk/spdk_pid2931049 00:35:14.249 Removing: /var/run/dpdk/spdk_pid2931550 00:35:14.249 Removing: /var/run/dpdk/spdk_pid2931786 00:35:14.507 Removing: /var/run/dpdk/spdk_pid2932063 00:35:14.507 Removing: /var/run/dpdk/spdk_pid2932299 00:35:14.507 Removing: /var/run/dpdk/spdk_pid2932557 00:35:14.507 Removing: /var/run/dpdk/spdk_pid2932770 00:35:14.507 Removing: /var/run/dpdk/spdk_pid2932856 00:35:14.507 Removing: /var/run/dpdk/spdk_pid2933069 00:35:14.507 Removing: /var/run/dpdk/spdk_pid2933631 00:35:14.507 Removing: /var/run/dpdk/spdk_pid2933840 00:35:14.507 Removing: /var/run/dpdk/spdk_pid2934170 00:35:14.507 Removing: /var/run/dpdk/spdk_pid2934402 00:35:14.507 Removing: /var/run/dpdk/spdk_pid2934477 00:35:14.507 Removing: /var/run/dpdk/spdk_pid2934533 00:35:14.507 Removing: /var/run/dpdk/spdk_pid2934768 00:35:14.507 Removing: /var/run/dpdk/spdk_pid2935015 00:35:14.507 Removing: /var/run/dpdk/spdk_pid2935255 00:35:14.507 Removing: /var/run/dpdk/spdk_pid2935508 00:35:14.507 Removing: /var/run/dpdk/spdk_pid2935745 00:35:14.507 Removing: /var/run/dpdk/spdk_pid2935999 00:35:14.507 Removing: /var/run/dpdk/spdk_pid2936231 00:35:14.507 Removing: /var/run/dpdk/spdk_pid2936481 00:35:14.507 Removing: /var/run/dpdk/spdk_pid2936698 00:35:14.507 Removing: /var/run/dpdk/spdk_pid2936919 00:35:14.507 Removing: /var/run/dpdk/spdk_pid2937097 00:35:14.507 Removing: /var/run/dpdk/spdk_pid2937295 00:35:14.507 Removing: /var/run/dpdk/spdk_pid2937481 00:35:14.507 Removing: /var/run/dpdk/spdk_pid2937727 00:35:14.507 Removing: /var/run/dpdk/spdk_pid2937963 00:35:14.507 Removing: /var/run/dpdk/spdk_pid2938211 00:35:14.507 Removing: /var/run/dpdk/spdk_pid2938451 00:35:14.507 Removing: /var/run/dpdk/spdk_pid2938698 00:35:14.507 Removing: /var/run/dpdk/spdk_pid2938932 00:35:14.507 Removing: /var/run/dpdk/spdk_pid2939181 00:35:14.507 Removing: /var/run/dpdk/spdk_pid2939420 00:35:14.507 Removing: /var/run/dpdk/spdk_pid2939669 00:35:14.507 Removing: /var/run/dpdk/spdk_pid2939901 00:35:14.507 Removing: /var/run/dpdk/spdk_pid2940150 00:35:14.507 Removing: /var/run/dpdk/spdk_pid2940390 00:35:14.507 Removing: /var/run/dpdk/spdk_pid2940608 00:35:14.507 Removing: /var/run/dpdk/spdk_pid2940791 00:35:14.507 Removing: /var/run/dpdk/spdk_pid2941002 00:35:14.507 Removing: /var/run/dpdk/spdk_pid2941183 00:35:14.507 Removing: /var/run/dpdk/spdk_pid2941409 00:35:14.507 Removing: /var/run/dpdk/spdk_pid2941634 00:35:14.507 Removing: /var/run/dpdk/spdk_pid2941887 00:35:14.507 Removing: /var/run/dpdk/spdk_pid2942124 00:35:14.507 Removing: /var/run/dpdk/spdk_pid2942375 00:35:14.507 Removing: /var/run/dpdk/spdk_pid2942615 00:35:14.507 Removing: /var/run/dpdk/spdk_pid2942871 00:35:14.507 Removing: /var/run/dpdk/spdk_pid2943103 00:35:14.507 Removing: /var/run/dpdk/spdk_pid2943352 00:35:14.507 Removing: /var/run/dpdk/spdk_pid2943598 00:35:14.507 Removing: /var/run/dpdk/spdk_pid2943849 00:35:14.507 Removing: /var/run/dpdk/spdk_pid2943926 00:35:14.507 Removing: /var/run/dpdk/spdk_pid2944220 00:35:14.507 Removing: /var/run/dpdk/spdk_pid2947905 00:35:14.507 Removing: /var/run/dpdk/spdk_pid3033109 00:35:14.507 Removing: /var/run/dpdk/spdk_pid3037387 00:35:14.507 Removing: /var/run/dpdk/spdk_pid3047507 00:35:14.507 Removing: /var/run/dpdk/spdk_pid3052962 00:35:14.507 Removing: /var/run/dpdk/spdk_pid3056839 00:35:14.507 Removing: /var/run/dpdk/spdk_pid3057468 00:35:14.507 Removing: /var/run/dpdk/spdk_pid3063522 00:35:14.507 Removing: /var/run/dpdk/spdk_pid3063527 00:35:14.507 Removing: /var/run/dpdk/spdk_pid3064456 00:35:14.507 Removing: /var/run/dpdk/spdk_pid3065383 00:35:14.507 Removing: /var/run/dpdk/spdk_pid3066278 00:35:14.507 Removing: /var/run/dpdk/spdk_pid3066793 00:35:14.507 Removing: /var/run/dpdk/spdk_pid3066795 00:35:14.764 Removing: /var/run/dpdk/spdk_pid3067034 00:35:14.764 Removing: /var/run/dpdk/spdk_pid3067264 00:35:14.764 Removing: /var/run/dpdk/spdk_pid3067266 00:35:14.764 Removing: /var/run/dpdk/spdk_pid3068201 00:35:14.764 Removing: /var/run/dpdk/spdk_pid3068930 00:35:14.764 Removing: /var/run/dpdk/spdk_pid3069841 00:35:14.765 Removing: /var/run/dpdk/spdk_pid3070458 00:35:14.765 Removing: /var/run/dpdk/spdk_pid3070532 00:35:14.765 Removing: /var/run/dpdk/spdk_pid3070772 00:35:14.765 Removing: /var/run/dpdk/spdk_pid3072080 00:35:14.765 Removing: /var/run/dpdk/spdk_pid3073181 00:35:14.765 Removing: /var/run/dpdk/spdk_pid3081996 00:35:14.765 Removing: /var/run/dpdk/spdk_pid3082421 00:35:14.765 Removing: /var/run/dpdk/spdk_pid3086545 00:35:14.765 Removing: /var/run/dpdk/spdk_pid3092451 00:35:14.765 Removing: /var/run/dpdk/spdk_pid3095100 00:35:14.765 Removing: /var/run/dpdk/spdk_pid3105393 00:35:14.765 Removing: /var/run/dpdk/spdk_pid3114579 00:35:14.765 Removing: /var/run/dpdk/spdk_pid3116231 00:35:14.765 Removing: /var/run/dpdk/spdk_pid3117164 00:35:14.765 Removing: /var/run/dpdk/spdk_pid3134437 00:35:14.765 Removing: /var/run/dpdk/spdk_pid3138244 00:35:14.765 Removing: /var/run/dpdk/spdk_pid3142562 00:35:14.765 Removing: /var/run/dpdk/spdk_pid3144290 00:35:14.765 Removing: /var/run/dpdk/spdk_pid3146185 00:35:14.765 Removing: /var/run/dpdk/spdk_pid3146352 00:35:14.765 Removing: /var/run/dpdk/spdk_pid3146553 00:35:14.765 Removing: /var/run/dpdk/spdk_pid3146795 00:35:14.765 Removing: /var/run/dpdk/spdk_pid3147539 00:35:14.765 Removing: /var/run/dpdk/spdk_pid3149409 00:35:14.765 Removing: /var/run/dpdk/spdk_pid3150414 00:35:14.765 Removing: /var/run/dpdk/spdk_pid3150923 00:35:14.765 Removing: /var/run/dpdk/spdk_pid3156385 00:35:14.765 Removing: /var/run/dpdk/spdk_pid3162020 00:35:14.765 Removing: /var/run/dpdk/spdk_pid3167429 00:35:14.765 Removing: /var/run/dpdk/spdk_pid3203850 00:35:14.765 Removing: /var/run/dpdk/spdk_pid3208013 00:35:14.765 Removing: /var/run/dpdk/spdk_pid3214062 00:35:14.765 Removing: /var/run/dpdk/spdk_pid3215391 00:35:14.765 Removing: /var/run/dpdk/spdk_pid3216953 00:35:14.765 Removing: /var/run/dpdk/spdk_pid3221079 00:35:14.765 Removing: /var/run/dpdk/spdk_pid3225266 00:35:14.765 Removing: /var/run/dpdk/spdk_pid3232750 00:35:14.765 Removing: /var/run/dpdk/spdk_pid3232755 00:35:14.765 Removing: /var/run/dpdk/spdk_pid3237507 00:35:14.765 Removing: /var/run/dpdk/spdk_pid3237737 00:35:14.765 Removing: /var/run/dpdk/spdk_pid3237933 00:35:14.765 Removing: /var/run/dpdk/spdk_pid3238268 00:35:14.765 Removing: /var/run/dpdk/spdk_pid3238375 00:35:14.765 Removing: /var/run/dpdk/spdk_pid3239692 00:35:14.765 Removing: /var/run/dpdk/spdk_pid3241476 00:35:14.765 Removing: /var/run/dpdk/spdk_pid3243164 00:35:14.765 Removing: /var/run/dpdk/spdk_pid3244792 00:35:14.765 Removing: /var/run/dpdk/spdk_pid3246727 00:35:14.765 Removing: /var/run/dpdk/spdk_pid3248601 00:35:14.765 Removing: /var/run/dpdk/spdk_pid3255911 00:35:14.765 Removing: /var/run/dpdk/spdk_pid3256442 00:35:14.765 Removing: /var/run/dpdk/spdk_pid3258192 00:35:14.765 Removing: /var/run/dpdk/spdk_pid3259143 00:35:14.765 Removing: /var/run/dpdk/spdk_pid3265129 00:35:14.765 Removing: /var/run/dpdk/spdk_pid3267927 00:35:14.765 Removing: /var/run/dpdk/spdk_pid3273383 00:35:14.765 Removing: /var/run/dpdk/spdk_pid3279209 00:35:14.765 Removing: /var/run/dpdk/spdk_pid3284746 00:35:14.765 Removing: /var/run/dpdk/spdk_pid3285416 00:35:14.765 Removing: /var/run/dpdk/spdk_pid3285902 00:35:14.765 Removing: /var/run/dpdk/spdk_pid3286384 00:35:14.765 Removing: /var/run/dpdk/spdk_pid3287132 00:35:15.023 Removing: /var/run/dpdk/spdk_pid3287832 00:35:15.023 Removing: /var/run/dpdk/spdk_pid3288383 00:35:15.023 Removing: /var/run/dpdk/spdk_pid3289039 00:35:15.023 Removing: /var/run/dpdk/spdk_pid3293666 00:35:15.023 Removing: /var/run/dpdk/spdk_pid3294184 00:35:15.023 Removing: /var/run/dpdk/spdk_pid3300967 00:35:15.023 Removing: /var/run/dpdk/spdk_pid3301133 00:35:15.023 Removing: /var/run/dpdk/spdk_pid3303405 00:35:15.023 Removing: /var/run/dpdk/spdk_pid3311000 00:35:15.023 Removing: /var/run/dpdk/spdk_pid3311079 00:35:15.023 Removing: /var/run/dpdk/spdk_pid3316076 00:35:15.023 Removing: /var/run/dpdk/spdk_pid3318012 00:35:15.023 Removing: /var/run/dpdk/spdk_pid3320201 00:35:15.023 Removing: /var/run/dpdk/spdk_pid3321364 00:35:15.023 Removing: /var/run/dpdk/spdk_pid3323473 00:35:15.023 Removing: /var/run/dpdk/spdk_pid3324578 00:35:15.023 Removing: /var/run/dpdk/spdk_pid3333426 00:35:15.023 Removing: /var/run/dpdk/spdk_pid3333895 00:35:15.023 Removing: /var/run/dpdk/spdk_pid3334495 00:35:15.023 Removing: /var/run/dpdk/spdk_pid3336960 00:35:15.023 Removing: /var/run/dpdk/spdk_pid3337760 00:35:15.023 Removing: /var/run/dpdk/spdk_pid3338343 00:35:15.023 Clean 00:35:15.023 killing process with pid 2873504 00:35:23.129 killing process with pid 2873501 00:35:23.129 killing process with pid 2873503 00:35:23.129 killing process with pid 2873502 00:35:23.129 19:21:39 -- common/autotest_common.sh@1446 -- # return 0 00:35:23.129 19:21:39 -- spdk/autotest.sh@374 -- # timing_exit post_cleanup 00:35:23.129 19:21:39 -- common/autotest_common.sh@728 -- # xtrace_disable 00:35:23.129 19:21:39 -- common/autotest_common.sh@10 -- # set +x 00:35:23.129 19:21:39 -- spdk/autotest.sh@376 -- # timing_exit autotest 00:35:23.129 19:21:39 -- common/autotest_common.sh@728 -- # xtrace_disable 00:35:23.129 19:21:39 -- common/autotest_common.sh@10 -- # set +x 00:35:23.129 19:21:39 -- spdk/autotest.sh@377 -- # chmod a+r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:35:23.129 19:21:39 -- spdk/autotest.sh@379 -- # [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log ]] 00:35:23.129 19:21:39 -- spdk/autotest.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log 00:35:23.129 19:21:39 -- spdk/autotest.sh@381 -- # [[ y == y ]] 00:35:23.129 19:21:39 -- spdk/autotest.sh@383 -- # hostname 00:35:23.130 19:21:39 -- spdk/autotest.sh@383 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -t spdk-wfp-08 -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info 00:35:23.388 geninfo: WARNING: invalid characters removed from testname! 00:35:45.421 19:21:59 -- spdk/autotest.sh@384 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:35:45.421 19:22:01 -- spdk/autotest.sh@385 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/dpdk/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:35:46.797 19:22:03 -- spdk/autotest.sh@389 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info --ignore-errors unused,unused '/usr/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:35:48.700 19:22:05 -- spdk/autotest.sh@390 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/examples/vmd/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:35:50.076 19:22:06 -- spdk/autotest.sh@391 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_lspci/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:35:51.978 19:22:08 -- spdk/autotest.sh@392 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_top/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:35:53.876 19:22:10 -- spdk/autotest.sh@393 -- # rm -f cov_base.info cov_test.info OLD_STDOUT OLD_STDERR 00:35:53.876 19:22:10 -- common/autotest_common.sh@1689 -- $ [[ y == y ]] 00:35:53.877 19:22:10 -- common/autotest_common.sh@1690 -- $ lcov --version 00:35:53.877 19:22:10 -- common/autotest_common.sh@1690 -- $ awk '{print $NF}' 00:35:53.877 19:22:10 -- common/autotest_common.sh@1690 -- $ lt 1.15 2 00:35:53.877 19:22:10 -- scripts/common.sh@372 -- $ cmp_versions 1.15 '<' 2 00:35:53.877 19:22:10 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:35:53.877 19:22:10 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:35:53.877 19:22:10 -- scripts/common.sh@335 -- $ IFS=.-: 00:35:53.877 19:22:10 -- scripts/common.sh@335 -- $ read -ra ver1 00:35:53.877 19:22:10 -- scripts/common.sh@336 -- $ IFS=.-: 00:35:53.877 19:22:10 -- scripts/common.sh@336 -- $ read -ra ver2 00:35:53.877 19:22:10 -- scripts/common.sh@337 -- $ local 'op=<' 00:35:53.877 19:22:10 -- scripts/common.sh@339 -- $ ver1_l=2 00:35:53.877 19:22:10 -- scripts/common.sh@340 -- $ ver2_l=1 00:35:53.877 19:22:10 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:35:53.877 19:22:10 -- scripts/common.sh@343 -- $ case "$op" in 00:35:53.877 19:22:10 -- scripts/common.sh@344 -- $ : 1 00:35:53.877 19:22:10 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:35:53.877 19:22:10 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:35:53.877 19:22:10 -- scripts/common.sh@364 -- $ decimal 1 00:35:53.877 19:22:10 -- scripts/common.sh@352 -- $ local d=1 00:35:53.877 19:22:10 -- scripts/common.sh@353 -- $ [[ 1 =~ ^[0-9]+$ ]] 00:35:53.877 19:22:10 -- scripts/common.sh@354 -- $ echo 1 00:35:53.877 19:22:10 -- scripts/common.sh@364 -- $ ver1[v]=1 00:35:53.877 19:22:10 -- scripts/common.sh@365 -- $ decimal 2 00:35:53.877 19:22:10 -- scripts/common.sh@352 -- $ local d=2 00:35:53.877 19:22:10 -- scripts/common.sh@353 -- $ [[ 2 =~ ^[0-9]+$ ]] 00:35:53.877 19:22:10 -- scripts/common.sh@354 -- $ echo 2 00:35:53.877 19:22:10 -- scripts/common.sh@365 -- $ ver2[v]=2 00:35:53.877 19:22:10 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:35:53.877 19:22:10 -- scripts/common.sh@367 -- $ (( ver1[v] < ver2[v] )) 00:35:53.877 19:22:10 -- scripts/common.sh@367 -- $ return 0 00:35:53.877 19:22:10 -- common/autotest_common.sh@1691 -- $ lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:35:53.877 19:22:10 -- common/autotest_common.sh@1703 -- $ export 'LCOV_OPTS= 00:35:53.877 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:35:53.877 --rc genhtml_branch_coverage=1 00:35:53.877 --rc genhtml_function_coverage=1 00:35:53.877 --rc genhtml_legend=1 00:35:53.877 --rc geninfo_all_blocks=1 00:35:53.877 --rc geninfo_unexecuted_blocks=1 00:35:53.877 00:35:53.877 ' 00:35:53.877 19:22:10 -- common/autotest_common.sh@1703 -- $ LCOV_OPTS=' 00:35:53.877 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:35:53.877 --rc genhtml_branch_coverage=1 00:35:53.877 --rc genhtml_function_coverage=1 00:35:53.877 --rc genhtml_legend=1 00:35:53.877 --rc geninfo_all_blocks=1 00:35:53.877 --rc geninfo_unexecuted_blocks=1 00:35:53.877 00:35:53.877 ' 00:35:53.877 19:22:10 -- common/autotest_common.sh@1704 -- $ export 'LCOV=lcov 00:35:53.877 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:35:53.877 --rc genhtml_branch_coverage=1 00:35:53.877 --rc genhtml_function_coverage=1 00:35:53.877 --rc genhtml_legend=1 00:35:53.877 --rc geninfo_all_blocks=1 00:35:53.877 --rc geninfo_unexecuted_blocks=1 00:35:53.877 00:35:53.877 ' 00:35:53.877 19:22:10 -- common/autotest_common.sh@1704 -- $ LCOV='lcov 00:35:53.877 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:35:53.877 --rc genhtml_branch_coverage=1 00:35:53.877 --rc genhtml_function_coverage=1 00:35:53.877 --rc genhtml_legend=1 00:35:53.877 --rc geninfo_all_blocks=1 00:35:53.877 --rc geninfo_unexecuted_blocks=1 00:35:53.877 00:35:53.877 ' 00:35:53.877 19:22:10 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:35:53.877 19:22:10 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:35:53.877 19:22:10 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:35:53.877 19:22:10 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:35:53.877 19:22:10 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:35:53.877 19:22:10 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:35:53.877 19:22:10 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:35:53.877 19:22:10 -- paths/export.sh@5 -- $ export PATH 00:35:53.877 19:22:10 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:35:53.877 19:22:10 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:35:53.877 19:22:10 -- common/autobuild_common.sh@440 -- $ date +%s 00:35:53.877 19:22:10 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1732645330.XXXXXX 00:35:53.877 19:22:10 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1732645330.oDw4WI 00:35:53.877 19:22:10 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:35:53.877 19:22:10 -- common/autobuild_common.sh@446 -- $ '[' -n v22.11.4 ']' 00:35:53.877 19:22:10 -- common/autobuild_common.sh@447 -- $ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:35:53.877 19:22:10 -- common/autobuild_common.sh@447 -- $ scanbuild_exclude=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk' 00:35:53.877 19:22:10 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:35:53.877 19:22:10 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:35:53.877 19:22:10 -- common/autobuild_common.sh@456 -- $ get_config_params 00:35:53.877 19:22:10 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:35:53.877 19:22:10 -- common/autotest_common.sh@10 -- $ set +x 00:35:53.877 19:22:10 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-vfio-user --with-dpdk=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build' 00:35:53.877 19:22:10 -- spdk/autopackage.sh@10 -- $ MAKEFLAGS=-j96 00:35:53.877 19:22:10 -- spdk/autopackage.sh@11 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:35:53.877 19:22:10 -- spdk/autopackage.sh@13 -- $ [[ 0 -eq 1 ]] 00:35:53.877 19:22:10 -- spdk/autopackage.sh@18 -- $ [[ 1 -eq 0 ]] 00:35:53.877 19:22:10 -- spdk/autopackage.sh@18 -- $ [[ 0 -eq 0 ]] 00:35:53.877 19:22:10 -- spdk/autopackage.sh@19 -- $ timing_finish 00:35:53.877 19:22:10 -- common/autotest_common.sh@734 -- $ flamegraph=/usr/local/FlameGraph/flamegraph.pl 00:35:53.877 19:22:10 -- common/autotest_common.sh@735 -- $ '[' -x /usr/local/FlameGraph/flamegraph.pl ']' 00:35:53.877 19:22:10 -- common/autotest_common.sh@737 -- $ /usr/local/FlameGraph/flamegraph.pl --title 'Build Timing' --nametype Step: --countname seconds /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:35:53.877 19:22:10 -- spdk/autopackage.sh@20 -- $ exit 0 00:35:53.877 + [[ -n 2818983 ]] 00:35:53.877 + sudo kill 2818983 00:35:53.886 [Pipeline] } 00:35:53.903 [Pipeline] // stage 00:35:53.908 [Pipeline] } 00:35:53.921 [Pipeline] // timeout 00:35:53.925 [Pipeline] } 00:35:53.939 [Pipeline] // catchError 00:35:53.946 [Pipeline] } 00:35:53.961 [Pipeline] // wrap 00:35:53.966 [Pipeline] } 00:35:53.981 [Pipeline] // catchError 00:35:53.989 [Pipeline] stage 00:35:53.991 [Pipeline] { (Epilogue) 00:35:54.003 [Pipeline] catchError 00:35:54.004 [Pipeline] { 00:35:54.016 [Pipeline] echo 00:35:54.017 Cleanup processes 00:35:54.022 [Pipeline] sh 00:35:54.305 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:35:54.305 3351782 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:35:54.318 [Pipeline] sh 00:35:54.600 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:35:54.600 ++ grep -v 'sudo pgrep' 00:35:54.600 ++ awk '{print $1}' 00:35:54.600 + sudo kill -9 00:35:54.600 + true 00:35:54.613 [Pipeline] sh 00:35:54.896 + jbp/jenkins/jjb-config/jobs/scripts/compress_artifacts.sh 00:36:04.879 [Pipeline] sh 00:36:05.159 + jbp/jenkins/jjb-config/jobs/scripts/check_artifacts_size.sh 00:36:05.159 Artifacts sizes are good 00:36:05.174 [Pipeline] archiveArtifacts 00:36:05.181 Archiving artifacts 00:36:05.331 [Pipeline] sh 00:36:05.619 + sudo chown -R sys_sgci: /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:36:05.635 [Pipeline] cleanWs 00:36:05.645 [WS-CLEANUP] Deleting project workspace... 00:36:05.645 [WS-CLEANUP] Deferred wipeout is used... 00:36:05.651 [WS-CLEANUP] done 00:36:05.653 [Pipeline] } 00:36:05.671 [Pipeline] // catchError 00:36:05.683 [Pipeline] sh 00:36:05.992 + logger -p user.info -t JENKINS-CI 00:36:06.027 [Pipeline] } 00:36:06.042 [Pipeline] // stage 00:36:06.047 [Pipeline] } 00:36:06.063 [Pipeline] // node 00:36:06.069 [Pipeline] End of Pipeline 00:36:06.110 Finished: SUCCESS